WO2020186481A1 - Fingerprint collection method and system, and electronic device - Google Patents

Fingerprint collection method and system, and electronic device Download PDF

Info

Publication number
WO2020186481A1
WO2020186481A1 PCT/CN2019/078889 CN2019078889W WO2020186481A1 WO 2020186481 A1 WO2020186481 A1 WO 2020186481A1 CN 2019078889 W CN2019078889 W CN 2019078889W WO 2020186481 A1 WO2020186481 A1 WO 2020186481A1
Authority
WO
WIPO (PCT)
Prior art keywords
fingerprint
module
display screen
display
frame
Prior art date
Application number
PCT/CN2019/078889
Other languages
French (fr)
Chinese (zh)
Inventor
李明采
王波
王兵
Original Assignee
深圳市汇顶科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市汇顶科技股份有限公司 filed Critical 深圳市汇顶科技股份有限公司
Priority to CN201980000489.3A priority Critical patent/CN110088769B/en
Priority to PCT/CN2019/078889 priority patent/WO2020186481A1/en
Publication of WO2020186481A1 publication Critical patent/WO2020186481A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/13—Sensors therefor
    • G06V40/1318—Sensors therefor using electro-optical elements or layers, e.g. electroluminescent sensing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12—Fingerprints or palmprints
    • G06V40/1365—Matching; Classification
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
    • G09G2340/0435—Change or adaptation of the frame rate of the video stream

Definitions

  • This application relates to the field of optical fingerprint technology, and more specifically, to a method, system, and electronic device for fingerprint collection.
  • the under-screen fingerprint technology has made the screen ratio to the extreme.
  • the optical fingerprint technology is particularly prominent in the under-screen fingerprint technology.
  • the fingerprint recognition module is placed under the display based on the self-luminous characteristics of the OLED display. When the finger is pressed on the display, the fingerprint recognition module Receiving the light signal reflected by the finger from the OLED light source for imaging, thereby collecting the image signal of the finger.
  • the display image is controlled by refreshing the display data at a certain frequency. If the fingerprint recognition module is just receiving the light signal to collect the fingerprint image while the OLED display is refreshing the display data, it will be due to the OLED display.
  • the change of refresh display data causes abrupt changes in the optical signal collected by the fingerprint recognition module, resulting in poor quality fingerprint images such as horizontal stripes, which affects the performance of the fingerprint collection system and brings a bad experience to users.
  • the embodiments of the present application provide a fingerprint collection method, system, and electronic device, which can improve the performance of the fingerprint collection system.
  • a fingerprint collection method which is applied to an electronic device having a display screen and a fingerprint recognition module, wherein the fingerprint recognition module is disposed under the display screen for receiving through the display
  • the optical signal of the display screen reflected or scattered by the human finger above the screen for fingerprint image collection includes:
  • Control the fingerprint identification module to collect the fingerprint image, wherein the collection time of the fingerprint image is within the display time range of the one frame image.
  • the technical solution of the present application controls the frame display time of the display screen so that the frame display time is not less than the time when the fingerprint recognition module collects fingerprint images, and the fingerprint image acquisition time is within the time of one frame of the display Within the display time range, therefore, it avoids the collection of fingerprint images when switching between frames of the display screen, thereby avoiding the collection of poor-quality fingerprint images such as horizontal stripes, and improving the quality of fingerprint images and fingerprint recognition performance.
  • the display screen and the fingerprint identification module are respectively driven by a display screen drive module and a fingerprint acquisition control module, and the method further includes: the display screen drive module is controlling the After the display screen displays the one frame of image for the first frame display time, it sends first indication information to the fingerprint collection control module;
  • the fingerprint collection control module receives the first indication information, and controls the fingerprint identification module to collect the fingerprint image based on the first indication information.
  • the method further includes: before the display screen driving module controls the display screen to display the one frame of the image at the first frame display time, comparing the original display screen The frame display time and the collection time of the fingerprint image, and based on the comparison result, the display screen is controlled to display the one frame of the image with the first frame display time.
  • the controlling the display screen to display the one frame of image at the first frame display time based on the comparison result includes:
  • the frame display time of the display screen is adjusted to the first frame display time.
  • the controlling the display screen to display the one frame of image at the first frame display time based on the comparison result includes:
  • the comparison result is that the original frame display time of the display screen is not less than the fingerprint image acquisition time, the frame display time of the display screen is not adjusted, and the first frame display time is the original frame display time.
  • the method further includes: before the display screen driving module compares the display time of the original frame of the display screen with the acquisition time of the fingerprint image, receiving the fingerprint acquisition control module to send Of the fingerprint image collection time.
  • the method further includes: the display screen driving module further compares the display time of the original frame of the display screen with the acquisition time of the fingerprint image, obtaining finger touch information, based on all The finger touch information acquires a preset collection time of the fingerprint image.
  • the method further includes: after the fingerprint acquisition control module controls the fingerprint identification module to acquire the fingerprint image, sending second instruction information to the display screen driving module;
  • the display screen driving module restores the frame display time of the display screen to the original frame display time according to the second instruction information.
  • the fingerprint collection control module includes a fingerprint service module, a fingerprint application module, and a fingerprint drive module, and the fingerprint collection control module receives the first indication information and bases it on the first indication information. Controlling the fingerprint identification module to collect the fingerprint image includes:
  • the fingerprint service module receives the first instruction information, and sends a notification message to the fingerprint application module, where the notification message is a message instructing to start fingerprint image collection;
  • the fingerprint application module receives the notification message and sends a control message to the fingerprint driving module, where the control message is a message for controlling the fingerprint driving module to collect fingerprint images;
  • the fingerprint driving module receives the control message to control the fingerprint identification module to collect the fingerprint image.
  • the method further includes: the fingerprint application module receives the fingerprint image, and performs fingerprint recognition on the fingerprint image to obtain a fingerprint recognition result.
  • the fingerprint identification system further includes a client application module, and the method further includes:
  • the fingerprint application module sends the fingerprint identification result to the fingerprint service module
  • the fingerprint service module sends the fingerprint identification result to the client application module.
  • the display screen driver module and the fingerprint driver module run in a rich execution environment REE and are located at the kernel layer;
  • the fingerprint service module runs in the rich execution environment REE and is located at the hardware abstraction HAL layer;
  • the fingerprint application module runs in the trusted execution environment TEE and is located at the trusted application TA layer.
  • a fingerprint collection system which is applied to an electronic device having a display screen and a fingerprint recognition module, wherein the fingerprint recognition module is arranged under the display screen for receiving The light signal of the display screen reflected or scattered by the human finger above the screen is used for fingerprint image collection.
  • the system includes: a display screen drive module and a fingerprint collection control module;
  • the display screen driving module is used to control the display screen to display a frame of image with the first frame display time during the fingerprint image collection period of the fingerprint identification module, and the first frame display time is not less than the fingerprint image collection time;
  • the fingerprint collection control module is configured to control the fingerprint identification module to collect the fingerprint image, wherein the collection time of the fingerprint image is within the display time range of the one frame image.
  • the display screen driving module is further configured to, after controlling the display screen to display the one frame of images for the first frame display time, send the first frame to the fingerprint collection control module.
  • the first indication information is used to instruct the fingerprint collection control module to control the fingerprint identification module to collect the fingerprint image.
  • the display screen driving module is further configured to compare the original frame display of the display screen before controlling the display screen to display the one frame of image at the first frame display time Time and the collection time of the fingerprint image, and based on the comparison result, the display screen is controlled to display the one frame of image with the first frame display time.
  • the display screen driving module is specifically configured to adjust the display screen's display time when the comparison result is that the original frame display time of the display screen is less than the fingerprint image acquisition time Frame display time to the first frame display time.
  • the display screen driving module is specifically configured to not adjust the display when the comparison result is that the display time of the original frame of the display screen is not less than the acquisition time of the fingerprint image
  • the frame display time of the screen, the first frame display time is the original frame display time.
  • the display screen drive module is further configured to receive all data sent by the fingerprint acquisition control module before comparing the display time of the original frame of the display screen with the acquisition time of the fingerprint image. State the collection time of the fingerprint image.
  • the display screen driving module is further configured to obtain finger touch information before comparing the display time of the original frame of the display screen with the acquisition time of the fingerprint image, based on the finger touch Information acquisition preset collection time of the fingerprint image.
  • the fingerprint acquisition control module is further configured to send second instruction information to the display screen driving module after controlling the fingerprint identification module to acquire the fingerprint image;
  • the display screen driving module is further configured to restore the frame display time of the display screen to the original frame display time according to the second instruction information.
  • the fingerprint collection control module includes a fingerprint service module, a fingerprint application module, and a fingerprint drive module;
  • the fingerprint service module is configured to receive the first instruction information and send a notification message to the fingerprint application module, where the notification message is a message instructing to start collecting the fingerprint image;
  • the fingerprint application module is configured to receive the notification message and send a control message to the fingerprint driving module, where the control message is a message for controlling the fingerprint driving module to collect the fingerprint image;
  • the fingerprint driving module is used for receiving the control message to control the fingerprint identification module to collect the fingerprint image.
  • the fingerprint application module is further configured to receive the fingerprint image, and perform fingerprint recognition on the fingerprint image to obtain a fingerprint recognition result.
  • system further includes a client application module
  • the fingerprint application module sends the fingerprint identification result to the fingerprint service module
  • the fingerprint service module sends the fingerprint identification result to the client application module.
  • the display screen driver module and the fingerprint driver module run in a rich execution environment REE and are located at the kernel layer;
  • the fingerprint service module runs in the rich execution environment REE and is located at the hardware abstraction HAL layer;
  • the fingerprint application module runs in the trusted execution environment TEE and is located at the trusted application TA layer.
  • an electronic device including a display screen, a fingerprint identification module, and a fingerprint identification system such as the second aspect or any possible implementation of the second aspect;
  • the fingerprint identification module is disposed under the display screen, and is used to receive the light signal of the display screen returned by the reflection or scattering of a human finger above the display screen for fingerprint image collection.
  • a chip in a fourth aspect, includes an input and output interface, at least one processor, at least one memory, and a bus.
  • the at least one memory is used to store instructions
  • the at least one processor is used to call Instructions to execute the method in the first aspect or any possible implementation of the first aspect.
  • a computer-readable medium for storing a computer program, and the computer program includes instructions for executing the above-mentioned first aspect or any possible implementation of the first aspect.
  • a computer program product including instructions is provided.
  • the computer runs the instructions of the computer program product, the computer executes the first aspect or any of the possible implementations of the first aspect. Fingerprint identification method.
  • the computer program product can run on the electronic device of the third aspect.
  • Fig. 1 is a schematic structural diagram of a terminal device to which an embodiment of the present application is applicable.
  • FIG. 2 is a schematic diagram of the screen display timing and the fingerprint image collection timing of the fingerprint identification module in an embodiment of the present application.
  • Fig. 3 is a schematic flowchart of a fingerprint collection method according to an embodiment of the present application.
  • Fig. 4 is a schematic flowchart of another fingerprint collection method according to an embodiment of the present application.
  • FIG. 5 is a schematic diagram of another screen display timing and fingerprint image collection timing of the fingerprint identification module in an embodiment of the present application.
  • FIG. 6 is a schematic diagram of another screen display timing and fingerprint image collection timing of the fingerprint identification module in an embodiment of the present application.
  • Fig. 7 is a schematic flowchart of another fingerprint collection method according to an embodiment of the present application.
  • FIG. 8 is a schematic diagram of another screen display timing and fingerprint image collection timing of the fingerprint identification module in an embodiment of the present application.
  • Fig. 9 is a schematic flowchart of another fingerprint collection method according to an embodiment of the present application.
  • Fig. 10 is a schematic flowchart of another fingerprint collection method according to an embodiment of the present application.
  • Fig. 11 is a schematic block diagram of a fingerprint collection system according to an embodiment of the present application.
  • Fig. 12 is a schematic block diagram of another fingerprint collection system according to an embodiment of the present application.
  • Fig. 13 is a diagram of the positional relationship of various modules in the fingerprint collection system according to an embodiment of the present application.
  • Fig. 14 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
  • optical fingerprint systems including but not limited to optical fingerprint identification systems and products based on optical fingerprint imaging.
  • the embodiments of this application only take optical fingerprint systems as an example for illustration, but should not be implemented in this application.
  • the examples constitute any limitation, and the examples of this application are also applicable to other systems that use optical imaging technology.
  • the optical fingerprint system provided in the embodiments of this application can be applied to smart phones, tablet computers, and other mobile terminals with display screens or other terminal devices; more specifically, in the above-mentioned terminal devices, fingerprint identification
  • the module can be arranged in a partial area or the entire area under the display screen to form an under-display optical fingerprint system.
  • the fingerprint identification device can also be partially or fully integrated into the display screen of the terminal device, thereby forming an in-display optical fingerprint system.
  • FIG. 1 is a schematic structural diagram of a terminal device to which the embodiment of the application can be applied.
  • the terminal device 10 includes a display screen 120 and a fingerprint identification module 130, wherein the fingerprint identification module 130 is provided on the display screen. Partial area below 120.
  • the fingerprint recognition module 130 includes an optical fingerprint sensor, and the optical fingerprint sensor includes a sensing array 133 having a plurality of optical sensing units 131.
  • the sensing array 133 is located or its sensing area is the fingerprint recognition module 130 Fingerprint detection area 103. As shown in FIG. 1, the fingerprint detection area 103 is located in the display area of the display screen 120.
  • the fingerprint recognition module 130 can also be arranged in other positions, such as the side of the display screen 120 or the non-transparent area of the edge of the terminal device 10, and the optical path design is used to design the The optical signal of at least a part of the display area of the display screen 120 is guided to the fingerprint identification module 130 so that the fingerprint detection area 103 is actually located in the display area of the display screen 120.
  • the area of the fingerprint detection area 103 may be different from the area of the sensing array of the fingerprint recognition module 130, for example, through a light path design such as lens imaging, a reflective folding light path design, or other light convergence or reflection light path designs.
  • the area of the fingerprint detection area 103 of the fingerprint identification module 130 can be made larger than the area of the sensing array of the fingerprint identification module 130.
  • the fingerprint detection area 103 of the fingerprint identification module 130 may also be designed to be substantially the same as the area of the sensing array of the fingerprint identification module 130.
  • the terminal device 10 adopting the above structure does not need to reserve a space on the front side for the fingerprint button (such as the Home button), so that a full screen solution can be adopted, that is, the display area of the display screen 120 It can be basically extended to the front of the entire terminal device 10.
  • the fingerprint recognition module 130 includes a light detection part 134 and an optical component 132.
  • the light detection part 134 includes the sensor array and is electrically connected to the sensor array.
  • the read circuit and other auxiliary circuits that are sexually connected can be fabricated on a chip (Die) by a semiconductor process, such as an optical imaging chip or an optical fingerprint sensor.
  • the sensing array is specifically a photodetector (Photodetector) array.
  • the photodetectors can be used as the above-mentioned optical sensing unit; the optical component 132 can be arranged above the sensing array of the photodetecting part 134, which can be specifically Including a filter layer (Filter), a light guide layer or light path guide structure and other optical elements, the filter layer can be used to filter out the ambient light penetrating the finger, and the light guide layer or light path guide structure is mainly used The reflected light reflected from the finger surface is guided to the sensing array for optical inspection.
  • the filter layer Filter
  • the filter layer can be used to filter out the ambient light penetrating the finger
  • the light guide layer or light path guide structure is mainly used The reflected light reflected from the finger surface is guided to the sensing array for optical inspection.
  • the optical assembly 132 and the light detecting part 134 may be packaged in the same optical fingerprint component.
  • the optical component 132 and the optical detection part 134 can be packaged in the same optical fingerprint chip, or the optical component 132 can be arranged outside the chip where the optical detection part 134 is located, for example, the optical component 132 is attached above the chip, or some components of the optical assembly 132 are integrated into the chip.
  • the light guide layer or light path guiding structure of the optical component 132 has multiple implementation schemes.
  • the light guide layer may specifically be a collimator layer made on a semiconductor silicon wafer, which has multiple A collimating unit or a micro-hole array.
  • the collimating unit can be specifically a small hole.
  • the reflected light reflected from the finger the light that is perpendicularly incident on the collimating unit can pass through and be passed by the optical sensing unit below it.
  • the light with an excessively large incident angle is attenuated by multiple reflections inside the collimating unit. Therefore, each optical sensing unit can basically only receive the reflected light reflected by the fingerprint pattern directly above it.
  • the sensor array can detect the fingerprint image of the finger.
  • the light guide layer or the light path guide structure may also be an optical lens (Lens) layer, which has one or more lens units, such as a lens group composed of one or more aspheric lenses, which The sensing array used to converge the reflected light reflected from the finger to the light detection part 134 below it, so that the sensing array can perform imaging based on the reflected light, thereby obtaining a fingerprint image of the finger.
  • the optical lens layer may further have a pinhole formed in the optical path of the lens unit, and the pinhole may cooperate with the optical lens layer to expand the field of view of the fingerprint recognition module to improve the The fingerprint imaging effect of the fingerprint identification module 130.
  • the light guide layer or the light path guide structure may also specifically adopt a micro-lens (Micro-Lens) layer.
  • the micro-lens layer has a micro-lens array formed by a plurality of micro-lenses, which can be grown by semiconductors.
  • a process or other processes are formed above the sensing array of the light detecting part 134, and each microlens may correspond to one of the sensing units of the sensing array.
  • other optical film layers may be formed between the microlens layer and the sensing unit, such as a dielectric layer or a passivation layer.
  • the microlens layer and the sensing unit may also include The light-blocking layer of the micro-hole, wherein the micro-hole is formed between the corresponding micro-lens and the sensing unit, the light-blocking layer can block the optical interference between the adjacent micro-lens and the sensing unit, and make the sensing The light corresponding to the unit is condensed into the microhole through the microlens and is transmitted to the sensing unit through the microhole to perform optical fingerprint imaging.
  • a microlens layer can be further provided under the collimator layer or the optical lens layer.
  • the collimator layer or the optical lens layer is used in combination with the micro lens layer, its specific laminated structure or optical path may need to be adjusted according to actual needs.
  • the display screen 120 may be a display screen with a self-luminous display unit, such as an OLED display screen or a micro-LED (Micro-LED) display screen.
  • the fingerprint identification module 130 can use the display unit (ie, an OLED light source) of the OLED display screen 120 located in the fingerprint detection area 103 as an excitation light source for optical fingerprint detection.
  • the display screen 120 emits a beam of light 111 to the target finger 140 above the fingerprint detection area 103.
  • the light 111 is reflected on the surface of the finger 140 to form reflected light or pass through all the fingers.
  • the finger 140 scatters to form scattered light.
  • the above-mentioned reflected light and scattered light are collectively referred to as reflected light. Since the ridge and valley of the fingerprint have different light reflection capabilities, the reflected light 151 from the fingerprint ridge and the reflected light 152 from the fingerprint ridge have different light intensities. After the reflected light passes through the optical component 132, It is received by the sensor array 134 in the fingerprint identification module 130 and converted into a corresponding electrical signal, that is, a fingerprint detection signal; based on the fingerprint detection signal, fingerprint image data can be obtained, and fingerprint matching verification can be further performed, thereby The terminal device 10 realizes the optical fingerprint recognition function.
  • the fingerprint identification module 130 may also use a built-in light source or an external light source to provide an optical signal for fingerprint detection.
  • the fingerprint identification module 130 may be suitable for non-self-luminous display screens, such as liquid crystal display screens or other passively-luminous display screens.
  • the optical fingerprint system of the terminal device 10 may also include an excitation light source for optical fingerprint detection.
  • the excitation light source may specifically be an infrared light source or a light source of invisible light of a specific wavelength, which may be arranged under the backlight module of the liquid crystal display or arranged in the edge area under the protective cover of the terminal device 10, and the
  • the fingerprint identification module 130 can be arranged under the edge area of the liquid crystal panel or the protective cover and guided by the light path so that the fingerprint detection light can reach the fingerprint identification module 130; or, the fingerprint identification module 130 can also be arranged at all Below the backlight module, and the backlight module is designed to allow the fingerprint detection light to pass through the liquid crystal panel and the backlight module and reach the fingerprint by perforating film layers such as diffuser, brightness enhancement film, and reflective film or other optical designs Identification module 130.
  • the fingerprint identification module 130 adopts a built-in light source or an external light source to provide an optical signal for fingerprint detection, the detection principle is the same as that described above.
  • the terminal device 10 further includes a transparent protective cover, and the cover may be a glass cover or a sapphire cover, which is located above the display screen 120 and covers the terminal.
  • the front of the device 10. because, in the embodiment of the present application, the so-called finger pressing on the display screen 120 actually refers to pressing on the cover plate above the display screen 120 or covering the surface of the protective layer of the cover plate.
  • the fingerprint recognition module 130 may only include an optical fingerprint sensor.
  • the fingerprint detection area 103 of the fingerprint recognition module 130 has a small area and a fixed position, so the user is performing During fingerprint input, it is necessary to press the finger to a specific position of the fingerprint detection area 103, otherwise the fingerprint recognition module 130 may not be able to collect the fingerprint image, resulting in poor user experience.
  • the fingerprint recognition module 130 may specifically include a plurality of optical fingerprint sensors; the plurality of optical fingerprint sensors may be arranged side by side under the display screen 120 in a splicing manner, and the plurality of The sensing area of the optical fingerprint sensor collectively constitutes the fingerprint detection area 103 of the fingerprint identification module 130.
  • the fingerprint detection area 103 of the fingerprint recognition module 130 may include multiple sub-areas, and each sub-area corresponds to the sensing area of one of the optical fingerprint sensors, so that the fingerprint of the fingerprint recognition module 130 is collected
  • the area 103 can be expanded to the main area of the lower half of the display screen, that is, to the area where the finger is habitually pressed, so as to realize the blind fingerprint input operation.
  • the fingerprint detection area 130 can also be extended to half of the display area or even the entire display area, thereby realizing half-screen or full-screen fingerprint detection.
  • the sensing array in the fingerprint recognition module may also be referred to as a pixel array
  • the optical sensing unit or sensing unit in the sensing array may also be referred to as a pixel unit.
  • the fingerprint identification module in the embodiments of the present application may also be referred to as an optical fingerprint identification module, a fingerprint identification device, a fingerprint module, a fingerprint acquisition device, etc., and the above terms can be replaced with each other.
  • the fingerprint recognition module uses an OLED light source as the excitation light source for optical fingerprint detection.
  • the fingerprint light signal after the OLED light source is reflected by the finger is received and processed by the light detection part of the fingerprint recognition module.
  • the time when the sensor array in the light detection part receives the fingerprint light signal and converts the fingerprint light signal into an electrical signal is the fingerprint image collection time.
  • the sensor array is a photodiode (PD) array.
  • PD photodiode
  • the photodiode array starts to receive the fingerprint light signal and converts the fingerprint light signal into an electrical signal.
  • the driving voltage is stopped, the photodiode array stops converting the electrical signal.
  • the duration of the driving voltage Is the collection time of the fingerprint image.
  • the light-emitting unit of the OLED display screen is an organic polymer light-emitting diode, and a pixel of a monochrome screen is a light-emitting diode, and multiple pixels form a pixel array.
  • a pixel of a monochrome screen is a light-emitting diode, and multiple pixels form a pixel array.
  • To light up a pixel just apply a positive voltage to the column electrode where the pixel is located, and the row electrode is grounded.
  • the row drive circuit sequentially generates low-level scanning of each row of the pixel array, and the column drive circuit reads the display data and sequentially loads it on the column electrodes of the pixel array. After completing a full-screen scan, it is called a frame.
  • Each frame displays an image on the screen, and different frames display different images, so as to realize the display of dynamic video on the screen.
  • the display time of each frame does not change.
  • the number of frames displayed on the screen per second that is, the number of images that appear per second, is called the screen refresh frequency, and the unit is Hertz (Hz).
  • the display time of each frame is between two frames.
  • the sum of the time intervals is equal to the inverse of the screen refresh frequency.
  • the fingerprint recognition module When the OLED display screen refreshes the image, if the fingerprint recognition module is collecting fingerprint images at this time, it will receive the fingerprint light signal from the OLED light source reflected by the finger, which will be affected by the sharply changing light source, for example, as shown in Figure 2. It shows that when the refresh frequency of the OLED screen is 30Hz and the fingerprint image acquisition time in the fingerprint recognition module acquisition sequence is 20ms, the sum of the image display time of each frame and the time interval between two adjacent frames is about 33.3ms. If the fingerprint recognition module collects the fingerprint light signal when the OLED screen is refreshed, it will be affected by the change of the light source, and horizontal stripes will appear on the fingerprint image, which will reduce the fingerprint recognition performance.
  • this application provides a fingerprint collection solution.
  • the frame display time of the display screen is controlled by the display drive module so that the frame display time is longer than the time for the fingerprint acquisition control module to control the fingerprint recognition module to collect fingerprint images.
  • the display screen does not refresh and display the same frame of image during the time when the fingerprint recognition module collects the fingerprint image. Therefore, the influence of light source changes on the fingerprint image when the display screen is refreshed is eliminated, the quality of the fingerprint image is improved, and the fingerprint recognition performance is improved.
  • the fingerprint collection process may be referred to as a fingerprint identification process, and the fingerprint collection process may also be referred to as a fingerprint identification process.
  • FIG. 3 is a schematic flowchart of a fingerprint collection method 200 according to an embodiment of the present application, which is applied to an electronic device having a display screen and a fingerprint recognition module, wherein the fingerprint recognition module is arranged under the display screen, It is used to receive the light signal of the display screen returned by the reflection or scattering of the human finger above the display screen for fingerprint image collection.
  • the method 200 includes:
  • S210 controlling the display screen to display a frame of image with the first frame display time during the fingerprint image collection period of the fingerprint identification module, and the first frame display time is not less than the fingerprint image collection time;
  • S220 Control the fingerprint identification module to collect the fingerprint image, wherein the collection time of the fingerprint image is within the display time range of the one frame image.
  • the electronic device may be the terminal device 10 in FIG. 1
  • the display screen may be the display screen 120 in FIG. 1
  • the fingerprint identification module may be the fingerprint identification module 130 in FIG. 1.
  • the fingerprint recognition system is a processing unit or the processing unit may include the fingerprint recognition system, the processing unit may be a processor or a controller of an electronic device, the display driving module and
  • the fingerprint collection control module may be a software module running on the processing unit to control a display screen and a fingerprint identification module on an electronic device.
  • the display screen driving module can also control the display screen to display multiple frames of images with the first frame of display time, and the fingerprint recognition module can collect images within the display time of one frame of the multiple frames of images.
  • the fingerprint recognition module can also collect multiple fingerprint images, and the time for each fingerprint image collection is within the display time of one frame of the multiple frames of images, which is not limited in the embodiment of the application .
  • FIG. 4 shows a schematic diagram of another fingerprint collection method 300 according to an embodiment of the present application. flow chart.
  • the method 300 includes:
  • the display screen driving module controls the display screen to display the one frame of image in the first frame display time
  • the display screen driving module sends first instruction information to the fingerprint collection control module
  • the fingerprint acquisition control module receives the first instruction information, and controls the fingerprint identification module to acquire the fingerprint image based on the first instruction information.
  • the display time of the first frame is T1
  • the collection time of the fingerprint image is S1, where S1 ⁇ T1.
  • the display screen will start to display a frame of image with the first frame display time at time t1, and the display screen driving module sends the first instruction information to the fingerprint collection control module at time t1.
  • the fingerprint collection control module starts to collect fingerprint images at time t1.
  • the display screen will start to display a frame of image at the first frame display time at time t1, and the display driving module will send the first instruction information to the fingerprint collector at time t2 after time t1
  • the moment when the fingerprint collection control module starts to collect the fingerprint image may also be another moment that satisfies the collection time of the fingerprint image within the display time range of the one frame of image.
  • the time when fingerprint image collection is started may be any time between t1 and t2.
  • the image display time of each frame is equal to that of adjacent two.
  • the sum of the time intervals between frames is about 16.7ms, and the frame display time of each frame is less than the fingerprint image collection time, the optical fingerprint device will inevitably be affected by the change of the light source, and horizontal stripes appear on the fingerprint image.
  • FIG. 7 is a schematic flowchart of another method 400 for fingerprint collection according to an embodiment of the present application. As shown in FIG. 7, the method 400 includes:
  • the display screen driving module compares the display time of the original frame of the display screen with the collection time of the fingerprint image.
  • the display screen driving module adjusts the frame display time of the display screen to the first frame display time.
  • the frame display time of the display screen corresponds to the screen refresh frequency
  • the sum of the frame display time of each frame and the time interval between two frames is equal to the reciprocal of the screen refresh frequency.
  • the display screen driving module can adjust the frame display time of the display screen to the first frame display time by adjusting the screen refresh frequency of the display screen.
  • the display screen driving module reduces the original screen refresh frequency of the display screen to obtain the first intermediate screen refresh frequency and the first intermediate screen refresh frequency.
  • An intermediate frame display time The display driving module compares the first intermediate frame display time with the fingerprint image acquisition time, and when the first intermediate frame display time is less than or equal to the fingerprint image acquisition time, Continue to reduce the refresh rate of the first middle screen to obtain the refresh rate of the second middle screen and the display time of the second middle frame and compare them with the fingerprint image acquisition time, continue in this way until the refresh rate of the first screen is reduced , The display time of the first frame is not less than the fingerprint image collection time.
  • the manner in which the display screen driving module reduces the screen refresh frequency of the display screen may be to reduce the current screen refresh frequency of the display screen by half. It should be understood that the way to reduce the screen refresh frequency of the display screen can also be the current screen refresh frequency minus the preset frequency value, until the first screen refresh frequency is obtained, the first frame display time is greater than the fingerprint image acquisition time, etc. . The embodiments of this application do not limit this.
  • the method 400 further includes:
  • the display screen driving module controls the display screen to display the one frame of image in the first frame display time.
  • the display screen driving module sends first instruction information to the fingerprint collection control module.
  • the fingerprint collection control module controls the fingerprint identification module to collect the fingerprint image based on the first indication information.
  • steps S440 to S460 are the same as the steps S310 to S330 in FIG. 4, and the specific implementation can refer to FIG. 4, which will not be repeated here.
  • the screen refresh frequency of the display screen is f2
  • the display time of the first frame is T2
  • the fingerprint image acquisition time is S2, where S2>T2 .
  • the display screen drive module compares the size of S2 and T2. Since S2>T2, the display screen drive module reduces the screen refresh frequency f2 to f2/2. At this time, the frame display time is T3, and the display screen driver The module compares the size of T3 and S2.
  • the display driving module sends the first instruction information to the fingerprint collection control module at time t3, and the fingerprint collection control module starts fingerprint image collection.
  • the method 400 further includes:
  • the display screen driving module receives the collection time of the fingerprint image sent by the fingerprint collection control module.
  • the display screen driving module obtains finger touch information, and obtains a preset collection time of the fingerprint image based on the finger touch information.
  • the display screen is a touch display screen with touch sensing function.
  • touch display screen When a finger touches the touch display screen, the capacitance or voltage of the finger touch area on the touch display screen changes, thereby generating Finger touch information.
  • the collection time of the fingerprint image is a physical parameter of the fingerprint identification module, which may be stored in the processor or memory of the electronic device where the fingerprint identification module is located in the form of a preset value.
  • the display screen driving module may receive the fingerprint image collection time sent by the fingerprint collection control module or acquire the preset fingerprint image collection time after receiving the finger touch information.
  • the fingerprint collection method 400 further includes:
  • the fingerprint collection control module sends second instruction information to the display screen driving module.
  • the display screen driving module restores the frame display time of the display screen to the original frame display time according to the second instruction information.
  • the display screen driving module can restore the frame display time of the display screen to the original frame display time by increasing the screen refresh frequency of the display screen.
  • the screen refresh frequency of the display screen is f2
  • the original frame display time is T2
  • the fingerprint image acquisition time is S2, where S2>T2, so
  • the display drive module reduces the screen refresh frequency f2 to f2/2.
  • the display time of the first frame is T3, and the fingerprint acquisition control module starts fingerprint image acquisition at t3.
  • the fingerprint acquisition completes fingerprint image acquisition at time t4, and sends second instruction information to the display screen drive module, and the display screen drive module restores the display time of the first frame of the display screen to T3 according to the second instruction information
  • the original frame shows time T2.
  • the fingerprint collection control module After the fingerprint collection control module completes the collection of the fingerprint image, it performs fingerprint image processing, feature extraction, fingerprint matching and other operations on the fingerprint image.
  • the display screen drive module restores the original frame display time, does not affect the display of the display screen, and takes into account the display effect of the screen and the fingerprint Image acquisition quality.
  • the processor of an electronic device can include two operating environments, one is the rich execution environment (REE), which runs The internal application is a client application (CA); the other is a trusted execution environment (TEE), and the internal application is a trusted application (TA).
  • TEE refers to an independent safe operating environment in the OS of the main processor, which is isolated from REE and runs independently, for example, the TrustZone environment, or Qualcomm’s QSEE TEE, secure digital signal processing (digital signal processing) processing, DSP), etc.
  • TEE provides a series of security services for TA, including application execution integrity, secure storage, secure interaction with input and output devices, key management, encryption algorithm, and CA in REE For secure communications, etc. Because the fingerprint recognition function has high requirements for security, the control and recognition functions of the fingerprint acquisition system need to run in a safe and reliable TEE environment.
  • the fingerprint collection control module includes a fingerprint service module, a fingerprint application module, and a fingerprint drive module.
  • the fingerprint service module and the fingerprint driver module may run in a REE environment.
  • the fingerprint service module runs in a hardware abstract layer in the user space of the operating system. , HAL
  • the hardware abstraction layer is an interface layer between the operating system kernel layer and the hardware circuit, and its purpose is to abstract the hardware and provide an interface for users.
  • the fingerprint drive module and the display screen drive module run at the kernel layer in the kernel (knernel space) space of the operating system, and perform fingerprint image acquisition for driving the fingerprint acquisition control module in the fingerprint acquisition system.
  • the fingerprint service module and the fingerprint drive module need to be communicated with the fingerprint application module running in the secure environment TEE to ensure the security of the fingerprint collection system.
  • the fingerprint application module is used to control fingerprint image collection, and perform image processing and fingerprint recognition on the collected fingerprint image.
  • the fingerprint application module may be TA.
  • step S460 in FIG. 7 by the fingerprint collection control module controlling the fingerprint identification module to collect the fingerprint image based on the first indication information may include:
  • the fingerprint service module receives the first instruction information, and sends a notification message to the fingerprint application module, where the notification message is a message instructing to start fingerprint image collection.
  • the fingerprint service module located in the HAL layer in the REE environment receives the first indication information sent by the display screen driver module, it sends a notification message to the fingerprint application module located in the TEE environment.
  • the notification message is sent from the non-secure environment REE to the secure environment TEE, and needs to meet the specific requirements of the TEE communication protocol.
  • the fingerprint service module may communicate with the fingerprint application module through a TEE client application program interface (application programming interface, API).
  • the fingerprint application module receives the notification message, and sends a control message to the fingerprint driving module, where the control message is a message for controlling the fingerprint driving module to collect fingerprint images.
  • the fingerprint application module located in the TEE environment sends a control message to control the fingerprint drive module located in the system kernel layer to collect fingerprint images.
  • the fingerprint drive module is located in the system kernel layer of the REE environment.
  • the fingerprint driving module receives the control message to control the fingerprint identification module to collect the fingerprint image.
  • the fingerprint drive module drives the fingerprint recognition module, turns on the sensing array in the fingerprint recognition module, receives the light signal of the display screen reflected by the finger, and reflects the fingerprint
  • the light signal of the display screen is converted into a fingerprint image signal.
  • the fingerprint collection method 500 includes:
  • the fingerprint application module receives the fingerprint image, and performs fingerprint recognition on the fingerprint image to obtain a fingerprint recognition result.
  • neither the fingerprint image collected by the fingerprint recognition module nor the fingerprint recognition result processed by the fingerprint application module can be sent and stored in an untrusted memory space. All fingerprint image signals and fingerprints All recognition results need to be placed in trusted memory for protection.
  • the fingerprint recognition result includes fingerprint image data and fingerprint feature data and other information data related to the finger
  • the trusted memory is the memory in the TEE environment.
  • S520 The fingerprint application module sends the fingerprint identification result to the fingerprint service module.
  • the fingerprint service module sends the fingerprint identification result to the client application module.
  • the client application module is the client application software CA running in the REE environment, which can interact with the user.
  • the fingerprint application module sends the fingerprint recognition result to the customer application module, and the customer application module can present the fingerprint recognition result to the user.
  • the customer application software may be Alipay and other applications that require secure login.
  • the software can support fingerprint identification and login. When the fingerprint identification result is a successful fingerprint identification authentication, the user can log in to the software directly through fingerprints.
  • FIG. 11 is a schematic block diagram of a fingerprint collection system according to an embodiment of the present application, the fingerprint collection system is applied to an electronic device having a display screen and a fingerprint recognition module, wherein the fingerprint recognition module is arranged on the display screen The lower part is used to receive the light signal of the display screen returned by the reflection or scattering of the human finger above the display screen for fingerprint image collection.
  • the fingerprint collection system 600 includes: a display screen driving module 610 and a fingerprint collection control module 620;
  • the display screen driving module 610 is used to control the display screen to display a frame of image with the first frame of display time during the fingerprint image collection period of the fingerprint identification module, and the first frame of display time is not less than the fingerprint image Acquisition time
  • the fingerprint collection control module 620 is configured to control the fingerprint identification module to collect the fingerprint image, wherein the collection time of the fingerprint image is within the display time range of the one frame image.
  • the fingerprint acquisition system 600 may be a processing unit or the processing unit includes the fingerprint acquisition system 600, and the processing unit may be a processor or a controller of an electronic device.
  • the display screen driving module 610 and the fingerprint acquisition control module 620 are software modules running on the processor or controller, and drive the display screen and fingerprint identification module on the electronic device where the fingerprint acquisition system is located.
  • the display screen driving module 610 is further configured to send the first instruction information to the fingerprint collection control module 620 after controlling the display screen to display the one frame of image in the first frame display time;
  • the first indication information is used to instruct the fingerprint collection control module 620 to control the fingerprint identification module to collect the fingerprint image.
  • the display screen driving module 610 is further configured to: before controlling the display screen to display the one frame of image at the first frame display time, compare the display The display time of the original frame of the screen and the collection time of the fingerprint image, and based on the comparison result, the display screen is controlled to display the one frame of image with the first frame display time.
  • the display screen driving module 610 is specifically configured to adjust when the comparison result is that the original frame display time of the display screen is less than the fingerprint image acquisition time The frame display time of the display screen to the first frame display time.
  • the display screen driving module 610 is specifically configured to: when the comparison result is that the display time of the original frame of the display screen is not less than the collection time of the fingerprint image, The frame display time of the display screen is not adjusted, and the first frame display time is the original frame display time.
  • the display screen driving module 610 is further configured to receive the fingerprint collection before comparing the display time of the original frame of the display screen with the collection time of the fingerprint image The collection time of the fingerprint image sent by the control module 620.
  • the display screen driving module 610 is further configured to obtain finger touch information before comparing the display time of the original frame of the display screen with the collection time of the fingerprint image, Obtain a preset collection time of the fingerprint image based on the finger touch information.
  • the fingerprint collection control module 620 is further configured to, after controlling the fingerprint identification module to collect the fingerprint image, send a second second to the display screen driving module 610 Instruction information
  • the display screen driving module is further configured to restore the frame display time of the display screen to the original frame display time according to the second instruction information.
  • the fingerprint collection control module 620 is further configured to perform fingerprint image processing, feature extraction, fingerprint matching and other operations on the fingerprint image.
  • the frame display time of the display screen corresponds to the screen refresh frequency
  • the display screen driving module 610 can adjust the frame display time of the display screen by adjusting the screen refresh frequency of the display screen.
  • the fingerprint collection control module 620 includes a fingerprint service module 621, a fingerprint application module 622, and a fingerprint drive module 623.
  • the fingerprint service module 621 is specifically configured to receive the first instruction information, and send a notification message to the fingerprint application module 622, where the notification message is a message instructing to start collecting the fingerprint image;
  • the fingerprint application module 622 is specifically configured to receive the notification message and send a control message to the fingerprint driving module 623, where the control message is a message for controlling the fingerprint driving module to collect the fingerprint image;
  • the fingerprint driving module 623 is specifically configured to receive the control message to control the fingerprint identification module to collect the fingerprint image.
  • the fingerprint application module 622 is further configured to receive the fingerprint image, and perform image processing and fingerprint recognition on the fingerprint image signal to obtain a fingerprint recognition result.
  • the fingerprint identification system 600 further includes a client application module 630.
  • the fingerprint application module 622 is further configured to send the fingerprint identification result to the fingerprint service module 621;
  • the fingerprint service module 621 sends the fingerprint identification result to the client application module 630.
  • the client application module 630 is the client application software CA running in the REE environment, and can interact with the user.
  • FIG. 13 shows a positional relationship diagram of the display screen driving module 610, the fingerprint service module 621, the fingerprint application module 622, the fingerprint driving module 623, and the client application module 630 according to an embodiment of the present application.
  • the display screen driving module 610 may run in the REE environment and located at the kernel layer in the kernel space.
  • the fingerprint service module 621 may run in the REE environment and located at the HAL layer in the user space.
  • the fingerprint application module 622 may run in a TEE environment, and the fingerprint application module 622 may be a trusted application TA.
  • the fingerprint drive module 623 can run in the REE environment and located at the kernel layer in the kernel space.
  • the client application module 630 may run in the REE environment and located at the application layer in the user space.
  • the electronic device 700 may include a display screen 120, a fingerprint identification module 130, and a fingerprint identification system 600, wherein the fingerprint identification module 130 Located below the display screen 120, the fingerprint identification module 130 receives the light signal of the display screen 120 that is reflected or scattered by a human finger above the display screen to collect fingerprint images.
  • the fingerprint identification system 600 may be the fingerprint identification system 600 in the foregoing embodiment, and may be used to control the display screen 120 and the fingerprint identification module 130. In addition, the fingerprint identification system 600 can be used to execute the content in the method embodiments shown in FIGS. 3 to 10.
  • the electronic device may be an electronic device that supports the Android system, such as portable or mobile computing devices such as smart phones, laptops, tablets, and gaming devices, as well as electronic databases, automobiles, and bank automated teller machines (Automated Teller Machines). , ATM) and other electronic devices, but the embodiments of the present application are not limited thereto.
  • Android such as portable or mobile computing devices such as smart phones, laptops, tablets, and gaming devices, as well as electronic databases, automobiles, and bank automated teller machines (Automated Teller Machines). , ATM) and other electronic devices, but the embodiments of the present application are not limited thereto.
  • processing unit of the embodiment of the present application may be an integrated circuit chip with signal processing capability.
  • steps of the foregoing method embodiments may be completed by hardware integrated logic circuits in the processing unit or instructions in the form of software.
  • the above-mentioned processing units include, but are not limited to, the following: general-purpose processors, central processing units (CPUs), digital signal processors (digital signal processors, DSP), application specific integrated circuits (ASICs), ready-made programmable gate arrays Field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.
  • CPUs central processing units
  • DSP digital signal processors
  • ASICs application specific integrated circuits
  • FPGA Field programmable gate array
  • the methods, steps, and logical block diagrams disclosed in the embodiments of the present application can be implemented or executed.
  • the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
  • the steps of the method disclosed in the embodiments of the present application may be directly embodied as being executed and completed by a hardware decoding processor, or executed and completed by a combination of hardware and software modules in the decoding processor.
  • the software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory, or electrically erasable programmable memory, registers.
  • the storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.
  • the fingerprint recognition in the embodiments of the present application may further include a memory
  • the memory may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory.
  • the non-volatile memory can be read-only memory (ROM), programmable read-only memory (programmable ROM, PROM), erasable programmable read-only memory (erasable PROM, EPROM), and electronic Erase programmable read-only memory (electrically EPROM, EEPROM) or flash memory.
  • the volatile memory may be random access memory (RAM), which is used as an external cache.
  • RAM random access memory
  • static random access memory static random access memory
  • dynamic RAM dynamic random access memory
  • DRAM dynamic random access memory
  • SDRAM synchronous dynamic random access memory
  • double data rate synchronous dynamic random access memory double data rate SDRAM, DDR SDRAM
  • enhanced synchronous dynamic random access memory enhanced SDRAM, ESDRAM
  • serial link DRAM SLDRAM
  • direct rambus RAM direct rambus RAM
  • the embodiment of the present application also proposes a computer-readable storage medium that stores one or more programs, and the one or more programs include instructions.
  • the instructions When the instructions are included in a portable electronic device that includes multiple application programs When executed, the portable electronic device can be made to execute the method of the embodiment shown in FIG. 3 to FIG. 10.
  • the embodiment of the present application also proposes a computer program, the computer program includes instructions, when the computer program is executed by the computer, the computer can execute the method of the embodiments shown in FIG. 3 to FIG. 10.
  • An embodiment of the present application also provides a chip that includes an input and output interface, at least one processor, at least one memory, and a bus.
  • the at least one memory is used to store instructions, and the at least one processor is used to call the at least one memory. To execute the method of the embodiment shown in FIG. 3 to FIG. 10.
  • the disclosed system, device, and method may be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • each unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
  • the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of the present application essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , Including several instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present application.
  • the aforementioned storage medium includes: U disk, mobile hard disk, read only memory (read only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computer Hardware Design (AREA)
  • Image Input (AREA)
  • Telephone Function (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Collating Specific Patterns (AREA)

Abstract

Disclosed are a fingerprint collection method and system, and an electronic device, which can improve the performance of a fingerprint collection system. The fingerprint collection method is applied to an electronic device with a display screen and a fingerprint recognition module, wherein the fingerprint recognition module is arranged below the display screen and is used for receiving a light signal, returned by means of the reflection or scattering of a human finger above the display screen, of the display screen, so as to perform fingerprint image collection. The method comprises: controlling, during a period in which a fingerprint recognition module performs fingerprint image collection, a display screen to display a frame of image for a first frame display time, wherein the first frame display time is not less than the time for collecting a fingerprint image; and controlling the fingerprint recognition module to collect the fingerprint image, wherein the time for collecting the fingerprint image is within the range of the display time of the frame of image.

Description

指纹采集的方法、***和电子设备Fingerprint collection method, system and electronic equipment 技术领域Technical field
本申请涉及光学指纹技术领域，并且更具体地，涉及一种指纹采集的方法、***和电子设备。This application relates to the field of optical fingerprint technology, and more specifically, to a method, system, and electronic device for fingerprint collection.
背景技术Background technique
随着全面屏手机时代的到来，屏下指纹技术让屏占比做到了极致，目前屏下指纹技术中以光学指纹技术尤为突出。在有机发光二极管(organic light emitting diode，OLED)显示屏中，依靠OLED显示屏自发光的特点，将指纹识别模组放置于显示屏之下，当手指按压在显示屏上时，指纹识别模组接收OLED光源经过手指反射后的光信号进行成像，从而采集到手指的图像信号。With the advent of the era of full-screen mobile phones, the under-screen fingerprint technology has made the screen ratio to the extreme. At present, the optical fingerprint technology is particularly prominent in the under-screen fingerprint technology. In the organic light emitting diode (OLED) display, the fingerprint recognition module is placed under the display based on the self-luminous characteristics of the OLED display. When the finger is pressed on the display, the fingerprint recognition module Receiving the light signal reflected by the finger from the OLED light source for imaging, thereby collecting the image signal of the finger.
在OLED显示屏中，通过在一定频率下刷新显示数据来控制显示图像，如果在OLED显示屏刷新显示数据的同时，指纹识别模组刚好在接收光信号进行指纹图像的采集，会由于OLED显示屏刷新显示数据的变化引起指纹识别模组采集的光信号发生陡变，导致采集的图像为出现横条纹等质量较差的指纹图像，进而影响指纹采集***的性能，给用户带来不良的体验。In the OLED display, the display image is controlled by refreshing the display data at a certain frequency. If the fingerprint recognition module is just receiving the light signal to collect the fingerprint image while the OLED display is refreshing the display data, it will be due to the OLED display. The change of refresh display data causes abrupt changes in the optical signal collected by the fingerprint recognition module, resulting in poor quality fingerprint images such as horizontal stripes, which affects the performance of the fingerprint collection system and brings a bad experience to users.
发明内容Summary of the invention
本申请实施例提供了一种指纹采集的方法、***和电子设备，能够提高指纹采集***的性能。The embodiments of the present application provide a fingerprint collection method, system, and electronic device, which can improve the performance of the fingerprint collection system.
第一方面，提供了一种指纹采集的方法，应用于具有显示屏和指纹识别模组的电子设备，其中，所述指纹识别模组设置于所述显示屏下方，用于收经由所述显示屏上方的人体手指反射或散射而返回的所述显示屏的光信号以进行指纹图像采集，所述方法包括：In the first aspect, a fingerprint collection method is provided, which is applied to an electronic device having a display screen and a fingerprint recognition module, wherein the fingerprint recognition module is disposed under the display screen for receiving through the display The optical signal of the display screen reflected or scattered by the human finger above the screen for fingerprint image collection, and the method includes:
控制所述显示屏在所述指纹识别模组进行指纹图像采集期间，以第一帧显示时间显示一帧图像，所述第一帧显示时间不小于指纹图像的采集时间；Controlling the display screen to display a frame of image with the first frame display time during the fingerprint image collection period of the fingerprint identification module, and the first frame display time is not less than the fingerprint image collection time;
控制所述指纹识别模组采集所述指纹图像，其中，所述指纹图像的采集时间在所述一帧图像的显示时间范围内。Control the fingerprint identification module to collect the fingerprint image, wherein the collection time of the fingerprint image is within the display time range of the one frame image.
本申请的技术方案，通过控制显示屏的帧显示时间，使该帧显示时间不 小于指纹识别模组采集指纹图像的时间，且所述指纹图像的采集时间在所述显示屏的一帧图像的显示时间范围内，因此，避免了在所述显示屏的帧间图像切换时进行指纹图像的采集，进而避免采集到出现横条纹等质量较差的指纹图像，提高了指纹图像的质量和指纹识别性能。The technical solution of the present application controls the frame display time of the display screen so that the frame display time is not less than the time when the fingerprint recognition module collects fingerprint images, and the fingerprint image acquisition time is within the time of one frame of the display Within the display time range, therefore, it avoids the collection of fingerprint images when switching between frames of the display screen, thereby avoiding the collection of poor-quality fingerprint images such as horizontal stripes, and improving the quality of fingerprint images and fingerprint recognition performance.
在一种可能的实现方式中，所述显示屏和所述指纹识别模组分别通过显示屏驱动模块和指纹采集控制模块进行驱动，所述方法还包括：所述显示屏驱动模块在控制所述显示屏以所述第一帧显示时间显示所述一帧图像后，向所述指纹采集控制模块发送第一指示信息；In a possible implementation manner, the display screen and the fingerprint identification module are respectively driven by a display screen drive module and a fingerprint acquisition control module, and the method further includes: the display screen drive module is controlling the After the display screen displays the one frame of image for the first frame display time, it sends first indication information to the fingerprint collection control module;
所述指纹采集控制模块接收所述第一指示信息，并基于所述第一指示信息控制所述指纹识别模组采集所述指纹图像。The fingerprint collection control module receives the first indication information, and controls the fingerprint identification module to collect the fingerprint image based on the first indication information.
在一种可能的实现方式中，所述方法还包括：所述显示屏驱动模块在控制所述显示屏以所述第一帧显示时间显示所述一帧图像前，比较所述显示屏的原始帧显示时间与所述指纹图像的采集时间，并基于比较结果控制所述显示屏以所述第一帧显示时间显示所述一帧图像。In a possible implementation, the method further includes: before the display screen driving module controls the display screen to display the one frame of the image at the first frame display time, comparing the original display screen The frame display time and the collection time of the fingerprint image, and based on the comparison result, the display screen is controlled to display the one frame of the image with the first frame display time.
在一种可能的实现方式中，所述基于比较结果控制所述显示屏以所述第一帧显示时间显示所述一帧图像包括：In a possible implementation manner, the controlling the display screen to display the one frame of image at the first frame display time based on the comparison result includes:
当所述比较结果为所述显示屏的原始帧显示时间小于所述指纹图像的采集时间时，调整所述显示屏的帧显示时间至所述第一帧显示时间。When the comparison result is that the original frame display time of the display screen is less than the fingerprint image collection time, the frame display time of the display screen is adjusted to the first frame display time.
在一种可能的实现方式中，所述基于比较结果控制所述显示屏以所述第一帧显示时间显示所述一帧图像包括：In a possible implementation manner, the controlling the display screen to display the one frame of image at the first frame display time based on the comparison result includes:
当所述比较结果为所述显示屏的原始帧显示时间不小于所述指纹图像的采集时间时，不调整所述显示屏的帧显示时间，所述第一帧显示时间为所述原始帧显示时间。When the comparison result is that the original frame display time of the display screen is not less than the fingerprint image acquisition time, the frame display time of the display screen is not adjusted, and the first frame display time is the original frame display time.
在一种可能的实现方式中，所述方法还包括：所述显示屏驱动模块在比较所述显示屏的原始帧显示时间与所述指纹图像的采集时间前，接收所述指纹采集控制模块发送的所述指纹图像的采集时间。In a possible implementation, the method further includes: before the display screen driving module compares the display time of the original frame of the display screen with the acquisition time of the fingerprint image, receiving the fingerprint acquisition control module to send Of the fingerprint image collection time.
在一种可能的实现方式中，所述方法还包括：所述显示屏驱动模块还在比较所述显示屏的原始帧显示时间与所述指纹图像的采集时间前，获取手指触摸信息，基于所述手指触摸信息获取预设的所述指纹图像的采集时间。In a possible implementation manner, the method further includes: the display screen driving module further compares the display time of the original frame of the display screen with the acquisition time of the fingerprint image, obtaining finger touch information, based on all The finger touch information acquires a preset collection time of the fingerprint image.
在一种可能的实现方式中，所述方法还包括：所述指纹采集控制模块在控制所述指纹识别模组采集所述指纹图像后，向所述显示屏驱动模块发送第 二指示信息；In a possible implementation manner, the method further includes: after the fingerprint acquisition control module controls the fingerprint identification module to acquire the fingerprint image, sending second instruction information to the display screen driving module;
所述显示屏驱动模块根据所述第二指示信息将所述显示屏的帧显示时间恢复至所述原始帧显示时间。The display screen driving module restores the frame display time of the display screen to the original frame display time according to the second instruction information.
在一种可能的实现方式中，所述指纹采集控制模块包括指纹服务模块、指纹应用模块和指纹驱动模块，所述指纹采集控制模块接收所述第一指示信息，并基于所述第一指示信息控制所述指纹识别模组采集所述指纹图像包括：In a possible implementation, the fingerprint collection control module includes a fingerprint service module, a fingerprint application module, and a fingerprint drive module, and the fingerprint collection control module receives the first indication information and bases it on the first indication information. Controlling the fingerprint identification module to collect the fingerprint image includes:
所述指纹服务模块接收所述第一指示信息，并发送通知消息给所述指纹应用模块，所述通知消息为指示开始进行指纹图像采集的消息；The fingerprint service module receives the first instruction information, and sends a notification message to the fingerprint application module, where the notification message is a message instructing to start fingerprint image collection;
所述指纹应用模块接收所述通知消息，并发送控制消息给所述指纹驱动模块，所述控制消息为控制所述指纹驱动模块进行指纹图像采集的消息；The fingerprint application module receives the notification message and sends a control message to the fingerprint driving module, where the control message is a message for controlling the fingerprint driving module to collect fingerprint images;
所述指纹驱动模块接收所述控制消息以控制所述指纹识别模组采集所述指纹图像。The fingerprint driving module receives the control message to control the fingerprint identification module to collect the fingerprint image.
在一种可能的实现方式中，所述方法还包括：所述指纹应用模块接收所述指纹图像，并对所述指纹图像进行指纹识别得到指纹识别结果。In a possible implementation, the method further includes: the fingerprint application module receives the fingerprint image, and performs fingerprint recognition on the fingerprint image to obtain a fingerprint recognition result.
在一种可能的实现方式中，所述指纹识别***还包括客户应用模块，所述方法还包括：In a possible implementation manner, the fingerprint identification system further includes a client application module, and the method further includes:
所述指纹应用模块将所述指纹识别结果发送给所述指纹服务模块；The fingerprint application module sends the fingerprint identification result to the fingerprint service module;
所述指纹服务模块将所述指纹识别结果发送给所述客户应用模块。The fingerprint service module sends the fingerprint identification result to the client application module.
在一种可能的实现方式中，所述显示屏驱动模块和所述指纹驱动模块运行在富执行环境REE中，位于内核层；In a possible implementation manner, the display screen driver module and the fingerprint driver module run in a rich execution environment REE and are located at the kernel layer;
所述指纹服务模块运行在富执行环境REE中，位于硬件抽象HAL层；The fingerprint service module runs in the rich execution environment REE and is located at the hardware abstraction HAL layer;
所述指纹应用模块运行在可信执行环境TEE中，位于可信应用TA层。The fingerprint application module runs in the trusted execution environment TEE and is located at the trusted application TA layer.
第二方面，提供了一种指纹采集的***，应用于具有显示屏和指纹识别模组的电子设备，其中，所述指纹识别模组设置于所述显示屏下方，用于接收经由所述显示屏上方的人体手指反射或散射而返回的所述显示屏的光信号以进行指纹图像采集，所述***包括：显示屏驱动模块和指纹采集控制模块；In a second aspect, a fingerprint collection system is provided, which is applied to an electronic device having a display screen and a fingerprint recognition module, wherein the fingerprint recognition module is arranged under the display screen for receiving The light signal of the display screen reflected or scattered by the human finger above the screen is used for fingerprint image collection. The system includes: a display screen drive module and a fingerprint collection control module;
所述显示屏驱动模块用于控制所述显示屏在所述指纹识别模组进行指纹图像采集期间，以第一帧显示时间显示一帧图像，所述第一帧显示时间不小于指纹图像的采集时间；The display screen driving module is used to control the display screen to display a frame of image with the first frame display time during the fingerprint image collection period of the fingerprint identification module, and the first frame display time is not less than the fingerprint image collection time;
所述指纹采集控制模块用于控制所述指纹识别模组采集所述指纹图像，其中，所述指纹图像的采集时间在所述一帧图像的显示时间范围内。The fingerprint collection control module is configured to control the fingerprint identification module to collect the fingerprint image, wherein the collection time of the fingerprint image is within the display time range of the one frame image.
在一种可能的实现方式中，所述显示屏驱动模块还用于在控制所述显示屏以所述第一帧显示时间显示所述一帧图像后，向所述指纹采集控制模块发送第一指示信息；In a possible implementation manner, the display screen driving module is further configured to, after controlling the display screen to display the one frame of images for the first frame display time, send the first frame to the fingerprint collection control module. Instruction information
所述第一指示信息用于指示所述指纹采集控制模块控制所述指纹识别模组采集所述指纹图像。The first indication information is used to instruct the fingerprint collection control module to control the fingerprint identification module to collect the fingerprint image.
在一种可能的实现方式中，所述显示屏驱动模块还用于，在控制所述显示屏以所述第一帧显示时间显示所述一帧图像前，比较所述显示屏的原始帧显示时间与所述指纹图像的采集时间，并基于比较结果控制所述显示屏以所述第一帧显示时间显示所述一帧图像。In a possible implementation manner, the display screen driving module is further configured to compare the original frame display of the display screen before controlling the display screen to display the one frame of image at the first frame display time Time and the collection time of the fingerprint image, and based on the comparison result, the display screen is controlled to display the one frame of image with the first frame display time.
在一种可能的实现方式中，所述显示屏驱动模块具体用于，当所述比较结果为所述显示屏的原始帧显示时间小于所述指纹图像的采集时间时，调整所述显示屏的帧显示时间至所述第一帧显示时间。In a possible implementation, the display screen driving module is specifically configured to adjust the display screen's display time when the comparison result is that the original frame display time of the display screen is less than the fingerprint image acquisition time Frame display time to the first frame display time.
在一种可能的实现方式中，所述显示屏驱动模块具体用于，当所述比较结果为所述显示屏的原始帧显示时间不小于所述指纹图像的采集时间时，不调整所述显示屏的帧显示时间，所述第一帧显示时间为所述原始帧显示时间。In a possible implementation manner, the display screen driving module is specifically configured to not adjust the display when the comparison result is that the display time of the original frame of the display screen is not less than the acquisition time of the fingerprint image The frame display time of the screen, the first frame display time is the original frame display time.
在一种可能的实现方式中，所述显示屏驱动模块还用于，在比较所述显示屏的原始帧显示时间与所述指纹图像的采集时间前，接收所述指纹采集控制模块发送的所述指纹图像的采集时间。In a possible implementation manner, the display screen drive module is further configured to receive all data sent by the fingerprint acquisition control module before comparing the display time of the original frame of the display screen with the acquisition time of the fingerprint image. State the collection time of the fingerprint image.
在一种可能的实现方式中，所述显示屏驱动模块还用于，在比较所述显示屏的原始帧显示时间与所述指纹图像的采集时间前，获取手指触摸信息，基于所述手指触摸信息获取预设的所述指纹图像的采集时间。In a possible implementation, the display screen driving module is further configured to obtain finger touch information before comparing the display time of the original frame of the display screen with the acquisition time of the fingerprint image, based on the finger touch Information acquisition preset collection time of the fingerprint image.
在一种可能的实现方式中，所述指纹采集控制模块还用于，在控制所述指纹识别模组采集所述指纹图像后，向所述显示屏驱动模块发送第二指示信息；In a possible implementation, the fingerprint acquisition control module is further configured to send second instruction information to the display screen driving module after controlling the fingerprint identification module to acquire the fingerprint image;
所述显示屏驱动模块还用于根据所述第二指示信息将所述显示屏的帧显示时间恢复至所述原始帧显示时间。The display screen driving module is further configured to restore the frame display time of the display screen to the original frame display time according to the second instruction information.
在一种可能的实现方式中，所述指纹采集控制模块包括指纹服务模块、指纹应用模块和指纹驱动模块；In a possible implementation manner, the fingerprint collection control module includes a fingerprint service module, a fingerprint application module, and a fingerprint drive module;
所述指纹服务模块用于接收所述第一指示信息，并发送通知消息给所述指纹应用模块，所述通知消息为指示开始采集所述指纹图像的消息；The fingerprint service module is configured to receive the first instruction information and send a notification message to the fingerprint application module, where the notification message is a message instructing to start collecting the fingerprint image;
所述指纹应用模块用于接收所述通知消息，并发送控制消息给所述指纹驱动模块，所述控制消息为控制所述指纹驱动模块采集所述指纹图像的消息；The fingerprint application module is configured to receive the notification message and send a control message to the fingerprint driving module, where the control message is a message for controlling the fingerprint driving module to collect the fingerprint image;
所述指纹驱动模块用于接收所述控制消息以控制所述指纹识别模组采集所述指纹图像。The fingerprint driving module is used for receiving the control message to control the fingerprint identification module to collect the fingerprint image.
在一种可能的实现方式中，所述指纹应用模块还用于接收所述指纹图像，并对所述指纹图像进行指纹识别得到指纹识别结果。In a possible implementation manner, the fingerprint application module is further configured to receive the fingerprint image, and perform fingerprint recognition on the fingerprint image to obtain a fingerprint recognition result.
在一种可能的实现方式中，所述***还包括客户应用模块；In a possible implementation manner, the system further includes a client application module;
所述指纹应用模块将所述指纹识别结果发送给所述指纹服务模块；The fingerprint application module sends the fingerprint identification result to the fingerprint service module;
所述指纹服务模块将所述指纹识别结果发送给所述客户应用模块。The fingerprint service module sends the fingerprint identification result to the client application module.
在一种可能的实现方式中，所述显示屏驱动模块和所述指纹驱动模块运行在富执行环境REE中，位于内核层；In a possible implementation manner, the display screen driver module and the fingerprint driver module run in a rich execution environment REE and are located at the kernel layer;
所述指纹服务模块运行在富执行环境REE中，位于硬件抽象HAL层；The fingerprint service module runs in the rich execution environment REE and is located at the hardware abstraction HAL layer;
所述指纹应用模块运行在可信执行环境TEE中，位于可信应用TA层。The fingerprint application module runs in the trusted execution environment TEE and is located at the trusted application TA layer.
第三方面，提供了一种电子设备，包括显示屏、指纹识别模组以及如第二方面或第二方面的任一可能的实现方式中的指纹识别***；In a third aspect, an electronic device is provided, including a display screen, a fingerprint identification module, and a fingerprint identification system such as the second aspect or any possible implementation of the second aspect;
其中，所述指纹识别模组设置于所述显示屏下方，用于接收经由所述显示屏上方的人体手指反射或散射而返回的所述显示屏的光信号以进行指纹图像采集。Wherein, the fingerprint identification module is disposed under the display screen, and is used to receive the light signal of the display screen returned by the reflection or scattering of a human finger above the display screen for fingerprint image collection.
第四方面，提供了一种芯片，该芯片包括输入输出接口、至少一个处理器、至少一个存储器和总线，该至少一个存储器用于存储指令，该至少一个处理器用于调用该至少一个存储器中的指令，以执行第一方面或第一方面的任一可能的实现方式中的方法。In a fourth aspect, a chip is provided. The chip includes an input and output interface, at least one processor, at least one memory, and a bus. The at least one memory is used to store instructions, and the at least one processor is used to call Instructions to execute the method in the first aspect or any possible implementation of the first aspect.
第五方面，提供了一种计算机可读介质，用于存储计算机程序，所述计算机程序包括用于执行上述第一方面或第一方面的任一可能的实现方式中的指令。In a fifth aspect, a computer-readable medium is provided for storing a computer program, and the computer program includes instructions for executing the above-mentioned first aspect or any possible implementation of the first aspect.
第六方面，提供了一种包括指令的计算机程序产品，当计算机运行所述计算机程序产品的所述指时，所述计算机执行上述第一方面或第一方面的任一可能的实现方式中的指纹识别的方法。In a sixth aspect, a computer program product including instructions is provided. When the computer runs the instructions of the computer program product, the computer executes the first aspect or any of the possible implementations of the first aspect. Fingerprint identification method.
具体地，该计算机程序产品可以运行于上述第三方面的电子设备上。Specifically, the computer program product can run on the electronic device of the third aspect.
附图说明Description of the drawings
图1是本申请实施例所适用的终端设备的结构示意图。Fig. 1 is a schematic structural diagram of a terminal device to which an embodiment of the present application is applicable.
图2是本申请实施例中屏幕显示时序与指纹识别模组指纹图像采集时序的示意图。2 is a schematic diagram of the screen display timing and the fingerprint image collection timing of the fingerprint identification module in an embodiment of the present application.
图3是根据本申请实施例的指纹采集方法的示意性流程图。Fig. 3 is a schematic flowchart of a fingerprint collection method according to an embodiment of the present application.
图4是根据本申请实施例的另一指纹采集方法的示意性流程图。Fig. 4 is a schematic flowchart of another fingerprint collection method according to an embodiment of the present application.
图5是本申请实施例中另一屏幕显示时序与指纹识别模组指纹图像采集时序的示意图。5 is a schematic diagram of another screen display timing and fingerprint image collection timing of the fingerprint identification module in an embodiment of the present application.
图6是本申请实施例中另一屏幕显示时序与指纹识别模组指纹图像采集时序的示意图。6 is a schematic diagram of another screen display timing and fingerprint image collection timing of the fingerprint identification module in an embodiment of the present application.
图7是根据本申请实施例的另一指纹采集方法的示意性流程图。Fig. 7 is a schematic flowchart of another fingerprint collection method according to an embodiment of the present application.
图8是本申请实施例中另一屏幕显示时序与指纹识别模组指纹图像采集时序的示意图。FIG. 8 is a schematic diagram of another screen display timing and fingerprint image collection timing of the fingerprint identification module in an embodiment of the present application.
图9是根据本申请实施例的另一指纹采集方法的示意性流程图。Fig. 9 is a schematic flowchart of another fingerprint collection method according to an embodiment of the present application.
图10是根据本申请实施例的另一指纹采集方法的示意性流程图。Fig. 10 is a schematic flowchart of another fingerprint collection method according to an embodiment of the present application.
图11是根据本申请实施例的指纹采集***的示意性框图。Fig. 11 is a schematic block diagram of a fingerprint collection system according to an embodiment of the present application.
图12是根据本申请实施例的另一指纹采集***的示意性框图。Fig. 12 is a schematic block diagram of another fingerprint collection system according to an embodiment of the present application.
图13是根据本申请实施例的指纹采集***中各模块的位置关系图。Fig. 13 is a diagram of the positional relationship of various modules in the fingerprint collection system according to an embodiment of the present application.
图14是根据本申请实施例的电子设备的示意性结构图。Fig. 14 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
具体实施方式detailed description
下面将结合附图，对本申请实施例中的技术方案进行描述。The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings.
应理解，本申请实施例可以应用于光学指纹***，包括但不限于光学指纹识别***和基于光学指纹成像的产品，本申请实施例仅以光学指纹***为例进行说明，但不应对本申请实施例构成任何限定，本申请实施例同样适用于其他采用光学成像技术的***等。It should be understood that the embodiments of this application can be applied to optical fingerprint systems, including but not limited to optical fingerprint identification systems and products based on optical fingerprint imaging. The embodiments of this application only take optical fingerprint systems as an example for illustration, but should not be implemented in this application. The examples constitute any limitation, and the examples of this application are also applicable to other systems that use optical imaging technology.
作为一种常见的应用场景，本申请实施例提供的光学指纹***可以应用在智能手机、平板电脑以及其他具有显示屏的移动终端或者其他终端设备；更具体地，在上述终端设备中，指纹识别模组可以设置在显示屏下方的局部 区域或者全部区域，从而形成屏下(Under-display)光学指纹***。或者，所述指纹识别装置也可以部分或者全部集成至所述终端设备的显示屏内部，从而形成屏内(In-display)光学指纹***。As a common application scenario, the optical fingerprint system provided in the embodiments of this application can be applied to smart phones, tablet computers, and other mobile terminals with display screens or other terminal devices; more specifically, in the above-mentioned terminal devices, fingerprint identification The module can be arranged in a partial area or the entire area under the display screen to form an under-display optical fingerprint system. Alternatively, the fingerprint identification device can also be partially or fully integrated into the display screen of the terminal device, thereby forming an in-display optical fingerprint system.
如图1所示为本申请实施例可以适用的终端设备的结构示意图，所述终端设备10包括显示屏120和指纹识别模组130，其中，所述指纹识别模组130设置在所述显示屏120下方的局部区域。所述指纹识别模组130包括光学指纹传感器，所述光学指纹传感器包括具有多个光学感应单元131的感应阵列133，所述感应阵列133所在区域或者其感应区域为所述指纹识别模组130的指纹检测区域103。如图1所示，所述指纹检测区域103位于所述显示屏120的显示区域之中。在一种替代实施例中，所述指纹识别模组130还可以设置在其他位置，比如所述显示屏120的侧面或者所述终端设备10的边缘非透光区域，并通过光路设计来将所述显示屏120的至少部分显示区域的光信号导引到所述指纹识别模组130，从而使得所述指纹检测区域103实际上位于所述显示屏120的显示区域。FIG. 1 is a schematic structural diagram of a terminal device to which the embodiment of the application can be applied. The terminal device 10 includes a display screen 120 and a fingerprint identification module 130, wherein the fingerprint identification module 130 is provided on the display screen. Partial area below 120. The fingerprint recognition module 130 includes an optical fingerprint sensor, and the optical fingerprint sensor includes a sensing array 133 having a plurality of optical sensing units 131. The sensing array 133 is located or its sensing area is the fingerprint recognition module 130 Fingerprint detection area 103. As shown in FIG. 1, the fingerprint detection area 103 is located in the display area of the display screen 120. In an alternative embodiment, the fingerprint recognition module 130 can also be arranged in other positions, such as the side of the display screen 120 or the non-transparent area of the edge of the terminal device 10, and the optical path design is used to design the The optical signal of at least a part of the display area of the display screen 120 is guided to the fingerprint identification module 130 so that the fingerprint detection area 103 is actually located in the display area of the display screen 120.
应当理解，所述指纹检测区域103的面积可以与所述指纹识别模组130的感应阵列的面积不同，例如通过例如透镜成像的光路设计、反射式折叠光路设计或者其他光线汇聚或者反射等光路设计，可以使得所述指纹识别模组130的指纹检测区域103的面积大于所述指纹识别模组130感应阵列的面积。在其他替代实现方式中，如果采用例如光线准直方式进行光路引导，所述指纹识别模组130的指纹检测区域103也可以设计成与所述指纹识别模组130的感应阵列的面积基本一致。It should be understood that the area of the fingerprint detection area 103 may be different from the area of the sensing array of the fingerprint recognition module 130, for example, through a light path design such as lens imaging, a reflective folding light path design, or other light convergence or reflection light path designs. , The area of the fingerprint detection area 103 of the fingerprint identification module 130 can be made larger than the area of the sensing array of the fingerprint identification module 130. In other alternative implementations, if for example, light collimation is used for light path guidance, the fingerprint detection area 103 of the fingerprint identification module 130 may also be designed to be substantially the same as the area of the sensing array of the fingerprint identification module 130.
因此，使用者在需要对所述终端设备进行解锁或者其他指纹验证的时候，只需要将手指按压在位于所述显示屏120的指纹检测区域103，便可以实现指纹输入。由于指纹检测可以在屏内实现，因此采用上述结构的终端设备10无需其正面专门预留空间来设置指纹按键(比如Home键)，从而可以采用全面屏方案，即所述显示屏120的显示区域可以基本扩展到整个终端设备10的正面。Therefore, when the user needs to unlock the terminal device or perform other fingerprint verification, he only needs to press his finger on the fingerprint detection area 103 located in the display screen 120 to realize fingerprint input. Since fingerprint detection can be implemented in the screen, the terminal device 10 adopting the above structure does not need to reserve a space on the front side for the fingerprint button (such as the Home button), so that a full screen solution can be adopted, that is, the display area of the display screen 120 It can be basically extended to the front of the entire terminal device 10.
作为一种可选的实现方式，如图1所示，所述指纹识别模组130包括光检测部分134和光学组件132，所述光检测部分134包括所述感应阵列以及与所述感应阵列电性连接的读取电路及其他辅助电路，其可以在通过半导体工艺制作在一个芯片(Die)，比如光学成像芯片或者光学指纹传感器，所述感 应阵列具体为光探测器(Photo detector)阵列，其包括多个呈阵列式分布的光探测器，所述光探测器可以作为如上所述的光学感应单元；所述光学组件132可以设置在所述光检测部分134的感应阵列的上方，其可以具体包括滤光层(Filter)、导光层或光路引导结构以及其他光学元件，所述滤光层可以用于滤除穿透手指的环境光，而所述导光层或光路引导结构主要用于从手指表面反射回来的反射光导引至所述感应阵列进行光学检测。As an optional implementation, as shown in FIG. 1, the fingerprint recognition module 130 includes a light detection part 134 and an optical component 132. The light detection part 134 includes the sensor array and is electrically connected to the sensor array. The read circuit and other auxiliary circuits that are sexually connected can be fabricated on a chip (Die) by a semiconductor process, such as an optical imaging chip or an optical fingerprint sensor. The sensing array is specifically a photodetector (Photodetector) array. It includes a plurality of photodetectors distributed in an array, and the photodetectors can be used as the above-mentioned optical sensing unit; the optical component 132 can be arranged above the sensing array of the photodetecting part 134, which can be specifically Including a filter layer (Filter), a light guide layer or light path guide structure and other optical elements, the filter layer can be used to filter out the ambient light penetrating the finger, and the light guide layer or light path guide structure is mainly used The reflected light reflected from the finger surface is guided to the sensing array for optical inspection.
在具体实现上，所述光学组件132可以与所述光检测部分134封装在同一个光学指纹部件。比如，所述光学组件132可以与所述光学检测部分134封装在同一个光学指纹芯片，也可以将所述光学组件132设置在所述光检测部分134所在的芯片外部，比如将所述光学组件132贴合在所述芯片上方，或者将所述光学组件132的部分元件集成在上述芯片之中。In terms of specific implementation, the optical assembly 132 and the light detecting part 134 may be packaged in the same optical fingerprint component. For example, the optical component 132 and the optical detection part 134 can be packaged in the same optical fingerprint chip, or the optical component 132 can be arranged outside the chip where the optical detection part 134 is located, for example, the optical component 132 is attached above the chip, or some components of the optical assembly 132 are integrated into the chip.
其中，所述光学组件132的导光层或者光路引导结构有多种实现方案，比如，所述导光层可以具体为在半导体硅片制作而成的准直器(Collimator)层，其具有多个准直单元或者微孔阵列，所述准直单元可以具体为小孔，从手指反射回来的反射光中，垂直入射到所述准直单元的光线可以穿过并被其下方的光学感应单元接收，而入射角度过大的光线在所述准直单元内部经过多次反射被衰减掉，因此每一个光学感应单元基本只能接收到其正上方的指纹纹路反射回来的反射光，从而所述感应阵列便可以检测出手指的指纹图像。Wherein, the light guide layer or light path guiding structure of the optical component 132 has multiple implementation schemes. For example, the light guide layer may specifically be a collimator layer made on a semiconductor silicon wafer, which has multiple A collimating unit or a micro-hole array. The collimating unit can be specifically a small hole. Among the reflected light reflected from the finger, the light that is perpendicularly incident on the collimating unit can pass through and be passed by the optical sensing unit below it. The light with an excessively large incident angle is attenuated by multiple reflections inside the collimating unit. Therefore, each optical sensing unit can basically only receive the reflected light reflected by the fingerprint pattern directly above it. The sensor array can detect the fingerprint image of the finger.
在另一种实施例中，所述导光层或者光路引导结构也可以为光学透镜(Lens)层，其具有一个或多个透镜单元，比如一个或多个非球面透镜组成的透镜组，其用于将从手指反射回来的反射光汇聚到其下方的光检测部分134的感应阵列，以使得所述感应阵列可以基于所述反射光进行成像，从而得到所述手指的指纹图像。可选地，所述光学透镜层在所述透镜单元的光路中还可以形成有针孔，所述针孔可以配合所述光学透镜层扩大所述指纹识别模组的视场，以提高所述指纹识别模组130的指纹成像效果。In another embodiment, the light guide layer or the light path guide structure may also be an optical lens (Lens) layer, which has one or more lens units, such as a lens group composed of one or more aspheric lenses, which The sensing array used to converge the reflected light reflected from the finger to the light detection part 134 below it, so that the sensing array can perform imaging based on the reflected light, thereby obtaining a fingerprint image of the finger. Optionally, the optical lens layer may further have a pinhole formed in the optical path of the lens unit, and the pinhole may cooperate with the optical lens layer to expand the field of view of the fingerprint recognition module to improve the The fingerprint imaging effect of the fingerprint identification module 130.
在其他实施例中，所述导光层或者光路引导结构也可以具体采用微透镜(Micro-Lens)层，所述微透镜层具有由多个微透镜形成的微透镜阵列，其可以通过半导体生长工艺或者其他工艺形成在所述光检测部分134的感应阵列上方，并且每一个微透镜可以分别对应于所述感应阵列的其中一个感应单元。并且，所述微透镜层和所述感应单元之间还可以形成其他光学膜层，比 如介质层或者钝化层，更具体地，所述微透镜层和所述感应单元之间还可以包括具有微孔的挡光层，其中所述微孔形成在其对应的微透镜和感应单元之间，所述挡光层可以阻挡相邻微透镜和感应单元之间的光学干扰，并使得所述感应单元所对应的光线通过所述微透镜汇聚到所述微孔内部并经由所述微孔传输到所述感应单元以进行光学指纹成像。应当理解，上述光路引导结构的几种实现方案可以单独使用也可以结合使用，比如，可以在所述准直器层或者所述光学透镜层下方进一步设置微透镜层。当然，在所述准直器层或者所述光学透镜层与所述微透镜层结合使用时，其具体叠层结构或者光路可能需要按照实际需要进行调整。In other embodiments, the light guide layer or the light path guide structure may also specifically adopt a micro-lens (Micro-Lens) layer. The micro-lens layer has a micro-lens array formed by a plurality of micro-lenses, which can be grown by semiconductors. A process or other processes are formed above the sensing array of the light detecting part 134, and each microlens may correspond to one of the sensing units of the sensing array. Moreover, other optical film layers may be formed between the microlens layer and the sensing unit, such as a dielectric layer or a passivation layer. More specifically, the microlens layer and the sensing unit may also include The light-blocking layer of the micro-hole, wherein the micro-hole is formed between the corresponding micro-lens and the sensing unit, the light-blocking layer can block the optical interference between the adjacent micro-lens and the sensing unit, and make the sensing The light corresponding to the unit is condensed into the microhole through the microlens and is transmitted to the sensing unit through the microhole to perform optical fingerprint imaging. It should be understood that several implementation solutions of the above-mentioned optical path guiding structure can be used alone or in combination. For example, a microlens layer can be further provided under the collimator layer or the optical lens layer. Of course, when the collimator layer or the optical lens layer is used in combination with the micro lens layer, its specific laminated structure or optical path may need to be adjusted according to actual needs.
作为一种可选的实施例，所述显示屏120可以采用具有自发光显示单元的显示屏，比如OLED显示屏或者微型发光二极管(Micro-LED)显示屏。以采用OLED显示屏为例，所述指纹识别模组130可以利用所述OLED显示屏120位于所述指纹检测区域103的显示单元(即OLED光源)来作为光学指纹检测的激励光源。当手指140按压在所述指纹检测区域103时，显示屏120向所述指纹检测区域103上方的目标手指140发出一束光111，该光111在手指140的表面发生反射形成反射光或者经过所述手指140内部散射而形成散射光，在相关专利申请中，为便于描述，上述反射光和散射光统称为反射光。由于指纹的嵴(ridge)与峪(valley)对于光的反射能力不同，因此，来自指纹嵴的反射光151和来自指纹峪的反射光152具有不同的光强，反射光经过光学组件132后，被指纹识别模组130中的感应阵列134所接收并转换为相应的电信号，即指纹检测信号；基于所述指纹检测信号便可以获得指纹图像数据，并且可以进一步进行指纹匹配验证，从而在所述终端设备10实现光学指纹识别功能。As an optional embodiment, the display screen 120 may be a display screen with a self-luminous display unit, such as an OLED display screen or a micro-LED (Micro-LED) display screen. Taking an OLED display screen as an example, the fingerprint identification module 130 can use the display unit (ie, an OLED light source) of the OLED display screen 120 located in the fingerprint detection area 103 as an excitation light source for optical fingerprint detection. When the finger 140 is pressed against the fingerprint detection area 103, the display screen 120 emits a beam of light 111 to the target finger 140 above the fingerprint detection area 103. The light 111 is reflected on the surface of the finger 140 to form reflected light or pass through all the fingers. The finger 140 scatters to form scattered light. In related patent applications, for ease of description, the above-mentioned reflected light and scattered light are collectively referred to as reflected light. Since the ridge and valley of the fingerprint have different light reflection capabilities, the reflected light 151 from the fingerprint ridge and the reflected light 152 from the fingerprint ridge have different light intensities. After the reflected light passes through the optical component 132, It is received by the sensor array 134 in the fingerprint identification module 130 and converted into a corresponding electrical signal, that is, a fingerprint detection signal; based on the fingerprint detection signal, fingerprint image data can be obtained, and fingerprint matching verification can be further performed, thereby The terminal device 10 realizes the optical fingerprint recognition function.
在其他实施例中，所述指纹识别模组130也可以采用内置光源或者外置光源来提供用于进行指纹检测的光信号。在这种情况下，所述指纹识别模组130可以适用于非自发光显示屏，比如液晶显示屏或者其他的被动发光显示屏。以应用在具有背光模组和液晶面板的液晶显示屏为例，为支持液晶显示屏的屏下指纹检测，所述终端设备10的光学指纹***还可以包括用于光学指纹检测的激励光源，所述激励光源可以具体为红外光源或者特定波长非可见光的光源，其可以设置在所述液晶显示屏的背光模组下方或者设置在所述终端设备10的保护盖板下方的边缘区域，而所述指纹识别模组130可以设 置液晶面板或者保护盖板的边缘区域下方并通过光路引导以使得指纹检测光可以到达所述指纹识别模组130；或者，所述指纹识别模组130也可以设置在所述背光模组下方，且所述背光模组通过对扩散片、增亮片、反射片等膜层进行开孔或者其他光学设计以允许指纹检测光穿过液晶面板和背光模组并到达所述指纹识别模组130。当采用所述指纹识别模组130采用内置光源或者外置光源来提供用于进行指纹检测的光信号时，其检测原理与上面描述内容是一致的。In other embodiments, the fingerprint identification module 130 may also use a built-in light source or an external light source to provide an optical signal for fingerprint detection. In this case, the fingerprint identification module 130 may be suitable for non-self-luminous display screens, such as liquid crystal display screens or other passively-luminous display screens. Taking a liquid crystal display with a backlight module and a liquid crystal panel as an example, in order to support the under-screen fingerprint detection of the liquid crystal display, the optical fingerprint system of the terminal device 10 may also include an excitation light source for optical fingerprint detection. The excitation light source may specifically be an infrared light source or a light source of invisible light of a specific wavelength, which may be arranged under the backlight module of the liquid crystal display or arranged in the edge area under the protective cover of the terminal device 10, and the The fingerprint identification module 130 can be arranged under the edge area of the liquid crystal panel or the protective cover and guided by the light path so that the fingerprint detection light can reach the fingerprint identification module 130; or, the fingerprint identification module 130 can also be arranged at all Below the backlight module, and the backlight module is designed to allow the fingerprint detection light to pass through the liquid crystal panel and the backlight module and reach the fingerprint by perforating film layers such as diffuser, brightness enhancement film, and reflective film or other optical designs Identification module 130. When the fingerprint identification module 130 adopts a built-in light source or an external light source to provide an optical signal for fingerprint detection, the detection principle is the same as that described above.
应当理解的是，在具体实现上，所述终端设备10还包括透明保护盖板，所述盖板可以为玻璃盖板或者蓝宝石盖板，其位于所述显示屏120的上方并覆盖所述终端设备10的正面。因为，本申请实施例中，所谓的手指按压在所述显示屏120实际上是指按压在所述显示屏120上方的盖板或者覆盖所述盖板的保护层表面。It should be understood that, in specific implementation, the terminal device 10 further includes a transparent protective cover, and the cover may be a glass cover or a sapphire cover, which is located above the display screen 120 and covers the terminal. The front of the device 10. Because, in the embodiment of the present application, the so-called finger pressing on the display screen 120 actually refers to pressing on the cover plate above the display screen 120 or covering the surface of the protective layer of the cover plate.
另一方面，在某些实施例中，所述指纹识别模组130可以仅包括一个光学指纹传感器，此时指纹识别模组130的指纹检测区域103的面积较小且位置固定，因此用户在进行指纹输入时需要将手指按压到所述指纹检测区域103的特定位置，否则指纹识别模组130可能无法采集到指纹图像而造成用户体验不佳。在其他替代实施例中，所述指纹识别模组130可以具体包括多个光学指纹传感器；所述多个光学指纹传感器可以通过拼接方式并排设置在所述显示屏120的下方，且所述多个光学指纹传感器的感应区域共同构成所述指纹识别模组130的指纹检测区域103。也即是说，所述指纹识别模组130的指纹检测区域103可以包括多个子区域，每个子区域分别对应于其中一个光学指纹传感器的感应区域，从而将所述指纹识别模组130的指纹采集区域103可以扩展到所述显示屏的下半部分的主要区域，即扩展到手指惯常按压区域，从而实现盲按式指纹输入操作。可替代地，当所述光学指纹传感器数量足够时，所述指纹检测区域130还可以扩展到半个显示区域甚至整个显示区域，从而实现半屏或者全屏指纹检测。On the other hand, in some embodiments, the fingerprint recognition module 130 may only include an optical fingerprint sensor. At this time, the fingerprint detection area 103 of the fingerprint recognition module 130 has a small area and a fixed position, so the user is performing During fingerprint input, it is necessary to press the finger to a specific position of the fingerprint detection area 103, otherwise the fingerprint recognition module 130 may not be able to collect the fingerprint image, resulting in poor user experience. In other alternative embodiments, the fingerprint recognition module 130 may specifically include a plurality of optical fingerprint sensors; the plurality of optical fingerprint sensors may be arranged side by side under the display screen 120 in a splicing manner, and the plurality of The sensing area of the optical fingerprint sensor collectively constitutes the fingerprint detection area 103 of the fingerprint identification module 130. In other words, the fingerprint detection area 103 of the fingerprint recognition module 130 may include multiple sub-areas, and each sub-area corresponds to the sensing area of one of the optical fingerprint sensors, so that the fingerprint of the fingerprint recognition module 130 is collected The area 103 can be expanded to the main area of the lower half of the display screen, that is, to the area where the finger is habitually pressed, so as to realize the blind fingerprint input operation. Alternatively, when the number of optical fingerprint sensors is sufficient, the fingerprint detection area 130 can also be extended to half of the display area or even the entire display area, thereby realizing half-screen or full-screen fingerprint detection.
还应理解，在本申请实施例中，指纹识别模组中的感应阵列也可以称为像素阵列，感应阵列中的光学感应单元或感应单元也可称为像素单元。It should also be understood that, in the embodiments of the present application, the sensing array in the fingerprint recognition module may also be referred to as a pixel array, and the optical sensing unit or sensing unit in the sensing array may also be referred to as a pixel unit.
需要说明的是，本申请实施例中的指纹识别模组也可以称为光学指纹识别模组、指纹识别装置、指纹模组、指纹采集装置等，上述术语可相互替换。It should be noted that the fingerprint identification module in the embodiments of the present application may also be referred to as an optical fingerprint identification module, a fingerprint identification device, a fingerprint module, a fingerprint acquisition device, etc., and the above terms can be replaced with each other.
在OLED屏下指纹识别模组中，指纹识别模组以OLED光源作为光学 指纹检测的激励光源，OLED光源经过手指反射后的指纹光信号被指纹识别模组中的光检测部分接收并处理，其中光检测部分中的感应阵列接收指纹光信号并将指纹光信号转换为电信号的时间为指纹图像的采集时间，例如，所述感应阵列为光电二极管(photo diode，PD)阵列，给该光电二极管阵列施加驱动电压，该光电二极管阵列开始接收指纹光信号并将该指纹光信号转换为电信号，当停止施加驱动电压时，该该光电二极管阵列停止转换电信号，此时，驱动电压的持续时间为指纹图像的采集时间。In the fingerprint recognition module under the OLED screen, the fingerprint recognition module uses an OLED light source as the excitation light source for optical fingerprint detection. The fingerprint light signal after the OLED light source is reflected by the finger is received and processed by the light detection part of the fingerprint recognition module. The time when the sensor array in the light detection part receives the fingerprint light signal and converts the fingerprint light signal into an electrical signal is the fingerprint image collection time. For example, the sensor array is a photodiode (PD) array. When the array applies a driving voltage, the photodiode array starts to receive the fingerprint light signal and converts the fingerprint light signal into an electrical signal. When the driving voltage is stopped, the photodiode array stops converting the electrical signal. At this time, the duration of the driving voltage Is the collection time of the fingerprint image.
OLED显示屏的发光单元是有机聚合物发光二级管，单色屏的一个像素就是一个发光二极管，多个像素形成像素阵列。要点亮一个像素，只要在该像素所在列电极上加上正电压、行电极接地。在OLED显示屏的显示过程中，行驱动电路依次产生低电平扫描像素阵列各行，列驱动电路读取显示数据依次加载到像素阵列的列电极上。完成一次全屏扫描，就叫做一帧，每一帧显示屏显示一个图像，不同帧显示的不同的图像，从而实现显示屏动态视频的显示。其中，每一帧的显示时间不变，显示屏上每秒显示的帧数，即每秒出现的图像数称为屏幕刷新频率，单位是赫兹(Hz)，每帧的显示时间与两帧之间的时间间隔之和等于屏幕刷新频率的倒数。在屏幕进行刷新时，两帧之间会有时间间隔，且下一帧的图像与前一帧图像不同，使得屏幕在刷新图像时，OLED光源会发生陡变。The light-emitting unit of the OLED display screen is an organic polymer light-emitting diode, and a pixel of a monochrome screen is a light-emitting diode, and multiple pixels form a pixel array. To light up a pixel, just apply a positive voltage to the column electrode where the pixel is located, and the row electrode is grounded. In the display process of the OLED display screen, the row drive circuit sequentially generates low-level scanning of each row of the pixel array, and the column drive circuit reads the display data and sequentially loads it on the column electrodes of the pixel array. After completing a full-screen scan, it is called a frame. Each frame displays an image on the screen, and different frames display different images, so as to realize the display of dynamic video on the screen. Among them, the display time of each frame does not change. The number of frames displayed on the screen per second, that is, the number of images that appear per second, is called the screen refresh frequency, and the unit is Hertz (Hz). The display time of each frame is between two frames. The sum of the time intervals is equal to the inverse of the screen refresh frequency. When the screen is refreshed, there will be a time interval between two frames, and the image of the next frame is different from the image of the previous frame, so that the OLED light source will change sharply when the screen is refreshing the image.
当OLED显示屏刷新显示图像时，若此时指纹识别模组正在进行指纹图像的采集，则接收OLED光源经过手指反射后的指纹光信号，则会受到陡变的光源影响，例如，如图2所示，当OLED屏幕刷新频率为30Hz，指纹识别模组采集时序中的指纹图像的采集时间为20ms时，每一帧的图像显示时间与相邻两帧之间的时间间隔之和约为33.3ms，指纹识别模组若在OLED屏幕刷新时进行采集指纹光信号，则会受到光源变化的影响，在指纹图像上出现横条纹，从而使指纹识别性能下降。When the OLED display screen refreshes the image, if the fingerprint recognition module is collecting fingerprint images at this time, it will receive the fingerprint light signal from the OLED light source reflected by the finger, which will be affected by the sharply changing light source, for example, as shown in Figure 2. It shows that when the refresh frequency of the OLED screen is 30Hz and the fingerprint image acquisition time in the fingerprint recognition module acquisition sequence is 20ms, the sum of the image display time of each frame and the time interval between two adjacent frames is about 33.3ms. If the fingerprint recognition module collects the fingerprint light signal when the OLED screen is refreshed, it will be affected by the change of the light source, and horizontal stripes will appear on the fingerprint image, which will reduce the fingerprint recognition performance.
基于此，本申请提供了一种指纹采集的方案，通过显示屏驱动模块控制显示屏的帧显示时间，使该帧显示时间大于指纹采集控制模块控制指纹识别模组采集指纹图像的时间，且在指纹识别模组采集指纹图像的时间内显示屏不进行刷新显示同一帧图像，因此，消除了显示屏刷新时的光源变化对指纹图像的影响，提高了指纹图像的质量，进而提升了指纹识别性能。Based on this, this application provides a fingerprint collection solution. The frame display time of the display screen is controlled by the display drive module so that the frame display time is longer than the time for the fingerprint acquisition control module to control the fingerprint recognition module to collect fingerprint images. The display screen does not refresh and display the same frame of image during the time when the fingerprint recognition module collects the fingerprint image. Therefore, the influence of light source changes on the fingerprint image when the display screen is refreshed is eliminated, the quality of the fingerprint image is improved, and the fingerprint recognition performance is improved. .
应理解，在本申请实施例中，该指纹采集过程可以称为是指纹识别过程， 指纹采集处理也可以称为指纹识别处理。It should be understood that in the embodiments of the present application, the fingerprint collection process may be referred to as a fingerprint identification process, and the fingerprint collection process may also be referred to as a fingerprint identification process.
图3是根据本申请实施例的指纹采集的方法200的示意性流程图，应用于具有显示屏和指纹识别模组的电子设备，其中，所述指纹识别模组设置于所述显示屏下方，用于接收经由所述显示屏上方的人体手指反射或散射而返回的所述显示屏的光信号以进行指纹图像采集。FIG. 3 is a schematic flowchart of a fingerprint collection method 200 according to an embodiment of the present application, which is applied to an electronic device having a display screen and a fingerprint recognition module, wherein the fingerprint recognition module is arranged under the display screen, It is used to receive the light signal of the display screen returned by the reflection or scattering of the human finger above the display screen for fingerprint image collection.
如图3所示，所述方法200包括：As shown in FIG. 3, the method 200 includes:
S210，控制所述显示屏在所述指纹识别模组进行指纹图像采集期间，以第一帧显示时间显示一帧图像，所述第一帧显示时间不小于指纹图像的采集时间；S210, controlling the display screen to display a frame of image with the first frame display time during the fingerprint image collection period of the fingerprint identification module, and the first frame display time is not less than the fingerprint image collection time;
S220，控制所述指纹识别模组采集所述指纹图像，其中，所述指纹图像的采集时间在所述一帧图像的显示时间范围内。S220: Control the fingerprint identification module to collect the fingerprint image, wherein the collection time of the fingerprint image is within the display time range of the one frame image.
可选地，所述电子设备可以为图1中的终端设备10，所述显示屏可以为图1中的显示屏120，所述指纹识别模组可以为图1中的指纹识别模组130。Optionally, the electronic device may be the terminal device 10 in FIG. 1, the display screen may be the display screen 120 in FIG. 1, and the fingerprint identification module may be the fingerprint identification module 130 in FIG. 1.
在一些实施例中，所述指纹识别的***为处理单元或者所述处理单元可以包括所述指纹识别的***，该处理单元可以是电子设备的处理器或控制器，所述显示屏驱动模块和所述指纹采集控制模块可以为运行在所述处理单元上的软件模块，控制电子设备上的显示屏以及指纹识别模组。In some embodiments, the fingerprint recognition system is a processing unit or the processing unit may include the fingerprint recognition system, the processing unit may be a processor or a controller of an electronic device, the display driving module and The fingerprint collection control module may be a software module running on the processing unit to control a display screen and a fingerprint identification module on an electronic device.
应理解，所述显示屏驱动模块还可以控制所述显示屏以第一帧显示时间显示多帧图像，所述指纹识别模组可以在所述多帧图像中的一帧图像的显示时间内采集一次指纹图像，所述指纹识别模组还可以采集多次指纹图像，每一次采集指纹图像的时间在所述多帧图像中的一帧图像的显示时间内，本申请实施例对此不做限定。It should be understood that the display screen driving module can also control the display screen to display multiple frames of images with the first frame of display time, and the fingerprint recognition module can collect images within the display time of one frame of the multiple frames of images. For one fingerprint image, the fingerprint recognition module can also collect multiple fingerprint images, and the time for each fingerprint image collection is within the display time of one frame of the multiple frames of images, which is not limited in the embodiment of the application .
可选地，所述显示屏和所述指纹识别模组分别通过显示屏驱动模块和指纹采集控制模块进行驱动，图4示出了根据本申请实施例的另一指纹采集的方法300的示意性流程图。Optionally, the display screen and the fingerprint identification module are respectively driven by a display screen drive module and a fingerprint collection control module. FIG. 4 shows a schematic diagram of another fingerprint collection method 300 according to an embodiment of the present application. flow chart.
如图4所示，所述方法300包括：As shown in FIG. 4, the method 300 includes:
S310，所述显示屏驱动模块控制所述显示屏以所述第一帧显示时间显示所述一帧图像；S310: The display screen driving module controls the display screen to display the one frame of image in the first frame display time;
S320，所述显示屏驱动模块向所述指纹采集控制模块发送第一指示信息；S320: The display screen driving module sends first instruction information to the fingerprint collection control module;
S330，所述指纹采集控制模块接收所述第一指示信息，并基于所述第一 指示信息控制所述指纹识别模组采集所述指纹图像。S330. The fingerprint acquisition control module receives the first instruction information, and controls the fingerprint identification module to acquire the fingerprint image based on the first instruction information.
例如，如图5所示，所述第一帧显示时间为T1，指纹图像的采集时间为S1，其中S1≤T1。如图5中的(a)所示，显示屏将在t1时刻开始以第一帧显示时间显示一帧图像，所述显示屏驱动模块在t1时刻发送第一指示信息给指纹采集控制模块，所述指纹采集控制模块在t1时刻开始进行指纹图像采集。如图5中的(b)所示，显示屏将在t1时刻开始以第一帧显示时间显示一帧图像，所述显示屏驱动模块在t1时刻之后的t2时刻发送第一指示信息给指纹采集控制模块，所述指纹采集控制模块在t2时刻开始进行指纹图像采集，其中，t2＝t1+T1-S1。For example, as shown in FIG. 5, the display time of the first frame is T1, and the collection time of the fingerprint image is S1, where S1≤T1. As shown in (a) in Figure 5, the display screen will start to display a frame of image with the first frame display time at time t1, and the display screen driving module sends the first instruction information to the fingerprint collection control module at time t1. The fingerprint collection control module starts to collect fingerprint images at time t1. As shown in (b) in Figure 5, the display screen will start to display a frame of image at the first frame display time at time t1, and the display driving module will send the first instruction information to the fingerprint collector at time t2 after time t1 The control module, the fingerprint collection control module starts fingerprint image collection at time t2, where t2=t1+T1-S1.
应理解，所述指纹采集控制模块开始进行指纹图像采集的时刻还可以为其它满足所述指纹图像的采集时间在所述一帧图像的显示时间范围内的时刻。例如，在图5中，所述开始进行指纹图像采集的时刻可以为t1至t2之间的任意时刻。It should be understood that the moment when the fingerprint collection control module starts to collect the fingerprint image may also be another moment that satisfies the collection time of the fingerprint image within the display time range of the one frame of image. For example, in FIG. 5, the time when fingerprint image collection is started may be any time between t1 and t2.
在一种可能的实施方式中，如图6所示，当OLED屏幕刷新频率为60Hz，光学指纹装置采集时序中的指纹图像的采集时间为20ms时，每一帧的图像显示时间与相邻两帧之间的时间间隔之和约为16.7ms，每一帧的帧显示时间小于指纹图像的采集时间，则光学指纹装置必然会受到光源变化的影响，在指纹图像上出现横条纹。In a possible implementation, as shown in FIG. 6, when the refresh frequency of the OLED screen is 60 Hz, and the fingerprint image acquisition time in the acquisition sequence of the optical fingerprint device is 20 ms, the image display time of each frame is equal to that of adjacent two. The sum of the time intervals between frames is about 16.7ms, and the frame display time of each frame is less than the fingerprint image collection time, the optical fingerprint device will inevitably be affected by the change of the light source, and horizontal stripes appear on the fingerprint image.
可选地，图7是根据本申请实施例的另一指纹采集的方法400的示意性流程图。如图7所示，所述方法400包括：Optionally, FIG. 7 is a schematic flowchart of another method 400 for fingerprint collection according to an embodiment of the present application. As shown in FIG. 7, the method 400 includes:
S420，所述显示屏驱动模块比较所述显示屏的原始帧显示时间与所述指纹图像的采集时间。S420: The display screen driving module compares the display time of the original frame of the display screen with the collection time of the fingerprint image.
S431，当所述显示屏的原始帧显示时间小于所述指纹图像的采集时间时，所述显示屏驱动模块调整所述显示屏的帧显示时间至所述第一帧显示时间。S431: When the original frame display time of the display screen is less than the fingerprint image acquisition time, the display screen driving module adjusts the frame display time of the display screen to the first frame display time.
S432，当所述显示屏的原始帧显示时间不小于所述指纹图像的采集时间时，不调整所述显示屏的帧显示时间，所述第一帧显示时间为所述原始帧显示时间。S432: When the original frame display time of the display screen is not less than the fingerprint image acquisition time, the frame display time of the display screen is not adjusted, and the first frame display time is the original frame display time.
可选地，所述显示屏的帧显示时间对应屏幕刷新频率，每帧的帧显示时间与两帧之间的时间间隔之和等于屏幕刷新频率的倒数。所述显示屏驱动模块可以通过调整所述显示屏的屏幕刷新频率以调整所述显示屏的帧显示时 间至所述第一帧显示时间。Optionally, the frame display time of the display screen corresponds to the screen refresh frequency, and the sum of the frame display time of each frame and the time interval between two frames is equal to the reciprocal of the screen refresh frequency. The display screen driving module can adjust the frame display time of the display screen to the first frame display time by adjusting the screen refresh frequency of the display screen.
可选地，当所述显示屏的原始帧显示时间小于等于所述指纹图像的采集时间时，所述显示屏驱动模块降低所述显示屏的原始屏幕刷新频率得到第一中间屏幕刷新频率和第一中间帧显示时间，所述显示屏驱动模块比较所述第一中间帧显示时间与所述指纹图像的采集时间，当所述第一中间帧显示时间小于等于所述指纹图像的采集时间时，继续降低所述第一中间屏幕刷新频率，得到第二中间屏幕刷新频率和第二中间帧显示时间并与所述指纹图像采集时间比较，按照此方式继续进行，直至降低至第一屏幕刷新频率时，所述第一帧显示时间不小于所述指纹图像采集的时间。Optionally, when the original frame display time of the display screen is less than or equal to the fingerprint image collection time, the display screen driving module reduces the original screen refresh frequency of the display screen to obtain the first intermediate screen refresh frequency and the first intermediate screen refresh frequency. An intermediate frame display time. The display driving module compares the first intermediate frame display time with the fingerprint image acquisition time, and when the first intermediate frame display time is less than or equal to the fingerprint image acquisition time, Continue to reduce the refresh rate of the first middle screen to obtain the refresh rate of the second middle screen and the display time of the second middle frame and compare them with the fingerprint image acquisition time, continue in this way until the refresh rate of the first screen is reduced , The display time of the first frame is not less than the fingerprint image collection time.
可选地，所述显示屏驱动模块降低所述显示屏的屏幕刷新频率的方式可以是将所述显示屏的当前屏幕刷新频率降低一半。应理解，降低显示屏的屏幕刷新频率的方式还可以为当前屏幕刷新频率减去预设频率值，直至得到第一屏幕刷新频率下，第一帧显示时间大于所述指纹图像采集时间等其它方式。本申请实施例对此不做限定。Optionally, the manner in which the display screen driving module reduces the screen refresh frequency of the display screen may be to reduce the current screen refresh frequency of the display screen by half. It should be understood that the way to reduce the screen refresh frequency of the display screen can also be the current screen refresh frequency minus the preset frequency value, until the first screen refresh frequency is obtained, the first frame display time is greater than the fingerprint image acquisition time, etc. . The embodiments of this application do not limit this.
可选地，如图7所示，所述方法400还包括：Optionally, as shown in FIG. 7, the method 400 further includes:
S440，所述显示屏驱动模块控制所述显示屏以所述第一帧显示时间显示所述一帧图像。S440: The display screen driving module controls the display screen to display the one frame of image in the first frame display time.
S450，所述显示屏驱动模块向所述指纹采集控制模块发送第一指示信息。S450: The display screen driving module sends first instruction information to the fingerprint collection control module.
S460，所述指纹采集控制模块基于所述第一指示信息控制所述指纹识别模组采集所述指纹图像。S460: The fingerprint collection control module controls the fingerprint identification module to collect the fingerprint image based on the first indication information.
以上S440～S460与图4中S310～S330步骤相同，具体实施方案可以参照图4，此处不再赘述。The above steps S440 to S460 are the same as the steps S310 to S330 in FIG. 4, and the specific implementation can refer to FIG. 4, which will not be repeated here.
在一种可能的实施方式中，例如，如图8中的(a)所示，显示屏屏幕刷新频率为f2，第一帧显示时间为T2，指纹图像的采集时间为S2，其中S2＞T2。所述显示屏驱动模块比较S2与T2的大小，由于S2＞T2，则所述显示屏驱动模块将屏幕刷新频率f2降低为f2/2，此时，帧显示时间为T3，所述显示屏驱动模块比较T3与S2的大小，当S2≤T3时，所述显示屏驱动模块在t3时刻发送第一指示信息给指纹采集控制模块，所述指纹采集控制模块开始进行指纹图像采集。In a possible implementation, for example, as shown in (a) in Figure 8, the screen refresh frequency of the display screen is f2, the display time of the first frame is T2, and the fingerprint image acquisition time is S2, where S2>T2 . The display screen drive module compares the size of S2 and T2. Since S2>T2, the display screen drive module reduces the screen refresh frequency f2 to f2/2. At this time, the frame display time is T3, and the display screen driver The module compares the size of T3 and S2. When S2≤T3, the display driving module sends the first instruction information to the fingerprint collection control module at time t3, and the fingerprint collection control module starts fingerprint image collection.
可选地，如图7所示，所述方法400还包括：Optionally, as shown in FIG. 7, the method 400 further includes:
S411，所述显示屏驱动模块接收所述指纹采集控制模块发送的所述指纹图像的采集时间。S411: The display screen driving module receives the collection time of the fingerprint image sent by the fingerprint collection control module.
S412，所述显示屏驱动模块获取手指触摸信息，基于所述手指触摸信息获取预设的所述指纹图像的采集时间。S412: The display screen driving module obtains finger touch information, and obtains a preset collection time of the fingerprint image based on the finger touch information.
具体地，所述显示屏为具有触摸感应功能的触摸显示屏，手指在所述触摸显示屏上触摸，所述触摸显示屏上手指触摸区域的电容或者电压发生变化，从而产生触摸显示屏上的手指触摸信息。Specifically, the display screen is a touch display screen with touch sensing function. When a finger touches the touch display screen, the capacitance or voltage of the finger touch area on the touch display screen changes, thereby generating Finger touch information.
具体地，所述指纹图像的采集时间为所述指纹识别模组的物理参数，可以以预设值的形式存储在所述指纹识别模组所在的电子设备的处理器或者内存中。Specifically, the collection time of the fingerprint image is a physical parameter of the fingerprint identification module, which may be stored in the processor or memory of the electronic device where the fingerprint identification module is located in the form of a preset value.
可选地，所述显示屏驱动模块可以在接收手指触摸信息之后，接收所述指纹采集控制模块发送的所述指纹图像的采集时间或者获取预设的所述指纹图像的采集时间。Optionally, the display screen driving module may receive the fingerprint image collection time sent by the fingerprint collection control module or acquire the preset fingerprint image collection time after receiving the finger touch information.
可选地，如图7所示，所述指纹采集方法400还包括：Optionally, as shown in FIG. 7, the fingerprint collection method 400 further includes:
S470，所述指纹采集控制模块向所述显示屏驱动模块发送第二指示信息。S470: The fingerprint collection control module sends second instruction information to the display screen driving module.
S480，所述显示屏驱动模块根据所述第二指示信息将所述显示屏的帧显示时间恢复至所述原始帧显示时间。S480: The display screen driving module restores the frame display time of the display screen to the original frame display time according to the second instruction information.
可选地，所述显示屏驱动模块可以通过提高所述显示屏的屏幕刷新频率以将所述显示屏的帧显示时间恢复至所述原始帧显示时间。Optionally, the display screen driving module can restore the frame display time of the display screen to the original frame display time by increasing the screen refresh frequency of the display screen.
在一种可能的实施方式中，例如，如图8中的(b)所示，显示屏屏幕刷新频率为f2，原始帧显示时间为T2，指纹图像采集时间为S2，其中S2＞T2，所述显示屏驱动模块将屏幕刷新频率f2降低为f2/2，此时，第一帧显示时间为T3，所述指纹采集控制模块在t3时刻开始进行指纹图像采集，经过S2后，所述指纹采集控制模块在t4时刻完成指纹图像采集，向所述显示屏驱动模块发送第二指示信息，所述显示屏驱动模块根据所述第二指示信息将所述显示屏的第一帧显示时间T3恢复至所述原始帧显示时间T2。In a possible implementation, for example, as shown in (b) in Figure 8, the screen refresh frequency of the display screen is f2, the original frame display time is T2, and the fingerprint image acquisition time is S2, where S2>T2, so The display drive module reduces the screen refresh frequency f2 to f2/2. At this time, the display time of the first frame is T3, and the fingerprint acquisition control module starts fingerprint image acquisition at t3. After S2, the fingerprint acquisition The control module completes fingerprint image acquisition at time t4, and sends second instruction information to the display screen drive module, and the display screen drive module restores the display time of the first frame of the display screen to T3 according to the second instruction information The original frame shows time T2.
可选地，所述指纹采集控制模块完成所述指纹图像的采集后，对所述指纹图像进行指纹图像处理、特征提取、指纹匹配等操作。Optionally, after the fingerprint collection control module completes the collection of the fingerprint image, it performs fingerprint image processing, feature extraction, fingerprint matching and other operations on the fingerprint image.
在本申请实施例中，在指纹采集控制模块完成指纹图像采集之后，所述显示屏驱动模块恢复所述原始帧显示时间，对所述显示屏的显示不造成影 响，兼顾屏幕的显示效果以及指纹图像采集质量。In the embodiment of the present application, after the fingerprint acquisition control module completes the fingerprint image acquisition, the display screen drive module restores the original frame display time, does not affect the display of the display screen, and takes into account the display effect of the screen and the fingerprint Image acquisition quality.
目前，电子设备的处理器，如中央处理器(central processing unit，CPU)的操作***(operating system，OS)可以包括两大运行环境，一种是富执行环境(rich execution environment，REE)，运行在其内部的应用为客户应用(client application，CA)；另一种是可信执行环境(trusted execution enviroment，TEE)，运行在其内部的应用为可信应用(trusted application，TA)。TEE是指在主处理器的OS内的一个独立的安全运行环境，该环境与REE相互隔离，独立运行，例如，TrustZone环境，或者，高通的QSEE TEE，安全(Secure)数字信号处理(digital signal processing，DSP)等。与REE中的CA所不同的是，TEE为TA提供一系列的安全服务，包括应用执行的完整性、安全存储、与输入输出设备的安全交互、密钥管理、加密算法以及与REE中的CA进行安全通信等。由于指纹识别功能对安全性的需求较高，因此指纹采集***的控制以及识别功能需要运行在安全可靠的TEE环境中。At present, the processor of an electronic device, such as the operating system (OS) of the central processing unit (CPU), can include two operating environments, one is the rich execution environment (REE), which runs The internal application is a client application (CA); the other is a trusted execution environment (TEE), and the internal application is a trusted application (TA). TEE refers to an independent safe operating environment in the OS of the main processor, which is isolated from REE and runs independently, for example, the TrustZone environment, or Qualcomm’s QSEE TEE, secure digital signal processing (digital signal processing) processing, DSP), etc. Different from the CA in REE, TEE provides a series of security services for TA, including application execution integrity, secure storage, secure interaction with input and output devices, key management, encryption algorithm, and CA in REE For secure communications, etc. Because the fingerprint recognition function has high requirements for security, the control and recognition functions of the fingerprint acquisition system need to run in a safe and reliable TEE environment.
可选地，在本申请一个实施例中，所述指纹采集控制模块包括指纹服务模块、指纹应用模块和指纹驱动模块。Optionally, in an embodiment of the present application, the fingerprint collection control module includes a fingerprint service module, a fingerprint application module, and a fingerprint drive module.
可选地，所述指纹服务模块和所述指纹驱动模块可以运行在REE环境中，具体地，所述指纹服务模块运行在操作***的用户空间(user space)中的硬件抽象层(hardware abstract layer，HAL)，所述硬件抽象层是位于操作***内核层与硬件电路之间的接口层，其目的在于将硬件抽象化，为用户提供接口。所述指纹驱动模块和所述显示屏驱动模块运行在操作***的内核(knernel space)空间中的内核层，为驱动指纹采集***中的指纹采集控制模块进行指纹图像采集。Optionally, the fingerprint service module and the fingerprint driver module may run in a REE environment. Specifically, the fingerprint service module runs in a hardware abstract layer in the user space of the operating system. , HAL), the hardware abstraction layer is an interface layer between the operating system kernel layer and the hardware circuit, and its purpose is to abstract the hardware and provide an interface for users. The fingerprint drive module and the display screen drive module run at the kernel layer in the kernel (knernel space) space of the operating system, and perform fingerprint image acquisition for driving the fingerprint acquisition control module in the fingerprint acquisition system.
由于指纹采集***对于安全性能的要求，需要通过运行在安全环境TEE中的指纹应用模块对所述指纹服务模块和所述指纹驱动模块进行通信，以保证指纹采集***的安全性。所述指纹应用模块用于控制指纹图像采集，并对采集到的指纹图像进行图像处理以及指纹识别。对应的，所述指纹应用模块可以为TA。Due to the security performance requirements of the fingerprint collection system, the fingerprint service module and the fingerprint drive module need to be communicated with the fingerprint application module running in the secure environment TEE to ensure the security of the fingerprint collection system. The fingerprint application module is used to control fingerprint image collection, and perform image processing and fingerprint recognition on the collected fingerprint image. Correspondingly, the fingerprint application module may be TA.
可选地，如图9所示，图7中步骤S460指纹采集控制模块基于所述第一指示信息控制所述指纹识别模组采集所述指纹图像可以包括：Optionally, as shown in FIG. 9, step S460 in FIG. 7 by the fingerprint collection control module controlling the fingerprint identification module to collect the fingerprint image based on the first indication information may include:
S461，所述指纹服务模块接收所述第一指示信息，并发送通知消息给所述指纹应用模块，所述通知消息为指示开始进行指纹图像采集的消息。S461: The fingerprint service module receives the first instruction information, and sends a notification message to the fingerprint application module, where the notification message is a message instructing to start fingerprint image collection.
具体地，REE环境中位于HAL层的所述指纹服务模块接收显示屏驱动模块发送的第一指示信息后，发送通知消息给位于TEE环境的指纹应用模块。所述通知消息由非安全环境REE发送至安全环境TEE中，需要满足TEE通信协议的具体要求。可选地，所述指纹服务模块可以通过TEE客户端应用程序接口(application programming interface，API)与所述指纹应用模块之间进行通信。Specifically, after the fingerprint service module located in the HAL layer in the REE environment receives the first indication information sent by the display screen driver module, it sends a notification message to the fingerprint application module located in the TEE environment. The notification message is sent from the non-secure environment REE to the secure environment TEE, and needs to meet the specific requirements of the TEE communication protocol. Optionally, the fingerprint service module may communicate with the fingerprint application module through a TEE client application program interface (application programming interface, API).
S462，所述指纹应用模块接收所述通知消息，并发送控制消息给所述指纹驱动模块，所述控制消息为控制所述指纹驱动模块进行指纹图像采集的消息。S462: The fingerprint application module receives the notification message, and sends a control message to the fingerprint driving module, where the control message is a message for controlling the fingerprint driving module to collect fingerprint images.
具体地，位于TEE环境中的所述指纹应用模块接收到通知消息后，发送控制消息以控制位于***内核层中的指纹驱动模块进行指纹图像采集。可选地，所述指纹驱动模块位于REE环境的***内核层中。Specifically, after receiving the notification message, the fingerprint application module located in the TEE environment sends a control message to control the fingerprint drive module located in the system kernel layer to collect fingerprint images. Optionally, the fingerprint drive module is located in the system kernel layer of the REE environment.
S463，所述指纹驱动模块接收所述控制消息以控制所述指纹识别模组采集所述指纹图像。S463: The fingerprint driving module receives the control message to control the fingerprint identification module to collect the fingerprint image.
具体地，所述指纹驱动模块接收控制消息后，驱动所述指纹识别模组，开启所述指纹识别模组中的感应阵列，接收经过手指反射的显示屏光信号，并将所述经过手指反射的显示屏光信号转为指纹图像信号。Specifically, after receiving the control message, the fingerprint drive module drives the fingerprint recognition module, turns on the sensing array in the fingerprint recognition module, receives the light signal of the display screen reflected by the finger, and reflects the fingerprint The light signal of the display screen is converted into a fingerprint image signal.
可选地，在本申请实施例中，所述指纹驱动模块接收所述控制消息以控制所述指纹识别模组采集所述指纹图像之后，如图10所示，指纹采集方法500包括：Optionally, in the embodiment of the present application, after the fingerprint driving module receives the control message to control the fingerprint identification module to collect the fingerprint image, as shown in FIG. 10, the fingerprint collection method 500 includes:
S510，所述指纹应用模块接收所述指纹图像，并对所述指纹图像进行指纹识别得到指纹识别结果。S510: The fingerprint application module receives the fingerprint image, and performs fingerprint recognition on the fingerprint image to obtain a fingerprint recognition result.
在本申请一个实施例中，所述指纹识别模组采集到的指纹图像以及所述指纹应用模块处理过后的指纹识别结果均不能发送和存储到不可信的内存空间中，所有指纹图像信号和指纹识别结果都需要被放到可信内存中进行保护。其中，所述指纹识别结果包括指纹图像数据以及指纹特征数据等与手指相关的信息数据，所述可信内存为TEE环境中的内存。In an embodiment of the present application, neither the fingerprint image collected by the fingerprint recognition module nor the fingerprint recognition result processed by the fingerprint application module can be sent and stored in an untrusted memory space. All fingerprint image signals and fingerprints All recognition results need to be placed in trusted memory for protection. Wherein, the fingerprint recognition result includes fingerprint image data and fingerprint feature data and other information data related to the finger, and the trusted memory is the memory in the TEE environment.
S520，所述指纹应用模块将所述指纹识别结果发送给所述指纹服务模块。S520: The fingerprint application module sends the fingerprint identification result to the fingerprint service module.
S530，所述指纹服务模块将所述指纹识别结果发送给客户应用模块。S530: The fingerprint service module sends the fingerprint identification result to the client application module.
具体地，所述客户应用模块为运行在REE环境中的客户应用软件CA， 可以与用户进行交互。所述指纹应用模块将所述指纹识别结果发送给所述客户应用模块，所述客户应用模块可以将所述指纹识别结果呈现给用户，例如，所述客户应用软件可以为支付宝等需要安全登录的软件，可以支持指纹识别登录的方式，当指纹识别结果为指纹识别认证成功时，用户可以直接通过指纹登录软件。Specifically, the client application module is the client application software CA running in the REE environment, which can interact with the user. The fingerprint application module sends the fingerprint recognition result to the customer application module, and the customer application module can present the fingerprint recognition result to the user. For example, the customer application software may be Alipay and other applications that require secure login. The software can support fingerprint identification and login. When the fingerprint identification result is a successful fingerprint identification authentication, the user can log in to the software directly through fingerprints.
上文结合图3至图10，详细描述了本申请的方法实施例，下文结合图11至图13，详细描述本申请的装置实施例，应理解，装置实施例与方法实施例相互对应，类似的描述可以参照方法实施例。The method embodiments of the present application are described in detail above with reference to FIGS. 3 to 10, and the apparatus embodiments of the present application are described in detail below in conjunction with FIGS. 11 to 13. It should be understood that the apparatus embodiments and the method embodiments correspond to each other and are similar The description can refer to the method embodiment.
图11是根据本申请实施例的指纹采集***的示意性框图，所述指纹采集***应用于具有显示屏和指纹识别模组的电子设备，其中，所述指纹识别模组设置于所述显示屏下方，用于接收经由所述显示屏上方的人体手指反射或散射而返回的所述显示屏的光信号以进行指纹图像采集。11 is a schematic block diagram of a fingerprint collection system according to an embodiment of the present application, the fingerprint collection system is applied to an electronic device having a display screen and a fingerprint recognition module, wherein the fingerprint recognition module is arranged on the display screen The lower part is used to receive the light signal of the display screen returned by the reflection or scattering of the human finger above the display screen for fingerprint image collection.
如图11所示，该指纹采集***600包括：显示屏驱动模块610和指纹采集控制模块620；As shown in FIG. 11, the fingerprint collection system 600 includes: a display screen driving module 610 and a fingerprint collection control module 620;
所述显示屏驱动模块610用于控制所述显示屏在所述指纹识别模组进行指纹图像采集期间，以第一帧显示时间显示一帧图像，所述第一帧显示时间不小于指纹图像的采集时间；The display screen driving module 610 is used to control the display screen to display a frame of image with the first frame of display time during the fingerprint image collection period of the fingerprint identification module, and the first frame of display time is not less than the fingerprint image Acquisition time
所述指纹采集控制模块620用于控制所述指纹识别模组采集所述指纹图像，其中，所述指纹图像的采集时间在所述一帧图像的显示时间范围内。The fingerprint collection control module 620 is configured to control the fingerprint identification module to collect the fingerprint image, wherein the collection time of the fingerprint image is within the display time range of the one frame image.
可选地，在本申请的一个实施例中，所述指纹采集***600可以为处理单元或者所述处理单元包括所述指纹采集***600，该处理单元可以为电子设备的处理器或控制器。所述显示屏驱动模块610和所述指纹采集控制模块620为运行在所述处理器或控制器上的软件模块，驱动所述指纹采集***所在的电子设备上的显示屏以及指纹识别模组。Optionally, in an embodiment of the present application, the fingerprint acquisition system 600 may be a processing unit or the processing unit includes the fingerprint acquisition system 600, and the processing unit may be a processor or a controller of an electronic device. The display screen driving module 610 and the fingerprint acquisition control module 620 are software modules running on the processor or controller, and drive the display screen and fingerprint identification module on the electronic device where the fingerprint acquisition system is located.
可选地，所述显示屏驱动模块610还用于在控制所述显示屏以所述第一帧显示时间显示所述一帧图像后，向所述指纹采集控制模块620发送第一指示信息；Optionally, the display screen driving module 610 is further configured to send the first instruction information to the fingerprint collection control module 620 after controlling the display screen to display the one frame of image in the first frame display time;
所述第一指示信息用于指示所述指纹采集控制模块620控制所述指纹识别模组采集所述指纹图像。The first indication information is used to instruct the fingerprint collection control module 620 to control the fingerprint identification module to collect the fingerprint image.
可选地，在本申请的一个实施例中，所述显示屏驱动模块610还用于，在控制所述显示屏以所述第一帧显示时间显示所述一帧图像前，比较所述显 示屏的原始帧显示时间与所述指纹图像的采集时间，并基于比较结果控制所述显示屏以所述第一帧显示时间显示所述一帧图像。Optionally, in an embodiment of the present application, the display screen driving module 610 is further configured to: before controlling the display screen to display the one frame of image at the first frame display time, compare the display The display time of the original frame of the screen and the collection time of the fingerprint image, and based on the comparison result, the display screen is controlled to display the one frame of image with the first frame display time.
可选地，在本申请的一个实施例中，所述显示屏驱动模块610具体用于，当所述比较结果为所述显示屏的原始帧显示时间小于所述指纹图像的采集时间时，调整所述显示屏的帧显示时间至所述第一帧显示时间。Optionally, in an embodiment of the present application, the display screen driving module 610 is specifically configured to adjust when the comparison result is that the original frame display time of the display screen is less than the fingerprint image acquisition time The frame display time of the display screen to the first frame display time.
可选地，在本申请的一个实施例中，所述显示屏驱动模块610具体用于，当所述比较结果为所述显示屏的原始帧显示时间不小于所述指纹图像的采集时间时，不调整所述显示屏的帧显示时间，所述第一帧显示时间为所述原始帧显示时间。Optionally, in an embodiment of the present application, the display screen driving module 610 is specifically configured to: when the comparison result is that the display time of the original frame of the display screen is not less than the collection time of the fingerprint image, The frame display time of the display screen is not adjusted, and the first frame display time is the original frame display time.
可选地，在本申请的一个实施例中，所述显示屏驱动模块610还用于，在比较所述显示屏的原始帧显示时间与所述指纹图像的采集时间前，接收所述指纹采集控制模块620发送的所述指纹图像的采集时间。Optionally, in an embodiment of the present application, the display screen driving module 610 is further configured to receive the fingerprint collection before comparing the display time of the original frame of the display screen with the collection time of the fingerprint image The collection time of the fingerprint image sent by the control module 620.
可选地，在本申请的一个实施例中，所述显示屏驱动模块610还用于，在比较所述显示屏的原始帧显示时间与所述指纹图像的采集时间前，获取手指触摸信息，基于所述手指触摸信息获取预设的所述指纹图像的采集时间。Optionally, in an embodiment of the present application, the display screen driving module 610 is further configured to obtain finger touch information before comparing the display time of the original frame of the display screen with the collection time of the fingerprint image, Obtain a preset collection time of the fingerprint image based on the finger touch information.
可选地，在本申请的一个实施例中，所述指纹采集控制模块620还用于，在控制所述指纹识别模组采集所述指纹图像后，向所述显示屏驱动模块610发送第二指示信息；Optionally, in an embodiment of the present application, the fingerprint collection control module 620 is further configured to, after controlling the fingerprint identification module to collect the fingerprint image, send a second second to the display screen driving module 610 Instruction information
所述显示屏驱动模块还用于根据所述第二指示信息将所述显示屏的帧显示时间恢复至所述原始帧显示时间。The display screen driving module is further configured to restore the frame display time of the display screen to the original frame display time according to the second instruction information.
可选地，完成所述指纹图像的采集后，所述指纹采集控制模块620还用于对所述指纹图像进行指纹图像处理、特征提取、指纹匹配等操作。Optionally, after completing the fingerprint image collection, the fingerprint collection control module 620 is further configured to perform fingerprint image processing, feature extraction, fingerprint matching and other operations on the fingerprint image.
可选地，所述显示屏的帧显示时间对应屏幕刷新频率，所述显示屏驱动模块610可以通过调整所述显示屏的屏幕刷新频率以调整所述显示屏的帧显示时间。Optionally, the frame display time of the display screen corresponds to the screen refresh frequency, and the display screen driving module 610 can adjust the frame display time of the display screen by adjusting the screen refresh frequency of the display screen.
可选地，在本申请的一个实施例中，如图12所示，所述指纹采集控制模块620包括指纹服务模块621、指纹应用模块622和指纹驱动模块623。Optionally, in an embodiment of the present application, as shown in FIG. 12, the fingerprint collection control module 620 includes a fingerprint service module 621, a fingerprint application module 622, and a fingerprint drive module 623.
可选地，所述指纹服务模块621具体用于接收所述第一指示信息，并发送通知消息给所述指纹应用模块622，所述通知消息为指示开始采集所述指纹图像的消息；Optionally, the fingerprint service module 621 is specifically configured to receive the first instruction information, and send a notification message to the fingerprint application module 622, where the notification message is a message instructing to start collecting the fingerprint image;
可选地，所述指纹应用模块622具体用于接收所述通知消息，并发送控 制消息给所述指纹驱动模块623，所述控制消息为控制所述指纹驱动模块采集所述指纹图像的消息；Optionally, the fingerprint application module 622 is specifically configured to receive the notification message and send a control message to the fingerprint driving module 623, where the control message is a message for controlling the fingerprint driving module to collect the fingerprint image;
可选地，所述指纹驱动模块623具体用于接收所述控制消息以控制所述指纹识别模组采集所述指纹图像。Optionally, the fingerprint driving module 623 is specifically configured to receive the control message to control the fingerprint identification module to collect the fingerprint image.
可选地，所述指纹应用模块622还用于接收所述指纹图像，并对所述指纹图像信号进行图像处理和指纹识别得到指纹识别结果。Optionally, the fingerprint application module 622 is further configured to receive the fingerprint image, and perform image processing and fingerprint recognition on the fingerprint image signal to obtain a fingerprint recognition result.
可选地，如图12所示，所述指纹识别***600还包括客户应用模块630。所述指纹应用模块622还用于将所述指纹识别结果发送给所述指纹服务模块621；Optionally, as shown in FIG. 12, the fingerprint identification system 600 further includes a client application module 630. The fingerprint application module 622 is further configured to send the fingerprint identification result to the fingerprint service module 621;
所述指纹服务模块621将所述指纹识别结果发送给所述客户应用模块630。The fingerprint service module 621 sends the fingerprint identification result to the client application module 630.
具体地，所述客户应用模块630为运行在REE环境中的客户端应用软件CA，可以与用户进行交互。Specifically, the client application module 630 is the client application software CA running in the REE environment, and can interact with the user.
可选地，图13示出了根据本申请实施例的显示屏驱动模块610、指纹服务模块621、指纹应用模块622、指纹驱动模块623以及客户应用模块630的位置关系图。Optionally, FIG. 13 shows a positional relationship diagram of the display screen driving module 610, the fingerprint service module 621, the fingerprint application module 622, the fingerprint driving module 623, and the client application module 630 according to an embodiment of the present application.
可选地，所述显示屏驱动模块610可以运行在REE环境中，位于内核空间中的内核层。Optionally, the display screen driving module 610 may run in the REE environment and located at the kernel layer in the kernel space.
可选地，所述指纹服务模块621可以运行在REE环境中，位于用户空间中的HAL层。Optionally, the fingerprint service module 621 may run in the REE environment and located at the HAL layer in the user space.
可选地，所述指纹应用模块622可以运行在TEE环境中，所述指纹应用模块622可以为可信应用TA。Optionally, the fingerprint application module 622 may run in a TEE environment, and the fingerprint application module 622 may be a trusted application TA.
可选地，所述指纹驱动模块623可以运行在REE环境中，位于内核空间中的内核层。Optionally, the fingerprint drive module 623 can run in the REE environment and located at the kernel layer in the kernel space.
可选地，所述客户应用模块630可以运行在REE环境中，位于用户空间中的应用(application)层。Optionally, the client application module 630 may run in the REE environment and located at the application layer in the user space.
本申请实施例还提供了一种电子设备700，如图14所示，所述电子设备700可以包括显示屏120、指纹识别模组130以及指纹识别***600，其中，所述指纹识别模组130设置于所述显示屏120下方，所述指纹识别模组130接收经由所述显示屏上方的人体手指反射或散射而返回的所述显示屏120的光信号以进行指纹图像采集。An embodiment of the present application also provides an electronic device 700. As shown in FIG. 14, the electronic device 700 may include a display screen 120, a fingerprint identification module 130, and a fingerprint identification system 600, wherein the fingerprint identification module 130 Located below the display screen 120, the fingerprint identification module 130 receives the light signal of the display screen 120 that is reflected or scattered by a human finger above the display screen to collect fingerprint images.
所述指纹识别***600可以为前述实施例中的指纹识别***600，可以用于控制所述显示屏120和指纹识别模组130。另外，所述指纹识别***600可以能够用于执行图3至图10所示方法实施例中的内容。The fingerprint identification system 600 may be the fingerprint identification system 600 in the foregoing embodiment, and may be used to control the display screen 120 and the fingerprint identification module 130. In addition, the fingerprint identification system 600 can be used to execute the content in the method embodiments shown in FIGS. 3 to 10.
在一些实施例中，该电子设备可以为支持Android***的电子设备，例如智能手机、笔记本电脑、平板电脑、游戏设备等便携式或移动计算设备，以及电子数据库、汽车、银行自动柜员机(Automated Teller Machine，ATM)等其他电子设备，但本申请实施例对此并不限定。In some embodiments, the electronic device may be an electronic device that supports the Android system, such as portable or mobile computing devices such as smart phones, laptops, tablets, and gaming devices, as well as electronic databases, automobiles, and bank automated teller machines (Automated Teller Machines). , ATM) and other electronic devices, but the embodiments of the present application are not limited thereto.
应理解，本申请实施例的处理单元可以是一种集成电路芯片，具有信号的处理能力。在实现过程中，上述方法实施例的各步骤可以通过处理单元中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理单元包括但不限于以下各种：通用处理器，中央处理器CPU、数字信号处理器(digital signal processor，DSP)、专用集成电路(application specific integrated circuit，ASIC)、现成可编程门阵列(field programmable gate array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成，或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器，闪存、只读存储器，可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于存储器，处理器读取存储器中的信息，结合其硬件完成上述方法的步骤。It should be understood that the processing unit of the embodiment of the present application may be an integrated circuit chip with signal processing capability. In the implementation process, the steps of the foregoing method embodiments may be completed by hardware integrated logic circuits in the processing unit or instructions in the form of software. The above-mentioned processing units include, but are not limited to, the following: general-purpose processors, central processing units (CPUs), digital signal processors (digital signal processors, DSP), application specific integrated circuits (ASICs), ready-made programmable gate arrays Field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps, and logical block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like. The steps of the method disclosed in the embodiments of the present application may be directly embodied as being executed and completed by a hardware decoding processor, or executed and completed by a combination of hardware and software modules in the decoding processor. The software module can be located in a mature storage medium in the field such as random access memory, flash memory, read-only memory, programmable read-only memory, or electrically erasable programmable memory, registers. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.
可以理解，本申请实施例的指纹识别还可以包括存储器，存储器可以是易失性存储器或非易失性存储器，或可包括易失性和非易失性存储器两者。其中，非易失性存储器可以是只读存储器(read-only memory，ROM)、可编程只读存储器(programmable ROM，PROM)、可擦除可编程只读存储器(erasable PROM，EPROM)、电可擦除可编程只读存储器(electrically EPROM，EEPROM)或闪存。易失性存储器可以是随机存取存储器(random access memory，RAM)，其用作外部高速缓存。通过示例性但不是限制性说明，许多形式的RAM可用，例如静态随机存取存储器(static RAM，SRAM)、动态随机存取存储器(dynamic RAM，DRAM)、同步动态随机存取存储器(synchronous DRAM，SDRAM)、双倍数据速率同步动态随机存取存储器 (double data rate SDRAM，DDR SDRAM)、增强型同步动态随机存取存储器(enhanced SDRAM，ESDRAM)、同步连接动态随机存取存储器(synchlink DRAM，SLDRAM)和直接内存总线随机存取存储器(direct rambus RAM，DR RAM)。应注意，本文描述的***和方法的存储器旨在包括但不限于这些和任意其它适合类型的存储器。It can be understood that the fingerprint recognition in the embodiments of the present application may further include a memory, and the memory may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memory. Among them, the non-volatile memory can be read-only memory (ROM), programmable read-only memory (programmable ROM, PROM), erasable programmable read-only memory (erasable PROM, EPROM), and electronic Erase programmable read-only memory (electrically EPROM, EEPROM) or flash memory. The volatile memory may be random access memory (RAM), which is used as an external cache. By way of exemplary but not restrictive description, many forms of RAM are available, such as static random access memory (static RAM, SRAM), dynamic random access memory (dynamic RAM, DRAM), synchronous dynamic random access memory (synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (double data rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (enhanced SDRAM, ESDRAM), synchronous connection dynamic random access memory (synchlink DRAM, SLDRAM) ) And direct memory bus random access memory (direct rambus RAM, DR RAM). It should be noted that the memories of the systems and methods described herein are intended to include, but are not limited to, these and any other suitable types of memories.
本申请实施例还提出了一种计算机可读存储介质，该计算机可读存储介质存储一个或多个程序，该一个或多个程序包括指令，该指令当被包括多个应用程序的便携式电子设备执行时，能够使该便携式电子设备执行图3至图10所示实施例的方法。The embodiment of the present application also proposes a computer-readable storage medium that stores one or more programs, and the one or more programs include instructions. When the instructions are included in a portable electronic device that includes multiple application programs When executed, the portable electronic device can be made to execute the method of the embodiment shown in FIG. 3 to FIG. 10.
本申请实施例还提出了一种计算机程序，该计算机程序包括指令，当该计算机程序被计算机执行时，使得计算机可以执行图3至图10所示实施例的方法。The embodiment of the present application also proposes a computer program, the computer program includes instructions, when the computer program is executed by the computer, the computer can execute the method of the embodiments shown in FIG. 3 to FIG. 10.
本申请实施例还提供了一种芯片，该芯片包括输入输出接口、至少一个处理器、至少一个存储器和总线，该至少一个存储器用于存储指令，该至少一个处理器用于调用该至少一个存储器中的指令，以执行图3至图10所示实施例的方法。An embodiment of the present application also provides a chip that includes an input and output interface, at least one processor, at least one memory, and a bus. The at least one memory is used to store instructions, and the at least one processor is used to call the at least one memory. To execute the method of the embodiment shown in FIG. 3 to FIG. 10.
本领域普通技术人员可以意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。A person of ordinary skill in the art may be aware that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的***、装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。Those skilled in the art can clearly understand that, for the convenience and conciseness of description, the specific working process of the above-described system, device, and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.
在本申请所提供的几个实施例中，应所述理解到，所揭露的***、装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个***，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。In addition, the functional units in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分或者所述技术方案的部分可以以软件产品的形式体现出来，所述计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(read only memory，ROM)、随机存取存储器(random access memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solution of the present application essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , Including several instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (read only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program codes.
以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应所述以权利要求的保护范围为准。The above are only specific implementations of this application, but the protection scope of this application is not limited to this. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in this application. Should be covered within the scope of protection of this application. Therefore, the protection scope of this application shall be subject to the protection scope of the claims.

Claims (25)

  1. 一种指纹采集的方法，其特征在于，应用于具有显示屏和指纹识别模组的电子设备，其中，所述指纹识别模组设置于所述显示屏下方，用于接收经由所述显示屏上方的人体手指反射或散射而返回的所述显示屏的光信号以进行指纹图像采集，所述方法包括：A fingerprint collection method, characterized in that it is applied to an electronic device with a display screen and a fingerprint identification module, wherein the fingerprint identification module is arranged below the display screen for receiving The light signal of the display screen returned by the human finger reflected or scattered to perform fingerprint image collection, and the method includes:
    控制所述显示屏在所述指纹识别模组进行指纹图像采集期间，以第一帧显示时间显示一帧图像，所述第一帧显示时间不小于指纹图像的采集时间；Controlling the display screen to display a frame of image with the first frame display time during the fingerprint image collection period of the fingerprint identification module, and the first frame display time is not less than the fingerprint image collection time;
    控制所述指纹识别模组采集所述指纹图像，其中，所述指纹图像的采集时间在所述一帧图像的显示时间范围内。Control the fingerprint identification module to collect the fingerprint image, wherein the collection time of the fingerprint image is within the display time range of the one frame image.
  2. 根据权利要求1所述的方法，其特征在于，其中，所述显示屏和所述指纹识别模组分别通过显示屏驱动模块和指纹采集控制模块进行驱动，所述方法还包括：The method according to claim 1, wherein the display screen and the fingerprint identification module are respectively driven by a display screen drive module and a fingerprint acquisition control module, and the method further comprises:
    所述显示屏驱动模块在控制所述显示屏以所述第一帧显示时间显示所述一帧图像后，向所述指纹采集控制模块发送第一指示信息；The display screen driving module sends first instruction information to the fingerprint collection control module after controlling the display screen to display the one-frame image in the first frame display time;
    所述指纹采集控制模块接收所述第一指示信息，并基于所述第一指示信息控制所述指纹识别模组采集所述指纹图像。The fingerprint collection control module receives the first indication information, and controls the fingerprint identification module to collect the fingerprint image based on the first indication information.
  3. 根据权利要求2所述的方法，其特征在于，所述方法还包括：The method of claim 2, wherein the method further comprises:
    所述显示屏驱动模块在控制所述显示屏以所述第一帧显示时间显示所述一帧图像前，比较所述显示屏的原始帧显示时间与所述指纹图像的采集时间，并基于比较结果控制所述显示屏以所述第一帧显示时间显示所述一帧图像。The display driving module compares the original frame display time of the display screen with the acquisition time of the fingerprint image before controlling the display screen to display the one frame of image at the first frame display time, and compares it based on the comparison As a result, the display screen is controlled to display the one frame of image with the first frame display time.
  4. 根据权利要求3所述的方法，其特征在于，所述基于比较结果控制所述显示屏以所述第一帧显示时间显示所述一帧图像包括：The method according to claim 3, wherein the controlling the display screen to display the one frame of the image at the first frame display time based on the comparison result comprises:
    当所述比较结果为所述显示屏的原始帧显示时间小于所述指纹图像的采集时间时，调整所述显示屏的帧显示时间至所述第一帧显示时间。When the comparison result is that the original frame display time of the display screen is less than the fingerprint image collection time, the frame display time of the display screen is adjusted to the first frame display time.
  5. 根据权利要求3所述的方法，其特征在于，所述基于比较结果控制所述显示屏以所述第一帧显示时间显示所述一帧图像包括：The method according to claim 3, wherein the controlling the display screen to display the one frame of the image at the first frame display time based on the comparison result comprises:
    当所述比较结果为所述显示屏的原始帧显示时间不小于所述指纹图像的采集时间时，不调整所述显示屏的帧显示时间，所述第一帧显示时间为所述原始帧显示时间。When the comparison result is that the original frame display time of the display screen is not less than the fingerprint image acquisition time, the frame display time of the display screen is not adjusted, and the first frame display time is the original frame display time.
  6. 根据权利要求3至5中任一项所述的方法，其特征在于，所述方法 还包括：The method according to any one of claims 3 to 5, wherein the method further comprises:
    所述显示屏驱动模块在比较所述显示屏的原始帧显示时间与所述指纹图像的采集时间前，接收所述指纹采集控制模块发送的所述指纹图像的采集时间。The display screen driving module receives the fingerprint image acquisition time sent by the fingerprint acquisition control module before comparing the original frame display time of the display screen with the fingerprint image acquisition time.
  7. 根据权利要求3至5中任一项所述的方法，其特征在于，所述方法还包括：The method according to any one of claims 3 to 5, wherein the method further comprises:
    所述显示屏驱动模块还在比较所述显示屏的原始帧显示时间与所述指纹图像的采集时间前，获取手指触摸信息，基于所述手指触摸信息获取预设的所述指纹图像的采集时间。The display screen driving module also obtains finger touch information before comparing the display time of the original frame of the display screen with the collection time of the fingerprint image, and obtains the preset collection time of the fingerprint image based on the finger touch information .
  8. 根据权利要求3至7中任一项所述的方法，其特征在于，所述方法还包括：The method according to any one of claims 3 to 7, wherein the method further comprises:
    所述指纹采集控制模块在控制所述指纹识别模组采集所述指纹图像后，向所述显示屏驱动模块发送第二指示信息；After controlling the fingerprint identification module to collect the fingerprint image, the fingerprint acquisition control module sends second instruction information to the display screen driving module;
    所述显示屏驱动模块根据所述第二指示信息将所述显示屏的帧显示时间恢复至所述原始帧显示时间。The display screen driving module restores the frame display time of the display screen to the original frame display time according to the second instruction information.
  9. 根据权利要求2至8中任一项所述的方法，其特征在于，所述指纹采集控制模块包括指纹服务模块、指纹应用模块和指纹驱动模块，所述指纹采集控制模块接收所述第一指示信息，并基于所述第一指示信息控制所述指纹识别模组采集所述指纹图像包括：The method according to any one of claims 2 to 8, wherein the fingerprint collection control module includes a fingerprint service module, a fingerprint application module, and a fingerprint drive module, and the fingerprint collection control module receives the first instruction Information, and controlling the fingerprint identification module to collect the fingerprint image based on the first instruction information includes:
    所述指纹服务模块接收所述第一指示信息，并发送通知消息给所述指纹应用模块，所述通知消息为指示开始进行指纹图像采集的消息；The fingerprint service module receives the first instruction information, and sends a notification message to the fingerprint application module, where the notification message is a message instructing to start fingerprint image collection;
    所述指纹应用模块接收所述通知消息，并发送控制消息给所述指纹驱动模块，所述控制消息为控制所述指纹驱动模块进行指纹图像采集的消息；The fingerprint application module receives the notification message and sends a control message to the fingerprint driving module, where the control message is a message for controlling the fingerprint driving module to collect fingerprint images;
    所述指纹驱动模块接收所述控制消息以控制所述指纹识别模组采集所述指纹图像。The fingerprint driving module receives the control message to control the fingerprint identification module to collect the fingerprint image.
  10. 根据权利要求9所述的方法，其特征在于，所述方法还包括：The method according to claim 9, wherein the method further comprises:
    所述指纹应用模块接收所述指纹图像，并对所述指纹图像进行指纹识别得到指纹识别结果。The fingerprint application module receives the fingerprint image, and performs fingerprint recognition on the fingerprint image to obtain a fingerprint recognition result.
  11. 根据权利要求10所述的方法，其特征在于，所述方法还包括：The method according to claim 10, wherein the method further comprises:
    所述指纹应用模块将所述指纹识别结果发送给所述指纹服务模块；The fingerprint application module sends the fingerprint identification result to the fingerprint service module;
    所述指纹服务模块将所述指纹识别结果发送给客户应用模块。The fingerprint service module sends the fingerprint identification result to the client application module.
  12. 根据权利要求9至11中任一项所述的方法，其特征在于，所述显示屏驱动模块和所述指纹驱动模块运行在富执行环境REE中，位于内核层；The method according to any one of claims 9 to 11, wherein the display screen driver module and the fingerprint driver module run in a rich execution environment, REE, at the kernel layer;
    所述指纹服务模块运行在富执行环境REE中，位于硬件抽象HAL层；The fingerprint service module runs in the rich execution environment REE and is located at the hardware abstraction HAL layer;
    所述指纹应用模块运行在可信执行环境TEE中，位于可信应用TA层。The fingerprint application module runs in the trusted execution environment TEE and is located at the trusted application TA layer.
  13. 一种指纹采集的***，其特征在于，应用于具有显示屏和指纹识别模组的电子设备，其中，所述指纹识别模组设置于所述显示屏下方，用于接收经由所述显示屏上方的人体手指反射或散射而返回的所述显示屏的光信号以进行指纹图像采集，所述***包括：显示屏驱动模块和指纹采集控制模块；A fingerprint collection system, characterized by being applied to an electronic device with a display screen and a fingerprint identification module, wherein the fingerprint identification module is arranged below the display screen for receiving The light signal of the display screen reflected or scattered by the human finger to perform fingerprint image collection, and the system includes: a display screen drive module and a fingerprint collection control module;
    所述显示屏驱动模块用于控制所述显示屏在所述指纹识别模组进行指纹图像采集期间，以第一帧显示时间显示一帧图像，所述第一帧显示时间不小于指纹图像的采集时间；The display screen driving module is used to control the display screen to display a frame of image with the first frame display time during the fingerprint image collection period of the fingerprint identification module, and the first frame display time is not less than the fingerprint image collection time;
    所述指纹采集控制模块用于控制所述指纹识别模组采集所述指纹图像，其中，所述指纹图像的采集时间在所述一帧图像的显示时间范围内。The fingerprint collection control module is configured to control the fingerprint identification module to collect the fingerprint image, wherein the collection time of the fingerprint image is within the display time range of the one frame image.
  14. 根据权利要求13所述的***，其特征在于，所述显示屏驱动模块还用于在控制所述显示屏以所述第一帧显示时间显示所述一帧图像后，向所述指纹采集控制模块发送第一指示信息；The system according to claim 13, wherein the display screen driving module is further configured to control the display screen to display the one frame of images in the first frame display time, and then to control the fingerprint collection The module sends the first indication information;
    所述第一指示信息用于指示所述指纹采集控制模块控制所述指纹识别模组采集所述指纹图像。The first indication information is used to instruct the fingerprint collection control module to control the fingerprint identification module to collect the fingerprint image.
  15. 根据权利要求13或14所述的***，其特征在于，所述显示屏驱动模块还用于，在控制所述显示屏以所述第一帧显示时间显示所述一帧图像前，比较所述显示屏的原始帧显示时间与所述指纹图像的采集时间，并基于比较结果控制所述显示屏以所述第一帧显示时间显示所述一帧图像。The system according to claim 13 or 14, wherein the display screen driving module is further configured to compare the frame of image before controlling the display screen to display the one frame of image at the first frame display time The display time of the original frame of the display screen and the collection time of the fingerprint image are controlled, and based on the comparison result, the display screen is controlled to display the one frame of image with the display time of the first frame.
  16. 根据权利要求15所述的***，其特征在于，所述显示屏驱动模块具体用于，当所述比较结果为所述显示屏的原始帧显示时间小于所述指纹图像的采集时间时，调整所述显示屏的帧显示时间至所述第一帧显示时间。The system according to claim 15, wherein the display screen driving module is specifically configured to adjust the display time when the original frame display time of the display screen is less than the fingerprint image acquisition time when the comparison result is The frame display time of the display screen to the first frame display time.
  17. 根据权利要求15所述的***，其特征在于，所述显示屏驱动模块具体用于，当所述比较结果为所述显示屏的原始帧显示时间不小于所述指纹图像的采集时间时，不调整所述显示屏的帧显示时间，所述第一帧显示时间为所述原始帧显示时间。The system according to claim 15, wherein the display screen driving module is specifically configured to: when the comparison result is that the display time of the original frame of the display screen is not less than the acquisition time of the fingerprint image, not Adjust the frame display time of the display screen, and the first frame display time is the original frame display time.
  18. 根据权利要求15至17中任一项所述的***，其特征在于，所述显 示屏驱动模块还用于，在比较所述显示屏的原始帧显示时间与所述指纹图像的采集时间前，接收所述指纹采集控制模块发送的所述指纹图像的采集时间。The system according to any one of claims 15 to 17, wherein the display screen driving module is further configured to: before comparing the display time of the original frame of the display screen with the collection time of the fingerprint image, Receiving the collection time of the fingerprint image sent by the fingerprint collection control module.
  19. 根据权利要求15至17中任一项所述的***，其特征在于，所述显示屏驱动模块还用于，在比较所述显示屏的原始帧显示时间与所述指纹图像的采集时间前，获取手指触摸信息，基于所述手指触摸信息获取预设的所述指纹图像的采集时间。The system according to any one of claims 15 to 17, wherein the display screen driving module is further configured to: before comparing the display time of the original frame of the display screen with the collection time of the fingerprint image, Acquiring finger touch information, and acquiring a preset collection time of the fingerprint image based on the finger touch information.
  20. 根据权利要求15至19中任一项所述的***，其特征在于，所述指纹采集控制模块还用于，在控制所述指纹识别模组采集所述指纹图像后，向所述显示屏驱动模块发送第二指示信息；The system according to any one of claims 15 to 19, wherein the fingerprint acquisition control module is further configured to, after controlling the fingerprint identification module to acquire the fingerprint image, drive the display screen The module sends second indication information;
    所述显示屏驱动模块还用于根据所述第二指示信息将所述显示屏的帧显示时间恢复至所述原始帧显示时间。The display screen driving module is further configured to restore the frame display time of the display screen to the original frame display time according to the second instruction information.
  21. 根据权利要求14至20中任一项所述的***，其特征在于，所述指纹采集控制模块包括指纹服务模块、指纹应用模块和指纹驱动模块；The system according to any one of claims 14 to 20, wherein the fingerprint collection control module includes a fingerprint service module, a fingerprint application module, and a fingerprint drive module;
    所述指纹服务模块用于接收所述第一指示信息，并发送通知消息给所述指纹应用模块，所述通知消息为指示开始采集所述指纹图像的消息；The fingerprint service module is configured to receive the first instruction information and send a notification message to the fingerprint application module, where the notification message is a message instructing to start collecting the fingerprint image;
    所述指纹应用模块用于接收所述通知消息，并发送控制消息给所述指纹驱动模块，所述控制消息为控制所述指纹驱动模块采集所述指纹图像的消息；The fingerprint application module is configured to receive the notification message and send a control message to the fingerprint driving module, where the control message is a message for controlling the fingerprint driving module to collect the fingerprint image;
    所述指纹驱动模块用于接收所述控制消息以控制所述指纹识别模组采集所述指纹图像。The fingerprint driving module is used for receiving the control message to control the fingerprint identification module to collect the fingerprint image.
  22. 根据权利要求21所述的***，其特征在于，所述指纹应用模块还用于接收所述指纹图像，并对所述指纹图像进行指纹识别得到指纹识别结果。The system according to claim 21, wherein the fingerprint application module is further configured to receive the fingerprint image, and perform fingerprint recognition on the fingerprint image to obtain a fingerprint recognition result.
  23. 根据权利要求22所述的***，其特征在于，所述***还包括客户应用模块；The system according to claim 22, wherein the system further comprises a client application module;
    所述指纹应用模块将所述指纹识别结果发送给所述指纹服务模块；The fingerprint application module sends the fingerprint identification result to the fingerprint service module;
    所述指纹服务模块将所述指纹识别结果发送给所述客户应用模块。The fingerprint service module sends the fingerprint identification result to the client application module.
  24. 根据权利要求21至23中任一项所述的***，其特征在于，所述显示屏驱动模块和所述指纹驱动模块运行在富执行环境REE中，位于内核层；The system according to any one of claims 21 to 23, wherein the display screen driver module and the fingerprint driver module run in a rich execution environment, REE, at the kernel layer;
    所述指纹服务模块运行在富执行环境REE中，位于硬件抽象HAL层；The fingerprint service module runs in the rich execution environment REE and is located at the hardware abstraction HAL layer;
    所述指纹应用模块运行在可信执行环境TEE中，位于可信应用TA层。The fingerprint application module runs in the trusted execution environment TEE and is located at the trusted application TA layer.
  25. 一种电子设备，其特征在于，所述电子设备包括：显示屏、指纹识别模组以及，An electronic device, characterized in that the electronic device includes: a display screen, a fingerprint recognition module, and,
    如权利要求13至24中任一项所述的指纹采集的***；The fingerprint collection system according to any one of claims 13 to 24;
    其中，所述指纹识别模组设置于所述显示屏下方，用于接收经由所述显示屏上方的人体手指反射或散射而返回的所述显示屏的光信号以进行指纹图像采集。Wherein, the fingerprint identification module is disposed under the display screen, and is used to receive the light signal of the display screen returned by the reflection or scattering of a human finger above the display screen for fingerprint image collection.
PCT/CN2019/078889 2019-03-20 2019-03-20 Fingerprint collection method and system, and electronic device WO2020186481A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201980000489.3A CN110088769B (en) 2019-03-20 2019-03-20 Fingerprint acquisition method and system and electronic equipment
PCT/CN2019/078889 WO2020186481A1 (en) 2019-03-20 2019-03-20 Fingerprint collection method and system, and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/078889 WO2020186481A1 (en) 2019-03-20 2019-03-20 Fingerprint collection method and system, and electronic device

Publications (1)

Publication Number Publication Date
WO2020186481A1 true WO2020186481A1 (en) 2020-09-24

Family

ID=67424463

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/078889 WO2020186481A1 (en) 2019-03-20 2019-03-20 Fingerprint collection method and system, and electronic device

Country Status (2)

Country Link
CN (1) CN110088769B (en)
WO (1) WO2020186481A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112712065A (en) * 2021-01-19 2021-04-27 维沃移动通信有限公司 Electronic equipment, and biological feature acquisition method and device

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110705411B (en) * 2019-09-23 2022-06-21 Oppo广东移动通信有限公司 Fingerprint identification method and device, equipment and storage medium
CN110785770A (en) * 2019-09-26 2020-02-11 深圳市汇顶科技股份有限公司 Fingerprint identification method and device and electronic equipment
CN110807383B (en) * 2019-10-24 2023-10-17 维沃移动通信有限公司 Scanning method and electronic equipment
CN114093329B (en) * 2020-07-31 2023-05-23 京东方科技集团股份有限公司 Driving method and driving device of display panel and display device
CN112883903B (en) * 2021-03-12 2022-09-20 厦门天马微电子有限公司 Display panel driving method and display device
CN113778274B (en) * 2021-06-15 2023-03-31 荣耀终端有限公司 Light spot display method and device
CN113778273B (en) * 2021-07-29 2022-12-23 荣耀终端有限公司 Light spot display method, electronic device and computer readable storage medium
CN114489410B (en) * 2021-07-29 2023-11-17 荣耀终端有限公司 Light spot display method, electronic device and computer readable storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160266695A1 (en) * 2015-03-10 2016-09-15 Crucialtec Co., Ltd. Display apparatus having image scanning function
CN107908034A (en) * 2017-12-05 2018-04-13 武汉天马微电子有限公司 Array substrate, touch display panel and touch display panel driving method
CN107958193A (en) * 2017-08-17 2018-04-24 深圳信炜科技有限公司 Display module and electronic equipment
CN108256409A (en) * 2017-10-27 2018-07-06 京东方科技集团股份有限公司 Display device and its fingerprint identification method
CN108806603A (en) * 2018-06-29 2018-11-13 上海天马有机发光显示技术有限公司 A kind of organic light emitting display panel and its driving method, organic light-emitting display device
CN109376616A (en) * 2018-09-29 2019-02-22 京东方科技集团股份有限公司 Fingerprint recognition device, its fingerprint identification method and display device

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101928319B1 (en) * 2015-06-18 2018-12-12 선전 구딕스 테크놀로지 컴퍼니, 리미티드 Multifunction fingerprint sensor with photo sensing capability
CN106095159B (en) * 2016-05-25 2019-04-09 京东方科技集团股份有限公司 The driving method of touch screen, display device and display device
CN106845422B (en) * 2017-01-22 2020-12-22 Oppo广东移动通信有限公司 Fingerprint identification module, fingerprint identification method and mobile terminal
CN107403152B (en) * 2017-07-19 2020-07-31 大唐终端技术有限公司 High-pass platform TrustZone fingerprint identification implementation method and system
CN109117616B (en) * 2018-08-02 2021-03-02 Oppo广东移动通信有限公司 Verification method and device, electronic equipment and computer readable storage medium
WO2020037683A1 (en) * 2018-08-24 2020-02-27 深圳市汇顶科技股份有限公司 Backlight module, below-screen fingerprint recognition method and apparatus, and electronic device
CN110163058B (en) * 2018-10-30 2021-11-09 京东方科技集团股份有限公司 Fingerprint identification display module and fingerprint identification method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160266695A1 (en) * 2015-03-10 2016-09-15 Crucialtec Co., Ltd. Display apparatus having image scanning function
CN107958193A (en) * 2017-08-17 2018-04-24 深圳信炜科技有限公司 Display module and electronic equipment
CN108256409A (en) * 2017-10-27 2018-07-06 京东方科技集团股份有限公司 Display device and its fingerprint identification method
CN107908034A (en) * 2017-12-05 2018-04-13 武汉天马微电子有限公司 Array substrate, touch display panel and touch display panel driving method
CN108806603A (en) * 2018-06-29 2018-11-13 上海天马有机发光显示技术有限公司 A kind of organic light emitting display panel and its driving method, organic light-emitting display device
CN109376616A (en) * 2018-09-29 2019-02-22 京东方科技集团股份有限公司 Fingerprint recognition device, its fingerprint identification method and display device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112712065A (en) * 2021-01-19 2021-04-27 维沃移动通信有限公司 Electronic equipment, and biological feature acquisition method and device
CN112712065B (en) * 2021-01-19 2023-10-27 维沃移动通信有限公司 Electronic equipment, biological characteristic acquisition method and device

Also Published As

Publication number Publication date
CN110088769A (en) 2019-08-02
CN110088769B (en) 2021-08-13

Similar Documents

Publication Publication Date Title
WO2020186481A1 (en) Fingerprint collection method and system, and electronic device
CN110753999B (en) Systems and methods for optical sensing using point-based illumination
US10614283B2 (en) Devices with peripheral task bar display zone and under-LCD screen optical sensor module for on-screen fingerprint sensing
WO2020077505A1 (en) Under-display fingerprint recognition apparatus and electronic device
US10410037B2 (en) Under-screen optical sensor module for on-screen fingerprint sensing implementing imaging lens, extra illumination or optical collimator array
WO2020181489A1 (en) Fingerprint recognition device, fingerprint recognition method and electronic device
EP3674856A1 (en) Multi-sensor-based on-screen fingerprint collection method and system and electronic device
EP3678002B1 (en) Multi-sensor-based under-screen fingerprint collection method, system and electronic device
US10643049B2 (en) Display substrate, manufacturing method thereof, display device and fingerprint identification method
WO2020223881A1 (en) Fingerprint detection method and apparatus, and electronic device
WO2020093251A1 (en) Double sensing area-based fingerprint identification method, fingerprint identification system, and electronic device
US11928885B2 (en) Fingerprint identification method, fingerprint identification apparatus and electronic device
US11113495B2 (en) Method and apparatus for fingerprint identification and electronic device
WO2020177083A1 (en) Fingerprint recognition method and apparatus, and terminal device
US20210271851A1 (en) Integrated spectrum sensing device for real-finger judgement and sensing method
WO2021035599A1 (en) Fingerprint recognition device and method, and electronic apparatus
WO2020227986A1 (en) Image collection apparatus and method, and electronic device
US11132523B2 (en) Method and apparatus for fingerprint identification and electronic device
WO2021056318A1 (en) Fingerprint recognition method and apparatus, and electronic device
WO2020164055A1 (en) Method and apparatus for entering function interface, and terminal device
WO2020199159A1 (en) Method and electronic device for guiding users to register fingerprints
WO2020061734A1 (en) Fingerprint registration method, fingerprint registration device and electronic device
WO2020061754A1 (en) Multi-sensor-based in-screen fingerprint verification method and system, and electronic device
TW201839660A (en) Iris recognition method and device
CN109328349B (en) Fingerprint identification method and device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19919970

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19919970

Country of ref document: EP

Kind code of ref document: A1