CN110677532A - Voice assistant control method and system based on fingerprint identification and electronic equipment - Google Patents
Voice assistant control method and system based on fingerprint identification and electronic equipment Download PDFInfo
- Publication number
- CN110677532A CN110677532A CN201810707867.9A CN201810707867A CN110677532A CN 110677532 A CN110677532 A CN 110677532A CN 201810707867 A CN201810707867 A CN 201810707867A CN 110677532 A CN110677532 A CN 110677532A
- Authority
- CN
- China
- Prior art keywords
- fingerprint
- voice assistant
- user
- template
- electronic device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 79
- 230000002618 waking effect Effects 0.000 claims abstract description 17
- 238000012545 processing Methods 0.000 claims description 16
- 238000012795 verification Methods 0.000 claims description 10
- 230000003287 optical effect Effects 0.000 description 53
- 230000006870 function Effects 0.000 description 50
- 238000001514 detection method Methods 0.000 description 38
- 230000008569 process Effects 0.000 description 19
- 238000010586 diagram Methods 0.000 description 7
- 230000005284 excitation Effects 0.000 description 5
- 239000010410 layer Substances 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 230000002452 interceptive effect Effects 0.000 description 3
- 241000238558 Eucarida Species 0.000 description 2
- 238000012217 deletion Methods 0.000 description 2
- 230000037430 deletion Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000000149 penetrating effect Effects 0.000 description 2
- 239000011241 protective layer Substances 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 229910052594 sapphire Inorganic materials 0.000 description 1
- 239000010980 sapphire Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/66—Substation equipment, e.g. for use by subscribers with means for preventing unauthorised or fraudulent calling
- H04M1/667—Preventing unauthorised calls from a telephone set
- H04M1/67—Preventing unauthorised calls from a telephone set by electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2201/00—Electronic components, circuits, software, systems or apparatus used in telephone systems
- H04M2201/40—Electronic components, circuits, software, systems or apparatus used in telephone systems using speech recognition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/74—Details of telephonic subscriber devices with voice recognition means
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Telephone Function (AREA)
- Collating Specific Patterns (AREA)
- Image Input (AREA)
Abstract
The application discloses a voice assistant control method based on fingerprint identification. The voice assistant control method based on fingerprint identification comprises the following steps: registering a special fingerprint template of a voice assistant for waking up the electronic equipment in advance; acquiring a fingerprint image input by a user; judging whether the fingerprint image is matched with the exclusive fingerprint template; and when the fingerprint image is matched with the exclusive fingerprint template, waking up a voice assistant of the electronic equipment. The application also discloses a voice assistant control system based on fingerprint identification and corresponding electronic equipment.
Description
Technical Field
The application belongs to the technical field of fingerprint identification, and particularly relates to a voice assistant control method and system based on fingerprint identification and an electronic device.
Background
With the development of voice recognition and artificial intelligence technologies, most electronic devices such as smart phones and tablet computers support the function of a voice assistant, and the voice assistant has the functions of realizing voice control, information query and the like in a voice interaction mode.
Generally, a voice assistant of an electronic device needs to be woken up by a user when performing voice interaction. The traditional voice assistant awakening mode mainly comprises two modes, wherein one mode is that a user inputs a specific voice awakening word to awaken the voice assistant, for example, the voice assistant Siri function of the apple mobile phone can be awakened by the specific awakening word 'hello Siri'; another way is to configure a dedicated voice assistant wake-up physical button on the electronic device, and the user can wake-up the voice assistant function of the electronic device by pressing the physical button.
However, no matter whether the electronic device uses a voice wake-up word mode or a dedicated physical key mode to wake up the voice assistant function, when the electronic device is in a standby state, the user needs to unlock the electronic device first. That is, during the use process, the user needs to unlock the electronic device by inputting the biometric feature or the password first, and then can start the voice assistant by inputting the voice wake-up word or pressing the physical key, and then can use the voice assistant function normally. Therefore, the traditional voice assistant awakening method is complicated, and the use efficiency and the operation experience of a user are influenced.
In view of the foregoing, there is a need for a voice assistant control method and system that is more efficient and provides a better user experience.
Disclosure of Invention
One of the objectives of the present application is to provide a method and system for controlling a voice assistant based on fingerprint recognition, so as to solve the above problems in the prior art; it is another object of the present patent application to provide an electronic device that can be based on the above-mentioned voice assistant control method.
The voice assistant control method based on fingerprint identification comprises the following steps: registering a special fingerprint template of a voice assistant for waking up the electronic equipment in advance; acquiring a fingerprint image input by a user; judging whether the fingerprint image is matched with the exclusive fingerprint template; and when the fingerprint image is matched with the exclusive fingerprint template, waking up a voice assistant of the electronic equipment.
As an implementation manner of the voice assistant control method based on fingerprint identification provided in the present application, the pre-registering a dedicated fingerprint template of a voice assistant for waking up an electronic device includes: the method comprises the steps of registering a plurality of fingerprint templates in advance, wherein at least one fingerprint template is an exclusive fingerprint template which is input by a user through a designated finger, and the exclusive fingerprint template is used for awakening a voice assistant of the electronic equipment.
As an implementation manner of the voice assistant control method based on fingerprint recognition provided in the present application, the determining whether the fingerprint image matches the dedicated fingerprint template includes: judging whether the fingerprint image is matched with one of the pre-registered fingerprint templates; when the fingerprint image is matched with one of the fingerprint templates, judging whether the fingerprint template matched with the fingerprint image belongs to the exclusive fingerprint template; if yes, the fingerprint image is judged to be matched with the exclusive fingerprint template.
As an implementation manner of the voice assistant control method based on fingerprint identification provided by the present application, the method further includes:
and when the fingerprint image is matched with one of the fingerprint templates but the fingerprint template is not the exclusive fingerprint template, judging that the user identity verification is passed but not starting the voice assistant function of the electronic equipment.
As an implementation manner of the voice assistant control method based on fingerprint identification provided by the present application, the method further includes: and after the voice assistant is awakened, the electronic equipment is controlled to execute corresponding operation according to a voice input command of a user.
The application provides a voice assistant control system based on fingerprint identification, including: the fingerprint registration module is used for registering an exclusive fingerprint template of a voice assistant for awakening the electronic equipment; the fingerprint acquisition module is used for acquiring a fingerprint image input by a user; the fingerprint matching module is used for judging whether the fingerprint image is matched with the exclusive fingerprint template; and the voice assistant awakening module is used for awakening the voice assistant of the electronic equipment when the fingerprint image is matched with the exclusive fingerprint template.
As an implementation manner of the voice assistant control system based on fingerprint identification provided by the application, the fingerprint registration module is specifically used for registering a plurality of fingerprint templates in advance, wherein at least one fingerprint template is an exclusive fingerprint template for a user to enter by using a designated finger, and the exclusive fingerprint template is used for waking up the voice assistant of the electronic device.
As an implementation manner of the voice assistant control system based on fingerprint recognition provided by the present application, the fingerprint matching module includes: the matching unit is used for matching the fingerprint image with the pre-registered fingerprint templates so as to judge whether the fingerprint image is matched with one of the pre-registered fingerprint templates; and the judging unit is used for judging whether the fingerprint template matched with the fingerprint image belongs to the exclusive fingerprint template or not when the fingerprint image is matched with one of the fingerprint templates, and judging that the fingerprint image is matched with the exclusive fingerprint template when the fingerprint template belongs to the exclusive fingerprint template.
As an implementation manner of the voice assistant control system based on fingerprint recognition provided by the present application, the voice assistant wake-up module is further configured to refuse to enable a voice assistant function of the electronic device when the fingerprint image of the fingerprint matching module matches one of the fingerprint templates but the fingerprint template is not the exclusive fingerprint template.
The electronic equipment provided by the application comprises the voice assistant control system based on fingerprint identification.
Compared with the traditional mode that voice assistant awakening is carried out by adopting a voice awakening word or a common physical key mode through the traditional electronic equipment, the voice assistant control method, the voice assistant control system and the electronic equipment provided by the embodiments of the application can awaken the voice assistant of the electronic equipment through a fingerprint identification function when a user needs to use the voice assistant function of the electronic equipment, so that the voice assistant awakening and the user identity authentication can be simultaneously controlled through one-time operation.
Drawings
One or more embodiments of the present application are illustrated by way of example in the accompanying drawings and not by way of limitation, in which elements having the same reference numeral designations in the drawings are shown as similar elements and the drawings are not to be construed as limiting the application in any way unless otherwise specified.
FIG. 1 is a schematic diagram of an electronic device using an off-screen fingerprint identification scheme that may be suitable for use in embodiments of the present application;
FIG. 2 is a flowchart illustrating an embodiment of a method for controlling a voice assistant based on fingerprint recognition according to the present application;
FIG. 3 is a flowchart illustrating another exemplary embodiment of a method for controlling a voice assistant based on fingerprint recognition according to the present application;
FIG. 4 is a schematic diagram of an electronic device using a front-side fingerprint identification scheme, which can be applied to embodiments of the present application;
FIG. 5 is a schematic diagram of an electronic device using a backside fingerprint identification scheme that can be applied to embodiments of the present application;
FIG. 6 is a schematic structural diagram of an electronic device that employs a voice recognition assistant wake-up key with a fingerprint recognition function according to an embodiment of the present disclosure;
FIG. 7 is a schematic structural diagram of another electronic device that can employ a voice recognition assistant wake-up button with a fingerprint recognition function according to an embodiment of the present disclosure;
fig. 8 is a flowchart illustrating a voice assistant control method based on fingerprint recognition according to an embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The application provides a voice assistant control method and system based on fingerprint identification, when a user needs to use the voice assistant function of the electronic equipment, the voice assistant of the electronic equipment can be awakened through the fingerprint identification function, so that the voice assistant awakening and the user identity authentication can be simultaneously controlled through one-time operation, on one hand, the user operation efficiency and experience are improved, on the other hand, the user fingerprint authentication is simultaneously carried out when the voice assistant is started, and therefore, the application of the voice assistant can be expanded to scenes needing the user identity authentication, such as mobile payment, authority setting, application installation/deletion and the like.
The voice assistant control method and system based on fingerprint recognition provided by the embodiment of the application can be applied to, for example, smart phones, tablet computers and other mobile terminals or other terminal devices with display screens, and the electronic devices include fingerprint recognition devices, which may be capacitive fingerprint recognition devices traditionally arranged on the front or back of the electronic devices, or under-screen fingerprint recognition devices arranged below the display screens of the electronic devices, such as optical fingerprint recognition devices or ultrasonic fingerprint recognition devices, and this application is not particularly limited thereto.
As a typical application scenario, the electronic device may employ an optical fingerprint recognition device for user fingerprint acquisition and verification, and the optical fingerprint recognition device may be disposed in a partial area or a whole area below a display screen, so as to form an Under-screen (Under-display) optical fingerprint recognition system. Please refer to fig. 1, which is a schematic structural diagram of an electronic device using an off-screen fingerprint recognition system to which the voice assistant control method based on fingerprint recognition according to the embodiment of the present application is applicable. The terminal device 100 comprises a display 120 and an optical fingerprint recognition device 130, wherein the optical fingerprint recognition device 130 is arranged in a partial area below the display 120. The optical fingerprint identification device 130 includes a sensing array having a plurality of optical sensing units, and the sensing array is located in the fingerprint detection area 103 of the optical fingerprint identification device 130.
The optical fingerprint recognition device 130 may be attached to the lower surface of the display screen 120 or fixed below the display screen 120 by other methods. As a preferred embodiment, the optical fingerprint recognition device 130 may be mounted and fixed below the display screen 120 through a mounting bracket, such as a middle frame of the electronic device 100, and fixed below the display screen 120 through the middle frame, so as to have a certain gap with the display screen 120, i.e., not to contact with the lower surface of the display screen 120, thereby facilitating individual replacement or repair of damaged parts when the display screen 120 or the optical fingerprint recognition device 130 is damaged.
However, it should be understood that in other alternative implementations, the fingerprint detection area may be extended to other locations of the display area 102 and even the entire display area 120 by optical design, and is not limited to the location of the optical fingerprint recognition device 130. Alternatively, the optical fingerprint identification device 130 may be disposed in an edge area of the electronic apparatus 100, that is, the optical fingerprint identification device 130 is not located or only partially located within the display area 102, but the optical path is designed such that the fingerprint detection area 103 of the optical fingerprint identification device 130 still covers at least a portion of the display area 102 of the display screen 120.
As shown in fig. 1, the fingerprint detection area 103 is located in the display area 102 of the display screen 120, so that when a user needs to unlock or otherwise verify a fingerprint of the electronic device, the user only needs to press a finger on the fingerprint detection area 103 located on the display screen 120, and thus a fingerprint input can be achieved. Since fingerprint detection and fingerprint identification can be implemented in the screen, the terminal device 100 adopting the above structure does not need to reserve a special space on the front surface thereof to set a fingerprint key (such as a Home key), so that a full-screen scheme can be adopted, that is, the display area 102 of the display screen 120 can be substantially extended to the front surface of the whole terminal device 100.
In a preferred embodiment, the display screen 120 may be a display screen having a self-luminous display unit, such as an Organic Light Emitting Diode (OLED) display screen or a Micro-LED (Micro-LED) display screen. Taking an OLED display screen as an example, the optical fingerprint identification device 130 may use the display unit (i.e., the OLED light source) of the OLED display screen 120 located in the fingerprint detection area 103 as an excitation light source for optical fingerprint detection; it should be understood, however, that the optical fingerprint recognition device 130 may also be provided with an additional excitation light source (e.g., an infrared light source) for fingerprint detection and recognition. Moreover, the sensing array of the optical fingerprint identification apparatus 130 is specifically a Photo Detector (PD) array, which includes a plurality of Photo detectors distributed in an array, and the Photo detectors may be used as the optical sensing units. When a finger presses the fingerprint detection area 103, light emitted by the display unit of the fingerprint detection area 103 is reflected on the fingerprint on the surface of the finger and forms reflected light, wherein the reflected light of the ridges and valleys of the fingerprint is different, and the reflected light is received by the photodetector array from the display screen 120 and converted into a corresponding electrical signal, i.e., a fingerprint detection signal. Based on the fingerprint detection signal, the optical fingerprint identification device 130 or the processing unit of the electronic device 100 may obtain fingerprint image data, and may further perform fingerprint matching verification, thereby implementing an optical fingerprint identification function in the electronic device 100.
It should be understood that in a specific implementation, the electronic device 100 further includes a transparent protective cover plate 110, and the cover plate 110 may be a glass cover plate or a sapphire cover plate, which is located above the display screen 120 and covers the front surface of the terminal device 100. Since the cover plate 110 covers the surface of the display screen 120, in the embodiment of the present application, the pressing of the finger on the display screen 120 may actually be pressing the cover plate 110 above the display screen 120, or when a user attaches a protective layer on the surface of the cover plate 110, the pressing of the finger on the display screen 120 may actually be pressing the protective layer on the surface of the cover plate 110.
As an alternative implementation, as shown in fig. 1, the optical fingerprint identification device 130 includes a light detection portion 134 and an optical component 132, wherein the light detection portion 134 may include the sensing array and a reading circuit and other auxiliary circuits electrically connected to the sensing array, which may be fabricated on a chip (Die) through a semiconductor process. The optical assembly 132 may be disposed over the sensing array of light detecting portions 134, which may specifically include light guides, Filter layers (filters), and other optical elements. The light guide is mainly used for guiding the reflected light reflected from the surface of the finger to the sensing array for optical detection, for example, a Lens (Lens) may be used to focus the reflected light on the sensing array of the light detection portion 134 or a Collimator (collimat) may be used to limit each optical sensing unit of the sensing array to receive only the reflected light from the portion of the finger above the optical sensing unit. The filter layer may be used to filter the ambient light penetrating through the finger to prevent the light detection portion 134 from being interfered by strong external light, for example, the filter layer may be an infrared filter layer to filter the wavelength band of sunlight or other ambient light penetrating through the finger and entering the light detection portion 134. In addition, a circuit board 150, such as a flexible circuit board, may be disposed below the optical fingerprint identification device 130, and the optical fingerprint identification device 130 may be electrically connected to other functional modules of the electronic apparatus 100 through the circuit board 150 and perform signal transmission.
In other alternative implementations, the display screen 120 may also be a non-self-luminous display screen, such as a liquid crystal display screen that uses a backlight; in this case, the optical fingerprint identification device 130 cannot use the display unit of the display screen 120 as an excitation light source, so that the optical fingerprint detection can be realized by integrating the excitation light source inside the optical detection device 130 or disposing the excitation light source outside the optical detection device 130, and the detection principle is consistent with the above description.
In particular embodiments, the electronic device 100 may be configured with voice assistant functionality that may enable the electronic device 100 to support intelligent voice recognition and voice control, which provides a voice-based interactive interface to a user. After the user wakes up the voice assistant of the electronic device 100, the electronic device 100 may acquire a voice input command of the user through a voice input module (such as a microphone), and recognize the voice input command through an internal voice recognition module to acquire corresponding voice input information; further, the electronic device 100 may respond to the voice input information through its internal processing unit, and control other functional modules of the electronic device 100 to perform an operation corresponding to the voice input command, and then feed back an operation result or response information to the user through an output module (such as the display screen 120 and/or a speaker).
For example, when the user asks the voice assistant of the electronic device 100 about the current weather, the voice assistant may broadcast the weather information to the user through a speaker or control the display screen 120 to display the current weather information after the current weather information is acquired by the system background. For another example, after the user issues a voice command to the voice assistant of the electronic device 100 to take a picture, the system of the electronic device 100 may call the camera control module to control the camera hardware of the electronic device 100 to be enabled, and use the camera hardware to take a current picture, and then control the display screen 120 to display the taken picture. For another example, when the user issues an instant messaging message to a certain contact to the voice assistant of the electronic device 100, the voice recognition module of the electronic device 100 may convert the user voice input content into text information, and after the system calls a corresponding instant messaging program, the text information is sent to the corresponding contact through the instant messaging program, and then the display screen 120 is controlled to display a corresponding message sending result, and the like. It should be understood, of course, that the above-mentioned examples are merely illustrative, and the voice assistant function related to the embodiments of the present application is not limited to the above-mentioned examples.
In practical applications, a user needs to first wake up the voice assistant function of the electronic device 100 and then perform corresponding intelligent voice control by using the voice assistant. If the electronic device 100 is in a standby or locked state, the electronic device 100 needs to first prompt the user to perform authentication, and the voice assistant function is turned on only after the user authentication is passed and the device is unlocked; on the other hand, when the user wakes up the voice assistant and issues the voice input command, if the operation control corresponding to the voice input command needs to perform the identity authentication on the user, the electronic device needs to interrupt the operation, prompt the user to perform the identity authentication, and execute the operation after the user passes the identity authentication. Therefore, if the electronic equipment can simultaneously perform user identity authentication when the user wakes up the voice assistant, the use efficiency and the operation experience of the user for the voice assistant can be improved.
In view of this, embodiments of the present application provide a voice assistant control method based on fingerprint identification, which can perform user fingerprint detection and authentication synchronously when a user wakes up a voice assistant of an electronic device. Taking the electronic device 100 shown in fig. 1 as an example, referring to fig. 2, the method for controlling a voice assistant based on fingerprint recognition provided by the present application may include the following steps:
step S11, registering a plurality of fingerprint templates in advance, wherein at least one fingerprint template is an exclusive fingerprint template for waking up the voice assistant of the electronic equipment;
in order to enable the electronic device 100 to normally support the fingerprint recognition function of the optical fingerprint recognition device 130, when the electronic device 100 is initialized or the fingerprint recognition function of the electronic device is used for the first time, a user may first register a plurality of fingerprint templates in the electronic device 100 and store the plurality of fingerprint templates in a storage unit inside the electronic device 100. Specifically, when performing fingerprint template registration, the electronic device 100 may provide a template registration interface for a user, and the user may perform fingerprint input by pressing the fingerprint detection area 103 in the display screen 120 of the electronic device 100 multiple times according to a prompt of the template registration interface.
The optical fingerprint identification device 130 located below the display screen 120 may acquire a fingerprint registration image of the user through fingerprint scanning each time the user presses, and the electronic device 100 may further perform necessary processing on the fingerprint registration image, such as fingerprint registration image enhancement, discarding an unsatisfactory fingerprint registration image, fingerprint feature point extraction, and performing stitching on a satisfactory fingerprint image. After the fingerprint template registration is completed, the electronic device 100 may obtain and store a plurality of fingerprint templates, and the fingerprint templates are used for performing matching verification on the input fingerprint sample in the fingerprint verification process, so as to ensure the validity of the user identity. In particular embodiments, the plurality of fingerprint templates may correspond to one or more fingers, depending on the finger used by the user during the fingerprint template enrollment process.
In this embodiment, in order to support controlling the voice assistant function of the electronic device 100 through fingerprint recognition, during a fingerprint enrollment process of a user or when the user initializes the voice assistant function, the electronic device 100 may further prompt the user to enroll a specific fingerprint template with a specific finger through the display screen 120, so as to wake up the voice assistant function of the electronic device 100. In particular embodiments, the enrollment process of the proprietary fingerprint template is substantially identical to the enrollment process of other fingerprint templates, except that a dedicated finger is required to be assigned to act as a voice assistant to control the finger to perform the enrollment of the proprietary fingerprint template. After the registration of the unique fingerprint template is completed, the electronic device 100 may associate the unique fingerprint template with the voice assistant function and save the unique fingerprint template.
Step S12, acquiring a fingerprint image input by a user;
in the electronic device 100, since the optical fingerprint recognition device 130 is disposed below the display screen 120, a user cannot perceive a specific position of the fingerprint detection area 103 of the optical fingerprint recognition device 130. Therefore, during the use of the electronic device 100, the system may control the display screen 120 to display a fingerprint prompting icon on the fingerprint detection area 103 through the display driving module according to the current working state or other triggering events (such as, but not limited to, a display screen touch detection trigger or a key press trigger, etc.) so as to prompt the user to press a position in the display area of the display screen 120 when performing a fingerprint input.
For example, when the electronic device 100 is in a standby state, most functional modules of the electronic device 100 may be in a sleep or low power consumption operating state except that a few necessary functional modules still operate in a normal state or are periodically started. If the user needs to perform an unlocking process on the electronic device 100 or use a voice assistant function of the electronic device 100, he or she may perform a fingerprint input by pressing a finger against the fingerprint detection area 103 of the display screen 120. As an alternative implementation manner, when the finger press of the user meets a certain trigger condition (for example, the press pressure or the press time reaches a preset threshold), the system of the electronic device 100 may wake up the optical fingerprint identification apparatus 130 through the fingerprint driving module. After the optical fingerprint identification device 130 is awakened, it may start fingerprint scanning and acquire a fingerprint image input by pressing a finger of a user.
For another example, when the electronic device 100 is in a normal operating state, and a user starts a certain program application requiring authentication, executes a certain application operation requiring authentication, or when the user needs to start a voice assistant function, the system of the electronic device 100 may control the display screen 120 to display the fingerprint prompt icon in the fingerprint detection area 103 according to actual needs. When the user performs a fingerprint pressing input in the fingerprint detection area 103, the optical fingerprint recognition device 130 may acquire a fingerprint image of the user by fingerprint scanning.
Of course, it should be understood that the above-mentioned several scenarios for user fingerprint input are merely exemplary, and the scenario for user fingerprint input at the electronic device 100 is not limited thereto. On the other hand, in the voice assistant control method based on fingerprint recognition provided in this embodiment, since the voice assistant of the electronic device 100 is capable of supporting fingerprint recognition to wake up, when a user wishes to wake up the voice assistant of the electronic device 100, the user can perform a pressing input on the fingerprint detection area 103 by using a designated finger used in the registration process of the dedicated fingerprint template, so that the optical fingerprint recognition device 130 can acquire a fingerprint image of the designated finger.
Step S13, judging whether the fingerprint image is matched with one of the pre-registered fingerprint templates, if so, entering step S14;
specifically, after the optical fingerprint identification device 130 acquires a fingerprint image that is pressed and input by the user in the fingerprint detection area 103, the electronic apparatus 100 may perform some necessary image processing on the fingerprint image, such as image enhancement processing, feature point processing, and the like. Then, the electronic device 100 may read the pre-registered fingerprint templates from the storage unit thereof, and determine whether the fingerprint image matches one of the pre-registered fingerprint templates by feature point comparison or other fingerprint matching methods. In a specific embodiment, the fingerprint matching process may be implemented in a processing unit (e.g., an application processor) of the electronic device 100, or may be performed in a microprocessor of the optical fingerprint identification apparatus 100 to perform fingerprint matching and output a matching result with the processing unit of the electronic device 100; the fingerprint matching process is preferably performed at a processing unit of the electronic device 100, irrespective of processing capabilities as well as storage capabilities.
When the similarity between the fingerprint image and one of the pre-registered fingerprint templates reaches a certain threshold, for example, when the number of corresponding feature points reaches a certain predetermined value, the fingerprint image and the fingerprint template may be considered to be matched, and therefore, the process proceeds to step S14; when the fingerprint image is not matched with the current fingerprint template, one fingerprint template can be selected again and matched with the fingerprint image for verification, in the actual work, the steps of selecting the fingerprint template and matching the fingerprint can be repeated, and if the fingerprint template matched with the fingerprint image cannot be found, the fingerprint image is considered to be not verified, namely the current user is not a legal user and cannot pass the user identity verification.
Step S14, judging whether the fingerprint template matched with the fingerprint image belongs to the exclusive fingerprint template, if so, entering step S15, otherwise, entering step S17;
specifically, when it is determined that the fingerprint image matches one of the fingerprint templates, the electronic device 100 further determines whether the fingerprint template matching the fingerprint image belongs to the specific fingerprint template, that is, whether the fingerprint template is one of at least one specific fingerprint template registered by a user with a specific finger and used for waking up the voice assistant function of the electronic device 100. If yes, it means that the current legal user of the electronic device 100 wishes to wake up the voice assistant function of the electronic device 100; the voice assistant control method based on fingerprint recognition goes to step S15. If not, it means that the valid user of the electronic device 100 only needs to perform authentication to unlock the device or perform other application operation, so the method goes to step S17.
Step S15, judging that the user identity authentication is passed, and simultaneously waking up the voice assistant of the electronic equipment;
when the fingerprint image matches the specific fingerprint template, the electronic device 100 may know that the current user is a valid user and/or that the current valid user wishes to use the voice assistant function, and thus, the electronic device 100 may verify the identity of the user and simultaneously wake up the voice assistant of the electronic device. For example, if the electronic device 100 is in a standby state, the system may control the display screen 120 to be lit and unlock the electronic device 100, and simultaneously turn on the voice assistant function of the electronic device 100.
Step S16, the voice assistant controls the electronic device to execute corresponding operation according to the voice input command of the user;
after the voice assistant of the electronic device 100 is awakened, the electronic device 100 may provide a voice interactive interface to the user, and the user may issue a voice input command to the system through the voice interactive interface. The voice assistant of the electronic device 100 acquires the voice input information corresponding to the voice input command through the voice recognition function, responds to the voice input information, controls the functional module of the electronic device 100 to perform corresponding operation, and then feeds back an operation result or response information to the user. In step S16, since the user has passed fingerprint authentication when the voice assistant of the electronic device 100 is working, if the voice input command of the user relates to some operations that require authentication, such as mobile payment, permission setting, application installation/deletion, etc., the electronic device 100 may directly perform the above operations without prompting the user for authentication, thereby effectively improving the user efficiency and operation experience of the voice assistant.
And step S17, judging that the user identity is verified, but not enabling the voice assistant function of the electronic equipment.
When the fingerprint image matches with other fingerprint templates that are not the exclusive fingerprint template, the electronic device 100 may know that the current user is a valid user, but the valid user does not need to wake up the voice assistant function. Therefore, in step S17, the electronic device 100 may determine that the current user authentication is successful and may perform the operation of the legitimate user, but maintain the so-called voice assistant shutdown function of the electronic device 100 to prevent the voice assistant from being mistakenly activated to interfere with or affect other functions of the electronic device 100.
It should be noted that, the voice assistant control method based on fingerprint recognition provided in the above embodiment is described in the electronic device 100 in some application scenarios with the combination of a common fingerprint verification function, and in practical work, the voice assistant control method based on fingerprint recognition provided in the embodiment of the present application may also be a method of independently performing wakeup or other voice assistant control of a voice assistant that controls the electronic device 100 through a fingerprint recognition technology.
In this scenario, referring to fig. 3, as an alternative embodiment, the method for controlling a voice assistant based on fingerprint recognition may be embodied as follows: the user can pre-register at least one fingerprint template with a designated finger as a specific fingerprint template for waking up the voice assistant of the electronic device (S1); when the voice assistant function of the electronic device 100 needs to be awakened, the user may perform a fingerprint pressing input through the designated finger, the electronic device 100 detects the fingerprint image of the user through the optical fingerprint recognition device 130 (S2), and when it is determined that the current fingerprint image matches the dedicated fingerprint template through fingerprint matching (S3), the voice assistant function may be directly awakened (S4). The specific process of the above voice assistant control method based on fingerprint identification may refer to the description of each step of the method shown in fig. 2, and is not described herein again.
As an embodiment, the present application further provides a voice assistant control system based on fingerprint recognition, where the voice assistant control system includes: the fingerprint registration module is used for registering an exclusive fingerprint template of a voice assistant for awakening the electronic equipment; the fingerprint acquisition module is used for acquiring a fingerprint image input by a user; the fingerprint matching module is used for judging whether the fingerprint image is matched with the exclusive fingerprint template; and the voice assistant awakening module is used for awakening the voice assistant of the electronic equipment when the fingerprint image is matched with the exclusive fingerprint template.
The fingerprint registration module may be specifically configured to pre-register a plurality of fingerprint templates, where at least one fingerprint template is an exclusive fingerprint template that is entered by a user using a designated finger, and the exclusive fingerprint template is used to wake up a voice assistant of the electronic device. Optionally, the fingerprint acquisition module acquires a fingerprint image input by a user through a fingerprint identification device; the fingerprint matching module includes: the matching unit is used for matching the fingerprint image with the pre-registered fingerprint templates so as to judge whether the fingerprint image is matched with one of the pre-registered fingerprint templates; and the judging unit is used for judging whether the fingerprint template matched with the fingerprint image belongs to the exclusive fingerprint template or not when the fingerprint image is matched with one of the fingerprint templates, and judging that the fingerprint image is matched with the exclusive fingerprint template when the fingerprint template belongs to the exclusive fingerprint template. And the voice assistant awakening module may be further configured to refuse to enable a voice assistant function of the electronic device when the fingerprint image matches one of the fingerprint templates but the fingerprint template is not the specific fingerprint template.
In a specific embodiment, each functional module of the above-mentioned voice assistant control system based on fingerprint recognition may be a software module or a hardware module, for example, each functional module may be implemented by executing some program instructions in a processing unit (such as an application processor or other processor) of the electronic device, or by controlling related hardware through program instructions; the program may be stored in a computer-readable storage medium. Moreover, the division of the functional modules is only an exemplary illustration, and in terms of specific implementation, specific working processes of the functional modules may refer to the description of the above embodiments.
On the other hand, it should be understood that the method for controlling a voice assistant based on fingerprint recognition provided in the embodiment of the present application is not limited to the electronic device 100 using an optical fingerprint recognition system under a screen shown in fig. 1, and may also be applied to electronic devices using other types of fingerprint recognition systems under a screen. Alternatively, the voice assistant control method based on fingerprint identification can also be applied to electronic equipment adopting a capacitive fingerprint identification system. As shown in fig. 4, the electronic device 400 may include a fingerprint recognition device 430, where the fingerprint recognition device 430 is a capacitive fingerprint recognition device, and may be disposed on a main key (such as a Home key) on the front surface of the electronic device 400. Alternatively, as shown in fig. 5, the electronic device 500 may include the fingerprint recognition device 530, and the fingerprint recognition device 530 may be a capacitive fingerprint recognition device disposed on the back of the electronic device 500.
When the electronic device 400, 500 shown in fig. 4 or fig. 5 is applied, the electronic device 400, 500 may also register a plurality of fingerprint templates in advance, where at least one fingerprint template is a dedicated fingerprint template for waking up a voice assistant of the electronic device. Since the fingerprint recognition device 430 or 530 is a physical component located on the front or back of the electronic device 400 or 500, the display screen does not need to display a fingerprint prompt icon in the fingerprint detection area of the display screen as in the above embodiments, and a user can directly perform a fingerprint pressing input on the fingerprint recognition device 430 or 530. When a user presses the fingerprint identification device 430 or 530 of the electronic device 400 or 500 with his finger, the electronic device 400 or 500 may acquire a fingerprint image input by the user through the fingerprint identification device 430 or 530, determine whether the fingerprint image matches a fingerprint template, and further determine whether the fingerprint template is the dedicated fingerprint template, and if so, the electronic device 400 or 500 may perform user authentication and wake up a voice assistant module of the electronic device at the same time. Further, the voice assistant controls the electronic devices 400 and 500 to perform corresponding operations according to the voice input command of the user. Similarly, when the method for controlling a voice assistant based on fingerprint recognition is applied to the electronic devices 400 and 500 shown in fig. 4 or fig. 5, the specific processes of the steps of the method may refer to the specific description of the embodiment shown in fig. 2.
As an alternative embodiment, when the electronic device wakes up the voice assistant by using a dedicated wake-up key, the fingerprint identification device may be directly integrated with the voice assistant wake-up key. For example, the fingerprint recognition device may be disposed to overlap with a key body of the voice assistant wake-up key. Please refer to fig. 6, which is a schematic structural diagram of an electronic device employing a voice recognition assistant wake-up button with a fingerprint recognition function. The electronic device 600 includes a bezel 610, a display 620, a fingerprint recognition device 630, and a voice assistant wake-up button 640.
The bezel 610 may be a metal bezel or a bezel of other material. The display screen 620 is located on the front surface of the electronic device 610 and is surrounded by the bezel 610, and the display screen 620 may be specifically an OLED display screen or an LCD display screen; in a specific embodiment, the display screen 620 may also be a touch display screen with both touch detection and display functions. The fingerprint identification device 630 is overlapped with the voice assistant wakeup button 640 and is installed on the side of the electronic device 600. For example, the bezel 610 may be formed with an opening on one side for receiving the voice assistant wake-up button 640, and the voice recognition wake-up button 640 may be a physical button dedicated to wake up a voice assistant of the electronic device 600, that is, when the voice recognition wake-up button 640 is pressed, the electronic device 600 turns on its voice assistant function.
In the embodiment shown in FIG. 6, the fingerprint recognition device 630 may be a capacitive fingerprint recognition device that is disposed directly above the voice assistant wake-up button 640. The overlapped fingerprint identification device 630 and the voice assistant awakening key 640 can be understood as a fingerprint key module with fingerprint identification and voice assistant awakening functions; alternatively, the fingerprint identification device 630 may also serve as a key cap for the voice assistant wake-up key 640. Therefore, when the user turns on the voice assistant function by pressing the voice recognition wake-up button 640, he or she simultaneously presses the fingerprint recognition device 630, so that the fingerprint recognition device 630 can collect the user fingerprint information and authenticate the user fingerprint information when the voice assistant is turned on. Based on the above configuration, when a valid user wakes up the voice assistant of the electronic device 100 through the voice assistant wake-up button 640, the electronic device 100 may simultaneously verify that the user is a valid user through fingerprint identification when the voice assistant is turned on, and further control its internal functional module to respond to a voice input command of the user; for example, device unlocking and screen lighting are directly performed in the standby state of the electronic device 100, and authentication is not required to be performed again when some sensitive applications of the electronic device 100 are operated.
On the other hand, as shown in fig. 6, as an alternative implementation, the electronic device 600 may further include a main key (e.g., a Home key) 650 located on the front surface, where the main key may be a virtual key or a physical key. Moreover, in some optional embodiments, the main key 650 may also be a fingerprint key, i.e. the main key 650 is also equipped with another fingerprint identification device; that is, the electronic device 600 may be equipped with a dual fingerprint system at both the voice assistant wake button 640 and the main button 650. Compared with the fingerprint identification device 630 which is only arranged on the voice assistant wake-up key 640 on the side surface of the electronic device 600, the configuration of the main key 650 as the front fingerprint key is more suitable for the operation habit of the user, and the user experience can be improved.
As another alternative, the voice assistant wake-up button 640 may also be configured with a physical button on the front or back of the electronic device 600, and the fingerprint recognition device 630 is disposed to overlap the physical button on the front or back. Alternatively, it may also adopt a virtual key located on the front, back or side of the electronic device 600, and the fingerprint recognition device 630 is simultaneously disposed on the surface of the virtual key.
As another embodiment, referring to fig. 7, the overlapped fingerprint identification device 730 and the voice assistant wakeup key 740 may also be applied to the electronic device 700 that uses a full screen or a quasi-full screen, that is, the display screen 720 of the electronic device 700 may extend to most of the front area of the electronic device 700, and no physical main key is arranged on the front side. Moreover, the fingerprint identification device 730 and the voice assistant wakeup key 740 may be disposed on one side of the bezel 710 of the electronic device 700 as well; in addition, optionally, the electronic device 700 may be configured with the off-screen optical fingerprint identification device 750, and the specific structure and operation process of the off-screen optical fingerprint identification device 750 may refer to the description of the above embodiments.
Based on the electronic device which adopts the voice recognition assistant with the fingerprint recognition function to wake up the key, the application further provides another voice assistant control method based on fingerprint recognition. Please refer to fig. 8, which is a flowchart illustrating a voice assistant control method based on fingerprint recognition according to another embodiment of the present application. The method mainly comprises the following steps:
step S21, detecting whether the voice assistant awakening key of the electronic equipment is pressed;
for ease of understanding, the steps of the voice assistant control method shown in FIG. 8 are described below with respect to the electronic device 600 shown in FIG. 6 as an example. Specifically, when the user needs to use the voice assistant function of the electronic device 600, he or she may wake up the voice assistant by pressing the voice assistant wake-up button 640 of the electronic device 600 with his or her finger, and thus, in step S21, the electronic device 600 may determine whether the voice assistant wake-up button 640 is pressed by key detection, and if so, the voice assistant control method based on fingerprint recognition goes to step S22.
Step S22, when the voice assistant awakening key is pressed, acquiring a fingerprint image input by a user through a fingerprint identification device above the voice assistant awakening key;
specifically, in step S22, when the electronic device 600 determines that the voice assistant wake-up key 640 is pressed through key detection, it may perform fingerprint scanning by the fingerprint detection device 630 above the voice assistant wake-up key 640, and if the pressed object is a finger of a user, the fingerprint identification device 630 may acquire a fingerprint image of the finger of the user through fingerprint scanning.
Step S23, judging whether the fingerprint image is matched with a pre-registered fingerprint template, if so, entering step S24, otherwise, entering step S25;
after the fingerprint recognition device 630 acquires the fingerprint image, the electronic device 600 may perform necessary processing on the fingerprint image, such as image enhancement, feature extraction, and the like, and read a pre-registered fingerprint template from an internal storage unit. Then, the processing unit of the electronic device 600 may compare the fingerprint image with the fingerprint template to determine whether the fingerprint template matching the fingerprint image can be found. If so, the method proceeds to step S24, otherwise to step S25.
In a specific embodiment, the pre-registered fingerprint template may be a fingerprint template that is entered and stored in the electronic device 600 when the user performs fingerprint registration, that is, step S23 only needs to determine whether the fingerprint image scanned by the fingerprint identification device 630 is from a legitimate user. Alternatively, the pre-registered fingerprint template may be a dedicated fingerprint template specifically registered for voice assistant control, as described in connection with the embodiment shown in fig. 2. If the user has registered the dedicated fingerprint template in advance, it is determined in step S23 whether the fingerprint image matches the dedicated fingerprint template, and if so, the process proceeds to step S24.
Step S24, judging that the user identity authentication is passed, and waking up the voice assistant of the electronic equipment;
in the fingerprint matching process, if the fingerprint image acquired by the fingerprint identification device 630 matches the pre-registered fingerprint template, the processing unit of the electronic device 600 may determine that the user identity verification is passed, that is, the user currently pressing the voice assistant wake-up key 640 is a valid user. Meanwhile, since the voice assistant wake-up button 640 is triggered by being pressed, the electronic device 600 may trigger and wake up its voice assistant in response to the pressing. Of course, it should be understood that if the user is pre-registered with a dedicated fingerprint template for voice assistant control, the electronic device 600 needs to wake up the voice assistant of the electronic device 600 when the fingerprint image acquired by the fingerprint identification device 630 matches the dedicated fingerprint template.
Step S25, determining that the user identity authentication fails, and refusing to wake up the voice assistant of the electronic device or waking up the voice assistant but performing permission limitation on the voice assistant.
In the fingerprint matching process, if the fingerprint image is not matched with the pre-registered fingerprint template, it means that the current user is not a pre-registered legal user. Therefore, the electronic device 600 may determine that the current user authentication fails, and refuse to wake up the voice assistant of the electronic device 600. Alternatively, in other alternative embodiments, the electronic device 600 may still wake the voice assistant because it has detected that the voice assistant wake-up button 640 has been pressed for triggering, but may limit the authority of the voice assistant while waking the voice assistant because the authentication is not passed, such as limiting the voice assistant from performing certain operations related to authentication to ensure the security of the electronic device 600.
After the voice assistant of the electronic device 600 is awakened, the voice assistant of the electronic device 600 acquires the voice input command through the voice recognition function, controls the functional modules of the electronic device 100 to perform corresponding operations, and then feeds back an operation result or response information to the user. Of course, if the voice assistant is limited by the authority, the voice assistant may refuse to execute the operation corresponding to the voice input command and return a prompt message indicating that the operation is rejected to the user when the voice input command of the user is not authorized.
In addition, it should be understood that the voice assistant control method shown in fig. 8 may also be applied to the electronic device 700 shown in fig. 7 or other electronic devices that may wake up the voice assistant function by using fingerprint recognition, which is not limited in this application.
Compared with the traditional method, system and electronic equipment for controlling the voice assistant by using the voice awakening words or the common physical key, the voice assistant control method, system and electronic equipment provided by the embodiments of the application can awaken the voice assistant of the electronic equipment through the fingerprint identification function when the user needs to use the voice assistant function of the electronic equipment, so that the voice assistant awakening and the user identity authentication can be simultaneously controlled through one-time operation, on one hand, the user operation efficiency and the user experience are improved, and on the other hand, the user fingerprint authentication is simultaneously passed when the voice assistant is started, so that the application of the voice assistant can be expanded to a scene needing the user identity authentication.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions (e.g., an application processor or other processing unit). The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as Read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and so on.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope of the disclosure being indicated by the following claims.
It should be understood that the above-mentioned embodiments are merely preferred embodiments of the present application and are not intended to limit the present application, and any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.
Claims (15)
1. A voice assistant control method based on fingerprint identification is characterized by comprising the following steps:
registering a special fingerprint template of a voice assistant for waking up the electronic equipment in advance;
acquiring a fingerprint image input by a user;
judging whether the fingerprint image is matched with the exclusive fingerprint template;
and when the fingerprint image is matched with the exclusive fingerprint template, waking up a voice assistant of the electronic equipment.
2. The voice assistant control method of claim 1, wherein pre-registering a proprietary fingerprint template for a voice assistant to wake up an electronic device comprises:
the method comprises the steps of registering a plurality of fingerprint templates in advance, wherein at least one fingerprint template is an exclusive fingerprint template which is input by a user through a designated finger, and the exclusive fingerprint template is used for awakening a voice assistant of the electronic equipment.
3. The voice assistant control method of claim 2, wherein the determining whether the fingerprint image matches the proprietary fingerprint template comprises:
judging whether the fingerprint image is matched with one of the pre-registered fingerprint templates;
when the fingerprint image is matched with one of the fingerprint templates, judging whether the fingerprint template matched with the fingerprint image belongs to the exclusive fingerprint template;
if yes, the fingerprint image is judged to be matched with the exclusive fingerprint template.
4. The voice assistant control method of claim 3, further comprising:
and when the fingerprint image is matched with one of the fingerprint templates but the fingerprint template is not the exclusive fingerprint template, judging that the user identity verification is passed but not starting the voice assistant function of the electronic equipment.
5. The voice assistant control method of claim 1, further comprising:
and after the voice assistant is awakened, the electronic equipment is controlled to execute corresponding operation according to a voice input command of a user.
6. A voice assistant control system based on fingerprint recognition is characterized by comprising:
the fingerprint registration module is used for registering an exclusive fingerprint template of a voice assistant for awakening the electronic equipment;
the fingerprint acquisition module is used for acquiring a fingerprint image input by a user;
the fingerprint matching module is used for judging whether the fingerprint image is matched with the exclusive fingerprint template;
and the voice assistant awakening module is used for awakening the voice assistant of the electronic equipment when the fingerprint image is matched with the exclusive fingerprint template.
7. The voice assistant control system of claim 6, wherein the fingerprint registration module is specifically configured to pre-register a plurality of fingerprint templates, at least one of the fingerprint templates being a dedicated fingerprint template for a user to enter with a specific finger, the dedicated fingerprint template being used to wake up a voice assistant of the electronic device.
8. The voice assistant control system of claim 7, wherein the fingerprint matching module comprises:
the matching unit is used for matching the fingerprint image with the pre-registered fingerprint templates so as to judge whether the fingerprint image is matched with one of the pre-registered fingerprint templates;
and the judging unit is used for judging whether the fingerprint template matched with the fingerprint image belongs to the exclusive fingerprint template or not when the fingerprint image is matched with one of the fingerprint templates, and judging that the fingerprint image is matched with the exclusive fingerprint template when the fingerprint template belongs to the exclusive fingerprint template.
9. The voice assistant control system of claim 8,
the voice assistant awakening module is further used for refusing to start the voice assistant function of the electronic equipment when the fingerprint image of the fingerprint matching module is matched with one of the fingerprint templates but the fingerprint template is not the exclusive fingerprint template.
10. An electronic device characterized by comprising a voice assistant control system based on fingerprint recognition according to any one of claims 5-9.
11. An electronic device is characterized by comprising a fingerprint identification device and a voice assistant wake-up key, wherein the fingerprint identification device and the voice assistant wake-up key are arranged in an overlapping mode, the voice assistant wake-up key is used for waking up a voice assistant of the electronic device, the fingerprint identification device is used for acquiring a fingerprint image of a user when the voice assistant wake-up key is pressed, and the fingerprint image is used for judging whether the user pressing the voice assistant wake-up key is a legal user currently so as to determine whether the voice assistant is normally started.
12. The electronic device of claim 11, further comprising a processing unit to determine whether the fingerprint image matches a pre-registered fingerprint template and, when the fingerprint image matches the pre-registered fingerprint template, to determine that user authentication passed and to wake up a voice assistant of the electronic device.
13. The electronic device of claim 12, wherein the pre-registered fingerprint template comprises a proprietary fingerprint template entered by a user with a designated finger, the proprietary fingerprint template being used to wake up a voice assistant of the electronic device.
14. A voice assistant control method based on fingerprint identification is characterized by comprising the following steps:
detecting whether a voice assistant awakening key of the electronic equipment is pressed;
when the voice assistant awakening key is pressed, acquiring a fingerprint image input by a user through a fingerprint identification device above the voice assistant awakening key;
judging whether the fingerprint image is matched with a pre-registered fingerprint template; ,
and if the fingerprint image is matched with the pre-registered fingerprint template, judging that the user identity authentication is passed and awakening the voice assistant of the electronic equipment.
15. The voice assistant control method of claim 14, further comprising:
and when the fingerprint image is not matched with the pre-registered fingerprint template, judging that the user identity authentication is not passed, and refusing to awaken the voice assistant of the electronic equipment or awakening the voice assistant but limiting the authority of the voice assistant.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810707867.9A CN110677532A (en) | 2018-07-02 | 2018-07-02 | Voice assistant control method and system based on fingerprint identification and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810707867.9A CN110677532A (en) | 2018-07-02 | 2018-07-02 | Voice assistant control method and system based on fingerprint identification and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110677532A true CN110677532A (en) | 2020-01-10 |
Family
ID=69065967
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810707867.9A Pending CN110677532A (en) | 2018-07-02 | 2018-07-02 | Voice assistant control method and system based on fingerprint identification and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110677532A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112164395A (en) * | 2020-09-18 | 2021-01-01 | 北京百度网讯科技有限公司 | Vehicle-mounted voice starting method and device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103440445A (en) * | 2013-08-14 | 2013-12-11 | 深圳市亚略特生物识别科技有限公司 | Electronic equipment unlocking control method and system |
| CN104104460A (en) * | 2013-04-09 | 2014-10-15 | 中国计量学院 | Wireless interphone intelligent control broadcasting system having fingerprint identification function |
| CN104361272A (en) * | 2014-10-11 | 2015-02-18 | 深圳市汇顶科技股份有限公司 | Fingerprint input information processing method and system and mobile terminal |
| US20170110125A1 (en) * | 2015-10-14 | 2017-04-20 | Alibaba Group Holding Limited | Method and apparatus for initiating an operation using voice data |
| CN107592416A (en) * | 2017-08-31 | 2018-01-16 | 努比亚技术有限公司 | Method for sending voice message, terminal and computer-readable recording medium |
-
2018
- 2018-07-02 CN CN201810707867.9A patent/CN110677532A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104104460A (en) * | 2013-04-09 | 2014-10-15 | 中国计量学院 | Wireless interphone intelligent control broadcasting system having fingerprint identification function |
| CN103440445A (en) * | 2013-08-14 | 2013-12-11 | 深圳市亚略特生物识别科技有限公司 | Electronic equipment unlocking control method and system |
| CN104361272A (en) * | 2014-10-11 | 2015-02-18 | 深圳市汇顶科技股份有限公司 | Fingerprint input information processing method and system and mobile terminal |
| US20170110125A1 (en) * | 2015-10-14 | 2017-04-20 | Alibaba Group Holding Limited | Method and apparatus for initiating an operation using voice data |
| CN107592416A (en) * | 2017-08-31 | 2018-01-16 | 努比亚技术有限公司 | Method for sending voice message, terminal and computer-readable recording medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112164395A (en) * | 2020-09-18 | 2021-01-01 | 北京百度网讯科技有限公司 | Vehicle-mounted voice starting method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3674856B1 (en) | Multi-sensor-based on-screen fingerprint collection method and system and electronic device | |
| CN109496314B (en) | Fingerprint recognition device and electronic equipment under screen | |
| EP3144835B1 (en) | Fingerprint recognition-based terminal and method and system for logging in to same in stand-by state | |
| US10929631B2 (en) | Fingerprint sensor with proximity detection, and corresponding devices, systems, and methods | |
| US10885294B2 (en) | Finger print sensor with passive proximity detection for power savings in an electronic device | |
| CN108729762B (en) | Control system and control method of electronic lock and intelligent door lock | |
| WO2019157804A1 (en) | Method and apparatus for fingerprint unlocking | |
| US20190286879A1 (en) | Fingerprint recognition control methods, touch panels and touch display devices | |
| US9471764B2 (en) | Electronic device switchable to a user-interface unlocked mode based upon spoof detection and related methods | |
| US20140157401A1 (en) | Method of Dynamically Adjusting an Authentication Sensor | |
| US20150015688A1 (en) | Facial unlock mechanism using light level determining module | |
| EP3678002B1 (en) | Multi-sensor-based under-screen fingerprint collection method, system and electronic device | |
| CN110062933B (en) | Fingerprint identification card and power supply operation method using same | |
| CN108388786A (en) | Unlocked by fingerprint method and device | |
| WO2019136759A1 (en) | Press detection method and device for fingerprint identification system and terminal device | |
| JP2013140440A (en) | Information processing device and driving method for the same, control program and readable storage medium | |
| US10248826B2 (en) | Fingerprint sensor with proximity detection, and corresponding devices, systems, and methods | |
| CN106250747B (en) | Information processing method and electronic equipment | |
| EP1941422B1 (en) | Biometric detector and identity control device | |
| CN108133180A (en) | Fingerprint identification method, device and terminal | |
| CN110677532A (en) | Voice assistant control method and system based on fingerprint identification and electronic equipment | |
| US9824219B2 (en) | Electronic device having wake up verification and electronic system having the electronic device | |
| CN106802710B (en) | Electronic device and driving method | |
| CN111242111B (en) | Fingerprint identification method and device and electronic equipment | |
| CN108521484A (en) | A kind of mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |