CN110248024B - Unlocking method and device, electronic equipment and computer readable storage medium - Google Patents
Unlocking method and device, electronic equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN110248024B CN110248024B CN201910502922.5A CN201910502922A CN110248024B CN 110248024 B CN110248024 B CN 110248024B CN 201910502922 A CN201910502922 A CN 201910502922A CN 110248024 B CN110248024 B CN 110248024B
- Authority
- CN
- China
- Prior art keywords
- icon
- focus
- area
- display screen
- screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 68
- 210000001508 eye Anatomy 0.000 claims abstract description 116
- 230000015654 memory Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 13
- 210000001747 pupil Anatomy 0.000 claims description 12
- 238000004891 communication Methods 0.000 claims description 8
- 210000004087 cornea Anatomy 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 14
- 230000006870 function Effects 0.000 description 7
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 230000004397 blinking Effects 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 210000003462 vein Anatomy 0.000 description 1
- 230000002618 waking effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/66—Substation equipment, e.g. for use by subscribers with means for preventing unauthorised or fraudulent calling
- H04M1/667—Preventing unauthorised calls from a telephone set
- H04M1/67—Preventing unauthorised calls from a telephone set by electronic means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72463—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions to restrict the functionality of the device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/52—Details of telephonic subscriber devices including functional features of a camera
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Multimedia (AREA)
- Computer Security & Cryptography (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Ophthalmology & Optometry (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Environmental & Geological Engineering (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses unlocking method and related equipment, which are applied to electronic equipment comprising a display screen and a camera module, wherein the electronic equipment is in a screen locking state, and the method comprises the following steps: displaying at least one icon on the display screen; tracking the human eyes through the camera module to determine a plurality of focuses of the human eyes on the display screen; and if the first area where the first icon is located comprises the position where the first focus is located, and the second area comprises the position where the second focus is located, executing screen unlocking operation, wherein the first time when the first focus is watched by the human eyes is earlier than the second time when the second focus is watched by the human eyes. By adopting the embodiment of the application, the protection of information safety can be improved.
Description
Technical Field
The present application relates to the field of electronic technologies, and in particular, to an unlocking method and a related device.
Background
With the development of science and technology and the application of mobile communication, electronic devices (such as smart phones, smart watches, etc.) have become an essential part of people's daily life. In order to improve the security of information protection, the user cannot operate the electronic device when the electronic device is in a screen locking state. The existing screen unlocking method is usually password unlocking or fingerprint identification, and the unlocking password information (such as a digital password combination, a fingerprint image and the like) of the contact type unlocking method is easy to steal and has low safety.
Disclosure of Invention
The embodiment of the application provides an unlocking method and related equipment, which are used for improving the protection of information safety.
In a first aspect, an embodiment of the present application provides an unlocking method, which is applied to an electronic device including a display screen and a camera module, where the electronic device is in a screen locking state, and the method includes:
displaying at least one icon on the display screen;
tracking the human eyes through the camera module to determine a plurality of focuses of the human eyes on the display screen;
if the first area where the first icon is located includes the position where the first focus is located, the second area includes the position where the second focus is located, then execute screen unlocking operation, at least one icon includes the first icon, the display screen includes the second area, the first area is different from the second area, the first focus is by the first time that people's eye was focused is earlier than the second focus is by the second time that people's eye was focused, a plurality of focuses include the first focus with the second focus.
In a second aspect, an embodiment of the present application provides an unlocking device, which is applied to an electronic device including a display screen and a camera module, wherein the electronic device is in a screen locking state, and the unlocking device includes:
a display unit for displaying at least one icon on the display screen;
the determining unit is used for tracking the human eyes through the camera module so as to determine a plurality of focuses of the human eyes on the display screen;
the execution unit is used for executing screen unlocking operation if a first area where the first icon is located comprises a position where a first focus is located, a second area comprises a position where a second focus is located, at least one icon comprises the first icon, the display screen comprises the second area, the first area is different from the second area, the first focus is earlier than the second focus when the human eyes watch, and the plurality of focuses comprise the first focus and the second focus.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing steps in the method according to the first aspect of the embodiment of the present application.
In a fourth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program makes a computer perform some or all of the steps described in the method according to the first aspect of the present application.
In a fifth aspect, the present application provides a computer program product, where the computer program product includes a non-transitory computer-readable storage medium storing a computer program, where the computer program is operable to cause a computer to perform some or all of the steps described in the method according to the first aspect of the present application. The computer program product may be a software installation package.
It can be seen that, in the embodiment of the application, the electronic device displays at least one icon on the display screen, and then tracks the human eyes through the camera module to determine that the human eyes watch on a plurality of focuses of the display screen; if the first area where the first icon is located comprises the position where the first focus is located, and the second area comprises the position where the second focus is located, screen unlocking operation is executed, the unlocking mode is non-contact, unlocking password information is not easy to steal, and therefore protection of information safety is improved.
These and other aspects of the present application will be more readily apparent from the following description of the embodiments.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;
fig. 2A is a schematic flowchart of an unlocking method according to an embodiment of the present application;
FIG. 2B is a schematic diagram illustrating a display of an AOD mode according to an embodiment of the present disclosure;
fig. 2C is a display schematic diagram of a lock screen interface provided in an embodiment of the present application;
fig. 2D is a schematic diagram of a positional relationship between the first region, the second region, the first focal point, and the second focal point according to an embodiment of the present application.
Fig. 2E is a schematic diagram of a process of dynamically moving an icon according to an embodiment of the present application;
fig. 3 is a schematic flowchart of an unlocking method provided in an embodiment of the present application;
fig. 4 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
fig. 5 is a schematic structural diagram of an unlocking device provided in an embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The following are detailed below.
The terms "first," "second," "third," and "fourth," etc. in the description and claims of this application and in the accompanying drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
Hereinafter, some terms in the present application are explained to facilitate understanding by those skilled in the art.
Electronic devices may include various handheld devices, vehicle mounted devices, wearable devices, computing devices or other processing devices connected to a wireless modem with wireless communication capabilities, as well as various forms of User Equipment (UE), Mobile Stations (MS), terminal Equipment (terminal device), and so forth.
Referring to fig. 1, fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure, where the electronic device includes a processor, a Memory, a signal processor, a communication interface, a touch screen, a speaker, a microphone, a Random Access Memory (RAM), a camera module, a transmitter, a sensor, and the like.
The processor may also be an AP processor, or may also be another processor.
The storage, the signal processor, the touch screen, the loudspeaker, the microphone, the RAM, the camera shooting module, the emitter and the sensor are connected with the processor, and the communication interface is connected with the signal processor.
The touch screen includes a display screen and a Touch Panel (TP). The display screen is used for displaying at least one icon.
Wherein, the sensor comprises a fingerprint sensor, an infrared sensor, a gyroscope and the like under the screen.
Wherein, the module of making a video recording includes leading camera and rearmounted camera, and the module of making a video recording is used for tracking people's eye.
Wherein the emitter is configured to emit an optical signal.
In an embodiment of the present application, a processor configured to display at least one icon on the display screen; tracking the human eyes through the camera module to determine a plurality of focuses of the human eyes on the display screen; if the first area where the first icon is located includes the position where the first focus is located, the second area includes the position where the second focus is located, then execute screen unlocking operation, at least one icon includes the first icon, the display screen includes the second area, the first area is different from the second area, the first focus is by the first time that people's eye was focused is earlier than the second focus is by the second time that people's eye was focused, a plurality of focuses include the first focus with the second focus.
In an implementation manner of the application, the processor is further configured to dynamically move the first icon from the first area to the second area when the screen unlocking operation is performed.
In an implementation of the application, the plurality of foci includes at least one third focus, a third time at which the at least one third focus is fixated by the human eye is between the first time and the second time; in respect of dynamically moving the first icon from the first area to the second area, a processor, in particular for determining a movement trajectory of the human eye based on the first focus, the second focus and the at least one third focus; dynamically moving the first icon from the first area to the second area based on the movement trajectory.
In an implementation manner of the present application, after the screen unlocking operation is performed, the processor is further configured to start a first application corresponding to the first focus, or start a second application corresponding to the second focus, or start a third application corresponding to the at least one third focus.
In an implementation manner of the present application, the electronic device further includes a transmitter, in which, in tracking the human eye through the camera module to determine a plurality of focal points where the human eye gazes at the display screen, the processor is specifically configured to control the transmitter to emit a light signal to illuminate the human eye; acquiring a plurality of first images of the human eyes through the camera module; determining a first position of a pupil of the human eye and a second position of a purkinje spot in each first image, the purkinje spot being a spot formed by reflection of the light signal impinging on a cornea of the human eye; determining a plurality of focal points at which the human eye gazes at the display screen based on the first and second locations in each first image.
In an implementation manner of the present application, in displaying at least one icon on the display screen, the processor is specifically configured to display at least one icon in a partial area of the display screen when the electronic device is in an AOD mode and the partial area of the display screen is lit in the AOD mode; or displaying a screen locking interface on the display screen, wherein the screen locking interface displays at least one icon.
In an implementation manner of the present application, the at least one icon includes at least one of: the electric quantity icon, the time icon, the date icon, the short message icon and the telephone icon.
It should be noted that, specific implementation procedures of the steps executed by the modules may refer to specific implementation procedures described in the following methods, and are not described herein.
Referring to fig. 2A, fig. 2A is a schematic flowchart of an unlocking method provided in an embodiment of the present application, and the unlocking method is applied to an electronic device including a display screen and a camera module, where the electronic device is in a screen locking state, and the method includes:
step 201: displaying at least one icon on the display screen.
Wherein the at least one icon includes at least one of: the electric quantity icon, the time icon, the date icon, the short message icon, the telephone icon, the QQ icon, the WeChat icon, the microblog icon, the Paibao icon and the like.
In an implementation manner of the present application, the displaying at least one icon on the display screen includes:
when the electronic equipment is in a screen rest AOD mode and a partial area of the display screen is lightened in the AOD mode, displaying at least one icon in the partial area of the display screen;
or displaying a screen locking interface on the display screen, wherein the screen locking interface displays at least one icon.
It should be noted that, when the electronic device is in an Always On Display (AOD) mode, a partial area of the Display screen remains normally bright and the interface background of the electronic device is not bright.
As shown in fig. 2B and fig. 2C, fig. 2B is a schematic display diagram of an AOD mode provided in an embodiment of the present application, and fig. 2C is a schematic display diagram of a screen locking interface provided in an embodiment of the present application. The display screen of the electronic device shown in fig. 2B is a black screen except for displaying a time icon, a date icon, an electric quantity icon, a short message icon, a mail icon, and a telephone icon. The display screen of the electronic device shown in fig. 2C not only displays the Wi-Fi icon, the cellular network icon, the time icon, the date icon, the power icon, and the operator icon, but also the lock screen interface background portion of the display screen remains normally bright.
In an implementation manner of the present application, before displaying at least one icon on the display screen, the method further includes:
and detecting a screen unlocking instruction.
The screen unlocking instruction may be a pressing operation on an entity key (e.g., a power key, a volume key, etc.) of the electronic device, a clicking operation, a sliding operation, etc. on the display screen, a lifting and waking operation on the electronic device, a blinking operation for a preset number of times or a watching operation for a preset duration on the electronic device, which is not limited herein.
Step 202: the human eyes are tracked through the camera module so as to determine that the human eyes watch the plurality of focuses of the display screen.
In an implementation of the present application, the electronic device further includes a transmitter, through the module of making a video recording tracks the eyes to confirm that the eyes watch on a specific implementation of a plurality of focuses of the display screen is:
controlling the transmitter to emit a light signal to illuminate the human eye;
acquiring a plurality of first images of the human eyes through the camera module;
determining a first position of a pupil of the human eye and a second position of a purkinje spot in each first image, the purkinje spot being a spot formed by reflection of the light signal impinging on a cornea of the human eye;
determining a plurality of focal points at which the human eye gazes at the display screen based on the first and second locations in each first image.
In an implementation of the present application, the determining a plurality of focal points at which the human eye gazes at the display screen based on the first position and the second position in each first image includes:
determining coordinates of a plurality of focal points at which the human eye gazes at the display screen based on a first formula and a second formula, the first formula and the second formula being respectively:
xn＝a+a1·xn+a2·xn 2+a3·xn 3+a4·xn 4+a5·xn 5；
yn＝b+b1·yn+b2·yn 2+b3·yn 3+b4·yn 4+b5·yn 5；
wherein, the xnAnd ynRespectively, the abscissa and the ordinate of the nth focal point, saidxnAndynrespectively the absolute value of the difference between the abscissa of the nth Purkinje spot and the abscissa of the nth pupil, and the absolute value of the difference between the ordinate of the nth Purkinje spot and the ordinate of the nth pupil, wherein a-a5、b～b5Is an empirical parameter;
determining the plurality of focal points based on the coordinates of the plurality of focal points.
Wherein, a to a5、b～b5The determination may be based on multiple trials or based on neural network method training.
In an implementation of the present application, the determining a plurality of focal points at which the human eye gazes at the display screen based on the first position and the second position in each first image includes:
determining coordinates of a plurality of focal points where the human eye gazes at the display screen based on a third formula and a fourth formula, wherein the third formula and the fourth formula are respectively:
xn＝c+c1·xn+c2·yn+c3·xn·yn+c4·xn 2+c5·yn 2；
yn＝d+d1·yn+d2·xn+d3·xn·yn+d4·xn 2+d5·yn 2；
wherein, the xnAnd ynRespectively, the abscissa and the ordinate of the nth focal point, saidxnAndynthe absolute value of the difference between the abscissa of the nth Purkinje spot and the abscissa of the nth pupil, and the absolute value of the difference between the ordinate of the nth Purkinje spot and the ordinate of the nth pupil, wherein c-c5、d～d5Is an empirical parameter;
determining the plurality of focal points based on the coordinates of the plurality of focal points.
Wherein, c to c5、d～d5The determination may be based on multiple trials or based on neural network method training.
Step 203: if the first area where the first icon is located includes the position where the first focus is located, the second area includes the position where the second focus is located, then execute screen unlocking operation, at least one icon includes the first icon, the display screen includes the second area, the first area is different from the second area, the first focus is by the first time that people's eye was focused is earlier than the second focus is by the second time that people's eye was focused, a plurality of focuses include the first focus with the second focus.
For example, as shown in fig. 2D, fig. 2D is a schematic diagram of a positional relationship between a first region, a second region, a first focal point, and a second focal point according to an embodiment of the present application. The first icon is an information icon, the information icon is in the first area, the first focus is also in the first area, and the second focus is in the second area.
It can be seen that, in the embodiment of the application, the electronic device displays at least one icon on the display screen, and then tracks the human eyes through the camera module to determine that the human eyes watch on a plurality of focuses of the display screen; if the first area where the first icon is located comprises the position where the first focus is located, and the second area comprises the position where the second focus is located, screen unlocking operation is executed, the unlocking mode is non-contact, unlocking password information is not easy to steal, and therefore protection of information safety is improved.
In an implementation manner of the present application, the method further includes:
dynamically moving the first icon from the first area to the second area while performing the screen unlock operation.
In an implementation of the application, the plurality of foci includes at least one third focus, a third time at which the at least one third focus is fixated by the human eye is between the first time and the second time; one embodiment of dynamically moving the first icon from the first area to the second area is:
determining a movement trajectory of the human eye based on the first focus, the second focus, and the at least one third focus;
dynamically moving the first icon from the first area to the second area based on the movement trajectory.
For example, fig. 2E is a schematic diagram of a process of dynamically moving an icon according to an embodiment of the present application. As shown in fig. 2E, the information icon is first moved from the first area to the third area, and then the information icon is moved from the third area to the second area.
Therefore, in the embodiment of the application, the screen can be unlocked only by watching different areas on the display screen according to the preset sequence, so that the information safety protection is further improved; and meanwhile, the icons are dynamically moved to the designated area according to the watching sequence, so that the user can watch the unlocking process, and the user experience is improved.
In an implementation manner of the present application, after performing the screen unlocking operation, the method further includes:
and starting a first application corresponding to the first focus, or starting a second application corresponding to the second focus, or starting a third application corresponding to the at least one third focus.
It should be noted that, as shown in fig. 2E, after the screen unlocking operation is performed, the information application corresponding to the first focus may be started, and if an application other than the information application exists in the third area or the second area, the second application corresponding to the second focus may also be started, or the third application corresponding to the third focus may also be started.
It can be seen that, in the embodiment of the application, after the screen unlocking operation is performed, the application corresponding to the focus is started, and the process of entering the main page is directly skipped, so that the starting time of the application is shortened.
In an implementation manner of the present application, before tracking the human eye through the camera module to determine that the human eye gazes at the plurality of focuses of the display screen, the method further includes:
determining that the degree of fatigue of the human eye is less than or equal to a first threshold under a first condition comprising at least one of: the human eye closing time is greater than or equal to a preset time, the human eye closing area is greater than or equal to a preset area, and the blink frequency of the human eyes is greater than or equal to a preset frequency.
The preset time is, for example, 5s, 10s, 15s, 20s or other values, which is not limited herein.
The predetermined area may be, for example, 2/3, 4/5, 5/7 or other values of the human eye area, which is not limited herein.
The predetermined frequency may be, for example, 3 times/s, 5 times/s, 7 times/s, 10 times/s, or other values, which is not limited herein.
It can be seen that, in the embodiment of the present application, before the camera module is started to track the human eye, it is determined that the human eye is not in the fatigue state first, so as to prevent the false unlocking in the fatigue state.
In an implementation manner of the present application, after the plurality of first images of the human eye are acquired by the camera module, the method further includes:
analyzing the plurality of first images to obtain a target feature point, wherein the target feature point comprises a first position of the pupil and a second position of the purkinje spot;
and determining the user related to the human eyes as a target user based on the target feature points.
Wherein the target feature points include at least one of: eye pattern feature points, eyeball vein feature points and pupil feature points.
In an implementation manner of the present application, a specific implementation manner for determining that the user associated with the human eye is the target user based on the target feature point is as follows: and if the target characteristic point is matched with the preset characteristic point, determining that the user related to the human eyes is the target user.
It can be seen that, in the embodiment of the application, before the screen unlocking operation is performed, whether the user associated with the human eye is the target user is firstly confirmed through the target feature point, if the user is the target user, the screen unlocking operation is performed, so that the user not permitted by the electronic device is prevented from unlocking the screen and using the electronic device, and the protection of information security is further improved.
Referring to fig. 3, fig. 3 is a schematic flowchart of an unlocking method according to an embodiment of the present application, and the unlocking method is applied to an electronic device including a display screen, a camera module, and a transmitter, where the electronic device is in a screen-locking state, and the method includes:
step 301: when the electronic equipment is in a screen rest AOD mode and a partial area of the display screen is lighted up in the AOD mode, displaying at least one icon in the partial area of the display screen, or displaying a screen locking interface on the display screen, wherein the screen locking interface displays at least one icon, and the at least one icon comprises at least one of the following: the electric quantity icon, the time icon, the date icon, the short message icon and the telephone icon.
Step 302: the transmitter is controlled to emit a light signal to illuminate the human eye.
Step 303: and acquiring a plurality of first images of the human eyes through the camera module.
Step 304: determining a first position of a pupil of the human eye and a second position of a purkinje spot in each first image, the purkinje spot being a spot formed by reflection of the light signal impinging on a cornea of the human eye.
Step 305: determining a plurality of focal points at which the human eye gazes at the display screen based on the first and second locations in each first image.
Step 306: if the first area where the first icon is located includes the position where the first focus is located, the second area includes the position where the second focus is located, then execute screen unlocking operation, at least one icon includes the first icon, the display screen includes the second area, the first area is different from the second area, the first focus is by the first time that people's eye was focused is earlier than the second focus is by the second time that people's eye was focused, a plurality of focuses include the first focus with the second focus.
Step 307: while performing the screen unlock operation, determining a movement trajectory of the human eye based on the first focus, the second focus, and at least one third focus, the plurality of focuses including the at least one third focus, a third time at which the at least one third focus is gazed by the human eye being between the first time and the second time.
Step 308: dynamically moving the first icon from the first area to the second area based on the movement trajectory.
Step 309: and starting a first application corresponding to the first focus, or starting a second application corresponding to the second focus, or starting a third application corresponding to the at least one third focus.
It should be noted that, for the specific implementation process of the present embodiment, reference may be made to the specific implementation process described in the above method embodiment, and a description thereof is omitted here.
In accordance with the embodiments shown in fig. 2A and fig. 3, please refer to fig. 4, and fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application, and as shown in the drawing, the electronic device further includes a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for performing the following steps:
displaying at least one icon on the display screen;
tracking the human eyes through the camera module to determine a plurality of focuses of the human eyes on the display screen;
if the first area where the first icon is located includes the position where the first focus is located, the second area includes the position where the second focus is located, then execute screen unlocking operation, at least one icon includes the first icon, the display screen includes the second area, the first area is different from the second area, the first focus is by the first time that people's eye was focused is earlier than the second focus is by the second time that people's eye was focused, a plurality of focuses include the first focus with the second focus.
In an implementation manner of the present application, the program includes instructions for further performing the following steps:
dynamically moving the first icon from the first area to the second area while performing the screen unlock operation.
In an implementation of the application, the plurality of foci includes at least one third focus, a third time at which the at least one third focus is fixated by the human eye is between the first time and the second time; in dynamically moving the first icon from the first region to the second region, the program includes instructions specifically for:
determining a movement trajectory of the human eye based on the first focus, the second focus, and the at least one third focus;
dynamically moving the first icon from the first area to the second area based on the movement trajectory.
In an implementation manner of the present application, after the screen unlocking operation is performed, the program includes instructions further for performing the following steps:
and starting a first application corresponding to the first focus, or starting a second application corresponding to the second focus, or starting a third application corresponding to the at least one third focus.
In an implementation manner of the present application, the electronic device further includes a transmitter, in tracking the human eye through the camera module to determine that the human eye gazes at the plurality of focuses of the display screen, where the program includes instructions specifically for performing the following steps:
controlling the transmitter to emit a light signal to illuminate the human eye;
acquiring a plurality of first images of the human eyes through the camera module;
determining a first position of a pupil of the human eye and a second position of a purkinje spot in each first image, the purkinje spot being a spot formed by reflection of the light signal impinging on a cornea of the human eye;
determining a plurality of focal points at which the human eye gazes at the display screen based on the first and second locations in each first image.
In an implementation of the present application, in displaying at least one icon on the display screen, the program includes instructions specifically for performing the steps of:
when the electronic equipment is in a screen rest AOD mode and a partial area of the display screen is lightened in the AOD mode, displaying at least one icon in the partial area of the display screen; or,
and displaying a screen locking interface on the display screen, wherein the screen locking interface displays at least one icon.
In an implementation manner of the present application, the at least one icon includes at least one of: the electric quantity icon, the time icon, the date icon, the short message icon and the telephone icon.
It should be noted that, for the specific implementation process of the present embodiment, reference may be made to the specific implementation process described in the above method embodiment, and a description thereof is omitted here.
The above embodiments mainly introduce the scheme of the embodiments of the present application from the perspective of the method-side implementation process. It is understood that the electronic device comprises corresponding hardware structures and/or software modules for performing the respective functions in order to realize the above-mentioned functions. Those of skill in the art would readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiment of the present application, the electronic device may be divided into the functional units according to the method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.
The following is an embodiment of the apparatus of the present application, which is used to execute the method implemented by the embodiment of the method of the present application. Referring to fig. 5, fig. 5 is a schematic structural diagram of an unlocking device according to an embodiment of the present application, and the unlocking device is applied to an electronic device including a display screen and a camera module, where the electronic device is in a screen locking state, and the unlocking device includes:
a display unit 501 for displaying at least one icon on the display screen;
a determining unit 502, configured to track a human eye through the camera module to determine a plurality of focuses of the human eye on the display screen;
an execution unit 503, configured to execute a screen unlocking operation if a first area where the first icon is located includes a location where the first focus is located, and a second area includes a location where the second focus is located, where the at least one icon includes the first icon, the display screen includes the second area, the first area is different from the second area, the first focus is earlier than a second time when the second focus is watched by the eyes, and the plurality of focuses include the first focus and the second focus.
In an implementation manner of the present application, the apparatus further includes:
a moving unit 504, configured to dynamically move the first icon from the first area to the second area when the screen unlocking operation is performed.
In an implementation of the application, the plurality of foci includes at least one third focus, a third time at which the at least one third focus is fixated by the human eye is between the first time and the second time; in terms of dynamically moving the first icon from the first area to the second area, the moving unit 504 is specifically configured to determine a moving trajectory of the human eye based on the first focus, the second focus, and the at least one third focus; dynamically moving the first icon from the first area to the second area based on the movement trajectory.
In an implementation manner of the present application, after performing the screen unlocking operation, the apparatus further includes:
a starting unit 505, configured to start a first application corresponding to the first focus, or start a second application corresponding to the second focus, or start a third application corresponding to the at least one third focus.
In an implementation manner of the present application, the electronic device further includes a transmitter, in terms of tracking the human eye through the camera module to determine a plurality of focal points where the human eye gazes at the display screen, the determining unit 502 is specifically configured to control the transmitter to emit a light signal to illuminate the human eye; acquiring a plurality of first images of the human eyes through the camera module; determining a first position of a pupil of the human eye and a second position of a purkinje spot in each first image, the purkinje spot being a spot formed by reflection of the light signal impinging on a cornea of the human eye; determining a plurality of focal points at which the human eye gazes at the display screen based on the first and second locations in each first image.
In an implementation manner of the present application, in displaying at least one icon on the display screen, the display unit 501 is specifically configured to display at least one icon in a partial area of the display screen when the electronic device is in an AOD mode and the partial area of the display screen is lit in the AOD mode; or displaying a screen locking interface on the display screen, wherein the screen locking interface displays at least one icon.
In an implementation manner of the present application, the at least one icon includes at least one of: the electric quantity icon, the time icon, the date icon, the short message icon and the telephone icon.
It should be noted that the display unit 501, the determination unit 502, the execution unit 503, the moving unit 504, and the activation unit 505 may be implemented by a processor.
Embodiments of the present application also provide a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, the computer program enabling a computer to execute part or all of the steps of any one of the methods described in the above method embodiments, and the computer includes an electronic device.
Embodiments of the present application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods as described in the above method embodiments. The computer program product may be a software installation package, the computer comprising an electronic device.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the above-described division of the units is only one type of division of logical functions, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit may be stored in a computer readable memory if it is implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the above-mentioned method of the embodiments of the present application. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (10)
1. The unlocking method is characterized by being applied to electronic equipment comprising a display screen and a camera module, wherein the electronic equipment is in a screen locking state, and the method comprises the following steps:
displaying at least one icon on the display screen;
determining that the fatigue of human eyes is less than or equal to a first threshold under a first condition, and tracking the human eyes through the camera module to determine a plurality of focuses of the human eyes gazing on the display screen;
if a first area where a first icon is located comprises a position where a first focus is located, and a second area comprises a position where a second focus is located, executing screen unlocking operation, wherein the at least one icon comprises the first icon, the display screen comprises the second area, the first area is different from the second area, the first time when the first focus is watched by the human eyes is earlier than the second time when the second focus is watched by the human eyes, and the plurality of focuses comprise the first focus and the second focus;
and when the fatigue degree of the human eyes is determined to be larger than the first threshold value under the first condition, indicating that the user is in a fatigue state, and in order to prevent the mistaken unlocking operation from being generated under the fatigue state, not allowing the electronic equipment to execute the screen unlocking operation.
2. The method of claim 1, further comprising:
dynamically moving the first icon from the first area to the second area while performing the screen unlock operation.
3. The method of claim 2, wherein the plurality of focal points includes at least one third focal point, a third time at which the at least one third focal point is fixated by the human eye being between the first time and the second time; the dynamically moving the first icon from the first region to the second region comprises:
determining a movement trajectory of the human eye based on the first focus, the second focus, and the at least one third focus;
dynamically moving the first icon from the first area to the second area based on the movement trajectory.
4. The method of claim 3, wherein after the performing the screen unlock operation, the method further comprises:
and starting a first application corresponding to the first focus, or starting a second application corresponding to the second focus, or starting a third application corresponding to the at least one third focus.
5. The method of any one of claims 1-4, wherein the electronic device further comprises a transmitter that tracks the human eye with the camera module to determine a plurality of focal points at which the human eye gazes at the display screen, comprising:
controlling the transmitter to emit a light signal to illuminate the human eye;
acquiring a plurality of first images of the human eyes through the camera module;
determining a first position of a pupil of the human eye and a second position of a purkinje spot in each first image, the purkinje spot being a spot formed by reflection of the light signal impinging on a cornea of the human eye;
determining a plurality of focal points at which the human eye gazes at the display screen based on the first and second locations in each first image.
6. The method of any of claims 1-4, wherein said displaying at least one icon on said display screen comprises:
when the electronic equipment is in a screen rest AOD mode and a partial area of the display screen is lightened in the AOD mode, displaying at least one icon in the partial area of the display screen;
or displaying a screen locking interface on the display screen, wherein the screen locking interface displays at least one icon.
7. The method of any of claims 1-4, wherein the at least one icon comprises at least one of: the electric quantity icon, the time icon, the date icon, the short message icon and the telephone icon.
8. The utility model provides an unlocking device, its characterized in that is applied to the electronic equipment including display screen and the module of making a video recording, electronic equipment is in the lock screen state, the device includes:
a display unit for displaying at least one icon on the display screen;
the determining unit is used for determining that the fatigue degree of human eyes is smaller than or equal to a first threshold under a first condition, and tracking the human eyes through the camera module so as to determine a plurality of focuses of the human eyes gazing the display screen;
the execution unit is used for executing screen unlocking operation if a first area where a first icon is located comprises a position where a first focus is located and a second area comprises a position where a second focus is located, wherein the at least one icon comprises the first icon, the display screen comprises the second area, the first area is different from the second area, the first time when the first focus is watched by the human eyes is earlier than the second time when the second focus is watched by the human eyes, and the plurality of focuses comprise the first focus and the second focus;
when the device determines that the fatigue degree of the human eyes is larger than the first threshold value under the first condition, the device indicates that the user is in a fatigue state, and in order to prevent the electronic equipment from performing the screen unlocking operation, the device does not allow the electronic equipment to perform the screen unlocking operation.
9. An electronic device comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 1-7.
10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program which is executed by a processor to implement the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910502922.5A CN110248024B (en) | 2019-06-11 | 2019-06-11 | Unlocking method and device, electronic equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910502922.5A CN110248024B (en) | 2019-06-11 | 2019-06-11 | Unlocking method and device, electronic equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110248024A CN110248024A (en) | 2019-09-17 |
| CN110248024B true CN110248024B (en) | 2020-12-18 |
Family
ID=67886790
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910502922.5A Active CN110248024B (en) | 2019-06-11 | 2019-06-11 | Unlocking method and device, electronic equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110248024B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112904997B (en) * | 2019-12-04 | 2023-05-26 | Oppo广东移动通信有限公司 | Equipment control method and related product |
| CN113031757A (en) * | 2019-12-25 | 2021-06-25 | 大众问问(北京)信息科技有限公司 | Equipment interaction method and device and electronic equipment |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010003410A1 (en) * | 2008-07-08 | 2010-01-14 | It-University Of Copenhagen | Eye gaze tracking |
| CN102125422A (en) * | 2010-01-12 | 2011-07-20 | 北京科技大学 | Pupil center-corneal reflection (PCCR) based sight line evaluation method in sight line tracking system |
| CN102981736B (en) * | 2012-10-29 | 2016-11-23 | 华为终端有限公司 | The method of unlocking screen and terminal |
| CN104571881B (en) * | 2013-10-22 | 2018-08-21 | 广东小天才科技有限公司 | Control method and device for unlocking screen |
| KR101847756B1 (en) * | 2013-11-09 | 2018-04-10 | 선전 구딕스 테크놀로지 컴퍼니, 리미티드 | Optical Eye Tracking |
| CN104750232B (en) * | 2013-12-28 | 2017-12-29 | 华为技术有限公司 | A kind of eye-tracking method and device |
| CN105278720A (en) * | 2014-07-25 | 2016-01-27 | 南京瀚宇彩欣科技有限责任公司 | Non-shielded touch hand-held electronic apparatus and unlocking method therefor |
| CN105425968B (en) * | 2015-12-17 | 2018-12-21 | 无锡天脉聚源传媒科技有限公司 | A kind of unlocking screen method and device |
| CN106445112B (en) * | 2016-08-31 | 2020-04-21 | 上海斐讯数据通信技术有限公司 | Mobile terminal and method for controlling mobile terminal to be used |
-
2019
- 2019-06-11 CN CN201910502922.5A patent/CN110248024B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN110248024A (en) | 2019-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11393258B2 (en) | Implementation of biometric authentication | |
| KR102060618B1 (en) | Implementation of biometric authentication | |
| KR102185854B1 (en) | Implementation of biometric authentication | |
| US20220027446A1 (en) | Implementation of biometric authentication | |
| KR102103866B1 (en) | Implementation of biometric authentication | |
| CN104850995B (en) | Operation execution method and device | |
| CN108319886B (en) | Fingerprint identification method and device | |
| CN107622246B (en) | Face recognition method and related product | |
| JP2015090569A (en) | Information processing device and information processing method | |
| CN110248024B (en) | Unlocking method and device, electronic equipment and computer readable storage medium | |
| EP2731369B1 (en) | Mobile terminal and control method thereof | |
| CN110032849B (en) | Implementation of biometric authentication | |
| AU2019200360B2 (en) | Implementation of biometric authentication | |
| CN110210869B (en) | Payment method and related equipment | |
| CN110413115B (en) | Display control method and related equipment | |
| DK179714B1 (en) | Implementation of biometric authentication | |
| DK179695B1 (en) | Implementation of biometric authentication | |
| CN112446019A (en) | Application operation control method and device and storage medium | |
| KR102111456B1 (en) | Mobile terminal and control method thereof | |
| CN110929552A (en) | Fingerprint identification method and device, electronic equipment and storage medium | |
| KR20200136504A (en) | Implementation of biometric authentication | |
| CN110929551A (en) | Fingerprint identification method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |