CN113032017B - Equipment awakening method and device and electronic equipment - Google Patents
Equipment awakening method and device and electronic equipment Download PDFInfo
- Publication number
- CN113032017B CN113032017B CN201911358775.5A CN201911358775A CN113032017B CN 113032017 B CN113032017 B CN 113032017B CN 201911358775 A CN201911358775 A CN 201911358775A CN 113032017 B CN113032017 B CN 113032017B
- Authority
- CN
- China
- Prior art keywords
- area
- region
- user
- edge
- value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 230000002618 waking effect Effects 0.000 claims abstract description 9
- 210000001508 eye Anatomy 0.000 claims description 168
- 210000001747 pupil Anatomy 0.000 claims description 90
- 210000000554 iris Anatomy 0.000 claims description 80
- 210000003128 head Anatomy 0.000 claims description 53
- 238000004590 computer program Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 6
- 210000005252 bulbus oculi Anatomy 0.000 description 4
- 210000004087 cornea Anatomy 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 238000012790 confirmation Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- UWKQSNNFCGGAFS-XIFFEERXSA-N irinotecan Chemical compound C1=C2C(CC)=C3CN(C(C4=C([C@@](C(=O)OC4)(O)CC)C=4)=O)C=4C3=NC2=CC=C1OC(=O)N(CC1)CCC1N1CCCCC1 UWKQSNNFCGGAFS-XIFFEERXSA-N 0.000 description 1
- 229960004768 irinotecan Drugs 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/4401—Bootstrapping
- G06F9/4418—Suspend and resume; Hibernate and awake
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- Computer Security & Cryptography (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Geometry (AREA)
- User Interface Of Digital Computer (AREA)
- Image Analysis (AREA)
Abstract
The embodiment of the invention provides a device wake-up method, a device and electronic equipment, wherein the method comprises the following steps: judging whether the user looks at the electronic equipment or not; if yes, waking up the electronic equipment; therefore, in the scheme, the user only needs to watch the electronic equipment, so that the user can wake up the electronic equipment, does not need to click a physical key or a touch screen key, does not need to wake up the electronic equipment through voice, and improves the operation convenience.
Description
Technical Field
The present invention relates to the field of assisted driving technologies, and in particular, to a device wake-up method and apparatus, and an electronic device.
Background
For some electronic devices, such as mobile phones, computers, smart speakers, smart home devices, car equipment, etc., if the user does not use the electronic devices for a period of time, the electronic devices may go to sleep. After the user wakes up the electronic equipment, the electronic equipment is switched from a dormant state to a working state, and then various services can be provided for the user.
Currently, a user may wake up the electronic device by physical buttons, touch screen buttons, or voice wake words. In some cases, these schemes for waking up an electronic device are less convenient for the user. For example, under the condition of darker light, the user clicks a physical key or a touch screen key, so that the operation is inconvenient; for another example, in the case of loud noise, the user wakes up the electronic device through voice, and the electronic device cannot distinguish between the noise and the voice of the user.
Disclosure of Invention
In view of the above, the present invention aims to provide a device wake-up method, a device and an electronic device, so as to improve convenience.
Based on the above object, an embodiment of the present invention provides a device wake-up method, including:
judging whether the user looks at the electronic equipment or not;
if so, waking up the electronic device.
Optionally, the determining whether the user gazes at the electronic device includes:
acquiring an eye image of a user;
based on the eye image, whether the user looks at the electronic device is judged.
Optionally, the acquiring an eye image of the user includes:
collecting user images through cameras arranged in a preset range corresponding to the electronic equipment;
judging whether the head of the user turns to the electronic equipment or not based on the user image;
after the user's head turns to the electronic device, the image acquired by the camera is determined to be the acquired eye image of the user.
Optionally, the electronic device is a vehicle-mounted device; the determining whether the user's head turns to the electronic device based on the user image includes:
if the user is positioned at the main driving position, judging whether the head of the user rotates towards the right side of the user based on the user image; if yes, judging that the head of the user turns to the electronic equipment;
If the user is positioned at the secondary driving position, judging whether the head of the user rotates towards the left side of the user based on the user image; if so, it is determined that the user's head is turned to the electronic device.
Optionally, the determining, based on the eye image, whether the user gazes at the electronic device includes:
determining an eye region in the eye image by identifying an eye contour in the eye image;
judging whether a purkinje spot exists between the pupil and the iris in the eye region; if so, determining that the user looks at the electronic device.
Optionally, the determining whether the purkinje spot exists between the pupil and the iris in the eye region includes:
identifying pupils, irises and purkinje plaques in the eye region;
determining a distance between the purkinje and the pupil center as a first distance;
determining a radius of the iris and a radius of the pupil;
and if the radius of the pupil is larger than the first distance and the first distance is smaller than the radius of the iris, judging that purkinje spots exist between the pupil and the iris in the eye region.
Optionally, the determining whether the purkinje spot exists between the pupil and the iris in the eye region includes:
In the eye region, identifying a black region as a pupil and identifying a first preset color region as an iris;
judging whether a light spot exists between the pupil and the iris, and if so, judging that purkinje spots exist between the pupil and the iris in the eye region.
Optionally, a second preset color area is arranged in a preset direction of the screen area of the electronic equipment;
the method further comprises, after determining the eye region in the eye image by identifying the eye contour in the eye image:
judging whether the region with the second preset color exists in the eye region or not;
said determining that the user gazes at the electronic device, if present, comprises:
and if the second preset color area exists in the eye area and the purkinje spot exists between the pupil and the iris in the eye area, judging that the user looks at the electronic equipment.
Optionally, the length of the screen area is a first value; the lower edge of the preset range is the upper edge of the screen area, and the distance between the upper edge of the preset range and the upper edge of the screen area is as follows: the distance between the left edge of the preset range and the left edge of the screen area is a second value, and the distance between the right edge of the preset range and the right edge of the screen area is a second value.
Optionally, the length of the screen area is a first value; the preset range includes any one or more of the following: a first region, a second region, a third region, a fourth region, a fifth region, a sixth region, a seventh region, an eighth region, and the screen region; wherein,
the first area is rectangular, the lower edge of the first area is the upper edge of the screen area, and the distance between the upper edge of the first area and the upper edge of the screen area is as follows: a first value+a second value, wherein the distance between the left edge of the first area and the left edge of the screen area is a second value, and the distance between the right edge of the first area and the right edge of the screen area is a second value;
the second area is rectangular, the upper edge of the second area is the lower edge of the screen area, and the distance between the lower edge of the second area and the lower edge of the screen area is as follows: a distance between the left edge of the second area and the left edge of the screen area is a second value, and a distance between the right edge of the second area and the right edge of the screen area is a second value;
The third area is rectangular, the right edge of the third area is the left edge of the screen area, and the distance between the left edge of the third area and the left edge of the screen area is: a first value+a second value, wherein the upper edge of the third region and the upper edge of the screen region are positioned on the same straight line, and the lower edge of the third region and the lower edge of the screen region are positioned on the same straight line;
the fourth area is rectangular, the left edge of the fourth area is the right edge of the screen area, and the distance between the right edge of the fourth area and the right edge of the screen area is: a first value+a second value, wherein the upper edge of the fourth region and the upper edge of the screen region are positioned on the same straight line, and the lower edge of the fourth region and the lower edge of the screen region are positioned on the same straight line;
the fifth region is a sector between the first region and the third region, and the radius of the fifth region is the first value;
the sixth area is a sector between the first area and the fourth area, and the radius of the sixth area is the first value;
the seventh area is a sector between the third area and the second area, and the radius of the seventh area is the first value;
The eighth region is a sector between the second region and the fourth region, and the radius of the eighth region is the first value.
Based on the above object, an embodiment of the present invention further provides a device wake-up apparatus, including:
the first judging module is used for judging whether the user looks at the electronic equipment or not; if yes, triggering a wake-up module;
and the awakening module is used for awakening the electronic equipment.
Optionally, the first judging module includes:
the acquisition sub-module is used for acquiring eye images of the user;
and the judging sub-module is used for judging whether the user looks at the electronic equipment or not based on the eye images.
Optionally, the acquiring sub-module includes:
the acquisition unit is used for acquiring the user image through a camera arranged in a preset range corresponding to the electronic equipment;
a first judging unit for judging whether the user's head turns to the electronic device based on the user image; triggering the first determining sub-module after the user's head turns to the electronic device;
and the first determining unit is used for determining the image acquired by the camera as the acquired eye image of the user.
Optionally, the electronic device is a vehicle-mounted device; the first judging unit is specifically configured to:
If the user is positioned at the main driving position, judging whether the head of the user rotates towards the right side of the user based on the user image; if yes, judging that the head of the user turns to the electronic equipment;
if the user is positioned at the secondary driving position, judging whether the head of the user rotates towards the left side of the user based on the user image; if so, it is determined that the user's head is turned to the electronic device.
Optionally, the judging submodule includes:
a second determining unit configured to determine an eye region in the eye image by identifying an eye contour in the eye image;
a second judging unit for judging whether or not there is a purkinje spot between the pupil and the iris in the eye region; if so, determining that the user looks at the electronic device.
Optionally, the second judging unit is specifically configured to:
identifying pupils, irises and purkinje plaques in the eye region;
determining a distance between the purkinje and the pupil center as a first distance;
determining a radius of the iris and a radius of the pupil;
and if the radius of the pupil is larger than the first distance and the first distance is smaller than the radius of the iris, judging that purkinje spots exist between the pupil and the iris in the eye region.
Optionally, the second judging unit is specifically configured to:
in the eye region, identifying a black region as a pupil and identifying a first preset color region as an iris;
judging whether a light spot exists between the pupil and the iris, and if so, judging that purkinje spots exist between the pupil and the iris in the eye region.
Optionally, a second preset color area is arranged in a preset direction of the screen area of the electronic equipment;
the apparatus further comprises: a second judging module, configured to judge whether an area of the second preset color exists in the eye area;
and if the second judging module judges that the region with the second preset color exists in the eye region and the second judging sub-module judges that the purkinje spot exists between the pupil and the iris in the eye region, judging that the user looks at the electronic equipment.
Optionally, the length of the screen area is a first value; the lower edge of the preset range is the upper edge of the screen area, and the distance between the upper edge of the preset range and the upper edge of the screen area is as follows: the distance between the left edge of the preset range and the left edge of the screen area is a second value, and the distance between the right edge of the preset range and the right edge of the screen area is a second value.
Optionally, the length of the screen area is a first value; the preset range includes any one or more of the following: a first region, a second region, a third region, a fourth region, a fifth region, a sixth region, a seventh region, an eighth region, and the screen region; wherein,
the first area is rectangular, the lower edge of the first area is the upper edge of the screen area, and the distance between the upper edge of the first area and the upper edge of the screen area is as follows: a first value+a second value, wherein the distance between the left edge of the first area and the left edge of the screen area is a second value, and the distance between the right edge of the first area and the right edge of the screen area is a second value;
the second area is rectangular, the upper edge of the second area is the lower edge of the screen area, and the distance between the lower edge of the second area and the lower edge of the screen area is as follows: a distance between the left edge of the second area and the left edge of the screen area is a second value, and a distance between the right edge of the second area and the right edge of the screen area is a second value;
The third area is rectangular, the right edge of the third area is the left edge of the screen area, and the distance between the left edge of the third area and the left edge of the screen area is: a first value+a second value, wherein the upper edge of the third region and the upper edge of the screen region are positioned on the same straight line, and the lower edge of the third region and the lower edge of the screen region are positioned on the same straight line;
the fourth area is rectangular, the left edge of the fourth area is the right edge of the screen area, and the distance between the right edge of the fourth area and the right edge of the screen area is: a first value+a second value, wherein the upper edge of the fourth region and the upper edge of the screen region are positioned on the same straight line, and the lower edge of the fourth region and the lower edge of the screen region are positioned on the same straight line;
the fifth region is a sector between the first region and the third region, and the radius of the fifth region is the first value;
the sixth area is a sector between the first area and the fourth area, and the radius of the sixth area is the first value;
the seventh area is a sector between the third area and the second area, and the radius of the seventh area is the first value;
The eighth region is a sector between the second region and the fourth region, and the radius of the eighth region is the first value.
Based on the above object, the embodiment of the present invention further provides an electronic device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the processor implements any one of the above device wake-up methods when executing the program.
By applying the embodiment of the invention, whether the user looks at the electronic equipment is judged; if yes, waking up the electronic equipment; therefore, in the scheme, the user only needs to watch the electronic equipment, so that the user can wake up the electronic equipment, does not need to click a physical key or a touch screen key, does not need to wake up the electronic equipment through voice, and improves the operation convenience.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic flow chart of a device wake-up method according to an embodiment of the present invention;
fig. 2a is a schematic diagram of a second flow of a device wake-up method according to an embodiment of the present invention;
fig. 2b is a schematic diagram of an application scenario provided in an embodiment of the present invention;
FIG. 3a is a schematic view of a camera mounting range according to an embodiment of the present invention;
FIG. 3b is a schematic view of another camera mounting range according to an embodiment of the present invention;
fig. 4 is a third flowchart of a device wake-up method according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a device wake-up apparatus according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The present invention will be further described in detail below with reference to specific embodiments and with reference to the accompanying drawings, in order to make the objects, technical solutions and advantages of the present invention more apparent.
It should be noted that unless otherwise defined, technical or scientific terms used in the embodiments of the present invention should be given the ordinary meaning as understood by one of ordinary skill in the art to which the present disclosure pertains. The terms "first," "second," and the like, as used in this disclosure, do not denote any order, quantity, or importance, but rather are used to distinguish one element from another. The word "comprising" or "comprises", and the like, means that elements or items preceding the word are included in the element or item listed after the word and equivalents thereof, but does not exclude other elements or items. The terms "connected" or "connected," and the like, are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "upper", "lower", "left", "right", etc. are used merely to indicate relative positional relationships, which may also be changed when the absolute position of the object to be described is changed.
In order to achieve the above objective, the embodiments of the present invention provide a device wake-up method and apparatus, and an electronic device, where the method and apparatus may be applied to various electronic devices such as a mobile phone, a computer, an intelligent sound box, an intelligent home device, a car machine device, and the like, and are not limited in particular.
Fig. 1 is a first flowchart of a device wake-up method according to an embodiment of the present invention, including:
s101: judging whether the user looks at the electronic equipment or not; if so, S102 is performed.
S102: the electronic device is awakened.
In one embodiment, an image of a user's eye may be acquired; based on the eye image, whether the user looks at the electronic device is judged. This determination will be described in detail in the embodiment shown in fig. 2.
In another embodiment, a physiological parameter of the user collected by the wearable device of the user may be obtained, and based on the physiological parameter, whether the user looks at the electronic device is determined. For example, the wearable device may be an eye tracker, and based on eye movement data collected by the eye tracker, it is determined whether the user looks at the electronic device. For another example, the wearable device may collect gesture data of the user, and determine whether the user gazes at the electronic device according to the gesture data of the user. For another example, the wearable device may collect electroencephalogram data of the user, and determine whether the user looks at the electronic device according to the electroencephalogram data of the user. Specific judging modes are not limited and are not listed.
By applying the embodiment of the invention, whether the user looks at the electronic equipment is judged; if yes, waking up the electronic equipment; therefore, in the scheme, the user only needs to watch the electronic equipment, so that the user can wake up the electronic equipment, does not need to click a physical key or a touch screen key, does not need to wake up the electronic equipment through voice, and improves the operation convenience.
Fig. 2a is a second flowchart of a device wake-up method according to an embodiment of the present invention, including:
s201: and acquiring an eye image of the user.
For example, the user may be a person in a vehicle, and the user eye image may be captured by a camera in the vehicle.
In one embodiment, S201 may include: collecting user images through cameras arranged in a preset range corresponding to the electronic equipment; judging whether the head of the user turns to the electronic equipment or not based on the user image; after the user's head turns to the electronic device, the image acquired by the camera is determined to be the acquired eye image of the user.
The preset range may be set according to actual conditions.
In this embodiment, only when the user's head turns to the electronic device, the eye image of the user is captured and the subsequent step is triggered to be executed, so that compared with executing the subsequent step for each image acquired by the camera, the computing resource is saved.
For example, in some cases, the electronic device is a vehicle device, and the primary driver is located on the left side of the vehicle, and the secondary driver is located on the right side of the vehicle; in this case, if the user is located at the main driving position, based on the user image, whether the user's head rotates toward the right side of the user is judged; if yes, judging that the head of the user turns to the electronic equipment; if the user is positioned at the secondary driving position, judging whether the head of the user rotates towards the left side of the user based on the user image; if so, it is determined that the user's head is turned to the electronic device.
Or in other cases, the electronic equipment is a car machine equipment, the main driving is positioned on the right side of the car, and the auxiliary driving is positioned on the left side of the car; in this case, if the user is located at the main driving position, it is determined whether the user's head is turned toward the left side of the user based on the user image; if yes, judging that the head of the user turns to the electronic equipment; if the user is positioned at the secondary driving position, judging whether the head of the user rotates towards the right side of the user based on the user image; if so, it is determined that the user's head is turned to the electronic device.
S202: based on the eye image, it is determined whether the user gazes at the electronic device, and if so, S203 is executed.
In one embodiment, S202 may include: determining an eye region in the eye image by identifying an eye contour in the eye image; judging whether a purkinje spot exists between the pupil and the iris in the eye region; if so, determining that the user looks at the electronic device.
For example, an eye contour is understood to be a curve formed by successive points joined together, having the same or similar color or gray scale. In one case, the image may be converted to a binary image, and then the binary image may be Canny boundary detected to identify the eye contour. Alternatively, the eye contours in the image may also be looked up using OpenCV (Open Source Computer Vision Library ). The specific manner in which the outline of the eye is identified is not limited.
In one case, after the eye contour is identified, an eye region may be cropped in the eye image based on the eye contour, and then only the cropped image region may be processed.
Purkinje image is a bright spot on the cornea of an eyeball, resulting from the reflection (corneal reflection, CR) of light entering the pupil on the outer surface of the cornea. When the eyeball rotates, the purkinje is motionless, the pupil deviates relative to the purkinje, and the sight direction of human eyes can be determined according to the deviation, so that whether a user looks at the electronic equipment can be judged.
In this embodiment, whether the user looks at the electronic device is determined by determining whether or not there is purkinje between the pupil and the iris in the eye region: in one case, pupils, irises and purkinje plaques in the eye image may be detected; determining a distance relationship between the pupil, iris and purkinje spot; and judging whether the user looks at the electronic equipment or not based on the distance relation. In another case, pupils and irinotecan spots in the eye image may be detected; judging whether the purkinje spots exist between the pupils and the purkinje spots of the iris.
In one embodiment, pupils, irises and purkinje plaques in the eye region may be identified; determining a distance between the purkinje and the pupil center as a first distance; determining a radius of the iris and a radius of the pupil; and if the radius of the pupil is larger than the first distance and the first distance is smaller than the radius of the iris, judging that purkinje spots exist between the pupil and the iris in the eye region.
The pupil is close to black, and the iris can be brown, blue, green and the like. A black area may be identified as a pupil and a first preset color area may be identified as an iris in the eye area; judging whether a light spot exists between the pupil and the iris, and if so, judging that purkinje spots exist between the pupil and the iris in the eye region. The first preset color may be brown, blue, green, etc., and may be specifically set according to practical situations.
Assuming that the radius of the pupil is R, the radius of the iris is R1, and the distance from the Purkin spot to the center of the pupil is R2; if R > R2 and R2< R1, this indicates that the user is looking at the screen area of the electronic device.
S203: the electronic device is awakened.
If the user looks at the electronic device, this means that the user may need to use the electronic device, in which case the electronic device is woken up. After the electronic device is awakened, an instruction sent by a user, such as a voice instruction or a key instruction, can be received. After receiving the instruction of the user, the electronic equipment can directly execute the instruction, can also confirm whether the instruction needs to be executed or not to the user, reduces the situation of misoperation of the user, and executes the corresponding instruction after receiving the confirmation instruction of the user.
Applying the embodiment of the invention shown in fig. 2a, based on the eye image of the user, judging whether the user looks at the electronic device; if yes, waking up the electronic equipment; therefore, in the scheme, the user only needs to watch the electronic equipment, so that the user can wake up the electronic equipment, does not need to click a physical key or a touch screen key, does not need to wake up the electronic equipment through voice, and improves the operation convenience.
In one embodiment, a second preset color area is set in a preset direction of a screen area of the electronic device; after determining an eye region in the eye image by identifying an eye contour in the eye image, it may also be determined whether a region of the second preset color is present in the eye region; if there is an area of the second preset color in the eye area and purkinje is present between the pupil and the iris in the eye area, it is determined that the user looks at the electronic device, and S203 is executed.
For example, the second preset color region may be a red region, or other regions different from the pupil color and the iris color. The second preset color area is arranged near the screen area of the electronic equipment, and the specific position is not limited.
Referring to fig. 2b, assuming that a red area is set under the screen area of the electronic device, a red spot appears in the eyes of the user when the user looks at the screen area of the electronic device. That is, if a red spot appears in the user's eye and there is a purkinje spot between the user's pupil and iris, this indicates that the user is looking at the screen area of the electronic device.
If the user looks at other areas near the screen area of the electronic device, there may also be purkinje spots between the user's pupil and iris, and thus there may be instances of false wake-up. In this embodiment, whether the user looks at the electronic device is determined by combining two factors (an area with a second preset color in the eye area and purkinje spots between the pupil and the iris in the eye area), the determination result is more accurate, and the false wake-up situation is reduced.
The following two embodiments are provided, the range of the camera is set, the camera is installed in the range, the camera can acquire eye images with more proper range and angle, the purkinje is positioned in the pupil, and the judgment result is more accurate when the user is judged to watch the electronic equipment based on the eye images, so that the false wake-up condition is reduced.
First embodiment:
referring to fig. 3a, assume that the length of the screen area is a first value W1; the lower edge of the preset range is the upper edge of the screen area, and the distance between the upper edge of the preset range and the upper edge of the screen area is as follows: the distance between the left edge of the preset range and the left edge of the screen area is a second value, and the distance between the right edge of the preset range and the right edge of the screen area is a second value.
For example, the second value may be 2CM, or may be another value.
Second embodiment:
referring to fig. 3b, assume that the screen area has a length of a first value W1 and a width H1; the preset range includes any one or more of the following: a first region, a second region, a third region, a fourth region, a fifth region, a sixth region, a seventh region, an eighth region, and the screen region; wherein,
the first area is rectangular, the lower edge of the first area is the upper edge of the screen area, and the distance between the upper edge of the first area and the upper edge of the screen area is as follows: a first value+a second value, wherein the distance between the left edge of the first area and the left edge of the screen area is a second value, and the distance between the right edge of the first area and the right edge of the screen area is a second value;
The second area is rectangular, the upper edge of the second area is the lower edge of the screen area, and the distance between the lower edge of the second area and the lower edge of the screen area is as follows: a distance between the left edge of the second area and the left edge of the screen area is a second value, and a distance between the right edge of the second area and the right edge of the screen area is a second value;
the third area is rectangular, the right edge of the third area is the left edge of the screen area, and the distance between the left edge of the third area and the left edge of the screen area is: a first value+a second value, wherein the upper edge of the third region and the upper edge of the screen region are positioned on the same straight line, and the lower edge of the third region and the lower edge of the screen region are positioned on the same straight line;
the fourth area is rectangular, the left edge of the fourth area is the right edge of the screen area, and the distance between the right edge of the fourth area and the right edge of the screen area is: a first value+a second value, wherein the upper edge of the fourth region and the upper edge of the screen region are positioned on the same straight line, and the lower edge of the fourth region and the lower edge of the screen region are positioned on the same straight line;
The fifth region is a sector between the first region and the third region, and the radius of the fifth region is the first value;
the sixth area is a sector between the first area and the fourth area, and the radius of the sixth area is the first value;
the seventh area is a sector between the third area and the second area, and the radius of the seventh area is the first value;
the eighth region is a sector between the second region and the fourth region, and the radius of the eighth region is the first value.
For example, the second value may be 2CM, or may be another value.
Fig. 4 is a third flow chart of a device wake-up method according to an embodiment of the present invention, including:
s401: and acquiring a user image through a camera arranged in a preset range corresponding to the electronic equipment.
In one embodiment, referring to fig. 3a, assume that the length of the screen area is a first value W1; the lower edge of the preset range is the upper edge of the screen area, and the distance between the upper edge of the preset range and the upper edge of the screen area is as follows: the distance between the left edge of the preset range and the left edge of the screen area is a second value, and the distance between the right edge of the preset range and the right edge of the screen area is a second value.
For example, the second value may be 2CM, or may be another value.
In another embodiment, referring to fig. 3b, assume that the screen area has a length of a first value W1 and a width of H1; the preset range includes any one or more of the following: a first region, a second region, a third region, a fourth region, a fifth region, a sixth region, a seventh region, an eighth region, and the screen region; wherein,
the first area is rectangular, the lower edge of the first area is the upper edge of the screen area, and the distance between the upper edge of the first area and the upper edge of the screen area is as follows: a first value+a second value, wherein the distance between the left edge of the first area and the left edge of the screen area is a second value, and the distance between the right edge of the first area and the right edge of the screen area is a second value;
the second area is rectangular, the upper edge of the second area is the lower edge of the screen area, and the distance between the lower edge of the second area and the lower edge of the screen area is as follows: a distance between the left edge of the second area and the left edge of the screen area is a second value, and a distance between the right edge of the second area and the right edge of the screen area is a second value;
The third area is rectangular, the right edge of the third area is the left edge of the screen area, and the distance between the left edge of the third area and the left edge of the screen area is: a first value+a second value, wherein the upper edge of the third region and the upper edge of the screen region are positioned on the same straight line, and the lower edge of the third region and the lower edge of the screen region are positioned on the same straight line;
the fourth area is rectangular, the left edge of the fourth area is the right edge of the screen area, and the distance between the right edge of the fourth area and the right edge of the screen area is: a first value+a second value, wherein the upper edge of the fourth region and the upper edge of the screen region are positioned on the same straight line, and the lower edge of the fourth region and the lower edge of the screen region are positioned on the same straight line;
the fifth region is a sector between the first region and the third region, and the radius of the fifth region is the first value;
the sixth area is a sector between the first area and the fourth area, and the radius of the sixth area is the first value;
the seventh area is a sector between the third area and the second area, and the radius of the seventh area is the first value;
The eighth region is a sector between the second region and the fourth region, and the radius of the eighth region is the first value.
For example, the second value may be 2CM, or may be another value.
The camera is arranged in the range, so that the camera can acquire eye images with more proper range and angle, the purkinje is positioned in the pupil, and the judgment result is more accurate when the user is judged whether to watch the electronic equipment or not based on the eye images, thereby reducing the situation of false awakening.
S402: based on the user image, it is determined whether the user' S head turns to the electronic device, and if so, S403 is executed.
For example, in some cases, the electronic device is a vehicle device, and the primary driver is located on the left side of the vehicle, and the secondary driver is located on the right side of the vehicle; in this case, S402 may include: if the user is positioned at the main driving position, judging whether the head of the user rotates towards the right side of the user based on the user image; if yes, judging that the head of the user turns to the electronic equipment; if the user is positioned at the secondary driving position, judging whether the head of the user rotates towards the left side of the user based on the user image; if so, it is determined that the user's head is turned to the electronic device.
Or in other cases, the electronic equipment is a car machine equipment, the main driving is positioned on the right side of the car, and the auxiliary driving is positioned on the left side of the car; in this case, S402 may include: if the user is positioned at the main driving position, judging whether the head of the user rotates towards the left side of the user based on the user image; if yes, judging that the head of the user turns to the electronic equipment; if the user is positioned at the secondary driving position, judging whether the head of the user rotates towards the right side of the user based on the user image; if so, it is determined that the user's head is turned to the electronic device.
S403: and determining an image acquired by the camera as an acquired eye image of the user.
In the embodiment shown in fig. 4, only in the case of the user's head turning to the electronic device, the user's eye image is captured and trigger to perform the subsequent steps, thus saving computational resources compared to performing the subsequent steps for each image acquired by the camera.
S404: an ocular region in the ocular image is determined by identifying an ocular contour in the ocular image.
For example, an eye contour is understood to be a curve formed by successive points joined together, having the same or similar color or gray scale. In one case, the image may be converted to a binary image, and then the binary image may be Canny boundary detected to identify the eye contour. Alternatively, the eye contours in the image may also be looked up using OpenCV (Open Source Computer Vision Library ). The specific manner in which the outline of the eye is identified is not limited.
In one case, after the eye contour is identified, an eye region may be cropped in the eye image based on the eye contour, and then only the cropped image region may be processed.
S405: judging whether a purkinje spot exists between the pupil and the iris in the eye region; judging whether a region with a second preset color exists in the eye region or not; if there is an area of the second preset color in the eye area and purkinje is present between the pupil and the iris in the eye area, S406 is performed.
Purkinje image is a bright spot on the cornea of an eyeball, resulting from the reflection (corneal reflection, CR) of light entering the pupil on the outer surface of the cornea. When the eyeball rotates, the purkinje is motionless, the pupil deviates relative to the purkinje, and the sight direction of human eyes can be determined according to the deviation, so that whether a user looks at the electronic equipment can be judged.
In one embodiment, pupils, irises and purkinje plaques in the eye region may be identified; determining a distance between the purkinje and the pupil center as a first distance; determining a radius of the iris and a radius of the pupil; and if the radius of the pupil is larger than the first distance and the first distance is smaller than the radius of the iris, judging that purkinje spots exist between the pupil and the iris in the eye region.
The pupil is close to black, and the iris can be brown, blue, green and the like. A black area may be identified as a pupil and a first preset color area may be identified as an iris in the eye area; judging whether a light spot exists between the pupil and the iris, and if so, judging that purkinje spots exist between the pupil and the iris in the eye region. The first preset color may be brown, blue, green, etc., and may be specifically set according to practical situations.
Assuming that the radius of the pupil is R, the radius of the iris is R1, and the distance from the Purkin spot to the center of the pupil is R2; if R > R2 and R2< R1, this indicates the presence of purkinje between the pupil and the iris in the region of the eye.
In the embodiment shown in fig. 4, the preset orientation of the screen area of the electronic device is provided with a second preset color area; after determining an eye region in the eye image by identifying an eye contour in the eye image, further determining whether there is a region of the second preset color in the eye region; if there is an area of the second preset color in the eye area and purkinje spots exist between the pupils and the irises in the eye area, it is determined that the user looks at the electronic device, and S406 is executed.
For example, the second preset color region may be a red region, or other regions different from the pupil color and the iris color. The second preset color area is arranged near the screen area of the electronic equipment, and the specific position is not limited.
Referring to fig. 2b, assuming that a red area is set under the screen area of the electronic device, a red spot appears in the eyes of the user when the user looks at the screen area of the electronic device. That is, if a red spot appears in the user's eye and there is a purkinje spot between the user's pupil and iris, this indicates that the user is looking at the screen area of the electronic device.
If the user looks at other areas near the screen area of the electronic device, there may also be purkinje spots between the user's pupil and iris, and thus there may be instances of false wake-up. In the embodiment shown in fig. 4, whether the user looks at the electronic device is determined by combining two factors (the region with the second preset color in the eye region and the purkinje spot between the pupil and the iris in the eye region), the determination result is more accurate, and the false wake-up condition is reduced.
S406: the electronic device is awakened.
If there is a region of the second preset color in the eye region and purkinje is present between the pupil and the iris in the eye region, this indicates that the user is looking at the electronic device, in which case the user may need to use the electronic device, waking up the electronic device. After the electronic device is awakened, an instruction sent by a user, such as a voice instruction or a key instruction, can be received. After receiving the instruction of the user, the electronic equipment can directly execute the instruction, can also confirm whether the instruction needs to be executed or not to the user, reduces the situation of misoperation of the user, and executes the corresponding instruction after receiving the confirmation instruction of the user.
According to the embodiment of the invention shown in fig. 4, in the first aspect, a user can wake up the electronic equipment only by looking at the electronic equipment, and the user does not need to click a physical key or a touch screen key or wake up the electronic equipment by voice, so that the operation convenience is improved. In the second aspect, whether the user looks at the electronic device is judged by combining two factors (an area with a second preset color in the eye area and purkinje spots between pupils and irises in the eye area), the judgment result is more accurate, and the situation of false awakening is reduced. In the third aspect, the range for installing the camera is set, the camera is installed in the range, the camera can acquire eye images with more proper range and angle, the purkinje is located in the pupil, and the judgment result is more accurate when the user is judged whether to watch the electronic equipment or not based on the eye images, so that the situation of false awakening is reduced.
It should be noted that, the method of the embodiment of the present invention may be performed by a single device, for example, a computer or a server. The method of the embodiment can also be applied to a distributed scene, and is completed by mutually matching a plurality of devices. In the case of such a distributed scenario, one of the devices may perform only one or more steps of the method of an embodiment of the present invention, the devices interacting with each other to accomplish the method.
The foregoing describes specific embodiments of the present disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
Corresponding to the above method embodiment, the embodiment of the present invention further provides a device wake-up apparatus, as shown in fig. 5, including:
A first determining module 501, configured to determine whether a user looks at the electronic device; if so, wake-up module 502 is triggered;
a wake module 502, configured to wake the electronic device.
In one embodiment, the first determining module 501 includes: an acquisition sub-module and a judgment sub-module (not shown in the figure), wherein,
the acquisition sub-module is used for acquiring eye images of the user;
and the judging sub-module is used for judging whether the user looks at the electronic equipment or not based on the eye images.
In one embodiment, the obtaining sub-module includes:
the acquisition unit is used for acquiring the user image through a camera arranged in a preset range corresponding to the electronic equipment;
a first judging unit for judging whether the user's head turns to the electronic device based on the user image; triggering the first determining sub-module after the user's head turns to the electronic device;
and the first determining unit is used for determining the image acquired by the camera as the acquired eye image of the user.
In one embodiment, the electronic device is a vehicle-mounted device; the first judging unit is specifically configured to:
if the user is positioned at the main driving position, judging whether the head of the user rotates towards the right side of the user based on the user image; if yes, judging that the head of the user turns to the electronic equipment;
If the user is positioned at the secondary driving position, judging whether the head of the user rotates towards the left side of the user based on the user image; if so, it is determined that the user's head is turned to the electronic device.
In one embodiment, the determining sub-module includes:
a second determining unit configured to determine an eye region in the eye image by identifying an eye contour in the eye image;
a second judging unit for judging whether or not there is a purkinje spot between the pupil and the iris in the eye region; if so, determining that the user looks at the electronic device.
In one embodiment, the second determining unit is specifically configured to:
identifying pupils, irises and purkinje plaques in the eye region;
determining a distance between the purkinje and the pupil center as a first distance;
determining a radius of the iris and a radius of the pupil;
and if the radius of the pupil is larger than the first distance and the first distance is smaller than the radius of the iris, judging that purkinje spots exist between the pupil and the iris in the eye region.
In one embodiment, the second determining unit is specifically configured to:
in the eye region, identifying a black region as a pupil and identifying a first preset color region as an iris;
Judging whether a light spot exists between the pupil and the iris, and if so, judging that purkinje spots exist between the pupil and the iris in the eye region.
In one embodiment, the preset azimuth of the screen area of the electronic device is provided with a second preset color area;
the apparatus further comprises: a second judging module (not shown in the figure) for judging whether or not there is a region of the second preset color in the eye region;
and if the second judging module judges that the region with the second preset color exists in the eye region and the second judging sub-module judges that the purkinje spot exists between the pupil and the iris in the eye region, judging that the user looks at the electronic equipment.
In one embodiment, the length of the screen area is a first value; the lower edge of the preset range is the upper edge of the screen area, and the distance between the upper edge of the preset range and the upper edge of the screen area is as follows: the distance between the left edge of the preset range and the left edge of the screen area is a second value, and the distance between the right edge of the preset range and the right edge of the screen area is a second value.
In one embodiment, the length of the screen area is a first value; the preset range includes any one or more of the following: a first region, a second region, a third region, a fourth region, a fifth region, a sixth region, a seventh region, an eighth region, and the screen region; wherein,
the first area is rectangular, the lower edge of the first area is the upper edge of the screen area, and the distance between the upper edge of the first area and the upper edge of the screen area is as follows: a first value+a second value, wherein the distance between the left edge of the first area and the left edge of the screen area is a second value, and the distance between the right edge of the first area and the right edge of the screen area is a second value;
the second area is rectangular, the upper edge of the second area is the lower edge of the screen area, and the distance between the lower edge of the second area and the lower edge of the screen area is as follows: a distance between the left edge of the second area and the left edge of the screen area is a second value, and a distance between the right edge of the second area and the right edge of the screen area is a second value;
The third area is rectangular, the right edge of the third area is the left edge of the screen area, and the distance between the left edge of the third area and the left edge of the screen area is: a first value+a second value, wherein the upper edge of the third region and the upper edge of the screen region are positioned on the same straight line, and the lower edge of the third region and the lower edge of the screen region are positioned on the same straight line;
the fourth area is rectangular, the left edge of the fourth area is the right edge of the screen area, and the distance between the right edge of the fourth area and the right edge of the screen area is: a first value+a second value, wherein the upper edge of the fourth region and the upper edge of the screen region are positioned on the same straight line, and the lower edge of the fourth region and the lower edge of the screen region are positioned on the same straight line;
the fifth region is a sector between the first region and the third region, and the radius of the fifth region is the first value;
the sixth area is a sector between the first area and the fourth area, and the radius of the sixth area is the first value;
the seventh area is a sector between the third area and the second area, and the radius of the seventh area is the first value;
The eighth region is a sector between the second region and the fourth region, and the radius of the eighth region is the first value.
The device of the foregoing embodiment is configured to implement the corresponding method in the foregoing embodiment, and has the beneficial effects of the corresponding method embodiment, which is not described herein.
The embodiment of the present invention further provides an electronic device, as shown in fig. 6, including a memory 602, a processor 601, and a computer program stored in the memory 602 and capable of running on the processor 601, where the processor 601 implements any one of the above device wake-up methods when executing the program.
The electronic equipment can be a mobile phone, a computer, an intelligent sound box, intelligent home equipment, car equipment and the like, and is not particularly limited.
The processor 601 may be implemented by a general-purpose CPU (Central Processing Unit ), a microprocessor, an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, etc. for executing relevant programs to implement the technical solutions provided in the embodiments of the present disclosure.
The Memory 602 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory ), static storage device, dynamic storage device, or the like. The memory 602 may store an operating system and other application programs, and when the technical solutions provided in the embodiments of the present specification are implemented by software or firmware, relevant program codes are stored in the memory 602 and invoked by the processor 601 to be executed.
The embodiment of the invention also provides a non-transitory computer readable storage medium, which stores computer instructions for causing the computer to execute any one of the device wake-up methods.
The computer readable media of the present embodiments, including both permanent and non-permanent, removable and non-removable media, may be used to implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device.
Those of ordinary skill in the art will appreciate that: the discussion of any of the embodiments above is merely exemplary and is not intended to suggest that the scope of the disclosure, including the claims, is limited to these examples; the technical features of the above embodiments or in the different embodiments may also be combined within the idea of the invention, the steps may be implemented in any order and there are many other variations of the different aspects of the invention as described above, which are not provided in detail for the sake of brevity.
Additionally, well-known power/ground connections to Integrated Circuit (IC) chips and other components may or may not be shown within the provided figures, in order to simplify the illustration and discussion, and so as not to obscure the invention. Furthermore, the devices may be shown in block diagram form in order to avoid obscuring the invention, and also in view of the fact that specifics with respect to implementation of such block diagram devices are highly dependent upon the platform within which the present invention is to be implemented (i.e., such specifics should be well within purview of one skilled in the art). Where specific details (e.g., circuits) are set forth in order to describe example embodiments of the invention, it should be apparent to one skilled in the art that the invention can be practiced without, or with variation of, these specific details. Accordingly, the description is to be regarded as illustrative in nature and not as restrictive.
While the invention has been described in conjunction with specific embodiments thereof, many alternatives, modifications, and variations of those embodiments will be apparent to those skilled in the art in light of the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.
The embodiments of the invention are intended to embrace all such alternatives, modifications and variances which fall within the broad scope of the appended claims. Therefore, any omission, modification, equivalent replacement, improvement, etc. of the present invention should be included in the scope of the present invention.
Claims (13)
1. A method of waking up a device, comprising:
judging whether the user looks at the electronic equipment or not;
if yes, waking up the electronic equipment;
wherein, the judging whether the user looks at the electronic equipment comprises:
acquiring an eye image of a user;
based on the eye image, determining whether the user gazes at an electronic device includes:
determining an eye region in the eye image by identifying an eye contour in the eye image;
judging whether a purkinje spot exists between the pupil and the iris in the eye region; if so, determining that the user looks at the electronic device;
the determining whether purkinje is present between the pupil and the iris in the eye region comprises:
identifying pupils, irises and purkinje plaques in the eye region;
determining a distance between the purkinje and the pupil center as a first distance;
Determining a radius of the iris and a radius of the pupil;
and if the radius of the pupil is larger than the first distance and the first distance is smaller than the radius of the iris, judging that purkinje spots exist between the pupil and the iris in the eye region.
2. The method of claim 1, wherein the acquiring an image of the user's eyes comprises:
collecting user images through cameras arranged in a preset range corresponding to the electronic equipment;
judging whether the head of the user turns to the electronic equipment or not based on the user image;
after the user's head turns to the electronic device, the image acquired by the camera is determined to be the acquired eye image of the user.
3. The method of claim 2, wherein the electronic device is a vehicle-mounted device; the determining whether the user's head turns to the electronic device based on the user image includes:
if the user is positioned at the main driving position, judging whether the head of the user rotates towards the right side of the user based on the user image; if yes, judging that the head of the user turns to the electronic equipment;
if the user is positioned at the secondary driving position, judging whether the head of the user rotates towards the left side of the user based on the user image; if so, it is determined that the user's head is turned to the electronic device.
4. The method of claim 1, wherein the preset orientation of the electronic device screen area is provided with a second preset color area;
the method further comprises, after determining the eye region in the eye image by identifying the eye contour in the eye image:
judging whether the region with the second preset color exists in the eye region or not;
said determining that the user gazes at the electronic device, if present, comprises:
and if the second preset color area exists in the eye area and the purkinje spot exists between the pupil and the iris in the eye area, judging that the user looks at the electronic equipment.
5. The method of claim 2, wherein the length of the electronic device screen area is a first value; the lower edge of the preset range is the upper edge of the screen area, and the distance between the upper edge of the preset range and the upper edge of the screen area is as follows: and the distance between the left edge of the preset range and the left edge of the screen area is a second value, and the distance between the right edge of the preset range and the right edge of the screen area is a second value.
6. The method of claim 2, wherein the length of the electronic device screen area is a first value; the preset range comprises any one or more of the following areas: a first region, a second region, a third region, a fourth region, a fifth region, a sixth region, a seventh region, an eighth region, and the screen region; wherein,
the first area is rectangular, the lower edge of the first area is the upper edge of the screen area, and the distance between the upper edge of the first area and the upper edge of the screen area is as follows: the distance between the left edge of the first area and the left edge of the screen area is a second value, and the distance between the right edge of the first area and the right edge of the screen area is a second value;
the second area is rectangular, the upper edge of the second area is the lower edge of the screen area, and the distance between the lower edge of the second area and the lower edge of the screen area is as follows: the distance between the left edge of the second area and the left edge of the screen area is a second value, and the distance between the right edge of the second area and the right edge of the screen area is a second value;
The third area is rectangular, the right edge of the third area is the left edge of the screen area, and the distance between the left edge of the third area and the left edge of the screen area is: the sum of the first value and the second value, the upper edge of the third area and the upper edge of the screen area are positioned on the same straight line, and the lower edge of the third area and the lower edge of the screen area are positioned on the same straight line;
the fourth area is rectangular, the left edge of the fourth area is the right edge of the screen area, and the distance between the right edge of the fourth area and the right edge of the screen area is: the sum of the first value and the second value, the upper edge of the fourth area and the upper edge of the screen area are positioned on the same straight line, and the lower edge of the fourth area and the lower edge of the screen area are positioned on the same straight line;
the fifth region is a sector between the first region and the third region, and the radius of the fifth region is the first value;
the sixth area is a sector between the first area and the fourth area, and the radius of the sixth area is the first value;
The seventh area is a sector between the third area and the second area, and the radius of the seventh area is the first value;
the eighth region is a sector between the second region and the fourth region, and the radius of the eighth region is the first value.
7. A device wake-up apparatus, comprising:
the first judging module is used for judging whether the user looks at the electronic equipment or not; if yes, triggering a wake-up module;
a wake-up module, configured to wake up the electronic device;
wherein, the first judging module includes:
the acquisition sub-module is used for acquiring eye images of the user;
the judging submodule is used for judging whether the user looks at the electronic equipment or not based on the eye images;
the judging submodule comprises:
a second determining unit configured to determine an eye region in the eye image by identifying an eye contour in the eye image;
a second judging unit for judging whether or not there is a purkinje spot between the pupil and the iris in the eye region; if so, determining that the user looks at the electronic device;
the second judging unit is used for:
identifying pupils, irises and purkinje plaques in the eye region;
Determining a distance between the purkinje and the pupil center as a first distance;
determining a radius of the iris and a radius of the pupil;
and if the radius of the pupil is larger than the first distance and the first distance is smaller than the radius of the iris, judging that purkinje spots exist between the pupil and the iris in the eye region.
8. The apparatus of claim 7, wherein the acquisition sub-module comprises:
the acquisition unit is used for acquiring the user image through a camera arranged in a preset range corresponding to the electronic equipment;
a first judging unit for judging whether the user's head turns to the electronic device based on the user image; triggering the first determining unit after the head of the user turns to the electronic device;
and the first determining unit is used for determining the image acquired by the camera as the acquired eye image of the user.
9. The apparatus of claim 8, wherein the electronic device is a vehicle-mounted device; the first judging unit is specifically configured to:
if the user is positioned at the main driving position, judging whether the head of the user rotates towards the right side of the user based on the user image; if yes, judging that the head of the user turns to the electronic equipment;
If the user is positioned at the secondary driving position, judging whether the head of the user rotates towards the left side of the user based on the user image; if so, it is determined that the user's head is turned to the electronic device.
10. The apparatus of claim 7, wherein the preset orientation of the electronic device screen area is provided with a second preset color area;
the apparatus further comprises: a second judging module, configured to judge whether an area of the second preset color exists in the eye area;
and if the second judging module judges that the region with the second preset color exists in the eye region and the second judging unit judges that the purkinje spot exists between the pupil and the iris in the eye region, judging that the user looks at the electronic equipment.
11. The apparatus of claim 8, wherein the length of the electronic device screen area is a first value; the lower edge of the preset range is the upper edge of the screen area, and the distance between the upper edge of the preset range and the upper edge of the screen area is as follows: and the distance between the left edge of the preset range and the left edge of the screen area is a second value, and the distance between the right edge of the preset range and the right edge of the screen area is a second value.
12. The apparatus of claim 8, wherein the length of the electronic device screen area is a first value; the preset range comprises any one or more of the following areas: a first region, a second region, a third region, a fourth region, a fifth region, a sixth region, a seventh region, an eighth region, and the screen region; wherein,
the first area is rectangular, the lower edge of the first area is the upper edge of the screen area, and the distance between the upper edge of the first area and the upper edge of the screen area is as follows: the distance between the left edge of the first area and the left edge of the screen area is a second value, and the distance between the right edge of the first area and the right edge of the screen area is a second value;
the second area is rectangular, the upper edge of the second area is the lower edge of the screen area, and the distance between the lower edge of the second area and the lower edge of the screen area is as follows: the distance between the left edge of the second area and the left edge of the screen area is a second value, and the distance between the right edge of the second area and the right edge of the screen area is a second value;
The third area is rectangular, the right edge of the third area is the left edge of the screen area, and the distance between the left edge of the third area and the left edge of the screen area is: the sum of the first value and the second value, the upper edge of the third area and the upper edge of the screen area are positioned on the same straight line, and the lower edge of the third area and the lower edge of the screen area are positioned on the same straight line;
the fourth area is rectangular, the left edge of the fourth area is the right edge of the screen area, and the distance between the right edge of the fourth area and the right edge of the screen area is: the sum of the first value and the second value, the upper edge of the fourth area and the upper edge of the screen area are positioned on the same straight line, and the lower edge of the fourth area and the lower edge of the screen area are positioned on the same straight line;
the fifth region is a sector between the first region and the third region, and the radius of the fifth region is the first value;
the sixth area is a sector between the first area and the fourth area, and the radius of the sixth area is the first value;
The seventh area is a sector between the third area and the second area, and the radius of the seventh area is the first value;
the eighth region is a sector between the second region and the fourth region, and the radius of the eighth region is the first value.
13. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any one of claims 1 to 6 when the program is executed by the processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911358775.5A CN113032017B (en) | 2019-12-25 | 2019-12-25 | Equipment awakening method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911358775.5A CN113032017B (en) | 2019-12-25 | 2019-12-25 | Equipment awakening method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113032017A CN113032017A (en) | 2021-06-25 |
| CN113032017B true CN113032017B (en) | 2024-02-02 |
Family
ID=76458653
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911358775.5A Active CN113032017B (en) | 2019-12-25 | 2019-12-25 | Equipment awakening method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113032017B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004005167A (en) * | 2002-05-31 | 2004-01-08 | Matsushita Electric Ind Co Ltd | Eye position specification method and device |
| CN106484113A (en) * | 2016-10-11 | 2017-03-08 | 京东方科技集团股份有限公司 | Screen Rouser and method |
| CN108235745A (en) * | 2017-05-08 | 2018-06-29 | 深圳前海达闼云端智能科技有限公司 | robot awakening method, device and robot |
| CN109177922A (en) * | 2018-08-31 | 2019-01-11 | 北京七鑫易维信息技术有限公司 | Vehicle starting method, device, equipment and storage medium |
| EP3440593A1 (en) * | 2016-07-18 | 2019-02-13 | Samsung Electronics Co., Ltd. | Method and apparatus for iris recognition |
| CN109976506A (en) * | 2017-12-28 | 2019-07-05 | 深圳市优必选科技有限公司 | Awakening method, storage medium and the robot of a kind of electronic equipment |
-
2019
- 2019-12-25 CN CN201911358775.5A patent/CN113032017B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004005167A (en) * | 2002-05-31 | 2004-01-08 | Matsushita Electric Ind Co Ltd | Eye position specification method and device |
| EP3440593A1 (en) * | 2016-07-18 | 2019-02-13 | Samsung Electronics Co., Ltd. | Method and apparatus for iris recognition |
| CN106484113A (en) * | 2016-10-11 | 2017-03-08 | 京东方科技集团股份有限公司 | Screen Rouser and method |
| CN108235745A (en) * | 2017-05-08 | 2018-06-29 | 深圳前海达闼云端智能科技有限公司 | robot awakening method, device and robot |
| CN109976506A (en) * | 2017-12-28 | 2019-07-05 | 深圳市优必选科技有限公司 | Awakening method, storage medium and the robot of a kind of electronic equipment |
| CN109177922A (en) * | 2018-08-31 | 2019-01-11 | 北京七鑫易维信息技术有限公司 | Vehicle starting method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113032017A (en) | 2021-06-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Fuhl et al. | Pupil detection for head-mounted eye tracking in the wild: an evaluation of the state of the art | |
| US11308311B2 (en) | Electronic device for obtaining fingerprints and control method thereof | |
| US9658688B2 (en) | Automatic view adjustment | |
| US10303933B2 (en) | Apparatus and method for processing a beauty effect | |
| CN110211549B (en) | Screen brightness adjustment method and device, terminal and storage medium | |
| CN105373766B (en) | Pupil positioning method and device | |
| US11379960B2 (en) | Image processing method, image processing apparatus, and wearable device | |
| US20190188469A1 (en) | Terminal with line-of-sight tracking function, and method and apparatus for determining point of gaze of user | |
| US20150227197A1 (en) | Information processing apparatus, information processing method, and program | |
| CN111553846B (en) | Super-resolution processing method and device | |
| CN105808122A (en) | Unlocking control method and terminal device | |
| JP5728080B2 (en) | Wrinkle detection device, wrinkle detection method and program | |
| US20200372272A1 (en) | Living-body detection method and apparatus for face, and computer readable medium | |
| CN111768352B (en) | Image processing method and device | |
| US10182196B2 (en) | Method of processing image of electronic device and electronic device thereof | |
| CN113032017B (en) | Equipment awakening method and device and electronic equipment | |
| CN111381996B (en) | Memory exception handling method and device | |
| US10091436B2 (en) | Electronic device for processing image and method for controlling the same | |
| WO2019244496A1 (en) | Information processing device, wearable equipment, information processing method, and program | |
| CN111178307A (en) | Gaze direction identification method and device, electronic equipment and storage medium | |
| KR20180008043A (en) | Electronic apparatus and method for controlling thereof | |
| CN114244655B (en) | Signal processing method and related device | |
| JP7384157B2 (en) | Information processing devices, wearable devices, information processing methods and programs | |
| CN112817512B (en) | False touch prevention method, mobile device and computer readable storage medium | |
| CN114445903A (en) | Screen-off unlocking method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |