CN107992825B - Face recognition method and system based on augmented reality - Google Patents

Face recognition method and system based on augmented reality Download PDF

Info

Publication number
CN107992825B
CN107992825B CN201711250288.8A CN201711250288A CN107992825B CN 107992825 B CN107992825 B CN 107992825B CN 201711250288 A CN201711250288 A CN 201711250288A CN 107992825 B CN107992825 B CN 107992825B
Authority
CN
China
Prior art keywords
information
action
target object
module
matching
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201711250288.8A
Other languages
Chinese (zh)
Other versions
CN107992825A (en
Inventor
李莉
王运涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Haier Intelligent Home Appliance Technology Co Ltd
Original Assignee
Qingdao Haier Intelligent Home Appliance Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Haier Intelligent Home Appliance Technology Co Ltd filed Critical Qingdao Haier Intelligent Home Appliance Technology Co Ltd
Priority to CN201711250288.8A priority Critical patent/CN107992825B/en
Publication of CN107992825A publication Critical patent/CN107992825A/en
Application granted granted Critical
Publication of CN107992825B publication Critical patent/CN107992825B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a face recognition method and system based on augmented reality, and belongs to the technical field of face recognition. The method comprises the following steps: responding to a face recognition operation signal, acquiring image information of face recognition, and calling first action information of a first prestored characteristic action of a target object matched with the image information; projecting the first action information to the target object for virtual display; prompting the target object to perform the operation of the first pre-stored characteristic action according to the first action information, and acquiring first operation information of the target object to perform the operation of the first pre-stored characteristic action in real time; and matching and verifying the first action information and the first operation information. The invention has the beneficial effects that: the augmented reality technology and the face recognition technology are combined, the face recognition process is interactive in real time, the accuracy is higher, and the safety is better.

Description

Face recognition method and system based on augmented reality
Technical Field
The invention relates to the technical field of face recognition, in particular to a face recognition method and system based on augmented reality.
Background
The common face recognition is only to simply compare the image data of the obtained face with the pre-stored data, and the purpose of successful recognition is achieved if the matching is successful, but the accuracy of the face recognition mode is low, for example, the face recognition can be authenticated through face photos to a certain extent, so that the safety of the face recognition is low.
Disclosure of Invention
The embodiment of the invention provides a face recognition method and system based on augmented reality, aiming at improving the accuracy and reliability of the existing face recognition mode. The following presents a simplified summary in order to provide a basic understanding of some aspects of the disclosed embodiments. This summary is not an extensive overview and is intended to neither identify key/critical elements nor delineate the scope of such embodiments. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is presented later.
The invention discloses a face recognition method and system based on augmented reality, wherein the augmented reality technology and the face recognition technology are combined, the face recognition process is interactive in real time, and the face recognition method and system are higher in accuracy and better in safety.
According to a first aspect of the embodiments of the present invention, there is provided a method for face recognition based on augmented reality, including:
responding to a face recognition operation signal, acquiring image information of face recognition, and calling first action information of a first prestored characteristic action of a target object matched with the image information;
projecting the first action information to the target object for virtual display;
prompting the target object to perform the operation of the first pre-stored characteristic action according to the first action information, and acquiring first operation information of the target object to perform the operation of the first pre-stored characteristic action in real time;
and matching and verifying the first action information and the first operation information.
Further, the matching and verifying the first action information and the first operation information specifically includes:
performing matching verification according to the data similarity of the first action information and the first operation information;
and outputting and displaying the matching verification result of the first action information and the first operation information.
In a preferred embodiment, the method further includes:
calling first voice information of pre-stored voice of the target object, wherein the first voice information comprises keyword information;
prompting the target object to repeat the keyword information, and acquiring second voice information of the target object repeating the keyword information;
and matching and verifying the first voice information and the second voice information.
Further, the matching and verification of the first voice message and the second voice message specifically comprises:
judging whether the second voice information contains the keyword information or not;
and if the second voice message contains the keyword message, performing matching verification according to the similarity degree of the sound attributes of the first voice message and the second voice message.
In a preferred embodiment, the method further includes:
in a specific time, if the first operation information matched with the first action information is not obtained, calling second action information of a second prestored characteristic action of the target object;
projecting the second action information to the target object for virtual display;
prompting the target object to perform the operation of the second pre-stored characteristic action according to the second action information, and acquiring second operation information of the target object performing the operation of the second pre-stored characteristic action in real time;
and matching and verifying the second action information and the second operation information.
According to a second aspect of the embodiments of the present invention, there is provided a system for face recognition based on augmented reality, including:
the first image acquisition module is used for responding to the face recognition signal and acquiring image information of face recognition;
the first calling module is used for calling first action information of a first prestored characteristic action of the target object matched with the image information;
the first projection module is used for projecting the first action information to the target object for virtual display;
the first prompting module is used for prompting the target object to perform the operation of the first pre-stored characteristic action according to the first action information;
the first action acquisition module is used for acquiring first operation information of the target object for performing the operation of the first pre-stored characteristic action in real time;
and the first matching module is used for matching and verifying the first action information and the first operation information.
Further, the first matching module comprises a first sub-matching module and a first sub-output module, wherein,
the first sub-matching module is used for performing matching verification according to the data similarity of the first action information and the first operation information;
the first sub-output module is used for outputting and displaying the matching and verifying result of the first action information and the first operation information.
In a preferred embodiment, the system further includes:
the second calling module is used for calling first voice information of pre-stored voice of the target object, and the first voice information comprises keyword information;
the second prompting module is used for prompting the target object to repeat the keyword information;
the second action acquisition module is used for acquiring second voice information of the target object repeating the keyword information;
and the second matching module is used for matching and verifying the first voice information and the second voice information.
Further, the second matching module further comprises a second sub-judgment module and a second sub-matching unit, wherein,
the second sub-judgment module is used for judging whether the second voice message contains the keyword message;
and the second sub-matching module is used for performing matching verification according to the similarity degree of the first voice information and the second voice information.
In a preferred embodiment, the system further includes:
the detection module is used for detecting whether the first operation information matched with the first action information is acquired within a specific time;
the third calling module is used for calling second action information of pre-stored characteristic actions of the target object matched with the image information;
the third projection module is used for projecting the second action information to the target object for virtual display;
the third prompting module is used for prompting the target object to perform the operation of the pre-stored characteristic action according to the second action information;
the third action acquisition module is used for acquiring second operation information of the target object for performing the operation of the pre-stored characteristic action in real time;
and the third matching module is used for matching and verifying the second action information and the second operation information.
The technical scheme provided by the embodiment of the invention has the following beneficial effects:
1. the augmented reality technology is combined with the face recognition technology, and a technical scheme of face recognition with better safety and higher recognition precision of real-time interaction is provided.
2. The action information of the characteristic action prestored in the target object matched with the acquired image information is called and projected to the target object for virtual display, and the action information is matched and judged with the operation information of the characteristic action performed by the target object in real time to perform identity verification, so that the instantaneity and complexity of face recognition authentication are increased, and the accuracy of face recognition is improved.
3. Calling voice information of target object pre-stored voice matched with the acquired image information, matching the voice information with real-time voice, and performing identity verification through comparison and judgment of voice attributes of the target object, so that the real-time performance and complexity of face recognition authentication are further increased, and the face recognition accuracy is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a first flowchart illustrating a method for augmented reality-based face recognition according to an exemplary embodiment;
FIG. 2 is a flowchart illustration two showing a method of augmented reality based face recognition, according to an example embodiment;
FIG. 3 is a third flowchart illustration of a method of augmented reality based face recognition, according to an example embodiment;
fig. 4 is a block diagram illustrating a system for augmented reality-based face recognition according to an exemplary embodiment.
Description of reference numerals: 410-a first image acquisition module; 411-first calling module; 412-a first projection module; 413-a first prompt module; 414-first action acquisition module; 415-first matching module 415; 4151-a first sub-matching module; 4152-a first sub-output module; 421 a second calling module; 422-a second prompting module; 423 a second action obtaining module; 424-a second matching module; 4241-a second sub-judgment module; 4242-a second sub-matching module; 431-a detection module; 432-third calling module; 433-a third projection module; 434-a third prompt module; 435-a third action acquisition module; 436-third matching module.
Detailed Description
The following description and the drawings sufficiently illustrate specific embodiments of the invention to enable those skilled in the art to practice them. The embodiments are merely representative of possible variations, individual components and functions are optional unless explicitly required, and the sequence of operations may vary. Portions and features of some embodiments may be included in or substituted for those of others. The scope of embodiments of the invention encompasses the full ambit of the claims, as well as all available equivalents of the claims. Embodiments may be referred to herein, individually or collectively, by the term "invention" merely for convenience and without intending to voluntarily limit the scope of this application to any single invention or inventive concept if more than one is in fact disclosed. The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed. The embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As shown in fig. 1, an embodiment of the present invention provides a face recognition method based on augmented reality, and specifically, the method includes the steps of:
s101: responding to a face recognition operation signal, acquiring image information of face recognition, and calling first action information of a first prestored characteristic action of a target object matched with the image information;
before step S101 is executed, an image acquisition device is used to acquire image information of a face of the target object to be verified and motion information of pre-stored feature actions of the image information, wherein the pre-stored feature actions include a first pre-stored feature action and a second pre-stored feature action, the first pre-stored feature action may be blinking eyes, rubbing a face, and the like, the second pre-stored feature action may be a beep mouth, a clap, and the like, the motion information includes first motion information and second motion information, the first motion information corresponds to the first pre-stored feature action, the second motion information corresponds to the second pre-stored feature action, and the acquired image information and the motion information are stored in a memory.
Furthermore, the pre-stored characteristic action of the target object to be verified, which is pre-stored in the memory, can be self-defined, for example, the left eye blinks twice first, and the right eye blinks five times again, and the pre-stored characteristic action set for each target object is only known by the user, so that the diversity of data information of the pre-stored characteristic action is ensured, the safety of the post-verification of the pre-stored characteristic action of the target object is improved, and the safety of face recognition is further improved.
After the target object is subjected to face recognition operation, a face recognition terminal responds to a face recognition operation signal, an image acquisition device is started, facial feature information of the face of the target object is acquired, the acquired facial feature information is recorded into a memory, the memory is retrieved, whether image information matched with the facial feature information exists in the memory is searched, if the image information does not exist, face recognition authentication fails, and if the image information matched with the facial feature of the face of the target object exists in the memory, the first action information of the target object is called from the memory through face recognition authentication.
S102: projecting the first action information to the target object for virtual display;
projecting the first motion information recalled from the memory onto the target object for virtual display using a projection device, wherein the first motion information is dynamic image information of the first preset characteristic motion obtained by sampling according to the first preset characteristic motion of the target object, the image of the first motion information virtually displayed on the target object is a dynamic image of the preset first characteristic motion in proportion to the target object, for example, the first preset characteristic motion of the target object is 'eye blinking', at this time, the first motion information is dynamic image information of "blinking eyes" obtained by sampling the acquired image, and virtually displaying a preset 'eye blinking' dynamic image which is in equal proportion to the target object on the eyes of the target object.
S103: prompting the target object to perform the operation of the first pre-stored characteristic action according to the first action information, and acquiring first operation information of the target object to perform the operation of the first pre-stored characteristic action in real time;
prompting the target object to perform the operation of the first pre-stored characteristic action according to the first action information of the target object called from the memory, and acquiring first operation information of the target object performing the operation of the first pre-stored characteristic action in real time by using an acquisition device, wherein the first operation information is dynamic image information obtained by virtually superposing the first pre-stored characteristic action performed by the target object in real time and the first pre-stored characteristic action of the target object, and endows the acquisition device with certain learning capability.
Furthermore, the prompt can be a voice prompt or a text prompt, for example, if the first characteristic is that eyes blink, the prompt device sends out a voice of 'eye blinking' to prompt the target object to perform an action operation of eye blinking, and by adopting the voice prompt, convenience can be provided for people who are inconvenient or do not know characters, such as old people and children, and the application range is wider; optionally, the prompt may also be a text prompt, and if the first characteristic is blinking, the prompt device displays a word "blinking" on the screen to prompt the target object to perform a blinking operation.
S104: and matching and verifying the first action information and the first operation information.
The first operation information is combined with the pre-stored data and the real-time data of the first pre-stored characteristic action of the target object, so that the interference of the appearance of the target object and the ambient factors can be effectively eliminated.
Further, the matching and verifying the first action information and the first operation information specifically includes:
performing matching verification according to the data similarity of the first action information and the first operation information;
and outputting and displaying the matching result of the first action information and the first operation information.
And performing data simulation analysis on the first action information of the first pre-stored characteristic action of the target and the first operation information, obtaining a matching result according to the approximation degree of the two data, if the two data are matched, passing through face recognition authentication, and if the two data are not matched, failing the face recognition authentication, increasing the authentication process of the target object based on the characteristic action of augmented reality, wherein the data are real-time, the influence of the appearance of the target object and the change of the surrounding environment on the verification result is avoided as much as possible, and the reliability of face recognition is higher.
In a preferred embodiment, as shown in fig. 2, operations of voice verification of the target object are added, and specifically, the method includes the following steps:
s201: responding to the face recognition operation signal, and acquiring image information of face recognition;
s202: calling first voice information of pre-stored voice of the target object, wherein the first voice information comprises keyword information;
before step S202 is executed, a voice collecting device is used to collect voice information of the target object to be verified, the collected voice information is stored in a memory, and after the target object passes through face recognition, the first voice information of pre-stored voice of the target object is called from the server, so that the voice attribute information of the first voice information of the target object is matched and compared with the real-time voice attribute information of the target object.
S203: prompting the target object to repeat the keyword information, and acquiring second voice information of the target object repeating the keyword information;
and calling keyword information from the memory by using a prompting device, prompting the target object to read the keywords, and acquiring second voice information of the target object repeating the keywords by using a voice acquisition device.
Further, the prompt may be a voice prompt, for example, if the keyword is "today's sunshine is very warm", the prompt device sends a voice of "please repeat" today's sunshine is very warm ", and prompts the target object to repeat the keyword.
Optionally, the prompt may also be a text prompt, and the keyword is "the sunlight is very warm today", and then the prompt device displays a word "please repeat" the sunlight is very warm today "on the screen to prompt the target object to repeat the keyword, so that the time for the prompt device to prompt the keyword can be relatively shortened, and the efficiency is relatively high.
S204: and matching and verifying the first voice information and the second voice information.
The matching verification of the first voice message and the second voice message specifically comprises the following steps:
judging whether the second voice information contains the keyword information or not;
and if the second voice information contains the keyword information, performing matching verification according to the similarity degree of the sound attributes of the second voice information and the first voice information, specifically, performing analysis and matching according to the data information of the sound attributes of the sound of the second voice information and the first voice information, for example, analyzing the similarity degree of the data information of the waveform of the sound attributes of the sound such as the tone, and the like, obtaining a matching result, and performing the next verification process according to the result.
Further, the voice verification of the target object may also be performed after the target object passes through the recognition verification process of the characteristic action.
And if the keyword voice information is not matched with the prestored voice information, the face recognition authentication fails, and if the keyword voice information is matched with the prestored voice information, the recognition verification of the characteristic action of the target object is continued.
S205: calling first action information of a first pre-stored characteristic action of the target object matched with the image information;
s206: projecting the first action information to the target object for virtual display;
s207: prompting the target object to perform the operation of the first pre-stored characteristic action according to the first action information, and acquiring first operation information of the target object to perform the operation of the first pre-stored characteristic action in real time;
s208: and matching and verifying the first action information and the first operation information.
In a preferred embodiment, as shown in fig. 3, a verification operation of a second characteristic action of the target object is added, and specifically, the method includes the following steps:
s301: responding to a face recognition operation signal, acquiring image information of face recognition, and calling first action information of a first prestored characteristic action of a target object matched with the image information;
s302: projecting the first action information to the target object for virtual display;
s303: prompting the target object to perform the operation of the first pre-stored characteristic action according to the first action information, and acquiring first operation information of the target object to perform the operation of the first pre-stored characteristic action in real time;
s304: in a specific time, if the first operation information matched with the first action information is not obtained, calling second action information of a second prestored characteristic action of the target object;
in a specific time period, if the target object does not perform action operation, or the made characteristic action is wrong, or the difference between the made characteristic action and the first pre-stored characteristic action is large, so that the acquisition equipment cannot acquire the first operation information matched with the first action information, the pre-stored second action information of the target object is called from the memory to continuously perform verification, and the target object can still continue to perform identity identification verification according to another characteristic action after forgetting the self-defined characteristic action of the target object.
S305: projecting the second action information to the target object for virtual display;
s306: prompting the target object to perform the operation of the second pre-stored characteristic action according to the second action information, and acquiring second operation information of the target object performing the operation of the second pre-stored characteristic action in real time;
s307: and matching and verifying the second action information and the second operation information.
The verification process of the second characteristic action is the same as the verification process of the first characteristic action, and therefore, the description is omitted.
Optionally, if the second operation information matched with the second action information is not obtained within a specific time according to needs, third action information of a third pre-stored characteristic action of the target object is called, and identity recognition verification is continued according to the third characteristic action of the target object.
The embodiment of the invention also provides a face recognition system based on augmented reality, which is described in the following embodiment. Because the working principle of the specific module of the system is similar to that of the method based on the augmented reality, the specific implementation manner of the system can refer to the implementation of the method, and repeated parts are not described again.
As shown in fig. 4, an embodiment of the present invention provides a system for face recognition based on augmented reality, and specifically, the system includes the following modules:
the first image obtaining module 410, responding to the face recognition signal, obtaining the image information of face recognition;
the first calling module 411 is used for calling first action information of a first pre-stored characteristic action of the target object matched with the image information;
a first projection module 412, which projects the first motion information onto the target object for virtual display;
the first prompting module 413 is used for prompting the target object to perform the operation of the first pre-stored characteristic action according to the first action information;
a first action obtaining module 414, configured to obtain first operation information of the target object performing the operation of the first pre-stored characteristic action in real time;
and a first matching module 415, which performs matching verification on the first action information and the first operation information.
Further, the first matching module 415 includes a first sub-matching module and a first sub-output module, wherein,
the first sub-matching module 4151 is configured to perform matching verification according to an approximation degree of the first action information and the data of the first operation information;
the first sub-output module 4152 is configured to output a matching result of the first action information and the first operation information.
In a preferred embodiment, as shown in fig. 4, the system further comprises:
a second calling module 421, configured to call first voice information of a pre-stored voice of the target object, where the first voice information includes keyword information;
a second prompting module 422, configured to prompt the target object to repeat the keyword information;
a second action obtaining module 423, configured to obtain second voice information that the target object repeats the keyword information;
and a second matching module 424, configured to perform matching verification on the first voice information and the second voice information.
Further, the second matching module 424 further includes a second sub-determining module 4241 and a second sub-matching module 4242, wherein,
the second sub-determining module 4241 is configured to determine whether the second voice message includes the keyword information;
if the second voice message includes the keyword message, the second sub-matching module 4242 is configured to perform matching verification according to a similarity between the first voice message and the second voice message.
In a preferred embodiment, as shown in fig. 4, the system further comprises:
a detection module 431, configured to detect whether the first operation information matched with the first action information is acquired within a specific time;
a third calling module 432, configured to call second action information of a pre-stored feature action of the target object that is matched with the image information;
a third projection module 433, configured to project the second motion information onto the target object for virtual display;
a third prompting module 434, configured to prompt the target object to perform the operation of the pre-stored feature action according to the second action information;
a third action obtaining module 435, configured to obtain second operation information of the target object performing the operation of the pre-stored characteristic action in real time;
a third matching module 436, configured to perform matching verification on the second action information and the second operation information.
Further, data call can be performed between modules of the system, and each module has a right to access and call data of other modules in the system, for example, the first call module 411 can access and call data of the image information acquired in the first image acquisition module 410, and the first projection module 412 can access and call data of the first action information in the first call module 411.
It is to be understood that the present invention is not limited to the procedures and structures described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims (10)

1. A face recognition method based on augmented reality is characterized by comprising the following steps:
responding to a face recognition operation signal, acquiring image information of face recognition, and calling first action information of a first prestored characteristic action of a target object matched with the image information;
projecting the first action information to the target object for virtual display; the image of the first action information virtually displayed on the target object is a dynamic image of the first pre-stored characteristic action in equal proportion to the target object;
prompting the target object to perform the operation of the first pre-stored characteristic action according to the first action information, and acquiring first operation information of the target object to perform the operation of the first pre-stored characteristic action in real time; the first operation information is dynamic image information obtained by virtually superposing the first pre-stored characteristic action of the target object and the first pre-stored characteristic action of the target object in real time;
and matching and verifying the first action information and the first operation information.
2. The method according to claim 1, wherein the matching verification of the first action information and the first operation information is specifically:
performing matching verification according to the data similarity of the first action information and the first operation information;
and outputting and displaying the matching verification result of the first action information and the first operation information.
3. The method of claim 1, further comprising:
calling first voice information of pre-stored voice of the target object, wherein the first voice information comprises keyword information;
prompting the target object to repeat the keyword information, and acquiring second voice information of the target object repeating the keyword information;
and matching and verifying the first voice information and the second voice information.
4. The method according to claim 3, wherein the matching verification of the pre-stored voice information and the keyword voice information is specifically:
judging whether the second voice information contains the keyword information or not;
and if the second voice message contains the keyword message, performing matching verification according to the similarity degree of the sound attributes of the first voice message and the second voice message.
5. The method of claim 1, further comprising:
in a specific time, if the first operation information matched with the first action information is not obtained, calling second action information of a second prestored characteristic action of the target object;
projecting the second action information to the target object for virtual display;
prompting the target object to perform the operation of the second pre-stored characteristic action according to the second action information, and acquiring second operation information of the target object performing the operation of the second pre-stored characteristic action in real time;
and matching and verifying the second action information and the second operation information.
6. A system for augmented reality based face recognition, comprising:
the first image acquisition module is used for responding to the face recognition signal and acquiring image information of face recognition;
the first calling module is used for calling first action information of a first prestored characteristic action of the target object matched with the image information;
the first projection module is used for projecting the first action information to the target object for virtual display; the image of the first action information virtually displayed on the target object is a dynamic image of the first pre-stored characteristic action in equal proportion to the target object;
the first prompting module is used for prompting the target object to perform the operation of the first pre-stored characteristic action according to the first action information;
the first action acquisition module is used for acquiring first operation information of the target object for performing the operation of the first pre-stored characteristic action in real time; the first operation information is dynamic image information obtained by virtually superposing the first pre-stored characteristic action of the target object and the first pre-stored characteristic action of the target object in real time;
and the first matching module is used for matching and verifying the first action information and the first operation information.
7. The system of claim 6, wherein the first matching module comprises a first sub-matching module and a first sub-output module, wherein,
the first sub-matching module is used for performing matching verification according to the similarity degree of the first action information and the first operation information;
the first sub-output module is used for outputting and displaying the matching and verifying result of the first action information and the first operation information.
8. The system of claim 6, further comprising,
the second calling module is used for calling first voice information of pre-stored voice of the target object, and the first voice information comprises keyword information;
the second prompting module is used for prompting the target object to repeat the keyword information;
the second action acquisition module is used for acquiring second voice information of the target object repeating the keyword information;
and the second matching module is used for matching and verifying the first voice information and the second voice information.
9. The system of claim 8, wherein the second matching module further comprises a second sub-judgment module and a second sub-matching unit, wherein,
the second sub-judgment module is used for judging whether the second voice message contains the keyword message;
and the second sub-matching module is used for performing matching verification according to the similarity degree of the first voice information and the second voice information.
10. The system of claim 6, further comprising:
the detection module is used for detecting whether the first operation information matched with the first action information is acquired within a specific time;
the third calling module is used for calling second action information of pre-stored characteristic actions of the target object matched with the image information;
the third projection module is used for projecting the second action information to the target object for virtual display;
the third prompting module is used for prompting the target object to perform the operation of the pre-stored characteristic action according to the second action information;
the third acquisition module is used for acquiring second operation information of the target object for performing the operation of the pre-stored characteristic action in real time;
and the third matching module is used for matching and verifying the second action information and the second operation information.
CN201711250288.8A 2017-12-01 2017-12-01 Face recognition method and system based on augmented reality Active CN107992825B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711250288.8A CN107992825B (en) 2017-12-01 2017-12-01 Face recognition method and system based on augmented reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711250288.8A CN107992825B (en) 2017-12-01 2017-12-01 Face recognition method and system based on augmented reality

Publications (2)

Publication Number Publication Date
CN107992825A CN107992825A (en) 2018-05-04
CN107992825B true CN107992825B (en) 2021-05-14

Family

ID=62035075

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711250288.8A Active CN107992825B (en) 2017-12-01 2017-12-01 Face recognition method and system based on augmented reality

Country Status (1)

Country Link
CN (1) CN107992825B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109343806B (en) * 2018-08-09 2023-07-21 维沃移动通信有限公司 Information display method and terminal
CN109146629B (en) * 2018-08-16 2020-11-27 连云港伍江数码科技有限公司 Target object locking method and device, computer equipment and storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102402691A (en) * 2010-09-08 2012-04-04 中国科学院自动化研究所 Method for tracking gestures and actions of human face
CN106295504A (en) * 2016-07-26 2017-01-04 车广为 Enhancing display packing on the basis of recognition of face
CN106251294B (en) * 2016-08-11 2019-03-26 西安理工大学 A kind of single width faces the virtual multi-pose generation method of facial image
CN106492461A (en) * 2016-09-13 2017-03-15 广东小天才科技有限公司 Method and device for realizing Augmented Reality (AR) game and user terminal
CN107358646A (en) * 2017-06-20 2017-11-17 安徽工程大学 A kind of fatigue detecting system and method based on machine vision

Also Published As

Publication number Publication date
CN107992825A (en) 2018-05-04

Similar Documents

Publication Publication Date Title
CN109902630B (en) Attention judging method, device, system, equipment and storage medium
Fenu et al. A multi-biometric system for continuous student authentication in e-learning platforms
CN108804884B (en) Identity authentication method, identity authentication device and computer storage medium
CN106156578B (en) Identity verification method and device
CN105468950B (en) Identity authentication method and device, terminal and server
EP3373202A1 (en) Verification method and system
CN106850648B (en) Identity verification method, client and service platform
US9430627B2 (en) Method and system for enforced biometric authentication
CN105426723A (en) Voiceprint identification, face identification and synchronous in-vivo detection-based identity authentication method and system
CN104598796A (en) Method and system for identifying identity
CN106302330A (en) Auth method, device and system
CN109271850B (en) Merchant information uploading method and device, electronic equipment and storage medium
CN110059624B (en) Method and apparatus for detecting living body
CN109086590B (en) Interface display method of electronic equipment and electronic equipment
CN109934191A (en) Information processing method and device
CN107992825B (en) Face recognition method and system based on augmented reality
CN111881431B (en) Man-machine verification method, device, equipment and storage medium
CN108847941A (en) Identity identifying method, device, terminal and storage medium
CN111079499B (en) Writing content identification method and system in learning environment
CN110633677A (en) Face recognition method and device
CN107507288B (en) Rapid attendance checking method and device
Carta et al. Video injection attacks on remote digital identity verification solution using face recognition
CN110516426A (en) Identity identifying method, certification terminal, device and readable storage medium storing program for executing
CN115906028A (en) User identity verification method and device and self-service terminal
CN114467283B (en) Identity authentication method, device, terminal, storage medium and program product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant