CN116051115A - Face-brushing payment prompting method, device and equipment - Google Patents
Face-brushing payment prompting method, device and equipment Download PDFInfo
- Publication number
- CN116051115A CN116051115A CN202310099205.9A CN202310099205A CN116051115A CN 116051115 A CN116051115 A CN 116051115A CN 202310099205 A CN202310099205 A CN 202310099205A CN 116051115 A CN116051115 A CN 116051115A
- Authority
- CN
- China
- Prior art keywords
- face
- payment
- image
- page
- brushing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/38—Payment protocols; Details thereof
- G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
- G06Q20/401—Transaction verification
- G06Q20/4014—Identity check for transactions
- G06Q20/40145—Biometric identity checks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/64—Three-dimensional objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Business, Economics & Management (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Accounting & Taxation (AREA)
- Evolutionary Computation (AREA)
- General Business, Economics & Management (AREA)
- Strategic Management (AREA)
- Finance (AREA)
- Computer Security & Cryptography (AREA)
- Artificial Intelligence (AREA)
- Computing Systems (AREA)
- Databases & Information Systems (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Image Analysis (AREA)
Abstract
The embodiment of the specification provides a face payment prompting method, device and equipment. When a face image of a user is detected in the acquired video image, judging whether the user is a target user or not based on the face image, wherein the target user meets the following conditions: the face image is a face image in a specified state, and the distance between the user and the face brushing payment equipment is smaller than a preset distance; and if so, prompting the target user to pay by brushing the face. Whether the user is a target user with a payment intention or not is judged through the collected face image of the user, and then the user is actively prompted to carry out face brushing payment through face brushing payment equipment instead of a cashier, so that interaction with the user is carried out, and the user experience can be improved.
Description
The application is a divisional application with the application date of 2019, 4-month and 15-date, the application number of 2019103013078 and the invention creation name of 'a face-brushing payment prompting method, device and equipment'.
Technical Field
The present disclosure relates to the field of face recognition technologies, and in particular, to a face brushing payment prompting method, device and equipment.
Background
Face recognition is a biometric identification technique that performs identity authentication based on facial feature information of a person. With the development of face recognition technology, face recognition technology has been applied to various fields. Face-recognition-based face-brushing payment is a novel payment means in the current offline scene, and as face-brushing payment is also an emerging payment means for users, most users can ignore existing face-brushing payment devices of existing manual cashier stations of supermarkets and convenience stores, and the users cannot perceive the novel products, so that the cashier is required to actively recommend or inquire each time to pay attention to the customers. Therefore, when the user approaches the face brushing support, the face brushing support replaces a cashier to actively call with the user, prompts the user to pay by brushing the face, not only can the labor cost be saved, but also the user experience can be improved.
Disclosure of Invention
Based on the above, the specification provides a face payment prompting method, a device and equipment.
According to a first aspect of embodiments of the present disclosure, there is provided a face-brushing payment prompting method, which is applicable to a face-brushing payment device, including:
when a face image of a user is detected in the acquired video image, judging whether the user is a target user or not based on the face image, wherein the target user meets the following conditions: the face image is a face image in a specified state, and the distance between the user and the face brushing payment equipment is smaller than a preset distance;
and if so, prompting the target user to pay by brushing the face.
According to a second aspect of embodiments of the present specification, there is provided a face-brushing payment device adapted for use in a face-brushing payment apparatus, comprising:
the judging module is used for judging whether the user is a target user or not based on the face image when the face image of the user is detected in the acquired video image, wherein the target user meets the following conditions: the face image is a face image in a specified state, and the distance between the user and the face brushing payment equipment is smaller than a preset distance;
and the prompting module is used for prompting the target user to pay by brushing the face if the user is the target user.
According to a third aspect of embodiments of the present specification, there is provided a face payment device comprising a memory, a processor and a video acquisition means, the memory having stored thereon a computer program executable on the processor, the processor implementing the method of any of the embodiments when executing the program.
By applying the scheme of the embodiment of the specification, the face-brushing payment equipment acquires video images around the equipment in real time through the video acquisition device, judges whether the face image is a face image in a specified state or not based on the face image when the face image of the user is detected in the acquired video images, calculates the distance between the user and the face-brushing payment equipment according to the face image, and judges whether the distance is smaller than a preset distance or not; and if the conditions are met, prompting the target user to pay by brushing the face. Whether the user is a target user with a payment intention or not is judged through the collected face image of the user, and then the user is actively prompted to carry out face brushing payment through face brushing payment equipment instead of a cashier, so that interaction with the user is carried out, and the user experience can be improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the specification and together with the description, serve to explain the principles of the specification.
FIG. 1 is a flow chart of a face payment prompting method in accordance with one embodiment of the present disclosure;
FIG. 2 is a flow chart of a face payment prompting method according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram of a logic structure of a face payment prompting device according to an embodiment of the present disclosure;
fig. 4 is a schematic diagram of a logic structure of a face payment device according to an embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present specification. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present description as detailed in the accompanying claims.
The terminology used in the description presented herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the description. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any or all possible combinations of one or more of the associated listed items.
It should be understood that although the terms first, second, third, etc. may be used in this specification to describe various information, these information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, the first information may also be referred to as second information, and similarly, the second information may also be referred to as first information, without departing from the scope of the present description. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context.
Face-brushing payment based on face recognition is a novel payment means in the current offline scene, and at present, face-brushing payment equipment is used for realizing face-brushing payment in various supermarkets, convenience stores, shopping malls and the like. Since face-brushing payment is also an emerging payment means for users, most users ignore these face-brushing payment devices and have no perception of this new product, so that each time a cashier is required to actively recommend or prompt to draw the attention of the customer. Therefore, when the user approaches the face-brushing payment equipment, the face-brushing payment equipment replaces a cashier to actively call with the user, and prompts the user to use the equipment to conduct face-brushing payment, so that the labor cost can be saved, and the user experience can be improved.
Based on this, the embodiment of the present disclosure provides a face payment prompting method, which is suitable for a face payment device, where the face payment device may continuously collect video images, and when a face image is detected in the video images, determine whether a user is a target user who intends to make payment based on the face image, and then prompt the user that the face payment can be made. As shown in fig. 1, the method may include:
s102, when a face image of a user is detected in an acquired video image, judging whether the user is a target user or not based on the face image, wherein the target user meets the following conditions: the face image is a face image in a specified state, and the distance between the user and the face brushing payment equipment is smaller than a preset distance;
s104, if yes, prompting the target user to pay by face brushing.
In general, a face-brushing payment device is placed at a cash register, and the face-brushing payment device comprises a video acquisition device, so that video images around the face-brushing payment device can be continuously acquired, and the situation around the face-brushing payment device is monitored. When the user approaches the face-brushing payment equipment, the video image acquired by the video acquisition device comprises the face image of the user. The face payment device detects whether the collected video image includes a face image in real time, wherein the detection of whether the video image includes the face image can be realized based on the existing face detection algorithm, and at present, the face detection algorithm is very mature, for example, a Fast R-CNN algorithm based on Haar features or HOG features combined with SVM or AdaBoost is adopted for determining. The principle of the method is that a sub-window is assumed to continuously shift and slide in a video image window to be detected during face detection, the characteristic of the region can be calculated every time the sub-window reaches a position, then the characteristic can be screened by an SVM classifier, and once the characteristic passes the screening of the classifier, the region is judged to be a face. However, this method is less effective and less efficient. The face detection algorithm which is commonly used at present is a Fast R-CNN algorithm based on deep learning, and Fast-RCNN is optimization of R-CNN. R-CNN (Region with CNN feature) is the application of convolutional neural networks to face detection problems. CNN has good characteristic extraction and classification performance, and the target detection problem realized by adopting the RegionPropos method mainly comprises the following three steps: (1) candidate region selection. And (2) extracting CNN characteristics. (3) classification and boundary regression. The RCNN algorithm overlaps a large number of candidate frames within the image, resulting in a large amount of redundancy in the extraction of features. The Fast RCNN well solves the problem, and the training speed is improved.
If it is detected that a face image is included in the video image, it is further determined whether the user is a target user based on acquiring the face image, wherein the target user is a user who may be willing to pay. When a user wants to pay, the user tends to go to the cash desk, and the face-brushing payment device located at the cash desk just faces the user, so that the face image of the user can be acquired, or the face of the user faces the face-brushing device, at the moment, the angle between the face and the screen is smaller, and in addition, the distance between the user needing to pay and the face-brushing device of the cash desk is smaller. Therefore, the user who meets the following conditions can be determined as the target user with the intention of payment, the face image of the user is collected as the face image in the specified state, and the distance between the user and the face brushing equipment is smaller than the preset distance. The face image in the specified state refers to an image in which the face image meets a preset condition, for example, the face image is a front face image, and a pitch angle or a yaw angle of the face image is within a preset angle range, and the specific condition can be flexibly set according to an actual situation. In addition, the distance between the target user and the face brushing payment equipment can be calculated through the acquired face image, and the internal parameters and the external parameters of the pre-calibrated video acquisition device. The distance between the target user and the face-brushing payment device can be calculated based on a binocular vision algorithm, and as the image acquired by the video acquisition device is the process of projecting the three-dimensional space coordinates of the target object to the two-dimensional space coordinates, after the internal parameters and the external parameters of the camera are calibrated, the three-dimensional coordinates of the face in the three-dimensional space and the distance between the face (the target user) and the video acquisition device (the face-brushing payment device) can be calculated through the internal parameters and the external parameters and the two-dimensional position coordinates of the acquired face image. A distance threshold may be preset, for example, may be set to 80cm, and when the distance between the user and the face brushing device is calculated through the collected face image and is smaller than 80cm, the user is considered to be in accordance with the condition.
After the user is determined to be the target user, the user is considered to have the payment intention, and the face-brushing payment device can prompt the user to pay by using the face-brushing payment device.
According to the embodiment of the specification, video images around the equipment are acquired in real time through the face-brushing payment equipment, when the face image of a user appears in the video images, whether the face image is the face image in a specified state is judged, the distance between the user and the face-brushing payment equipment is calculated according to the acquired face image, whether the distance is smaller than a preset distance is judged, if the two conditions are met, the user is considered to be a target user with a payment intention, and at the moment, the face-brushing payment equipment prompts the user to pay by using the face-brushing payment equipment. By the method, the face-brushing payment equipment can be used for replacing a cashier to prompt a user to pay by using the face-brushing payment equipment, interaction between the face-brushing payment equipment and the user is increased, and user experience is improved.
Because the user who generally needs to pay is going over against the cash desk, the collected face images are basically positive face images instead of the side face images of the user, so that the user can be considered to have a larger probability of paying intention when the collected face images are positive face images. Thus, in some embodiments, the face image of the specified state may be set as the front face image. When the face image is detected to exist in the video image, a preset algorithm can be adopted to judge whether the face image is a positive face image or not, and if so, the user is considered to be in accordance with the condition. At present, the technology of judging whether a face image is a front face image is also mature, and whether the face image is the front face image can be judged based on a pre-trained classification model algorithm.
In some embodiments, when judging whether the acquired face image is a frontal face image, a method may be adopted in which a plurality of key feature points are extracted from the acquired two-dimensional face image, coordinates of the key feature points in the two-dimensional image are determined, then three-dimensional coordinates corresponding to the key feature points are obtained through calculation according to internal parameters and external parameters of a video acquisition device calibrated in advance, a three-dimensional face model is built, then a face deflection angle of a user is determined according to the standard frontal face three-dimensional face model and the three-dimensional face model built according to the acquired face image, the standard frontal face is assumed to be parallel to a screen, angles of the face of the user and the screen can be obtained according to the face deflection angle, whether the angles are within a preset angle range or not is determined, for example, whether the angles are smaller than 15 degrees, and if yes, the face image is determined to be the frontal face image. Whether the face image is the front face image is judged by calculating the angle between the face and the screen, and the face image is more accurate than the fact that a classification model is adopted to determine whether the face image is the front face image.
After determining that the user is the target user, the face payment device can prompt the user to recommend the user to pay by using the face payment device. The mode of prompting the user to use the face-brushing payment device can be set according to actual needs. For example, in some embodiments, a voice broadcast may be used to prompt the user that the device may be used to make a face-brushing payment. In some embodiments, a prompt document may also be presented on the screen of the face payment device to prompt the user to make a face payment. The prompt document may consist of pictures, text, etc., such as "welcome face payment using the machine". Of course, the voice broadcast prompt and the text prompt can also be adopted at the same time, and the specification is not limited. In some embodiments, the reminder may include a cartoon character, such as a cartoon character or animal character, which may interact with the user by making a designated action for added interest, such as by engaging the user in his hands, calling the user, smiling the user, and so forth.
After prompting the user to pay by using the face-brushing payment equipment, the user can also use the cartoon image to interact with the user, so that the interest of payment is increased, and the user can preheat the face-brushing payment equipment before payment. For example, in some embodiments, the user's facial motion may be detected and then the cartoon character controlled to make a corresponding motion, increasing the interaction between the two. For example, when the user blinks and the cartoon image blinks, the user shakes and the cartoon image shakes, the user smiles and the cartoon image also makes smiling expression, and when the user's angry expression is detected, the angry expression is also made. Through the interactions, the interest of payment can be increased, and meanwhile, the user can feel good to the face brushing equipment. The detection of the human face action can be realized by adopting a human face posture algorithm which is mature at present, and the human face action can be analyzed by the human face posture algorithm, so that the cartoon image is controlled to make corresponding action.
In general, when the target user is not detected, the face-brushing payment device may be in a standby interface, and after the target user is detected, the interface including a presentation document to prompt the user to pay for the face-brushing is entered. Many times, the target user may be detected to have no willingness to pay by brushing the face, and then may revert to the standby interface. For example, after prompting the user to pay the face, the timer may be started to count time, and when the count time exceeds the preset time, whether the face payment instruction input by the user is detected is judged, the face payment instruction may be input by the user by clicking a face payment button of the screen, and if not, the user returns to the standby interface.
The face-brushing payment device in the embodiments of the present disclosure may include a video acquisition device, and may also include a plurality of video acquisition devices, in some embodiments, the face-brushing payment device may include a video acquisition device, where the video acquisition device may perform switching between a two-dimensional view angle and a three-dimensional view angle, may use the two-dimensional view angle to acquire video images around the face-brushing payment device in real time, send a face-brushing payment prompt when a detected target user, and after receiving a face-brushing instruction input by the user, switch the two-dimensional view angle acquired by the video into a three-dimensional view angle, acquire a three-dimensional face image through the three-dimensional view angle, and then identify the three-dimensional face image and complete face-brushing payment. Because the face detection has lower requirements on the acquired images, two-dimensional face images can be used, and the face recognition has high requirements on the images, and more characteristic information needs to be extracted to avoid false recognition, so that three-dimensional face images can be used. After the face brushing payment is completed, the mode of the video acquisition device is switched from the three-dimensional view angle mode to the two-dimensional view angle mode, at the moment, the face of the user can be acquired because the user does not leave, the user can still be judged to be a target user according to the acquired face image, and then a prompt is sent out.
In order to further explain the face payment prompting method provided in the embodiment of the present disclosure, a detailed embodiment is described below.
Face-brushing payment is a novel payment means and is already used in various markets and supermarkets at present. However, as a new payment mode, many users do not feel the face-brushing payment equipment at the cash desk at present, and in order to enable the face-brushing payment equipment to actively prompt the user to pay by brushing the face, the interaction between the equipment and the user is increased, the interestingness of the payment process is improved, and the face-brushing payment prompting method is provided. The face-brushing payment prompting method is applied to face-brushing payment equipment, and fig. 2 is a schematic diagram of a specific face-brushing prompting method. The face-brushing payment equipment comprises a video acquisition device, and the video acquisition device can realize mode switching between a two-dimensional view angle and a three-dimensional view angle, so that two-dimensional video images can be acquired, and three-dimensional video images can be acquired. The two-dimensional mode is used for monitoring the conditions around the face-brushing payment equipment in real time, and video images around the face-brushing payment equipment can be acquired in real time. When the collected video image comprises a face image of a user, judging whether the face image is a positive face image or not, calculating the distance between the user and a face-brushing payment device according to the face image and internal parameters and external parameters of a video collecting device calibrated in advance, judging whether the distance is smaller than a preset distance, if the distance meets the conditions, determining the user as a target user, prompting the user to conduct face-brushing payment through voice broadcasting, prompting the face-brushing payment screen to enter a welcome interface from a standby interface, prompting a text to prompt the user to conduct face-brushing payment through the welcome interface, and after the face action of the user is detected, controlling the cartoon image to conduct interaction with the user, so that the interestingness of the payment process is increased. After prompting the user to pay by brushing the face, starting timing, and if the user has not detected a face brushing payment instruction input by clicking a screen face brushing payment button for more than a preset time period, returning the screen interface to the standby interface. If a face-brushing payment instruction input by a user is detected, switching the video acquisition device from a two-dimensional mode to a three-dimensional mode, then acquiring a three-dimensional face image of the user, identifying the three-dimensional face image and finishing face-brushing payment. The various technical features in the above embodiments may be arbitrarily combined as long as there is no conflict or contradiction between the combinations of the features, but are not described in detail, so that the arbitrary combination of the various technical features in the above embodiments also falls within the scope of the disclosure of the present specification.
As shown in fig. 3, a face payment prompting device according to an embodiment of the present disclosure may include:
the judging module 31 is configured to judge, when a face image of a user is detected in an acquired video image, whether the user is a target user based on the face image, where the target user meets the following conditions: the face image is a face image in a specified state, and the distance between the user and the face brushing payment equipment is smaller than a preset distance;
and the prompting module 32 is used for prompting the target user to pay the face brushing if the user is the target user.
In one embodiment, the face image of the specified state includes:
the face image is a front face image.
In one embodiment, the process of determining that the face image is a positive face image includes:
judging whether the angle between the face of the user and the screen of the face brushing payment equipment is smaller than a preset angle or not based on the face image;
if the face image is smaller than the front face image, the face image is determined to be the front face image.
In one embodiment, prompting the target user to make a face payment includes:
prompting the user to pay by brushing the face by adopting voice broadcasting; or alternatively, the first and second heat exchangers may be,
and displaying a prompt document on a screen of the face brushing payment machine tool to prompt the user to conduct face brushing payment.
In one embodiment, the reminder document includes a cartoon image that performs a specified action to interact with the user.
In one embodiment, after prompting the target user to make a face-brushing payment, the method further comprises:
detecting the face action of the user;
and controlling the cartoon image to execute corresponding actions based on the human face actions.
In one embodiment, after prompting the target user to make a face-brushing payment, the method further comprises:
starting a timer for timing;
judging whether a face-brushing payment instruction input by a user is detected when the timing duration exceeds a preset duration;
if not, returning to the standby interface.
In one embodiment, the video image is a two-dimensional video image, and after prompting the target user to make a face-brushing payment, the method further comprises:
receiving a face-brushing payment instruction input by the target user;
invoking a three-dimensional image acquisition device to acquire a three-dimensional face image of the target user;
and recognizing the three-dimensional face image and finishing face brushing payment.
Specific details of the implementation process of the functions and roles of each module in the device are shown in the implementation process of the corresponding steps in the method, and are not repeated here.
For the device embodiments, reference is made to the description of the method embodiments for the relevant points, since they essentially correspond to the method embodiments. The apparatus embodiments described above are merely illustrative, wherein the modules illustrated as separate components may or may not be physically separate, and the components shown as modules may or may not be physical, i.e., may be located in one place, or may be distributed over a plurality of network modules. Some or all of the modules may be selected according to actual needs to achieve the purposes of the present description. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
Embodiments of the present description apparatus may be applied to a computer device, such as a server or a smart terminal. The apparatus embodiments may be implemented by software, or may be implemented by hardware or a combination of hardware and software. Taking software implementation as an example, the device in a logic sense is formed by reading corresponding computer program instructions in the nonvolatile memory into the memory through a processor of the file processing where the device is located. In terms of hardware, as shown in fig. 4, a hardware structure diagram of a face-brushing payment device where the apparatus of the present disclosure is located is shown in fig. 4, and besides the processor 402, the memory 404, the network interface 406, and the nonvolatile memory 408 shown in fig. 4, the server or the electronic device where the apparatus is located in the embodiment generally includes other hardware according to the actual function of the computer device, which is not described herein again.
Accordingly, the present specification embodiment also provides a computer storage medium having a program stored therein, which when executed by a processor, implements the method in any of the above embodiments.
Accordingly, the embodiments of the present disclosure further provide a face payment device, including a memory, a processor, a video capture device, and a computer program stored on the memory and executable on the processor, where the processor implements the method of any of the above embodiments when the program is executed.
The present application may take the form of a computer program product embodied on one or more storage media (including, but not limited to, magnetic disk storage, CD-ROM, optical storage, etc.) having program code embodied therein. Computer-usable storage media include both permanent and non-permanent, removable and non-removable media, and information storage may be implemented by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to: phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, may be used to store information that may be accessed by the computing device.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure herein. This disclosure is intended to cover any adaptations, uses, or adaptations of the disclosure following the general principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
The foregoing description of the preferred embodiments of the present disclosure is not intended to limit the disclosure, but rather to cover all modifications, equivalents, improvements and alternatives falling within the spirit and principles of the present disclosure.
Claims (19)
1. A face-brushing payment device comprising a video acquisition device, a display screen, a processor and a memory, wherein a computer program executable by the processor is stored in the memory, and the processor is used for realizing the following steps when executing the computer program:
acquiring video images of the surrounding environment of the face brushing payment equipment, which are acquired by the video acquisition device;
under the condition that a target user with a payment intention exists around the face-brushing payment equipment based on the video image, switching a display page of the display screen from a standby page to a face-brushing payment prompt page, and interacting with the target user through cartoon images on the face-brushing payment prompt page so as to prompt the target user to conduct face-brushing payment.
2. The face payment device of claim 1, the processor further configured to, after switching the display page of the display screen from the standby page to the face payment hint page:
under the condition that the face-brushing payment instruction is detected, switching the display page of the display screen from the face-brushing payment prompting page to a face-brushing payment page, and collecting the face image of the target user through the face-brushing payment page for payment verification.
3. The face payment device of claim 2, the video capture means comprising a two-dimensional view mode and a three-dimensional view mode; in the two-dimensional view angle mode, the image collected by the video collecting device is a two-dimensional image, in the three-dimensional view angle mode, the image collected by the video collecting device is a three-dimensional image, and the video image of the surrounding environment of the face brushing payment equipment is a two-dimensional image;
after the display page of the display screen is switched from the face payment prompting page to the face payment page, the processor is further configured to:
and switching the mode of the video acquisition device from the two-dimensional view angle mode to the three-dimensional view angle mode so as to acquire the three-dimensional face image of the target user for payment verification.
4. The face payment device of claim 1, the processor further configured to, after switching the display page of the display screen from the standby page to the face payment hint page:
and returning the display page of the display screen to the standby page under the condition that the face-brushing payment instruction is not detected after the preset time period is exceeded.
5. A swipe payment device as claimed in any of claims 2-4, comprising a swipe payment control on the swipe payment alert page, the target user being able to trigger the swipe payment instruction by touching the swipe payment control.
6. The face payment device of claim 1, wherein the processor is configured to, when interacting with the target user through the cartoon character on the face payment prompt page, specifically:
detecting the face action of the target user;
and controlling the cartoon image to execute corresponding actions based on the human face actions.
7. The face-brushing payment device according to claim 1, the processor being configured to, when detecting the presence of a target user with a payment intention around the face-brushing payment device based on the video image, in particular:
and if the face image of the user is detected in the video image, and the distance between the user and the face payment equipment is smaller than a preset distance and the face image is in a face image in a specified state, judging that a target user with a payment intention exists around the face payment equipment.
8. The face payment device of claim 7, the face image of the specified state comprising:
the face image is a front face image.
9. The face-brushing payment device according to claim 8, wherein in a case where it is determined that the angle of the face of the user with the display screen is smaller than a preset angle based on the face image, the face image is determined as a front face image.
10. The face-brushing payment prompting method is suitable for face-brushing payment equipment, wherein the face-brushing payment equipment comprises a video acquisition device and a display screen, and the method comprises the following steps:
acquiring video images of the surrounding environment of the face brushing payment equipment, which are acquired by the video acquisition device;
under the condition that a target user with a payment intention exists around the face-brushing payment equipment based on the video image, switching a display page of the display screen from a standby page to a face-brushing payment prompt page, and interacting with the target user through cartoon images on the face-brushing payment prompt page so as to prompt the target user to conduct face-brushing payment.
11. The method of claim 10, after switching the display page of the display screen from the standby page to the swipe payment hint page, further comprising:
under the condition of detecting a face payment instruction, switching a display page of the display screen from the face payment prompting page to a face payment page, and acquiring a face image of the target user through the face payment page for payment verification.
12. The method of claim 10, the video capture device comprising a two-dimensional view mode and a three-dimensional view mode; in the two-dimensional view angle mode, the image collected by the video collecting device is a two-dimensional image, in the three-dimensional view angle mode, the image collected by the video collecting device is a three-dimensional image, and the video image of the surrounding environment of the face brushing payment equipment is a two-dimensional image;
after the display page of the display screen is switched from the face payment prompting page to the face payment page, the method further comprises:
and switching the mode of the video acquisition device from the two-dimensional view angle mode to the three-dimensional view angle mode so as to acquire the three-dimensional face image of the target user for payment verification.
13. The method of claim 10, after switching the display page of the display screen from the standby page to the swipe payment hint page, the method further comprising:
and returning the display page of the display screen to the standby page under the condition that the face-brushing payment instruction is not detected after the preset time period is exceeded.
14. The method of any of claims 11-13, comprising a swipe payment control on the swipe payment hint page, the target user triggering the swipe payment instruction by touching the swipe payment control.
15. The method of claim 10, the interaction with the target user through the cartoon character on the face payment prompt page, comprising:
detecting the face action of the target user;
and controlling the cartoon image to execute corresponding actions based on the human face actions.
16. The method of claim 10, the detecting the presence of a target user with a payment intention around the swipe payment device based on the video image, comprising:
and if the face image of the user is detected in the video image, and the distance between the user and the face payment equipment is smaller than a preset distance and the face image is in a face image in a specified state, judging that a target user with a payment intention exists around the face payment equipment.
17. The method of claim 16, the face image of the specified state comprising:
the face image is a front face image.
18. The method according to claim 16, wherein in a case where it is determined based on the face image that the angle of the face of the user with the display screen is smaller than a preset angle, the face image is determined as a front face image.
19. A face-brushing payment prompting device, which is suitable for face-brushing payment equipment, wherein the face-brushing payment equipment comprises a video acquisition device and a display screen, and the device comprises:
the acquisition module is used for acquiring video images of the surrounding environment of the face brushing payment equipment acquired by the video acquisition device;
and the prompting module is used for switching the display page of the display screen from a standby page to a face-brushing payment prompting page under the condition that a target user with a payment intention exists around the face-brushing payment equipment based on the video image, and prompting the target user to carry out face-brushing payment through the cartoon image on the face-brushing payment prompting page.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310099205.9A CN116051115A (en) | 2019-04-15 | 2019-04-15 | Face-brushing payment prompting method, device and equipment |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310099205.9A CN116051115A (en) | 2019-04-15 | 2019-04-15 | Face-brushing payment prompting method, device and equipment |
| CN201910301307.8A CN110175514B (en) | 2019-04-15 | 2019-04-15 | Face brushing payment prompting method, device and equipment |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910301307.8A Division CN110175514B (en) | 2019-04-15 | 2019-04-15 | Face brushing payment prompting method, device and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116051115A true CN116051115A (en) | 2023-05-02 |
Family
ID=67689500
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310099205.9A Pending CN116051115A (en) | 2019-04-15 | 2019-04-15 | Face-brushing payment prompting method, device and equipment |
| CN201910301307.8A Active CN110175514B (en) | 2019-04-15 | 2019-04-15 | Face brushing payment prompting method, device and equipment |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910301307.8A Active CN110175514B (en) | 2019-04-15 | 2019-04-15 | Face brushing payment prompting method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN116051115A (en) |
Families Citing this family (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110955879B (en) * | 2019-11-29 | 2023-04-18 | 腾讯科技（深圳）有限公司 | Device control method, device, computer device and storage medium |
| CN111027982A (en) * | 2019-12-26 | 2020-04-17 | 北京意锐新创科技有限公司 | Non-inductive payment method and device suitable for full-screen |
| CN111292092B (en) * | 2020-05-09 | 2020-12-04 | 支付宝(杭州)信息技术有限公司 | Face brushing payment method and device and electronic equipment |
| CN111539740B (en) * | 2020-05-15 | 2022-11-18 | 支付宝(杭州)信息技术有限公司 | Payment method, device and equipment |
| CN112150159B (en) * | 2020-05-22 | 2022-06-24 | 支付宝(杭州)信息技术有限公司 | Payment method, device and equipment based on face recognition |
| CN112365255B (en) * | 2020-10-28 | 2021-08-31 | 中标慧安信息技术股份有限公司 | Non-inductive payment method and system for supermarket |
| CN112562221A (en) * | 2020-12-02 | 2021-03-26 | 支付宝(杭州)信息技术有限公司 | Terminal and method for supporting face recognition |
| CN112700568B (en) * | 2020-12-28 | 2023-04-18 | 科大讯飞股份有限公司 | Identity authentication method, equipment and computer readable storage medium |
| CN112906597A (en) * | 2021-03-03 | 2021-06-04 | 支付宝(杭州)信息技术有限公司 | User identity recognition method and device and face brushing equipment |
| CN113240428B (en) * | 2021-05-27 | 2023-09-08 | 支付宝(杭州)信息技术有限公司 | Payment processing method and device |
| CN113887451A (en) * | 2021-10-09 | 2022-01-04 | 支付宝(杭州)信息技术有限公司 | Picture processing method and device |
| CN113989925A (en) * | 2021-10-22 | 2022-01-28 | 支付宝(杭州)信息技术有限公司 | Face brushing interaction method and device |
| CN114240444A (en) * | 2021-12-17 | 2022-03-25 | 支付宝(杭州)信息技术有限公司 | Face brushing payment method and device and face brushing payment equipment |
| CN114511910A (en) * | 2022-02-25 | 2022-05-17 | 支付宝(杭州)信息技术有限公司 | Face brushing payment intention identification method, device and equipment |
| CN115035578A (en) * | 2022-06-20 | 2022-09-09 | 支付宝(杭州)信息技术有限公司 | Payment method, device and equipment |
| CN117523684A (en) * | 2022-07-27 | 2024-02-06 | 腾讯科技（深圳）有限公司 | Image acquisition method, device, computer equipment and storage medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104899742A (en) * | 2015-05-28 | 2015-09-09 | 宇龙计算机通信科技(深圳)有限公司 | Data transfer method, mobile terminal and server |
| CN106056379A (en) * | 2016-05-25 | 2016-10-26 | 努比亚技术有限公司 | Payment terminal and payment data processing method |
| CN109377234A (en) * | 2018-09-20 | 2019-02-22 | 阿里巴巴集团控股有限公司 | A kind of brush face method of payment and equipment |
-
2019
- 2019-04-15 CN CN202310099205.9A patent/CN116051115A/en active Pending
- 2019-04-15 CN CN201910301307.8A patent/CN110175514B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN110175514B (en) | 2023-02-28 |
| CN110175514A (en) | 2019-08-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN116051115A (en) | Face-brushing payment prompting method, device and equipment | |
| CN106897658B (en) | Method and device for identifying human face living body | |
| CN109976506B (en) | Awakening method of electronic equipment, storage medium and robot | |
| CN105184246B (en) | Living body detection method and living body detection system | |
| CN109034013B (en) | Face image recognition method, device and storage medium | |
| EP2546782B1 (en) | Liveness detection | |
| Yang et al. | Effective 3d action recognition using eigenjoints | |
| US9075453B2 (en) | Human eye controlled computer mouse interface | |
| EP2182469B1 (en) | System and method for sensing facial gesture | |
| KR102092931B1 (en) | Method for eye-tracking and user terminal for executing the same | |
| CN113366487A (en) | Operation determination method and device based on expression group and electronic equipment | |
| EP3286679A1 (en) | Method and system for identifying a human or machine | |
| CN109299658B (en) | Face detection method, face image rendering device and storage medium | |
| CN108897589B (en) | Human-computer interaction method and device in display equipment, computer equipment and storage medium | |
| US20130202162A1 (en) | Method of reconstructing three-dimensional facial shape | |
| CN108090422A (en) | Hair style recommends method, Intelligent mirror and storage medium | |
| US10360441B2 (en) | Image processing method and apparatus | |
| CN102054165A (en) | Image processing apparatus and image processing method | |
| CN112001932A (en) | Face recognition method and device, computer equipment and storage medium | |
| CN112632349B (en) | Exhibition area indication method and device, electronic equipment and storage medium | |
| CN103999133A (en) | Method and apparatus for user recognition | |
| CN111327888B (en) | Camera control method and device, computer equipment and storage medium | |
| CN113657903A (en) | Face-brushing payment method and device, electronic equipment and storage medium | |
| CN111275874B (en) | Information display method, device and equipment based on face detection and storage medium | |
| WO2016171923A1 (en) | Method and system for identifying a human or machine |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |