US20180315115A9 - Augmented reality device and method for product purchase facilitation - Google Patents
Augmented reality device and method for product purchase facilitation Download PDFInfo
- Publication number
- US20180315115A9 US20180315115A9 US15/730,556 US201715730556A US2018315115A9 US 20180315115 A9 US20180315115 A9 US 20180315115A9 US 201715730556 A US201715730556 A US 201715730556A US 2018315115 A9 US2018315115 A9 US 2018315115A9
- Authority
- US
- United States
- Prior art keywords
- product
- augmented reality
- module
- user
- purchase
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 94
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000000007 visual effect Effects 0.000 claims abstract description 31
- 238000004891 communication Methods 0.000 claims description 34
- 230000001815 facial effect Effects 0.000 claims description 4
- 230000000977 initiatory effect Effects 0.000 claims description 3
- 238000004590 computer program Methods 0.000 description 18
- 230000003287 optical effect Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 2
- 230000003416 augmentation Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0641—Shopping interfaces
- G06Q30/0643—Graphical representation of items or shoppers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/08—Payment architectures
- G06Q20/12—Payment architectures specially adapted for electronic shopping systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/08—Payment architectures
- G06Q20/20—Point-of-sale [POS] network systems
- G06Q20/208—Input by product or record sensing, e.g. weighing or scanner processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q20/00—Payment architectures, schemes or protocols
- G06Q20/38—Payment protocols; Details thereof
- G06Q20/40—Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
- G06Q20/401—Transaction verification
- G06Q20/4014—Identity check for transactions
- G06Q20/40145—Biometric identity checks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07F—COIN-FREED OR LIKE APPARATUS
- G07F9/00—Details other than those peculiar to special kinds or types of apparatus
- G07F9/02—Devices for alarm or indication, e.g. when empty; Advertising arrangements in coin-freed apparatus
- G07F9/023—Arrangements for display, data presentation or advertising
- G07F9/0235—Arrangements for display, data presentation or advertising the arrangements being full-front touchscreens
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
- G07G1/00—Cash registers
- G07G1/0036—Checkout procedures
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
- G07G1/00—Cash registers
- G07G1/0036—Checkout procedures
- G07G1/0045—Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader
- G07G1/0054—Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader with control of supplementary check-parameters, e.g. weight or number of articles
- G07G1/0063—Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader with control of supplementary check-parameters, e.g. weight or number of articles with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/0861—Network architectures or network communication protocols for network security for authentication of entities using biometrical features, e.g. fingerprint, retina-scan
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L2463/00—Additional details relating to network architectures or network communication protocols for network security covered by H04L63/00
- H04L2463/102—Additional details relating to network architectures or network communication protocols for network security covered by H04L63/00 applying security measure for e-commerce
Definitions
- the present disclosure relates broadly, but not exclusively, to an augmented reality device and a method for product purchase facilitation using an augmented reality device.
- Augmented reality is a live direct or indirect view of a physical, real-world environment whose elements are augmented (or supplemented) by computer-generated sensory input such as sound, video, graphics, or GPS data. Augmentation is conventionally in real-time and in semantic context with environmental elements, such as sports scores on TV during a match. In other words, information about the environment and its objects is overlaid on the real world. Using advanced AR technology (e.g. adding computer vision and object recognition) information about the surrounding real world of the user can become interactive.
- advanced AR technology e.g. adding computer vision and object recognition
- a non-confidential user identifier e.g. a user ID
- PIN personal identification number
- the system retrieves a registered PIN (that is stored in the system) based on the user ID and compares the registered PIN with the received PIN. The user is granted access only if the received PIN matches the registered PIN number.
- PINs may be used at point of sale (POS) terminals for authenticating a cardholder during electronic payment transactions involving payment cards such as debit cards and credit cards.
- POS point of sale
- a first aspect of the present disclosure provides an augmented reality device for facilitating product purchase, including a display module configured to provide augmented reality visual content, the augmented reality visual content including a virtual image of a product, a biometric authentication module configured to receive biometric data relating to a user and authenticate the user based on the received biometric data, and a transceiver module configured to receive, from a user device, digital payment credentials for facilitating purchase of the product, and transmit the digital payment credentials to a payment processing module for product purchase upon successful authentication of the user.
- the augmented reality device may further include a product identification module configured to determine product information relating to the product based on data encoded on a tag that is attached to the product.
- the transceiver module may be further configured to transmit at least a portion of the determined product information to the payment processing module for facilitating purchase of the product upon successful authentication of the user.
- the product information may include a description and a price of the product, and the price of the product is transmitted to the payment processing module.
- the display module may be further configured to display the description and the price of the product in conjunction with the augmented reality visual content.
- the transceiver module may be further configured to receive a payment success message from the payment processing module upon successful payment of the product, and the display module may be further configured to display an indication of the payment success in conjunction with the augmented reality visual content upon receipt of the payment success message.
- the biometric authentication module may be in communication with a biometric authentication directory server, and the received biometric data relating to the user is compared to reference biometric data stored in the biometric authentication directory server for authenticating the user.
- the augmented reality device may be in communication with an inventory management system, and the transceiver module may be further configured to transmit a product release message to the inventory management system for release of the product upon receipt of the payment success message.
- the augmented reality device may further include an input module configured to receive a purchase instruction from the user device to purchase the product, and the biometric authentication module may be configured to initiate authentication of the user upon receipt of the purchase instruction.
- the input module may be further configured to obtain an image of the user, and the augmented reality visual content provided by the display module may include the image of the user in juxtaposition with the virtual image of a product.
- the biometric data may include one or more of iris data, fingerprint data, voice data, and facial feature data.
- a second aspect of the present disclosure provides a method for product purchase facilitation using an augmented reality device, the augmented reality device including a display module, a biometric authentication module, and a transceiver module, the method including the steps of: providing augmented reality visual content including a virtual image of a product using the display module, receiving biometric data relating to a user at the biometric authentication module, authenticating the user based on the received biometric data using the biometric authentication module, and receiving, at the transceiver module, digital payment credentials from a user device for facilitating purchase of the product, and transmitting the digital payment credentials from the transceiver module to a payment processing module for product purchase upon successful authentication of the user by the biometric authentication module.
- the augmented reality device may further include a product identification module, and the method may further include determining, using the product identification module, product information relating to the product based on data encoded on a tag that is attached to the product, and transmitting, using the transceiver module, at least a portion of the determined product information to the payment processing module for facilitating purchase of the product upon successful authentication of the user.
- the product information may include a description and a price of the product, and the price of the product is transmitted to the payment processing module.
- the method may further include displaying, using the display module, the description and the price of the product in conjunction with the augmented reality visual content.
- the method may further include receiving, at the transceiver module, a payment success message from the payment processing module upon successful payment of the product, and displaying, using the display module, an indication of the payment success in conjunction with the augmented reality visual content upon receipt of the payment success message.
- the method may further include comparing the received biometric data relating to the user to reference biometric data stored in a biometric authentication directory server that is in communication with the biometric authentication module.
- the method may further include transmitting, using the transceiver module, a product release message to an inventory management system that is in communication with the augmented reality device upon receipt of the payment success message.
- the augmented reality device may further include an input module, and wherein the method may further include receiving, at the input module, a purchase instruction from the user device to purchase the product, and initiating authentication of the user by the biometric authentication module upon receipt of the purchase instruction.
- the method may further include obtaining an image of the user using the input module, and displaying, using the display module, the augmented reality visual content including the image of the user in juxtaposition with the virtual image of a product.
- FIG. 1 is a schematic of an augmented reality device for facilitating purchase of a product according to an example embodiment
- FIG. 2 is a flowchart illustrating a method for product purchase facilitation using an augmented reality device, according to an example embodiment
- FIG. 3 shows a schematic diagram of a computer system suitable for use in executing at least some steps of the method for product purchase facilitation or for realizing at least a part of the augmented reality device.
- the present disclosure also provides apparatus for performing the operations of the methods.
- Such apparatus may be specially constructed for the required purposes, or may include a computer or other device selectively activated or reconfigured by a computer program stored in the computer.
- the algorithms and displays presented herein are not inherently related to any particular computer or other apparatus.
- Various machines may be used with programs in accordance with the teachings herein.
- the construction of more specialized apparatus to perform the required method steps may be appropriate.
- the structure of a computer suitable for executing the various methods/processes described herein will appear from the description below.
- the present disclosure also implicitly provides a computer program, in that it would be apparent to the person skilled in the art that the individual steps of the method described herein may be put into effect by computer code.
- the computer program is not intended to be limited to any particular programming language and implementation thereof. It will be appreciated that a variety of programming languages and coding thereof may be used to implement the teachings of the disclosure contained herein.
- the computer program is not intended to be limited to any particular control flow. There are many other variants of the computer program, which can use different control flows without departing from the spirit or scope of the disclosure.
- Such a computer program may be stored on any computer readable medium.
- the computer readable medium may include storage devices such as magnetic or optical disks, memory chips, or other storage devices suitable for interfacing with a computer.
- the computer readable medium may also include a hard-wired medium such as exemplified in the Internet system, or wireless medium such as exemplified in the GSM mobile telephone system.
- the computer program when loaded and executed on such a computer effectively results in an apparatus that implements the steps of the method.
- FIG. 1 is a schematic of an augmented reality device 100 for facilitating purchase of a product, according to an embodiment.
- the augmented reality device 100 includes a display module 102 that is configured to provide augmented reality visual content.
- the augmented reality visual content includes a virtual image of a product.
- the augmented reality visual content includes a virtual image of the shirt having substantially similar attributes (e.g. color, shape, size, etc.) as the actual product.
- the term “module” e.g. display module, biometric authentication module, etc.
- the display module 102 may include a display screen with a reflective surface so that a user who is positioned in front of the reflective surface may be able to see an image of himself/herself in juxtaposition with the virtual image of a product, may be in real-time and in semantic context.
- the product is a shirt
- the virtual image of the shirt is superimposed on the user's torso
- the product is a hat
- the virtual image of the hat is superimposed on top of the user's head.
- an image capturing module may be used to capture an image of the user and the captured image (or a part thereof) is displayed on the display screen in conjunction with the virtual image of a product.
- the display module 102 may include an augmented reality processor (not shown in FIG. 1 ) that can generate the virtual images in juxtaposition with the image of the user may be in real-time and in semantic context.
- the augmented reality device 100 further includes a biometric authentication module 104 configured to receive biometric data relating to a user.
- the biometric data may include one or more of iris data, fingerprint data, voice data, and facial feature data relating to the user.
- the biometric authentication module 104 may include a biometric data such a fingerprint scanner for receiving the biometric data relating to the user.
- the biometric authentication module 104 is further configured to authenticate the user based on the received biometric data.
- the biometric authentication module 104 may be in communication with a biometric authentication directory server 114 .
- the biometric authentication directory server 114 may include a database with reference or template biometric data enrolled therein.
- the biometric authentication module 104 can authenticate the user based on the received biometric data by comparing the received biometric data relating to a user with the enrolled reference or template biometric data of the user.
- the biometric authentication directory server 114 is an external module (i.e. not part of) the augmented reality device 100 and may be administered by a financial institution or payment network.
- the biometric authentication directory server 114 may be an internal module (i.e. part of/integrated within) the augmented reality device 100 .
- the augmented reality device 100 further includes a transceiver module 106 that is configured to receive digital payment credentials from a user device 108 for facilitating purchase of the product.
- the user device 108 may be a mobile device (e.g. smartphone or tablet computer) having installed therein a mobile (digital) wallet application.
- the mobile wallet application may be loaded with one or more payment cards, and is capable of securely administering the digital payment credentials of each payment card.
- the transceiver module 106 is further configured to transmit the digital payment credentials to a payment processing module 110 for product purchase upon successful authentication of the user by the biometric authentication module 104 .
- the augmented reality device 100 may further include a product identification module 112 configured to determine product information relating to the product based on data encoded on a tag that is attached to the product.
- the product information includes, but is not limited to, a description and a price of the product.
- the tag may be a radio-frequency identification (RFID) tag that is attached to the product.
- the product identification module 112 may include a RFID scanner that is capable of reading the product information encoded on the RFID tag.
- the transceiver module 106 may be further configured to transmit at least a portion of the determined product information (e.g. the price of the product) to the payment processing module 110 for facilitating purchase of the product upon successful authentication of the user by the biometric authentication module 104 .
- the payment processing module 110 can generate an instruction to debit the corresponding amount from the user's account.
- the display module 102 may be further configured to display the description and/or the price of the product in conjunction with the augmented reality visual content.
- the display screen of the display module 102 can display the description and/or the price of the shirt in conjunction with the virtual image of the shirt that is superimposed on the user's torso.
- the transceiver module 106 is further configured to receive a payment success message from the payment processing module 110 upon successful payment of the product.
- the display module 102 is further configured to display an indication of the payment success in conjunction with the augmented reality visual content upon receipt of the payment success message.
- the display screen of the display module 102 can display the payment success message (e.g. “Payment Successful”) in conjunction with the virtual image of the shirt that is superimposed on the user's torso.
- the payment processing module 110 can be configured to process transactions as known in the art, which includes handling and/or generating messages between acquiring banks, card scheme networks, and issuing banks.
- the augmented reality device 100 is in communication with an inventory management system 116 , and the transceiver module 106 is further configured to transmit a product release message to the inventory management system 116 for release of the product upon receipt of the payment success message.
- release of a product includes handing over the product to the user (at a physical store) and delivering the product to the user (for an online store).
- the inventory management system 116 can update a product inventory so that stock can be monitored and replenished if necessary.
- the augmented reality device 100 further includes an input module 118 configured to receive a purchase instruction from the user device 108 to purchase the product.
- the biometric authentication module 100 can be further configured to initiate authentication of the user upon receipt of the purchase instruction.
- the purchase instruction from the user acts as a trigger for authentication of the user.
- the input module 118 may be further configured to obtain an image of the user.
- the input module 118 may have an image capturing module as described above.
- the display module 102 can display the augmented reality visual content that includes the obtained image of the user (or a part thereof) in juxtaposition with the virtual image of a product.
- the augmented reality device 100 may be placed in a merchant's store. Specifically, the augmented reality device 100 may replace a conventional mirror that is placed in a fitting room and placed in the open since a private enclosure is no longer required for customers to undress and try on articles of clothing. In other words, customers can utilize the augmented reality device 100 to try on articles of clothing in public as a virtual image of the article of clothing is provided in juxtaposition with an image of the user on a reflective surface (mirror) or display screen as described above. This advantageously minimizes waiting times at conventional fitting rooms. Furthermore, waiting times at conventional cashiers can also be minimized as payment can be done at the augmented reality device 100 based on biometric authentication of the cardholder.
- Purchased items can be collected at a separate counter or delivered directly to a consumer's home.
- the augmented reality device 100 may be configured to allow the user to select multiple products to try on sequentially or simultaneously, and the user can select which virtual item(s) to be displayed in juxtaposition with the image of the user.
- embodiments may also be implemented for off-site retail shopping.
- the embodiments described above can be used for mobile shopping (where a consumer has an augmented reality enabled smartphone that can provide, among other things, an image of the user in juxtaposition with a virtual image of a product) and smart television shopping (where a consumer has an augmented reality enabled television that can provide, among other things, an image of the user in juxtaposition with a virtual image of a product).
- Embodiments may also be implemented for in-game shopping (where users are able to purchase in-game items when playing games using an augmented reality enabled game console).
- Embodiments described above can also be used in vehicles where an augmented reality enabled rear-view mirror can be used to make purchases when a car is stationary (e.g. paying for petrol at a petrol station and the value of the petrol is displayed on the mirror).
- FIG. 2 is a flowchart 200 illustrating a method for product purchase facilitation using an augmented reality device, according to an example embodiment.
- the augmented reality device includes a display module, a biometric authentication module, and a transceiver module, substantially as described above.
- Step 202 involves providing augmented reality visual content including a virtual image of a product using the display module.
- Step 204 involves receiving biometric data relating to a user at the biometric authentication module.
- the user is authenticated based on the received biometric data (at step 204 ) using the biometric authentication module.
- the received biometric data relating to the user is compared to reference biometric data stored in a biometric authentication directory server that is in communication with the biometric authentication module.
- the augmented reality device may include an input module and the method may further include receiving, at the input module, a purchase instruction from the user device to purchase the product, and initiating authentication of the user (i.e. step 206 ) by the biometric authentication module upon receipt of the purchase instruction.
- the method may further include obtaining an image of the user using the input module, and displaying, using the display module, the augmented reality visual content including the image of the user in juxtaposition with the virtual image of a product.
- digital payment credentials for facilitating purchase of the product are received at the transceiver module from a user device (e.g. a smartphone or tablet computer having installed therein a mobile (digital) wallet application).
- a user device e.g. a smartphone or tablet computer having installed therein a mobile (digital) wallet application.
- the digital payment credentials received at step 208 are transmitted from the transceiver module to a payment processing module for product purchase upon successful authentication of the user by the biometric authentication module.
- the augmented reality device may further include a product identification module and the method may further include determining, using the product identification module, product information relating to the product based on data encoded on a tag that is attached to the product.
- the product information includes a description and a price of the product.
- the method may also include transmitting, using the transceiver module, at least a portion of the determined product information (e.g. the price of the product) to the payment processing module for facilitating purchase of the product upon successful authentication of the user.
- the method may further include displaying, using the display module, the description and the price of the product in conjunction with the augmented reality visual content.
- the method may also include receiving, at the transceiver module, a payment success message from the payment processing module upon successful payment of the product, and displaying, using the display module, an indication of the payment success in conjunction with the augmented reality visual content upon receipt of the payment success message.
- a product release message may be transmitted by the transceiver module to an inventory management system that is in communication with the augmented reality device upon receipt of the payment success message.
- the method may include a setup step (not shown in FIG. 2 ) which involves the user pairing his user device (having a digital wallet application) with the augmented reality device, e.g. via Bluetooth (BLE) connection.
- the setup step may be performed once and does not need to be repeated for every purchase of products.
- FIG. 3 shows a schematic diagram of a computer device/system 300 suitable for use in executing at least some steps of the method for product purchase facilitation or for realizing at least a part of the augmented reality device.
- the following description of the computing device 300 is provided by way of example only and is not intended to be limiting.
- the example computing device 300 includes a processor 304 for executing software routines. Although a single processor is shown for the sake of clarity, the computing device 300 may also include a multi-processor system.
- the processor 304 is connected to a communication infrastructure 306 for communication with other components of the computing device 300 .
- the communication infrastructure 306 may include, for example, a communications bus, cross-bar, or network.
- the computing device 300 further includes a main memory 308 , such as a random access memory (RAM), and a secondary memory 310 .
- the secondary memory 310 may include, for example, a hard disk drive 312 and/or a removable storage drive 314 , which may include a magnetic tape drive, an optical disk drive, or the like.
- the removable storage drive 314 reads from and/or writes to a removable storage unit 318 in a well-known manner.
- the removable storage unit 318 may include a magnetic tape, optical disk, or the like, which is read by and written to by removable storage drive 314 .
- the removable storage unit 318 includes a computer readable storage medium having stored therein computer executable program code instructions and/or data.
- the secondary memory 310 may additionally or alternatively include other similar means for allowing computer programs or other instructions to be loaded into the computing device 300 .
- Such means can include, for example, a removable storage unit 322 and an interface 320 .
- a removable storage unit 322 and interface 320 include a removable memory chip (such as an EPROM or PROM) and associated socket, and other removable storage units 322 and interfaces 320 which allow software and data to be transferred from the removable storage unit 322 to the computer system 300 .
- the computing device 300 also includes at least one communication interface 324 .
- the communication interface 324 allows software and data to be transferred between computing device 300 and external devices via a communication path 326 .
- the communication interface 324 permits data to be transferred between the computing device 300 and a data communication network, such as a public data or private data communication network.
- the communication interface 324 may be used to exchange data between different computing devices 300 which such computing devices 300 form part an interconnected computer network. Examples of a communication interface 324 can include a modem, a network interface (such as an Ethernet card), a communication port, an antenna with associated circuitry and the like.
- the communication interface 324 may be wired or may be wireless.
- Software and data transferred via the communication interface 324 are in the form of signals which can be electronic, electromagnetic, optical, or other signals capable of being received by communication interface 324 . These signals are provided to the communication interface via the communication path 326 .
- the computing device 300 further includes a display interface 302 which performs operations for rendering images to an associated display 330 and an audio interface 332 for performing operations for playing audio content via associated speaker(s) 334 .
- Computer program product may refer, in part, to removable storage unit 318 , removable storage unit 322 , a hard disk installed in hard disk drive 312 , or a carrier wave carrying software over communication path 326 (wireless link or cable) to communication interface 324 .
- Computer readable storage media refers to any non-transitory tangible storage medium that provides recorded instructions and/or data to the computing device 300 for execution and/or processing.
- Examples of such storage media include floppy disks, magnetic tape, CD-ROM, DVD, Blu-rayTM Disc, a hard disk drive, a ROM or integrated circuit, USB memory, a magneto-optical disk, or a computer readable card such as a PCMCIA card and the like, whether or not such devices are internal or external of the computing device 300 .
- Examples of transitory or non-tangible computer readable transmission media that may also participate in the provision of software, application programs, instructions and/or data to the computing device 300 include radio or infra-red transmission channels as well as a network connection to another computer or networked device, and the Internet or Intranets including e-mail transmissions and information recorded on Websites and the like.
- the computer programs are stored in main memory 308 and/or secondary memory 310 . Computer programs can also be received via the communication interface 324 . Such computer programs, when executed, enable the computing device 300 to perform one or more features of embodiments discussed herein. In various embodiments, the computer programs, when executed, enable the processor 304 to perform features of the above-described embodiments. Accordingly, such computer programs represent controllers of the computer system 300 .
- Software may be stored in a computer program product and loaded into the computing device 300 using the removable storage drive 314 , the hard disk drive 312 , or the interface 320 .
- the computer program product may be downloaded to the computer system 300 over the communications path 326 .
- the software when executed by the processor 304 , causes the computing device 300 to perform functions of embodiments described herein.
- FIG. 3 is presented merely by way of example. Therefore, in some embodiments one or more features of the computing device 300 may be omitted. Also, in some embodiments, one or more features of the computing device 300 may be combined together. Additionally, in some embodiments, one or more features of the computing device 300 may be split into one or more component parts.
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Accounting & Taxation (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- Computer Security & Cryptography (AREA)
- General Business, Economics & Management (AREA)
- Development Economics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Economics (AREA)
- Marketing (AREA)
- Software Systems (AREA)
- General Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- Biomedical Technology (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Entrepreneurship & Innovation (AREA)
- Game Theory and Decision Science (AREA)
- Health & Medical Sciences (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- User Interface Of Digital Computer (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
- This patent application claims priority to Singapore Application No. 10201608646S filed on Oct. 14, 2016, the disclosure of which is incorporated by reference herein in its entirety as part of the present application.
- The present disclosure relates broadly, but not exclusively, to an augmented reality device and a method for product purchase facilitation using an augmented reality device.
- Augmented reality (AR) is a live direct or indirect view of a physical, real-world environment whose elements are augmented (or supplemented) by computer-generated sensory input such as sound, video, graphics, or GPS data. Augmentation is conventionally in real-time and in semantic context with environmental elements, such as sports scores on TV during a match. In other words, information about the environment and its objects is overlaid on the real world. Using advanced AR technology (e.g. adding computer vision and object recognition) information about the surrounding real world of the user can become interactive.
- Currently, when consumers wish to purchase an article of clothing (jeans, shirt, shoes, etc.) they may try on the article (e.g. in an apparel merchant's fitting room) to see if the article fits and how it looks on the consumer. However, the queue at fitting rooms can be quite long especially during peak periods. Long waiting times at fitting rooms may discourage some consumers from purchasing products as they are not willing to queue up, potentially resulting in less revenue for merchants.
- Currently, users may provide a non-confidential user identifier (e.g. a user ID) and a confidential personal identification number (PIN) to gain access to a system. In this way, the PIN is used to authenticate the user to the system. Upon receiving the user ID and PIN, the system retrieves a registered PIN (that is stored in the system) based on the user ID and compares the registered PIN with the received PIN. The user is granted access only if the received PIN matches the registered PIN number. PINs may be used at point of sale (POS) terminals for authenticating a cardholder during electronic payment transactions involving payment cards such as debit cards and credit cards. However, this method of authentication requires that the user remembers his PIN. If the user forgets his PIN, he would not be able to complete the transaction.
- A need therefore exists to provide an augmented reality device and a method for product purchase facilitation using an augmented reality device that seek to address at least some of the above problems.
- A first aspect of the present disclosure provides an augmented reality device for facilitating product purchase, including a display module configured to provide augmented reality visual content, the augmented reality visual content including a virtual image of a product, a biometric authentication module configured to receive biometric data relating to a user and authenticate the user based on the received biometric data, and a transceiver module configured to receive, from a user device, digital payment credentials for facilitating purchase of the product, and transmit the digital payment credentials to a payment processing module for product purchase upon successful authentication of the user.
- The augmented reality device may further include a product identification module configured to determine product information relating to the product based on data encoded on a tag that is attached to the product. The transceiver module may be further configured to transmit at least a portion of the determined product information to the payment processing module for facilitating purchase of the product upon successful authentication of the user.
- The product information may include a description and a price of the product, and the price of the product is transmitted to the payment processing module.
- The display module may be further configured to display the description and the price of the product in conjunction with the augmented reality visual content.
- The transceiver module may be further configured to receive a payment success message from the payment processing module upon successful payment of the product, and the display module may be further configured to display an indication of the payment success in conjunction with the augmented reality visual content upon receipt of the payment success message.
- The biometric authentication module may be in communication with a biometric authentication directory server, and the received biometric data relating to the user is compared to reference biometric data stored in the biometric authentication directory server for authenticating the user.
- The augmented reality device may be in communication with an inventory management system, and the transceiver module may be further configured to transmit a product release message to the inventory management system for release of the product upon receipt of the payment success message.
- The augmented reality device may further include an input module configured to receive a purchase instruction from the user device to purchase the product, and the biometric authentication module may be configured to initiate authentication of the user upon receipt of the purchase instruction.
- The input module may be further configured to obtain an image of the user, and the augmented reality visual content provided by the display module may include the image of the user in juxtaposition with the virtual image of a product.
- The biometric data may include one or more of iris data, fingerprint data, voice data, and facial feature data.
- A second aspect of the present disclosure provides a method for product purchase facilitation using an augmented reality device, the augmented reality device including a display module, a biometric authentication module, and a transceiver module, the method including the steps of: providing augmented reality visual content including a virtual image of a product using the display module, receiving biometric data relating to a user at the biometric authentication module, authenticating the user based on the received biometric data using the biometric authentication module, and receiving, at the transceiver module, digital payment credentials from a user device for facilitating purchase of the product, and transmitting the digital payment credentials from the transceiver module to a payment processing module for product purchase upon successful authentication of the user by the biometric authentication module.
- The augmented reality device may further include a product identification module, and the method may further include determining, using the product identification module, product information relating to the product based on data encoded on a tag that is attached to the product, and transmitting, using the transceiver module, at least a portion of the determined product information to the payment processing module for facilitating purchase of the product upon successful authentication of the user.
- The product information may include a description and a price of the product, and the price of the product is transmitted to the payment processing module.
- The method may further include displaying, using the display module, the description and the price of the product in conjunction with the augmented reality visual content.
- The method may further include receiving, at the transceiver module, a payment success message from the payment processing module upon successful payment of the product, and displaying, using the display module, an indication of the payment success in conjunction with the augmented reality visual content upon receipt of the payment success message.
- The method may further include comparing the received biometric data relating to the user to reference biometric data stored in a biometric authentication directory server that is in communication with the biometric authentication module.
- The method may further include transmitting, using the transceiver module, a product release message to an inventory management system that is in communication with the augmented reality device upon receipt of the payment success message.
- The augmented reality device may further include an input module, and wherein the method may further include receiving, at the input module, a purchase instruction from the user device to purchase the product, and initiating authentication of the user by the biometric authentication module upon receipt of the purchase instruction.
- The method may further include obtaining an image of the user using the input module, and displaying, using the display module, the augmented reality visual content including the image of the user in juxtaposition with the virtual image of a product.
- Embodiments and implementations are provided by way of example only, and will be better understood and readily apparent to one of ordinary skill in the art from the following written description, read in conjunction with the drawings, in which:
-
FIG. 1 is a schematic of an augmented reality device for facilitating purchase of a product according to an example embodiment; -
FIG. 2 is a flowchart illustrating a method for product purchase facilitation using an augmented reality device, according to an example embodiment; and -
FIG. 3 shows a schematic diagram of a computer system suitable for use in executing at least some steps of the method for product purchase facilitation or for realizing at least a part of the augmented reality device. - Embodiments will be described, by way of example only, with reference to the drawings. Like reference numerals and characters in the drawings refer to like elements or equivalents.
- Some portions of the description which follows are explicitly or implicitly presented in terms of algorithms and functional or symbolic representations of operations on data within a computer memory. These algorithmic descriptions and functional or symbolic representations are the means used by those skilled in the data processing arts to convey most effectively the substance of their work to others skilled in the art. An algorithm is here, and generally, conceived to be a self-consistent sequence of steps leading to a desired result. The steps are those requiring physical manipulations of physical quantities, such as electrical, magnetic, or optical signals capable of being stored, transferred, combined, compared, and otherwise manipulated.
- Unless specifically stated otherwise, and as apparent from the following, it will be appreciated that throughout the present disclosure, discussions utilizing terms such as “receiving”, “scanning”, “calculating”, “determining”, “replacing”, “generating”, “initializing”, “outputting”, or the like, refer to the action and processes of a computer system, or similar electronic device, that manipulates and transforms data represented as physical quantities within the computer system into other data similarly represented as physical quantities within the computer system or other information storage, transmission, or display devices.
- The present disclosure also provides apparatus for performing the operations of the methods. Such apparatus may be specially constructed for the required purposes, or may include a computer or other device selectively activated or reconfigured by a computer program stored in the computer. The algorithms and displays presented herein are not inherently related to any particular computer or other apparatus. Various machines may be used with programs in accordance with the teachings herein. Alternatively, the construction of more specialized apparatus to perform the required method steps may be appropriate. The structure of a computer suitable for executing the various methods/processes described herein will appear from the description below.
- In addition, the present disclosure also implicitly provides a computer program, in that it would be apparent to the person skilled in the art that the individual steps of the method described herein may be put into effect by computer code. The computer program is not intended to be limited to any particular programming language and implementation thereof. It will be appreciated that a variety of programming languages and coding thereof may be used to implement the teachings of the disclosure contained herein. Moreover, the computer program is not intended to be limited to any particular control flow. There are many other variants of the computer program, which can use different control flows without departing from the spirit or scope of the disclosure.
- Furthermore, one or more of the steps of the computer program may be performed in parallel rather than sequentially. Such a computer program may be stored on any computer readable medium. The computer readable medium may include storage devices such as magnetic or optical disks, memory chips, or other storage devices suitable for interfacing with a computer. The computer readable medium may also include a hard-wired medium such as exemplified in the Internet system, or wireless medium such as exemplified in the GSM mobile telephone system. The computer program when loaded and executed on such a computer effectively results in an apparatus that implements the steps of the method.
-
FIG. 1 is a schematic of anaugmented reality device 100 for facilitating purchase of a product, according to an embodiment. Where the context permits, singular (e.g. “product”) or plural terms may also include the plural (e.g. “products”) or singular term, respectively. Theaugmented reality device 100 includes adisplay module 102 that is configured to provide augmented reality visual content. The augmented reality visual content includes a virtual image of a product. For example, if the product is a shirt, the augmented reality visual content includes a virtual image of the shirt having substantially similar attributes (e.g. color, shape, size, etc.) as the actual product. In the following description, the term “module” (e.g. display module, biometric authentication module, etc.) can refer to software, a hardware element, or a combination of both. - The
display module 102 may include a display screen with a reflective surface so that a user who is positioned in front of the reflective surface may be able to see an image of himself/herself in juxtaposition with the virtual image of a product, may be in real-time and in semantic context. In other words, if the product is a shirt, the virtual image of the shirt is superimposed on the user's torso, and if the product is a hat, the virtual image of the hat is superimposed on top of the user's head. Instead of a reflective surface, an image capturing module may be used to capture an image of the user and the captured image (or a part thereof) is displayed on the display screen in conjunction with the virtual image of a product. Thedisplay module 102 may include an augmented reality processor (not shown inFIG. 1 ) that can generate the virtual images in juxtaposition with the image of the user may be in real-time and in semantic context. - The
augmented reality device 100 further includes abiometric authentication module 104 configured to receive biometric data relating to a user. The biometric data may include one or more of iris data, fingerprint data, voice data, and facial feature data relating to the user. For example, thebiometric authentication module 104 may include a biometric data such a fingerprint scanner for receiving the biometric data relating to the user. Thebiometric authentication module 104 is further configured to authenticate the user based on the received biometric data. - The
biometric authentication module 104 may be in communication with a biometricauthentication directory server 114. The biometricauthentication directory server 114 may include a database with reference or template biometric data enrolled therein. Thebiometric authentication module 104 can authenticate the user based on the received biometric data by comparing the received biometric data relating to a user with the enrolled reference or template biometric data of the user. As shown inFIG. 1 , the biometricauthentication directory server 114 is an external module (i.e. not part of) the augmentedreality device 100 and may be administered by a financial institution or payment network. However, the biometricauthentication directory server 114 may be an internal module (i.e. part of/integrated within) the augmentedreality device 100. - The
augmented reality device 100 further includes atransceiver module 106 that is configured to receive digital payment credentials from auser device 108 for facilitating purchase of the product. Theuser device 108 may be a mobile device (e.g. smartphone or tablet computer) having installed therein a mobile (digital) wallet application. The mobile wallet application may be loaded with one or more payment cards, and is capable of securely administering the digital payment credentials of each payment card. Thetransceiver module 106 is further configured to transmit the digital payment credentials to apayment processing module 110 for product purchase upon successful authentication of the user by thebiometric authentication module 104. - In an implementation, the
augmented reality device 100 may further include aproduct identification module 112 configured to determine product information relating to the product based on data encoded on a tag that is attached to the product. The product information includes, but is not limited to, a description and a price of the product. For example, the tag may be a radio-frequency identification (RFID) tag that is attached to the product. Theproduct identification module 112 may include a RFID scanner that is capable of reading the product information encoded on the RFID tag. - The
transceiver module 106 may be further configured to transmit at least a portion of the determined product information (e.g. the price of the product) to thepayment processing module 110 for facilitating purchase of the product upon successful authentication of the user by thebiometric authentication module 104. For instance, with the price of the product, thepayment processing module 110 can generate an instruction to debit the corresponding amount from the user's account. - In addition to the providing the augmented reality visual content, the
display module 102 may be further configured to display the description and/or the price of the product in conjunction with the augmented reality visual content. Continuing from the example above, the display screen of thedisplay module 102 can display the description and/or the price of the shirt in conjunction with the virtual image of the shirt that is superimposed on the user's torso. - In an implementation, the
transceiver module 106 is further configured to receive a payment success message from thepayment processing module 110 upon successful payment of the product. Thedisplay module 102 is further configured to display an indication of the payment success in conjunction with the augmented reality visual content upon receipt of the payment success message. Continuing from the example above, the display screen of thedisplay module 102 can display the payment success message (e.g. “Payment Successful”) in conjunction with the virtual image of the shirt that is superimposed on the user's torso. Thepayment processing module 110 can be configured to process transactions as known in the art, which includes handling and/or generating messages between acquiring banks, card scheme networks, and issuing banks. - In an implementation, the
augmented reality device 100 is in communication with aninventory management system 116, and thetransceiver module 106 is further configured to transmit a product release message to theinventory management system 116 for release of the product upon receipt of the payment success message. In this context, release of a product includes handing over the product to the user (at a physical store) and delivering the product to the user (for an online store). After releasing a product, theinventory management system 116 can update a product inventory so that stock can be monitored and replenished if necessary. - In an implementation, the
augmented reality device 100 further includes aninput module 118 configured to receive a purchase instruction from theuser device 108 to purchase the product. Thebiometric authentication module 100 can be further configured to initiate authentication of the user upon receipt of the purchase instruction. In other words, the purchase instruction from the user acts as a trigger for authentication of the user. - The
input module 118 may be further configured to obtain an image of the user. For example, theinput module 118 may have an image capturing module as described above. Thedisplay module 102 can display the augmented reality visual content that includes the obtained image of the user (or a part thereof) in juxtaposition with the virtual image of a product. - The
augmented reality device 100 may be placed in a merchant's store. Specifically, theaugmented reality device 100 may replace a conventional mirror that is placed in a fitting room and placed in the open since a private enclosure is no longer required for customers to undress and try on articles of clothing. In other words, customers can utilize theaugmented reality device 100 to try on articles of clothing in public as a virtual image of the article of clothing is provided in juxtaposition with an image of the user on a reflective surface (mirror) or display screen as described above. This advantageously minimizes waiting times at conventional fitting rooms. Furthermore, waiting times at conventional cashiers can also be minimized as payment can be done at theaugmented reality device 100 based on biometric authentication of the cardholder. Purchased items can be collected at a separate counter or delivered directly to a consumer's home. Theaugmented reality device 100 may be configured to allow the user to select multiple products to try on sequentially or simultaneously, and the user can select which virtual item(s) to be displayed in juxtaposition with the image of the user. - Besides implementations for on-site retail shopping, embodiments may also be implemented for off-site retail shopping. For instance, the embodiments described above can be used for mobile shopping (where a consumer has an augmented reality enabled smartphone that can provide, among other things, an image of the user in juxtaposition with a virtual image of a product) and smart television shopping (where a consumer has an augmented reality enabled television that can provide, among other things, an image of the user in juxtaposition with a virtual image of a product). Embodiments may also be implemented for in-game shopping (where users are able to purchase in-game items when playing games using an augmented reality enabled game console). Embodiments described above can also be used in vehicles where an augmented reality enabled rear-view mirror can be used to make purchases when a car is stationary (e.g. paying for petrol at a petrol station and the value of the petrol is displayed on the mirror).
-
FIG. 2 is aflowchart 200 illustrating a method for product purchase facilitation using an augmented reality device, according to an example embodiment. The augmented reality device includes a display module, a biometric authentication module, and a transceiver module, substantially as described above. Step 202 involves providing augmented reality visual content including a virtual image of a product using the display module. Step 204 involves receiving biometric data relating to a user at the biometric authentication module. - At
step 206, the user is authenticated based on the received biometric data (at step 204) using the biometric authentication module. For example, the received biometric data relating to the user is compared to reference biometric data stored in a biometric authentication directory server that is in communication with the biometric authentication module. The augmented reality device may include an input module and the method may further include receiving, at the input module, a purchase instruction from the user device to purchase the product, and initiating authentication of the user (i.e. step 206) by the biometric authentication module upon receipt of the purchase instruction. - The method may further include obtaining an image of the user using the input module, and displaying, using the display module, the augmented reality visual content including the image of the user in juxtaposition with the virtual image of a product.
- At
step 208, digital payment credentials for facilitating purchase of the product are received at the transceiver module from a user device (e.g. a smartphone or tablet computer having installed therein a mobile (digital) wallet application). Atstep 210, the digital payment credentials received atstep 208 are transmitted from the transceiver module to a payment processing module for product purchase upon successful authentication of the user by the biometric authentication module. - The augmented reality device may further include a product identification module and the method may further include determining, using the product identification module, product information relating to the product based on data encoded on a tag that is attached to the product. The product information includes a description and a price of the product. The method may also include transmitting, using the transceiver module, at least a portion of the determined product information (e.g. the price of the product) to the payment processing module for facilitating purchase of the product upon successful authentication of the user. The method may further include displaying, using the display module, the description and the price of the product in conjunction with the augmented reality visual content.
- The method may also include receiving, at the transceiver module, a payment success message from the payment processing module upon successful payment of the product, and displaying, using the display module, an indication of the payment success in conjunction with the augmented reality visual content upon receipt of the payment success message. Further, a product release message may be transmitted by the transceiver module to an inventory management system that is in communication with the augmented reality device upon receipt of the payment success message.
- Prior to step 204 and potentially prior to step 202, the method may include a setup step (not shown in
FIG. 2 ) which involves the user pairing his user device (having a digital wallet application) with the augmented reality device, e.g. via Bluetooth (BLE) connection. The setup step may be performed once and does not need to be repeated for every purchase of products. -
FIG. 3 shows a schematic diagram of a computer device/system 300 suitable for use in executing at least some steps of the method for product purchase facilitation or for realizing at least a part of the augmented reality device. The following description of thecomputing device 300 is provided by way of example only and is not intended to be limiting. - As shown in
FIG. 3 , theexample computing device 300 includes aprocessor 304 for executing software routines. Although a single processor is shown for the sake of clarity, thecomputing device 300 may also include a multi-processor system. Theprocessor 304 is connected to acommunication infrastructure 306 for communication with other components of thecomputing device 300. Thecommunication infrastructure 306 may include, for example, a communications bus, cross-bar, or network. - The
computing device 300 further includes amain memory 308, such as a random access memory (RAM), and asecondary memory 310. Thesecondary memory 310 may include, for example, ahard disk drive 312 and/or aremovable storage drive 314, which may include a magnetic tape drive, an optical disk drive, or the like. Theremovable storage drive 314 reads from and/or writes to aremovable storage unit 318 in a well-known manner. Theremovable storage unit 318 may include a magnetic tape, optical disk, or the like, which is read by and written to byremovable storage drive 314. As will be appreciated by persons skilled in the relevant art(s), theremovable storage unit 318 includes a computer readable storage medium having stored therein computer executable program code instructions and/or data. - In an alternative implementation, the
secondary memory 310 may additionally or alternatively include other similar means for allowing computer programs or other instructions to be loaded into thecomputing device 300. Such means can include, for example, aremovable storage unit 322 and aninterface 320. Examples of aremovable storage unit 322 andinterface 320 include a removable memory chip (such as an EPROM or PROM) and associated socket, and otherremovable storage units 322 andinterfaces 320 which allow software and data to be transferred from theremovable storage unit 322 to thecomputer system 300. - The
computing device 300 also includes at least onecommunication interface 324. Thecommunication interface 324 allows software and data to be transferred betweencomputing device 300 and external devices via acommunication path 326. In various embodiments of the disclosure, thecommunication interface 324 permits data to be transferred between thecomputing device 300 and a data communication network, such as a public data or private data communication network. Thecommunication interface 324 may be used to exchange data betweendifferent computing devices 300 whichsuch computing devices 300 form part an interconnected computer network. Examples of acommunication interface 324 can include a modem, a network interface (such as an Ethernet card), a communication port, an antenna with associated circuitry and the like. Thecommunication interface 324 may be wired or may be wireless. Software and data transferred via thecommunication interface 324 are in the form of signals which can be electronic, electromagnetic, optical, or other signals capable of being received bycommunication interface 324. These signals are provided to the communication interface via thecommunication path 326. - As shown in
FIG. 3 , thecomputing device 300 further includes adisplay interface 302 which performs operations for rendering images to an associateddisplay 330 and anaudio interface 332 for performing operations for playing audio content via associated speaker(s) 334. - As used herein, the term “computer program product” may refer, in part, to
removable storage unit 318,removable storage unit 322, a hard disk installed inhard disk drive 312, or a carrier wave carrying software over communication path 326 (wireless link or cable) tocommunication interface 324. Computer readable storage media refers to any non-transitory tangible storage medium that provides recorded instructions and/or data to thecomputing device 300 for execution and/or processing. Examples of such storage media include floppy disks, magnetic tape, CD-ROM, DVD, Blu-ray™ Disc, a hard disk drive, a ROM or integrated circuit, USB memory, a magneto-optical disk, or a computer readable card such as a PCMCIA card and the like, whether or not such devices are internal or external of thecomputing device 300. Examples of transitory or non-tangible computer readable transmission media that may also participate in the provision of software, application programs, instructions and/or data to thecomputing device 300 include radio or infra-red transmission channels as well as a network connection to another computer or networked device, and the Internet or Intranets including e-mail transmissions and information recorded on Websites and the like. - The computer programs (also called computer program code) are stored in
main memory 308 and/orsecondary memory 310. Computer programs can also be received via thecommunication interface 324. Such computer programs, when executed, enable thecomputing device 300 to perform one or more features of embodiments discussed herein. In various embodiments, the computer programs, when executed, enable theprocessor 304 to perform features of the above-described embodiments. Accordingly, such computer programs represent controllers of thecomputer system 300. - Software may be stored in a computer program product and loaded into the
computing device 300 using theremovable storage drive 314, thehard disk drive 312, or theinterface 320. Alternatively, the computer program product may be downloaded to thecomputer system 300 over thecommunications path 326. The software, when executed by theprocessor 304, causes thecomputing device 300 to perform functions of embodiments described herein. - It is to be understood that the embodiment of
FIG. 3 is presented merely by way of example. Therefore, in some embodiments one or more features of thecomputing device 300 may be omitted. Also, in some embodiments, one or more features of thecomputing device 300 may be combined together. Additionally, in some embodiments, one or more features of thecomputing device 300 may be split into one or more component parts. - It will be appreciated by a person skilled in the art that numerous variations and/or modifications may be made to the present disclosure as shown in the specific embodiments without departing from the spirit or scope of the disclosure as broadly described. The present embodiments are, therefore, to be considered in all respects to be illustrative and not restrictive.
Claims (20)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
SG10201608646SA SG10201608646SA (en) | 2016-10-14 | 2016-10-14 | Augmented Reality Device and Method For Product Purchase Facilitation |
SG10201608646S | 2016-10-14 |
Publications (3)
Publication Number | Publication Date |
---|---|
US20180108080A1 US20180108080A1 (en) | 2018-04-19 |
US20180315115A9 true US20180315115A9 (en) | 2018-11-01 |
US11068968B2 US11068968B2 (en) | 2021-07-20 |
Family
ID=61901836
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/730,556 Active 2039-06-12 US11068968B2 (en) | 2016-10-14 | 2017-10-11 | Augmented reality device and method for product purchase facilitation |
Country Status (2)
Country | Link |
---|---|
US (1) | US11068968B2 (en) |
SG (1) | SG10201608646SA (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11037116B2 (en) * | 2017-12-29 | 2021-06-15 | Paypal, Inc. | Payment transactions using an augmented reality device |
US11282066B1 (en) * | 2019-01-18 | 2022-03-22 | Worldpay, Llc | Systems and methods to provide user verification in a shared user environment via a device-specific display |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200366670A1 (en) * | 2017-09-12 | 2020-11-19 | Peter Alexander Cordiner | A system and method for authenticating a user |
US20220134209A1 (en) * | 2020-11-02 | 2022-05-05 | Etone Motion Analysis Gmbh | Fitness Device With a Stand |
US20220188833A1 (en) * | 2020-12-12 | 2022-06-16 | Mastercard International Incorporated | Facilitating payments in an extended reality system based on behavioral biometrics |
Family Cites Families (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9153074B2 (en) | 2011-07-18 | 2015-10-06 | Dylan T X Zhou | Wearable augmented reality eyeglass communication device including mobile phone and mobile computing via virtual touch screen gesture control and neuron command |
US20080071559A1 (en) | 2006-09-19 | 2008-03-20 | Juha Arrasvuori | Augmented reality assisted shopping |
US8626611B2 (en) | 2008-01-11 | 2014-01-07 | Ncr Corporation | Method and apparatus for augmented reality shopping assistant |
US20150309316A1 (en) * | 2011-04-06 | 2015-10-29 | Microsoft Technology Licensing, Llc | Ar glasses with predictive control of external device based on event input |
US8866847B2 (en) | 2010-09-14 | 2014-10-21 | International Business Machines Corporation | Providing augmented reality information |
US10127606B2 (en) * | 2010-10-13 | 2018-11-13 | Ebay Inc. | Augmented reality system and method for visualizing an item |
US9224166B2 (en) | 2011-03-08 | 2015-12-29 | Bank Of America Corporation | Retrieving product information from embedded sensors via mobile device video analysis |
CN103843024A (en) * | 2012-01-05 | 2014-06-04 | 维萨国际服务协会 | Transaction visual capturing apparatuses, methods and systems |
US8606645B1 (en) | 2012-02-02 | 2013-12-10 | SeeMore Interactive, Inc. | Method, medium, and system for an augmented reality retail application |
US20130293530A1 (en) | 2012-05-04 | 2013-11-07 | Kathryn Stone Perez | Product augmentation and advertising in see through displays |
US9449343B2 (en) | 2012-10-05 | 2016-09-20 | Sap Se | Augmented-reality shopping using a networked mobile device |
US20140214547A1 (en) | 2013-01-25 | 2014-07-31 | R4 Technologies, Llc | Systems and methods for augmented retail reality |
US20140214600A1 (en) | 2013-01-31 | 2014-07-31 | Wal-Mart Stores, Inc. | Assisting A Consumer In Locating A Product Within A Retail Store |
US10223755B2 (en) | 2013-04-12 | 2019-03-05 | At&T Intellectual Property I, L.P. | Augmented reality retail system |
US10430985B2 (en) | 2014-03-14 | 2019-10-01 | Magic Leap, Inc. | Augmented reality systems and methods utilizing reflections |
US9477852B1 (en) | 2014-07-24 | 2016-10-25 | Wells Fargo Bank, N.A. | Augmented reality numberless transaction card |
WO2016105591A1 (en) * | 2014-12-22 | 2016-06-30 | University Of South Florida | Systems and methods for authentication using multiple devices |
US20160189134A1 (en) * | 2014-12-31 | 2016-06-30 | Ebay Inc. | Collaborating user devices for security |
US10122719B1 (en) * | 2015-12-31 | 2018-11-06 | Wells Fargo Bank, N.A. | Wearable device-based user authentication |
US9460557B1 (en) * | 2016-03-07 | 2016-10-04 | Bao Tran | Systems and methods for footwear fitting |
US10545343B2 (en) * | 2016-05-27 | 2020-01-28 | Assa Abloy Ab | Augmented reality security verification |
US10052026B1 (en) * | 2017-03-06 | 2018-08-21 | Bao Tran | Smart mirror |
-
2016
- 2016-10-14 SG SG10201608646SA patent/SG10201608646SA/en unknown
-
2017
- 2017-10-11 US US15/730,556 patent/US11068968B2/en active Active
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11037116B2 (en) * | 2017-12-29 | 2021-06-15 | Paypal, Inc. | Payment transactions using an augmented reality device |
US11816648B2 (en) | 2017-12-29 | 2023-11-14 | Paypal, Inc. | Payment transactions using an augmented reality device |
US11282066B1 (en) * | 2019-01-18 | 2022-03-22 | Worldpay, Llc | Systems and methods to provide user verification in a shared user environment via a device-specific display |
US20220129882A1 (en) * | 2019-01-18 | 2022-04-28 | Worldpay, Llc | Systems and methods to provide user verification in a shared user environment via a device-specific display |
US11699144B2 (en) * | 2019-01-18 | 2023-07-11 | Worldpay, Llc | Systems and methods to provide user verification in a shared user environment via a device-specific display |
US20230297999A1 (en) * | 2019-01-18 | 2023-09-21 | Worldpay, Llc | Systems and methods to provide user verification in a shared user environment via a device-specific display |
Also Published As
Publication number | Publication date |
---|---|
US11068968B2 (en) | 2021-07-20 |
SG10201608646SA (en) | 2018-05-30 |
US20180108080A1 (en) | 2018-04-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11068968B2 (en) | Augmented reality device and method for product purchase facilitation | |
US9710804B2 (en) | Virtual payment cards issued by banks for mobile and wearable devices | |
US10268810B2 (en) | Methods, apparatus and systems for securely authenticating a person depending on context | |
US10706136B2 (en) | Authentication-activated augmented reality display device | |
US20170243225A1 (en) | Systems and methods for using multi-party computation for biometric authentication | |
US20170039566A1 (en) | Method and system for secured processing of a credit card | |
US10832312B2 (en) | Systems and methods for facilitating a transaction relating to newly identified items using augmented reality | |
US20190199965A1 (en) | Server and method enabling augmented reality (ar) object sharing | |
US11257055B2 (en) | Mobile payment systems and methods for vending machines | |
US20170046671A1 (en) | Online mobile payment system and method using a qr code | |
US20190370549A1 (en) | Augmented and virtual reality operations system | |
CN108701311A (en) | Method and system for the certification mobile device based on browser and user | |
WO2018083663A1 (en) | Virtual payment cards issued by banks for mobile and wearable devices | |
US11379806B2 (en) | Virtual reality transaction integration | |
US10417636B2 (en) | Payment vehicle with encrypted image | |
KR101635396B1 (en) | Electronic commerce method | |
TWI661365B (en) | System and method for dynamically checking code scanning payment, computer-readable recording medium and computer program product | |
US20190251539A1 (en) | System and method for conducting a transanction | |
JP2019139758A (en) | System and method for conducting transaction | |
US20180101838A1 (en) | Method and System for Facilitating Mobile Payment for Products | |
KR20230158169A (en) | Method and non-transitory computer-readable recording medium for paying remotely through complex authentication | |
KR20170018767A (en) | Electronic commerce method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MASTERCARD ASIA/PACIFIC PTE. LTD., SINGAPORE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LIN, ERIC JIAN HUI;GILBEY, BENJAMIN CHARLES;KUOH, VERONICA;REEL/FRAME:043842/0313 Effective date: 20161024 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
FEPP | Fee payment procedure |
Free format text: PETITION RELATED TO MAINTENANCE FEES GRANTED (ORIGINAL EVENT CODE: PTGR); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |