WO2023175707A1 - Information processing device, information processing system, information processing method, and non-transitory computer-readable medium - Google Patents

Information processing device, information processing system, information processing method, and non-transitory computer-readable medium Download PDF

Info

Publication number
WO2023175707A1
WO2023175707A1 PCT/JP2022/011520 JP2022011520W WO2023175707A1 WO 2023175707 A1 WO2023175707 A1 WO 2023175707A1 JP 2022011520 W JP2022011520 W JP 2022011520W WO 2023175707 A1 WO2023175707 A1 WO 2023175707A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
information
store
biometric
terminal
Prior art date
Application number
PCT/JP2022/011520
Other languages
French (fr)
Japanese (ja)
Inventor
太一 奥村
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Priority to PCT/JP2022/011520 priority Critical patent/WO2023175707A1/en
Publication of WO2023175707A1 publication Critical patent/WO2023175707A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/12Hotels or restaurants

Definitions

  • the present disclosure relates to an information processing device, an information processing system, an information processing method, and a non-transitory computer-readable medium.
  • Patent Document 1 discloses a method of displaying store individual menu information generated based on the order history of users who have visited the store on a matching app, and accepting orders for food and drink via the matching app.
  • the server that receives the order information displays the order information on the store terminal and notifies the store staff of the start of cooking.
  • Patent Document 1 assumes user operations when visiting the store, and is therefore insufficient in terms of saving the effort of ordering when visiting the store.
  • an object of the present disclosure is to provide an information processing device, an information processing system, an information processing method, and a non-temporary computer-readable medium that can suitably save the trouble of ordering when visiting a store. be.
  • the information processing apparatus When the information processing apparatus according to one aspect of the present disclosure receives provisional order information including at least item information for specifying items related to the provisional order from a user terminal used by a user, the information processing apparatus transmits the provisional order information to the a registration means for registering in association with biometric information of a user; an authentication control means for controlling biometric authentication when biometric information of a user who visited a store is received; and, when the biometric authentication is successful, the biometric information of the user. and transmitting control means for transmitting the temporary order information associated with the temporary order information to a terminal of the store visited by the user.
  • An information processing system includes a biometric authentication device that performs biometric authentication and a server.
  • the server receives provisional order information that includes at least item information for identifying items related to the provisional order from a user terminal used by the user, the server registers the provisional order information in association with the user's biometric information.
  • an authentication control means for transmitting the biometric information to the biometric authentication device and receiving the biometric authentication result from the biometric authentication device when biometric information of a user who visited a store is received; and transmission control means for transmitting the provisional order information associated with the biometric information of the user to a terminal in the store if authentication is successful.
  • An information processing method is, when provisional order information including at least item information for specifying an item related to a provisional order is received from a user terminal used by a user, the provisional order information is When the biometric information of the user who visited the store is registered and registered in association with the biometric information of the user, the biometric authentication is controlled, and if the biometric authentication is successful, the provisional order associated with the biometric information of the user The information is transmitted to the terminal at the store.
  • the non-transitory computer-readable medium When the non-transitory computer-readable medium according to one aspect of the present disclosure receives provisional order information including at least item information for identifying items related to the provisional order from a user terminal used by a user, the non-transitory computer-readable medium a registration function that registers information in association with the biometric information of the user; an authentication control function that controls biometric authentication when biometric information of a user who visited a store is received; and a registration function that controls biometric authentication when the biometric authentication is successful; A program for causing a computer to implement a transmission control function of transmitting the provisional order information associated with the biometric information to the store terminal is stored.
  • an information processing device an information processing system, an information processing method, and a non-temporary computer-readable medium that can suitably save the trouble of ordering when visiting a store.
  • FIG. 1 is a block diagram showing the configuration of an information processing apparatus according to a first embodiment.
  • FIG. 3 is a flowchart showing the flow of the information processing method according to the first embodiment.
  • 2 is a block diagram showing the overall configuration of an information processing system according to a second embodiment.
  • FIG. 2 is a block diagram showing the configuration of a face authentication device according to a second embodiment.
  • 7 is a flowchart showing the flow of face information registration processing according to the second embodiment. 7 is a flowchart showing the flow of face authentication processing according to the second embodiment.
  • FIG. 2 is a block diagram showing the configuration of a user terminal according to a second embodiment.
  • FIG. 2 is a block diagram showing the configuration of a store terminal according to a second embodiment.
  • FIG. 2 is a block diagram showing the configuration of a server according to a second embodiment.
  • 7 is a sequence diagram showing the flow of member registration processing according to the second embodiment.
  • FIG. FIG. 7 is a sequence diagram showing the flow of temporary order processing according to the second embodiment.
  • 7 is a diagram illustrating an example of a display of a user terminal according to a second embodiment.
  • FIG. FIG. 7 is a sequence diagram showing the flow of main order processing according to the second embodiment.
  • FIG. 7 is a diagram showing an example of a display on a store terminal according to a second embodiment.
  • FIG. 7 is a diagram showing an example of a display on a store terminal according to a second embodiment.
  • 7 is a sequence diagram showing the flow of promotional information provision processing according to the second embodiment.
  • FIG. 7 is a diagram illustrating an example of a display of a user terminal according to a second embodiment.
  • FIG. 1 is a block diagram showing the configuration of an information processing apparatus 10 according to the first embodiment.
  • the information processing device 10 is composed of one or more computers that allow a user to place a temporary order for store items before visiting the store.
  • the store is a restaurant such as a cafe or restaurant, an apparel shop, a general store, a beauty salon, a gym, or the like.
  • the information processing device 10 is connected to a network (not shown).
  • the network may be wired or wireless.
  • a user terminal (not shown) used by the user and a store terminal (not shown), which is a terminal device installed in a store visited by the user, may be connected to the network.
  • the information processing device 10 includes a registration section 11, an authentication control section 12, and a transmission control section 15.
  • the registration unit 11 is also referred to as registration means.
  • the registration unit 11 registers the provisional order information in association with the user's biometric information.
  • Temporary order information is information related to a temporary order.
  • the provisional order information includes at least item information.
  • the item information is information for specifying the item related to the provisional order.
  • the item is a meal menu, training menu, product, service, or the like.
  • the item information may specify not only the type and quantity of the item but also the content of customization. Customization is specifying cooking preferences and adding or changing ingredients.
  • biometric information is information used in biometric authentication, which will be described later.
  • the biometric authentication is face authentication, fingerprint authentication, iris authentication, vein authentication, gait authentication, or other biometric authentication.
  • the biometric information is face information, iris information, vein information, gait information, or other biometric information.
  • the information processing device 10 may receive a user ID associated with the user's biometric information from the user terminal.
  • the registration unit 11 may associate the provisional order information with the user's biometric information by registering the provisional order information and the user ID in association with each other.
  • the authentication control unit 12 is also referred to as authentication control means.
  • the authentication control unit 12 controls biometric authentication based on the user's biometric information.
  • the information processing device 10 controlling biometric authentication may mean that the information processing device 10 performs biometric authentication using the user's biometric information, or the information processing device 10 may control another device, such as a biometric authentication device. Alternatively, biometric information may be sent to the person to perform biometric authentication.
  • the transmission control unit 15 is also referred to as transmission control means. If the biometric authentication is successful, the transmission control unit 15 transmits temporary order information associated with the user's biometric information to the store terminal.
  • FIG. 2 is a flowchart showing the flow of the information processing method according to the first embodiment.
  • the information processing device 10 receives provisional order information from a user terminal (S10).
  • the information processing device 10 may acquire the user's biometric information from the user terminal.
  • the registration unit 11 of the information processing device 10 registers the provisional order information in association with the user's biometric information (S11).
  • the information processing device 10 receives the user's biometric information from the store terminal of the store (S12).
  • the authentication control unit 12 controls biometric authentication based on the user's biometric information (S13). If the biometric authentication is successful (Yes in S14), the transmission control unit 15 transmits provisional order information associated with the user's biometric authentication to the store terminal (S15). The information processing device 10 then ends the process. On the other hand, if the biometric authentication fails (No in S14), the transmission control unit 15 ends the process.
  • the information processing device 10 receives a provisional order from the user in advance, and once the user's identity has been verified through biometric authentication when visiting the store, the information processing device 10 transmits information regarding the provisional order to the store.
  • FIG. 3 is a block diagram showing the overall configuration of an information processing system 1000 according to the second embodiment.
  • the information processing system 1000 is a system composed of one or more computers that allows a user to place a temporary order for store items before visiting the store.
  • the store is a cafe and the item is a meal menu, but the present invention is not limited to this.
  • the information processing system 1000 includes a face authentication device 100, an information processing device (hereinafter referred to as a server) 200, a user terminal 300, and one or more store terminals 400. Each device and terminal are connected to each other via a network N.
  • the network N is a wired or wireless communication line.
  • the user terminal 300 is a personal computer, smartphone, tablet terminal, or other information terminal used by the user.
  • the user uses the user terminal 300 to register as a member and to register a provisional order.
  • Each store terminal 400 is an information terminal installed in each store.
  • store terminal 400 is a store cash register.
  • the store terminal 400 accepts facial authentication for the user.
  • the store terminal 400 photographs at least the face of the user to be authenticated, and sends the facial image (hereinafter also referred to as a photographed image) or the facial feature information extracted from the facial image to the server. Send to 200.
  • Face authentication is performed in the face authentication device 100 via the store terminal 400 and the server 200.
  • the store terminal 400 receives and displays the user's provisional order information.
  • the store clerk who viewed the provisional order information confirms with the user the order intention at the time of the visit, such as whether the item related to the provisional order information can be accepted as a permanent order, and inputs the order intention into the store terminal 400.
  • the user who viewed the display may input an order intention into the store terminal 400.
  • the store terminal 400 accepts the actual order based on the provisional order information and the order intention. This order is a regular order.
  • the store terminal 400 that has received the order prompts the store clerk to provide the item related to the order.
  • the face authentication device 100 is an example of a biometric authentication device, and is a face authentication device that stores facial feature information of a plurality of people.
  • the face authentication device 100 registers the user's facial feature information at the time of membership registration, which will be described later.
  • the face authentication device 100 issues a user ID to the user.
  • the user ID is information that identifies a user, and is, for example, a membership number.
  • the face authentication device 100 has a face authentication function that, in response to a face authentication request received from the outside, verifies the facial image or facial feature information included in the request with the facial feature information of each user.
  • the face authentication device 100 acquires a face image of a user who has visited the store from the store terminal 400 via the server 200, and performs face authentication using the face image. The face authentication device 100 then returns the matching result (face authentication result) to the server 200.
  • the server 200 is an example of the information processing device 10 of the first embodiment. First, the server 200 registers the user as a member in response to a member registration request from the user terminal 300.
  • the server 200 When the server 200 receives a provisional order request from the user terminal 300 of a registered user, it requests the face authentication device 100 to perform facial authentication on the user's facial image or facial feature information. Then, the server 200 identifies the user ID from the face authentication result received from the face authentication device 100. When the server 200 receives provisional order information from the user terminal of a user who has already registered as a member, the server 200 registers the provisional order information in association with the user ID.
  • the server 200 when the server 200 receives a request from the store terminal 400 to output provisional order information of a user who visited the store, the server 200 requests the face authentication device 100 to perform facial recognition on the user's facial image or facial feature information. Then, the server 200 identifies the user ID from the face authentication result received from the face authentication device 100. The server 200 transmits temporary order information registered in association with the specified user ID to the store terminal 400.
  • FIG. 4 is a block diagram showing the configuration of the face authentication device 100 according to the second embodiment.
  • the face authentication device 100 includes a face information DB (DataBase) 110, a face detection section 120, a feature point extraction section 130, a registration section 140, and an authentication section 150.
  • the face information DB 110 stores a user ID 111 and facial feature information 112 of the user in association with each other.
  • the facial feature information 112 is a set of feature points extracted from the facial image.
  • the face authentication device 100 may delete the facial feature information 112 in the facial feature DB 110 in response to a request from a registered user of the facial feature information 112.
  • the face authentication device 100 may delete the facial feature information 112 after a certain period of time has passed since it was registered.
  • the face detection unit 120 detects a face area included in a registered image for registering facial feature information and supplies it to the feature point extraction unit 130.
  • the feature point extraction unit 130 extracts feature points from the face area detected by the face detection unit 120 and supplies facial feature information to the registration unit 140. Further, the feature point extraction unit 130 extracts feature points included in the facial image received from the server 200 and supplies facial feature information to the authentication unit 150.
  • the registration unit 140 issues a new user ID 111 when registering facial feature information.
  • the registration unit 140 associates the issued user ID 111 with the facial feature information 112 extracted from the registered image and registers it in the facial information DB 110.
  • the authentication unit 150 performs face authentication using the facial feature information 112. Specifically, the authentication unit 150 compares the facial feature information extracted from the facial image with the facial feature information 112 in the facial information DB 110.
  • the authentication unit 150 sends back to the server 200 whether or not the facial feature information matches. Whether or not the facial feature information matches corresponds to the success or failure of authentication. Note that the facial feature information matches (match exists) when the degree of matching is equal to or greater than a predetermined value.
  • FIG. 5 is a flowchart showing the flow of face information registration processing according to the second embodiment.
  • the face authentication device 100 acquires the user's registered image included in the face registration request (S21). For example, the face authentication device 100 receives a face registration request via the network N from the server 200 that received a member registration request from the user terminal 300. Note that the face authentication device 100 is not limited to this, and may directly receive a face registration request from the user terminal 300.
  • the face detection unit 120 detects a face area included in the registered image (S22).
  • the feature point extraction unit 130 extracts feature points from the face area detected in step S22, and supplies facial feature information to the registration unit 140 (S23).
  • the registration unit 140 issues the user ID 111, associates the user ID 111 with the facial feature information 112, and registers it in the facial information DB 110 (S24).
  • the face authentication device 100 may receive the facial feature information 112 from the face registration request source, and register it in the facial information DB 110 in association with the user ID 111.
  • FIG. 6 is a flowchart showing the flow of face authentication processing according to the second embodiment.
  • the feature point extraction unit 130 acquires facial feature information for authentication (S31).
  • the face authentication device 100 receives a face authentication request from the server 200 via the network N, and extracts facial feature information from the face image included in the face authentication request as in steps S21 to S23.
  • the face authentication device 100 may receive facial feature information from the server 200.
  • the authentication unit 150 compares the acquired facial feature information with the facial feature information 112 of the facial information DB 110 (S32).
  • the authentication unit 150 identifies the user ID 111 of the user whose facial feature information matches (S34). . The authentication unit 150 then returns the fact that the face authentication was successful and the specified user ID 111 to the server 200 as the face authentication result (S35). If matching facial feature information does not exist (No in S33), the authentication unit 150 returns the face authentication result to the server 200 to the effect that the facial authentication has failed (S36).
  • FIG. 7 is a block diagram showing the configuration of the user terminal 300 according to the second embodiment.
  • User terminal 300 includes a camera 310, a storage section 320, a communication section 330, a display section 340, an input section 350, and a control section 360.
  • the camera 310 is a photographing device that performs photographing under the control of the control unit 360.
  • the storage unit 320 is a storage device that stores programs for realizing each function of the user terminal 300.
  • the communication unit 330 is a communication interface with the network N.
  • Display unit 340 is a display device.
  • the input unit 350 is an input device that receives input from the user.
  • the display section 340 and the input section 350 may be integrally configured like a touch panel.
  • the control unit 360 controls the hardware included in the user terminal 300.
  • FIG. 8 is a block diagram showing the configuration of the store terminal 400 according to the second embodiment.
  • Store terminal 400 includes a camera 410, a storage section 420, a communication section 430, a display section 440, an input section 450, and a control section 460.
  • the camera 410 is a photographing device that performs photographing under the control of the control unit 460.
  • the storage unit 420 is a storage device that stores programs for realizing each function of the store terminal 400.
  • the communication unit 430 is a communication interface with the network N.
  • Display unit 440 is a display device.
  • Input unit 450 is an input device that receives input.
  • the display section 440 and the input section 450 may be integrally configured like a touch panel.
  • the control unit 460 controls the hardware included in the store terminal 400.
  • FIG. 9 is a block diagram showing the configuration of the server 200 according to the second embodiment.
  • the server 200 includes a storage section 210, a memory 220, a communication section 230, and a control section 240.
  • the storage unit 210 is a storage device such as a hard disk or flash memory.
  • the storage unit 210 stores a program 211, a user DB 212, a temporary order DB 213, a store DB 214, and a permanent order DB 215.
  • the program 211 is a computer program in which the processing of the information processing method according to the second embodiment is implemented.
  • the user DB 212 is a database that stores user information of users who are members. Specifically, the user DB 212 stores user information 2122 in association with the user ID 2121.
  • the user information 2122 includes attribute information, account information for payment, and contact information such as a telephone number and email address.
  • the temporary order DB 213 is a database that stores temporary order information. Specifically, the temporary order DB 213 stores temporary order information 2132 in association with the user ID 2131.
  • the temporary order information 2132 includes a store ID for identifying the store that the user plans to visit, and item information related to the temporary order.
  • the item information related to the provisional order is information that specifies the type, quantity, and presence/absence of customization of the item related to the provisional order, and if customization is present, the contents thereof.
  • the temporary order information 2132 may include the time when the temporary order was received. Note that since the user ID is associated with facial feature information in the face authentication device 100, it can be said that the temporary order information is associated with the facial feature information via the user ID.
  • the store DB 214 is a database that stores items that each store can provide. Specifically, the store DB 214 includes a store ID 2141 and an item list 2142.
  • the item list 2142 is a list of items that the store can provide and customized menus that the store can support. In the second embodiment, since the store is a cafe, the item list 2142 is also referred to as a menu table.
  • the actual order DB 215 stores actual order information.
  • the main order DB 215 stores the main order information 2152 in association with the user ID 2151.
  • the actual order information 2152 includes a store ID for identifying the store where the user placed the actual order, and item information regarding the actual order.
  • the item information related to this order is information that specifies the type, quantity, presence or absence of customization, and if customization, the contents of the item related to this order.
  • the actual order information 2152 may include the time when the actual order was received. Since the user ID is also associated with facial information in the face authentication device 100 here, it can be said that the main order information is associated with the facial information via the user ID.
  • the memory 220 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information when the control unit 240 operates.
  • the communication unit 230 is a communication interface with the network N.
  • the control unit 240 is a processor that controls each component of the server 200, that is, a control device.
  • the control unit 240 loads the program 211 from the storage unit 210 into the memory 220 and executes the program 211. Thereby, the control unit 240 realizes the functions of the registration unit 241, the authentication control unit 242, the determination unit 243, the additional specification unit 244, the transmission control unit 245, and the generation unit 246.
  • the registration unit 241 is an example of the registration unit 11 of the first embodiment.
  • the registration unit 241 transmits a face registration request to the face authentication device 100.
  • the registration unit 241 receives the issued user ID from the face authentication device 100 that has registered the facial feature information.
  • the registration unit 241 also receives user information from the user terminal 300, associates the issued user ID with the user information, and registers the associated information in the user DB 212.
  • the registration unit 241 when the registration unit 241 receives temporary order information from the user terminal 300 of a user who has successfully undergone facial authentication, the registration unit 241 associates the temporary order information with the user ID and registers it in the temporary order DB 213. At this time, the user terminal 300 may transmit provisional order information for each store, and the registration unit 241 may register the provisional order information and user ID in association with each other in the provisional order DB 213 for each store.
  • the registration unit 241 when the registration unit 241 receives from the store terminal 400 actual order information including the order intention of the user who has successfully passed facial authentication, the registration unit 241 associates the actual order information with the user ID and registers it in the actual order DB 215. This allows the user to keep a record of their actual orders.
  • the authentication control unit 242 is an example of the authentication control unit 12 of the first embodiment.
  • the authentication control unit 242 specifies the user ID of the user by controlling face authentication based on the face image. Specifically, when receiving a face image from the user terminal 300 or the store terminal 400, the authentication control unit 242 sends a face authentication request including the face image or facial feature information extracted from the face image via the network N. The information is sent to the authentication device 100. The authentication control unit 242 then obtains the face authentication result from the face authentication device 100. If the face authentication is successful, the authentication control unit 242 extracts the user ID from the face authentication result.
  • the determining unit 243 is also referred to as determining means. If the face authentication is successful, the determination unit 243 determines whether the store visited by the user is the store specified by the user at the time of the provisional order. Specifically, if the face authentication is successful, the determination unit 243 determines whether the store visited by the user is the store specified by the store ID included in the temporary order information in the temporary order DB 213. The determination unit 243 supplies the determination result to the transmission control unit 245.
  • the additional specifying unit 244 is also referred to as additional specifying means. If the face authentication is successful, the additional specifying unit 244 reads the item information of the temporary order information from the temporary order DB 213 and specifies other items that are recommended to be ordered in combination with the item indicated by the item information. The other items are also referred to as additional items.
  • the additional item is, for example, a side menu that goes well with the menu for the provisional order.
  • the server 200 maintains a table in which items that are generally determined to be compatible combinations are associated with each other, and the additional specifying unit 244 uses the table to select additional items when face authentication is successful. May be specified.
  • the addition specifying unit 244 may specify additional items based on the user's past main order history.
  • the additional specifying unit 244 reads the history of the user's book order information from the book order DB 215, and selects the combination of items that the user prefers to order based on the history of the book order information. analyse. The addition specifying unit 244 then specifies additional items based on the analysis results.
  • the transmission control unit 245 is an example of the transmission control unit 15 of the first embodiment. First, the transmission control unit 245 transmits the item list to the user terminal 300 that has made the provisional order request.
  • the transmission control unit 245 transmits provisional order information when the user visits the store specified at the time of the provisional order after placing the provisional order. Specifically, when the determination unit 243 determines that the store visited by the user is a store specified by the store ID included in the temporary order information 2132 of the temporary order DB 213, the transmission control unit 245 transmits the temporary order information. is transmitted to the store terminal 400 of the store in question. Thereby, the store terminal 400 that has received the provisional order information displays the provisional order information on the display unit 440, and the store clerk who viewed the information prompts the user to place the actual order.
  • the transmission control unit 245 transmits the temporary order information to the store terminal 400 of the store. Do not send. This can prevent provisional order information from being sent to a store that is not intended by the user.
  • the transmission control section 245 when transmitting the provisional order information to the store terminal 400, the transmission control section 245 also transmits to the store terminal 400 the item information of the additional item specified by the addition specifying section 244. Item information of additional items is also referred to as additional item information.
  • the additional item information may be transmitted at the same time as the provisional order information, or may be performed before or after the provisional order information is transmitted.
  • the store terminal 400 that has received the additional item information displays the additional item information on the display unit 440, and the clerk who viewed the information recommends the additional item to the user.
  • the generation unit 246 generates promotional information for each user based on the history of regular order information accumulated in the regular order DB 215.
  • the promotional information includes at least one of information regarding items recommended to the user and discount information for the items.
  • FIG. 10 is a sequence diagram showing the flow of member registration processing according to the second embodiment.
  • the user terminal 300 photographs the user U (S500), includes the registration image generated by the photographing in a membership registration request, and transmits the membership registration request to the server 200 (S501).
  • the registration unit 241 of the server 200 includes the registered image included in the received member registration request in a face registration request and transmits the face registration request to the face authentication device 100 (S502).
  • the face authentication device 100 registers the face information (facial feature information) of the user U based on the registration image included in the received face registration request (S503).
  • the face authentication device 100 then notifies the server 200 of the issued user ID (S504).
  • the user terminal 300 also transmits user information to the server 200 (S505). At this time, the user information may include attribute information, account information, and contact information.
  • the registration unit 241 of the server 200 registers the notified user ID and user information in the user DB 212 in association with each other (S506).
  • FIG. 11 is a sequence diagram showing the flow of temporary order processing according to the second embodiment. Temporary order processing is performed after member registration processing. First, the user terminal 300 photographs the user U (S510). The user then specifies the store to which the temporary order is to be placed. The user terminal 300 includes the facial image generated by the photographing and the store ID of the specified store in a temporary order request, and transmits the provisional order request to the server 200 (S511).
  • the authentication control unit 242 of the server 200 transmits a face authentication request for the face area of the user U in the received face image to the face authentication device 100 (S512).
  • the face authentication device 100 then performs face authentication on the face area of the user U in the face image included in the received face authentication request (S513).
  • the face authentication device 100 transmits the face authentication result including the fact that the face authentication was successful and the user ID to the server 200 (S514).
  • the server 200 may notify the user terminal 300 whether or not face authentication was successful.
  • the transmission control unit 245 of the server 200 which has received the face authentication result, reads the item list associated with the store ID included in the provisional order request from the store DB 214, and transmits it to the user terminal 300 (S515).
  • the user terminal 300 that has received the item list displays the item list on the display unit 340 (S516). Then, the user terminal 300 receives a selection operation from the user regarding the type of item, quantity, whether customization is required, and if customization is required, the contents of the item for the provisional order (S517).
  • FIG. 12 is a diagram showing an example of the display of the user terminal 300 according to the second embodiment.
  • the display section 340 shows a menu table for store A that the user specified when requesting a provisional order.
  • the user can select a main menu or a side menu as the type of item.
  • the user can specify cooking preferences and desired toppings for the selected menu on this display screen.
  • the cooking preference in this example, is the desired degree of roasting of the coffee beans.
  • User terminal 300 receives the selected information as item information.
  • the user can consider and specify the menu and customization in detail before visiting the store, which saves the user the trouble of conveying the details of the order when visiting the store. Additionally, the time required to place an order when visiting a store can be shortened, eliminating crowding at cash registers at stores.
  • the user terminal 300 that has received the selection operation includes the item information corresponding to the selection operation and the store ID of the store in the temporary order information, and transmits the temporary order information to the server 200 (S518).
  • the registration unit 241 of the server 200 that has received the provisional order information registers the provisional order information in the provisional order DB 213 in association with the user ID specified from the face authentication result (S519). At this point, provisional order information does not need to be transmitted to store terminal 400.
  • the registration unit 241 may delete the provisional order information from the provisional order DB 213. Thereby, even if the user is unable to pick up the item related to the provisional order, the user can easily cancel the order from the user terminal 300.
  • FIG. 13 is a sequence diagram showing the flow of the main order processing according to the second embodiment.
  • the store terminal 400 photographs a user who visited the store's cash register (S520).
  • the store terminal 400 includes the face image generated by the photographing and the store ID of the store in an output request, and transmits the output request to the server 200 (S521).
  • the information processing system 1000 executes S522 to S523, which are similar to S512 to S513.
  • the face authentication device 100 transmits the face authentication result including the fact that the face authentication was successful and the user ID to the server 200 (S524).
  • the server 200 may notify the store terminal 400 whether or not face authentication was successful.
  • the authentication control unit 242 of the server 200 extracts the user ID included in the face authentication result.
  • the determination unit 243 of the server 200 uses the extracted user ID to identify provisional order information associated with the user ID in the provisional order DB 213 (S525). Then, the determination unit 243 compares the store ID of the store terminal 400 that is the source of the output request and the store ID included in the provisional order information, and determines whether the two match (S526). Here, it is assumed that both match.
  • the addition specifying unit 244 specifies an additional item corresponding to the item in the item information included in the provisional order information (S527).
  • the transmission control unit 245 transmits the item information of the provisional order information and the item information regarding the additional item to the store terminal 400 according to the result of the comparison determination by the determination unit 243 (S528).
  • the store terminal 400 that has received the item information displays the received item information on the display unit 440 (S529). Then, the store terminal 400 receives an input operation of the user's order intention from the store clerk who has confirmed the user's order intention or from the user himself/herself (S530).
  • FIG. 14 is a diagram showing an example of a display on the store terminal 400 according to the second embodiment.
  • the display unit 440 displays the item and customization details related to the provisional order, and a message asking whether to make a permanent order for the item related to the provisional order.
  • the user confirms the contents of the tentative order and responds with his or her intention to order the items and customization related to the tentative order.
  • FIG. 15 is a diagram showing an example of a display on the store terminal 400 according to the second embodiment.
  • the display section 440 displays the contents of the additional item. The user confirms the contents of the additional item and responds with his or her intention to order the additional item.
  • the store terminal 400 generates main order information based on the intention to order items and customization related to the provisional order, and the intention to order additional items.
  • the store terminal 400 displays this order information on the display unit 440 or other terminals in the store other than the store terminal 400 to prompt the store staff to provide the items related to the order.
  • the user can easily order the desired item while minimizing the effort of ordering when visiting the store. If the item is a product for eating or drinking or a meal menu as in this example, the user can receive the freshly prepared food after visiting the store by converting the tentative order into a permanent order when the user visits the store.
  • the store terminal 400 may display a screen similar to the display screen shown in FIG. 12 on the display unit 440.
  • the store terminal 400 then receives the selected information as actual order information. This allows users to order items that match their mood when they visit the store.
  • the store terminal 400 that has generated the actual order information includes the store ID of the store in the actual order information and transmits it to the server 200 (S531).
  • the registration unit 241 of the server 200 registers the regular order information in the regular order DB 215 in association with the user ID included in the face authentication result (S532).
  • the server 200 may perform the payment using the account information associated with the user ID 2121 of the user DB 212. This saves you the hassle of making payments when you visit the store.
  • the server 200 can contribute to improving store sales by recommending additional items that match the tentatively ordered items.
  • FIG. 16 is a sequence diagram showing the flow of promotional information provision processing according to the second embodiment.
  • the process of providing promotional information may be performed using the main order as a trigger, or may be performed periodically, for example, regardless of the timing of the main order. Note that the process of providing promotional information is performed for each user.
  • the generation unit 246 of the server 200 reads the history of the regular order information associated with the user ID of the user in the regular order DB 215 (S535). The generation unit 246 then generates promotional information based on the history of this order information (S536). For example, the generation unit 246 may analyze the preferences of each user from the history of this order information, and specify the type of item or store of preference based on the analysis result. The generation unit 246 may then generate promotional information related to the specified store or type of item as promotional information for the user.
  • the analysis of preferences may be based on the frequency of store usage and item purchase frequency calculated from the history of this order information.
  • the analysis of preferences may be based on the user's attribute information in addition to the history of the order information.
  • the generation unit 246 may analyze the usage time of the store for each user and generate promotional information for items suitable for the time when the user is likely to use the store as the promotional information for the user. .
  • the generation unit 246 then transmits the promotional information to the user terminal 300 of that user (S537).
  • the user terminal 300 that has received the promotional information notifies the user by displaying the promotional information on the display unit 340 (S538).
  • FIG. 17 is a diagram showing an example of a display on the user terminal 300 according to the second embodiment.
  • Display unit 340 displays promotional information recommended for user X. As an example, the display unit 340 displays, as recommended promotional information, discount information for store A that user X frequents, and recommendation information for items from other stores that are related to frequently purchased items.
  • the server 200 can make the user feel the benefits by providing the user with personalized promotional information. As a result, it is possible to encourage users to use the service.
  • the program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more of the functions described in the embodiments.
  • the program may be stored on a non-transitory computer readable medium or a tangible storage medium.
  • computer readable or tangible storage media may include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD - Including ROM, digital versatile disc (DVD), Blu-ray disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disc storage or other magnetic storage device.
  • the program may be transmitted on a transitory computer-readable medium or a communication medium.
  • transitory computer-readable or communication media includes electrical, optical, acoustic, or other forms of propagating signals.
  • the present disclosure is not limited to the above embodiments, and can be modified as appropriate without departing from the spirit.
  • the face authentication device 100 has the face authentication function
  • the server 200 may have the face authentication function instead of or in addition to the face authentication device 100.
  • the store terminal 400 confirms the user's intention to place the order, generates the order information, and prompts the store clerk to provide the item for the order.
  • the store terminal 400 may generate provisional order information as permanent order information and prompt the store clerk to provide the items related to the permanent order, without waiting for confirmation of the order intention.
  • the user terminal 300 may accept input of multiple pieces of temporary order information for the same store from the user, and register the multiple pieces of temporary order information in the temporary order DB 213 of the server 200.
  • the user inputs the customization details when ordering a blended coffee from store A as the first temporary order information, and inputs the customization contents when the user orders a cafe latte from store A into the second temporary order information. May be entered as order information.
  • the registration unit 241 of the server 200 may associate the plural pieces of provisional order information with the user ID and register them in the provisional order DB 213. Then, when the user visits the store, the transmission control unit 245 may transmit all of the plural pieces of provisional order information associated with the user ID of the user whose face authentication has been successfully performed to the store terminal 400, or transmit at least one piece of provisional order information to the store terminal 400. may be selected and transmitted to the store terminal 400. When the transmission control unit 245 transmits a plurality of pieces of provisional order information to the store terminal 400, the store terminal 400 displays the plurality of pieces of provisional order information so that the user can select the provisional order information to be used as the main order information. good. This allows users to easily order according to their mood at the time.
  • the temporary order information in the temporary order DB 213 may include a group ID that identifies a group made up of stores of the same series, instead of or in addition to the store ID. If they are in the same group, the items they handle are likely to be the same or similar. Therefore, the transmission control unit 245 may transmit a common item list to the user terminal 300 if the groups have the same ID when requesting a temporary order.
  • the registration unit 241 may then associate the provisional order information with the user ID for each group and register them in the provisional order DB 213. Then, when the user visits the store, the determination unit 243 may determine whether the group to which the store visited by the user belongs is the group specified by the group ID included in the temporary order information in the temporary order DB 213.
  • the transmission control unit 245 transmits the provisional order information to the store terminal 400 if the group to which the store visited by the user belongs is a group specified by the group ID included in the provisional order information, and does not transmit the provisional order information if not. It's fine. As a result, the user can appropriately provisionally order the desired item regardless of the branch as long as the store belongs to the same group.
  • the addition specifying unit 244 may select an additional item from items common to the entire group.
  • the generation unit 246 may also generate promotional information for items that can be commonly used within the same group.
  • the transmission control unit 245 may transmit a different item list to the user terminal 300 when requesting a temporary order.
  • the addition specifying unit 244 may select additional items for each store. For example, the additional specifying unit 244 may preferentially select items limited to the store visited or items recommended by the store visited.
  • the generation unit 246 When the generation unit 246 generates promotional information, it may generate promotional information for different items for different stores even if they are in the same group.
  • the server 200 may invalidate the provisional order information if a predetermined period of time or more has passed since the provisional order information was registered in the provisional order DB 213.
  • the registration unit 241 may delete the temporary order information from the temporary order DB 213, or the transmission control unit 245 may not transmit the temporary order information and the item information of the additional item to the store terminal 400. This allows the pre-registered contents to be reflected in the actual order according to the user's most recent mood, while also allowing the user to cancel without any operations if the user's mood changes or it becomes difficult to receive the order.
  • the addition specifying unit 244 of the server 200 specifies additional items that are compatible with the item placed in the provisional order, and the transmission control unit 245 recommends the additional items via the store terminal 400.
  • the addition specifying unit 244 may recommend different additional items depending on how the user uses the store.
  • the addition specifying unit 244 uses a first table to specify additional items when the user is a dine-in customer, and uses a second table different from the first table when the user is a take-out customer to identify additional items. May be specified.
  • the first table is a table that associates items that go well together
  • the second table is a table that associates items that go well together from the takeout menu.
  • the server 200 may recommend a cake as an additional item if the user wishes to eat in, or a sandwich if the user wishes to take out. . This makes it possible to make recommendations that match the actual usage situation.
  • the server 200 may recommend additional items only when the user wishes to use the store in a predetermined usage mode.
  • the addition specifying unit 244 does not need to specify additional items when the user wishes to use the service for eat-in, but does not need to specify additional items when the user wishes to use the service for take-out.
  • the above first table may be used to specify the additional item.
  • the request to output provisional order information including the user's face image is received from the store terminal 400, but the request may be received from the user terminal 300 instead of the store terminal 400.
  • the user terminal 300 may specify the store ID from its own location information and include it in the output request, or may include its own location information in the output request instead of the store ID.
  • the transmission control unit 245 of the server 200 may transmit the provisional order information and the item information of the additional item to the user terminal 300 or to the store terminal 400 of the store visited by the user. good.
  • Provisional order information including at least item information for specifying an item related to the provisional order is received from a user terminal used by the user, a registration means for registering the provisional order information in association with the biometric information of the user; , an authentication control means for controlling biometric authentication when biometric information of a user visiting a store is received; and a transmission control means for transmitting the provisional order information associated with the biometric information of the user to a terminal of the store visited by the user, if the biometric authentication is successful.
  • the temporary order information further includes a store ID that identifies the store, If the biometric authentication is successful, the information processing device determines whether the store visited by the user is a store specified by a store ID included in provisional order information associated with the user's biometric information. further comprising a determination means, The information processing device according to supplementary note 1, wherein the transmission control means does not transmit the provisional order information to a terminal of the store visited by the user, if the store visited by the user is not a store specified by the store ID. .
  • (Appendix 5) Further comprising a generation means for generating promotional information for the user based on the history of the main order information associated with the user's biometric information, The information processing device according to appendix 4, wherein the transmission control means transmits the promotional information to the user terminal.
  • the additional specifying means is If the biometric authentication is successful, read the history of the order information associated with the user's biometric information; identifying additional items based on the history of said order information; The information processing device according to appendix 4 or 5, wherein the transmission control means transmits the specified additional item together with the provisional order information to a terminal in the store.
  • a biometric authentication device that performs biometric authentication; Equipped with a server and The server is When provisional order information including at least item information for specifying an item related to the provisional order is received from a user terminal used by the user, a registration means for registering the provisional order information in association with the biometric information of the user; , an authentication control means that, when receiving biometric information of a user who visited a store, transmits the biometric information to the biometric authentication device and receives a result of the biometric authentication from the biometric authentication device; and a transmission control means for transmitting the provisional order information associated with the biometric information of the user to a terminal in the store if the biometric authentication is successful.
  • appendix 10 The information processing system according to appendix 9, further comprising a terminal at the store.
  • provisional order information including at least item information for identifying the item related to the provisional order is received from a user terminal used by the user, the provisional order information is registered in association with the biometric information of the user;
  • biometric information of a user who visited a store control the biometric authentication, If the biometric authentication is successful, the provisional order information associated with the biometric information of the user is transmitted to a terminal at the store.
  • provisional order information including at least item information for specifying the item related to the provisional order is received from a user terminal used by the user, a registration function that registers the provisional order information in association with the biometric information of the user;
  • a registration function that registers the provisional order information in association with the biometric information of the user;
  • an authentication control function that controls biometric authentication; If the biometric authentication is successful, the temporary order information associated with the user's biometric information is transmitted to the terminal at the store.
  • Information processing device 11 Registration unit 12 Authentication control unit 15 Transmission control unit 100 Face authentication device 110 Face information DB 111 User ID 112 Facial feature information 120 Face detection unit 130 Feature point extraction unit 140 Registration unit 150 Authentication unit 200 Information processing device (server) 210 Storage unit 211 Program 212 User DB 2121 User ID 2122 User information 213 Temporary order DB 2131 User ID 2132 Temporary order information 214 Store DB 2141 Store ID 2142 Item list 215 Book order DB 2151 User ID 2152 Book order information 220 Memory 230 Communication section 240 Control section 241 Registration section 242 Authentication control section 243 Judgment section 244 Additional specification section 245 Transmission control section 246 Generation section 300 User terminal 310 Camera 320 Storage section 330 Communication section 340 Display section 350 Input section 360 control unit 400 store terminal 410 camera 420 storage unit 430 communication unit 440 display unit 450 input unit 460 control unit 1000 information processing system

Landscapes

  • Business, Economics & Management (AREA)
  • Tourism & Hospitality (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • Marketing (AREA)
  • Theoretical Computer Science (AREA)
  • Strategic Management (AREA)
  • Economics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Human Resources & Organizations (AREA)
  • General Health & Medical Sciences (AREA)
  • Development Economics (AREA)
  • Cash Registers Or Receiving Machines (AREA)

Abstract

An information processing device (10) comprises a registration unit (11), an authentication control unit (12), and a transmission control unit (15). When provisional order information that at least includes item information for identifying an item that pertains to the provisional order is received from a user terminal that a user uses, the registration unit (11) registers the provisional order information in association with the user's biological information. When the biological information of a user having visited a store is received, the authentication control unit (12) controls biometric authentication. When the biometric authentication was successful, the transmission control unit (15) transmits the provisional order information associated with the user's biological information to a terminal of the store which the user has visited.

Description

情報処理装置、情報処理システム、情報処理方法及び非一時的なコンピュータ可読媒体Information processing device, information processing system, information processing method, and non-transitory computer-readable medium
 本開示は、情報処理装置、情報処理システム、情報処理方法及び非一時的なコンピュータ可読媒体に関する。 The present disclosure relates to an information processing device, an information processing system, an information processing method, and a non-transitory computer-readable medium.
 飲食店において、情報端末を用いてアプリ上で注文を受ける注文システムが知られている。例えば特許文献1には、来店したユーザの注文履歴に基づいて生成した店舗の個別メニュー情報をマッチングアプリ上で表示させ、マッチングアプリを介して飲食品の注文を受け付ける方法が開示されている。注文情報を受信したサーバは、店舗端末に注文情報を表示させて、店舗のスタッフに調理の開始を通知する。 An ordering system is known in which restaurants receive orders on an app using an information terminal. For example, Patent Document 1 discloses a method of displaying store individual menu information generated based on the order history of users who have visited the store on a matching app, and accepting orders for food and drink via the matching app. The server that receives the order information displays the order information on the store terminal and notifies the store staff of the start of cooking.
国際公開第2021/162062号International Publication No. 2021/162062
 ここで上述の特許文献1に記載の方法は来店時のユーザ操作を前提としているため、来店時の注文の手間を省くという点では不十分である。 Here, the method described in the above-mentioned Patent Document 1 assumes user operations when visiting the store, and is therefore insufficient in terms of saving the effort of ordering when visiting the store.
 本開示の目的は、上述した課題に鑑み、来店時の注文の手間を好適に省くことが可能な情報処理装置、情報処理システム、情報処理方法及び非一時的なコンピュータ可読媒体を提供することにある。 In view of the above-mentioned problems, an object of the present disclosure is to provide an information processing device, an information processing system, an information processing method, and a non-temporary computer-readable medium that can suitably save the trouble of ordering when visiting a store. be.
 本開示の一態様にかかる情報処理装置は、ユーザが使用するユーザ端末から、仮注文にかかるアイテムを特定するためのアイテム情報を少なくとも含む仮注文情報を受信した場合、前記仮注文情報を、前記ユーザの生体情報に関連付けて登録する登録手段と、店舗を訪問したユーザの生体情報を受信した場合、生体認証を制御する認証制御手段と、前記生体認証が成功した場合、前記ユーザの前記生体情報に関連付けられた前記仮注文情報を、前記ユーザが訪問した前記店舗の端末に送信する送信制御手段とを備える。 When the information processing apparatus according to one aspect of the present disclosure receives provisional order information including at least item information for specifying items related to the provisional order from a user terminal used by a user, the information processing apparatus transmits the provisional order information to the a registration means for registering in association with biometric information of a user; an authentication control means for controlling biometric authentication when biometric information of a user who visited a store is received; and, when the biometric authentication is successful, the biometric information of the user. and transmitting control means for transmitting the temporary order information associated with the temporary order information to a terminal of the store visited by the user.
 本開示の一態様にかかる情報処理システムは、生体認証を実施する生体認証装置と、サーバとを備える。前記サーバは、ユーザが使用するユーザ端末から、仮注文にかかるアイテムを特定するためのアイテム情報を少なくとも含む仮注文情報を受信した場合、前記仮注文情報を、前記ユーザの生体情報に関連付けて登録する登録手段と、店舗を訪問したユーザの生体情報を受信した場合、前記生体情報を前記生体認証装置に送信し、前記生体認証の結果を前記生体認証装置から受信する認証制御手段と、前記生体認証が成功した場合、前記ユーザの前記生体情報に関連付けられた前記仮注文情報を、前記店舗の端末に送信する送信制御手段とを有する。 An information processing system according to one aspect of the present disclosure includes a biometric authentication device that performs biometric authentication and a server. When the server receives provisional order information that includes at least item information for identifying items related to the provisional order from a user terminal used by the user, the server registers the provisional order information in association with the user's biometric information. an authentication control means for transmitting the biometric information to the biometric authentication device and receiving the biometric authentication result from the biometric authentication device when biometric information of a user who visited a store is received; and transmission control means for transmitting the provisional order information associated with the biometric information of the user to a terminal in the store if authentication is successful.
 本開示の一態様にかかる情報処理方法は、ユーザが使用するユーザ端末から、仮注文にかかるアイテムを特定するためのアイテム情報を少なくとも含む仮注文情報を受信した場合、前記仮注文情報を、前記ユーザの生体情報に関連付けて登録し、店舗を訪問したユーザの生体情報を受信した場合、生体認証を制御し、前記生体認証が成功した場合、前記ユーザの前記生体情報に関連付けられた前記仮注文情報を、前記店舗の端末に送信する。 An information processing method according to one aspect of the present disclosure is, when provisional order information including at least item information for specifying an item related to a provisional order is received from a user terminal used by a user, the provisional order information is When the biometric information of the user who visited the store is registered and registered in association with the biometric information of the user, the biometric authentication is controlled, and if the biometric authentication is successful, the provisional order associated with the biometric information of the user The information is transmitted to the terminal at the store.
 本開示の一態様にかかる非一時的なコンピュータ可読媒体は、ユーザが使用するユーザ端末から、仮注文にかかるアイテムを特定するためのアイテム情報を少なくとも含む仮注文情報を受信した場合、前記仮注文情報を、前記ユーザの生体情報に関連付けて登録する登録機能と、店舗を訪問したユーザの生体情報を受信した場合、生体認証を制御する認証制御機能と、前記生体認証が成功した場合、前記ユーザの前記生体情報に関連付けられた前記仮注文情報を、前記店舗の端末に送信する送信制御機能とをコンピュータに実現させるためのプログラムが格納される。 When the non-transitory computer-readable medium according to one aspect of the present disclosure receives provisional order information including at least item information for identifying items related to the provisional order from a user terminal used by a user, the non-transitory computer-readable medium a registration function that registers information in association with the biometric information of the user; an authentication control function that controls biometric authentication when biometric information of a user who visited a store is received; and a registration function that controls biometric authentication when the biometric authentication is successful; A program for causing a computer to implement a transmission control function of transmitting the provisional order information associated with the biometric information to the store terminal is stored.
 本開示により、来店時の注文の手間を好適に省くことが可能な情報処理装置、情報処理システム、情報処理方法及び非一時的なコンピュータ可読媒体を提供できる。 According to the present disclosure, it is possible to provide an information processing device, an information processing system, an information processing method, and a non-temporary computer-readable medium that can suitably save the trouble of ordering when visiting a store.
実施形態1にかかる情報処理装置の構成を示すブロック図である。1 is a block diagram showing the configuration of an information processing apparatus according to a first embodiment. FIG. 実施形態1にかかる情報処理方法の流れを示すフローチャートである。3 is a flowchart showing the flow of the information processing method according to the first embodiment. 実施形態2にかかる情報処理システムの全体構成を示すブロック図である。2 is a block diagram showing the overall configuration of an information processing system according to a second embodiment. FIG. 実施形態2にかかる顔認証装置の構成を示すブロック図である。FIG. 2 is a block diagram showing the configuration of a face authentication device according to a second embodiment. 実施形態2にかかる顔情報登録処理の流れを示すフローチャートである。7 is a flowchart showing the flow of face information registration processing according to the second embodiment. 実施形態2にかかる顔認証処理の流れを示すフローチャートである。7 is a flowchart showing the flow of face authentication processing according to the second embodiment. 実施形態2にかかるユーザ端末の構成を示すブロック図である。FIG. 2 is a block diagram showing the configuration of a user terminal according to a second embodiment. 実施形態2にかかる店舗端末の構成を示すブロック図である。FIG. 2 is a block diagram showing the configuration of a store terminal according to a second embodiment. 実施形態2にかかるサーバの構成を示すブロック図である。FIG. 2 is a block diagram showing the configuration of a server according to a second embodiment. 実施形態2にかかる会員登録処理の流れを示すシーケンス図である。7 is a sequence diagram showing the flow of member registration processing according to the second embodiment. FIG. 実施形態2にかかる仮注文処理の流れを示すシーケンス図である。FIG. 7 is a sequence diagram showing the flow of temporary order processing according to the second embodiment. 実施形態2にかかるユーザ端末の表示の一例を示す図である。7 is a diagram illustrating an example of a display of a user terminal according to a second embodiment. FIG. 実施形態2にかかる本注文処理の流れを示すシーケンス図である。FIG. 7 is a sequence diagram showing the flow of main order processing according to the second embodiment. 実施形態2にかかる店舗端末の表示の一例を示す図である。FIG. 7 is a diagram showing an example of a display on a store terminal according to a second embodiment. 実施形態2にかかる店舗端末の表示の一例を示す図である。FIG. 7 is a diagram showing an example of a display on a store terminal according to a second embodiment. 実施形態2にかかる販促情報の提供処理の流れを示すシーケンス図である。7 is a sequence diagram showing the flow of promotional information provision processing according to the second embodiment. FIG. 実施形態2にかかるユーザ端末の表示の一例を示す図である。7 is a diagram illustrating an example of a display of a user terminal according to a second embodiment. FIG.
 以下では、本開示の実施形態について、図面を参照しながら詳細に説明する。各図面において、同一又は対応する要素には同一の符号が付されており、説明の明確化のため、必要に応じて重複説明は省略される。 Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are denoted by the same reference numerals, and for clarity of explanation, redundant explanation will be omitted as necessary.
 <実施形態1>
 まず、本開示の実施形態1について説明する。図1は、実施形態1にかかる情報処理装置10の構成を示すブロック図である。情報処理装置10は、ユーザが来店前に店舗のアイテムを仮注文することを可能とする1又は複数のコンピュータから構成される。店舗は、カフェやレストラン等の飲食店、アパレルショップ、雑貨屋、美容院、又はジム等である。
<Embodiment 1>
First, Embodiment 1 of the present disclosure will be described. FIG. 1 is a block diagram showing the configuration of an information processing apparatus 10 according to the first embodiment. The information processing device 10 is composed of one or more computers that allow a user to place a temporary order for store items before visiting the store. The store is a restaurant such as a cafe or restaurant, an apparel shop, a general store, a beauty salon, a gym, or the like.
 ここで情報処理装置10は、ネットワーク(不図示)に接続される。ネットワークは、有線であっても無線であってもよい。またネットワークには、ユーザが使用するユーザ端末(不図示)と、ユーザが訪問する店舗に設置される端末装置である店舗端末(不図示)とが接続されていてよい。 Here, the information processing device 10 is connected to a network (not shown). The network may be wired or wireless. Further, a user terminal (not shown) used by the user and a store terminal (not shown), which is a terminal device installed in a store visited by the user, may be connected to the network.
 情報処理装置10は、登録部11と、認証制御部12と、送信制御部15とを備える。 The information processing device 10 includes a registration section 11, an authentication control section 12, and a transmission control section 15.
 登録部11は、登録手段とも称する。登録部11は、情報処理装置10がユーザ端末から仮注文情報とユーザの生体情報とを受信した場合、ユーザの生体情報に仮注文情報を関連付けて登録する。仮注文情報は、仮注文にかかる情報である。仮注文情報は、アイテム情報を少なくとも含む。アイテム情報は、仮注文にかかるアイテムを特定するための情報である。アイテムは、食事メニュー、トレーニングメニュー、商品、又はサービス等である。アイテム情報は、アイテムの種別及び数量だけでなくカスタマイズの内容を特定できるものであってよい。カスタマイズは、調理の好みを指定したり、材料を追加若しくは変更することである。 The registration unit 11 is also referred to as registration means. When the information processing device 10 receives the provisional order information and the user's biometric information from the user terminal, the registration unit 11 registers the provisional order information in association with the user's biometric information. Temporary order information is information related to a temporary order. The provisional order information includes at least item information. The item information is information for specifying the item related to the provisional order. The item is a meal menu, training menu, product, service, or the like. The item information may specify not only the type and quantity of the item but also the content of customization. Customization is specifying cooking preferences and adding or changing ingredients.
 ここで生体情報は、後述の生体認証で用いる情報である。生体認証は、顔認証、指紋認証、虹彩認証、静脈認証、歩容認証又はその他の生体認証である。そして生体情報は、顔情報、虹彩情報、静脈情報、歩容情報又はその他の生体情報である。 Here, biometric information is information used in biometric authentication, which will be described later. The biometric authentication is face authentication, fingerprint authentication, iris authentication, vein authentication, gait authentication, or other biometric authentication. The biometric information is face information, iris information, vein information, gait information, or other biometric information.
 尚、情報処理装置10は、ユーザの生体情報に代えて、ユーザの生体情報に関連付けられたユーザIDをユーザ端末から受信してよい。この場合、登録部11は、仮注文情報とユーザIDとを対応付けて登録することで、結果的に仮注文情報とユーザの生体情報とを関連付けてよい。 Note that instead of the user's biometric information, the information processing device 10 may receive a user ID associated with the user's biometric information from the user terminal. In this case, the registration unit 11 may associate the provisional order information with the user's biometric information by registering the provisional order information and the user ID in association with each other.
 認証制御部12は、認証制御手段とも称する。認証制御部12は、店舗端末から、店舗を訪問したユーザの生体情報を受信した場合、ユーザの生体情報に基づく生体認証を制御する。情報処理装置10が生体認証を制御するとは、情報処理装置10がユーザの生体情報を用いて生体認証を実施することであってもよいし、情報処理装置10が他の装置、例えば生体認証装置に生体情報を送信して生体認証を実施させることであってもよい。 The authentication control unit 12 is also referred to as authentication control means. When receiving biometric information of a user who visited a store from a store terminal, the authentication control unit 12 controls biometric authentication based on the user's biometric information. The information processing device 10 controlling biometric authentication may mean that the information processing device 10 performs biometric authentication using the user's biometric information, or the information processing device 10 may control another device, such as a biometric authentication device. Alternatively, biometric information may be sent to the person to perform biometric authentication.
 送信制御部15は、送信制御手段とも称する。送信制御部15は、生体認証が成功した場合、ユーザの生体情報に関連付けられた仮注文情報を、店舗端末に送信する。 The transmission control unit 15 is also referred to as transmission control means. If the biometric authentication is successful, the transmission control unit 15 transmits temporary order information associated with the user's biometric information to the store terminal.
 図2は、実施形態1にかかる情報処理方法の流れを示すフローチャートである。まず情報処理装置10は、ユーザ端末から仮注文情報を受信する(S10)。このとき情報処理装置10は、ユーザ端末からユーザの生体情報を取得していてよい。次に情報処理装置10の登録部11は、仮注文情報をユーザの生体情報に関連付けて登録する(S11)。 FIG. 2 is a flowchart showing the flow of the information processing method according to the first embodiment. First, the information processing device 10 receives provisional order information from a user terminal (S10). At this time, the information processing device 10 may acquire the user's biometric information from the user terminal. Next, the registration unit 11 of the information processing device 10 registers the provisional order information in association with the user's biometric information (S11).
 その後、情報処理装置10は、ユーザが店舗を訪問したとき、その店舗の店舗端末からユーザの生体情報を受信する(S12)。次に認証制御部12は、ユーザの生体情報に基づく生体認証を制御する(S13)。送信制御部15は、生体認証が成功した場合(S14でYes)、ユーザの生体認証に関連付けられた仮注文情報を店舗端末に送信する(S15)。そして情報処理装置10は処理を終了する。一方、送信制御部15は、生体認証が失敗した場合(S14でNo)、処理を終了する。 After that, when the user visits a store, the information processing device 10 receives the user's biometric information from the store terminal of the store (S12). Next, the authentication control unit 12 controls biometric authentication based on the user's biometric information (S13). If the biometric authentication is successful (Yes in S14), the transmission control unit 15 transmits provisional order information associated with the user's biometric authentication to the store terminal (S15). The information processing device 10 then ends the process. On the other hand, if the biometric authentication fails (No in S14), the transmission control unit 15 ends the process.
 このように情報処理装置10は、ユーザから事前に仮注文を受け、来店した際に生体認証によるユーザの本人確認が済めば、仮注文にかかる情報を店舗に伝える。ユーザが事前に仮注文できるようにすることで、来店時の注文の手間を好適に省くことができる。特に細かいカスタマイズが可能なカフェ等では、ユーザが来店時にカスタマイズの詳細を店員に伝えなくても希望通りの注文が可能であるため、顕著な効果を奏する。 In this way, the information processing device 10 receives a provisional order from the user in advance, and once the user's identity has been verified through biometric authentication when visiting the store, the information processing device 10 transmits information regarding the provisional order to the store. By allowing the user to make a provisional order in advance, it is possible to suitably save the trouble of placing an order when visiting the store. Particularly in cafes and the like where detailed customization is possible, the user can order as desired without having to tell the clerk the details of the customization when visiting the store, which is particularly effective.
 <実施形態2>
 次に、本開示の実施形態2について説明する。実施形態2は実施形態1の具体例である。図3は、実施形態2にかかる情報処理システム1000の全体構成を示すブロック図である。情報処理システム1000は、ユーザが来店前に店舗のアイテムを仮注文することを可能とする1又は複数のコンピュータから構成されるシステムである。本実施形態2では、店舗はカフェであり、アイテムは食事メニューであるが、これに限らない。
<Embodiment 2>
Next, a second embodiment of the present disclosure will be described. Embodiment 2 is a specific example of Embodiment 1. FIG. 3 is a block diagram showing the overall configuration of an information processing system 1000 according to the second embodiment. The information processing system 1000 is a system composed of one or more computers that allows a user to place a temporary order for store items before visiting the store. In the second embodiment, the store is a cafe and the item is a meal menu, but the present invention is not limited to this.
 情報処理システム1000は、顔認証装置100と、情報処理装置(以下、サーバと呼ぶ)200と、ユーザ端末300と、1又は複数の店舗端末400とを備える。各装置及び端末は、ネットワークNを介して互いに接続されている。ネットワークNは、有線又は無線の通信回線である。 The information processing system 1000 includes a face authentication device 100, an information processing device (hereinafter referred to as a server) 200, a user terminal 300, and one or more store terminals 400. Each device and terminal are connected to each other via a network N. The network N is a wired or wireless communication line.
 ユーザ端末300は、ユーザが使用するパーソナルコンピュータ、スマートフォン、タブレット端末、又はその他の情報端末である。ユーザは、ユーザ端末300を用いて会員登録及び仮注文登録を行う。 The user terminal 300 is a personal computer, smartphone, tablet terminal, or other information terminal used by the user. The user uses the user terminal 300 to register as a member and to register a provisional order.
 各店舗端末400は、各店舗に設置された情報端末である。例えば店舗端末400は、店舗のキャッシュレジスターである。 Each store terminal 400 is an information terminal installed in each store. For example, store terminal 400 is a store cash register.
 店舗端末400は、ユーザが当該店舗に訪問した場合、ユーザに対する顔認証を受け付ける。本実施形態2では、店舗端末400は、認証対象であるユーザの少なくとも顔を撮影し、顔画像(以下、撮影画像と呼ぶこともある)又はその顔画像から抽出された顔特徴情報を、サーバ200に送信する。顔認証は、店舗端末400及びサーバ200を介して、顔認証装置100において行われる。 When the user visits the store, the store terminal 400 accepts facial authentication for the user. In the second embodiment, the store terminal 400 photographs at least the face of the user to be authenticated, and sends the facial image (hereinafter also referred to as a photographed image) or the facial feature information extracted from the facial image to the server. Send to 200. Face authentication is performed in the face authentication device 100 via the store terminal 400 and the server 200.
 ユーザの顔認証が成功した場合、店舗端末400は、ユーザの仮注文情報を受信し、表示する。仮注文情報を閲覧した店員は、仮注文情報にかかるアイテムを本注文として受け付けてよいか等、ユーザに訪問時の注文意思を確認し、注文意思を店舗端末400に入力する。あるいは、表示を閲覧したユーザが、注文意思を店舗端末400に入力してもよい。店舗端末400は、仮注文情報と注文意思とに基づいて本注文を受け付ける。本注文は、正規の注文である。本注文を受け付けた店舗端末400は、店員に対して本注文にかかるアイテムの提供を促す。 If the user's face authentication is successful, the store terminal 400 receives and displays the user's provisional order information. The store clerk who viewed the provisional order information confirms with the user the order intention at the time of the visit, such as whether the item related to the provisional order information can be accepted as a permanent order, and inputs the order intention into the store terminal 400. Alternatively, the user who viewed the display may input an order intention into the store terminal 400. The store terminal 400 accepts the actual order based on the provisional order information and the order intention. This order is a regular order. The store terminal 400 that has received the order prompts the store clerk to provide the item related to the order.
 顔認証装置100は、生体認証装置の一例であり、複数の人物の顔特徴情報を記憶する顔認証装置である。顔認証装置100は、後述する会員登録時に、ユーザの顔特徴情報を登録する。このとき顔認証装置100は、ユーザに対してユーザIDを発行する。ユーザIDは、ユーザを識別する情報であり、例えば会員番号である。また、顔認証装置100は、外部から受信した顔認証要求に応じて、当該要求に含まれる顔画像又は顔特徴情報について、各ユーザの顔特徴情報と照合を行う、顔認証機能を有する。本実施形態2では、顔認証装置100は、店舗端末400から、サーバ200を介して、来店したユーザの顔を撮影した顔画像を取得し、顔画像を用いて顔認証を実行する。そして顔認証装置100は、照合結果(顔認証結果)をサーバ200へ返信する。 The face authentication device 100 is an example of a biometric authentication device, and is a face authentication device that stores facial feature information of a plurality of people. The face authentication device 100 registers the user's facial feature information at the time of membership registration, which will be described later. At this time, the face authentication device 100 issues a user ID to the user. The user ID is information that identifies a user, and is, for example, a membership number. In addition, the face authentication device 100 has a face authentication function that, in response to a face authentication request received from the outside, verifies the facial image or facial feature information included in the request with the facial feature information of each user. In the second embodiment, the face authentication device 100 acquires a face image of a user who has visited the store from the store terminal 400 via the server 200, and performs face authentication using the face image. The face authentication device 100 then returns the matching result (face authentication result) to the server 200.
 サーバ200は、実施形態1の情報処理装置10の一例である。
 まずサーバ200は、ユーザ端末300からの会員登録要求に応じて、ユーザの会員登録を行う。
The server 200 is an example of the information processing device 10 of the first embodiment.
First, the server 200 registers the user as a member in response to a member registration request from the user terminal 300.
 そしてサーバ200は、会員登録済のユーザのユーザ端末300から仮注文要求を受信した場合、そのユーザの顔画像又は顔特徴情報に対する顔認証を顔認証装置100に要求する。そしてサーバ200は、顔認証装置100から受信した顔認証結果からユーザIDを特定する。サーバ200は、会員登録済のユーザのユーザ端末から仮注文情報を受信した場合、ユーザIDに対応付けて仮注文情報を登録する。 When the server 200 receives a provisional order request from the user terminal 300 of a registered user, it requests the face authentication device 100 to perform facial authentication on the user's facial image or facial feature information. Then, the server 200 identifies the user ID from the face authentication result received from the face authentication device 100. When the server 200 receives provisional order information from the user terminal of a user who has already registered as a member, the server 200 registers the provisional order information in association with the user ID.
 またサーバ200は、店舗を訪問したユーザの仮注文情報の出力要求を店舗端末400から受信した場合、そのユーザの顔画像又は顔特徴情報に対する顔認証を顔認証装置100に要求する。そしてサーバ200は、顔認証装置100から受信した顔認証結果からユーザIDを特定する。サーバ200は、特定したユーザIDに対応付けて登録された仮注文情報を、店舗端末400に送信する。 Further, when the server 200 receives a request from the store terminal 400 to output provisional order information of a user who visited the store, the server 200 requests the face authentication device 100 to perform facial recognition on the user's facial image or facial feature information. Then, the server 200 identifies the user ID from the face authentication result received from the face authentication device 100. The server 200 transmits temporary order information registered in association with the specified user ID to the store terminal 400.
 図4は、実施形態2にかかる顔認証装置100の構成を示すブロック図である。顔認証装置100は、顔情報DB(DataBase)110と、顔検出部120と、特徴点抽出部130と、登録部140と、認証部150とを備える。顔情報DB110は、ユーザID111と当該ユーザの顔特徴情報112とを対応付けて記憶する。顔特徴情報112は、顔画像から抽出された特徴点の集合である。尚、顔認証装置100は、顔特徴情報112の登録ユーザからの要望に応じて、顔特徴DB110内の顔特徴情報112を削除してもよい。または、顔認証装置100は、顔特徴情報112の登録から一定期間経過後に削除してもよい。 FIG. 4 is a block diagram showing the configuration of the face authentication device 100 according to the second embodiment. The face authentication device 100 includes a face information DB (DataBase) 110, a face detection section 120, a feature point extraction section 130, a registration section 140, and an authentication section 150. The face information DB 110 stores a user ID 111 and facial feature information 112 of the user in association with each other. The facial feature information 112 is a set of feature points extracted from the facial image. Note that the face authentication device 100 may delete the facial feature information 112 in the facial feature DB 110 in response to a request from a registered user of the facial feature information 112. Alternatively, the face authentication device 100 may delete the facial feature information 112 after a certain period of time has passed since it was registered.
 顔検出部120は、顔特徴情報を登録するための登録画像に含まれる顔領域を検出し、特徴点抽出部130に供給する。特徴点抽出部130は、顔検出部120が検出した顔領域から特徴点を抽出し、登録部140に顔特徴情報を供給する。また、特徴点抽出部130は、サーバ200から受信した顔画像に含まれる特徴点を抽出し、認証部150に顔特徴情報を供給する。 The face detection unit 120 detects a face area included in a registered image for registering facial feature information and supplies it to the feature point extraction unit 130. The feature point extraction unit 130 extracts feature points from the face area detected by the face detection unit 120 and supplies facial feature information to the registration unit 140. Further, the feature point extraction unit 130 extracts feature points included in the facial image received from the server 200 and supplies facial feature information to the authentication unit 150.
 登録部140は、顔特徴情報の登録に際して、ユーザID111を新規に発行する。登録部140は、発行したユーザID111と、登録画像から抽出した顔特徴情報112とを対応付けて顔情報DB110へ登録する。認証部150は、顔特徴情報112を用いた顔認証を行う。具体的には、認証部150は、顔画像から抽出された顔特徴情報と、顔情報DB110内の顔特徴情報112との照合を行う。認証部150は、顔特徴情報の一致の有無をサーバ200に返信する。顔特徴情報の一致の有無は、認証の成否に対応する。尚、顔特徴情報が一致する(一致有)とは、一致度が所定値以上である場合をいうものとする。 The registration unit 140 issues a new user ID 111 when registering facial feature information. The registration unit 140 associates the issued user ID 111 with the facial feature information 112 extracted from the registered image and registers it in the facial information DB 110. The authentication unit 150 performs face authentication using the facial feature information 112. Specifically, the authentication unit 150 compares the facial feature information extracted from the facial image with the facial feature information 112 in the facial information DB 110. The authentication unit 150 sends back to the server 200 whether or not the facial feature information matches. Whether or not the facial feature information matches corresponds to the success or failure of authentication. Note that the facial feature information matches (match exists) when the degree of matching is equal to or greater than a predetermined value.
 図5は、実施形態2にかかる顔情報登録処理の流れを示すフローチャートである。まず、顔認証装置100は、顔登録要求に含まれるユーザの登録画像を取得する(S21)。例えば、顔認証装置100は、顔登録要求を、ユーザ端末300から会員登録要求を受けたサーバ200から、ネットワークNを介して受け付ける。尚、顔認証装置100は、これに限らず、ユーザ端末300から直接、顔登録要求を受け付けてもよい。次に、顔検出部120は、登録画像に含まれる顔領域を検出する(S22)。次に、特徴点抽出部130は、ステップS22で検出した顔領域から特徴点を抽出し、登録部140に顔特徴情報を供給する(S23)。最後に、登録部140は、ユーザID111を発行し、当該ユーザID111と顔特徴情報112とを対応付けて顔情報DB110に登録する(S24)。尚、顔認証装置100は、顔登録要求元から顔特徴情報112を受信し、ユーザID111と対応付けて顔情報DB110に登録してもよい。 FIG. 5 is a flowchart showing the flow of face information registration processing according to the second embodiment. First, the face authentication device 100 acquires the user's registered image included in the face registration request (S21). For example, the face authentication device 100 receives a face registration request via the network N from the server 200 that received a member registration request from the user terminal 300. Note that the face authentication device 100 is not limited to this, and may directly receive a face registration request from the user terminal 300. Next, the face detection unit 120 detects a face area included in the registered image (S22). Next, the feature point extraction unit 130 extracts feature points from the face area detected in step S22, and supplies facial feature information to the registration unit 140 (S23). Finally, the registration unit 140 issues the user ID 111, associates the user ID 111 with the facial feature information 112, and registers it in the facial information DB 110 (S24). Note that the face authentication device 100 may receive the facial feature information 112 from the face registration request source, and register it in the facial information DB 110 in association with the user ID 111.
 図6は、実施形態2にかかる顔認証処理の流れを示すフローチャートである。まず、特徴点抽出部130は、認証用の顔特徴情報を取得する(S31)。例えば、顔認証装置100は、サーバ200からネットワークNを介して顔認証要求を受信し、顔認証要求に含まれる顔画像からステップS21からS23のように顔特徴情報を抽出する。または、顔認証装置100は、サーバ200から顔特徴情報を受信してもよい。次に、認証部150は、取得した顔特徴情報を、顔情報DB110の顔特徴情報112と照合する(S32)。顔特徴情報が一致した場合、つまり、顔特徴情報の一致度が所定値以上である場合(S33でYes)、認証部150は、顔特徴情報が一致したユーザのユーザID111を特定する(S34)。そして認証部150は、顔認証に成功した旨と特定したユーザID111とを、顔認証結果としてサーバ200に返信する(S35)。一致する顔特徴情報が存在しない場合(S33でNo)、認証部150は、顔認証に失敗した旨を、顔認証結果としてサーバ200に返信する(S36)。 FIG. 6 is a flowchart showing the flow of face authentication processing according to the second embodiment. First, the feature point extraction unit 130 acquires facial feature information for authentication (S31). For example, the face authentication device 100 receives a face authentication request from the server 200 via the network N, and extracts facial feature information from the face image included in the face authentication request as in steps S21 to S23. Alternatively, the face authentication device 100 may receive facial feature information from the server 200. Next, the authentication unit 150 compares the acquired facial feature information with the facial feature information 112 of the facial information DB 110 (S32). If the facial feature information matches, that is, if the degree of matching of the facial feature information is equal to or higher than the predetermined value (Yes in S33), the authentication unit 150 identifies the user ID 111 of the user whose facial feature information matches (S34). . The authentication unit 150 then returns the fact that the face authentication was successful and the specified user ID 111 to the server 200 as the face authentication result (S35). If matching facial feature information does not exist (No in S33), the authentication unit 150 returns the face authentication result to the server 200 to the effect that the facial authentication has failed (S36).
 図7は、実施形態2にかかるユーザ端末300の構成を示すブロック図である。ユーザ端末300は、カメラ310と、記憶部320と、通信部330と、表示部340と、入力部350と、制御部360とを備える。 FIG. 7 is a block diagram showing the configuration of the user terminal 300 according to the second embodiment. User terminal 300 includes a camera 310, a storage section 320, a communication section 330, a display section 340, an input section 350, and a control section 360.
 カメラ310は、制御部360の制御に応じて撮影を行う撮影装置である。記憶部320は、ユーザ端末300の各機能を実現するためのプログラムが格納される記憶装置である。通信部330は、ネットワークNとの通信インタフェースである。表示部340は、表示装置である。入力部350は、ユーザからの入力を受け付ける入力装置である。表示部340及び入力部350は、タッチパネルのように一体的に構成されていてもよい。制御部360は、ユーザ端末300が有するハードウェアの制御を行う。 The camera 310 is a photographing device that performs photographing under the control of the control unit 360. The storage unit 320 is a storage device that stores programs for realizing each function of the user terminal 300. The communication unit 330 is a communication interface with the network N. Display unit 340 is a display device. The input unit 350 is an input device that receives input from the user. The display section 340 and the input section 350 may be integrally configured like a touch panel. The control unit 360 controls the hardware included in the user terminal 300.
 図8は、実施形態2にかかる店舗端末400の構成を示すブロック図である。店舗端末400は、カメラ410と、記憶部420と、通信部430と、表示部440と、入力部450と、制御部460とを備える。 FIG. 8 is a block diagram showing the configuration of the store terminal 400 according to the second embodiment. Store terminal 400 includes a camera 410, a storage section 420, a communication section 430, a display section 440, an input section 450, and a control section 460.
 カメラ410は、制御部460の制御に応じて撮影を行う撮影装置である。記憶部420は、店舗端末400の各機能を実現するためのプログラムが格納される記憶装置である。通信部430は、ネットワークNとの通信インタフェースである。表示部440は、表示装置である。入力部450は、入力を受け付ける入力装置である。表示部440及び入力部450は、タッチパネルのように一体的に構成されていてもよい。制御部460は、店舗端末400が有するハードウェアの制御を行う。 The camera 410 is a photographing device that performs photographing under the control of the control unit 460. The storage unit 420 is a storage device that stores programs for realizing each function of the store terminal 400. The communication unit 430 is a communication interface with the network N. Display unit 440 is a display device. Input unit 450 is an input device that receives input. The display section 440 and the input section 450 may be integrally configured like a touch panel. The control unit 460 controls the hardware included in the store terminal 400.
 図9は、実施形態2にかかるサーバ200の構成を示すブロック図である。サーバ200は、記憶部210と、メモリ220と、通信部230と、制御部240とを備える。 FIG. 9 is a block diagram showing the configuration of the server 200 according to the second embodiment. The server 200 includes a storage section 210, a memory 220, a communication section 230, and a control section 240.
 記憶部210は、ハードディスク、フラッシュメモリ等の記憶装置である。記憶部210は、プログラム211と、ユーザDB212と、仮注文DB213と、店舗DB214と、本注文DB215とを記憶する。プログラム211は、本実施形態2にかかる情報処理方法の処理が実装されたコンピュータプログラムである。 The storage unit 210 is a storage device such as a hard disk or flash memory. The storage unit 210 stores a program 211, a user DB 212, a temporary order DB 213, a store DB 214, and a permanent order DB 215. The program 211 is a computer program in which the processing of the information processing method according to the second embodiment is implemented.
 ユーザDB212は、会員であるユーザのユーザ情報を記憶するデータベースである。具体的には、ユーザDB212は、ユーザID2121に対応付けて、ユーザ情報2122を記憶する。例えばユーザ情報2122は、属性情報と、決済のための口座情報と、電話番号やメールアドレス等の連絡先の情報とを含んでいる。 The user DB 212 is a database that stores user information of users who are members. Specifically, the user DB 212 stores user information 2122 in association with the user ID 2121. For example, the user information 2122 includes attribute information, account information for payment, and contact information such as a telephone number and email address.
 仮注文DB213は、仮注文情報を記憶するデータベースである。具体的には、仮注文DB213は、ユーザID2131に対応付けて仮注文情報2132を記憶する。例えば仮注文情報2132は、ユーザが訪問予定の店舗を識別するための店舗IDと、仮注文にかかるアイテム情報とを含んでいる。仮注文にかかるアイテム情報は、仮注文にかかるアイテムの種別、数量、カスタマイズの有無、カスタマイズ有の場合はその内容を特定する情報である。尚、仮注文情報2132には、仮注文を受け付けた時間が含まれていてもよい。尚、ユーザIDは、顔認証装置100において顔特徴情報と対応付けられているため、仮注文情報は、ユーザIDを介して顔特徴情報と関連付けられているといえる。 The temporary order DB 213 is a database that stores temporary order information. Specifically, the temporary order DB 213 stores temporary order information 2132 in association with the user ID 2131. For example, the temporary order information 2132 includes a store ID for identifying the store that the user plans to visit, and item information related to the temporary order. The item information related to the provisional order is information that specifies the type, quantity, and presence/absence of customization of the item related to the provisional order, and if customization is present, the contents thereof. Note that the temporary order information 2132 may include the time when the temporary order was received. Note that since the user ID is associated with facial feature information in the face authentication device 100, it can be said that the temporary order information is associated with the facial feature information via the user ID.
 店舗DB214は、各店舗が提供可能なアイテムを記憶するデータベースである。具体的には、店舗DB214は、店舗ID2141と、アイテムリスト2142を備える。アイテムリスト2142は、その店舗が提供可能なアイテムやその店舗が対応可能なカスタマイズメニューをリスト化したものである。本実施形態2では、店舗がカフェであるため、アイテムリスト2142はメニュー表とも称する。 The store DB 214 is a database that stores items that each store can provide. Specifically, the store DB 214 includes a store ID 2141 and an item list 2142. The item list 2142 is a list of items that the store can provide and customized menus that the store can support. In the second embodiment, since the store is a cafe, the item list 2142 is also referred to as a menu table.
 本注文DB215は、本注文情報を記憶する。具体的には、本注文DB215は、ユーザID2151に対応付けて本注文情報2152を記憶する。例えば本注文情報2152は、ユーザが本注文をした店舗を特定するための店舗IDと、本注文にかかるアイテム情報とを含んでいる。本注文にかかるアイテム情報は、本注文にかかるアイテム情報は、本注文にかかるアイテムの種別、数量、カスタマイズの有無、カスタマイズ有の場合はその内容を特定する情報である。尚、本注文情報2152には、本注文を受け付けた時間が含まれていてもよい。ここでもユーザIDは、顔認証装置100において顔情報と対応付けられているため、本注文情報は、ユーザIDを介して顔情報と関連付けられているといえる。 The actual order DB 215 stores actual order information. Specifically, the main order DB 215 stores the main order information 2152 in association with the user ID 2151. For example, the actual order information 2152 includes a store ID for identifying the store where the user placed the actual order, and item information regarding the actual order. The item information related to this order is information that specifies the type, quantity, presence or absence of customization, and if customization, the contents of the item related to this order. Note that the actual order information 2152 may include the time when the actual order was received. Since the user ID is also associated with facial information in the face authentication device 100 here, it can be said that the main order information is associated with the facial information via the user ID.
 メモリ220は、RAM(Random Access Memory)等の揮発性記憶装置であり、制御部240の動作時に一時的に情報を保持するための記憶領域である。通信部230は、ネットワークNとの通信インタフェースである。 The memory 220 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information when the control unit 240 operates. The communication unit 230 is a communication interface with the network N.
 制御部240は、サーバ200の各構成を制御するプロセッサつまり制御装置である。制御部240は、記憶部210からプログラム211をメモリ220へ読み込ませ、プログラム211を実行する。これにより制御部240は、登録部241、認証制御部242、判定部243、追加特定部244、送信制御部245、及び生成部246の機能を実現する。 The control unit 240 is a processor that controls each component of the server 200, that is, a control device. The control unit 240 loads the program 211 from the storage unit 210 into the memory 220 and executes the program 211. Thereby, the control unit 240 realizes the functions of the registration unit 241, the authentication control unit 242, the determination unit 243, the additional specification unit 244, the transmission control unit 245, and the generation unit 246.
 登録部241は、実施形態1の登録部11の一例である。
 登録部241は、通信部230がユーザ端末300から登録画像を含む会員登録要求を受信した場合、顔登録要求を顔認証装置100に送信する。そして登録部241は、顔特徴情報を登録した顔認証装置100から、発行されたユーザIDを受信する。また登録部241は、ユーザ端末300からユーザ情報を受信し、発行されたユーザIDとユーザ情報とを対応付けてユーザDB212に登録する。
The registration unit 241 is an example of the registration unit 11 of the first embodiment.
When the communication unit 230 receives a member registration request including a registered image from the user terminal 300, the registration unit 241 transmits a face registration request to the face authentication device 100. The registration unit 241 then receives the issued user ID from the face authentication device 100 that has registered the facial feature information. The registration unit 241 also receives user information from the user terminal 300, associates the issued user ID with the user information, and registers the associated information in the user DB 212.
 また登録部241は、顔認証に成功したユーザのユーザ端末300から仮注文情報を受信した場合、仮注文情報とユーザIDとを対応付けて仮注文DB213に登録する。このときユーザ端末300は店舗毎に仮注文情報を送信してよく、登録部241は、店舗毎に、仮注文情報とユーザIDとを対応付けて仮注文DB213に登録してよい。 Further, when the registration unit 241 receives temporary order information from the user terminal 300 of a user who has successfully undergone facial authentication, the registration unit 241 associates the temporary order information with the user ID and registers it in the temporary order DB 213. At this time, the user terminal 300 may transmit provisional order information for each store, and the registration unit 241 may register the provisional order information and user ID in association with each other in the provisional order DB 213 for each store.
 また登録部241は、顔認証に成功したユーザの訪問時の注文意思を含む本注文情報を店舗端末400から受信した場合、本注文情報とユーザIDとを対応付けて本注文DB215に登録する。これによりユーザが実際に注文した履歴を残すことができる。 Further, when the registration unit 241 receives from the store terminal 400 actual order information including the order intention of the user who has successfully passed facial authentication, the registration unit 241 associates the actual order information with the user ID and registers it in the actual order DB 215. This allows the user to keep a record of their actual orders.
 認証制御部242は、実施形態1の認証制御部12の一例である。認証制御部242は、顔画像に基づいて顔認証を制御することにより、ユーザのユーザIDを特定する。具体的には、認証制御部242は、ユーザ端末300又は店舗端末400から顔画像を受信した場合、顔画像又は顔画像から抽出した顔特徴情報を含む顔認証要求を、ネットワークNを介して顔認証装置100に送信する。そして認証制御部242は、顔認証装置100から顔認証結果を取得する。顔認証が成功した場合、認証制御部242は、顔認証結果からユーザIDを取り出す。 The authentication control unit 242 is an example of the authentication control unit 12 of the first embodiment. The authentication control unit 242 specifies the user ID of the user by controlling face authentication based on the face image. Specifically, when receiving a face image from the user terminal 300 or the store terminal 400, the authentication control unit 242 sends a face authentication request including the face image or facial feature information extracted from the face image via the network N. The information is sent to the authentication device 100. The authentication control unit 242 then obtains the face authentication result from the face authentication device 100. If the face authentication is successful, the authentication control unit 242 extracts the user ID from the face authentication result.
 判定部243は、判定手段とも称する。判定部243は、顔認証が成功した場合、ユーザが訪問した店舗が、ユーザが仮注文時に指定した店舗であるかを判定する。具体的には、判定部243は、顔認証が成功した場合、ユーザが訪問した店舗が、仮注文DB213の仮注文情報に含まれる店舗IDによって特定される店舗かを判定する。判定部243は、判定結果を送信制御部245に供給する。 The determining unit 243 is also referred to as determining means. If the face authentication is successful, the determination unit 243 determines whether the store visited by the user is the store specified by the user at the time of the provisional order. Specifically, if the face authentication is successful, the determination unit 243 determines whether the store visited by the user is the store specified by the store ID included in the temporary order information in the temporary order DB 213. The determination unit 243 supplies the determination result to the transmission control unit 245.
 追加特定部244は、追加特定手段とも称する。追加特定部244は、顔認証が成功した場合、仮注文DB213から仮注文情報のアイテム情報を読み出し、アイテム情報が示すアイテムと組み合わせて注文することが推奨される他のアイテムを特定する。当該他のアイテムは、追加アイテムとも称する。追加アイテムは、例えば、仮注文にかかるメニューと相性が良いサイドメニューである。例えばサーバ200は、一般的に相性が良い組み合わせとして定められたアイテム同士を互いに関連付けたテーブルを保持しており、追加特定部244は、顔認証が成功した場合に当該テーブルを用いて追加アイテムを特定してよい。あるいは追加特定部244は、ユーザのこれまでの本注文履歴に基づいて追加アイテムを特定してもよい。具体的には、追加特定部244は、顔認証が成功した場合、本注文DB215からユーザの本注文情報の履歴を読み出し、本注文情報の履歴に基づいてユーザが好んで注文するアイテムの組み合わせを分析する。そして追加特定部244は、分析結果に基づいて追加アイテムを特定する。 The additional specifying unit 244 is also referred to as additional specifying means. If the face authentication is successful, the additional specifying unit 244 reads the item information of the temporary order information from the temporary order DB 213 and specifies other items that are recommended to be ordered in combination with the item indicated by the item information. The other items are also referred to as additional items. The additional item is, for example, a side menu that goes well with the menu for the provisional order. For example, the server 200 maintains a table in which items that are generally determined to be compatible combinations are associated with each other, and the additional specifying unit 244 uses the table to select additional items when face authentication is successful. May be specified. Alternatively, the addition specifying unit 244 may specify additional items based on the user's past main order history. Specifically, if the face authentication is successful, the additional specifying unit 244 reads the history of the user's book order information from the book order DB 215, and selects the combination of items that the user prefers to order based on the history of the book order information. analyse. The addition specifying unit 244 then specifies additional items based on the analysis results.
 送信制御部245は、実施形態1の送信制御部15の一例である。まず送信制御部245は、仮注文要求をしたユーザ端末300にアイテムリストを送信する。 The transmission control unit 245 is an example of the transmission control unit 15 of the first embodiment. First, the transmission control unit 245 transmits the item list to the user terminal 300 that has made the provisional order request.
 そして送信制御部245は、仮注文後、ユーザが仮注文時に指定した店舗に来店した場合に仮注文情報を送信する。具体的には、送信制御部245は、ユーザが訪問した店舗が、仮注文DB213の仮注文情報2132に含まれる店舗IDによって特定される店舗であると判定部243が判定した場合、仮注文情報を当該の店舗の店舗端末400に送信する。これにより、仮注文情報を受信した店舗端末400は、仮注文情報を表示部440に表示し、閲覧した店員がユーザに本注文を促す。 Then, the transmission control unit 245 transmits provisional order information when the user visits the store specified at the time of the provisional order after placing the provisional order. Specifically, when the determination unit 243 determines that the store visited by the user is a store specified by the store ID included in the temporary order information 2132 of the temporary order DB 213, the transmission control unit 245 transmits the temporary order information. is transmitted to the store terminal 400 of the store in question. Thereby, the store terminal 400 that has received the provisional order information displays the provisional order information on the display unit 440, and the store clerk who viewed the information prompts the user to place the actual order.
 一方、送信制御部245は、ユーザが訪問した店舗が仮注文情報に含まれる店舗IDによって特定される店舗でないと判定部243が判定した場合は、当該の店舗の店舗端末400に仮注文情報を送信しない。これによりユーザの意図しない店舗に仮注文情報が送信されることを防ぐことができる。 On the other hand, if the determination unit 243 determines that the store visited by the user is not the store specified by the store ID included in the temporary order information, the transmission control unit 245 transmits the temporary order information to the store terminal 400 of the store. Do not send. This can prevent provisional order information from being sent to a store that is not intended by the user.
 尚、送信制御部245は、仮注文情報を店舗端末400に送信するときに、追加特定部244が特定した追加アイテムのアイテム情報も店舗端末400に送信する。追加アイテムのアイテム情報は追加アイテム情報とも称する。追加アイテム情報の送信は、仮注文情報の送信と同時であってもよいし、仮注文情報の送信の前後で行われてもよい。追加アイテム情報を受信した店舗端末400は、追加アイテム情報を表示部440に表示し、閲覧した店員がユーザに追加アイテムをリコメンドする。 Incidentally, when transmitting the provisional order information to the store terminal 400, the transmission control section 245 also transmits to the store terminal 400 the item information of the additional item specified by the addition specifying section 244. Item information of additional items is also referred to as additional item information. The additional item information may be transmitted at the same time as the provisional order information, or may be performed before or after the provisional order information is transmitted. The store terminal 400 that has received the additional item information displays the additional item information on the display unit 440, and the clerk who viewed the information recommends the additional item to the user.
 生成部246は、本注文DB215に蓄積された本注文情報の履歴に基づいて、ユーザ毎に販促情報を生成する。販促情報は、ユーザへリコメンドするアイテムに関する情報及びアイテムの割引情報の少なくとも一方を含む。このようにユーザにメリットを与えることで、サービスの活発な利用を促すことができる。 The generation unit 246 generates promotional information for each user based on the history of regular order information accumulated in the regular order DB 215. The promotional information includes at least one of information regarding items recommended to the user and discount information for the items. By providing benefits to users in this way, active use of the service can be encouraged.
 図10は、実施形態2にかかる会員登録処理の流れを示すシーケンス図である。まずユーザ端末300は、ユーザUを撮影し(S500)、撮影により生成された登録画像を会員登録要求に含ませて、サーバ200へ送信する(S501)。そしてサーバ200の登録部241は、受信した会員登録要求に含まれる登録画像を顔登録要求に含ませて、顔認証装置100に送信する(S502)。そして顔認証装置100は、受信した顔登録要求に含まれる登録画像に基づいて、ユーザUの顔情報(顔特徴情報)を登録する(S503)。そして顔認証装置100は、発行したユーザIDをサーバ200に通知する(S504)。またユーザ端末300は、ユーザ情報をサーバ200に送信する(S505)。このときユーザ情報は、属性情報と、口座情報と、連絡先とを含んでよい。サーバ200の登録部241は、通知されたユーザID及びユーザ情報を、互いに対応付けてユーザDB212に登録する(S506)。 FIG. 10 is a sequence diagram showing the flow of member registration processing according to the second embodiment. First, the user terminal 300 photographs the user U (S500), includes the registration image generated by the photographing in a membership registration request, and transmits the membership registration request to the server 200 (S501). Then, the registration unit 241 of the server 200 includes the registered image included in the received member registration request in a face registration request and transmits the face registration request to the face authentication device 100 (S502). The face authentication device 100 then registers the face information (facial feature information) of the user U based on the registration image included in the received face registration request (S503). The face authentication device 100 then notifies the server 200 of the issued user ID (S504). The user terminal 300 also transmits user information to the server 200 (S505). At this time, the user information may include attribute information, account information, and contact information. The registration unit 241 of the server 200 registers the notified user ID and user information in the user DB 212 in association with each other (S506).
 図11は、実施形態2にかかる仮注文処理の流れを示すシーケンス図である。仮注文処理は、会員登録処理の後に行われる。まずユーザ端末300はユーザUを撮影する(S510)。そしてユーザは仮注文の対象となる店舗を指定する。ユーザ端末300は、撮影により生成された顔画像と、指定された店舗の店舗IDとを仮注文要求に含ませて、サーバ200へ送信する(S511)。 FIG. 11 is a sequence diagram showing the flow of temporary order processing according to the second embodiment. Temporary order processing is performed after member registration processing. First, the user terminal 300 photographs the user U (S510). The user then specifies the store to which the temporary order is to be placed. The user terminal 300 includes the facial image generated by the photographing and the store ID of the specified store in a temporary order request, and transmits the provisional order request to the server 200 (S511).
 サーバ200の認証制御部242は、受信した顔画像内のユーザUの顔領域に対する顔認証要求を、顔認証装置100へ送信する(S512)。そして顔認証装置100は、受信した顔認証要求に含まれる顔画像内のユーザUの顔領域について顔認証を行う(S513)。ここでは、顔認証に成功したユーザIDがあったものとする。顔認証装置100は、顔認証に成功した旨及びユーザIDを含めた顔認証結果を、サーバ200へ送信する(S514)。このときサーバ200は、顔認証が成功したか否かを、ユーザ端末300に通知してよい。 The authentication control unit 242 of the server 200 transmits a face authentication request for the face area of the user U in the received face image to the face authentication device 100 (S512). The face authentication device 100 then performs face authentication on the face area of the user U in the face image included in the received face authentication request (S513). Here, it is assumed that there is a user ID whose face has been successfully authenticated. The face authentication device 100 transmits the face authentication result including the fact that the face authentication was successful and the user ID to the server 200 (S514). At this time, the server 200 may notify the user terminal 300 whether or not face authentication was successful.
 顔認証結果を受信したサーバ200の送信制御部245は、店舗DB214において、仮注文要求に含まれる店舗IDに対応付けられたアイテムリストを読み出し、ユーザ端末300に送信する(S515)。 The transmission control unit 245 of the server 200, which has received the face authentication result, reads the item list associated with the store ID included in the provisional order request from the store DB 214, and transmits it to the user terminal 300 (S515).
 アイテムリストを受信したユーザ端末300は、表示部340にアイテムリストを表示する(S516)。そしてユーザ端末300は、ユーザから仮注文にかかるアイテムの種別、数量、カスタマイズの有無、カスタマイズ有の場合はその内容の選択操作を受け付ける(S517)。 The user terminal 300 that has received the item list displays the item list on the display unit 340 (S516). Then, the user terminal 300 receives a selection operation from the user regarding the type of item, quantity, whether customization is required, and if customization is required, the contents of the item for the provisional order (S517).
 ここで図12は、実施形態2にかかるユーザ端末300の表示の一例を示す図である。表示部340には、ユーザが仮注文要求時に指定した店舗Aのメニュー表が示されている。ユーザは、本表示画面において、アイテムの種別として、メインメニュー及びサイドメニューが選択できるようになっている。さらにユーザは、本表示画面において、選択したメニューに対して、調理の好み及び好みのトッピングが指定できるようになっている。調理の好みは、本例では、コーヒー豆の好みの焙煎度合である。ユーザ端末300は、選択された情報をアイテム情報として受け付ける。 Here, FIG. 12 is a diagram showing an example of the display of the user terminal 300 according to the second embodiment. The display section 340 shows a menu table for store A that the user specified when requesting a provisional order. On this display screen, the user can select a main menu or a side menu as the type of item. Furthermore, the user can specify cooking preferences and desired toppings for the selected menu on this display screen. The cooking preference, in this example, is the desired degree of roasting of the coffee beans. User terminal 300 receives the selected information as item information.
 このようにユーザは、メニュー及びカスタマイズを来店前に検討して詳細に指定できるため、来店時に注文の内容を細かく伝える手間が省ける。また来店時の注文に要する時間を短縮できるため、店舗におけるレジの混雑を解消できる。 In this way, the user can consider and specify the menu and customization in detail before visiting the store, which saves the user the trouble of conveying the details of the order when visiting the store. Additionally, the time required to place an order when visiting a store can be shortened, eliminating crowding at cash registers at stores.
 図11に戻り、説明を続ける。選択操作を受け付けたユーザ端末300は、選択操作に対応するアイテム情報と、その店舗の店舗IDとを仮注文情報に含ませて、仮注文情報をサーバ200に送信する(S518)。 Returning to FIG. 11, the explanation will continue. The user terminal 300 that has received the selection operation includes the item information corresponding to the selection operation and the store ID of the store in the temporary order information, and transmits the temporary order information to the server 200 (S518).
 仮注文情報を受信したサーバ200の登録部241は、顔認証結果から特定したユーザIDに対応付けて、仮注文情報を仮注文DB213に登録する(S519)。この時点では、仮注文情報は店舗端末400に送信されなくてよい。 The registration unit 241 of the server 200 that has received the provisional order information registers the provisional order information in the provisional order DB 213 in association with the user ID specified from the face authentication result (S519). At this point, provisional order information does not need to be transmitted to store terminal 400.
 尚、登録部241は、ユーザ端末300から仮注文情報のキャンセルの要求を受信した場合、仮注文DB213から仮注文情報を削除してよい。これにより、ユーザが仮注文にかかるアイテムを受け取りに行けなくなった場合でも、ユーザ端末300から容易にキャンセルできる。 Note that when the registration unit 241 receives a request to cancel provisional order information from the user terminal 300, it may delete the provisional order information from the provisional order DB 213. Thereby, even if the user is unable to pick up the item related to the provisional order, the user can easily cancel the order from the user terminal 300.
 図13は、実施形態2にかかる本注文処理の流れを示すシーケンス図である。まず店舗端末400は、店舗のレジを訪問したユーザを撮影する(S520)。そして店舗端末400は、撮影により生成された顔画像とその店舗の店舗IDとを出力要求に含ませて、サーバ200に送信する(S521)。情報処理システム1000は、S512~S513と同様のS522~S523を実行する。ここでは、顔認証に成功したユーザIDがあったものとする。顔認証装置100は、顔認証に成功した旨及びユーザIDを含めた顔認証結果を、サーバ200へ送信する(S524)。このときサーバ200は、顔認証が成功したか否かを、店舗端末400に通知してよい。サーバ200の認証制御部242は、顔認証結果に含まれるユーザIDを抽出する。 FIG. 13 is a sequence diagram showing the flow of the main order processing according to the second embodiment. First, the store terminal 400 photographs a user who visited the store's cash register (S520). Then, the store terminal 400 includes the face image generated by the photographing and the store ID of the store in an output request, and transmits the output request to the server 200 (S521). The information processing system 1000 executes S522 to S523, which are similar to S512 to S513. Here, it is assumed that there is a user ID whose face has been successfully authenticated. The face authentication device 100 transmits the face authentication result including the fact that the face authentication was successful and the user ID to the server 200 (S524). At this time, the server 200 may notify the store terminal 400 whether or not face authentication was successful. The authentication control unit 242 of the server 200 extracts the user ID included in the face authentication result.
 次にサーバ200の判定部243は、抽出したユーザIDを用いて、仮注文DB213において当該ユーザIDに対応付けられた仮注文情報を特定する(S525)。そして判定部243は、出力要求元の店舗端末400の店舗IDと、仮注文情報に含まれる店舗IDとを照合し、両者が一致するかを判定する(S526)。ここで、両者は一致したものとする。 Next, the determination unit 243 of the server 200 uses the extracted user ID to identify provisional order information associated with the user ID in the provisional order DB 213 (S525). Then, the determination unit 243 compares the store ID of the store terminal 400 that is the source of the output request and the store ID included in the provisional order information, and determines whether the two match (S526). Here, it is assumed that both match.
 次に追加特定部244は、仮注文情報に含まれるアイテム情報のアイテムに対応する追加アイテムを特定する(S527)。 Next, the addition specifying unit 244 specifies an additional item corresponding to the item in the item information included in the provisional order information (S527).
 送信制御部245は、判定部243による照合判定の結果に応じて、仮注文情報のアイテム情報と、追加アイテムにかかるアイテム情報とを店舗端末400に送信する(S528)。 The transmission control unit 245 transmits the item information of the provisional order information and the item information regarding the additional item to the store terminal 400 according to the result of the comparison determination by the determination unit 243 (S528).
 アイテム情報を受信した店舗端末400は、受信したアイテム情報を表示部440に表示する(S529)。そして店舗端末400は、ユーザの注文意思を確認した店員、又はユーザ本人から、ユーザの注文意思の入力操作を受け付ける(S530)。 The store terminal 400 that has received the item information displays the received item information on the display unit 440 (S529). Then, the store terminal 400 receives an input operation of the user's order intention from the store clerk who has confirmed the user's order intention or from the user himself/herself (S530).
 図14は、実施形態2にかかる店舗端末400の表示の一例を示す図である。表示部440には、仮注文にかかるアイテム及びカスタマイズの内容と、仮注文にかかるアイテムを本注文するかを問うメッセージとが表示される。ユーザは、仮注文の内容を確認して、仮注文にかかるアイテム及びカスタマイズの注文意思を回答する。 FIG. 14 is a diagram showing an example of a display on the store terminal 400 according to the second embodiment. The display unit 440 displays the item and customization details related to the provisional order, and a message asking whether to make a permanent order for the item related to the provisional order. The user confirms the contents of the tentative order and responds with his or her intention to order the items and customization related to the tentative order.
 回答を受け付けた店舗端末400は、次に、図15に示す表示画面を表示する。図15は、実施形態2にかかる店舗端末400の表示の一例を示す図である。表示部440には、追加アイテムの内容が表示される。ユーザは、追加アイテムの内容を確認して、追加アイテムの注文意思を回答する。 The store terminal 400 that has received the response then displays the display screen shown in FIG. 15. FIG. 15 is a diagram showing an example of a display on the store terminal 400 according to the second embodiment. The display section 440 displays the contents of the additional item. The user confirms the contents of the additional item and responds with his or her intention to order the additional item.
 そして店舗端末400は、仮注文にかかるアイテム及びカスタマイズの注文意思並びに追加アイテムの注文意思に基づいて、本注文情報を生成する。 Then, the store terminal 400 generates main order information based on the intention to order items and customization related to the provisional order, and the intention to order additional items.
 店舗端末400は、表示部440や、その店舗端末400以外の店舗内の端末に本注文情報を表示させる等して、店員に対して本注文にかかるアイテムの提供を促す。これにより、ユーザは、来店時の注文の手間を極力省きつつ、希望通りのアイテムを容易に注文できる。本例のようにアイテムが飲食にかかる商品や食事メニューである場合は、来店時に仮注文の内容を本注文とすることで、ユーザは来店後に出来立てを受け取ることができる。 The store terminal 400 displays this order information on the display unit 440 or other terminals in the store other than the store terminal 400 to prompt the store staff to provide the items related to the order. As a result, the user can easily order the desired item while minimizing the effort of ordering when visiting the store. If the item is a product for eating or drinking or a meal menu as in this example, the user can receive the freshly prepared food after visiting the store by converting the tentative order into a permanent order when the user visits the store.
 尚、店舗端末400は、仮注文にかかるアイテムを本注文としない場合は、店員又はユーザ本人から、本注文にかかるアイテムの種別、数量、カスタマイズの有無、カスタマイズがある場合はその内容の選択操作を受け付ける。このとき店舗端末400は、図12に示す表示画面と同様の画面を表示部440に表示させてよい。そして店舗端末400は、選択された情報を本注文情報として受け付ける。これによりユーザの来店時の気分に合ったアイテムを注文できる。 In addition, if the store terminal 400 does not want to make the items related to the provisional order a permanent order, the store clerk or the user himself/herself can select the type, quantity, whether or not to customize the items related to the main order, and if there is customization, the contents. accept. At this time, the store terminal 400 may display a screen similar to the display screen shown in FIG. 12 on the display unit 440. The store terminal 400 then receives the selected information as actual order information. This allows users to order items that match their mood when they visit the store.
 図13に戻り、説明を続ける。本注文情報を生成した店舗端末400は、本注文情報に、その店舗の店舗IDを含ませて、サーバ200に送信する(S531)。
サーバ200の登録部241は、本注文情報を、顔認証結果に含まれるユーザIDに対応付けて本注文DB215に登録する(S532)。
Returning to FIG. 13, the explanation will be continued. The store terminal 400 that has generated the actual order information includes the store ID of the store in the actual order information and transmits it to the server 200 (S531).
The registration unit 241 of the server 200 registers the regular order information in the regular order DB 215 in association with the user ID included in the face authentication result (S532).
 尚、このときサーバ200は、ユーザDB212のユーザID2121に対応付けられた口座情報を用いて、決済を行ってよい。これにより、来店時の決済の手間を省くことができる。 At this time, the server 200 may perform the payment using the account information associated with the user ID 2121 of the user DB 212. This saves you the hassle of making payments when you visit the store.
 このように実施形態2によれば、ユーザが来店した時の注文の手間を好適に省きつつ、ユーザの事前の希望通りの、又はその時の気分に合った柔軟な注文を可能とする。またサーバ200は、仮注文のアイテムに合った追加アイテムをリコメンドすることで、店舗の売り上げ向上に寄与できる。 As described above, according to the second embodiment, it is possible to suitably save the trouble of ordering when the user visits the store, and to make it possible to order flexibly according to the user's prior wishes or according to his or her mood at the time. Additionally, the server 200 can contribute to improving store sales by recommending additional items that match the tentatively ordered items.
 図16は、実施形態2にかかる販促情報の提供処理の流れを示すシーケンス図である。販促情報の提供処理は、本注文をトリガとして行われてもよいし、本注文のタイミングに関わらず、例えば定期的に行われてもよい。尚、販促情報の提供処理は、ユーザ毎に行われる。 FIG. 16 is a sequence diagram showing the flow of promotional information provision processing according to the second embodiment. The process of providing promotional information may be performed using the main order as a trigger, or may be performed periodically, for example, regardless of the timing of the main order. Note that the process of providing promotional information is performed for each user.
 まずサーバ200の生成部246は、本注文DB215においてユーザのユーザIDに対応付けられた本注文情報の履歴を読み出す(S535)。そして生成部246は、本注文情報の履歴に基づいて販促情報を生成する(S536)。例えば生成部246は、ユーザ毎に、本注文情報の履歴からそのユーザの嗜好性を分析し、分析結果に基づいて好みのアイテムの種別又は好みの店舗を特定してよい。そして生成部246は、特定した店舗やアイテムの種別に関連する販促情報を、ユーザのための販促情報として生成してよい。 First, the generation unit 246 of the server 200 reads the history of the regular order information associated with the user ID of the user in the regular order DB 215 (S535). The generation unit 246 then generates promotional information based on the history of this order information (S536). For example, the generation unit 246 may analyze the preferences of each user from the history of this order information, and specify the type of item or store of preference based on the analysis result. The generation unit 246 may then generate promotional information related to the specified store or type of item as promotional information for the user.
 嗜好性の分析は、本注文情報の履歴から算出される店舗の利用頻度やアイテムの購入頻度に基づいてもよい。尚、嗜好性の分析は、本注文情報の履歴に加えて、ユーザの属性情報に基づいてもよい。 The analysis of preferences may be based on the frequency of store usage and item purchase frequency calculated from the history of this order information. The analysis of preferences may be based on the user's attribute information in addition to the history of the order information.
 また例えば生成部246は、ユーザ毎に、店舗の利用時間帯を分析し、ユーザが利用する傾向が高い時間帯に適したアイテムの販促情報を、ユーザのための販促情報として生成してもよい。 Furthermore, for example, the generation unit 246 may analyze the usage time of the store for each user and generate promotional information for items suitable for the time when the user is likely to use the store as the promotional information for the user. .
 そして生成部246は、販促情報をそのユーザのユーザ端末300に送信する(S537)。販促情報を受信したユーザ端末300は、表示部340に販促情報を表示させるなどして、ユーザに通知する(S538)。 The generation unit 246 then transmits the promotional information to the user terminal 300 of that user (S537). The user terminal 300 that has received the promotional information notifies the user by displaying the promotional information on the display unit 340 (S538).
 図17は、実施形態2にかかるユーザ端末300の表示の一例を示す図である。表示部340には、ユーザXにおすすめの販促情報が表示されている。一例として表示部340には、おすすめの販促情報として、ユーザXの行きつけの店舗Aの割引情報と、よく購入するアイテムに関連した他店舗のアイテムのリコメンド情報とが表示されている。 FIG. 17 is a diagram showing an example of a display on the user terminal 300 according to the second embodiment. Display unit 340 displays promotional information recommended for user X. As an example, the display unit 340 displays, as recommended promotional information, discount information for store A that user X frequents, and recommendation information for items from other stores that are related to frequently purchased items.
 このようにサーバ200は、パーソナライズされた販促情報をユーザに提供することで、ユーザにメリットを感じさせることができる。その結果、ユーザに対してサービスの利用を促進できる。 In this way, the server 200 can make the user feel the benefits by providing the user with personalized promotional information. As a result, it is possible to encourage users to use the service.
 尚、本開示は、任意の処理を、プロセッサにコンピュータプログラムを実行させることにより実現することが可能である。 Note that the present disclosure can implement arbitrary processing by causing a processor to execute a computer program.
 上述の例において、プログラムは、コンピュータに読み込まれた場合に、実施形態で説明された1又はそれ以上の機能をコンピュータに行わせるための命令群(又はソフトウェアコード)を含む。プログラムは、非一時的なコンピュータ可読媒体又は実体のある記憶媒体に格納されてもよい。限定ではなく例として、コンピュータ可読媒体又は実体のある記憶媒体は、random-access memory(RAM)、read-only memory(ROM)、フラッシュメモリ、solid-state drive(SSD)又はその他のメモリ技術、CD-ROM、digital versatile disc(DVD)、Blu-ray(登録商標)ディスク又はその他の光ディスクストレージ、磁気カセット、磁気テープ、磁気ディスクストレージ又はその他の磁気ストレージデバイスを含む。プログラムは、一時的なコンピュータ可読媒体又は通信媒体上で送信されてもよい。限定ではなく例として、一時的なコンピュータ可読媒体又は通信媒体は、電気的、光学的、音響的、またはその他の形式の伝搬信号を含む。 In the examples above, the program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more of the functions described in the embodiments. The program may be stored on a non-transitory computer readable medium or a tangible storage medium. By way of example and not limitation, computer readable or tangible storage media may include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD - Including ROM, digital versatile disc (DVD), Blu-ray disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disc storage or other magnetic storage device. The program may be transmitted on a transitory computer-readable medium or a communication medium. By way of example and not limitation, transitory computer-readable or communication media includes electrical, optical, acoustic, or other forms of propagating signals.
 尚、本開示は上記実施形態に限られたものではなく、趣旨を逸脱しない範囲で適宜変更することが可能である。例えば上記実施形態2では、顔認証機能を顔認証装置100が有していたが、顔認証装置100に代えて又は加えて、サーバ200が顔認証機能を有してもよい。 Note that the present disclosure is not limited to the above embodiments, and can be modified as appropriate without departing from the spirit. For example, in the second embodiment, the face authentication device 100 has the face authentication function, but the server 200 may have the face authentication function instead of or in addition to the face authentication device 100.
 また上記実施形態2では、店舗端末400は本注文時にユーザの注文意思を確認した上で、本注文情報を生成し、そして店員に対して本注文にかかるアイテムの提供を促していた。しかし店舗端末400は、注文意思の確認を待たず、仮注文情報を本注文情報として生成し、店員に対して本注文にかかるアイテムの提供を促してよい。 Furthermore, in the second embodiment, the store terminal 400 confirms the user's intention to place the order, generates the order information, and prompts the store clerk to provide the item for the order. However, the store terminal 400 may generate provisional order information as permanent order information and prompt the store clerk to provide the items related to the permanent order, without waiting for confirmation of the order intention.
 またユーザ端末300は、同じ店舗に対する複数の仮注文情報の入力をユーザから受け付けて、当該複数の仮注文情報をサーバ200の仮注文DB213に登録させてよい。一例としてユーザが、店舗Aのブレンドコーヒーを注文する場合のカスタマイズの内容を、第1の仮注文情報として入力し、ユーザが店舗Aのカフェラテを注文する場合のカスタマイズの内容を、第2の仮注文情報として入力してよい。 Further, the user terminal 300 may accept input of multiple pieces of temporary order information for the same store from the user, and register the multiple pieces of temporary order information in the temporary order DB 213 of the server 200. As an example, the user inputs the customization details when ordering a blended coffee from store A as the first temporary order information, and inputs the customization contents when the user orders a cafe latte from store A into the second temporary order information. May be entered as order information.
 サーバ200の登録部241は、当該複数の仮注文情報と、ユーザIDとを対応付けて、仮注文DB213に登録してよい。そして送信制御部245は、ユーザが来店した際に、顔認証が成功したユーザのユーザIDに対応付けられた複数の仮注文情報の全部を店舗端末400に送信してもよいし、少なくとも1つを選択して店舗端末400に送信してもよい。送信制御部245が複数の仮注文情報を店舗端末400に送信した場合は、店舗端末400は、ユーザが本注文情報とする仮注文情報を選択できるように、複数の仮注文情報を表示してよい。これによりユーザがその時の気分に合わせて容易に注文できる。 The registration unit 241 of the server 200 may associate the plural pieces of provisional order information with the user ID and register them in the provisional order DB 213. Then, when the user visits the store, the transmission control unit 245 may transmit all of the plural pieces of provisional order information associated with the user ID of the user whose face authentication has been successfully performed to the store terminal 400, or transmit at least one piece of provisional order information to the store terminal 400. may be selected and transmitted to the store terminal 400. When the transmission control unit 245 transmits a plurality of pieces of provisional order information to the store terminal 400, the store terminal 400 displays the plurality of pieces of provisional order information so that the user can select the provisional order information to be used as the main order information. good. This allows users to easily order according to their mood at the time.
 尚、仮注文DB213の仮注文情報には、店舗IDに代えて又は加えて、同じ系列の店舗同士で構成されたグループを識別するグループIDを含んでよい。同じグループであれば取り扱うアイテムは同じか類似している可能性が高い。そこで送信制御部245は、仮注文要求時に同じグループIDであれば共通のアイテムリストをユーザ端末300に送信してよい。そして登録部241は、グループごとに、仮注文情報と、ユーザIDとを対応付けて、仮注文DB213に登録してよい。そして判定部243は、ユーザが来店時に、ユーザが訪問した店舗が属するグループが仮注文DB213の仮注文情報に含まれるグループIDによって特定されるグループかを判定してよい。送信制御部245は、ユーザが訪問した店舗が属するグループが仮注文情報に含まれるグループIDによって特定されるグループである場合に仮注文情報を店舗端末400に送信し、そうでない場合に送信しなくてよい。これによりユーザは同じグループに属する店舗であれば、支店に関わらず希望通りのアイテムを適切に仮注文できる。 Note that the temporary order information in the temporary order DB 213 may include a group ID that identifies a group made up of stores of the same series, instead of or in addition to the store ID. If they are in the same group, the items they handle are likely to be the same or similar. Therefore, the transmission control unit 245 may transmit a common item list to the user terminal 300 if the groups have the same ID when requesting a temporary order. The registration unit 241 may then associate the provisional order information with the user ID for each group and register them in the provisional order DB 213. Then, when the user visits the store, the determination unit 243 may determine whether the group to which the store visited by the user belongs is the group specified by the group ID included in the temporary order information in the temporary order DB 213. The transmission control unit 245 transmits the provisional order information to the store terminal 400 if the group to which the store visited by the user belongs is a group specified by the group ID included in the provisional order information, and does not transmit the provisional order information if not. It's fine. As a result, the user can appropriately provisionally order the desired item regardless of the branch as long as the store belongs to the same group.
 尚、仮注文情報にグループIDが含まれる場合、追加特定部244は、グループ全体で共通のアイテムから追加アイテムを選択してよい。また生成部246は、同じグループ内で共通に利用可能なアイテムの販促情報を生成してよい。 Note that if the temporary order information includes a group ID, the addition specifying unit 244 may select an additional item from items common to the entire group. The generation unit 246 may also generate promotional information for items that can be commonly used within the same group.
 ここで同じグループIDであっても店舗ごとに基本メニューや限定メニューが異なる場合がある。したがって送信制御部245は、同じグループIDであっても店舗が異なる場合は、仮注文要求時に異なるアイテムリストをユーザ端末300に送信してもよい。また追加特定部244は、同じグループIDであっても店舗が異なる場合は、店舗毎に追加アイテムを選択してもよい。例えば追加特定部244は、来店した店舗限定のアイテムや来店した店舗が推奨するアイテムを優先的に選択してもよい。生成部246が販促情報を生成する場合にも、同じグループであっても異なる店舗については異なるアイテムの販促情報を生成してよい。 Here, even if the group ID is the same, the basic menu and limited menu may differ from store to store. Therefore, if the group IDs are the same but the stores are different, the transmission control unit 245 may transmit a different item list to the user terminal 300 when requesting a temporary order. Moreover, if the stores are different even if the group ID is the same, the addition specifying unit 244 may select additional items for each store. For example, the additional specifying unit 244 may preferentially select items limited to the store visited or items recommended by the store visited. When the generation unit 246 generates promotional information, it may generate promotional information for different items for different stores even if they are in the same group.
 またサーバ200は、仮注文情報が仮注文DB213に登録されてから所定時間以上経過している場合は、仮注文情報を無効化してよい。このとき登録部241が仮注文情報を仮注文DB213から削除してもよいし、送信制御部245が、仮注文情報及び追加アイテムのアイテム情報を店舗端末400に送信しないようにしてもよい。これにより、ユーザの直近の気分に合わせて事前登録した内容を本注文に反映させることを可能しつつ、気分が変わったり受け取りが困難になった場合は操作不要でキャンセルできる。 Additionally, the server 200 may invalidate the provisional order information if a predetermined period of time or more has passed since the provisional order information was registered in the provisional order DB 213. At this time, the registration unit 241 may delete the temporary order information from the temporary order DB 213, or the transmission control unit 245 may not transmit the temporary order information and the item information of the additional item to the store terminal 400. This allows the pre-registered contents to be reflected in the actual order according to the user's most recent mood, while also allowing the user to cancel without any operations if the user's mood changes or it becomes difficult to receive the order.
 また上記実施形態2では、サーバ200の追加特定部244は、仮注文にかかるアイテムと相性が良い追加アイテムを特定し、送信制御部245が店舗端末400を介して追加アイテムをリコメンドするとした。このとき追加特定部244は、ユーザによる店舗の利用態様に応じて、リコメンドする追加アイテムを異ならせてもよい。例えば追加特定部244は、ユーザがイートイン利用である場合は第1テーブルを用いて追加アイテムを特定し、ユーザがテイクアウト利用である場合、第1テーブルとは異なる第2テーブルを用いて追加アイテムを特定してよい。例えば第1テーブルは、相性が良いアイテム同士を関連付けたテーブルであり、第2テーブルは、テイクアウトメニューのうち、相性が良いアイテム同士を関連付けたテーブルである。一例としてユーザがブレンドコーヒーを仮注文している場合に、サーバ200は、ユーザがイートイン利用を希望する場合はケーキを、ユーザがテイクアウト利用を希望する場合はサンドイッチを、追加アイテムとしてリコメンドしてよい。これにより、利用実態に合ったリコメンドを行うことが可能となる。 Furthermore, in the second embodiment, the addition specifying unit 244 of the server 200 specifies additional items that are compatible with the item placed in the provisional order, and the transmission control unit 245 recommends the additional items via the store terminal 400. At this time, the addition specifying unit 244 may recommend different additional items depending on how the user uses the store. For example, the addition specifying unit 244 uses a first table to specify additional items when the user is a dine-in customer, and uses a second table different from the first table when the user is a take-out customer to identify additional items. May be specified. For example, the first table is a table that associates items that go well together, and the second table is a table that associates items that go well together from the takeout menu. For example, when a user temporarily orders blended coffee, the server 200 may recommend a cake as an additional item if the user wishes to eat in, or a sandwich if the user wishes to take out. . This makes it possible to make recommendations that match the actual usage situation.
 またサーバ200は、ユーザが所定の利用態様で店舗の利用を希望する場合にのみ、追加アイテムをリコメンドしてもよい。例えば追加特定部244は、ユーザがイートイン利用を希望する場合は追加アイテムを特定し、ユーザがテイクアウト利用を希望する場合は追加アイテムの特定をしなくてよい。このとき追加アイテムの特定には、上記第1テーブルを用いてよい。 Additionally, the server 200 may recommend additional items only when the user wishes to use the store in a predetermined usage mode. For example, the addition specifying unit 244 does not need to specify additional items when the user wishes to use the service for eat-in, but does not need to specify additional items when the user wishes to use the service for take-out. At this time, the above first table may be used to specify the additional item.
 また上記実施形態2では、ユーザの顔画像を含む仮注文情報の出力要求を、店舗端末400から受信するとしたが、店舗端末400に代えてユーザ端末300から受信してもよい。この場合、ユーザ端末300は、自己の位置情報から店舗IDを特定して出力要求に含めてもよいし、店舗IDに代えて自己の位置情報を出力要求に含めてもよい。またこの場合、サーバ200の送信制御部245は、仮注文情報と追加アイテムのアイテム情報とを、ユーザ端末300に送信してもよいし、ユーザが訪問した店舗の店舗端末400に送信してもよい。 Furthermore, in the second embodiment, the request to output provisional order information including the user's face image is received from the store terminal 400, but the request may be received from the user terminal 300 instead of the store terminal 400. In this case, the user terminal 300 may specify the store ID from its own location information and include it in the output request, or may include its own location information in the output request instead of the store ID. In this case, the transmission control unit 245 of the server 200 may transmit the provisional order information and the item information of the additional item to the user terminal 300 or to the store terminal 400 of the store visited by the user. good.
 上記の実施形態の一部又は全部は、以下の付記のようにも記載されうるが、以下には限られない。
   (付記1)
 ユーザが使用するユーザ端末から、仮注文にかかるアイテムを特定するためのアイテム情報を少なくとも含む仮注文情報を受信した場合、前記仮注文情報を、前記ユーザの生体情報に関連付けて登録する登録手段と、
 店舗を訪問したユーザの生体情報を受信した場合、生体認証を制御する認証制御手段と、
 前記生体認証が成功した場合、前記ユーザの前記生体情報に関連付けられた前記仮注文情報を、前記ユーザが訪問した前記店舗の端末に送信する送信制御手段と
 を備える情報処理装置。
   (付記2)
 前記仮注文情報は、店舗を識別する店舗IDをさらに含み、
 前記情報処理装置は、前記生体認証が成功した場合、前記ユーザが訪問した店舗が、前記ユーザの生体情報に関連付けられた仮注文情報に含まれる店舗IDによって特定される店舗か否かを判定する判定手段をさらに備え、
 前記送信制御手段は、前記ユーザが訪問した前記店舗が前記店舗IDによって特定される店舗でない場合、前記ユーザが訪問した前記店舗の端末に前記仮注文情報を送信しない
 付記1に記載の情報処理装置。
   (付記3)
 前記生体認証が成功した場合、前記仮注文にかかるアイテムと組み合わせて注文することが推奨される追加アイテムを特定する追加特定手段をさらに備え、
 前記送信制御手段は、特定した前記追加アイテムの情報を、前記仮注文情報とともに前記店舗の端末に送信する
 付記1又は2に記載の情報処理装置。
   (付記4)
 前記登録手段は、前記ユーザが訪問した前記店舗の端末から、前記ユーザの訪問時の注文意思を含む本注文情報を受信した場合、前記本注文情報を前記ユーザの生体情報に関連付けて登録する
 付記3に記載の情報処理装置。
   (付記5)
 前記ユーザの生体情報に関連づけられた前記本注文情報の履歴に基づいて、前記ユーザへの販促情報を生成する生成手段をさらに備え、
 前記送信制御手段は、前記販促情報を前記ユーザ端末に送信する
 付記4に記載の情報処理装置。
   (付記6)
 前記追加特定手段は、
 前記生体認証が成功した場合、前記ユーザの生体情報に関連付けられた本注文情報の履歴を読み出し、
 前記本注文情報の履歴に基づいて追加アイテムを特定し、
 前記送信制御手段は、特定した前記追加アイテムを、前記仮注文情報とともに前記店舗の端末に送信する
 付記4又は5に記載の情報処理装置。
   (付記7)
 前記アイテムは、食事のメニューであり、
 前記追加特定手段は、前記ユーザがイートイン利用である場合、相性が良いイートインメニュー同士を関連付けた第1テーブルを用いて前記追加アイテムを特定する
 付記3から5のいずれか一項に記載の情報処理装置。
   (付記8)
 前記追加特定手段は、前記ユーザがテイクアウト利用である場合、相性が良いテイクアウトメニュー同士を関連付けた第2テーブルを用いて前記追加アイテムを特定する
 付記7に記載の情報処理装置。
   (付記9)
 生体認証を実施する生体認証装置と、
 サーバと
 を備え、
 前記サーバは、
 ユーザが使用するユーザ端末から、仮注文にかかるアイテムを特定するためのアイテム情報を少なくとも含む仮注文情報を受信した場合、前記仮注文情報を、前記ユーザの生体情報に関連付けて登録する登録手段と、
 店舗を訪問したユーザの生体情報を受信した場合、前記生体情報を前記生体認証装置に送信し、前記生体認証の結果を前記生体認証装置から受信する認証制御手段と、
 前記生体認証が成功した場合、前記ユーザの前記生体情報に関連付けられた前記仮注文情報を、前記店舗の端末に送信する送信制御手段と
 を有する
 情報処理システム。
   (付記10)
 前記店舗の端末をさらに備える
 付記9に記載の情報処理システム。
   (付記11)
 ユーザが使用するユーザ端末から、仮注文にかかるアイテムを特定するためのアイテム情報を少なくとも含む仮注文情報を受信した場合、前記仮注文情報を、前記ユーザの生体情報に関連付けて登録し、
 店舗を訪問したユーザの生体情報を受信した場合、生体認証を制御し、
 前記生体認証が成功した場合、前記ユーザの前記生体情報に関連付けられた前記仮注文情報を、前記店舗の端末に送信する
 情報処理方法。
   (付記12)
 ユーザが使用するユーザ端末から、仮注文にかかるアイテムを特定するためのアイテム情報を少なくとも含む仮注文情報を受信した場合、前記仮注文情報を、前記ユーザの生体情報に関連付けて登録する登録機能と、
 店舗を訪問したユーザの生体情報を受信した場合、生体認証を制御する認証制御機能と、
 前記生体認証が成功した場合、前記ユーザの前記生体情報に関連付けられた前記仮注文情報を、前記店舗の端末に送信する送信制御機能と
 をコンピュータに実現させるためのプログラムが格納された非一時的なコンピュータ可読媒体。
Part or all of the above embodiments may be described as in the following additional notes, but are not limited to the following.
(Additional note 1)
When provisional order information including at least item information for specifying an item related to the provisional order is received from a user terminal used by the user, a registration means for registering the provisional order information in association with the biometric information of the user; ,
an authentication control means for controlling biometric authentication when biometric information of a user visiting a store is received;
and a transmission control means for transmitting the provisional order information associated with the biometric information of the user to a terminal of the store visited by the user, if the biometric authentication is successful.
(Additional note 2)
The temporary order information further includes a store ID that identifies the store,
If the biometric authentication is successful, the information processing device determines whether the store visited by the user is a store specified by a store ID included in provisional order information associated with the user's biometric information. further comprising a determination means,
The information processing device according to supplementary note 1, wherein the transmission control means does not transmit the provisional order information to a terminal of the store visited by the user, if the store visited by the user is not a store specified by the store ID. .
(Additional note 3)
Further comprising additional identifying means for identifying additional items recommended to be ordered in combination with the items related to the provisional order if the biometric authentication is successful;
The information processing device according to Supplementary note 1 or 2, wherein the transmission control means transmits information on the specified additional item together with the provisional order information to a terminal in the store.
(Additional note 4)
When the registration means receives regular order information including the user's order intention at the time of the visit from a terminal of the store visited by the user, the registration means registers the regular order information in association with the biometric information of the user. 3. The information processing device according to 3.
(Appendix 5)
Further comprising a generation means for generating promotional information for the user based on the history of the main order information associated with the user's biometric information,
The information processing device according to appendix 4, wherein the transmission control means transmits the promotional information to the user terminal.
(Appendix 6)
The additional specifying means is
If the biometric authentication is successful, read the history of the order information associated with the user's biometric information;
identifying additional items based on the history of said order information;
The information processing device according to appendix 4 or 5, wherein the transmission control means transmits the specified additional item together with the provisional order information to a terminal in the store.
(Appendix 7)
the item is a meal menu;
The information processing according to any one of Supplementary Notes 3 to 5, wherein the additional specifying means specifies the additional item using a first table that associates compatible eat-in menus with each other when the user is a dine-in customer. Device.
(Appendix 8)
The information processing device according to appendix 7, wherein the additional specifying means specifies the additional item using a second table that associates compatible take-out menus when the user is a take-out customer.
(Appendix 9)
A biometric authentication device that performs biometric authentication;
Equipped with a server and
The server is
When provisional order information including at least item information for specifying an item related to the provisional order is received from a user terminal used by the user, a registration means for registering the provisional order information in association with the biometric information of the user; ,
an authentication control means that, when receiving biometric information of a user who visited a store, transmits the biometric information to the biometric authentication device and receives a result of the biometric authentication from the biometric authentication device;
and a transmission control means for transmitting the provisional order information associated with the biometric information of the user to a terminal in the store if the biometric authentication is successful.
(Appendix 10)
The information processing system according to appendix 9, further comprising a terminal at the store.
(Appendix 11)
When provisional order information including at least item information for identifying the item related to the provisional order is received from a user terminal used by the user, the provisional order information is registered in association with the biometric information of the user;
When receiving biometric information of a user who visited a store, control the biometric authentication,
If the biometric authentication is successful, the provisional order information associated with the biometric information of the user is transmitted to a terminal at the store.
(Appendix 12)
When provisional order information including at least item information for specifying the item related to the provisional order is received from a user terminal used by the user, a registration function that registers the provisional order information in association with the biometric information of the user; ,
When receiving biometric information of a user who visited a store, an authentication control function that controls biometric authentication;
If the biometric authentication is successful, the temporary order information associated with the user's biometric information is transmitted to the terminal at the store. computer-readable medium.
 10 情報処理装置
 11 登録部
 12 認証制御部
 15 送信制御部
 100 顔認証装置
 110 顔情報DB
 111 ユーザID
 112 顔特徴情報
 120 顔検出部
 130 特徴点抽出部
 140 登録部
 150 認証部
 200 情報処理装置(サーバ)
 210 記憶部
 211 プログラム
 212 ユーザDB
 2121 ユーザID
 2122 ユーザ情報
 213 仮注文DB
 2131 ユーザID
 2132 仮注文情報
 214 店舗DB
 2141 店舗ID
 2142 アイテムリスト
 215 本注文DB
 2151 ユーザID
 2152 本注文情報
 220 メモリ
 230 通信部
 240 制御部
 241 登録部
 242 認証制御部
 243 判定部
 244 追加特定部
 245 送信制御部
 246 生成部
 300 ユーザ端末
 310 カメラ
 320 記憶部
 330 通信部
 340 表示部
 350 入力部
 360 制御部
 400 店舗端末
 410 カメラ
 420 記憶部
 430 通信部
 440 表示部
 450 入力部
 460 制御部
 1000 情報処理システム
10 Information processing device 11 Registration unit 12 Authentication control unit 15 Transmission control unit 100 Face authentication device 110 Face information DB
111 User ID
112 Facial feature information 120 Face detection unit 130 Feature point extraction unit 140 Registration unit 150 Authentication unit 200 Information processing device (server)
210 Storage unit 211 Program 212 User DB
2121 User ID
2122 User information 213 Temporary order DB
2131 User ID
2132 Temporary order information 214 Store DB
2141 Store ID
2142 Item list 215 Book order DB
2151 User ID
2152 Book order information 220 Memory 230 Communication section 240 Control section 241 Registration section 242 Authentication control section 243 Judgment section 244 Additional specification section 245 Transmission control section 246 Generation section 300 User terminal 310 Camera 320 Storage section 330 Communication section 340 Display section 350 Input section 360 control unit 400 store terminal 410 camera 420 storage unit 430 communication unit 440 display unit 450 input unit 460 control unit 1000 information processing system

Claims (12)

  1.  ユーザが使用するユーザ端末から、仮注文にかかるアイテムを特定するためのアイテム情報を少なくとも含む仮注文情報を受信した場合、前記仮注文情報を、前記ユーザの生体情報に関連付けて登録する登録手段と、
     店舗を訪問したユーザの生体情報を受信した場合、生体認証を制御する認証制御手段と、
     前記生体認証が成功した場合、前記ユーザの前記生体情報に関連付けられた前記仮注文情報を、前記ユーザが訪問した前記店舗の端末に送信する送信制御手段と
     を備える情報処理装置。
    When provisional order information including at least item information for specifying an item related to the provisional order is received from a user terminal used by the user, a registration means for registering the provisional order information in association with the biometric information of the user; ,
    an authentication control means for controlling biometric authentication when biometric information of a user visiting a store is received;
    and a transmission control means for transmitting the provisional order information associated with the biometric information of the user to a terminal of the store visited by the user, if the biometric authentication is successful.
  2.  前記仮注文情報は、店舗を識別する店舗IDをさらに含み、
     前記情報処理装置は、前記生体認証が成功した場合、前記ユーザが訪問した店舗が、前記ユーザの生体情報に関連付けられた仮注文情報に含まれる店舗IDによって特定される店舗か否かを判定する判定手段をさらに備え、
     前記送信制御手段は、前記ユーザが訪問した前記店舗が前記店舗IDによって特定される店舗でない場合、前記ユーザが訪問した前記店舗の端末に前記仮注文情報を送信しない
     請求項1に記載の情報処理装置。
    The temporary order information further includes a store ID that identifies the store,
    If the biometric authentication is successful, the information processing device determines whether the store visited by the user is a store specified by a store ID included in provisional order information associated with the user's biometric information. further comprising a determination means,
    The information processing according to claim 1, wherein the transmission control means does not transmit the provisional order information to a terminal of the store visited by the user, if the store visited by the user is not a store specified by the store ID. Device.
  3.  前記生体認証が成功した場合、前記仮注文にかかるアイテムと組み合わせて注文することが推奨される追加アイテムを特定する追加特定手段をさらに備え、
     前記送信制御手段は、特定した前記追加アイテムの情報を、前記仮注文情報とともに前記店舗の端末に送信する
     請求項1又は2に記載の情報処理装置。
    Further comprising additional identifying means for identifying additional items recommended to be ordered in combination with the items related to the provisional order if the biometric authentication is successful;
    The information processing device according to claim 1 or 2, wherein the transmission control means transmits information on the specified additional item together with the provisional order information to a terminal in the store.
  4.  前記登録手段は、前記ユーザが訪問した前記店舗の端末から、前記ユーザの訪問時の注文意思を含む本注文情報を受信した場合、前記本注文情報を前記ユーザの生体情報に関連付けて登録する
     請求項3に記載の情報処理装置。
    When the registration means receives regular order information including the user's order intention at the time of the visit from a terminal of the store visited by the user, the registration means registers the regular order information in association with the biometric information of the user. The information processing device according to item 3.
  5.  前記ユーザの生体情報に関連づけられた前記本注文情報の履歴に基づいて、前記ユーザへの販促情報を生成する生成手段をさらに備え、
     前記送信制御手段は、前記販促情報を前記ユーザ端末に送信する
     請求項4に記載の情報処理装置。
    Further comprising a generation means for generating promotional information for the user based on the history of the main order information associated with the user's biometric information,
    The information processing device according to claim 4, wherein the transmission control means transmits the promotional information to the user terminal.
  6.  前記追加特定手段は、
     前記生体認証が成功した場合、前記ユーザの生体情報に関連付けられた本注文情報の履歴を読み出し、
     前記本注文情報の履歴に基づいて追加アイテムを特定し、
     前記送信制御手段は、特定した前記追加アイテムを、前記仮注文情報とともに前記店舗の端末に送信する
     請求項4又は5に記載の情報処理装置。
    The additional specifying means is
    If the biometric authentication is successful, read the history of the order information associated with the user's biometric information;
    identifying additional items based on the history of said order information;
    The information processing device according to claim 4 or 5, wherein the transmission control means transmits the specified additional item together with the provisional order information to a terminal in the store.
  7.  前記アイテムは、食事のメニューであり、
     前記追加特定手段は、前記ユーザがイートイン利用である場合、相性が良いイートインメニュー同士を関連付けた第1テーブルを用いて前記追加アイテムを特定する
     請求項3から5のいずれか一項に記載の情報処理装置。
    the item is a meal menu;
    The information according to any one of claims 3 to 5, wherein when the user is a dine-in user, the additional specifying means specifies the additional item using a first table that associates eat-in menus that are compatible with each other. Processing equipment.
  8.  前記追加特定手段は、前記ユーザがテイクアウト利用である場合、相性が良いテイクアウトメニュー同士を関連付けた第2テーブルを用いて前記追加アイテムを特定する
     請求項7に記載の情報処理装置。
    The information processing device according to claim 7, wherein, when the user is a take-out customer, the additional specifying unit specifies the additional item using a second table that associates take-out menus that are compatible with each other.
  9.  生体認証を実施する生体認証装置と、
     サーバと
     を備え、
     前記サーバは、
     ユーザが使用するユーザ端末から、仮注文にかかるアイテムを特定するためのアイテム情報を少なくとも含む仮注文情報を受信した場合、前記仮注文情報を、前記ユーザの生体情報に関連付けて登録する登録手段と、
     店舗を訪問したユーザの生体情報を受信した場合、前記生体情報を前記生体認証装置に送信し、前記生体認証の結果を前記生体認証装置から受信する認証制御手段と、
     前記生体認証が成功した場合、前記ユーザの前記生体情報に関連付けられた前記仮注文情報を、前記店舗の端末に送信する送信制御手段と
     を有する
     情報処理システム。
    A biometric authentication device that performs biometric authentication;
    Equipped with a server and
    The server is
    When provisional order information including at least item information for specifying an item related to the provisional order is received from a user terminal used by the user, a registration means for registering the provisional order information in association with the biometric information of the user; ,
    an authentication control means that, when receiving biometric information of a user who visited a store, transmits the biometric information to the biometric authentication device and receives a result of the biometric authentication from the biometric authentication device;
    and a transmission control means for transmitting the provisional order information associated with the biometric information of the user to a terminal in the store if the biometric authentication is successful.
  10.  前記店舗の端末をさらに備える
     請求項9に記載の情報処理システム。
    The information processing system according to claim 9, further comprising a terminal at the store.
  11.  ユーザが使用するユーザ端末から、仮注文にかかるアイテムを特定するためのアイテム情報を少なくとも含む仮注文情報を受信した場合、前記仮注文情報を、前記ユーザの生体情報に関連付けて登録し、
     店舗を訪問したユーザの生体情報を受信した場合、生体認証を制御し、
     前記生体認証が成功した場合、前記ユーザの前記生体情報に関連付けられた前記仮注文情報を、前記店舗の端末に送信する
     情報処理方法。
    When provisional order information including at least item information for identifying the item related to the provisional order is received from a user terminal used by the user, the provisional order information is registered in association with the biometric information of the user;
    When receiving biometric information of a user who visited a store, control the biometric authentication,
    If the biometric authentication is successful, the provisional order information associated with the biometric information of the user is transmitted to a terminal at the store.
  12.  ユーザが使用するユーザ端末から、仮注文にかかるアイテムを特定するためのアイテム情報を少なくとも含む仮注文情報を受信した場合、前記仮注文情報を、前記ユーザの生体情報に関連付けて登録する登録機能と、
     店舗を訪問したユーザの生体情報を受信した場合、生体認証を制御する認証制御機能と、
     前記生体認証が成功した場合、前記ユーザの前記生体情報に関連付けられた前記仮注文情報を、前記店舗の端末に送信する送信制御機能と
     をコンピュータに実現させるためのプログラムが格納された非一時的なコンピュータ可読媒体。
    When provisional order information including at least item information for specifying the item related to the provisional order is received from a user terminal used by the user, a registration function that registers the provisional order information in association with the biometric information of the user; ,
    When receiving biometric information of a user who visited a store, an authentication control function that controls biometric authentication;
    If the biometric authentication is successful, the temporary order information associated with the user's biometric information is transmitted to the terminal at the store. computer-readable medium.
PCT/JP2022/011520 2022-03-15 2022-03-15 Information processing device, information processing system, information processing method, and non-transitory computer-readable medium WO2023175707A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/011520 WO2023175707A1 (en) 2022-03-15 2022-03-15 Information processing device, information processing system, information processing method, and non-transitory computer-readable medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/011520 WO2023175707A1 (en) 2022-03-15 2022-03-15 Information processing device, information processing system, information processing method, and non-transitory computer-readable medium

Publications (1)

Publication Number Publication Date
WO2023175707A1 true WO2023175707A1 (en) 2023-09-21

Family

ID=88022845

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/011520 WO2023175707A1 (en) 2022-03-15 2022-03-15 Information processing device, information processing system, information processing method, and non-transitory computer-readable medium

Country Status (1)

Country Link
WO (1) WO2023175707A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021162062A1 (en) * 2020-02-10 2021-08-19 パナソニックIpマネジメント株式会社 Control method, terminal equipment, program, and recording medium
JP2021174210A (en) * 2020-04-23 2021-11-01 株式会社寺岡精工 Order entry system and ordering method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021162062A1 (en) * 2020-02-10 2021-08-19 パナソニックIpマネジメント株式会社 Control method, terminal equipment, program, and recording medium
JP2021174210A (en) * 2020-04-23 2021-11-01 株式会社寺岡精工 Order entry system and ordering method

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
ANONYMOUS: "Face authentication, mobile ordering, automated electric gates, etc. Tokyo Dome DX Project has started! ", CARDWAVE, vol. 34, no. 2, 25 April 2021 (2021-04-25), pages 18 - 19, XP009549487 *
SATO, YOSHIHIKO: "Went and tried! Usability of cashless stores", NIKKEI TRENDY, vol. 449, 4 July 2019 (2019-07-04), pages 66 - 67, XP009549488 *
YAMADA, TETSUYA: "Next-generation stadium experience with high-speed touchless fingerprint authentication solution MorphoWave Compact", GEKKAN JIDOU NINSHIKI, NIHON KOGYO SHUPPAN K.K., TOKYO, JP, vol. 33, no. 8, 10 July 2020 (2020-07-10), JP , pages 54 - 57, XP009549113, ISSN: 0915-1060 *

Similar Documents

Publication Publication Date Title
US20050171800A1 (en) Menu-order selection support system, data center and eating-house system
US20230306494A1 (en) Method for providing information
JP2010238118A (en) Ordering system
US11363437B2 (en) Patron service method utilizing near-field communication tag identifiers
JP7424671B2 (en) Information processing device, information processing method and program
KR101778556B1 (en) Restaurant reservation service method and system
JP5746554B2 (en) Information providing system, information providing method, program, and information recording medium
JP5996748B1 (en) Order processing system, order processing method
WO2023175707A1 (en) Information processing device, information processing system, information processing method, and non-transitory computer-readable medium
JP2019159449A (en) Information processing apparatus, information processing method and program
JP5086936B2 (en) Point management device, point management method, and point management program
JP2014157593A (en) Electronic menu system
US20150332323A1 (en) Server and program
WO2023026360A1 (en) Information processing device, information processing system, information processing method, and non-transitory computer-readable medium
WO2023175797A1 (en) Information processing device, information processing system, information processing method, and non-transitory computer-readable medium
JP2003122838A (en) Menu support device and menu support method
US11416911B2 (en) Method and system for personalized and continuously updated maintenance of orders
JP7259881B2 (en) Information processing equipment, order system and program
JP7444030B2 (en) Information processing device, information processing method, and information processing program
JP7376799B2 (en) Order support system, order support method, and order support program
WO2022201386A1 (en) Information control device, information control method, and computer-readable medium
JP2023173664A (en) Recommendation device, method, and program
KR20200138850A (en) the smart table using biometrics
KR20040001043A (en) A lunch order processing system on the online and method thereof
JP2022149374A (en) Information processor, order system, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22931992

Country of ref document: EP

Kind code of ref document: A1