WO2014196178A1 - 誘導方法及び誘導システム - Google Patents
誘導方法及び誘導システム Download PDFInfo
- Publication number
- WO2014196178A1 WO2014196178A1 PCT/JP2014/002892 JP2014002892W WO2014196178A1 WO 2014196178 A1 WO2014196178 A1 WO 2014196178A1 JP 2014002892 W JP2014002892 W JP 2014002892W WO 2014196178 A1 WO2014196178 A1 WO 2014196178A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- product
- guidance
- information
- registered
- identification information
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/20—Instruments for performing navigational calculations
- G01C21/206—Instruments for performing navigational calculations specially adapted for indoor navigation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/024—Guidance services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/33—Services specially adapted for particular environments, situations or purposes for indoor environments, e.g. buildings
Definitions
- the present invention relates to a guidance method and guidance system for guiding a user to the position of a product of interest.
- GPS Global Positioning System
- GPS Global Positioning System
- the car navigation system uses GPS to identify the current position of the user (automobile) and guides the user to the destination.
- Patent Literature 1 a store that is located within a certain distance from the terminal position and that sells a registered purchase plan product is searched, and the purchase plan product near the user.
- a shopping guidance information providing device for notifying a mobile terminal owned by the user of the store information when the store selling the store is searched is disclosed.
- the present invention has been made to solve the above problems, and an object thereof is to provide a guidance method and a guidance system capable of guiding a user to a position of a product of interest in a building. is there.
- a guidance method is a product placement in which a plurality of product identification information for identifying a plurality of products placed in a building is associated with a placement position of the plurality of products in the building.
- a product placement information holding step for holding information in a product placement information holding unit, a shooting step for shooting the periphery of the user in the building, a photographed image taken in the photographing step is analyzed, and the photographed image is included in the photographed image.
- the user can move to the position of the product of interest in the building using the arrangement position of the product included in the photographed image and the arrangement position of the registered product registered in advance in the building by the user. Can be induced.
- FIG. 1 shows the whole guidance system composition in an embodiment of the invention. It is a figure which shows the structure of the guidance service apparatus, guidance apparatus, and apparatus in embodiment of this invention.
- it is a flowchart for explaining the operation of the device and the guidance service device.
- it is a 1st flowchart for demonstrating operation
- it is a 2nd flowchart for demonstrating operation
- it is a figure for demonstrating the imaging
- FIG. It is a figure which shows an example of the user interface component image used when producing the guidance information shown in FIG. It is a figure which shows an example of the guidance information displayed when an interest product exists in the position which cannot be seen in a picked-up image. It is a figure which shows an example of the user interface component image used when producing the guidance information shown in FIG. It is a figure which shows an example of the guidance information displayed when the specified goods are not interested goods and an interested product exists in a picked-up image. It is a figure which shows an example of the user interface component image used when producing the guidance information shown in FIG. It is a figure which shows an example of the guidance information displayed when an interest product does not exist in the picked-up image in which goods are arrange
- the guidance system guides a user to a position of a product (such as a target product desired to be purchased) in which the user is interested in a store where a large number of products are arranged on a display shelf. It is.
- the user holds a portable terminal (smartphone) having a camera function, and the guidance system guides the user to a target position using an image captured by the user with the camera.
- In-store search 1 First, the application takes a picture of the inside of the store using the camera installed on the smartphone. Next, the application or server matches the photographed image with a product list that represents products that the user is interested in by image recognition. Next, the application presents on the screen of the smartphone that there is a product that the user is interested in.
- the application takes a picture of the inside of the store using the camera installed on the smartphone.
- the application or server matches the photographed image with a product list that represents products that the user is interested in by image recognition.
- the application presents the mark indicating the position of the product of interest superimposed on the captured image displayed on the screen of the smartphone.
- the application takes a picture of the inside of the store using the camera installed on the smartphone.
- the application or the server identifies the product displayed by the image recognition, and estimates the position of the smartphone (user) from the product layout information in which the product is associated with the position where the product is arranged.
- the application presents the relative position of the product of interest on the screen of the smartphone with text or the like from the estimated position of the smartphone and the position of the product of interest, or notifies by voice.
- the application takes a picture of the inside of the store using the camera installed on the smartphone.
- the application or the server identifies the product displayed by the image recognition, and estimates the position of the smartphone (user) from the product layout information in which the product is associated with the position where the product is arranged.
- the application presents the relative direction from the estimated position of the smartphone and the position of the product of interest to the product of interest on the smartphone screen.
- the application takes a picture of the inside of the store using the camera installed on the smartphone.
- the application or the server identifies the product displayed by the image recognition, and estimates the position of the smartphone (user) from the product layout information in which the product is associated with the position where the product is arranged.
- the application presents a mark indicating the position of the product of interest on the back side of the shelf superimposed on the photographed image displayed on the screen of the smartphone.
- FIG. 1 is a diagram showing an overall configuration of a guidance system according to an embodiment of the present invention.
- the guidance system includes a guidance service device 100, a guidance device 200, and a device 300.
- the device 300 is a home appliance such as a refrigerator, a washing machine, or a microwave oven, for example.
- the device 300 is used when registering a product of interest to the user in the guidance service device 100.
- the user interface of the device 300 displays a product list and accepts selection of a product from the product list by the user.
- the device 300 notifies the guidance service device 100 of the selected product.
- the guidance service device 100 is, for example, a server device.
- the guidance service device 100 stores the notified product as a product of interest of the user (hereinafter referred to as “interested product”) in the interested product list.
- the product of interest is, for example, a product to be purchased (shopping memo) that is explicitly specified by the user.
- products that are of interest are automatically managed and grasped by household devices such as refrigerators or microwave ovens, and automatically used as products that need to be purchased in the near future. The product selected in.
- the guidance device 200 is, for example, a smartphone that executes an application.
- the guidance device 200 may be a portable tablet computer or mobile phone, or may be a terminal having a camera function.
- the guidance device 200 downloads a guidance application from the guidance service device 100.
- the guidance application is managed by an application management unit included in the guidance service device 100.
- the application management unit transmits a guidance application in response to a request from the guidance device 200.
- the guidance device 200 may download the guidance application from a server device that manages the guidance application, which is different from the guidance service device 100. Note that the guidance device 200 and the device 300 may be the same device.
- the guidance device 200 executes the downloaded guidance application.
- a guidance application (program) executed on the guidance device 200 controls a camera provided in the guidance device 200 to capture an image of the user's surroundings.
- the guidance device 200 transmits the captured image to the guidance service device 100.
- the guidance service device 100 analyzes the received image and identifies the product being photographed.
- the guidance device 200 may hold in advance analysis data used for image analysis.
- the guidance application analyzes the photographed image and specifies the photographed product.
- the guide device 200 notifies the guide service device 100 of the specified product.
- a method for specifying a product included in a photographed image for example, there is a method of recording and managing a product package photograph or text written on a product package in a database and matching the images. Further, the product included in the photographed image may be specified by matching the text extracted from the photographed image with the text recorded in advance in the database. In addition, you may identify the goods contained in the image
- photographed image with another method.
- FIG. 2 is a diagram showing the configuration of the guidance service device 100, the guidance device 200, and the device 300 in the embodiment of the present invention.
- the guidance service device 100 and the guidance device 200 are connected to be communicable with each other via a network.
- the guidance service device 100 and the device 300 are connected to each other via a network so that they can communicate with each other.
- the network is, for example, the Internet.
- the device 300 includes a product input receiving unit 301 of interest, a display unit 302, and a communication unit 303.
- the interested product input receiving unit 301 receives the input of the interested product by the user.
- the product-of-interest receiving unit 301 receives an input of products of interest by the user using, for example, a keyboard displayed on the touch panel screen.
- the interested product input reception part 301 may receive the input of the interested product by a user by voice recognition.
- Display unit 302 displays various information.
- the display unit 302 displays selectable products.
- the display unit 302 displays products used in the device 300. For example, when the device 300 is a refrigerator, the display unit 302 displays food materials such as frozen food, vegetables, and fruits. The user selects a desired product of interest from the product list displayed on the display unit 302.
- the communication unit 303 receives various information from the guidance service device 100, and transmits various information to the guidance service device 100.
- the communication unit 303 receives a selectable product list from the guidance service device 100.
- the communication unit 303 transmits the interest product information related to the product of interest received by the product-of-interest input reception unit 301 to the guidance service device 100.
- the interest product information includes a user ID for identifying the user.
- the guidance device 200 includes an imaging unit 201, a current position acquisition unit 202, a display unit 203, and a communication unit 204.
- the imaging unit 201 captures the periphery of the user in the building and acquires a captured image.
- the captured image may be a still image or a moving image.
- the current position acquisition unit 202 is configured with a GPS, for example, and acquires the current position of the guidance device 200.
- the communication unit 204 receives various information from the guidance service device 100, and transmits various information to the guidance service device 100.
- the communication unit 204 transmits the captured image captured by the imaging unit to the guidance service device 100.
- the communication unit 204 receives the guidance information transmitted by the guidance service device 100.
- the guidance information is information for guiding the user to the position of the product of interest.
- Display unit 203 displays various information.
- the display unit 203 displays the guidance information received by the communication unit 204.
- the guidance service device 100 includes a product layout database 101, an interest product database 102, a product identification unit 103, a guidance information creation unit 104, an update unit 105, and a communication unit 106.
- the product layout database 101 holds product placement information in which a plurality of product identification information for identifying a plurality of products placed in a building and the placement positions of the plurality of products in the building are associated with each other.
- the product arrangement information exists for each store.
- the product identification information includes, for example, a product name or a product image.
- the product-of-interest database 102 holds product-of-interest identification information for identifying products of interest registered in advance by the user.
- the interested product database 102 holds an interest product list for each user.
- the interested product database 102 stores an interest product list in association with a user ID for identifying a user.
- the interest product identification information includes, for example, a product name of the product of interest or an image of the product of interest.
- the product specifying unit 103 analyzes the photographed image photographed by the photographing unit 201 of the guidance device 200, and identifies the product identification information included in the photographed image.
- the guide information creation unit 104 identifies the product identification information specified by the product specification unit 103, the product arrangement information held in the product layout database 101, and the product of interest for identifying the product of interest registered in advance by the user. Based on the identification information, the arrangement position of the product of interest in the building is specified, and guidance information for guiding the user to the arrangement position of the specified product of interest is created.
- the guidance information creation unit 104 identifies the store where the user is currently based on the current position information received from the guidance device 200, and reads the product layout information corresponding to the identified store from the product layout database 101.
- the guidance information creation unit 104 is an image indicating the position of the interest product in the captured image. Is created as guidance information. That is, the case where the product identification information specified by the product specification unit 103 matches the interested product identification information held in the interested product database 102 means that the interested product exists in the captured image.
- the guidance information is information indicating where the product of interest exists in the captured image.
- the guidance information creation unit 104 guides an image indicating the position of the interested product. Create as information. That is, the case where the product identification information specified by the product specification unit 103 and the interest product identification information held in the product-of-interest database 102 do not match means that the product of interest does not exist in the captured image.
- the guidance information is information indicating where the product of interest exists outside the captured image.
- the guide information creation unit 104 displays an image indicating the direction in which the product of interest exists when the product identification information specified by the product specification unit 103 and the product of interest identification information stored in the product of interest database 102 do not match. May be created as guidance information.
- the guide information creating unit 104 does not match the product identification information specified by the product specifying unit 103 with the product identification information of interest held in the product of interest database 102, and is interested in a hidden position in the captured image.
- an image indicating a virtual position of the product of interest is created as guidance information.
- the guide information creation unit 104 displays the current user. Guidance information that virtually indicates the position of the product of interest that cannot be seen from the position of is created.
- the update unit 105 updates the product arrangement information held in the product layout database 101 based on the photographed image photographed by the photographing unit 201 of the guidance device 200.
- the update unit 105 specifies the arrangement position of the product identification information specified by the product specification unit 103 in the building, and if the specified arrangement position is different from the arrangement position of the product identification information included in the product arrangement information, the product arrangement The product placement information is updated so that the placement position of the product identification information included in the information is changed to the specified placement position.
- the communication unit 106 receives various information from the device 300 and transmits various information to the device 300.
- the communication unit 106 receives various types of information from the guidance device 200 and transmits various types of information to the guidance device 200.
- the communication unit 106 receives current position information and captured image information transmitted by the guidance device 200.
- the communication unit 106 receives the interest product information transmitted by the device 300.
- the communication unit 106 transmits the guidance information created by the guidance information creation unit 104 to the guidance device 200.
- FIG. 3 is a flowchart for explaining the operation of the device and the guidance service device in the embodiment of the present invention.
- the product-of-interest input receiving unit 301 of the device 300 receives an input of product information of interest by the user.
- the user inputs a product (interested product) in which the user is interested.
- the user inputs a product to be purchased as a product of interest.
- the interested product input receiving unit 301 may receive selection of a desired product from a plurality of products displayed on the display unit 302.
- the interested product input receiving unit 301 may receive an input of a product name of the interested product or a product number of the interested product.
- the interested product input receiving unit 301 may receive the type of product as the interested product information.
- Product type is not information that can uniquely identify a product such as a specific product name. For example, it is possible to specify a general product type such as sweets, frozen food, meat, fish, or vegetables. Information.
- step S ⁇ b> 2 the communication unit 303 transmits the interested product information received by the interested product input receiving unit 301 to the guidance service device 100. At this time, the communication unit 303 adds a user ID for identifying the user to the interest product information and transmits it.
- the user ID may be input by the user or stored in the device 300 in advance.
- step S ⁇ b> 3 the communication unit 106 of the guidance service device 100 receives the interest product information transmitted by the device 300.
- step S4 the communication unit 106 stores the received interest product information in the interest product database 102. At this time, the communication unit 106 stores the interest product information in association with the received user ID.
- the product of interest is registered in advance in the guidance service device 100.
- FIG. 4 is a first flowchart for explaining the operation of the guidance device and the guidance service device in the embodiment of the present invention
- FIG. 5 is the guidance device and guidance service in the embodiment of the present invention. It is a 2nd flowchart for demonstrating operation
- step S11 the photographing unit 201 of the guidance device 200 photographs the vicinity of the user in the store. At this time, the photographing unit 201 photographs a shelf on which a plurality of products in the store are displayed.
- step S12 the current position acquisition unit 202 acquires current position information indicating the current position of the guidance device 200.
- the current position information is represented by, for example, latitude and longitude.
- step S ⁇ b> 13 the communication unit 303 transmits the captured image captured by the imaging unit 201 and the current position information acquired by the current position acquisition unit 202 to the guidance service device 100. At this time, the communication unit 303 adds a user ID for identifying the user to the captured image and the current position information, and transmits it.
- the user ID may be input by the user or may be stored in advance in the guidance device 200.
- the guidance device 200 acquires and transmits the current position information.
- the present invention is not particularly limited to this, and the guidance device 200 inputs the store address or the store name.
- the received store address or store name may be transmitted as the current position information.
- step S14 the communication unit 106 of the guidance service device 100 receives the captured image and the current position information transmitted by the guidance device 200.
- step S15 the product identification unit 103 analyzes the captured image received by the communication unit 106 and identifies the product included in the captured image.
- step S ⁇ b> 16 the updating unit 105 specifies the arrangement position of the product specified by the product specifying unit 103.
- the update unit 105 recognizes the shelf on which the specified product is displayed by analyzing the captured image, and recognizes on which shelf the specified product is arranged, It is specified on which shelf of which shelf in the store the specified product is arranged. Note that, for example, a shelf name and a column number are posted on a shelf on which products in the store are displayed, and the shelf name and the column number are identified by image analysis.
- step S ⁇ b> 17 the update unit 105 has the same arrangement position as the arrangement position corresponding to the product identified by the product identification unit 103 acquired from the product arrangement information held in the product layout database 101. It is determined whether or not.
- the update unit 105 updates the product layout database 101 in step S18. That is, the update unit 105 updates the arrangement position corresponding to the product specified by the product specifying unit 103 held in the product layout database 101 to the specified arrangement position.
- the product layout information in the product layout database 101 can always be updated to the latest information. Further, it is not necessary for an administrator or the like to update the product arrangement information in the product layout database 101, and the product arrangement information in the product layout database 101 can be automatically updated.
- the guide information creation unit 104 is specified by the product specification unit 103 in step S19. It is determined whether or not the product matches the product of interest held in the product of interest database 102.
- step S20 the guidance information creation unit 104 uses the image indicating the position of the product of interest in the captured image as the guidance information. create.
- step S21 the guidance information creation unit 104 determines the arrangement position corresponding to the identified product from the product layout database 101. get.
- step S ⁇ b> 22 the guidance information creation unit 104 acquires an arrangement position corresponding to the product of interest from the product layout database 101.
- step S23 the guidance information creation unit 104 creates an image indicating the position of the product of interest as guidance information.
- step S24 the communication unit 106 transmits the guidance information created by the guidance information creation unit 104 to the guidance device 200.
- step S25 the communication unit 204 of the guidance device 200 receives the guidance information transmitted by the guidance service device 100.
- step S26 the display unit 302 displays the guidance information received by the communication unit 204.
- FIG. 6 is a diagram for describing a shooting direction in which a user photographs the inside of a store using the guidance device in the embodiment of the present invention.
- the store 400 has a plurality of shelves.
- a shelf name (H1 to H12) is assigned to each of the plurality of shelves.
- the product A, the product B, the product C, and the product D are each a product of interest.
- FIG. 7 is a diagram showing an example of an in-store layout diagram held in the product layout database
- FIG. 8 is a diagram showing an example of product layout information held in the product layout database.
- the in-store layout diagram 500 is represented in two dimensions, but may be represented in three dimensions.
- the shelf name 610, the column number 620, and the product 630 are associated with each other.
- the product A is arranged on the second level of the shelf name “H2”
- the product B is arranged on the first level of the shelf name “H3”
- the product C is It can be seen that the product name D is arranged in the first row of the shelf name “H5”, and the product D is arranged in the third row of the shelf name “H3”.
- the guide service device 100 When the specified product matches the product of interest in the product of interest database 102 managed and stored by the guide service device 100, the guide service device 100 indicates that the product of interest is included in the shooting range. Information is notified to the guidance device 200. The guidance device 200 outputs guidance information indicating that the product of interest is included in the shooting range.
- FIG. 9 is a diagram illustrating an example of guidance information displayed when a product of interest exists in a captured image. If the product A is a product of interest and is photographed from the position shown in FIG. 6, the product of interest exists in the photographed image. In this case, as shown in FIG. 9, the display unit 203 of the guidance device 200 presents guidance information 800 indicating that there is a product of interest in front of you. The guidance information 800 is expressed in a text format.
- FIG. 10 is a diagram illustrating another example of the guidance information displayed when the product of interest exists in the photographed image
- FIG. 11 is a user interface used when creating the guidance information illustrated in FIG. It is a figure which shows an example of a component image.
- the guidance information creation unit 104 creates guidance information 810 in which a user interface component image 811 indicating the position of a product of interest is superimposed on a captured image.
- the user interface component image 811 is stored in advance in a memory in the guidance service device 100.
- the guide information creating unit 104 creates the guide information 810 in which the user interface component image 811 indicating the position of the product of interest is superimposed on the captured image, but the present invention is particularly limited to this. Instead, the guidance information creation unit 104 may create only the user interface component image 811 indicating the position of the product of interest as guidance information.
- the guidance device 200 displays the guidance information (user interface component image 811) received from the guidance service device 100 superimposed on the image captured by the imaging unit 201 in real time. The guidance information is transmitted together with information for specifying the display position of the guidance information on the display screen of the display unit 203.
- the guidance service device 100 uses the product layout database 101 to create guidance information that guides the user to the product of interest. .
- FIG. 12 is a diagram illustrating an example of guidance information displayed when a product of interest does not exist in a captured image.
- the guidance information creation unit 104 of the guidance service device 100 accesses the product layout database 101 and stores the product identified from the captured image in the store. Get the position. For example, when the product A is a specified product, the guidance information creation unit 104 can specify that the product A exists in the second stage of the shelf H2 by referring to the product layout database 101.
- the guide information creation unit 104 accesses the product layout database 101 and acquires the position of the product of interest in the store. For example, when the product B is a product of interest, the guidance information creation unit 104 can specify that the product B exists in the first stage of the shelf H3 by referring to the product layout database 101.
- the guidance information creation unit 104 creates guidance information for guiding the product in the store from the acquired product to the location in the store of the acquired product of interest.
- the guidance service device 100 notifies the guidance device 200 of guidance information for guiding from the shooting position to the position of the product of interest.
- the guidance device 200 outputs guidance information for guiding from the shooting position to the position of the product of interest.
- the guidance service device 100 may notify the guidance device 200 of the position of the product of interest, and the guidance device 200 determines the product of interest from the shooting position based on the location of the product of interest notified by the guidance service device 100. You may create and output the guidance information which guides to a position.
- the guide information creation unit 104 displays the product B on the first row of the first shelf in the right direction of the product A. Can be specified.
- the display unit 203 of the guidance device 200 presents guidance information 820 indicating that the product B is at the top of the first shelf in the right direction in a text format.
- FIG. 13 is a diagram showing another example of the guidance information displayed when the product of interest does not exist in the photographed image
- FIG. 14 is a user interface used when creating the guidance information shown in FIG. It is a figure which shows an example of a component image.
- the guidance information creation unit 104 creates guidance information 830 in which a user interface component image 831 indicating the position of a product of interest is superimposed on a captured image.
- the guide information 830 indicates a direction from the position of the specified product toward the position where the product of interest exists. Note that the user interface component image 831 is stored in advance in a memory in the guidance service device 100.
- the display unit 203 of the guidance device 200 displays guidance information 830 indicating that the product B is in the right direction. Present.
- the display unit 203 of the guidance device 200 may present the relative position of the product of interest B superimposed on the actually captured image.
- the user interface component image 831 is an example of an image that is superimposed on an actually captured image.
- the guide information creation unit 104 creates the guide information 830 in which the user interface component image 831 indicating the position of the product of interest is superimposed on the captured image, but the present invention is particularly limited to this. Instead, the guide information creation unit 104 may create only the user interface component image 831 indicating the position of the product of interest as the guide information.
- the guidance device 200 displays the guidance information (user interface component image 831) received from the guidance service device 100 superimposed on the image captured by the imaging unit 201 in real time. The guidance information is transmitted together with information for specifying the display position of the guidance information on the display screen of the display unit 203.
- the guidance device 200 may present the position of the virtual product of interest.
- FIG. 15 is a diagram illustrating an example of guidance information displayed when a product of interest exists at an invisible position in a captured image.
- FIG. 16 is used when creating the guidance information illustrated in FIG. It is a figure which shows an example of a user interface component image.
- the product C is arranged on the shelf on the back side of the shelf where the product A specified from the photographed image is arranged. Although it is blocked by a shelf that cannot be photographed directly, it is within the viewing angle of the photographed image.
- the display unit 203 of the guidance device 200 may superimpose a virtual position of the product C of interest in the three-dimensional space on the actually captured image.
- the user interface component image 841 is an example of an image that is superimposed on an actually captured image.
- the guidance information creation unit 104 creates guidance information 840 in which a user interface component image 841 indicating a virtual position of a product of interest in a three-dimensional space is superimposed on a captured image.
- the guide information 840 indicates a virtual position where the product of interest exists in the three-dimensional space. Note that the user interface component image 841 is stored in advance in a memory in the guidance service device 100.
- the product C When the product C is in the interest product list, the product A is specified, and the product C is displayed on the shelf on the back side of the shelf on which the product A is displayed, as shown in FIG.
- the display unit 203 of 200 presents guidance information 840 indicating that the product C is on the shelf on the back side of the shelf on which the product A is displayed. At this time, a shelf image that is not actually visible is superimposed on the photographed image together with the position of the product C that is the product of interest.
- the guide information creation unit 104 creates the guide information 840 in which the user interface component image 841 indicating the virtual position of the product of interest is superimposed on the photographed image.
- the guide information creation unit 104 may create only the user interface component image 841 indicating the virtual position of the product of interest as the guide information.
- the guidance device 200 displays the guidance information (user interface component image 841) received from the guidance service device 100 superimposed on the image captured by the imaging unit 201 in real time.
- the guidance information is transmitted together with information for specifying the display position of the guidance information on the display screen of the display unit 203.
- FIG. 17 is a diagram illustrating an example of guide information displayed when the specified product is not the product of interest and the product of interest exists in the photographed image
- FIG. 18 creates the guide information illustrated in FIG. It is a figure which shows an example of the user interface component image used when doing.
- the guidance device 200 presents the position of the product of interest in the captured image. .
- the guidance information creation unit 104 acquires an arrangement position corresponding to the identified product. Next, the guidance information creation unit 104 acquires an arrangement position corresponding to the product of interest. Next, the guidance information creation unit 104 identifies the position of the shelf included in the captured image, and determines whether the layout position corresponding to the acquired product of interest is included in the captured image.
- the position of the shelf included in the captured image can be specified by identifying the shelf name posted on the shelf by image analysis.
- the guidance information creation unit 104 creates an image indicating the position of the product of interest in the captured image as guidance information.
- the guide information creation unit 104 uses an image indicating the position of the product of interest (an image indicating the direction in which the product of interest exists) as guide information. create.
- the guidance information creation unit 104 creates guidance information 850 in which the user interface component image 851 indicating the position of the product of interest is superimposed on the photographed image.
- the guide information 850 indicates a position where the product of interest exists. Note that the user interface component image 851 is stored in advance in a memory in the guidance service device 100.
- the display unit 203 of the guidance device 200 displays guidance information indicating that there is the product B of interest in the captured image. 850 is presented.
- the display unit 203 of the guidance device 200 may present the relative position of the product of interest B superimposed on the actually captured image.
- the user interface component image 851 is an example of an image that is superimposed on an actually captured image.
- the guide information creating unit 104 creates the guide information 850 in which the user interface component image 851 indicating the position of the product of interest is superimposed on the captured image, but the present invention is particularly limited to this. Instead, the guide information creation unit 104 may create only the user interface component image 851 indicating the position of the product of interest as the guide information.
- the guidance device 200 displays the guidance information (user interface component image 851) received from the guidance service device 100 superimposed on the image captured by the imaging unit 201 in real time. The guidance information is transmitted together with information for specifying the display position of the guidance information on the display screen of the display unit 203.
- FIG. 19 is a diagram illustrating an example of guidance information displayed when a product of interest does not exist in a photographed image in which products are two-dimensionally arranged.
- FIG. 20 illustrates creation of the guidance information illustrated in FIG. It is a figure which shows an example of the user interface component image used when doing.
- the guidance information creation unit 104 creates guidance information 860 in which a user interface component image 861 indicating the position of a product of interest is superimposed on a captured image in which the product is two-dimensionally arranged.
- the guide information 860 indicates a direction from the position of the specified product toward the position where the product of interest exists.
- the user interface component image 861 is stored in advance in a memory in the guidance service device 100.
- the display unit 203 of the guidance device 200 displays guidance information 860 indicating that the product D is in the downward direction. Present.
- the display unit 203 of the guidance device 200 may present the relative position of the product of interest D superimposed on the actually captured image.
- the user interface component image 861 is an example of an image that is superimposed on an actually captured image.
- the guide information creation unit 104 creates the guide information 860 in which the user interface component image 861 indicating the position of the product of interest is superimposed on the captured image, but the present invention is particularly limited to this. Instead, the guide information creation unit 104 may create only the user interface component image 861 indicating the position of the product of interest as the guide information.
- the guidance device 200 displays the guidance information (user interface component image 861) received from the guidance service device 100 superimposed on the image captured by the imaging unit 201 in real time. The guidance information is transmitted together with information for specifying the display position of the guidance information on the display screen of the display unit 203.
- the number of products of interest registered in the product of interest database 102 is not limited to one, and a plurality of products of interest may be registered. Therefore, when the arrangement positions of a plurality of products of interest are acquired, the guidance information creation unit 104 may create guidance information that guides the user to the products of interest that are closest to the identified products. In addition, the guidance information creation unit 104 may create guidance information that guides the user to the recently registered product of interest when arrangement positions of a plurality of products of interest are acquired. Further, when the arrangement positions of a plurality of products of interest are acquired, the guidance information creation unit 104 may create guidance information that guides the user in order from the products of interest that are closest to the identified products. . Furthermore, when the arrangement positions of a plurality of products of interest are acquired, the guidance information creation unit 104 may create guidance information that guides the user in order from the recently registered products of interest.
- the guidance information is displayed on the display unit 203 included in the guidance device 200.
- the present invention is not particularly limited to this, and the guidance information is output as voice by the voice output unit included in the guidance device 200. May be.
- the guidance device 200 may include a vibration device that vibrates the guidance device 200. The vibration device may cause the guidance device 200 to vibrate so that the user is directed toward the product of interest represented by the guidance information. Good.
- the guide information creating unit 104 selects one product identification among the specified plurality of product identification information. Based on the information, the product arrangement information held in the product layout database 101, and the interest product identification information registered in advance by the user, the arrangement position of the product of interest in the building may be specified. For example, the product identification information corresponding to the product closest to the center of the photographed image is selected as one product identification information among the plurality of specified product identification information.
- a guidance method is a product placement in which a plurality of product identification information for identifying a plurality of products placed in a building is associated with a placement position of the plurality of products in the building.
- a product placement information holding step for holding information in a product placement information holding unit, a shooting step for shooting the periphery of the user in the building, a photographed image taken in the photographing step is analyzed, and the photographed image is included in the photographed image.
- the plurality of product identification information for identifying the plurality of products arranged in the building and the product placement information in which the placement positions of the plurality of products in the building are associated are held.
- Product identification information included in the photographed image is specified.
- the placement position of the registered product in the building is identified and identified. Guidance information for guiding the user to the registered product placement position is presented.
- the guidance step includes an image indicating a position of the registered product in the captured image when the product identification information specified in the specification step matches the registered product identification information. Is preferably presented as the guidance information.
- the guidance step presents an image indicating the position of the registered product as guidance information when the product identification information identified in the identification step and the registered product identification information do not match. It is preferable to do.
- the image indicating the position of the registered product is presented as the guidance information, so the registered product is not included in the photographed image. Even in this case, the position of the registered product can be presented to the user.
- the guiding step includes displaying an image indicating a direction in which the registered product exists when the product identification information specified in the specifying step does not match the registered product identification information. It is preferable to present it as information.
- the image indicating the direction in which the registered product exists is presented as the guidance information, so the registered product is included in the captured image. Even if not, the direction in which the registered product exists can be presented to the user.
- the product identification information specified in the specifying step does not match the registered product identification information, and the registered product is hidden at a hidden position in the captured image.
- the arrangement position of the product identification information specified in the specifying step is specified in the building, and the specified arrangement position is an arrangement position of the product identification information included in the product arrangement information. It is preferable that the method further includes an update step of updating the product arrangement information so as to change the arrangement position of the product identification information included in the product arrangement information to the specified arrangement position.
- the product arrangement information since the product arrangement information is updated based on the captured image, the product arrangement information can be updated every time a captured image is acquired, and the latest product arrangement information is used. The position of the registered product can be presented to the user.
- the registered product includes a plurality of registered products
- the guide step is closest to an arrangement position of the product identification information specified in the specifying step among the plurality of registered products. It is preferable to present guidance information for guiding the user to the arrangement position of the registered product.
- a guidance system is a guidance system including a server device and a guidance device that is communicably connected to the server device, and the server device includes a plurality of guidance devices arranged in a building.
- a product placement information holding unit for holding product placement information in which a plurality of product identification information for identifying a product and placement positions of the plurality of products in the building are associated with each other, and a user's surroundings in the building
- a captured image acquisition unit that acquires a captured image obtained by photographing
- a specifying unit that analyzes the captured image acquired by the captured image acquisition unit and specifies product identification information included in the captured image
- Registration for identifying the product identification information specified by the product placement information, the product placement information held in the product placement information holding unit, and a registered product registered in advance by a user
- a guide information creating unit that creates a guide information for identifying the location of the registered product in the building based on product identification information and guiding the user to the location of the specified registered product.
- the guidance device includes a photographing
- the product placement information in which the plurality of product identification information for identifying the plurality of products placed in the building is associated with the placement positions of the plurality of products in the building is retained. Is done. A photographed image obtained by photographing the periphery of the user in the building is acquired. The acquired captured image is analyzed, and product identification information included in the captured image is specified. Based on the specified product identification information, the stored product placement information, and the registered product identification information for identifying the registered product registered in advance by the user, the location of the registered product in the building is specified. Then, guidance information for guiding the user to the specified registered product placement position is created. In the guidance device, the area around the user in the building is photographed. The created guidance information is presented.
- the guidance method and guidance system according to the present invention can guide the user to the position of the product of interest in the building, and are useful for the guidance method and system for guiding the user to the position of the product of interest. is there.
Landscapes
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Business, Economics & Management (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Finance (AREA)
- Accounting & Taxation (AREA)
- Automation & Control Theory (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Navigation (AREA)
- Instructional Devices (AREA)
Abstract
Description
まず、アプリケーションが、スマートフォンに搭載されたカメラを使って店内を撮影する。次に、アプリケーション又はサーバが、画像認識により利用者が関心のある商品を表す商品リストと、撮影された画像とをマッチングする。次に、アプリケーションが、スマートフォンの画面に利用者が関心のある商品が近辺にあることを提示する。
まず、アプリケーションが、スマートフォンに搭載されたカメラを使って店内を撮影する。次に、アプリケーション又はサーバが、画像認識により利用者が関心のある商品を表す商品リストと、撮影された画像とをマッチングする。次に、アプリケーションが、スマートフォンの画面に表示される撮影画像に、関心のある商品の位置を示すマークを重畳して提示する。
まず、アプリケーションが、スマートフォンに搭載されたカメラを使って店内を撮影する。次に、アプリケーション又はサーバが、画像認識により陳列されている商品を特定し、商品と商品が配置されている位置とを対応付けた商品レイアウト情報からスマートフォン(利用者)の位置を推定する。次に、アプリケーションが、推定したスマートフォンの位置と関心のある商品の位置とから、関心のある商品の相対位置をテキストなどでスマートフォンの画面に提示する、又は、音声で通知する。
まず、アプリケーションが、スマートフォンに搭載されたカメラを使って店内を撮影する。次に、アプリケーション又はサーバが、画像認識により陳列されている商品を特定し、商品と商品が配置されている位置とを対応付けた商品レイアウト情報からスマートフォン(利用者)の位置を推定する。次に、アプリケーションが、推定したスマートフォンの位置と関心のある商品の位置とから、関心のある商品への相対方向をスマートフォンの画面に提示する。
まず、アプリケーションが、スマートフォンに搭載されたカメラを使って店内を撮影する。次に、アプリケーション又はサーバが、画像認識により陳列されている商品を特定し、商品と商品が配置されている位置とを対応付けた商品レイアウト情報からスマートフォン(利用者)の位置を推定する。次に、アプリケーションが、スマートフォンの画面に表示される撮影画像に、棚の裏側にある関心のある商品の位置を示すマークを重畳して提示する。
図1は、本発明の実施の形態における誘導システムの全体構成を示す図である。誘導システムは、誘導サービス装置100、誘導装置200及び機器300を備える。
Claims (8)
- 建物内に配置された複数の商品を識別するための複数の商品識別情報と、前記複数の商品の前記建物内における配置位置とを対応付けた商品配置情報を商品配置情報保持部に保持する商品配置情報保持ステップと、
前記建物内における利用者の周辺を撮影する撮影ステップと、
前記撮影ステップにおいて撮影された撮影画像を分析し、前記撮影画像内に含まれる商品識別情報を特定する特定ステップと、
前記特定ステップにおいて特定された前記商品識別情報と、前記商品配置情報保持部に保持されている前記商品配置情報と、利用者によって予め登録された登録商品を識別するための登録商品識別情報とに基づいて、前記登録商品の前記建物内における配置位置を特定し、特定した前記登録商品の配置位置へ前記利用者を誘導するための誘導情報を提示する誘導ステップとを含む誘導方法。 - 前記誘導ステップは、前記特定ステップにおいて特定された前記商品識別情報と、前記登録商品識別情報とが一致する場合、前記登録商品の前記撮影画像内における位置を示す画像を前記誘導情報として提示する請求項1記載の誘導方法。
- 前記誘導ステップは、前記特定ステップにおいて特定された前記商品識別情報と、前記登録商品識別情報とが一致しない場合、前記登録商品の位置を示す画像を誘導情報として提示する請求項1又は2記載の誘導方法。
- 前記誘導ステップは、前記特定ステップにおいて特定された前記商品識別情報と、前記登録商品識別情報とが一致しない場合、前記登録商品が存在する方向を示す画像を前記誘導情報として提示する請求項3記載の誘導方法。
- 前記誘導ステップは、前記特定ステップにおいて特定された前記商品識別情報と、前記登録商品識別情報とが一致せず、前記撮影画像内の隠れた位置に前記登録商品が存在する場合、前記登録商品の仮想的な位置を示す画像を前記誘導情報として提示する請求項1~4のいずれかに記載の誘導方法。
- 前記特定ステップにおいて特定された前記商品識別情報の前記建物内における配置位置を特定し、特定した配置位置が、前記商品配置情報に含まれる前記商品識別情報の配置位置と異なる場合、前記商品配置情報に含まれる前記商品識別情報の配置位置を前記特定した配置位置に変更するように前記商品配置情報を更新する更新ステップをさらに含む請求項1~5のいずれかに記載の誘導方法。
- 前記登録商品は、複数の登録商品を含み、
前記誘導ステップは、前記複数の登録商品のうち、前記特定ステップにおいて特定された前記商品識別情報の配置位置に最も近い登録商品の配置位置へ前記利用者を誘導するための誘導情報を提示する請求項1~6のいずれかに記載の誘導方法。 - サーバ装置と、前記サーバ装置と通信可能に接続された誘導装置とを備える誘導システムであって、
前記サーバ装置は、
建物内に配置された複数の商品を識別するための複数の商品識別情報と、前記複数の商品の前記建物内における配置位置とを対応付けた商品配置情報を保持する商品配置情報保持部と、
前記建物内における利用者の周辺を撮影した撮影画像を取得する撮影画像取得部と、
前記撮影画像取得部によって取得された前記撮影画像を分析し、前記撮影画像内に含まれる商品識別情報を特定する特定部と、
前記特定部によって特定された前記商品識別情報と、前記商品配置情報保持部に保持されている前記商品配置情報と、利用者によって予め登録された登録商品を識別するための登録商品識別情報とに基づいて、前記登録商品の前記建物内における配置位置を特定し、特定した前記登録商品の配置位置へ前記利用者を誘導するための誘導情報を作成する誘導情報作成部とを備え、
前記誘導装置は、
前記建物内における利用者の周辺を撮影する撮影部と、
前記誘導情報作成部によって作成された前記誘導情報を提示する誘導情報提示部とを備える誘導システム。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/416,900 US10054448B2 (en) | 2013-06-04 | 2014-05-30 | Guiding method and guiding system |
JP2015521293A JP6314137B2 (ja) | 2013-06-04 | 2014-05-30 | 誘導サービス方法及びサーバ装置 |
CN201480001947.2A CN104508695B (zh) | 2013-06-04 | 2014-05-30 | 引导方法及引导*** |
US16/038,785 US10670409B2 (en) | 2013-06-04 | 2018-07-18 | Guiding method and guiding system |
US16/859,351 US11067397B2 (en) | 2013-06-04 | 2020-04-27 | Guiding method and guiding system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201361830730P | 2013-06-04 | 2013-06-04 | |
US61/830,730 | 2013-06-04 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/416,900 A-371-Of-International US10054448B2 (en) | 2013-06-04 | 2014-05-30 | Guiding method and guiding system |
US16/038,785 Continuation US10670409B2 (en) | 2013-06-04 | 2018-07-18 | Guiding method and guiding system |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014196178A1 true WO2014196178A1 (ja) | 2014-12-11 |
Family
ID=52007835
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2014/002892 WO2014196178A1 (ja) | 2013-06-04 | 2014-05-30 | 誘導方法及び誘導システム |
Country Status (4)
Country | Link |
---|---|
US (3) | US10054448B2 (ja) |
JP (1) | JP6314137B2 (ja) |
CN (1) | CN104508695B (ja) |
WO (1) | WO2014196178A1 (ja) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015075832A (ja) * | 2013-10-07 | 2015-04-20 | コニカミノルタ株式会社 | Ar表示システム、およびar表示装置、情報処理装置、プログラム |
JP2017058969A (ja) * | 2015-09-16 | 2017-03-23 | グリー株式会社 | 仮想画像表示プログラム、仮想画像表示装置及び仮想画像表示方法 |
JP2017117362A (ja) * | 2015-12-25 | 2017-06-29 | 東芝テック株式会社 | 買い物支援システムおよびサーバ |
JP3213869U (ja) * | 2017-09-25 | 2017-12-07 | 株式会社e−セレス | 地面・場所における各種周辺情報の表示用の標識具及びこれを利用した地面・場所における各種周辺情報の表示システム |
JP2018113824A (ja) * | 2017-01-13 | 2018-07-19 | 株式会社デンソー | 回転電機 |
WO2019106847A1 (ja) * | 2017-12-01 | 2019-06-06 | マクセル株式会社 | カメラ撮影画像を用いる位置情報システム、及びそれに用いるカメラ付き情報機器 |
JP2019091103A (ja) * | 2017-11-10 | 2019-06-13 | 東芝テック株式会社 | 情報提供装置及びプログラム |
JP2020053099A (ja) * | 2019-12-24 | 2020-04-02 | 東芝テック株式会社 | 買い物支援システムおよびサーバ |
JP2022087202A (ja) * | 2019-12-24 | 2022-06-09 | 東芝テック株式会社 | 買い物支援システムおよびプログラム |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11047702B1 (en) * | 2016-09-16 | 2021-06-29 | Apple Inc. | Tracking systems for electronic devices |
WO2018188041A1 (zh) * | 2017-04-14 | 2018-10-18 | 深圳市瑞荣创电子科技有限公司 | 一种商业区内店铺信息提供方法 |
CN107291903A (zh) * | 2017-06-23 | 2017-10-24 | 国网冀北电力有限公司唐山供电公司 | 一种基于可视化软件***的工程技术档案查找与归档方法 |
JP7118856B2 (ja) * | 2018-10-24 | 2022-08-16 | 東芝テック株式会社 | 購買支援装置及びプログラム |
CN110991372A (zh) * | 2019-12-09 | 2020-04-10 | 河南中烟工业有限责任公司 | 一种识别零售商户卷烟牌号陈列情况的方法 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003323539A (ja) * | 2002-04-30 | 2003-11-14 | Fujitsu Ltd | 店舗棚割管理システム及び情報処理装置 |
JP2011227875A (ja) * | 2010-03-31 | 2011-11-10 | Ns Solutions Corp | 情報処理装置、情報処理方法及びプログラム |
JP2011253324A (ja) * | 2010-06-01 | 2011-12-15 | Sharp Corp | 商品情報提供端末装置および商品情報提供システム |
JP2012185576A (ja) * | 2011-03-03 | 2012-09-27 | Toshiba Tec Corp | 買物アシストシステム、情報端末装置及び制御プログラム |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002175465A (ja) | 2000-12-06 | 2002-06-21 | Casio Comput Co Ltd | 買い物案内情報提供装置およびそのプログラム記録媒体 |
US20100070365A1 (en) * | 2008-09-12 | 2010-03-18 | At&T Intellectual Property I, L.P. | Planogram guided shopping |
SG10201400956YA (en) | 2010-03-30 | 2014-05-29 | Ns Solutions Corp | Information processing system, information processing method and program, information processing apparatus, vacant space guidance system, vacant space guidance method and program, image display system, image display method and program |
JP5132732B2 (ja) * | 2010-08-23 | 2013-01-30 | 東芝テック株式会社 | 店舗システムおよびプログラム |
JP5132733B2 (ja) | 2010-08-23 | 2013-01-30 | 東芝テック株式会社 | 店舗システムおよびプログラム |
US8624725B1 (en) * | 2011-09-22 | 2014-01-07 | Amazon Technologies, Inc. | Enhanced guidance for electronic devices having multiple tracking modes |
US9020838B2 (en) * | 2011-11-30 | 2015-04-28 | Ncr Corporation | Augmented reality for assisting consumer transactions |
JP2013156934A (ja) | 2012-01-31 | 2013-08-15 | Toshiba Tec Corp | 情報処理装置、店舗システム及びプログラム |
US8775068B2 (en) * | 2012-05-29 | 2014-07-08 | Apple Inc. | System and method for navigation guidance with destination-biased route display |
US20140279294A1 (en) * | 2013-03-14 | 2014-09-18 | Nordstrom, Inc. | System and methods for order fulfillment, inventory management, and providing personalized services to customers |
-
2014
- 2014-05-30 US US14/416,900 patent/US10054448B2/en active Active
- 2014-05-30 CN CN201480001947.2A patent/CN104508695B/zh active Active
- 2014-05-30 WO PCT/JP2014/002892 patent/WO2014196178A1/ja active Application Filing
- 2014-05-30 JP JP2015521293A patent/JP6314137B2/ja active Active
-
2018
- 2018-07-18 US US16/038,785 patent/US10670409B2/en active Active
-
2020
- 2020-04-27 US US16/859,351 patent/US11067397B2/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003323539A (ja) * | 2002-04-30 | 2003-11-14 | Fujitsu Ltd | 店舗棚割管理システム及び情報処理装置 |
JP2011227875A (ja) * | 2010-03-31 | 2011-11-10 | Ns Solutions Corp | 情報処理装置、情報処理方法及びプログラム |
JP2011253324A (ja) * | 2010-06-01 | 2011-12-15 | Sharp Corp | 商品情報提供端末装置および商品情報提供システム |
JP2012185576A (ja) * | 2011-03-03 | 2012-09-27 | Toshiba Tec Corp | 買物アシストシステム、情報端末装置及び制御プログラム |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015075832A (ja) * | 2013-10-07 | 2015-04-20 | コニカミノルタ株式会社 | Ar表示システム、およびar表示装置、情報処理装置、プログラム |
JP2017058969A (ja) * | 2015-09-16 | 2017-03-23 | グリー株式会社 | 仮想画像表示プログラム、仮想画像表示装置及び仮想画像表示方法 |
JP2017117362A (ja) * | 2015-12-25 | 2017-06-29 | 東芝テック株式会社 | 買い物支援システムおよびサーバ |
JP2018113824A (ja) * | 2017-01-13 | 2018-07-19 | 株式会社デンソー | 回転電機 |
JP3213869U (ja) * | 2017-09-25 | 2017-12-07 | 株式会社e−セレス | 地面・場所における各種周辺情報の表示用の標識具及びこれを利用した地面・場所における各種周辺情報の表示システム |
JP7049809B2 (ja) | 2017-11-10 | 2022-04-07 | 東芝テック株式会社 | 情報提供装置及びプログラム |
JP7361828B2 (ja) | 2017-11-10 | 2023-10-16 | 東芝テック株式会社 | 情報提供装置及びプログラム |
JP2019091103A (ja) * | 2017-11-10 | 2019-06-13 | 東芝テック株式会社 | 情報提供装置及びプログラム |
JP2022084876A (ja) * | 2017-11-10 | 2022-06-07 | 東芝テック株式会社 | 情報提供装置及びプログラム |
JPWO2019106847A1 (ja) * | 2017-12-01 | 2020-12-17 | マクセル株式会社 | カメラ撮影画像を用いる位置情報システム、及びそれに用いるカメラ付き情報機器 |
JP7001711B2 (ja) | 2017-12-01 | 2022-01-20 | マクセル株式会社 | カメラ撮影画像を用いる位置情報システム、及びそれに用いるカメラ付き情報機器 |
WO2019106847A1 (ja) * | 2017-12-01 | 2019-06-06 | マクセル株式会社 | カメラ撮影画像を用いる位置情報システム、及びそれに用いるカメラ付き情報機器 |
JP2021101386A (ja) * | 2019-12-24 | 2021-07-08 | 東芝テック株式会社 | 買い物支援システムおよびサーバ |
JP7059418B2 (ja) | 2019-12-24 | 2022-04-25 | 東芝テック株式会社 | 買い物支援システムおよびサーバ |
JP2020053099A (ja) * | 2019-12-24 | 2020-04-02 | 東芝テック株式会社 | 買い物支援システムおよびサーバ |
JP2022087202A (ja) * | 2019-12-24 | 2022-06-09 | 東芝テック株式会社 | 買い物支援システムおよびプログラム |
JP7166477B2 (ja) | 2019-12-24 | 2022-11-07 | 東芝テック株式会社 | 買い物支援システムおよびプログラム |
Also Published As
Publication number | Publication date |
---|---|
JPWO2014196178A1 (ja) | 2017-02-23 |
CN104508695A (zh) | 2015-04-08 |
US20200256680A1 (en) | 2020-08-13 |
CN104508695B (zh) | 2019-03-15 |
JP6314137B2 (ja) | 2018-04-18 |
US20150204677A1 (en) | 2015-07-23 |
US10670409B2 (en) | 2020-06-02 |
US20180321044A1 (en) | 2018-11-08 |
US11067397B2 (en) | 2021-07-20 |
US10054448B2 (en) | 2018-08-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6314137B2 (ja) | 誘導サービス方法及びサーバ装置 | |
JP5280590B2 (ja) | 情報処理システム、情報処理方法及びプログラム | |
CN108362279B (zh) | 基于增强现实技术ar的购物导航方法、装置及*** | |
US8918208B1 (en) | Projection of interactive map data | |
US20190251719A1 (en) | System and method for augmented reality map | |
US10354316B2 (en) | Item list display | |
US20150161715A1 (en) | Using indoor maps to direct consumers to sale items, shopping lists, or other specific locations in a store, retail establishment, or other geographic area | |
US20120130635A1 (en) | Portable information terminal apparatus and computer program product | |
US11410390B2 (en) | Augmented reality device for visualizing luminaire fixtures | |
JPWO2014017392A1 (ja) | 情報処理装置、そのデータ処理方法、およびプログラム | |
CN112182426A (zh) | 用户界面信息展示方法、装置及电子设备 | |
JP2015152483A (ja) | 位置情報取得システム、及び位置情報取得方法 | |
JP2019032791A (ja) | 表示制御装置、表示制御方法及び表示制御システム | |
KR101117615B1 (ko) | 실내 측위기술이 탑재된 스마트 폰의 위치정보를 이용한 광고 제공 방법 | |
JPWO2018021229A1 (ja) | シミュレーションシステム、シミュレーション方法及び冷蔵庫 | |
JP2019075126A (ja) | 情報処理装置及びプログラム | |
KR101925181B1 (ko) | 증강/가상 현실 기반 동적 정보 처리 방법 및 시스템 | |
JP2018156623A (ja) | 不動産情報提供システム、サーバ、方法およびプログラム | |
Mankodiya et al. | Interactive shopping experience through immersive store environments | |
KR20200127107A (ko) | 증강현실을 이용한 지역 상권 데이터 가시화 시스템 | |
JP5493581B2 (ja) | 情報処理システム、情報処理装置、情報管理装置及びプログラム | |
JP2017037355A (ja) | 周辺情報配信システム | |
JP2014228458A (ja) | 投票処理システム、サーバ装置、端末装置、投票処理用プログラムおよび投票処理方法 | |
WO2020244578A1 (zh) | 基于光通信装置的交互方法和电子设备 | |
JP2019074649A (ja) | 情報処理装置及びプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2015521293 Country of ref document: JP Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14808099 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14416900 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 14808099 Country of ref document: EP Kind code of ref document: A1 |