WO2010029671A1 - System capable of displaying virtual information added to visibility information - Google Patents

System capable of displaying virtual information added to visibility information Download PDF

Info

Publication number
WO2010029671A1
WO2010029671A1 PCT/JP2009/003222 JP2009003222W WO2010029671A1 WO 2010029671 A1 WO2010029671 A1 WO 2010029671A1 JP 2009003222 W JP2009003222 W JP 2009003222W WO 2010029671 A1 WO2010029671 A1 WO 2010029671A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
information providing
providing terminal
server
virtual display
Prior art date
Application number
PCT/JP2009/003222
Other languages
French (fr)
Japanese (ja)
Inventor
井口尊仁
Original Assignee
頓智ドット株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 頓智ドット株式会社 filed Critical 頓智ドット株式会社
Publication of WO2010029671A1 publication Critical patent/WO2010029671A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Definitions

  • the present invention relates to a system that can display virtual information added to view information. More specifically, the present invention relates to a system capable of inputting and displaying virtual information corresponding to the real world by inputting the direction of the information providing terminal manually in an information providing terminal having no gyro.
  • Patent Document 1 discloses an invention in which real-world media (broadcasting, etc.) and virtual space media (broadcasting, etc.) are integrated to link the real world and virtual space.
  • the virtual space is not directly linked to the real world taken by the mobile terminal in the real world. For this reason, the system disclosed in this publication has a sense of unity and reality.
  • Patent Document 2 states that “a plurality of balloons in which a plurality of three-dimensional real space range information is associated with an identifier for identifying each three-dimensional real space range information. A first database holding data. Thereby, a plurality of balloon data corresponding to the three-dimensional real space can be displayed.
  • Paragraph [0023] of this publication discloses that the mobile terminal has an inclination sensor and an orientation sensor. In the invention disclosed in this publication, an inclination sensor is used to grasp the inclination of the mobile terminal from the horizontal plane, and an orientation sensor is used to grasp the azimuth.
  • the object of the present invention is to provide a system capable of displaying real world and virtual space in combination with reality.
  • Another object of the present invention is to provide a system capable of easily grasping the tilt and direction of an information providing terminal and appropriately displaying the real society and a virtual space.
  • the information providing terminal 3 that can superimpose and display the virtual display corresponding to the object included in the photographed real space, the position of the information providing terminal 3, and the information providing terminal 3
  • the present invention relates to an information providing system 1 including a server 5 that transmits display information.
  • the information providing terminal 3 includes a receiving unit 31 of the information providing terminal 3, a photographing unit 33, a position grasping unit 34, a scroll unit 35, a display unit 37, and a transmitting unit 39 of the information providing terminal 3. .
  • the receiving means 31 of the information providing terminal 3 is means for receiving virtual display information from the server 5.
  • the photographing means 33 is a means for photographing a real space.
  • the position grasping means 34 is a means for grasping the position of the information providing terminal 3.
  • the scroll unit 35 is a unit for inputting information related to the direction of the information providing terminal 3.
  • the display unit 37 can display the real space photographed by the photographing unit 33 and can superimpose a virtual display based on the virtual display information transmitted from the server 5 on the real space.
  • the transmission means 39 of the information providing terminal 3 is a means for transmitting to the server 5 information relating to the position of the information providing terminal 3 grasped by the position grasping means 34 and information relating to the direction of the information providing terminal 3 input by the scroll means 35. It is.
  • the server 5 includes a receiving unit 51 of the server 5, a database 53, a virtual display information selecting unit 55, and a transmitting unit 57 of the server 5.
  • the receiving means 51 of the server 5 is means for receiving information relating to the position of the information providing terminal 3 and information relating to the direction of the information providing terminal 3.
  • the database 53 is a storage unit that stores virtual display information corresponding to an object in association with information about the object.
  • the virtual display information selection unit 55 grasps the object included in the real space photographed by the information providing terminal 3 from the information related to the position of the information providing terminal 3 and the information related to the direction of the information providing terminal 3, and This is means for selecting and reading out virtual display information corresponding to the object from the database.
  • the transmission means 57 of the server 5 is means for transmitting virtual display information corresponding to the object read by the virtual display information selection means 55 to the information providing terminal 3.
  • the information providing system 1 operates as follows. Information relating to the real space is input to the information providing terminal 3 by the imaging means 33. Information regarding the position of the information providing terminal 3 is grasped by the position grasping means 34. Information relating to the direction of the information providing terminal 3 is input to the information providing terminal 3 by the scroll means 35. Information relating to the position of the information providing terminal 3 and information relating to the direction of the information providing terminal 3 are transmitted to the server 5 by the transmission means 39 of the information providing terminal 3. The receiving means 51 of the server 5 receives information regarding the position of the information providing terminal 3 and information regarding the direction of the information providing terminal 3.
  • the virtual display information selection means 55 grasps the object included in the real space photographed by the information providing terminal 3 from the information related to the position of the information providing terminal 3 and the information related to the direction of the information providing terminal 3, and A virtual display corresponding to the object is selected from the database 53 and read.
  • the transmission unit 57 of the server 5 transmits virtual display information corresponding to the object read by the virtual display information selection unit 55 to the information providing terminal 3.
  • the display unit of the information providing terminal 3 displays the real space photographed by the photographing unit 33 and displays a virtual display based on the virtual display information transmitted from the server 5 so as to overlap the real space.
  • the second aspect of the present invention basically relates to an information providing system 1 including an information providing terminal 3 that can be photographed, a server 5, and a base station 7 that mediates between the information providing terminal 3 and the server 5.
  • the information providing terminal 3 is an information providing terminal capable of displaying a virtual display corresponding to an object included in the real space on the photographed real space
  • the server 5 provides the information providing The position of the terminal 3 is grasped and virtual display information is transmitted to the information providing terminal 3.
  • information relating to the real space is input to the information providing terminal 3 by the photographing unit 33, and information relating to the direction of the information providing terminal 3 is input to the information providing terminal 3 by the scroll unit 35.
  • the receiving means 71 of the base station 7 receives information on the direction of the information providing terminal 3, the position grasping means 73 grasps the position of the information providing terminal 3, and the transmitting means 75 of the base station 7 Information relating to the position of the information providing terminal 3 and information relating to the direction of the information providing terminal 3 are transmitted to the server 5.
  • the receiving means 51 receives the information related to the position of the information providing terminal 3 and the information related to the direction of the information providing terminal 3 transmitted from the base station 7, and the virtual display information selecting means 55 is connected to the information providing terminal 3.
  • the object included in the real space photographed by the information providing terminal 3 is grasped, and the virtual display information corresponding to the grasped object is obtained from the database 53.
  • the transmission means 57 of the server 5 transmits the virtual display information corresponding to the object read by the virtual display information selection means to the information providing terminal 3.
  • the display unit 39 of the information providing terminal 3 displays the real space photographed by the photographing unit 33 and the virtual display based on the virtual display information transmitted from the server 5 is displayed superimposed on the real space.
  • this information providing system 1 virtual information can be added to the visual field information in the real space. Therefore, the user can acquire information that cannot be obtained only from the visual space information (Live View) in the real space from the virtual information at the destination. Moreover, since this virtual information is displayed in a state associated with the real society, the user can view the display screen 37a of the display means 37 with a sense of unity and reality. For this reason, the user can obtain information while viewing the display screen 37a without feeling uncomfortable.
  • the information providing terminal 3 includes the scroll unit 35, it is not necessary to provide the information providing terminal 3 with an inclination sensor such as a gyroscope or an orientation sensor. It is not necessary to calculate and calculate from the output information of the inclination sensor or the azimuth sensor, and can be easily grasped.
  • the present invention it is possible to provide a system capable of displaying the real world and the virtual space in association with reality.
  • a system capable of easily grasping the inclination and direction of the information providing terminal 3 and appropriately connecting the real society and the virtual space for display.
  • FIG. 1 is a block diagram showing a basic configuration of an information providing system relating to the first aspect of the present invention.
  • FIG. 2 is an example of a database.
  • FIG. 3 is a diagram showing a display screen when the real space photographed by the photographing means is displayed.
  • FIG. 4 is a diagram showing a display screen when a virtual display is superimposed and displayed in the real space as shown in FIG.
  • FIG. 5 is a block diagram showing a basic configuration of an information providing system relating to the second aspect of the present invention.
  • FIG. 1 is a block diagram showing a basic configuration of an information providing system relating to the first aspect of the present invention.
  • the information providing system 1 of the present invention includes an information providing terminal 3 and a server 5.
  • reference numeral 7 denotes a base station or an access point, which is an optional element for relaying information exchange between the information providing terminal 3 and the server 5.
  • the information providing terminal 3 includes a receiving unit 31 for the information providing terminal 3, a photographing unit 33, a position grasping unit 34, a scroll unit 35, a display unit 37, and a transmitting unit 39 for the information providing terminal 3. is doing. And the virtual display corresponding to the target object contained in this space can be superimposed and displayed on the image
  • Examples of the information providing terminal 3 are configured to be communicable, such as a portable communication device with an imaging device such as a mobile phone, a portable information processing device with an imaging device such as a notebook personal computer or PDA (Personal digital assistant), etc. An image processing apparatus (digital camera or video camera).
  • the information providing terminal 3 may be a portable terminal or a stationary terminal. These devices and apparatuses are preferably configured to be capable of wireless communication. Since the information providing terminal has a device for wireless communication, the user can carry these devices and devices around.
  • each means of the information providing terminal 3 is realized by a built-in computer indicated by a dotted line in FIG. That is, the information recording medium of this computer stores a program for causing this computer to function as an apparatus including each means.
  • each element is connected via a bus or the like, so that information can be exchanged.
  • the control unit appropriately reads information from the storage unit in response to an instruction of the control program stored in the main memory, performs arithmetic processing using the arithmetic unit, The calculation result is appropriately stored in the storage unit and output from the output unit.
  • the receiving means 31 of the information providing terminal 3 is means for receiving virtual display information from the server 5.
  • the receiving means 31 can be realized by a known antenna and CODEC (encoder and decoder), for example.
  • the photographing means 33 is a means for photographing a real space.
  • the user selects the direction (azimuth or inclination) of the information providing terminal 3 so as to include the object that is the main subject, and the imaging unit 33 images the real space with the selected direction as the imaging direction. That is, the real space includes an object.
  • An example of the photographing means 33 is a known digital camera mounted on a mobile phone.
  • the position grasping means 34 is a means for grasping the position of the information providing terminal 3.
  • the position grasping means 73 specifies the position latitude and longitude of the information providing terminal 3 based on, for example, information from a GPS (Global Positioning System) satellite.
  • the position grasping means 34 may identify the position of the information providing terminal 3 by a WiFi (Wi-Fi) mechanism.
  • the information providing terminal 3 When the information providing terminal 3 has a GPS function, the information providing terminal 3 receives a GPS signal transmitted from a GPS satellite. The information providing terminal 3 analyzes the received GPS signal and grasps the position of the information providing terminal. The position of the information providing terminal is represented by, for example, latitude and longitude. The information providing terminal 3 temporarily stores information on the analyzed position of the information providing terminal in a memory or the like. In this way, the information providing terminal grasps the position of the information providing terminal 3.
  • the information providing terminal 3 When the information providing terminal 3 has a wireless LAN communication function such as Wi-Fi, the information providing terminal 3 receives information on the position of the information providing terminal such as a Wi-Fi signal.
  • the information providing terminal 3 has a database for analyzing the position of the information providing terminal using a Wi-Fi signal. Then, the information providing terminal 3 analyzes the received Wi-Fi signal and grasps the position of the information providing terminal.
  • the position of the information providing terminal is represented by, for example, latitude and longitude.
  • the information providing terminal 3 temporarily stores information on the analyzed position of the information providing terminal in a memory or the like. In this way, the information providing terminal grasps the position of the information providing terminal 3.
  • the position of the information providing terminal may be grasped as follows. That is, the information providing terminal 3 receives information on the position of the information providing terminal such as a Wi-Fi signal. The information providing terminal 3 transmits the Wi-Fi signal or information obtained by analyzing the Wi-Fi signal to a server for grasping the position.
  • the server for grasping the position has a database for acquiring position information based on the Wi-Fi signal or information obtained by analyzing the Wi-Fi signal. For this reason, the server for grasping
  • the information providing terminal 3 receives position information from a server for grasping the position. The information providing terminal 3 temporarily stores the received information regarding the position of the information providing terminal in a memory or the like. In this way, the information providing terminal grasps the position of the information providing terminal 3.
  • the scroll means 35 is a means for inputting information related to the direction of the information providing terminal 3.
  • the scroll unit 35 is mainly configured by a scroll bar 35a displayed on the display screen 37a of the display unit 37 and a unit for displaying the scroll bar 35a. That is, the example of the scroll means of the present invention is such that the scroll bar displayed on the monitor is scrolled to input information relating to the direction of the information providing terminal itself.
  • the scroll means 35 may be a slide bar instead of the scroll bar 35a. Then, the user can input the azimuth of the information providing terminal 3 such as east, west, north and south, and the inclination of the information providing terminal 3 with respect to the horizontal plane or the ground by operating the scroll bar 35a.
  • a monitor as a display means may be a pressure-sensitive touch panel, and a change in pressure may be grasped and instruction information may be input thereby.
  • the user can change the shooting direction or the relative positional relationship between the object and the information providing terminal 3, and the upper side of the display screen 37 a of the display means 37 of the information providing terminal 3 "May be designated by tracing the display screen 37a with a finger (flicking or pinching). Or in order to designate an azimuth
  • the direction of the information providing terminal 3 can be specified from the date on which the scroll bar 35a is operated and the direction of the sun or the moon.
  • the shooting direction with respect to the path the user (that is, the information providing terminal 3) has moved may be input.
  • the course of the information providing terminal 3 can be grasped from the time-lapse information of the position of the information providing terminal 3 grasped by the position grasping means.
  • the information input by the scroll unit 35 is not limited to the azimuth and inclination of the information providing terminal 3 and may be any information as long as the direction of the information providing terminal 3 can be specified.
  • the scroll means of the present invention there is one that inputs the direction of the information providing terminal itself by tracing a monitor on which a real space is displayed. Specifically, the virtual display about the typical target object near the information provision terminal transmitted from the server is displayed on the display means. Then, by moving the display by tracing the monitor, and receiving input information such as releasing the finger from the monitor when it matches the object in the real space, this inputs information regarding the direction of the information providing terminal itself Things can be raised.
  • the display unit 37 displays the real space photographed by the photographing unit 33 and can superimpose a virtual display based on the virtual display information transmitted from the server 5 on the real space.
  • An example of the display means is a mobile phone monitor.
  • the information providing terminal has, for example, a frame buffer.
  • the information providing terminal may store information for display in the frame buffer, convert the information into display information, and display the information on the monitor.
  • the display unit 37 is preferably configured with a touch panel. In this case, the touch panel can function as a part of the input means.
  • the transmission unit 39 is a unit that transmits information on the position of the information providing terminal 3 grasped by the position grasping unit 34 and information on the direction of the information providing terminal 3 input by the scroll unit 35.
  • Specific examples of the transmission means include an antenna and a CODEC.
  • the server 5 includes a receiving unit 51 for the server 5, a database 53, a virtual display information selecting unit 55, and a transmitting unit 57 for the server 5, grasping the position of the information providing terminal 3 and providing information The virtual display information is transmitted to the terminal 3.
  • each means of the server 5 is realized by a built-in computer indicated by a dotted line in FIG. That is, the information recording medium of this computer stores a program for causing this computer to function as an apparatus including each means.
  • the receiving means 51 is means for receiving information relating to the position of the information providing terminal 3 and information relating to the direction of the information providing terminal 3.
  • the database 53 is a storage unit that stores virtual display information corresponding to a target object in association with information about the target object.
  • An example of information on the object is information on the position of the object.
  • the virtual display information is information for the information providing terminal to perform virtual display based on this information.
  • the virtual display information includes information for reading out the data and position information of the object.
  • the virtual display information may be image data or text data for the information providing terminal to perform virtual display, and position information of the target object. .
  • FIG. 2 is an example of the database 53.
  • an object, its position, its orientation, text information about the object, and image information necessary for virtual display such as a still image and a moving image are associated with each other.
  • information on stores in the building is divided according to the direction of the building.
  • the object may be associated with the angle and the image information of the building corresponding to the angle, thereby providing more detailed information to the user accurately. can do.
  • the virtual display information selection means 55 grasps the object included in the real space photographed by the information providing terminal 3 from the information related to the position of the information providing terminal 3 and the information related to the direction of the information providing terminal 3, and This is means for selecting and reading out a virtual display corresponding to the object from the database 53.
  • the virtual display information selection unit 55 specifies the position of the target object that is the main subject from the position and direction of the information providing terminal 3, selects the target object at the specified position from the database 53, and The direction is specified, and text information and image information associated with the object are read as virtual display information corresponding to the object. Further, for example, it is possible to grasp the real space photographed by the information providing terminal 3 from the information related to the position of the information providing terminal 3 and the information related to the direction of the information providing terminal 3 and select an object included in the space. Good.
  • the server 5 may count the number of objects included in the shooting space. And the server 5 may memorize
  • the position of the identified object and the position of the object stored in the database 53 do not have to be completely matched, and may be matched within an allowable range.
  • the virtual display information selection unit 55 selects the information on the object of the genre corresponding to the user profile, information requested by the user, and the like. Composed. In this case, the user's profile age, sex, occupation, and the information required by the user are registered in the server 5 in advance.
  • Another example of the virtual display information selection unit 55 is to obtain an area included in the real space photographed by the information providing terminal 3 from information relating to the position of the information providing terminal 3 and information relating to the direction of the information providing terminal 3. is there. And the target object which has the latitude and longitude contained in this area
  • the transmission unit 57 is a unit that transmits a virtual display corresponding to the object read by the virtual display information selection unit 55 to the information providing terminal 3.
  • the user points the information providing terminal 3 toward a desired object, and images the real space including the object by the imaging means 33.
  • information relating to the real space is input to the information providing terminal 3, thereby causing the display means 37 to display the real space photographed by the photographing means 33 as shown in FIG. 3.
  • “XX building” is the object.
  • the position grasping means grasps the position of the information providing terminal 3. Subsequently, the user inputs information regarding the direction of the information providing terminal 3 to the information providing terminal 3 using the scroll unit 35 while visually recognizing the displayed real space.
  • the scroll bar 35a is used to input that the direction is “westward” and that the tilt angle indicating the tilt of the information providing terminal 3 is about ⁇ 20 °.
  • the transmission means 39 of the information provision terminal 3 transmits information regarding the position of the information provision terminal 3 and information regarding the direction of the information provision terminal 3 to the server 5.
  • the receiving unit 71 receives the position information of the information providing terminal 3 and the information on the direction of the information providing terminal 3 transmitted from the information providing terminal 3.
  • the receiving unit 51 receives information on the position of the information providing terminal 3 and information on the direction of the information providing terminal 3.
  • the virtual display information selection unit 55 selects the object included in the real space photographed by the information providing terminal 3 from the information related to the position of the information providing terminal 3 and the information related to the direction of the information providing terminal 3.
  • a virtual display corresponding to the grasped object is selected from the database 53 and read out. That is, it can be said that the server 5 grasps the real space photographed by the information providing terminal 3.
  • virtual display information is transmitted to the information providing terminal 3, and the virtual display information includes information regarding the position of the object. For this reason, the information providing terminal 3 estimates the position of the object displayed on the display unit using the information on the position of the object, and draws a virtual display at or near the estimated position of the object. .
  • the contents of the virtual display corresponding to the object are selected based on the user's profile age, sex, occupation, etc., information requested by the user, and the time.
  • the user is “female” and the user is interested in information (genre) related to “meal”
  • the information related to “stationery store” and the information related to “bank” are deleted even if extracted from the database 53. Is done.
  • the virtual display information corresponding to the object read by the virtual display information selection unit 55 is transmitted to the information providing terminal 3 by the transmission unit 57.
  • the virtual display (Virtual World) transmitted from the server 5 by the display means 37 is overlapped with the real space (Real World) photographed and displayed by the photographing means 33. Will be displayed.
  • An example of the display screen 37a at this time is shown in FIG.
  • text information and image information related to “XX Ramen Store” are displayed as a virtual display (object) in the vicinity of the wall facing “West” of “XX Building” that is the object.
  • the virtual display is displayed in an easy-to-understand manner for the user.
  • the virtual display can be easily understood by the user by changing the shape, color, movement, etc. of the virtual display according to the genre corresponding to the virtual display information.
  • the narrow display screen 37a can be efficiently used by displaying only the link destination, switching to the list display, or creating another screen. Is preferred.
  • the main body of the information providing terminal 3 especially in the case of iPhone (registered trademark)
  • the screen is changed to a link destination screen by changing to (direction).
  • you may output with an audio
  • virtual information can be added to the visual field information in the real space. Therefore, according to the aspect mentioned above, the user can acquire the information which cannot be obtained only by the visual field information (Live View) of the real space from the virtual information on the go. Moreover, since the virtual information is displayed in a state associated with the real society, the user can view the display screen 37a with a sense of unity and reality. For this reason, the user can obtain information while viewing the display screen 37a without feeling uncomfortable.
  • the user selects the virtual information to be added to the view information simply by operating the scroll means 35 and specifying the information regarding the direction of the information providing terminal 3, so that the virtual information can be obtained very easily. can do. That is, the user does not need to input time, a keyword, or the like in order to acquire virtual information, and it does not take time.
  • the information providing terminal 3 since the information providing terminal 3 has the scroll means 35, it is not necessary to provide the information providing terminal 3 with an inclination sensor such as a gyroscope or an orientation sensor, and the information providing terminal 3 can be downsized. Furthermore, since it is not necessary to provide the information providing terminal 3 with an inclination sensor or an orientation sensor, the server 5 does not have to calculate information regarding the direction of the information providing terminal 3 from the output information of the inclination sensor or the orientation sensor. Can be grasped easily and accurately.
  • an inclination sensor such as a gyroscope or an orientation sensor
  • the virtual information transmitted from the server 5 to the information providing terminal 3 is limited to a range that can be photographed by the photographing unit 33 of the information providing terminal 3, that is, a target related to an object that is visible to the user.
  • the amount of information can be reduced.
  • the amount of information can be further reduced by limiting the virtual information to information corresponding to the time when the current image was taken. That is, the server 5 can reduce the noise ratio (S / N ratio) included in the virtual information to be provided to the user. Thereby, the user does not need to acquire useless information and can acquire appropriate information, and as a result, it becomes possible to act intuitively.
  • the load on the network can be reduced.
  • the information on the object is classified according to the direction of the object, so that the user can obtain different information depending on the direction when the object such as a building is photographed. Yes. Thereby, more appropriate information can be provided to the user.
  • the base station has a position grasping means 73. That is, it is the same as that of the information provision system regarding the 1st embodiment of this invention except a base station having a position grasping means.
  • the information provision system concerning the 2nd embodiment of the present invention can adopt suitably various elements explained in the information provision system concerning the 1st embodiment of the present invention.
  • the user inputs information relating to the real space to the information providing terminal 3 by directing the information providing terminal 3 toward a desired target and photographing the real space including the target with the photographing unit 33.
  • the user inputs information regarding the direction of the information providing terminal 3 to the information providing terminal 3 using the scroll unit 35 while visually recognizing the displayed real space.
  • the transmission means 39 of the information providing terminal 3 transmits information regarding the direction of the information providing terminal 3 to the base station 7.
  • the receiving means 71 receives the information regarding the direction of the information providing terminal 3 transmitted from the information providing terminal 3 from the information providing terminal 3.
  • the base station 7 grasps the position of the information providing terminal 3 by the position grasping means 73.
  • the base station 7 receives a Wi-Fi signal transmitted from the information providing terminal 3.
  • the base station has a database for grasping the information providing terminal 3 based on the Wi-Fi signal. For this reason, the base station 7 can grasp the position of the information providing terminal 3.
  • the transmission means 75 of the base station 7 transmits information regarding the position of the information providing terminal 3 and information regarding the direction of the information providing terminal 3 to the server 5.
  • the receiving means 51 receives the information related to the position of the information providing terminal 3 and the information related to the direction of the information providing terminal 3 transmitted from the base station 7.
  • the subsequent information processing is the same as that of the information provision system regarding the first embodiment.
  • a user photographs a certain space using a camera. Then, an image of the photographed space is input into the system and temporarily stored in the storage unit.
  • the terminal When shooting is performed using a camera, the terminal acquires information on the position of the terminal using the GPS function. Information about the obtained position of the terminal is stored in a storage unit in the terminal. Further, since the terminal includes the scroll unit 35, the direction of the lens of the camera is appropriately input to the terminal by the scroll unit, and the direction of the lens of the camera (the direction of the terminal) is stored in the storage unit. Since the direction of the terminal before a certain operation is already stored in the storage unit, when there is an input from the scroll means, the stored terminal direction is read and the amount of displacement input by the scroll means is read. May be added to obtain new terminal direction information. Next, information regarding the position of the terminal 3 and information regarding the direction of the terminal 3 are transmitted to the server 5.
  • the server 5 receives information on the position of the terminal 3 and information on the direction of the terminal 3.
  • the server that has received the information uses the information on the position of the terminal 3 and the information on the direction of the terminal 3 to obtain a space (display space) that is considered to be captured by the camera and displayed on the terminal 3.
  • the server uses the position (that is, a certain area) included in the display space to raise candidates for objects to be displayed on the terminal from the database.
  • the database 53 stores latitude and longitude as the position of the object. Therefore, the server 5 determines whether or not the latitude and longitude are included in the display space. When it is determined that the latitude and longitude are included in the display space, it is determined that the object is included in the captured real space.
  • the database 53 stores virtual display information (text information, images, photos, videos, or sounds) associated with the position of the object.
  • the server 5 reads virtual display information about the object included in the real space to be photographed.
  • the server 5 transmits the read virtual display information and the position information about the target object to the terminal 3.
  • the terminal 3 obtains the display position of the monitor using the position information about the object. Since the terminal has information regarding the position of the terminal 3 and information regarding the direction of the terminal 3, it is possible to determine which position on the monitor indicates which latitude and longitude. Therefore, the terminal can determine at which position on the monitor the position information about the object is displayed.
  • the terminal that has grasped the position on the monitor that performs virtual display performs virtual display at the position using the virtual display information. In this way, the virtual display can be superimposed and displayed on the image captured by the terminal.
  • the information providing system of the present invention can be used in fields such as the communication equipment industry.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

A system capable of displaying a real society and a virtual space in association, with reality. An information providing system (1) comprises an information providing terminal (3) which input-photographs information relating to a real space into the terminal (3) and transmits information relating to the position of the terminal (3) and the direction of the terminal (3) to a server (5), and the server (5) which grasps, from the received  information relating to the position and direction of the terminal (3), objects included in the real space photographed by the terminal (3), selectively reads a virtual display corresponding to the objects from a database (53), and transmits the virtual display to the terminal (3).  Thus, the terminal (3) displays virtual display information superimposed on the photographed real space.

Description

視界情報に仮想情報を付加して表示できるシステムA system that can display virtual information added to view information
　本発明は、視界情報に仮想情報を付加して表示できるシステムなどに関する。より詳しく説明すると、本発明は、ジャイロを持たない情報提供端末において、マニュアルにより情報提供端末の方向を入力し、これにより現実社会に対応した仮想情報を付加して表示できるシステムに関する。 The present invention relates to a system that can display virtual information added to view information. More specifically, the present invention relates to a system capable of inputting and displaying virtual information corresponding to the real world by inputting the direction of the information providing terminal manually in an information providing terminal having no gyro.
　特開２００３－２４８６５０号公報（特許文献１）には、現実世界のメディア（放送等）と仮想空間のメディア（放送等）を統合し、現実社会と仮想空間を結びつける発明が開示されている。この発明は、現実世界において携帯端末が撮影した現実世界に直接仮想空間が結び付けられるものではない。このため、この公報に開示されたシステムは、一体感やリアリティにかける。 Japanese Patent Application Laid-Open No. 2003-248650 (Patent Document 1) discloses an invention in which real-world media (broadcasting, etc.) and virtual space media (broadcasting, etc.) are integrated to link the real world and virtual space. In the present invention, the virtual space is not directly linked to the real world taken by the mobile terminal in the real world. For this reason, the system disclosed in this publication has a sense of unity and reality.
　一方、特開２００６－２４１６８号公報（特許文献２）に開示された発明は、「複数の３次元実空間範囲情報と各３次元実空間範囲情報を識別する識別子とを対応付けた複数のバルーンデータを保持する第１データベース」を有する。これにより３次元実空間に対応した複数のバルーンデータを表示することができるとされている。この公報の段落［００２３］には、携帯端末が、傾斜センサ及び方位センサを有することが開示されている。そして、この公報に開示された発明は、傾斜センサを用いて携帯端末の水平面からの傾きを把握し、方位センサを用いて方位を把握するとされている。 On the other hand, the invention disclosed in Japanese Patent Laying-Open No. 2006-24168 (Patent Document 2) states that “a plurality of balloons in which a plurality of three-dimensional real space range information is associated with an identifier for identifying each three-dimensional real space range information. A first database holding data. Thereby, a plurality of balloon data corresponding to the three-dimensional real space can be displayed. Paragraph [0023] of this publication discloses that the mobile terminal has an inclination sensor and an orientation sensor. In the invention disclosed in this publication, an inclination sensor is used to grasp the inclination of the mobile terminal from the horizontal plane, and an orientation sensor is used to grasp the azimuth.
　しかしながら、現実に傾斜センサや方位センサを用いても携帯端末の傾きや方向を正しく把握することができない。
特開２００３－２４８６５０号公報 特開２００６－２４１６８号公報 However, even if an inclination sensor or an orientation sensor is actually used, the inclination and direction of the mobile terminal cannot be correctly grasped.
JP 2003-248650 A JP 2006-24168 A
　本発明は、リアリティを持って、現実社会と仮想空間を結びつけて表示できるシステムを提供することを目的とする。 The object of the present invention is to provide a system capable of displaying real world and virtual space in combination with reality.
　また、本発明は、容易に情報提供端末の傾きや方向を把握して、適切に現実社会と仮想空間を結びつけて表示できるシステムを提供することを目的とする。 Another object of the present invention is to provide a system capable of easily grasping the tilt and direction of an information providing terminal and appropriately displaying the real society and a virtual space.
　本発明の第１の態様は、撮影した現実空間に含まれる対象物に対応した仮想表示を重ねて表示できる情報提供端末３と、情報提供端末３の位置を把握し、情報提供端末３へ仮想表示情報を送信するサーバ５とを含む、情報提供システム１に関する。 In the first aspect of the present invention, the information providing terminal 3 that can superimpose and display the virtual display corresponding to the object included in the photographed real space, the position of the information providing terminal 3, and the information providing terminal 3 The present invention relates to an information providing system 1 including a server 5 that transmits display information.
　そして、情報提供端末３は、情報提供端末３の受信手段３１と、撮影手段３３と、位置把握手段３４と、スクロール手段３５と、表示手段３７と、情報提供端末３の送信手段３９とを有する。情報提供端末３の受信手段３１は、サーバ５から仮想表示情報を受信する手段である。 The information providing terminal 3 includes a receiving unit 31 of the information providing terminal 3, a photographing unit 33, a position grasping unit 34, a scroll unit 35, a display unit 37, and a transmitting unit 39 of the information providing terminal 3. . The receiving means 31 of the information providing terminal 3 is means for receiving virtual display information from the server 5.
　撮影手段３３は、現実空間を撮影する手段である。位置把握手段３４は、情報提供端末３の位置を把握するための手段である。スクロール手段３５は、情報提供端末３の方向に関する情報を入力するための手段である。表示手段３７は、撮影手段３３により撮影された現実空間を表示するとともに、サーバ５から送信された仮想表示情報に基づく仮想表示を現実空間に重ねて表示することができるものである。情報提供端末３の送信手段３９は、位置把握手段３４が把握した情報提供端末３の位置に関する情報と、スクロール手段３５により入力された情報提供端末３の方向に関する情報とをサーバ５へ送信する手段である。 The photographing means 33 is a means for photographing a real space. The position grasping means 34 is a means for grasping the position of the information providing terminal 3. The scroll unit 35 is a unit for inputting information related to the direction of the information providing terminal 3. The display unit 37 can display the real space photographed by the photographing unit 33 and can superimpose a virtual display based on the virtual display information transmitted from the server 5 on the real space. The transmission means 39 of the information providing terminal 3 is a means for transmitting to the server 5 information relating to the position of the information providing terminal 3 grasped by the position grasping means 34 and information relating to the direction of the information providing terminal 3 input by the scroll means 35. It is.
　サーバ５は、サーバ５の受信手段５１と、データベース５３と、仮想表示情報選択手段５５と、サーバ５の送信手段５７とを含む。 The server 5 includes a receiving unit 51 of the server 5, a database 53, a virtual display information selecting unit 55, and a transmitting unit 57 of the server 5.
　サーバ５の受信手段５１は、情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報を受信する手段である。データベース５３は、対象物に関する情報と関連して当該対象物に対応した仮想表示情報を記憶した記憶部である。仮想表示情報選択手段５５は、情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報から、情報提供端末３により撮影される現実空間に含まれる対象物を把握し、当該把握した対象物に対応した仮想表示情報をデータベースから選択して読み出す手段である。サーバ５の送信手段５７は、仮想表示情報選択手段５５が読み出した対象物に対応した仮想表示情報を情報提供端末３へ送信する手段である。 The receiving means 51 of the server 5 is means for receiving information relating to the position of the information providing terminal 3 and information relating to the direction of the information providing terminal 3. The database 53 is a storage unit that stores virtual display information corresponding to an object in association with information about the object. The virtual display information selection unit 55 grasps the object included in the real space photographed by the information providing terminal 3 from the information related to the position of the information providing terminal 3 and the information related to the direction of the information providing terminal 3, and This is means for selecting and reading out virtual display information corresponding to the object from the database. The transmission means 57 of the server 5 is means for transmitting virtual display information corresponding to the object read by the virtual display information selection means 55 to the information providing terminal 3.
　情報提供システム１は、以下のように動作する。撮影手段３３により情報提供端末３に現実空間に関する情報が入力される。位置把握手段３４により、情報提供端末３の位置に関する情報が把握される。スクロール手段３５により、情報提供端末３に情報提供端末３の方向に関する情報が入力される。情報提供端末３の送信手段３９により、情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報がサーバ５へ送信される。サーバ５の受信手段５１が、情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報とを受信する。仮想表示情報選択手段５５が、情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報から、情報提供端末３により撮影される現実空間に含まれる対象物を把握し、当該把握した対象物に対応した仮想表示をデータベース５３から選択して読み出す。サーバ５の送信手段５７は、仮想表示情報選択手段５５が読み出した対象物に対応した仮想表示情報を情報提供端末３へ送信する。情報提供端末３の表示手段は、撮影手段３３により撮影された現実空間を表示するとともに、サーバ５から送信された仮想表示情報に基づく仮想表示を現実空間に重ねて表示する。 The information providing system 1 operates as follows. Information relating to the real space is input to the information providing terminal 3 by the imaging means 33. Information regarding the position of the information providing terminal 3 is grasped by the position grasping means 34. Information relating to the direction of the information providing terminal 3 is input to the information providing terminal 3 by the scroll means 35. Information relating to the position of the information providing terminal 3 and information relating to the direction of the information providing terminal 3 are transmitted to the server 5 by the transmission means 39 of the information providing terminal 3. The receiving means 51 of the server 5 receives information regarding the position of the information providing terminal 3 and information regarding the direction of the information providing terminal 3. The virtual display information selection means 55 grasps the object included in the real space photographed by the information providing terminal 3 from the information related to the position of the information providing terminal 3 and the information related to the direction of the information providing terminal 3, and A virtual display corresponding to the object is selected from the database 53 and read. The transmission unit 57 of the server 5 transmits virtual display information corresponding to the object read by the virtual display information selection unit 55 to the information providing terminal 3. The display unit of the information providing terminal 3 displays the real space photographed by the photographing unit 33 and displays a virtual display based on the virtual display information transmitted from the server 5 so as to overlap the real space.
　本発明の第２の態様は、基本的には、撮影可能な情報提供端末３と、サーバ５と、情報提供端末３とサーバ５とを仲介する基地局７とを含む情報提供システム１に関する。この発明の情報提供システム１において、情報提供端末３は、撮影した現実空間に、現実空間に含まれる対象物に対応した仮想表示を重ねて表示できる情報提供端末であり、サーバ５は、情報提供端末３の位置を把握し、情報提供端末３へ仮想表示情報を送信するものである。そして、情報提供端末３では、撮影手段３３により情報提供端末３に現実空間に関する情報が入力され、スクロール手段３５により、情報提供端末３に情報提供端末３の方向に関する情報が入力され、情報提供端末３の送信手段３９により、情報提供端末３の方向に関する情報が基地局７へ送信される。基地局７では、基地局７の受信手段７１が、情報提供端末３の方向に関する情報を受け取り、位置把握手段７３が、情報提供端末３の位置を把握し、基地局７の送信手段７５が、サーバ５に対して、情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報を送信する。サーバ５では、受信手段５１が、基地局７から送信された情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報を受信し、仮想表示情報選択手段５５が、情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報から、情報提供端末３により撮影される現実空間に含まれる対象物を把握し、当該把握した対象物に対応した仮想表示情報をデータベース５３から選択して読み出し、サーバ５の送信手段５７は、仮想表示情報選択手段が読み出した対象物に対応した仮想表示情報を情報提供端末３へ送信する。これにより、情報提供端末３の表示手段３９には、撮影手段３３により撮影された現実空間が表示されるとともに、サーバ５から送信された仮想表示情報に基づく仮想表示が現実空間に重ねて表示される。 The second aspect of the present invention basically relates to an information providing system 1 including an information providing terminal 3 that can be photographed, a server 5, and a base station 7 that mediates between the information providing terminal 3 and the server 5. In the information providing system 1 of the present invention, the information providing terminal 3 is an information providing terminal capable of displaying a virtual display corresponding to an object included in the real space on the photographed real space, and the server 5 provides the information providing The position of the terminal 3 is grasped and virtual display information is transmitted to the information providing terminal 3. In the information providing terminal 3, information relating to the real space is input to the information providing terminal 3 by the photographing unit 33, and information relating to the direction of the information providing terminal 3 is input to the information providing terminal 3 by the scroll unit 35. 3, information regarding the direction of the information providing terminal 3 is transmitted to the base station 7. In the base station 7, the receiving means 71 of the base station 7 receives information on the direction of the information providing terminal 3, the position grasping means 73 grasps the position of the information providing terminal 3, and the transmitting means 75 of the base station 7 Information relating to the position of the information providing terminal 3 and information relating to the direction of the information providing terminal 3 are transmitted to the server 5. In the server 5, the receiving means 51 receives the information related to the position of the information providing terminal 3 and the information related to the direction of the information providing terminal 3 transmitted from the base station 7, and the virtual display information selecting means 55 is connected to the information providing terminal 3. From the information relating to the position of the information providing terminal 3 and the information relating to the direction of the information providing terminal 3, the object included in the real space photographed by the information providing terminal 3 is grasped, and the virtual display information corresponding to the grasped object is obtained from the database 53. The transmission means 57 of the server 5 transmits the virtual display information corresponding to the object read by the virtual display information selection means to the information providing terminal 3. As a result, the display unit 39 of the information providing terminal 3 displays the real space photographed by the photographing unit 33 and the virtual display based on the virtual display information transmitted from the server 5 is displayed superimposed on the real space. The
　すなわち、この情報提供システム１によれば、現実空間の視界情報に仮想情報を付加することができる。したがって、ユーザは、現実空間の視界情報（Ｌｉｖｅ　Ｖｉｅｗ）だけでは得られない情報を、出先で、仮想情報から取得することができる。しかも、この仮想情報は、現実社会と結びつけられた状態で表示されるので、ユーザは、一体感やリアリティを持って表示手段３７の表示画面３７ａを見ることができる。このため、ユーザは、表示画面３７ａを違和感なく見ながら、情報を得ることができる。また、情報提供端末３は、スクロール手段３５を有しているので、情報提供端末３にジャイロなどの傾斜センサや方位センサを設ける必要がないため、サーバ５は、情報提供端末３の方向に関する情報を、傾斜センサや方位センサの出力情報から計算して求める必要がなく、容易に把握することができる。 That is, according to this information providing system 1, virtual information can be added to the visual field information in the real space. Therefore, the user can acquire information that cannot be obtained only from the visual space information (Live View) in the real space from the virtual information at the destination. Moreover, since this virtual information is displayed in a state associated with the real society, the user can view the display screen 37a of the display means 37 with a sense of unity and reality. For this reason, the user can obtain information while viewing the display screen 37a without feeling uncomfortable. In addition, since the information providing terminal 3 includes the scroll unit 35, it is not necessary to provide the information providing terminal 3 with an inclination sensor such as a gyroscope or an orientation sensor. It is not necessary to calculate and calculate from the output information of the inclination sensor or the azimuth sensor, and can be easily grasped.
　本発明によれば、リアリティを持って、現実社会と仮想空間を結びつけて表示できるシステムを提供できる。また、容易に情報提供端末３の傾きや方向を把握して、適切に現実社会と仮想空間を結びつけて表示できるシステムを提供することができる。 According to the present invention, it is possible to provide a system capable of displaying the real world and the virtual space in association with reality. In addition, it is possible to provide a system capable of easily grasping the inclination and direction of the information providing terminal 3 and appropriately connecting the real society and the virtual space for display.
図１は、本発明の第１の態様に関する情報提供システムの基本構成を示すブロック図である。FIG. 1 is a block diagram showing a basic configuration of an information providing system relating to the first aspect of the present invention. 図２は、データベースの例である。FIG. 2 is an example of a database. 図３は、撮影手段により撮影された現実空間を表示させたときの表示画面を示す図である。FIG. 3 is a diagram showing a display screen when the real space photographed by the photographing means is displayed. 図４は、図３に示すような現実空間に仮想表示を重ねて表示させたときの表示画面を示す図である。FIG. 4 is a diagram showing a display screen when a virtual display is superimposed and displayed in the real space as shown in FIG. 図５は、本発明の第２の態様に関する情報提供システムの基本構成を示すブロック図である。FIG. 5 is a block diagram showing a basic configuration of an information providing system relating to the second aspect of the present invention.
　以下、図面を用いて本発明を実施するための最良の形態を説明する。しかしながら、以下説明する形態は例であって、当業者にとって自明な範囲で適宜修正することができる。 Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings. However, the modes described below are examples and can be appropriately modified within a range obvious to those skilled in the art.
　図１は、本発明の第１の態様に関する情報提供システムの基本構成を示すブロック図である。図１に示されるように、本発明の情報提供システム１は、情報提供端末３と、サーバ５とを含む。図中、符号７は、基地局やアクセスポイントを示し、情報提供端末３とサーバ５との情報の授受を中継するための任意要素である。 FIG. 1 is a block diagram showing a basic configuration of an information providing system relating to the first aspect of the present invention. As shown in FIG. 1, the information providing system 1 of the present invention includes an information providing terminal 3 and a server 5. In the figure, reference numeral 7 denotes a base station or an access point, which is an optional element for relaying information exchange between the information providing terminal 3 and the server 5.
　情報提供端末３は、情報提供端末３用の受信手段３１と、撮影手段３３と、位置把握手段３４と、スクロール手段３５と、表示手段３７と、情報提供端末３用の送信手段３９とを有している。そして、撮影した現実空間に、この空間に含まれる対象物に対応した仮想表示を重ねて表示できるものである。情報提供端末３の例は、携帯電話などの撮像装置付きの携帯通信機器、ノート型パーソナルコンピュータやＰＤＡ（Ｐｅｒｓｏｎａｌ　ｄｉｇｉｔａｌ　ａｓｓｉｓｔａｎｔ）などの撮像装置付の携帯可能な情報処理装置、通信可能に構成された画像処理装置（デジタルカメラやビデオカメラ）である。情報提供端末３は、携帯端末であっても、設置型の端末であってもよい。これらの機器や装置は、無線通信可能に構成されていることが好ましい。情報提供端末が無線通信用の装置を有するため、ユーザは、これらの機器や装置を携帯して移動することができる。 The information providing terminal 3 includes a receiving unit 31 for the information providing terminal 3, a photographing unit 33, a position grasping unit 34, a scroll unit 35, a display unit 37, and a transmitting unit 39 for the information providing terminal 3. is doing. And the virtual display corresponding to the target object contained in this space can be superimposed and displayed on the image | photographed real space. Examples of the information providing terminal 3 are configured to be communicable, such as a portable communication device with an imaging device such as a mobile phone, a portable information processing device with an imaging device such as a notebook personal computer or PDA (Personal digital assistant), etc. An image processing apparatus (digital camera or video camera). The information providing terminal 3 may be a portable terminal or a stationary terminal. These devices and apparatuses are preferably configured to be capable of wireless communication. Since the information providing terminal has a device for wireless communication, the user can carry these devices and devices around.
　ここで、情報提供端末３の各手段は、図１において点線で示す内蔵コンピュータによって実現される。すなわち、このコンピュータの情報記録媒体には、このコンピュータを、各手段を含む装置として機能させるためのプログラムが格納されている。このコンピュータは、各要素がバスなどを介して接続されており、情報の授受を行うことができるようにされている。そして、たとえば、入力部から各種情報が入力された場合、メインメモリに格納された制御プログラムの指令を受けて制御部が記憶部から適宜情報を読み出して、演算部を用いて演算処理を行い、演算結果を記憶部に適宜記憶し、出力部から出力する。 Here, each means of the information providing terminal 3 is realized by a built-in computer indicated by a dotted line in FIG. That is, the information recording medium of this computer stores a program for causing this computer to function as an apparatus including each means. In this computer, each element is connected via a bus or the like, so that information can be exchanged. And, for example, when various types of information are input from the input unit, the control unit appropriately reads information from the storage unit in response to an instruction of the control program stored in the main memory, performs arithmetic processing using the arithmetic unit, The calculation result is appropriately stored in the storage unit and output from the output unit.
　情報提供端末３の受信手段３１は、サーバ５から仮想表示情報を受信する手段である。この受信手段３１は、たとえば、公知のアンテナ及びＣＯＤＥＣ（符号器及び複号器）により実現できる。 The receiving means 31 of the information providing terminal 3 is means for receiving virtual display information from the server 5. The receiving means 31 can be realized by a known antenna and CODEC (encoder and decoder), for example.
　撮影手段３３は、現実空間を撮影する手段である。一般的に、ユーザは、主な被写体である対象物を含むように情報提供端末３の方向（方位や傾き）を選び、選んだ方向を撮影方向として、撮影手段３３で現実空間を撮影する。すなわち、現実空間は、対象物を含む。この撮影手段３３の例は、携帯電話に搭載された公知のデジタルカメラである。 The photographing means 33 is a means for photographing a real space. In general, the user selects the direction (azimuth or inclination) of the information providing terminal 3 so as to include the object that is the main subject, and the imaging unit 33 images the real space with the selected direction as the imaging direction. That is, the real space includes an object. An example of the photographing means 33 is a known digital camera mounted on a mobile phone.
　位置把握手段３４は、情報提供端末３の位置を把握するための手段である。位置把握手段７３は、たとえば、ＧＰＳ（Ｇｌｏｂａｌ　Ｐｏｓｉｔｉｏｎｉｎｇ　Ｓｙｓｔｅｍ）衛星からの情報に基づいて、情報提供端末３の位置緯度及び経度を特定する。位置把握手段３４は、ワイファイ（Ｗｉ－Ｆｉ）の仕組みによって、情報提供端末３の位置を特定するものであってもよい。 The position grasping means 34 is a means for grasping the position of the information providing terminal 3. The position grasping means 73 specifies the position latitude and longitude of the information providing terminal 3 based on, for example, information from a GPS (Global Positioning System) satellite. The position grasping means 34 may identify the position of the information providing terminal 3 by a WiFi (Wi-Fi) mechanism.
　情報提供端末３がＧＰＳ機能を有する場合、ＧＰＳ衛星から送信されるＧＰＳシグナルを情報提供端末３が受信する。情報提供端末３は、受信したＧＰＳシグナルを解析して、情報提供端末の位置を把握する。この情報提供端末の位置は、たとえば緯度及び経度により表されるものである。情報提供端末３は、解析した情報提供端末の位置に関する情報を、メモリなどに一時的に記憶する。このようにして、情報提供端末は、情報提供端末３の位置を把握する。 When the information providing terminal 3 has a GPS function, the information providing terminal 3 receives a GPS signal transmitted from a GPS satellite. The information providing terminal 3 analyzes the received GPS signal and grasps the position of the information providing terminal. The position of the information providing terminal is represented by, for example, latitude and longitude. The information providing terminal 3 temporarily stores information on the analyzed position of the information providing terminal in a memory or the like. In this way, the information providing terminal grasps the position of the information providing terminal 3.
　情報提供端末３がＷｉ－Ｆｉのような無線ＬＡＮ通信機能を有する場合、Ｗｉ－Ｆｉシグナルなどの情報提供端末の位置に関する情報を情報提供端末３が受信する。情報提供端末３は、Ｗｉ－Ｆｉシグナルを用いて情報提供端末の位置を解析するためのデータベースを有している。そして、情報提供端末３は、受信したＷｉ－Ｆｉシグナルを解析して、情報提供端末の位置を把握する。この情報提供端末の位置は、たとえば緯度及び経度により表されるものである。情報提供端末３は、解析した情報提供端末の位置に関する情報を、メモリなどに一時的に記憶する。このようにして、情報提供端末は、情報提供端末３の位置を把握する。 When the information providing terminal 3 has a wireless LAN communication function such as Wi-Fi, the information providing terminal 3 receives information on the position of the information providing terminal such as a Wi-Fi signal. The information providing terminal 3 has a database for analyzing the position of the information providing terminal using a Wi-Fi signal. Then, the information providing terminal 3 analyzes the received Wi-Fi signal and grasps the position of the information providing terminal. The position of the information providing terminal is represented by, for example, latitude and longitude. The information providing terminal 3 temporarily stores information on the analyzed position of the information providing terminal in a memory or the like. In this way, the information providing terminal grasps the position of the information providing terminal 3.
　情報提供端末３がＷｉ－Ｆｉのような無線ＬＡＮ通信機能を有する場合、次のようにして情報提供端末の位置を把握してもよい。すなわち、Ｗｉ－Ｆｉシグナルなどの情報提供端末の位置に関する情報を情報提供端末３が受信する。情報提供端末３は、Ｗｉ－ＦｉシグナルまたはＷｉ－Ｆｉシグナルを解析した情報を、位置把握のためのサーバに送信する。この位置把握のためのサーバは、Ｗｉ－Ｆｉシグナル又はそれを解析した情報に基づいて、位置情報を取得するためのデータベースを有している。このため、位置把握のためのサーバは、受信した情報に関連した位置情報を解析できる。そして、位置把握のためのサーバは、解析した位置情報を、情報提供端末３は送信する。情報提供端末３は、位置把握のためのサーバから位置情報を受信する。情報提供端末３は、受信した情報提供端末の位置に関する情報を、メモリなどに一時的に記憶する。このようにして、情報提供端末は、情報提供端末３の位置を把握する。 When the information providing terminal 3 has a wireless LAN communication function such as Wi-Fi, the position of the information providing terminal may be grasped as follows. That is, the information providing terminal 3 receives information on the position of the information providing terminal such as a Wi-Fi signal. The information providing terminal 3 transmits the Wi-Fi signal or information obtained by analyzing the Wi-Fi signal to a server for grasping the position. The server for grasping the position has a database for acquiring position information based on the Wi-Fi signal or information obtained by analyzing the Wi-Fi signal. For this reason, the server for grasping | ascertaining a position can analyze the positional information relevant to the received information. Then, the information providing terminal 3 transmits the analyzed position information to the server for grasping the position. The information providing terminal 3 receives position information from a server for grasping the position. The information providing terminal 3 temporarily stores the received information regarding the position of the information providing terminal in a memory or the like. In this way, the information providing terminal grasps the position of the information providing terminal 3.
　スクロール手段３５は、情報提供端末３の方向に関する情報を入力するための手段である。たとえば、スクロール手段３５は、表示手段３７の表示画面３７ａ上に表示されたスクロールバー３５ａと、スクロールバー３５ａを表示するための手段とによって主として構成される。すなわち、本発明のスクロール手段の例は、モニタに表示されるスクロールバーをスクロールさせて情報提供端末自体の方向に関する情報を入力させるものである。なお、スクロール手段３５は、スクロールバー３５ａに代えてスライドバーであってもよい。そして、ユーザは、このスクロールバー３５ａを操作することによって、情報提供端末３の東西南北などの方位と、情報提供端末３の水平面又は地面に対する傾きとを入力することができる。この操作は、たとえば、表示手段であるモニタが圧力感知型のタッチパネルとなっており、圧力の変異を把握して、これにより指示情報を入力できるものであっても良い。方位は、東西南北などを指定することに代えて、ユーザが撮影方向又は対象物と情報提供端末３との相対位置関係を、情報提供端末３の表示手段３７の表示画面３７ａの上辺を「北」として、表示画面３７ａを指でなぞる（フリックやピンチする）ようにして示すことで指定してもよい。又は、方位を指定するために、たとえば、太陽や月の向きを指定してもよい。この場合、スクロールバー３５ａを操作した年月日と、太陽や月の向きとから情報提供端末３の方向を特定することができる。また、方位を指定するために、ユーザ（つまり、情報提供端末３）が移動してきた進路に対する撮影方向を入力してもよい。ここで、情報提供端末３の進路は、位置把握手段が把握した情報提供端末３の位置の経時情報から把握することが可能である。なお、スクロール手段３５で入力される情報は、情報提供端末３の方位や傾きに限られることはなく、情報提供端末３の方向を特定できるものであればいかなるものであってもよい。 The scroll means 35 is a means for inputting information related to the direction of the information providing terminal 3. For example, the scroll unit 35 is mainly configured by a scroll bar 35a displayed on the display screen 37a of the display unit 37 and a unit for displaying the scroll bar 35a. That is, the example of the scroll means of the present invention is such that the scroll bar displayed on the monitor is scrolled to input information relating to the direction of the information providing terminal itself. The scroll means 35 may be a slide bar instead of the scroll bar 35a. Then, the user can input the azimuth of the information providing terminal 3 such as east, west, north and south, and the inclination of the information providing terminal 3 with respect to the horizontal plane or the ground by operating the scroll bar 35a. In this operation, for example, a monitor as a display means may be a pressure-sensitive touch panel, and a change in pressure may be grasped and instruction information may be input thereby. Instead of designating the east, west, north, and south directions, the user can change the shooting direction or the relative positional relationship between the object and the information providing terminal 3, and the upper side of the display screen 37 a of the display means 37 of the information providing terminal 3 "May be designated by tracing the display screen 37a with a finger (flicking or pinching). Or in order to designate an azimuth | direction, you may designate the direction of the sun or the moon, for example. In this case, the direction of the information providing terminal 3 can be specified from the date on which the scroll bar 35a is operated and the direction of the sun or the moon. In addition, in order to specify the azimuth, the shooting direction with respect to the path the user (that is, the information providing terminal 3) has moved may be input. Here, the course of the information providing terminal 3 can be grasped from the time-lapse information of the position of the information providing terminal 3 grasped by the position grasping means. Note that the information input by the scroll unit 35 is not limited to the azimuth and inclination of the information providing terminal 3 and may be any information as long as the direction of the information providing terminal 3 can be specified.
　また、本発明のスクロール手段の別の例として、現実空間が表示されているモニタをなぞることにより、情報提供端末自体の方向を入力するものがあげられる。具体的には、表示手段には、サーバから送信された情報提供端末付近の代表的な対象物についての仮想表示が表示されている。そして、モニタをなぞることによりその表示を移動させ、現実空間のその対象物と一致した場合にモニタから指を離すなどの入力情報を受けて、これにより情報提供端末自体の方向に関する情報を入力するものがあげられる。 As another example of the scroll means of the present invention, there is one that inputs the direction of the information providing terminal itself by tracing a monitor on which a real space is displayed. Specifically, the virtual display about the typical target object near the information provision terminal transmitted from the server is displayed on the display means. Then, by moving the display by tracing the monitor, and receiving input information such as releasing the finger from the monitor when it matches the object in the real space, this inputs information regarding the direction of the information providing terminal itself Things can be raised.
　表示手段３７は、撮影手段３３により撮影された現実空間を表示するとともに、サーバ５から送信された仮想表示情報に基づく仮想表示を現実空間に重ねて表示することができるものである。表示手段の例は、携帯電話のモニタである。情報提供端末は、たとえばフレームバッファを有しており、表示するための情報をいったんフレームバッファに格納し、表示用の情報に変換した後モニタに表示すればよい。表示手段３７は、タッチパネルで構成されていることが好ましい。この場合、タッチパネルが入力手段の一部として機能しうる。 The display unit 37 displays the real space photographed by the photographing unit 33 and can superimpose a virtual display based on the virtual display information transmitted from the server 5 on the real space. An example of the display means is a mobile phone monitor. The information providing terminal has, for example, a frame buffer. The information providing terminal may store information for display in the frame buffer, convert the information into display information, and display the information on the monitor. The display unit 37 is preferably configured with a touch panel. In this case, the touch panel can function as a part of the input means.
　送信手段３９は、位置把握手段３４が把握した情報提供端末３の位置に関する情報と、スクロール手段３５により入力された情報提供端末３の方向に関する情報を送信する手段である。送信手段の具体的な態様として、アンテナ及びＣＯＤＥＣがあげられる。 The transmission unit 39 is a unit that transmits information on the position of the information providing terminal 3 grasped by the position grasping unit 34 and information on the direction of the information providing terminal 3 input by the scroll unit 35. Specific examples of the transmission means include an antenna and a CODEC.
　サーバ５は、サーバ５用の受信手段５１と、データベース５３と、仮想表示情報選択手段５５と、サーバ５用の送信手段５７とを含んでおり、情報提供端末３の位置を把握し、情報提供端末３へ仮想表示情報を送信するものである。ここで、サーバ５の各手段は、図１において点線で示す内蔵コンピュータによって実現される。すなわち、このコンピュータの情報記録媒体には、このコンピュータを、各手段を含む装置として機能させるためのプログラムが格納されている。 The server 5 includes a receiving unit 51 for the server 5, a database 53, a virtual display information selecting unit 55, and a transmitting unit 57 for the server 5, grasping the position of the information providing terminal 3 and providing information The virtual display information is transmitted to the terminal 3. Here, each means of the server 5 is realized by a built-in computer indicated by a dotted line in FIG. That is, the information recording medium of this computer stores a program for causing this computer to function as an apparatus including each means.
　受信手段５１は、情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報を受信する手段である。 The receiving means 51 is means for receiving information relating to the position of the information providing terminal 3 and information relating to the direction of the information providing terminal 3.
　データベース５３は、対象物に関する情報と関連して当該対象物に対応した仮想表示情報を記憶した記憶部である。この対象物に関する情報の例は、対象物の位置に関する情報である。仮想表示情報とは，情報提供端末がこの情報に基づいて仮想表示を行うための情報である。仮想表示の画像データやテキストデータが情報提供端末に記憶されている場合，仮想表示情報はそれらのデータを読み出すための情報と、対象物の位置情報があげられる。一方，情報提供端末がそのような情報を記憶していない場合は，仮想表示情報は，情報提供端末が仮想表示を行うための画像データ又はテキストデータと、対象物の位置情報であってもよい。 The database 53 is a storage unit that stores virtual display information corresponding to a target object in association with information about the target object. An example of information on the object is information on the position of the object. The virtual display information is information for the information providing terminal to perform virtual display based on this information. When virtual display image data and text data are stored in the information providing terminal, the virtual display information includes information for reading out the data and position information of the object. On the other hand, when the information providing terminal does not store such information, the virtual display information may be image data or text data for the information providing terminal to perform virtual display, and position information of the target object. .
　図２は、データベース５３の例である。図２に示すように、対象物と、その位置と、その向きと、その対象物に関するテキスト情報と、静止画や動画などの仮想表示に必要な画像情報とが関連付けられている。この例では、ある建物「○×ビル」について、その建物にある店舗に関する情報が建物の向きによって分けられている。また、図２に示したようなデータベース５３において、さらに、対象物とその角度と当該角度に対応する建物の画像情報とを関連付けてもよく、これにより、より詳細な情報をユーザに精確に提供することができる。さらには、データベース５３において、対象物に関する情報を、ジャンル分けしておくことが好ましい。 FIG. 2 is an example of the database 53. As shown in FIG. 2, an object, its position, its orientation, text information about the object, and image information necessary for virtual display such as a still image and a moving image are associated with each other. In this example, with respect to a certain building “XX building”, information on stores in the building is divided according to the direction of the building. Further, in the database 53 as shown in FIG. 2, the object may be associated with the angle and the image information of the building corresponding to the angle, thereby providing more detailed information to the user accurately. can do. Furthermore, in the database 53, it is preferable to categorize information on the object.
　仮想表示情報選択手段５５は、情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報から、情報提供端末３により撮影される現実空間に含まれる対象物を把握し、当該把握した対象物に対応した仮想表示をデータベース５３から選択して読み出す手段である。具体的には、仮想表示情報選択手段５５は、情報提供端末３の位置及び方向から主被写体である対象物の位置を特定し、データベース５３から、特定した位置にある対象物を選択するとともに、その向きを特定し、さらに、その対象物に関連付けられたテキスト情報及び画像情報を対象物に対応した仮想表示情報として読み出す。また、たとえば、情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報から、情報提供端末３により撮影される現実空間を把握し、その空間に含まれる対象物を選択してもよい。 The virtual display information selection means 55 grasps the object included in the real space photographed by the information providing terminal 3 from the information related to the position of the information providing terminal 3 and the information related to the direction of the information providing terminal 3, and This is means for selecting and reading out a virtual display corresponding to the object from the database 53. Specifically, the virtual display information selection unit 55 specifies the position of the target object that is the main subject from the position and direction of the information providing terminal 3, selects the target object at the specified position from the database 53, and The direction is specified, and text information and image information associated with the object are read as virtual display information corresponding to the object. Further, for example, it is possible to grasp the real space photographed by the information providing terminal 3 from the information related to the position of the information providing terminal 3 and the information related to the direction of the information providing terminal 3 and select an object included in the space. Good.
　サーバ５は、撮影空間に含まれる対象物の数をカウントしてもよい。そして、サーバ５は、あらかじめ情報提供端末へ仮想表示情報が送信される対象物の閾値を記憶しておいてもよい。そして、情報提供端末へ仮想表示情報が送信される対象物が閾値より小さい場合は、すべての対象物について仮想表示情報を送信する。一方、情報提供端末へ仮想表示情報が送信される対象物が閾値より大きい場合は、情報提供端末から近い対象物に関する仮想表示情報を優先的に情報提供端末へ送信する。また、サーバは、対象物に関連して重要度を記憶しており、重要度の高い対象物についての仮想表示情報を情報提供端末に表示してもよい。 The server 5 may count the number of objects included in the shooting space. And the server 5 may memorize | store the threshold value of the target object in which virtual display information is transmitted to an information provision terminal beforehand. And when the target object whose virtual display information is transmitted to the information providing terminal is smaller than the threshold value, the virtual display information is transmitted for all the target objects. On the other hand, when the object whose virtual display information is transmitted to the information providing terminal is larger than the threshold value, the virtual display information related to the object close to the information providing terminal is preferentially transmitted to the information providing terminal. Further, the server may store the importance in relation to the object, and may display virtual display information about the object having a high importance on the information providing terminal.
　なお、特定した対象物の位置とデータベース５３に記憶されている対象物の位置は、完全に一致する必要はなく、許容範囲内で一致していればよい。また、データベース５３において、対象物に関する情報を、ジャンル分けしてある場合、仮想表示情報選択手段５５は、ユーザのプロフィールやユーザが求める情報などに対応したジャンルの対象物に関する情報を選択するように構成される。なお、この場合、ユーザのプロフィール年齢、性別、及び職業などやユーザが求める情報は、サーバ５に予め登録されている。 It should be noted that the position of the identified object and the position of the object stored in the database 53 do not have to be completely matched, and may be matched within an allowable range. Further, in the database 53, when the information on the object is classified into genres, the virtual display information selection unit 55 selects the information on the object of the genre corresponding to the user profile, information requested by the user, and the like. Composed. In this case, the user's profile age, sex, occupation, and the information required by the user are registered in the server 5 in advance.
　仮想表示情報選択手段５５の別の例は、情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報から、情報提供端末３により撮影される現実空間に含まれる領域を求めるものである。そして、この領域に含まれる緯度及び経度を有する対象物を決定する。そして、決定した対象物に対応した仮想表示をデータベース５３から選択して読み出す。 Another example of the virtual display information selection unit 55 is to obtain an area included in the real space photographed by the information providing terminal 3 from information relating to the position of the information providing terminal 3 and information relating to the direction of the information providing terminal 3. is there. And the target object which has the latitude and longitude contained in this area | region is determined. Then, the virtual display corresponding to the determined object is selected from the database 53 and read.
　送信手段５７は、仮想表示情報選択手段５５が読み出した対象物に対応した仮想表示を、情報提供端末３へ送信する手段である。 The transmission unit 57 is a unit that transmits a virtual display corresponding to the object read by the virtual display information selection unit 55 to the information providing terminal 3.
　上述したような構成の情報提供システム１において、視界情報に仮想情報を付加して表示する方法について説明する。 In the information providing system 1 having the above-described configuration, a method for displaying virtual information added to visual field information will be described.
　まず、ユーザは、情報提供端末３を所望の対象物に向け、撮影手段３３によって、対象物を含む現実空間を撮影する。このようにして、情報提供端末３に現実空間に関する情報を入力し、これにより、図３に示すように、表示手段３７に、撮影手段３３により撮影された現実空間を表示させる。図３に示す例では、「○×ビル」が対象物となっている。 First, the user points the information providing terminal 3 toward a desired object, and images the real space including the object by the imaging means 33. In this way, information relating to the real space is input to the information providing terminal 3, thereby causing the display means 37 to display the real space photographed by the photographing means 33 as shown in FIG. 3. In the example shown in FIG. 3, “XX building” is the object.
　位置把握手段は、情報提供端末３の位置を把握する。続いて、ユーザは、表示された現実空間を視認しながら、スクロール手段３５を用いて、情報提供端末３に、情報提供端末３の方向に関する情報を入力する。図３に示す例では、スクロールバー３５ａを用いて、「西寄り」向きである旨と、情報提供端末３の傾きを示すチルト角が約－２０°である旨が入力される。これらの情報が入力されると、情報提供端末３の送信手段３９は、情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報をサーバ５へ送信する。 The position grasping means grasps the position of the information providing terminal 3. Subsequently, the user inputs information regarding the direction of the information providing terminal 3 to the information providing terminal 3 using the scroll unit 35 while visually recognizing the displayed real space. In the example shown in FIG. 3, the scroll bar 35a is used to input that the direction is “westward” and that the tilt angle indicating the tilt of the information providing terminal 3 is about −20 °. When these pieces of information are input, the transmission means 39 of the information provision terminal 3 transmits information regarding the position of the information provision terminal 3 and information regarding the direction of the information provision terminal 3 to the server 5.
　そして、サーバ５では、受信手段７１が、情報提供端末３から送信された情報提供端末３の位置情報および情報提供端末３の方向に関する情報を受け取る。 In the server 5, the receiving unit 71 receives the position information of the information providing terminal 3 and the information on the direction of the information providing terminal 3 transmitted from the information providing terminal 3.
　これにより、サーバ５において、受信手段５１は、情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報を受信することになる。 Thereby, in the server 5, the receiving unit 51 receives information on the position of the information providing terminal 3 and information on the direction of the information providing terminal 3.
　そして、サーバ５では、仮想表示情報選択手段５５が、情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報から、情報提供端末３により撮影される現実空間に含まれる対象物を把握し、当該把握した対象物に対応した仮想表示をデータベース５３から選択して読み出す。すなわち、サーバ５は、情報提供端末３により撮影される現実空間を把握しているともいえる。この場合、情報提供端末３には、仮想表示情報が送信されており、この仮想表示情報には対象物の位置に関する情報が含まれている。このため、情報提供端末３は、この対象物の位置に関する情報を用いて、表示手段に表示されている対象物の位置を推測し、推測した対象物の位置又はその近傍に仮想表示を描画する。 In the server 5, the virtual display information selection unit 55 selects the object included in the real space photographed by the information providing terminal 3 from the information related to the position of the information providing terminal 3 and the information related to the direction of the information providing terminal 3. A virtual display corresponding to the grasped object is selected from the database 53 and read out. That is, it can be said that the server 5 grasps the real space photographed by the information providing terminal 3. In this case, virtual display information is transmitted to the information providing terminal 3, and the virtual display information includes information regarding the position of the object. For this reason, the information providing terminal 3 estimates the position of the object displayed on the display unit using the information on the position of the object, and draws a virtual display at or near the estimated position of the object. .
　また、仮想表示を選択する際、好ましくは、ユーザのプロフィール年齢、性別、及び職業などや、ユーザが求める情報、さらには時刻などに基づいて、対象物に対応した仮想表示の内容は取捨選択される。たとえば、ユーザが「女性」であり、そのユーザが「食事」に関する情報（ジャンル）に興味がある場合、「文具店」に関する情報や「銀行」に関する情報は、データベース５３から抽出されたとしても削除される。 Further, when selecting the virtual display, preferably, the contents of the virtual display corresponding to the object are selected based on the user's profile age, sex, occupation, etc., information requested by the user, and the time. The For example, when the user is “female” and the user is interested in information (genre) related to “meal”, the information related to “stationery store” and the information related to “bank” are deleted even if extracted from the database 53. Is done.
　そして、当該仮想表示情報選択手段５５が読み出した対象物に対応した仮想表示情報は、送信手段５７によって、情報提供端末３へ送信される。これにより、情報提供端末３では、撮影手段３３により撮影されて表示されている現実空間（Ｒｅａｌ　Ｗｏｒｌｄ）に重なるようにして、表示手段３７によって、サーバ５から送信された仮想表示（Ｖｉｒｔｕａｌ　Ｗｏｒｌｄ）が表示されることになる。このときの表示画面３７ａの例を図４に示す。図４に示す例では、対象物である「○×ビル」の「西」向きの壁面近傍に、「×○ラーメン店」に関するテキスト情報及び画像情報が仮想表示（オブジェクト）として表示される。図４に示すように、仮想表示は、ユーザに分かりやすく表示される。特に、仮想表示情報に応じたジャンルなどに合わせて、仮想表示の形、色、動きなどを変えて表示することで、仮想表示をユーザに分かりやすくすることができる。 The virtual display information corresponding to the object read by the virtual display information selection unit 55 is transmitted to the information providing terminal 3 by the transmission unit 57. Thereby, in the information providing terminal 3, the virtual display (Virtual World) transmitted from the server 5 by the display means 37 is overlapped with the real space (Real World) photographed and displayed by the photographing means 33. Will be displayed. An example of the display screen 37a at this time is shown in FIG. In the example shown in FIG. 4, text information and image information related to “XX Ramen Store” are displayed as a virtual display (object) in the vicinity of the wall facing “West” of “XX Building” that is the object. As shown in FIG. 4, the virtual display is displayed in an easy-to-understand manner for the user. In particular, the virtual display can be easily understood by the user by changing the shape, color, movement, etc. of the virtual display according to the genre corresponding to the virtual display information.
　ここで、仮想表示に関する情報の情報量が多い場合には、リンク先のみを表示したり、リスト表示に切替えたり、別画面を作成したりすることで、狭い表示画面３７ａを効率的に用いることが好ましい。リンク先のみを表示する場合、情報提供端末３（特に、ｉＰｈｏｎｅ（登録商標）である場合）の本体を横位置（表示画面３７ａが横長となる向き）から縦位置（表示画面３７ａが縦長となる向き）に変更することで、リンク先の画面に遷移させるように構成することが好ましい。なお、仮想表示に関する情報を表示せずに、音声などで出力してもよい。 Here, when there is a large amount of information related to the virtual display, the narrow display screen 37a can be efficiently used by displaying only the link destination, switching to the list display, or creating another screen. Is preferred. When only the link destination is displayed, the main body of the information providing terminal 3 (especially in the case of iPhone (registered trademark)) is moved from the horizontal position (the display screen 37a is in a landscape orientation) to the vertical position (the display screen 37a is in a portrait orientation) It is preferable that the screen is changed to a link destination screen by changing to (direction). In addition, you may output with an audio | voice etc., without displaying the information regarding a virtual display.
　このようにすることで、現実空間の視界情報に仮想情報を付加することができる。したがって、上述した態様によれば、ユーザは、現実空間の視界情報（Ｌｉｖｅ　Ｖｉｅｗ）だけでは得られない情報を、出先で、仮想情報から取得することができる。しかも、この仮想情報は、現実社会と結びつけられた状態で表示されるので、ユーザは、一体感やリアリティを持って表示画面３７ａを見ることができる。このため、ユーザは、表示画面３７ａを違和感なく見ながら、情報を得ることができる。 In this way, virtual information can be added to the visual field information in the real space. Therefore, according to the aspect mentioned above, the user can acquire the information which cannot be obtained only by the visual field information (Live View) of the real space from the virtual information on the go. Moreover, since the virtual information is displayed in a state associated with the real society, the user can view the display screen 37a with a sense of unity and reality. For this reason, the user can obtain information while viewing the display screen 37a without feeling uncomfortable.
　また、ユーザは、スクロール手段３５を操作して情報提供端末３の方向に関する情報を指定するだけで、サーバ５が視界情報に付加すべき仮想情報を選択するので、非常に簡便に仮想情報を取得することができる。すなわち、ユーザは、仮想情報を取得するために、時刻やキーワードなどを入力する必要がなく、手間がかからない。 In addition, the user selects the virtual information to be added to the view information simply by operating the scroll means 35 and specifying the information regarding the direction of the information providing terminal 3, so that the virtual information can be obtained very easily. can do. That is, the user does not need to input time, a keyword, or the like in order to acquire virtual information, and it does not take time.
　さらに、情報提供端末３は、スクロール手段３５を有しているので、情報提供端末３にジャイロなどの傾斜センサや方位センサを設ける必要がなく、情報提供端末３の小型化を図ることができる。さらには、情報提供端末３に傾斜センサや方位センサを設ける必要がないので、サーバ５は、情報提供端末３の方向に関する情報を、傾斜センサや方位センサの出力情報から計算して求める必要がなく、容易にかつ正確に把握することができる。 Furthermore, since the information providing terminal 3 has the scroll means 35, it is not necessary to provide the information providing terminal 3 with an inclination sensor such as a gyroscope or an orientation sensor, and the information providing terminal 3 can be downsized. Furthermore, since it is not necessary to provide the information providing terminal 3 with an inclination sensor or an orientation sensor, the server 5 does not have to calculate information regarding the direction of the information providing terminal 3 from the output information of the inclination sensor or the orientation sensor. Can be grasped easily and accurately.
　また、サーバ５が情報提供端末３へ送信する仮想情報は、情報提供端末３の撮影手段３３で撮影可能な範囲つまり、ユーザが視認可能な範囲にある対象物に関するものに限られているため、情報量を少なくすることができる。さらには、仮想情報を現時点撮影した時点に対応する情報に限ることで、情報量をさらに少なくすることができる。すなわち、サーバ５は、ユーザに提供すべき仮想情報に含まれるノイズの比率（Ｓ／Ｎ比）を低くすることができる。これにより、ユーザは、無駄な情報を取得せずに済み、適確な情報を取得することができ、その結果、直感的に行動することが可能となる。また、ネットワークにかかる負荷を低減させることができる。 Further, since the virtual information transmitted from the server 5 to the information providing terminal 3 is limited to a range that can be photographed by the photographing unit 33 of the information providing terminal 3, that is, a target related to an object that is visible to the user. The amount of information can be reduced. Furthermore, the amount of information can be further reduced by limiting the virtual information to information corresponding to the time when the current image was taken. That is, the server 5 can reduce the noise ratio (S / N ratio) included in the virtual information to be provided to the user. Thereby, the user does not need to acquire useless information and can acquire appropriate information, and as a result, it becomes possible to act intuitively. In addition, the load on the network can be reduced.
　また、データベース５３では、対象物に関する情報は、対象物の向きによっても区分けされているので、ユーザは、建物などの対象物を撮影したときの方向によっても、得られる情報が異なるようになっている。これにより、より適確な情報をユーザに提供することができる。 Further, in the database 53, the information on the object is classified according to the direction of the object, so that the user can obtain different information depending on the direction when the object such as a building is photographed. Yes. Thereby, more appropriate information can be provided to the user.
　次に、本発明の第２の実施態様に関する情報提供システムについて説明する。このシステムは、基地局が位置把握手段７３を有するものである。すなわち、基地局が位置把握手段を有する以外は、本発明の第１の実施態様に関する情報提供システムと同様である。このため、本発明の第２の実施態様に関する情報提供システムは、本発明の第１の実施態様に関する情報提供システムにおいて説明した各種要素を適宜採用できる。 Next, an information providing system related to the second embodiment of the present invention will be described. In this system, the base station has a position grasping means 73. That is, it is the same as that of the information provision system regarding the 1st embodiment of this invention except a base station having a position grasping means. For this reason, the information provision system concerning the 2nd embodiment of the present invention can adopt suitably various elements explained in the information provision system concerning the 1st embodiment of the present invention.
　上述したような構成の情報提供システム１において、視界情報に仮想情報を付加して表示する方法について説明する。 In the information providing system 1 having the above-described configuration, a method for displaying virtual information added to visual field information will be described.
　まず、ユーザは、情報提供端末３を所望の対象物に向け、撮影手段３３によって、対象物を含む現実空間を撮影することで、情報提供端末３に現実空間に関する情報を入力する。 First, the user inputs information relating to the real space to the information providing terminal 3 by directing the information providing terminal 3 toward a desired target and photographing the real space including the target with the photographing unit 33.
　続いて、ユーザは、表示された現実空間を視認しながら、スクロール手段３５を用いて、情報提供端末３に、情報提供端末３の方向に関する情報を入力する。情報提供端末３の送信手段３９は、情報提供端末３の方向に関する情報を基地局７へ送信する。 Subsequently, the user inputs information regarding the direction of the information providing terminal 3 to the information providing terminal 3 using the scroll unit 35 while visually recognizing the displayed real space. The transmission means 39 of the information providing terminal 3 transmits information regarding the direction of the information providing terminal 3 to the base station 7.
　そして、基地局７では、受信手段７１が、情報提供端末３から送信された情報提供端末３の方向に関する情報を情報提供端末３から受け取る。また、このとき、基地局７は、位置把握手段７３によって、情報提供端末３の位置を把握する。たとえば、基地局７は、情報提供端末３から送信されたＷｉ－Ｆｉシグナルを受信する。そして、基地局はＷｉ－Ｆｉシグナルに基づいて情報提供端末３を把握するためのデータベースを有している。このため、基地局７は、情報提供端末３の位置を把握できる。そして、基地局７の送信手段７５は、サーバ５に対して、情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報とを送信する。 Then, in the base station 7, the receiving means 71 receives the information regarding the direction of the information providing terminal 3 transmitted from the information providing terminal 3 from the information providing terminal 3. At this time, the base station 7 grasps the position of the information providing terminal 3 by the position grasping means 73. For example, the base station 7 receives a Wi-Fi signal transmitted from the information providing terminal 3. The base station has a database for grasping the information providing terminal 3 based on the Wi-Fi signal. For this reason, the base station 7 can grasp the position of the information providing terminal 3. Then, the transmission means 75 of the base station 7 transmits information regarding the position of the information providing terminal 3 and information regarding the direction of the information providing terminal 3 to the server 5.
　これにより、サーバ５において、受信手段５１は、基地局７から送信された情報提供端末３の位置に関する情報と、情報提供端末３の方向に関する情報を受信することになる。以降の情報処理は、第１の実施態様に関する情報提供システムと同様である。 Thereby, in the server 5, the receiving means 51 receives the information related to the position of the information providing terminal 3 and the information related to the direction of the information providing terminal 3 transmitted from the base station 7. The subsequent information processing is the same as that of the information provision system regarding the first embodiment.
　次に、本発明の情報提供システムの動作例について説明する。ユーザがカメラを用いて、ある空間を撮影する。すると、撮影した空間の像が、システム内に入力され、記憶部に一時的に記憶される。 Next, an operation example of the information providing system of the present invention will be described. A user photographs a certain space using a camera. Then, an image of the photographed space is input into the system and temporarily stored in the storage unit.
　カメラを用いて撮影が行われると、ＧＰＳ機能を用いて、端末が端末の位置に関する情報を取得する。得られた端末の位置に関する情報は、端末内の記憶部に記憶される。また、この端末は、スクロール手段３５を有しているので、スクロール手段によりカメラのレンズの方向が適宜端末に入力され、カメラのレンズの方向（端末の方向）が記憶部に記憶される。なお、ある動作の前の端末の方向が既に記憶部に記憶されているので、スクロール手段からの入力があった場合、記憶されている端末の方向を読み出して、スクロール手段により入力された変位分を足し合わせて、新たな端末の方向情報としてもよい。次に、端末３の位置に関する情報と、端末３の方向に関する情報がサーバ５へ送信される。 When shooting is performed using a camera, the terminal acquires information on the position of the terminal using the GPS function. Information about the obtained position of the terminal is stored in a storage unit in the terminal. Further, since the terminal includes the scroll unit 35, the direction of the lens of the camera is appropriately input to the terminal by the scroll unit, and the direction of the lens of the camera (the direction of the terminal) is stored in the storage unit. Since the direction of the terminal before a certain operation is already stored in the storage unit, when there is an input from the scroll means, the stored terminal direction is read and the amount of displacement input by the scroll means is read. May be added to obtain new terminal direction information. Next, information regarding the position of the terminal 3 and information regarding the direction of the terminal 3 are transmitted to the server 5.
　サーバ５は、端末３の位置に関する情報と、端末３の方向に関する情報とを受信する。これらの情報を受け取ったサーバは、端末３の位置に関する情報と端末３の方向に関する情報とを用いて、カメラで撮影され、端末３に表示されると考えられる空間（表示空間）を求める。次に、サーバは、表示空間に含まれる位置（すなわち、一定の領域）を用いて、データベースから、端末で表示される対象物の候補をあげる。この場合、データベース５３には、対象物についての位置として緯度及び経度が記憶されている。よって、サーバ５は、この緯度及び経度が、表示空間に含まれるか否か判断する。そして、緯度及び経度が、表示空間に含まれると判断した場合、撮影される現実空間に含まれる対象物であると判断する。 The server 5 receives information on the position of the terminal 3 and information on the direction of the terminal 3. The server that has received the information uses the information on the position of the terminal 3 and the information on the direction of the terminal 3 to obtain a space (display space) that is considered to be captured by the camera and displayed on the terminal 3. Next, the server uses the position (that is, a certain area) included in the display space to raise candidates for objects to be displayed on the terminal from the database. In this case, the database 53 stores latitude and longitude as the position of the object. Therefore, the server 5 determines whether or not the latitude and longitude are included in the display space. When it is determined that the latitude and longitude are included in the display space, it is determined that the object is included in the captured real space.
　データベース５３には、対象物についての位置と関連づけられて、仮想表示情報（テキスト情報、画像、写真、動画、又は音声）が記憶されている。サーバ５は、撮影される現実空間に含まれる対象物についての、仮想表示情報を読み出す。サーバ５は、読み出した仮想表示情報とその対象物についての位置情報とを、端末３に送信する。 The database 53 stores virtual display information (text information, images, photos, videos, or sounds) associated with the position of the object. The server 5 reads virtual display information about the object included in the real space to be photographed. The server 5 transmits the read virtual display information and the position information about the target object to the terminal 3.
　端末３は、対象物についての位置情報を用いて、モニタの表示位置を求める。端末は、端末３の位置に関する情報と端末３の方向に関する情報とを有しているため、モニタのどの位置がどの緯度及び経度を示すかを求めることができる。このため端末は、対象物についての位置情報が、モニタのどの位置に表示される対象であるかを求めることができる。仮想表示を行うモニタ上の位置を把握した端末は、仮想表示情報を用いて、その位置に仮想表示を行う。このようにして、端末が撮影した画像に、仮想表示を重畳して表示することができる。 The terminal 3 obtains the display position of the monitor using the position information about the object. Since the terminal has information regarding the position of the terminal 3 and information regarding the direction of the terminal 3, it is possible to determine which position on the monitor indicates which latitude and longitude. Therefore, the terminal can determine at which position on the monitor the position information about the object is displayed. The terminal that has grasped the position on the monitor that performs virtual display performs virtual display at the position using the virtual display information. In this way, the virtual display can be superimposed and displayed on the image captured by the terminal.
　本発明の情報提供システムは、通信機器産業などの分野で利用されうる。 The information providing system of the present invention can be used in fields such as the communication equipment industry.
　１　情報提供システム；　３　情報提供端末；　５　サーバ；　７　基地局；　
３１　受信手段；　３３　撮影手段；　３４　位置把握手段；　３５　スクロール手段；　３７　表示手段；　３７ａ　表示画面；　３９　送信手段；　
５１　受信手段；　５３　データベース；　５５　仮想表示情報選択手段；　
５７　送信手段；
７１　受信手段；　７３　位置把握手段；　７５　送信手段　 DESCRIPTION OF SYMBOLS 1 Information provision system; 3 Information provision terminal; 5 Server; 7 Base station;
31 receiving means; 33 photographing means; 34 position grasping means; 35 scroll means; 37 display means; 37a display screen; 39 transmitting means;
51 receiving means; 53 database; 55 virtual display information selecting means;
57 transmission means;
71 receiving means; 73 position grasping means; 75 transmitting means

Claims (4)

  1. 　撮影した現実空間に、前記現実空間に含まれる対象物に対応した仮想表示を重ねて表示できる情報提供端末（３）と、
    　前記情報提供端末（３）の位置を把握し、前記情報提供端末（３）へ前記仮想表示情報を送信するサーバ（５）と、
    　を含む、情報提供システム（１）であって、
     
    　前記情報提供端末（３）は、
    　　情報提供端末（３）の受信手段（３１）と、撮影手段（３３）と、位置把握手段（３４）と、スクロール手段（３５）と、表示手段（３７）と、情報提供端末（３）の送信手段（３９）とを有し、
    　　前記情報提供端末（３）の受信手段（３１）は、
    　　　前記サーバ（５）から仮想表示情報を受信する手段であり、
    　　前記撮影手段（３３）は、
    　　　現実空間を撮影する手段であり、
    　　前記位置把握手段（３４）は、
    　　　前記情報提供端末（３）の位置を把握するための手段であり、
    　　前記スクロール手段（３５）は、
    　　　前記情報提供端末（３）自体の方向に関する情報を入力するための手段であり、
    　　前記表示手段（３７）は、
    　　　前記撮影手段（３３）により撮影された現実空間を表示するとともに、前記サーバ（５）から送信された前記仮想表示情報を前記現実空間に重ねて表示することができるものであり、
    　　前記情報提供端末（３）の送信手段（３９）は、
    　　　前記位置把握手段（３４）が把握した前記情報提供端末（３）の位置に関する情報と、前記スクロール手段（３５）により入力された情報提供端末（３）自体の方向に関する情報とを前記サーバ（５）へ送信する手段であり、
     
    　前記サーバ（５）は、
    　　サーバ（５）の受信手段（５１）と、データベース（５３）と、仮想表示情報選択手段（５５）と、サーバ（５）の送信手段（５７）とを含み、
    　　前記サーバ（５）の受信手段（５１）は、前記情報提供端末（３）の位置に関する情報と、前記情報提供端末（３）自体の方向に関する情報を受信する手段であり、
    　　前記データベース（５３）は、前記対象物に関する情報と関連して当該対象物に対応した仮想表示を記憶した記憶部であり、
    　　前記仮想表示情報選択手段（５５）は、前記情報提供端末（３）の位置に関する情報と、前記情報提供端末（３）自体の方向に関する情報から、前記情報提供端末（３）により撮影される現実空間に含まれる対象物を把握し、当該把握した対象物に対応した仮想表示を前記データベースから選択して読み出す手段であり、
    　　前記サーバ（５）の送信手段（５７）は、前記仮想表示情報選択手段（５５）が読み出した対象物に対応した仮想表示を前記情報提供端末（３）へ送信する手段であり、
     
    　これにより、前記撮影手段（３３）により前記情報提供端末（３）に現実空間に関する情報が入力され、
    　前記位置把握手段（３４）により、前記情報提供端末（３）の位置に関する情報が把握され、
    　前記スクロール手段（３５）により、前記情報提供端末（３）に前記情報提供端末（３）自体の方向に関する情報が入力され、
    　前記情報提供端末（３）の送信手段（３９）により、前記情報提供端末（３）の位置に関する情報と、前記情報提供端末（３）自体の方向に関する情報が前記サーバ（５）へ送信され、
    　前記サーバ（５）の受信手段（５１）が、前記情報提供端末（３）の位置に関する情報と、前記情報提供端末（３）自体の方向に関する情報とを受信し、
    　前記仮想表示情報選択手段（５５）が、前記情報提供端末（３）の位置に関する情報と、前記情報提供端末（３）自体の方向に関する情報から、前記情報提供端末（３）により撮影される現実空間に含まれる対象物を把握し、当該把握した対象物に対応した仮想表示を前記データベース（５３）から選択して読み出し、
    　前記サーバ（５）の送信手段（５７）は、前記仮想表示情報選択手段（５５）が読み出した対象物に対応した仮想表示を前記情報提供端末（３）へ送信し、
    　前記情報提供端末（３）の表示手段は、前記撮影手段（３３）により撮影された現実空間を表示するとともに、前記サーバ（５）から送信された前記仮想表示情報を前記現実空間に重ねて表示する、
     
    　情報提供システム（１）。
          An information providing terminal (3) capable of displaying a virtual display corresponding to an object included in the real space in an overlapping manner on the photographed real space;
    A server (5) for grasping the position of the information providing terminal (3) and transmitting the virtual display information to the information providing terminal (3);
    An information providing system (1) including:

    The information providing terminal (3)
    The receiving means (31), the photographing means (33), the position grasping means (34), the scroll means (35), the display means (37), and the information providing terminal (3) of the information providing terminal (3). Transmission means (39),
    The receiving means (31) of the information providing terminal (3)
    Means for receiving virtual display information from the server (5);
    The photographing means (33)
    It is a means of photographing the real space,
    The position grasping means (34)
    Means for grasping the position of the information providing terminal (3);
    The scroll means (35)
    Means for inputting information relating to the direction of the information providing terminal (3) itself;
    The display means (37)
    While displaying the real space image | photographed by the said imaging | photography means (33), the said virtual display information transmitted from the said server (5) can be superimposed and displayed on the said real space,
    The transmission means (39) of the information providing terminal (3)
    Information on the position of the information providing terminal (3) grasped by the position grasping means (34) and information on the direction of the information providing terminal (3) itself inputted by the scroll means (35) are stored in the server (5). )

    The server (5)
    Including a receiving means (51) of the server (5), a database (53), a virtual display information selecting means (55), and a transmitting means (57) of the server (5),
    The receiving means (51) of the server (5) is means for receiving information relating to the position of the information providing terminal (3) and information relating to the direction of the information providing terminal (3) itself,
    The database (53) is a storage unit that stores a virtual display corresponding to the object in association with information on the object;
    The virtual display information selection means (55) is photographed by the information providing terminal (3) from information on the position of the information providing terminal (3) and information on the direction of the information providing terminal (3) itself. It is means for grasping an object included in the space, selecting and reading out a virtual display corresponding to the grasped object from the database,
    The transmission means (57) of the server (5) is means for transmitting a virtual display corresponding to the object read by the virtual display information selection means (55) to the information providing terminal (3),

    Thereby, the information relating to the real space is input to the information providing terminal (3) by the photographing means (33),
    Information regarding the position of the information providing terminal (3) is grasped by the position grasping means (34),
    Information about the direction of the information providing terminal (3) itself is input to the information providing terminal (3) by the scroll means (35),
    Information on the position of the information providing terminal (3) and information on the direction of the information providing terminal (3) itself are transmitted to the server (5) by the transmission means (39) of the information providing terminal (3),
    The receiving means (51) of the server (5) receives information on the position of the information providing terminal (3) and information on the direction of the information providing terminal (3) itself,
    The virtual display information selection means (55) is photographed by the information providing terminal (3) from information relating to the position of the information providing terminal (3) and information relating to the direction of the information providing terminal (3) itself. Grasping an object included in the space, selecting and reading out a virtual display corresponding to the grasped object from the database (53),
    The transmission means (57) of the server (5) transmits a virtual display corresponding to the object read by the virtual display information selection means (55) to the information providing terminal (3),
    The display means of the information providing terminal (3) displays the real space photographed by the photographing means (33) and displays the virtual display information transmitted from the server (5) superimposed on the real space. To

    Information providing system (1).
  2. 　前記対象物に関する情報は、前記対象物の位置に関する情報である、請求項１に記載の情報提供システム（１）。
          The information providing system (1) according to claim 1, wherein the information related to the object is information related to a position of the object.
  3. 　前記対象物に対応した仮想表示は、前記対象物に関連して記憶されるテキストを含む、請求項１に記載の情報提供システム（１）。
          The information providing system (1) according to claim 1, wherein the virtual display corresponding to the object includes text stored in association with the object.
  4. 　撮影した現実空間に、前記現実空間に含まれる対象物に対応した仮想表示を重ねて表示できる情報提供端末（３）と、
    　前記情報提供端末（３）の位置を把握し、前記情報提供端末（３）へ前記仮想表示情報を送信するサーバ（５）と、
    　前記情報提供端末（３）と前記サーバ（５）とを仲介する基地局（７）と、
    　を含む、情報提供システム（１）であって、
     
    　前記情報提供端末（３）は、
    　　情報提供端末（３）の受信手段（３１）と、撮影手段（３３）と、スクロール手段（３５）と、表示手段（３７）と、情報提供端末（３）の送信手段（３９）とを有し、
    　　前記情報提供端末（３）の受信手段（３１）は、
    　　　前記サーバ（５）から仮想表示情報を受信する手段であり、
    　　前記撮影手段（３３）は、
    　　　現実空間を撮影する手段であり、
    　　前記スクロール手段（３５）は、
    　　　前記情報提供端末（３）自体の方向に関する情報を入力するための手段であり、
    　　前記表示手段（３７）は、
    　　　前記撮影手段（３３）により撮影された現実空間を表示するとともに、前記サーバ（５）から送信された前記仮想表示情報を前記現実空間に重ねて表示することができるものであり、
    　　前記情報提供端末（３）の送信手段（３９）は、
    　　　前記スクロール手段（３５）により入力された情報提供端末（３）自体の方向に関する情報を前記基地局（７）へ送信する手段であり、
     
    　前記基地局（７）は、
    　　基地局（７）の受信手段（７１）と、位置把握手段（７３）と、基地局（７）の送信手段（７５）とを有し、
    　　前記基地局（７）の受信手段（７１）は、
    　　　前記情報提供端末（３）自体の方向に関する情報を受け取る手段であり、
    　　前記位置把握手段（７３）は、
    　　　前記情報提供端末（３）の位置を把握する手段であり、
    　　前記基地局（７）の送信手段（７５）は、
    　　　前記サーバ（５）に対して、前記情報提供端末（３）の位置に関する情報と、前記情報提供端末（３）自体の方向に関する情報を送信する手段であり、
     
    　前記サーバ（５）は、
    　　サーバ（５）の受信手段（５１）と、データベース（５３）と、仮想表示情報選択手段（５５）と、サーバ（５）の送信手段（５７）とを含み、
    　　前記サーバ（５）の受信手段（５１）は、前記基地局（７）から送信された前記情報提供端末（３）の位置に関する情報と、前記情報提供端末（３）自体の方向に関する情報を受信する手段であり、
    　　前記データベース（５３）は、対象物に関する情報と関連して当該対象物に対応した仮想表示を記憶した記憶部であり、
    　　前記仮想表示情報選択手段（５５）は、前記情報提供端末（３）の位置に関する情報と、前記情報提供端末（３）自体の方向に関する情報から、前記情報提供端末（３）により撮影される現実空間に含まれる対象物を把握し、当該把握した対象物に対応した仮想表示を前記データベースから選択して読み出す手段であり、
    　　前記サーバ（５）の送信手段（５７）は、前記仮想表示情報選択手段（５５）が読み出した対象物に対応した仮想表示を前記情報提供端末（３）へ送信する手段であり、
     
    　これにより、前記撮影手段（３３）により前記情報提供端末（３）に現実空間に関する情報が入力され、
    　前記スクロール手段（３５）により、前記情報提供端末（３）に前記情報提供端末（３）自体の方向に関する情報が入力され、
    　前記情報提供端末（３）の送信手段（３９）により、前記情報提供端末（３）自体の方向に関する情報が前記基地局（７）へ送信され、
    　前記基地局（７）の受信手段（７１）が、前記情報提供端末（３）自体の方向に関する情報を受け取り、
    　前記位置把握手段（７３）が、前記情報提供端末（３）の位置を把握し、
    　前記基地局（７）の送信手段（７５）が、前記サーバ（５）に対して、前記情報提供端末（３）の位置に関する情報と、前記情報提供端末（３）自体の方向に関する情報を送信し、
    　前記サーバ（５）の受信手段（５１）が、前記基地局（７）から送信された前記情報提供端末（３）の位置に関する情報と、前記情報提供端末（３）自体の方向に関する情報を受信し、
    　前記仮想表示情報選択手段（５５）は、前記情報提供端末（３）の位置に関する情報と、前記情報提供端末（３）自体の方向に関する情報から、前記情報提供端末（３）により撮影される現実空間に含まれる対象物を把握し、当該把握した対象物に対応した仮想表示を前記データベース（５３）から選択して読み出し、
    　前記サーバ（５）の送信手段（５７）は、前記仮想表示情報選択手段（５５）が読み出した対象物に対応した仮想表示を前記情報提供端末（３）へ送信し、
    　前記情報提供端末（３）の表示手段は、前記撮影手段（３３）により撮影された現実空間を表示するとともに、前記サーバ（５）から送信された前記仮想表示情報を前記現実空間に重ねて表示する、
     
    　情報提供システム（１）。     An information providing terminal (3) capable of displaying a virtual display corresponding to an object included in the real space in an overlapping manner on the photographed real space;
    A server (5) for grasping the position of the information providing terminal (3) and transmitting the virtual display information to the information providing terminal (3);
    A base station (7) that mediates between the information providing terminal (3) and the server (5);
    An information providing system (1) including:

    The information providing terminal (3)
    The receiving unit (31) of the information providing terminal (3), the photographing unit (33), the scrolling unit (35), the display unit (37), and the transmitting unit (39) of the information providing terminal (3) are provided. And
    The receiving means (31) of the information providing terminal (3)
    Means for receiving virtual display information from the server (5);
    The photographing means (33)
    It is a means of photographing the real space,
    The scroll means (35)
    Means for inputting information relating to the direction of the information providing terminal (3) itself;
    The display means (37)
    While displaying the real space image | photographed by the said imaging | photography means (33), the said virtual display information transmitted from the said server (5) can be superimposed and displayed on the said real space,
    The transmission means (39) of the information providing terminal (3)
    Means for transmitting to the base station (7) information relating to the direction of the information providing terminal (3) itself input by the scroll means (35);

    The base station (7)
    A receiving means (71) of the base station (7), a position grasping means (73), and a transmitting means (75) of the base station (7);
    The receiving means (71) of the base station (7)
    Means for receiving information on the direction of the information providing terminal (3) itself;
    The position grasping means (73)
    Means for grasping the position of the information providing terminal (3);
    The transmission means (75) of the base station (7)
    Means for transmitting to the server (5) information relating to the position of the information providing terminal (3) and information relating to the direction of the information providing terminal (3) itself;

    The server (5)
    Including a receiving means (51) of the server (5), a database (53), a virtual display information selecting means (55), and a transmitting means (57) of the server (5),
    The receiving means (51) of the server (5) receives the information related to the position of the information providing terminal (3) and the information related to the direction of the information providing terminal (3) itself transmitted from the base station (7). Means to
    The database (53) is a storage unit that stores a virtual display corresponding to the object in association with information on the object,
    The virtual display information selection means (55) is photographed by the information providing terminal (3) from information on the position of the information providing terminal (3) and information on the direction of the information providing terminal (3) itself. It is means for grasping an object included in the space, selecting and reading out a virtual display corresponding to the grasped object from the database,
    The transmission means (57) of the server (5) is means for transmitting a virtual display corresponding to the object read by the virtual display information selection means (55) to the information providing terminal (3),

    Thereby, the information relating to the real space is input to the information providing terminal (3) by the photographing means (33),
    Information about the direction of the information providing terminal (3) itself is input to the information providing terminal (3) by the scroll means (35),
    Information on the direction of the information providing terminal (3) itself is transmitted to the base station (7) by the transmission means (39) of the information providing terminal (3),
    The receiving means (71) of the base station (7) receives information on the direction of the information providing terminal (3) itself,
    The position grasping means (73) grasps the position of the information providing terminal (3),
    The transmission means (75) of the base station (7) transmits information regarding the position of the information providing terminal (3) and information regarding the direction of the information providing terminal (3) itself to the server (5). And
    The receiving means (51) of the server (5) receives the information on the position of the information providing terminal (3) and the information on the direction of the information providing terminal (3) itself transmitted from the base station (7). And
    The virtual display information selection means (55) is photographed by the information providing terminal (3) from information on the position of the information providing terminal (3) and information on the direction of the information providing terminal (3) itself. Grasping an object included in the space, selecting and reading out a virtual display corresponding to the grasped object from the database (53),
    The transmission means (57) of the server (5) transmits a virtual display corresponding to the object read by the virtual display information selection means (55) to the information providing terminal (3),
    The display means of the information providing terminal (3) displays the real space photographed by the photographing means (33) and displays the virtual display information transmitted from the server (5) superimposed on the real space. To

    Information providing system (1).
PCT/JP2009/003222 2008-09-09 2009-07-09 System capable of displaying virtual information added to visibility information WO2010029671A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2008230523A JP2011242816A (en) 2008-09-09 2008-09-09 System capable of adding virtual information to visual field information and displaying it
JP2008-230523 2008-09-09

Publications (1)

Publication Number Publication Date
WO2010029671A1 true WO2010029671A1 (en) 2010-03-18

Family

ID=42004937

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2009/003222 WO2010029671A1 (en) 2008-09-09 2009-07-09 System capable of displaying virtual information added to visibility information

Country Status (2)

Country Link
JP (1) JP2011242816A (en)
WO (1) WO2010029671A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012118882A (en) * 2010-12-02 2012-06-21 Ns Solutions Corp Information processing system, and control method and program thereof
JP2013218597A (en) * 2012-04-11 2013-10-24 Sony Corp Information processing apparatus, display control method, and program
US20140184641A1 (en) * 2012-12-29 2014-07-03 Canon Kabushiki Kaisha Information display apparatus, information display system, control method thereof, and program
JP6387471B1 (en) * 2018-03-12 2018-09-05 Ｓｃｓｋ株式会社 Display program, storage program, display system, and storage system
CN112541467A (en) * 2020-12-21 2021-03-23 杭州光粒科技有限公司 Information display method, device and equipment and storage medium
WO2021131992A1 (en) * 2019-12-23 2021-07-01 ソニーグループ株式会社 Terminal device, application server, reception method, and transmission method

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6062041B2 (en) * 2012-05-07 2017-01-18 本田技研工業株式会社 A method for generating a virtual display surface from a video image of a landscape based on a road
JP2014203164A (en) 2013-04-02 2014-10-27 株式会社東芝 Information processing device, information processing method, and program
JP6421670B2 (en) * 2015-03-26 2018-11-14 富士通株式会社 Display control method, display control program, and information processing apparatus
JP6496671B2 (en) 2016-01-13 2019-04-03 株式会社ぐるなび Information processing apparatus, terminal apparatus, information processing method, and program
JP6976395B1 (en) * 2020-09-24 2021-12-08 Kddi株式会社 Distribution device, distribution system, distribution method and distribution program

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000285260A (en) * 1999-03-31 2000-10-13 Toshiba Corp Encoding method for multi-view point picture and generation method for arbitrary-view point picture
JP2001076168A (en) * 1999-09-02 2001-03-23 Ntt Docomo Inc Information terminal equipment, data base server device, picture display system and control method for the same
JP2003204481A (en) * 2001-08-16 2003-07-18 Space Tag Inc Image-information distribution system
JP2003248650A (en) * 2002-02-25 2003-09-05 Fujitsu Ltd Method and system for providing information between virtual space constructed and provided on computer network and real world
JP2006024168A (en) * 2004-07-06 2006-01-26 Fujitsu Ltd Server system and user terminal, and service provision method using server system and user terminal
JP2008046806A (en) * 2006-08-14 2008-02-28 Nippon Telegr & Teleph Corp <Ntt> Image processing method, image processor, and program

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000285260A (en) * 1999-03-31 2000-10-13 Toshiba Corp Encoding method for multi-view point picture and generation method for arbitrary-view point picture
JP2001076168A (en) * 1999-09-02 2001-03-23 Ntt Docomo Inc Information terminal equipment, data base server device, picture display system and control method for the same
JP2003204481A (en) * 2001-08-16 2003-07-18 Space Tag Inc Image-information distribution system
JP2003248650A (en) * 2002-02-25 2003-09-05 Fujitsu Ltd Method and system for providing information between virtual space constructed and provided on computer network and real world
JP2006024168A (en) * 2004-07-06 2006-01-26 Fujitsu Ltd Server system and user terminal, and service provision method using server system and user terminal
JP2008046806A (en) * 2006-08-14 2008-02-28 Nippon Telegr & Teleph Corp <Ntt> Image processing method, image processor, and program

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012118882A (en) * 2010-12-02 2012-06-21 Ns Solutions Corp Information processing system, and control method and program thereof
JP2013218597A (en) * 2012-04-11 2013-10-24 Sony Corp Information processing apparatus, display control method, and program
US9823821B2 (en) 2012-04-11 2017-11-21 Sony Corporation Information processing apparatus, display control method, and program for superimposing virtual objects on input image and selecting an interested object
US20140184641A1 (en) * 2012-12-29 2014-07-03 Canon Kabushiki Kaisha Information display apparatus, information display system, control method thereof, and program
US9721538B2 (en) * 2012-12-29 2017-08-01 Canon Kabushiki Kaisha Information display apparatus, information display system, control method thereof, and program
US10410607B2 (en) 2012-12-29 2019-09-10 Canon Kabushiki Kaisha Information display apparatus that superposes information on an imaged image and displays the information and the imaged image, and related information display system, control method and program
JP6387471B1 (en) * 2018-03-12 2018-09-05 Ｓｃｓｋ株式会社 Display program, storage program, display system, and storage system
JP2019159668A (en) * 2018-03-12 2019-09-19 Ｓｃｓｋ株式会社 Display program, storage program, display system, and storage system
WO2021131992A1 (en) * 2019-12-23 2021-07-01 ソニーグループ株式会社 Terminal device, application server, reception method, and transmission method
US11836876B2 (en) 2019-12-23 2023-12-05 Sony Group Corporation Terminal device, application server, receiving method, and transmitting method
CN112541467A (en) * 2020-12-21 2021-03-23 杭州光粒科技有限公司 Information display method, device and equipment and storage medium

Also Published As

Publication number Publication date
JP2011242816A (en) 2011-12-01

Similar Documents

Publication Publication Date Title
WO2010029671A1 (en) System capable of displaying virtual information added to visibility information
WO2011004608A1 (en) System capable of displaying visibility information to which virtual information is added
US11915353B2 (en) Display of a live scene and auxiliary object
US10586365B2 (en) Server, user terminal, and service providing method, and control method thereof
US10530998B2 (en) Image processing device, imaging device, image processing method, and program
CA2804096C (en) Methods, apparatuses and computer program products for automatically generating suggested information layers in augmented reality
US8416309B2 (en) Camera-fitted information retrieval device
CN104350736B (en) The augmented reality of neighbouring position information is arranged
KR101977703B1 (en) Method for controlling photographing in terminal and terminal thereof
JP5398970B2 (en) Mobile communication device and control method
US20090167919A1 (en) Method, Apparatus and Computer Program Product for Displaying an Indication of an Object Within a Current Field of View
US20110216165A1 (en) Electronic apparatus, image output method, and program therefor
JP5247347B2 (en) Image display system and main apparatus
JP4085634B2 (en) Image display program
KR102451012B1 (en) System and method for station information service using augmented reality
US20180192249A1 (en) Video region indicator that indicates that video content is available
JP2019075126A (en) Information processing device and program
JP4403336B2 (en) Electronic map display device, navigation device, storage medium, and electronic map display method
JP5414572B2 (en) Map display control device, map display control method, and map display control program
KR101146665B1 (en) Method of advertising based on location search service, system and method of location search service using the same
JP2010063076A (en) Image processing apparatus and image processing apparatus program
KR20110052247A (en) Camera apparatus for providing photograph image, display apparatus for displaying the photograph image and relating image, and methods thereof
JP2010021885A (en) Imaging device, and imaging support method
JP2019074649A (en) Information processing device and program
WO2021200187A1 (en) Portable terminal, information processing method, and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09812820

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC, EPO FORM 1205A DATED 09.08.2011

NENP Non-entry into the national phase

Ref country code: JP

122 Ep: pct application non-entry in european phase

Ref document number: 09812820

Country of ref document: EP

Kind code of ref document: A1