WO2014129105A1 - ヘッドマウントディスプレイシステム、ヘッドマウントディスプレイ及びヘッドマウントディスプレイ制御プログラム - Google Patents
ヘッドマウントディスプレイシステム、ヘッドマウントディスプレイ及びヘッドマウントディスプレイ制御プログラム Download PDFInfo
- Publication number
- WO2014129105A1 WO2014129105A1 PCT/JP2014/000140 JP2014000140W WO2014129105A1 WO 2014129105 A1 WO2014129105 A1 WO 2014129105A1 JP 2014000140 W JP2014000140 W JP 2014000140W WO 2014129105 A1 WO2014129105 A1 WO 2014129105A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- segment
- display
- coordinate system
- selection
- mounted display
- Prior art date
Links
- 238000010586 diagram Methods 0.000 description 37
- 210000003128 head Anatomy 0.000 description 27
- 238000004891 communication Methods 0.000 description 12
- 238000005516 engineering process Methods 0.000 description 9
- 230000010365 information processing Effects 0.000 description 9
- 238000012545 processing Methods 0.000 description 6
- 238000000034 method Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- QNRATNLHPGXHMA-XZHTYLCXSA-N (r)-(6-ethoxyquinolin-4-yl)-[(2s,4s,5r)-5-ethyl-1-azabicyclo[2.2.2]octan-2-yl]methanol;hydrochloride Chemical compound Cl.C([C@H]([C@H](C1)CC)C2)CN1[C@@H]2[C@H](O)C1=CC=NC2=CC=C(OCC)C=C21 QNRATNLHPGXHMA-XZHTYLCXSA-N 0.000 description 2
- 125000002066 L-histidyl group Chemical group [H]N1C([H])=NC(C([H])([H])[C@](C(=O)[*])([H])N([H])[H])=C1[H] 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000004886 head movement Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/163—Wearable computers, e.g. on a belt
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04802—3D-info-object: information is displayed on the internal or external surface of a three dimensional manipulable object, e.g. on the faces of a cube that can be rotated by the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
Definitions
- This technology relates to the operation of the head mounted display.
- HMD head mounted display
- a transmissive (see-through) HMD capable of visually recognizing both the outside and the display has been developed, and is also used in the field of user assistance. Application is expected.
- Patent Document 1 discloses a technique related to the operation of the HMD. This technology detects a user's head movement, controls computer equipment based on the movement, and feeds it back to the display of the HMD, and treats the user's head movement as an operation input to the computer equipment. Is.
- an object of the present technology is to provide a head mounted display system, a head mounted display, and a head mounted display capable of realizing high operability without requiring an operating device for operating the HMD. It is to provide a control program.
- a head mounted display system includes a coordinate system setting unit, a segment selection unit, and an image generation unit.
- the coordinate system setting unit sets a cylindrical coordinate system partitioned into a plurality of segments in real space.
- the segment selection unit places one of the plurality of segments in a selection standby state based on the direction of the display in the cylindrical coordinate system.
- the image generation unit generates a display image to be displayed on the display according to the confirmed segment.
- the segment in the cylindrical coordinate system is in a selection standby state according to the direction of the display.
- a display image corresponding to the segment is displayed on the display. That is, the user can operate the head mounted display according to the orientation of the display without using an operating device.
- the segment selection unit obtains a field angle range occupied by a field angle of the display in the cylindrical coordinate system according to a direction of the display, and the area included in the field angle range is the largest among the plurality of segments.
- a wide segment may be in a selection standby state.
- a segment located in the display direction in the cylindrical coordinate system is in a selection standby state. That is, the user can place the segment in the selection standby state by directing the display to the specific segment in the cylindrical coordinate system.
- the segment selection unit obtains coordinates located in the direction of the display in the cylindrical coordinate system according to the direction of the display, and selects a segment including the coordinates from the plurality of segments as a selection standby state. Good.
- a segment located in the display direction in the cylindrical coordinate system is in a selection standby state. That is, the user can place the segment in the selection standby state by directing the display to the specific segment in the cylindrical coordinate system.
- the segment selection unit may receive a first trigger input and confirm selection of a segment in a selection standby state.
- the user can perform the first trigger input when a specific segment is in the selection standby state, and can confirm the selection of the segment.
- the display image according to the segment decided by the image generation part is produced
- the vertical direction may be the height direction and the horizontal direction may be the circumferential direction.
- the user when the user selects the segment according to the display direction, the user can make a selection based on the horizontal direction.
- the coordinate system setting unit may receive the second trigger input and move the cylindrical coordinate system in the height direction of the cylindrical coordinate system.
- the user can adjust the height using the cylindrical coordinate system.
- the coordinate system setting unit may divide the cylindrical coordinate system into the plurality of segments by dividing the cylindrical coordinate system into a height direction and a circumferential direction of the cylindrical coordinate system.
- the cylindrical coordinate system is partitioned into rectangular segments.
- the coordinate system setting unit may divide the cylindrical coordinate system into the plurality of segments by dividing the cylindrical coordinate system in an oblique direction with respect to a height direction and a circumferential direction of the cylindrical coordinate system. .
- the cylindrical coordinate system is partitioned into rhombic segments.
- the head mounted display further includes an object placement unit that places an object in each of the plurality of segments.
- the image generation unit may generate an image of the object as the display image according to the angle of view range in the cylindrical coordinate system.
- the user can select a segment in which a desired object is placed while waiting for selection while referring to the image of the object, and use an application or the like corresponding to the object.
- the segment selection unit may not select a segment in which the object is not placed in a selection standby state.
- the object placement unit may not place the object in a segment existing in the front direction of the display in real space among the plurality of segments.
- the above object is an application icon
- the image generation unit may generate the display image based on an output of an application corresponding to the icon when selection of a segment in which a specific icon is arranged is confirmed.
- the user can select an arbitrary application according to the direction of the display and display the output on the display.
- the object is a widget generated by a given application
- the image generation unit may generate the display image based on an output of an application corresponding to the widget when selection of a segment in which the specific widget is arranged is confirmed.
- the user can confirm the widget according to the direction of the display, and can display the output of the application corresponding to the widget on the display as necessary.
- the above object is an application launcher
- the image generation unit may generate an image including an application selection menu as the display image when the selection of the segment where the application launcher is arranged is confirmed.
- the user can select an application launcher according to the direction of the display and select an arbitrary application.
- the object is a notification generated by a given application
- the image generation unit may generate the display image based on the output of the application that generated the notification when the selection of the segment in which the specific notification is arranged is confirmed.
- the user can confirm the notification according to the direction of the display, and can display the output of the application that generated the notification on the display as necessary.
- the display may be a transmissive display.
- the user can visually recognize the outside world through the transmissive display. Therefore, the user can work by visually recognizing the outside world through the transmissive display, change the direction of the display as necessary, and refer to the display image displayed on the transmissive display.
- a head mounted display includes a coordinate system setting unit, a segment selection unit, and an image generation unit.
- the coordinate system setting unit sets a cylindrical coordinate system partitioned into a plurality of segments in real space.
- the segment selection unit places one of the plurality of segments in a selection standby state based on the direction of the display in the cylindrical coordinate system.
- the image generation unit generates a display image to be displayed on the display according to the confirmed segment.
- a head mounted display control program causes a computer to function as a coordinate system setting unit, a segment selection unit, and an image generation unit.
- the coordinate system setting unit sets a cylindrical coordinate system partitioned into a plurality of segments in real space.
- the segment selection unit places one of the plurality of segments in a selection standby state based on the direction of the display in the cylindrical coordinate system.
- the image generation unit generates a display image to be displayed on the display according to the confirmed segment.
- a head-mounted display system capable of realizing high operability without requiring an operating device for operating the HMD are provided. It is possible to provide.
- FIG. 1 is a perspective view showing an external appearance of a head mounted display system 100 (hereinafter referred to as an HMD system 100) according to the present embodiment
- FIG. 2 is a block diagram showing a configuration of the HMD system 100.
- the HMD system 100 can be composed of a head mounted display 200 (hereinafter, HMD 200) and an information processing apparatus 300.
- the HMD 200 includes a frame 201, a display 202 (right display 202R and left display 202L), an input device 203, a CPU 204, a communication device 205, a memory 206, and a direction sensor 207, as shown in FIGS.
- the frame 201 supports the HMD 200 on the user's head and places the display 202 in front of the user's eyes.
- the shape of the frame 201 is not particularly limited, and may be a headgear type or the like in addition to the glasses type shown in FIG.
- Display 202 (right display 202R and left display 202L) displays a display image.
- the right display 202R is disposed in front of the user's right eye
- the left display 202L is disposed in front of the user's left eye. Note that either the right display 202R or the left display 202L may be provided.
- the display 202 can be a transmissive display (see-through display) or a non-transmissive display, but a transmissive display is suitable in this embodiment.
- the input device 203 receives an operation input by the user.
- an operation button a touch sensor, a proximity sensor, an illuminance sensor, or the like that can detect the approach or contact of an operator (such as a user's finger) can be used.
- the arrangement and number of input devices 203 are not particularly limited.
- the CPU (Central Processing Unit) 204 executes various arithmetic processes, and executes input by the input device 203, communication processing by the communication device 205, generation of a display image on the display 202, and the like.
- the communication device 205 communicates with a communication device 303 (described later) of the information processing apparatus 300 according to various communication standards such as USB (Universal Serial Bus), Bluetooth (registered trademark), and Wi-Fi (registered trademark).
- the memory 206 stores various types of information such as arithmetic processing results of the CPU 204 and display images.
- the direction sensor 207 detects the direction of the display 202.
- the direction sensor 207 can be composed of a geomagnetic sensor, an angular velocity sensor, an acceleration sensor, and the like. In addition, a sensor capable of detecting the direction of the display 202 can be used.
- the information processing apparatus 300 includes an input device 301, a CPU 302, a communication device 303, a memory 304, a display 305, and a storage 306.
- the information processing apparatus 300 can be various information processing apparatuses such as a smartphone, a tablet computer, and a laptop computer, but those that can be carried with the HMD 200 are preferable.
- the input device 301 receives an operation input by the user.
- the input device 301 can be a touch panel, an operation button, or the like.
- the CPU 302 performs input processing by the input device 301, communication processing by the communication device 303, execution of an application, and the like.
- the communication device 303 communicates with the communication device 205 of the HMD 200 according to various communication standards.
- the memory 307 stores the arithmetic processing result of the CPU 302 and the like.
- the storage 306 stores application and image information.
- the configurations of the HMD 200 and the information processing apparatus 300 are not limited to those shown here, and any configuration that can realize a functional configuration described later is acceptable.
- FIG. 3 is a schematic diagram showing a functional configuration of the HMD system 100.
- the HMD system 100 includes an image generation unit 101, a coordinate system setting unit 102, an object placement unit 103, and a segment selection unit 104.
- these functional configurations may be realized by either the HMD 200 or the information processing apparatus 300, or may be realized by the cooperation of both.
- a part or all of the functional configuration may be realized on a computer network.
- the image generation unit 101 generates a display image displayed on the display 202. At this time, the image generation unit 101 generates a display image using a coordinate system in the display 202 (hereinafter referred to as a display coordinate system).
- FIG. 4 is a schematic diagram showing the display coordinate system D. As shown in FIG. As shown in the figure, in the display coordinate system D, the upper left of the display is the origin Og, the right direction on the display is the x axis, and the lower direction on the display is the y axis. The width Wg in the x-axis direction and the height Hg in the y-axis direction are the display image size. The generation of the display image by the image generation unit 101 will be described later.
- the coordinate system setting unit 102 sets a cylindrical coordinate system in real space. Specifically, the coordinate system setting unit 102 sets, for example, the direction of the display 202 when the power of the HMD 200 is turned on or when a predetermined operation input is given to the HMD 200 as the front direction.
- the coordinate system setting unit 102 can acquire the direction of the display 202 from the direction sensor 207.
- the coordinate system setting unit 102 sets a cylindrical coordinate system having a central axis passing through the position (user origin) of the HMD 200 as a cylindrical coordinate system with the direction perpendicular to the front direction of the display 202 as the axial direction. be able to.
- a cylindrical coordinate system is formed in which the axial direction of the central axis is the height direction and the direction perpendicular to the axial direction is the circumferential direction.
- the coordinate system setting unit 102 may set the central axis of the cylindrical coordinate system as the vertical direction regardless of the front direction of the display 202. In this case, a cylindrical coordinate system is formed in which the vertical direction is the height direction and the horizontal direction is the circumferential direction.
- FIG. 5 is a schematic diagram showing a cylindrical coordinate system C.
- the cylindrical coordinate system has an x axis in the circumferential direction having a radius from the user origin Oh to the display coordinate system origin Or, a z axis in the radial direction, and a direction perpendicular to the x axis and the z axis.
- the coordinate system setting unit 102 sets a cylindrical coordinate system partitioned into a plurality of segments.
- FIG. 6 is a schematic diagram showing segments on a cylindrical coordinate system. 6A is a perspective view of the cylindrical coordinate system C, and FIG. 6B is a development view of the cylindrical coordinate system C.
- the coordinate system setting unit 102 sets a cylindrical coordinate system C partitioned into a plurality of segments S.
- the coordinate system setting unit 102 can divide the cylindrical coordinate system C in the height direction (y direction) and the circumferential direction (xz direction), respectively, and divide it into rectangular segments S. .
- the height (y direction) of each segment S is set as hg
- the width (xz direction) is set as wg.
- the cylindrical coordinate system is divided into three parts in the height direction and the circumferential direction, and is divided into rectangular segments. Further, the shape of each segment is not limited to a rectangular shape. As shown in FIG. 7, the coordinate system setting unit 102 divides the cylindrical coordinate system C in an oblique direction with respect to the height direction (y direction) and the circumferential direction (xz direction), and divides the cylindrical coordinate system C into rhombic segments. It is also possible. Hereinafter, a rectangular segment will be described as an example.
- the coordinate system setting unit 102 can set the segment located at the center in the height direction and the circumferential direction of the cylindrical coordinate system among the plurality of segments to be in the front direction of the display 202.
- the segment located at the center is referred to as a center segment.
- the coordinate system setting unit 102 may set the cylindrical coordinate system so that segments other than the central segment are in the front direction of the display 202.
- the coordinate system setting unit 102 can move the cylindrical coordinate system in the height direction upon receiving a predetermined trigger input (second trigger input).
- FIG. 8 is a schematic diagram showing a cylindrical coordinate system C that is moved in the height direction of the cylindrical coordinate system by the coordinate system setting unit 102.
- the origin Oru is the origin when the cylindrical coordinate system is moved upward in the height direction
- the origin Orl is the origin when the cylindrical coordinate system is moved downward in the height direction.
- the moving direction and moving amount of the cylindrical coordinate system can be determined by a user operation input.
- the object placement unit 103 places an object in each segment.
- FIG. 9 is a schematic diagram showing an object A arranged in each segment S.
- the object placement unit 103 can place an object A in each segment S as shown in FIG.
- the object A can be an application icon or widget, an application launcher, or a notification. Details will be described later.
- the object placement unit 103 may not place the object A in the central segment Sc.
- the segment selection unit 104 places one of the plurality of segments in a selection standby state based on the direction of the display 202. Specifically, the segment selection unit 104 can use the “view angle range” for selecting a segment.
- FIG. 10 is an example of the field angle range, and shows the field angle range H in the cylindrical coordinate system C.
- the segment selection unit 104 acquires the range occupied by the angle of view of the display 202 in the cylindrical coordinate system C as the angle of view range based on the direction of the display 202 and the radius of the cylindrical coordinate system.
- the view angle range H in the cylindrical coordinate system C moves with the change.
- the segment selection unit 104 can select one segment from a plurality of segments using this angle of view range.
- FIG. 11 is a schematic diagram showing segment selection by the segment selection unit 104. As shown in the figure, the segment selection unit 104 sets the segment S (hatched in the figure) having the largest area included in the angle-of-view range H among the plurality of segments S to be in a selection standby state.
- the segment selection unit 104 When the segment selection unit 104 receives a predetermined trigger input (assumed to be the first trigger input) while a specific segment is in the selection standby state, the segment selection unit 104 determines the selection of the segment in the selection standby state.
- the first trigger input can be a touch input by the user or a timeout (elapse of set time).
- the segment selection unit 104 confirms the segment selection, the segment selection unit 104 instructs the image generation unit 101 on the determined segment.
- the segment selection unit 104 when the segment selection unit 104 changes the direction of the display 202 when the specific segment is in the selection standby state and the segment with the largest area included in the view angle range is changed to another segment, the segment selection unit 104 Cancel the selection standby state.
- the segment selection unit 104 may not select a segment in which no object is arranged.
- FIG. 12 is a schematic diagram showing a segment S in which the object A is not arranged. As shown in the figure, when the segment S having the largest area included in the angle of view range H is the segment S where the object A is not arranged, the segment selection unit 104 does not place the segment S in the selection standby state. It can be. Note that the segment in which no object is arranged may be the above-described central segment or other segment.
- the image generation unit 101 generates a display image according to the display coordinate system and supplies the display image to the display 202.
- the image generation unit 101 When the segment selection unit 104 determines the selection of a specific segment, the image generation unit 101 generates a display image including a display corresponding to the segment.
- the display corresponding to the segment can be, for example, a display based on the output of the application corresponding to the object arranged in the segment.
- the image generation unit 101 can generate an image of an object as a display image based on a field angle range in the cylindrical coordinate system.
- the image generation unit 101 can arrange the object image in the display coordinate system in correspondence with the position of the object in the angle of view range and generate a display image. . Details of this will be described later.
- the coordinate system setting unit 102 sets the above-described cylindrical coordinate system on the real space. At this time, the coordinate system setting unit 102 can set the cylindrical coordinate system so that the central segment is arranged in the front direction of the display 202. Note that the coordinate system setting unit 102 may arrange a segment other than the central segment in the front direction of the display 202.
- the object placement unit 103 places an object A in each segment S as shown in FIG.
- the segment selection unit 104 acquires the field angle range of the display 202 in the cylindrical coordinate system.
- the field angle range includes the central segment, and no object is arranged in the central segment. Does not generate a display image. In this state, the user can visually recognize the outside world via the display 202 on which nothing is displayed, and can perform work or the like.
- FIG. 14 is a schematic diagram showing the moved view angle range H.
- the image generation unit 101 generates an image of the object (hereinafter referred to as an object image) as a display image.
- FIG. 15 is a schematic diagram showing the display image G at this time.
- the image generation unit 101 can arrange the object image in the display coordinate system according to the position of the object in the angle of view range. That is, when the user turns his / her head in any direction from the front direction, the user can view the object image arranged in the segment in that direction, and for example, can search for an icon of a desired application.
- the segment selection unit 104 detects the area of each segment S included in the angle-of-view range H as shown in FIG. 11, and sets the segment S included in the angle-of-view range H to the selection standby state.
- the image generation unit 101 blinks or enlarges the object image of the object arranged in the segment in the selection standby state, and presents to the user that the segment in which the object is arranged is in the selection standby state. May be.
- FIG. 17 is a schematic diagram showing the angle of view range H at this time.
- the segment selection unit 104 sets the segment to a selection standby state.
- the image generation unit 101 When the user performs the first trigger input in this state, the selection of the segment in the selection waiting state is confirmed.
- the image generation unit 101 generates a display image including a display corresponding to the segment instead of the object image. For example, when the object is an application icon, the image generation unit 101 generates an image generated by the application as a display image, as shown in FIG. That is, the user can visually recognize an image generated by a desired application.
- the segment selection unit 104 when the object A is not arranged in the segment S having the largest area included in the angle of view range H, the segment selection unit 104 does not place the segment S in the selection standby state. Can do. As a result, it is possible to prevent selection of a segment in which no object is arranged and to improve convenience.
- the image generation unit 101 Upon receiving a predetermined input from the user, the image generation unit 101 ends the display image including the display corresponding to the segment, and displays a display image (an image such as an icon) based on the field angle range of the display 202 illustrated in FIGS. 15 and 16. ).
- the user when the user is facing the front direction, the user can visually recognize the outside world through the display 202 on which nothing is displayed, and can perform work or the like.
- the user moves the direction of the head (display 202) as necessary to search for a desired object, and by performing the first trigger input, the display corresponding to the object can be visually recognized. That is, the user can select an arbitrary object without using an operation device such as a control box, and the HMD system 100 provides high operability.
- FIG. 19 is a schematic diagram showing movement of the cylindrical coordinate system C by the coordinate system setting unit 102.
- the cylindrical coordinate system C is set to the same height as the display 202 and can be used by the user as described above.
- the coordinate system setting unit 102 moves the cylindrical coordinate system in the height direction (upward in the figure) as shown in FIG.
- the second trigger input may be an input for moving the direction of the display 202 while the user touches the input device 203.
- the coordinate system setting unit 102 can move the cylindrical coordinate system C in accordance with the direction of the display 202 (angle with respect to the front direction).
- the cylindrical coordinate system C does not exist at the same height as the display 202 as shown in FIG. 19B. Therefore, even if the user slightly changes the direction of the display 202 from the front direction, the segment is selected. It is not in a standby state and no object image is displayed.
- the user can perform work while visually recognizing the outside world over a wide range.
- the cylindrical coordinate system is set above or below the display 202, the user points the display 202 toward the upper or lower cylindrical coordinate system C as shown in FIG. C can be used.
- the cylindrical coordinate system C is set to the same height as the display 202 as shown in FIG. Can be moved and used.
- the coordinate system setting unit 102 moves the cylindrical coordinate system in the height direction, so that the user can work in a wide field of view and use the cylindrical coordinate system as necessary. Is possible.
- the segment selection unit 104 can use the coordinates located in the direction of the display 202 in the cylindrical coordinate system (hereinafter referred to as display direction coordinates) for selecting a segment, instead of the “viewing angle range”.
- the segment selection unit 104 acquires the display direction coordinate P in the cylindrical coordinate system C based on the direction of the display 202.
- the display direction coordinate P in the cylindrical coordinate system C moves with the change.
- the segment selection unit 104 can select one segment from a plurality of segments using the display direction coordinates.
- FIG. 20 is a schematic diagram showing segment selection by the segment selection unit 104. As shown in the figure, the segment selection unit 104 sets a segment S (shaded line in the figure) including the display direction coordinates P among the plurality of segments S to be in a selection standby state.
- the segment selection unit 104 When the segment selection unit 104 receives a predetermined trigger input (assumed to be the first trigger input) while a specific segment is in the selection standby state, the segment selection unit 104 determines the selection of the segment in the selection standby state.
- the first trigger input can be a touch input by the user or a timeout (elapse of set time).
- the segment selection unit 104 confirms the segment selection, the segment selection unit 104 instructs the image generation unit 101 on the determined segment.
- the segment selection unit 104 when the segment selection unit 104 changes the orientation of the display 202 and changes the segment including the display direction coordinates to another segment when the specific segment is in the selection standby state, the segment selection unit 104 enters the selection standby state of the segment. Is released.
- the segment selection unit 104 uses the display direction coordinates to select a segment, as in the case of using the angle of view range, the user does not use an operation device such as a control box. It is possible to select an object.
- the segment selection unit 104 may not set the segment S to the selection standby state. As a result, it is possible to prevent selection of a segment in which no object is arranged and to improve convenience.
- the object placement unit 103 can place an application icon as an object in each segment.
- the user changes the direction of the display 202, selects an arbitrary icon, and performs the first trigger input.
- the segment selection unit 104 determines the selection of the segment in which the icon is arranged, and instructs the image generation unit 101.
- the image generation unit 101 generates a display image based on the output of the application corresponding to the icon and supplies the display image to the display 202. Thus, the user can visually recognize an image based on the output of the application.
- the image generation unit 101 receives another trigger input by the user, for example, an input indicating that the display 202 is directed downward, the image generation unit 101 deletes the image based on the output of the application and generates a selection image of the original icon. . In this way, the user can easily use the application using the HMD system 100.
- the object placement unit 103 can place a widget generated by a specific application as an object in one or a plurality of segments.
- the user can visually recognize the widget by changing the orientation of the display 202, and can easily acquire information.
- the segment selection unit 104 determines the selection of the segment in which the widget is arranged, and instructs the image generation unit 101.
- the image generation unit 101 generates a display image based on the output of the application that generated the widget and supplies the display image to the display 202. Thus, the user can visually recognize an image based on the output of the application.
- the image generation unit 101 deletes the image based on the output of the application and generates a selection image of the original icon. In this way, the user can easily acquire simple information from the widget using the HMD system 100, and can acquire detailed information as necessary.
- the object placement unit 103 can place an application launcher (hereinafter, launcher) as an object in one or more segments.
- launcher an application launcher
- the user can visually recognize the launcher by changing the orientation of the display 202, and performs the first trigger input in the visually recognized state.
- the segment selection unit 104 determines the selection of the segment in which the launcher is arranged, and instructs the image generation unit 101.
- the image generation unit 101 generates an image including an application selection menu as the display image and supplies it to the display 202.
- the user can select an arbitrary application by operating the selection menu according to the operation input or the direction of the display 202.
- the image generation unit 101 generates an image based on the output of the selected application as a display image. Thus, the user can visually recognize an image based on the output of the application.
- the image generation unit 101 When the image generation unit 101 receives another trigger input from the user, the image generation unit 101 deletes the image based on the output of the application and generates a selection image of the original icon.
- the launcher By using the launcher, the user can select an arbitrary application even when all of the applications cannot be arranged in each segment.
- the object placement unit 103 can place a notification generated by a specific application as an object in one or a plurality of segments. Examples of the notification include mail arrival, SNS (social networking service) writing, schedule notification, and the like.
- the user can confirm the notification by changing the orientation of the display 202. Further, when the user performs the first trigger input while visually recognizing the notification, the segment selection unit 104 determines the selection of the segment in which the notification is arranged and instructs the image generation unit 101.
- the image generation unit 101 generates a display image based on the output of the application that generated the notification, and supplies the display image to the display 202. Thus, the user can visually recognize an image based on the output of the application.
- the image generation unit 101 deletes the image based on the output of the application and generates a selection image of the original icon. In this way, the user can check the notification using the HMD system 100 and use the application that generated the notification as necessary.
- the present technology is not limited to the above embodiments, and can be changed without departing from the gist of the present technology.
- a coordinate system setting unit for setting a cylindrical coordinate system partitioned into a plurality of segments on the real space;
- a segment selection unit that puts one of the plurality of segments in a selection standby state based on the direction of the display;
- a head mounted display system comprising: an image generation unit configured to generate a display image to be displayed on the display according to the confirmed segment when the selection of the segment in the selection standby state is confirmed.
- the segment selection unit obtains a field angle range occupied by a field angle of the display in the cylindrical coordinate system according to a direction of the display, and the area included in the field angle range is the largest among the plurality of segments.
- a head-mounted display system that puts a wide segment into the selection standby state.
- the segment selection unit obtains coordinates located in the direction of the display in the cylindrical coordinate system according to the direction of the display, and sets a segment including the coordinates among the plurality of segments to be in a selection standby state.
- Head mounted display system obtains coordinates located in the direction of the display in the cylindrical coordinate system according to the direction of the display, and sets a segment including the coordinates among the plurality of segments to be in a selection standby state.
- the segment selection unit receives a first trigger input and determines selection of a segment in a selection standby state.
- the head mounted display system according to any one of (1) to (4) above,
- the cylindrical coordinate system is a head mounted display system in which the vertical direction is the height direction and the horizontal direction is the circumferential direction.
- the head mounted display system according to any one of (1) to (5) above,
- the coordinate system setting unit receives a second trigger input and moves the cylindrical coordinate system in a height direction of the cylindrical coordinate system.
- the coordinate system setting unit divides the cylindrical coordinate system into the plurality of segments by dividing the cylindrical coordinate system into a height direction and a circumferential direction of the cylindrical coordinate system.
- the coordinate system setting unit divides the cylindrical coordinate system into the plurality of segments by dividing the cylindrical coordinate system in an oblique direction with respect to a height direction and a circumferential direction of the cylindrical coordinate system. system.
- the head mounted display system according to any one of (1) to (8) above, An object placement unit for placing an object in each of the plurality of segments;
- the image generation unit generates an image of the object as the display image according to the field angle range in the cylindrical coordinate system.
- the head mounted display system according to any one of (1) to (9) above, The segment selection unit does not select a segment in which the object is not placed in a selection standby state.
- Head mounted display system according to any one of (1) to (9) above, The segment selection unit does not select a segment in which the object is not placed in a selection standby state.
- the head mounted display system according to any one of (1) to (10) above, The object placement unit does not place the object in a segment existing in the front direction of the display in real space among the plurality of segments.
- the head mounted display system according to any one of (1) to (12) above,
- the object is a widget generated by a given application
- the image generation unit generates the display image based on an output of an application corresponding to the widget when selection of a segment in which the specific widget is arranged is confirmed.
- the head mounted display system according to any one of (1) to (13) above,
- the above object is an application launcher
- the image generation unit generates an image including an application selection menu as the display image when the selection of the segment where the application launcher is arranged is confirmed.
- the head mounted display system according to any one of (1) to (14) above,
- the object is a notification generated by a given application.
- the image generation unit When the selection of a segment in which a specific notification is arranged is confirmed, the image generation unit generates the display image based on an output of an application that generates the notification.
- the head mounted display system according to any one of (1) to (15) above,
- the display is a transmissive display head mounted display system.
- a coordinate system setting unit for setting a cylindrical coordinate system partitioned into a plurality of segments on the real space;
- a segment selection unit that puts one of the plurality of segments in a selection standby state based on the direction of the display;
- a head mounted display comprising: an image generation unit configured to generate a display image to be displayed on the display according to the confirmed segment when the selection of the segment in the selection standby state is confirmed.
- a coordinate system setting unit for setting a cylindrical coordinate system partitioned into a plurality of segments on the real space;
- a segment selection unit that puts one of the plurality of segments in a selection standby state based on the direction of the display;
- a head-mounted display control program that causes a computer to function as an image generation unit that generates a display image to be displayed on the display according to a determined segment when the selection of the segment in the selection standby state is determined.
- DESCRIPTION OF SYMBOLS 100 ... Head mounted display system 101 ... Image generation part 102 ... Coordinate system setting part 103 ... Object arrangement part 104 ... Segment selection part 200 ... Head mounted display 300 ... Information processing apparatus
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- Optics & Photonics (AREA)
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
Description
上記座標系設定部は、実空間上に、複数のセグメントに区画された円筒座標系を設定する。
上記セグメント選択部は、上記円筒座標系において、ディスプレイの方向に基づいて上記複数のセグメントのいずれかを選択待機状態とする。
上記画像生成部は、上記選択待機状態とされたセグメントの選択が確定すると、確定されたセグメントに応じて上記ディスプレイに表示される表示画像を生成する。
上記画像生成部は、上記円筒座標系における上記画角範囲に応じて、上記オブジェクトの画像を上記表示画像として生成してもよい。
上記画像生成部は、特定のアイコンが配置されたセグメントの選択が確定されると、上記アイコンに対応するアプリケーションの出力に基づいて上記表示画像を生成してもよい。
上記画像生成部は、特定のウィジェットが配置されたセグメントの選択が確定されると、上記ウィジェットに対応するアプリケーションの出力に基づいて上記表示画像を生成してもよい。
上記画像生成部は、アプリケーションラウンチャーが配置されたセグメントの選択が確定されると、アプリケーションの選択メニューを含む画像を上記表示画像として生成してもよい。
上記画像生成部は、特定の通知が配置されたセグメントの選択が確定されると、上記通知を生成したアプリケーションの出力に基づいて上記表示画像を生成してもよい。
上記座標系設定部は、実空間上に、複数のセグメントに区画された円筒座標系を設定する。
上記セグメント選択部は、上記円筒座標系において、ディスプレイの方向に基づいて上記複数のセグメントのいずれかを選択待機状態とする。
上記画像生成部は、上記選択待機状態とされたセグメントの選択が確定すると、確定されたセグメントに応じて上記ディスプレイに表示される表示画像を生成する。
上記座標系設定部は、実空間上に、複数のセグメントに区画された円筒座標系を設定する。
上記セグメント選択部は、上記円筒座標系において、ディスプレイの方向に基づいて上記複数のセグメントのいずれかを選択待機状態とする。
上記画像生成部は、上記選択待機状態とされたセグメントの選択が確定すると、確定されたセグメントに応じて上記ディスプレイに表示される表示画像を生成する。
図1は、本実施形態に係るヘッドマウントディスプレイシステム100(以下、HMDシステム100)の外観示す斜視図であり、図2はHMDシステム100の構成を示すブロック図である。これらの図に示すようにHMDシステム100は、ヘッドマウントディスプレイ200(以下、HMD200)と情報処理装置300から構成されているものとすることができる。
以上のようなハードウェア構成によって実現されるHMDシステム100の機能的構成について説明する。図3は、HMDシステム100の機能的構成を示す模式図である。
HMDシステム100の動作について説明する。ユーザがHMD200を装着し、入力デバイス203や情報処理装置300を操作して所定の操作入力を行うと、座標系設定部102はそのときのディスプレイ202の方向をディスプレイ202の正面方向として認識する。
上述のように座標系設定部102は円筒座標系を設定するが、円筒座標系をその高さ方向(上方又は下方)に移動させることができる。図19は座標系設定部102による円筒座標系Cの移動を示す模式図である。図19(a)に示すように、ユーザがディスプレイ202の正面方向を指定すると、ディスプレイ202と同等の高さに円筒座標系Cが設定され、上述したようにユーザが利用することができる。
セグメント選択部104は、上記「画角範囲」に替えて、円筒座標系においてディスプレイ202の方向に位置する座標(以下、ディスプレイ方向座標とする)をセグメントの選択に利用することができる。セグメント選択部104は、ディスプレイ202の方向に基づいて、円筒座標系Cにおいてディスプレイ方向座標Pを取得する。実空間におけるディスプレイ202の方向が変動すると、その変動に伴なって円筒座標系Cにおけるディスプレイ方向座標Pが移動する。
HMDシステム100の具体的な利用例について説明する。
図21に示すように、オブジェクト配置部103は、アプリケーションのアイコンをオブジェクトとして各セグメントに配置することができる。ユーザは、ディスプレイ202の向きを変更して任意のアイコンを選び、第1トリガ入力を行う。これによりセグメント選択部104は、当該アイコンが配置されているセグメントの選択を確定し、画像生成部101に指示する。
図22に示すように、オブジェクト配置部103は、特定のアプリケーションによって生成されたウィジェットをオブジェクトとしてひとつ又は複数のセグメントに配置することができる。ユーザは、ディスプレイ202の向きを変更することによってウィジェットを視認することができ、容易に情報を取得することができる。さらにユーザは、当該ウィジェットの詳細を確認したい場合、当該ウィジェットを視認した状態で、第1トリガ入力を行う。これによりセグメント選択部104は、当該ウィジェットが配置されているセグメントの選択を確定し、画像生成部101に指示する。
図23に示すように、オブジェクト配置部103は、アプリケーションラウンチャー(以下、ラウンチャー)をオブジェクトとしてひとつ又は複数のセグメントに配置することができる。ユーザは、ディスプレイ202の向きを変更することによってラウンチャーを視認することができ、視認した状態で第1トリガ入力を行う。これによりセグメント選択部104は、当該ラウンチャーが配置されているセグメントの選択を確定し、画像生成部101に指示する。
図24に示すように、オブジェクト配置部103は、特定のアプリケーションによって生成される通知をオブジェクトとしてひとつ又は複数のセグメントに配置することができる。通知は例えば、メール着信やSNS(social networking service)の書き込み、スケジュール通知等が挙げられる。ユーザは、ディスプレイ202の向きを変更することによって通知を確認することができる。さらにユーザが、当該通知を視認した状態で第1トリガ入力を行うと、セグメント選択部104が当該通知が配置されているセグメントの選択を確定し、画像生成部101に指示する。
(1)
実空間上に、複数のセグメントに区画された円筒座標系を設定する座標系設定部と、
上記円筒座標系において、ディスプレイの方向に基づいて上記複数のセグメントのいずれかを選択待機状態とするセグメント選択部と、
上記選択待機状態とされたセグメントの選択が確定すると、確定されたセグメントに応じて上記ディスプレイに表示される表示画像を生成する画像生成部と
を具備するヘッドマウントディスプレイシステム。
上記(1)に記載のヘッドマウントディスプレイシステムであって、
上記セグメント選択部は、上記ディスプレイの方向に応じて、上記円筒座標系において上記ディスプレイの画角が占める画角範囲を取得し、上記複数のセグメントのうち、上記画角範囲に含まれる面積が最も広いセグメントを選択待機状態とする
ヘッドマウントディスプレイシステム。
上記(1)又は(2)に記載のヘッドマウントディスプレイシステムであって、
上記セグメント選択部は、上記ディスプレイの方向に応じて、上記円筒座標系において上記ディスプレイの方向に位置する座標を取得し、上記複数のセグメントのうち、上記座標が含まれるセグメントを選択待機状態とする
ヘッドマウントディスプレイシステム。
上記(1)から(3)のうちいずれか一つに記載のヘッドマウントディスプレイシステムであって、
上記セグメント選択部は、第1のトリガ入力を受けて、選択待機状態のセグメントの選択を確定する
ヘッドマウントディスプレイシステム。
上記(1)から(4)のうちいずれか一つに記載のヘッドマウントディスプレイシステムであって、
上記円筒座標系は、鉛直方向を高さ方向とし、水平方向を円周方向とする
ヘッドマウントディスプレイシステム。
上記(1)から(5)のうちいずれか一つに記載のヘッドマウントディスプレイシステムであって、
上記座標系設定部は、第2のトリガ入力を受けて上記円筒座標系を、上記円筒座標系の高さ方向に移動させる
ヘッドマウントディスプレイシステム。
上記(1)から(6)のうちいずれか一つに記載のヘッドマウントディスプレイシステムであって、
上記座標系設定部は、上記円筒座標系を、上記円筒座標系の高さ方向及び円周方向に分割することによって上記円筒座標系を上記複数のセグメントに区画する
ヘッドマウントディスプレイシステム。
上記(1)から(7)のうちいずれか一つに記載のヘッドマウントディスプレイシステムであって、
上記座標系設定部は、上記円筒座標系を、上記円筒座標系の高さ方向及び円周方向に対して斜め方向に分割することによって上記円筒座標系を上記複数のセグメントに区画する
ヘッドマウントディスプレイシステム。
上記(1)から(8)のうちいずれか一つに記載のヘッドマウントディスプレイシステムであって、
上記複数のセグメントのそれぞれにオブジェクトを配置するオブジェクト配置部をさらに具備し、
上記画像生成部は、上記円筒座標系における上記画角範囲に応じて、上記オブジェクトの画像を上記表示画像として生成する
ヘッドマウントディスプレイシステム。
上記(1)から(9)のうちいずれか一つに記載のヘッドマウントディスプレイシステムであって、
上記セグメント選択部は、上記オブジェクトが配置されていないセグメントを選択待機状態としない
ヘッドマウントディスプレイシステム
上記(1)から(10)のうちいずれか一つに記載のヘッドマウントディスプレイシステムであって、
上記オブジェクト配置部は、上記複数のセグメントのうち、実空間において上記ディスプレイの正面方向に存在するセグメントには上記オブジェクトを配置しない
ヘッドマウントディスプレイシステム。
上記(1)から(11)のうちいずれか一つに記載のヘッドマウントディスプレイシステムであって
上記オブジェクトはアプリケーションのアイコンであり、
上記画像生成部は、特定のアイコンが配置されたセグメントの選択が確定されると、上記アイコンに対応するアプリケーションの出力に基づいて上記表示画像を生成する
ヘッドマウントディスプレイシステム。
上記(1)から(12)のうちいずれか一つに記載のヘッドマウントディスプレイシステムであって、
上記オブジェクトは所定のアプリケーションによって生成されるウィジェットであり、
上記画像生成部は、特定のウィジェットが配置されたセグメントの選択が確定されると、上記ウィジェットに対応するアプリケーションの出力に基づいて上記表示画像を生成する
ヘッドマウントディスプレイシステム。
上記(1)から(13)のうちいずれか一つに記載のヘッドマウントディスプレイシステムであって、
上記オブジェクトはアプリケーションラウンチャーであり、
上記画像生成部は、アプリケーションラウンチャーが配置されたセグメントの選択が確定されると、アプリケーションの選択メニューを含む画像を上記表示画像として生成する
ヘッドマウントディスプレイシステム。
上記(1)から(14)のうちいずれか一つに記載のヘッドマウントディスプレイシステムであって、
上記オブジェクトは所定のアプリケーションによって生成される通知であり、
上記画像生成部は、特定の通知が配置されたセグメントの選択が確定されると、上記通知を生成したアプリケーションの出力に基づいて上記表示画像を生成する
ヘッドマウントディスプレイシステム。
上記(1)から(15)のうちいずれか一つに記載のヘッドマウントディスプレイシステムであって、
上記ディスプレイは、透過型ディスプレイである
ヘッドマウントディスプレイシステム。
実空間上に、複数のセグメントに区画された円筒座標系を設定する座標系設定部と、
上記円筒座標系において、ディスプレイの方向に基づいて上記複数のセグメントのいずれかを選択待機状態とするセグメント選択部と、
上記選択待機状態とされたセグメントの選択が確定すると、確定されたセグメントに応じて上記ディスプレイに表示される表示画像を生成する画像生成部と
を具備するヘッドマウントディスプレイ。
実空間上に、複数のセグメントに区画された円筒座標系を設定する座標系設定部と、
上記円筒座標系において、ディスプレイの方向に基づいて上記複数のセグメントのいずれかを選択待機状態とするセグメント選択部と、
上記選択待機状態とされたセグメントの選択が確定すると、確定されたセグメントに応じて上記ディスプレイに表示される表示画像を生成する画像生成部と
としてコンピュータを機能させるヘッドマウントディスプレイ制御プログラム。
101…画像生成部
102…座標系設定部
103…オブジェクト配置部
104…セグメント選択部
200…ヘッドマウントディスプレイ
300…情報処理装置
Claims (18)
- 実空間上に、複数のセグメントに区画された円筒座標系を設定する座標系設定部と、
前記円筒座標系において、ディスプレイの方向に基づいて前記複数のセグメントのいずれかを選択待機状態とするセグメント選択部と、
前記選択待機状態とされたセグメントの選択が確定すると、確定されたセグメントに応じて前記ディスプレイに表示される表示画像を生成する画像生成部と
を具備するヘッドマウントディスプレイシステム。 - 請求項1に記載のヘッドマウントディスプレイシステムであって、
前記セグメント選択部は、前記ディスプレイの方向に応じて、前記円筒座標系において前記ディスプレイの画角が占める画角範囲を取得し、前記複数のセグメントのうち、前記画角範囲に含まれる面積が最も広いセグメントを選択待機状態とする
ヘッドマウントディスプレイシステム。 - 請求項1に記載のヘッドマウントディスプレイシステムであって、
前記セグメント選択部は、前記ディスプレイの方向に応じて、前記円筒座標系において前記ディスプレイの方向に位置する座標を取得し、前記複数のセグメントのうち、前記座標が含まれるセグメントを選択待機状態とする
ヘッドマウントディスプレイシステム。 - 請求項1に記載のヘッドマウントディスプレイシステムであって、
前記セグメント選択部は、第1のトリガ入力を受けて、選択待機状態のセグメントの選択を確定する
ヘッドマウントディスプレイシステム。 - 請求項1に記載のヘッドマウントディスプレイシステムであって、
前記円筒座標系は、鉛直方向を高さ方向とし、水平方向を円周方向とする
ヘッドマウントディスプレイシステム。 - 請求項1に記載のヘッドマウントディスプレイシステムであって、
前記座標系設定部は、第2のトリガ入力を受けて前記円筒座標系を、前記円筒座標系の高さ方向に移動させる
ヘッドマウントディスプレイシステム。 - 請求項1に記載のヘッドマウントディスプレイシステムであって、
前記座標系設定部は、前記円筒座標系を、前記円筒座標系の高さ方向及び円周方向に分割することによって前記円筒座標系を前記複数のセグメントに区画する
ヘッドマウントディスプレイシステム。 - 請求項1に記載のヘッドマウントディスプレイシステムであって、
前記座標系設定部は、前記円筒座標系を、前記円筒座標系の高さ方向及び円周方向に対して斜め方向に分割することによって前記円筒座標系を前記複数のセグメントに区画する
ヘッドマウントディスプレイシステム。 - 請求項1に記載のヘッドマウントディスプレイシステムであって、
前記複数のセグメントのそれぞれにオブジェクトを配置するオブジェクト配置部をさらに具備し、
前記画像生成部は、前記円筒座標系における前記画角範囲に応じて、前記オブジェクトの画像を前記表示画像として生成する
ヘッドマウントディスプレイシステム。 - 請求項9に記載のヘッドマウントディスプレイシステムであって、
前記セグメント選択部は、前記オブジェクトが配置されていないセグメントを選択待機状態としない
ヘッドマウントディスプレイシステム - 請求項9に記載のヘッドマウントディスプレイシステムであって、
前記オブジェクト配置部は、前記複数のセグメントのうち、実空間において前記ディスプレイの正面方向に存在するセグメントには前記オブジェクトを配置しない
ヘッドマウントディスプレイシステム。 - 請求項9に記載のヘッドマウントディスプレイシステムであって、
前記オブジェクトはアプリケーションのアイコンであり、
前記画像生成部は、特定のアイコンが配置されたセグメントの選択が確定されると、前記アイコンに対応するアプリケーションの出力に基づいて前記表示画像を生成する
ヘッドマウントディスプレイシステム。 - 請求項9に記載のヘッドマウントディスプレイシステムであって、
前記オブジェクトは所定のアプリケーションによって生成されるウィジェットであり、
前記画像生成部は、特定のウィジェットが配置されたセグメントの選択が確定されると、前記ウィジェットに対応するアプリケーションの出力に基づいて前記表示画像を生成する
ヘッドマウントディスプレイシステム。 - 請求項9に記載のヘッドマウントディスプレイシステムであって、
前記オブジェクトはアプリケーションラウンチャーであり、
前記画像生成部は、アプリケーションラウンチャーが配置されたセグメントの選択が確定されると、アプリケーションの選択メニューを含む画像を前記表示画像として生成する
ヘッドマウントディスプレイシステム。 - 請求項9に記載のヘッドマウントディスプレイシステムであって、
前記オブジェクトは所定のアプリケーションによって生成される通知であり、
前記画像生成部は、特定の通知が配置されたセグメントの選択が確定されると、前記通知を生成したアプリケーションの出力に基づいて前記表示画像を生成する
ヘッドマウントディスプレイシステム。 - 請求項1に記載のヘッドマウントディスプレイシステムであって、
前記ディスプレイは、透過型ディスプレイである
ヘッドマウントディスプレイシステム。 - 実空間上に、複数のセグメントに区画された円筒座標系を設定する座標系設定部と、
前記円筒座標系において、ディスプレイの方向に基づいて前記複数のセグメントのいずれかを選択待機状態とするセグメント選択部と、
前記選択待機状態とされたセグメントの選択が確定すると、確定されたセグメントに応じて前記ディスプレイに表示される表示画像を生成する画像生成部と
を具備するヘッドマウントディスプレイ。 - 実空間上に、複数のセグメントに区画された円筒座標系を設定する座標系設定部と、
前記円筒座標系において、ディスプレイの方向に基づいて前記複数のセグメントのいずれかを選択待機状態とするセグメント選択部と、
前記選択待機状態とされたセグメントの選択が確定すると、確定されたセグメントに応じて前記ディスプレイに表示される表示画像を生成する画像生成部と
としてコンピュータを機能させるヘッドマウントディスプレイ制御プログラム。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201480001299.0A CN104335155B (zh) | 2013-02-22 | 2014-01-15 | 头戴式显示***、头戴式显示器以及头戴式显示器的控制程序 |
US14/401,040 US9829997B2 (en) | 2013-02-22 | 2014-01-15 | Head-mounted display system, head-mounted display, and head-mounted display control program |
CN201811185267.7A CN109656354B (zh) | 2013-02-22 | 2014-01-15 | 信息处理装置和信息处理方法 |
JP2015501305A JP6260613B2 (ja) | 2013-02-22 | 2014-01-15 | ヘッドマウントディスプレイシステム、ヘッドマウントディスプレイ、ヘッドマウントディスプレイ制御プログラム、画像表示方法及び画像表示装置 |
US15/789,514 US20180101248A1 (en) | 2013-02-22 | 2017-10-20 | Head-mounted display system, head-mounted display, and head-mounted display control program |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2013033077 | 2013-02-22 | ||
JP2013-033077 | 2013-02-22 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/401,040 A-371-Of-International US9829997B2 (en) | 2013-02-22 | 2014-01-15 | Head-mounted display system, head-mounted display, and head-mounted display control program |
US15/789,514 Continuation US20180101248A1 (en) | 2013-02-22 | 2017-10-20 | Head-mounted display system, head-mounted display, and head-mounted display control program |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014129105A1 true WO2014129105A1 (ja) | 2014-08-28 |
Family
ID=51390915
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2014/000140 WO2014129105A1 (ja) | 2013-02-22 | 2014-01-15 | ヘッドマウントディスプレイシステム、ヘッドマウントディスプレイ及びヘッドマウントディスプレイ制御プログラム |
Country Status (4)
Country | Link |
---|---|
US (2) | US9829997B2 (ja) |
JP (3) | JP6260613B2 (ja) |
CN (2) | CN109656354B (ja) |
WO (1) | WO2014129105A1 (ja) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015049883A (ja) * | 2013-09-05 | 2015-03-16 | セイコーエプソン株式会社 | 頭部装着型表示装置、頭部装着型表示装置を制御する方法、画像表示システム |
CN104615241A (zh) * | 2015-01-04 | 2015-05-13 | 谭希韬 | 基于头转动的穿戴式眼镜控制方法和*** |
JP2016126381A (ja) * | 2014-12-26 | 2016-07-11 | セイコーエプソン株式会社 | 頭部装着型表示装置、頭部装着型表示装置の制御方法、および、コンピュータープログラム |
JP2016181302A (ja) * | 2016-07-13 | 2016-10-13 | 株式会社コロプラ | 没入型仮想空間でオブジェクト操作を制御するためのコンピュータ・プログラムおよびコンピュータ・システム |
JP2018521372A (ja) * | 2015-05-26 | 2018-08-02 | グーグル エルエルシー | 没入型メディアにおいてアプリケーションおよびアクティビティに入ったり出たりするための多次元グラフィック方法 |
JP2019194870A (ja) * | 2019-06-05 | 2019-11-07 | 株式会社コロプラ | 情報処理方法、情報処理プログラム、情報処理システムおよび情報処理装置 |
WO2020157955A1 (ja) * | 2019-02-01 | 2020-08-06 | マクセル株式会社 | 仮想オブジェクト表示装置及び仮想オブジェクト表示方法 |
JP2021108126A (ja) * | 2015-10-20 | 2021-07-29 | マジック リープ, インコーポレイテッドMagic Leap,Inc. | 3次元空間内の仮想オブジェクトの選択 |
Families Citing this family (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2014129105A1 (ja) * | 2013-02-22 | 2014-08-28 | ソニー株式会社 | ヘッドマウントディスプレイシステム、ヘッドマウントディスプレイ及びヘッドマウントディスプレイ制御プログラム |
US20150362990A1 (en) * | 2014-06-11 | 2015-12-17 | Lenovo (Singapore) Pte. Ltd. | Displaying a user input modality |
US10416760B2 (en) | 2014-07-25 | 2019-09-17 | Microsoft Technology Licensing, Llc | Gaze-based object placement within a virtual reality environment |
US9904055B2 (en) * | 2014-07-25 | 2018-02-27 | Microsoft Technology Licensing, Llc | Smart placement of virtual objects to stay in the field of view of a head mounted display |
US10311638B2 (en) | 2014-07-25 | 2019-06-04 | Microsoft Technology Licensing, Llc | Anti-trip when immersed in a virtual reality environment |
US10451875B2 (en) | 2014-07-25 | 2019-10-22 | Microsoft Technology Licensing, Llc | Smart transparency for virtual objects |
US9766460B2 (en) | 2014-07-25 | 2017-09-19 | Microsoft Technology Licensing, Llc | Ground plane adjustment in a virtual reality environment |
JP6433850B2 (ja) * | 2015-05-13 | 2018-12-05 | 株式会社ソニー・インタラクティブエンタテインメント | ヘッドマウントディスプレイ、情報処理装置、情報処理システム、およびコンテンツデータ出力方法 |
JP6344311B2 (ja) * | 2015-05-26 | 2018-06-20 | ソニー株式会社 | 表示装置、情報処理システム及び制御方法 |
JP6585929B2 (ja) * | 2015-06-02 | 2019-10-02 | キヤノン株式会社 | システム、システムの制御方法 |
CN104866105B (zh) * | 2015-06-03 | 2018-03-02 | 塔普翊海(上海)智能科技有限公司 | 头显设备的眼动和头动交互方法 |
CN105955454A (zh) * | 2016-04-15 | 2016-09-21 | 北京小鸟看看科技有限公司 | 一种用于虚拟现实***的防眩晕方法和装置 |
CN105955457A (zh) * | 2016-04-19 | 2016-09-21 | 北京小鸟看看科技有限公司 | 一种头戴显示设备的用户界面布局方法和头戴显示设备 |
KR20170129509A (ko) * | 2016-05-17 | 2017-11-27 | 엘지전자 주식회사 | 헤드 마운티드 디스플레이 장치 및 그것의 제어방법 |
US11048325B2 (en) | 2017-07-10 | 2021-06-29 | Samsung Electronics Co., Ltd. | Wearable augmented reality head mounted display device for phone content display and health monitoring |
WO2019013409A1 (en) | 2017-07-10 | 2019-01-17 | Samsung Electronics Co., Ltd. | INCREASED REALITY VISIOCASTIC DEVICE FOR DISPLAYING TELEPHONE CONTENT AND HEALTH MONITORING |
US10671237B2 (en) * | 2017-10-16 | 2020-06-02 | Microsoft Technology Licensing, Llc | Human-machine interface for presenting a user interface on a virtual curved visual surface |
US10460259B2 (en) | 2017-12-04 | 2019-10-29 | Bank Of America Corporation | Dynamic progress recognition and recommendations based on machine learning |
CN108008820B (zh) * | 2017-12-14 | 2021-09-21 | 深圳位形空间科技有限公司 | 重定向行走方法、重定向行走服务器及重定向行走*** |
TWI719483B (zh) * | 2019-05-17 | 2021-02-21 | 雅得近顯股份有限公司 | 便利備忘操作系統 |
US11178384B2 (en) * | 2019-07-10 | 2021-11-16 | Nintendo Co., Ltd. | Information processing system, storage medium, information processing apparatus and information processing method |
US11204649B2 (en) * | 2020-01-30 | 2021-12-21 | SA Photonics, Inc. | Head-mounted display with user-operated control |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004233909A (ja) * | 2003-01-31 | 2004-08-19 | Nikon Corp | ヘッドマウントディスプレイ |
WO2010107072A1 (ja) * | 2009-03-18 | 2010-09-23 | ブラザー工業株式会社 | ヘッドマウントディスプレイ |
JP2012033043A (ja) * | 2010-07-30 | 2012-02-16 | Toshiba Corp | 情報表示装置及び情報表示方法 |
Family Cites Families (32)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US246967A (en) * | 1881-09-13 | Portable fountains with aerated | ||
US5579026A (en) * | 1993-05-14 | 1996-11-26 | Olympus Optical Co., Ltd. | Image display apparatus of head mounted type |
JPH0778054A (ja) * | 1993-06-24 | 1995-03-20 | Casio Comput Co Ltd | データ処理装置 |
US5977935A (en) * | 1993-08-12 | 1999-11-02 | Seiko Epson Corporation | Head-mounted image display device and data processing apparatus including the same |
US6351261B1 (en) * | 1993-08-31 | 2002-02-26 | Sun Microsystems, Inc. | System and method for a virtual reality system having a frame buffer that stores a plurality of view points that can be selected and viewed by the user |
US6061064A (en) * | 1993-08-31 | 2000-05-09 | Sun Microsystems, Inc. | System and method for providing and using a computer user interface with a view space having discrete portions |
JPH07271546A (ja) | 1994-03-31 | 1995-10-20 | Olympus Optical Co Ltd | 画像表示制御方法 |
US6181371B1 (en) * | 1995-05-30 | 2001-01-30 | Francis J Maguire, Jr. | Apparatus for inducing attitudinal head movements for passive virtual reality |
JP3786294B2 (ja) * | 1995-10-02 | 2006-06-14 | ソニー株式会社 | 画像制御装置および方法 |
WO1999001838A2 (en) * | 1997-07-03 | 1999-01-14 | Koninklijke Philips Electronics N.V. | Apparatus and method for creating and controlling a virtual workspace of a windowing system |
JP4009433B2 (ja) * | 2001-03-29 | 2007-11-14 | 株式会社コナミデジタルエンタテインメント | ゲーム装置、ゲームプログラム及びゲームシステム |
GB2377147A (en) * | 2001-06-27 | 2002-12-31 | Nokia Corp | A virtual reality user interface |
JP2004199496A (ja) * | 2002-12-19 | 2004-07-15 | Sony Corp | 情報処理装置および方法、並びにプログラム |
JP4389161B2 (ja) * | 2004-04-12 | 2009-12-24 | ソニー株式会社 | 表示装置及び表示方法 |
JP4927631B2 (ja) | 2006-06-27 | 2012-05-09 | パナソニック株式会社 | 表示装置、その制御方法、プログラム、記録媒体および集積回路 |
US7928926B2 (en) * | 2006-06-27 | 2011-04-19 | Panasonic Corporation | Display apparatus and method for hands free operation that selects a function when window is within field of view |
JP4519883B2 (ja) * | 2007-06-01 | 2010-08-04 | 株式会社コナミデジタルエンタテインメント | キャラクター表示装置、キャラクター表示方法、ならびに、プログラム |
JP2010231290A (ja) | 2009-03-26 | 2010-10-14 | National Institute Of Advanced Industrial Science & Technology | 頭部運動による入力装置及び方法 |
CN102023700B (zh) * | 2009-09-23 | 2012-06-06 | 吴健康 | 一种三维人机交互*** |
JP5423406B2 (ja) * | 2010-01-08 | 2014-02-19 | ソニー株式会社 | 情報処理装置、情報処理システム及び情報処理方法 |
US8477425B2 (en) * | 2010-02-28 | 2013-07-02 | Osterhout Group, Inc. | See-through near-eye display glasses including a partially reflective, partially transmitting optical element |
JP4858626B2 (ja) * | 2010-04-16 | 2012-01-18 | カシオ計算機株式会社 | 情報表示装置及びプログラム |
JP5557316B2 (ja) * | 2010-05-07 | 2014-07-23 | Necカシオモバイルコミュニケーションズ株式会社 | 情報処理装置、情報生成方法及びプログラム |
CN102346544A (zh) * | 2010-07-30 | 2012-02-08 | 鸿富锦精密工业(深圳)有限公司 | 具有互动功能的头戴式显示***及显示方法 |
US9122307B2 (en) * | 2010-09-20 | 2015-09-01 | Kopin Corporation | Advanced remote control of host application using motion and voice commands |
US8866852B2 (en) * | 2011-11-28 | 2014-10-21 | Google Inc. | Method and system for input detection |
US8643951B1 (en) * | 2012-03-15 | 2014-02-04 | Google Inc. | Graphical menu and interaction therewith through a viewing window |
US20130246967A1 (en) * | 2012-03-15 | 2013-09-19 | Google Inc. | Head-Tracked User Interaction with Graphical Interface |
US20140101608A1 (en) * | 2012-10-05 | 2014-04-10 | Google Inc. | User Interfaces for Head-Mountable Devices |
WO2014129105A1 (ja) * | 2013-02-22 | 2014-08-28 | ソニー株式会社 | ヘッドマウントディスプレイシステム、ヘッドマウントディスプレイ及びヘッドマウントディスプレイ制御プログラム |
CN104246864B (zh) * | 2013-02-22 | 2016-06-29 | 索尼公司 | 头戴式显示器和图像显示装置 |
US9285872B1 (en) * | 2013-12-12 | 2016-03-15 | Google Inc. | Using head gesture and eye position to wake a head mounted device |
-
2014
- 2014-01-15 WO PCT/JP2014/000140 patent/WO2014129105A1/ja active Application Filing
- 2014-01-15 CN CN201811185267.7A patent/CN109656354B/zh active Active
- 2014-01-15 US US14/401,040 patent/US9829997B2/en active Active
- 2014-01-15 CN CN201480001299.0A patent/CN104335155B/zh active Active
- 2014-01-15 JP JP2015501305A patent/JP6260613B2/ja active Active
-
2017
- 2017-10-20 US US15/789,514 patent/US20180101248A1/en not_active Abandoned
- 2017-12-08 JP JP2017235704A patent/JP2018097364A/ja active Pending
-
2019
- 2019-08-21 JP JP2019151195A patent/JP2019212324A/ja active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004233909A (ja) * | 2003-01-31 | 2004-08-19 | Nikon Corp | ヘッドマウントディスプレイ |
WO2010107072A1 (ja) * | 2009-03-18 | 2010-09-23 | ブラザー工業株式会社 | ヘッドマウントディスプレイ |
JP2012033043A (ja) * | 2010-07-30 | 2012-02-16 | Toshiba Corp | 情報表示装置及び情報表示方法 |
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015049883A (ja) * | 2013-09-05 | 2015-03-16 | セイコーエプソン株式会社 | 頭部装着型表示装置、頭部装着型表示装置を制御する方法、画像表示システム |
US9658451B2 (en) | 2013-09-05 | 2017-05-23 | Seiko Epson Corporation | Head mounted display, method of controlling head mounted display, and image display system |
JP2016126381A (ja) * | 2014-12-26 | 2016-07-11 | セイコーエプソン株式会社 | 頭部装着型表示装置、頭部装着型表示装置の制御方法、および、コンピュータープログラム |
US10114604B2 (en) | 2014-12-26 | 2018-10-30 | Seiko Epson Corporation | Head-mounted display device, control method for head-mounted display device, and computer program |
CN104615241B (zh) * | 2015-01-04 | 2017-08-25 | 谭希韬 | 基于头转动的穿戴式眼镜控制方法和*** |
CN104615241A (zh) * | 2015-01-04 | 2015-05-13 | 谭希韬 | 基于头转动的穿戴式眼镜控制方法和*** |
JP2018521372A (ja) * | 2015-05-26 | 2018-08-02 | グーグル エルエルシー | 没入型メディアにおいてアプリケーションおよびアクティビティに入ったり出たりするための多次元グラフィック方法 |
JP2021108126A (ja) * | 2015-10-20 | 2021-07-29 | マジック リープ, インコーポレイテッドMagic Leap,Inc. | 3次元空間内の仮想オブジェクトの選択 |
JP7296995B2 (ja) | 2015-10-20 | 2023-06-23 | マジック リープ, インコーポレイテッド | 3次元空間内の仮想オブジェクトの選択 |
US11733786B2 (en) | 2015-10-20 | 2023-08-22 | Magic Leap, Inc. | Selecting virtual objects in a three-dimensional space |
JP2016181302A (ja) * | 2016-07-13 | 2016-10-13 | 株式会社コロプラ | 没入型仮想空間でオブジェクト操作を制御するためのコンピュータ・プログラムおよびコンピュータ・システム |
US11960635B2 (en) | 2019-02-01 | 2024-04-16 | Maxell, Ltd. | Virtual object display device and virtual object display method |
WO2020157955A1 (ja) * | 2019-02-01 | 2020-08-06 | マクセル株式会社 | 仮想オブジェクト表示装置及び仮想オブジェクト表示方法 |
JPWO2020157955A1 (ja) * | 2019-02-01 | 2021-10-21 | マクセル株式会社 | 仮想オブジェクト表示装置及び仮想オブジェクト表示方法 |
JP7504253B2 (ja) | 2019-02-01 | 2024-06-21 | マクセル株式会社 | 仮想オブジェクト表示装置 |
JP7274510B2 (ja) | 2019-02-01 | 2023-05-16 | マクセル株式会社 | 仮想オブジェクト表示装置及び仮想オブジェクト表示方法 |
JP2019194870A (ja) * | 2019-06-05 | 2019-11-07 | 株式会社コロプラ | 情報処理方法、情報処理プログラム、情報処理システムおよび情報処理装置 |
JP6994005B2 (ja) | 2019-06-05 | 2022-01-14 | 株式会社コロプラ | 情報処理方法、情報処理プログラム、情報処理システムおよび情報処理装置 |
Also Published As
Publication number | Publication date |
---|---|
JP2019212324A (ja) | 2019-12-12 |
CN109656354B (zh) | 2022-05-31 |
US9829997B2 (en) | 2017-11-28 |
US20180101248A1 (en) | 2018-04-12 |
CN104335155A (zh) | 2015-02-04 |
JP2018097364A (ja) | 2018-06-21 |
JP6260613B2 (ja) | 2018-01-17 |
CN109656354A (zh) | 2019-04-19 |
US20150138081A1 (en) | 2015-05-21 |
JPWO2014129105A1 (ja) | 2017-02-02 |
CN104335155B (zh) | 2018-11-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6260613B2 (ja) | ヘッドマウントディスプレイシステム、ヘッドマウントディスプレイ、ヘッドマウントディスプレイ制御プログラム、画像表示方法及び画像表示装置 | |
US9658451B2 (en) | Head mounted display, method of controlling head mounted display, and image display system | |
US9411410B2 (en) | Information processing device, method, and program for arranging virtual objects on a curved plane for operation in a 3D space | |
US10055064B2 (en) | Controlling multiple devices with a wearable input device | |
US10466794B2 (en) | Gesture recognition areas and sub-areas for interaction with real and virtual objects within augmented reality | |
TWI539362B (zh) | 介面切換方法及應用該介面切換方法的電子裝置 | |
KR20170126295A (ko) | 헤드 마운티드 디스플레이 장치 및 그것의 제어방법 | |
EP2405403A1 (en) | Three Dimensional User Interface | |
EP3548988A1 (en) | Switching of active objects in an augmented and/or virtual reality environment | |
JP7064040B2 (ja) | 表示システム、及び表示システムの表示制御方法 | |
US20150062164A1 (en) | Head mounted display, method of controlling head mounted display, computer program, image display system, and information processing apparatus | |
WO2012122007A2 (en) | Keyboards and methods thereof | |
KR101807655B1 (ko) | 사용자 인터페이스를 제공하기 위한 방법, 디바이스, 시스템 및 비일시성의 컴퓨터 판독 가능한 기록 매체 | |
US20150302653A1 (en) | Augmented Digital Data | |
CN102768607A (zh) | 一种实现触控操作应用程序的方法及装置 | |
US9983700B2 (en) | Input device, image display method, and program for reliable designation of icons | |
JP6174646B2 (ja) | 仮想空間内のオブジェクトを3軸操作するためのコンピュータ・プログラム | |
WO2013103968A2 (en) | Touchscreen controller | |
CN107967091B (zh) | 一种人机交互方法及用于人机交互的计算设备 | |
JP6374203B2 (ja) | 表示システム及びプログラム | |
KR20170124593A (ko) | 지능형 상호작용 방법, 장비 및 시스템 | |
WO2023037547A1 (ja) | 携帯情報端末及びオブジェクト表示方法 | |
WO2023210352A1 (ja) | 情報処理装置、情報処理方法、及びプログラム | |
KR102289368B1 (ko) | 단말기 및 그를 이용한 오브젝트 제어 방법 | |
JP2017157120A (ja) | 表示装置、及び、表示装置の制御方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2015501305 Country of ref document: JP Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14754108 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14401040 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 14754108 Country of ref document: EP Kind code of ref document: A1 |