WO2017113757A1 - 一种环绕式界面布局方法、三维沉浸式环境下内容切换方法和列表切换方法 - Google Patents

一种环绕式界面布局方法、三维沉浸式环境下内容切换方法和列表切换方法 Download PDF

Info

Publication number
WO2017113757A1
WO2017113757A1 PCT/CN2016/090295 CN2016090295W WO2017113757A1 WO 2017113757 A1 WO2017113757 A1 WO 2017113757A1 CN 2016090295 W CN2016090295 W CN 2016090295W WO 2017113757 A1 WO2017113757 A1 WO 2017113757A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
list
content
sight
line
Prior art date
Application number
PCT/CN2016/090295
Other languages
English (en)
French (fr)
Inventor
饶小林
冯雪
Original Assignee
北京小鸟看看科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201511029860.9A external-priority patent/CN105653034A/zh
Priority claimed from CN201511029344.6A external-priority patent/CN105677275B/zh
Priority claimed from CN201511026691.3A external-priority patent/CN105677165A/zh
Application filed by 北京小鸟看看科技有限公司 filed Critical 北京小鸟看看科技有限公司
Priority to US15/117,348 priority Critical patent/US10372289B2/en
Publication of WO2017113757A1 publication Critical patent/WO2017113757A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134—Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted

Definitions

  • the invention relates to the technical field of interface layout design, in particular to a wraparound interface layout method, a content switching method and a list switching method in a three-dimensional immersive environment.
  • the display interfaces of various computers, mobile terminals, and virtual reality devices are all in a flat tile layout, and the number of layout objects is limited, and the content can only be changed by sliding the screen, and the interface function is not scalable, and the interface layout cannot be made at the same time.
  • the user finds a sense of existence. When a plurality of objects are laid out on a large display device, in the user's visual, the objects that are close to each other are larger, the objects that are far away are smaller, and the viewing effect is not good. Obviously this flat tiled layout user interaction experience is not good.
  • the two-dimensional mode gesture operation and the visual switching mode are basically retained, for example, the user adopts left to right or From right to left gestures, the interface tile is pushed or disappeared from left to right or from right to left.
  • the immersive experience process in this way, the user's hand operation in the three-dimensional scene is too large, and it is necessary to distinguish whether the direction of the physical touch screen operation is correct and accurate.
  • Visually causing the user to experience a three-dimensional immersive experience the user still has a visual experience of watching a flat-panel TV or other two-dimensional applications, seriously affecting the user's intuitive visual experience. This reduces the user's viscosity of the three-dimensional immersive product to a certain extent.
  • the embodiments of the present invention provide a wraparound interface layout method, a content switching method and a list switching method in a three-dimensional immersive environment, which enable the user to find his own sense of presence, visually enhance the sense of space, and improve user stickiness.
  • the present invention provides a wraparound interface layout method, including:
  • the user's line of sight is obtained, and the display object located on the user's line of sight is clearly displayed to the user according to the direction of the user's line of sight.
  • the method further includes:
  • the display object is located on the line of sight of the user.
  • each display object is a curved object that can be attached to the surface of the three-dimensional space; or, each display The object is a flat object that is perpendicular to the user's line of sight.
  • the three-dimensional space is a user-centered cylindrical space
  • the plurality of display objects are arranged on a side of the cylindrical space by a 360-degree surrounding layout.
  • the three-dimensional space is a user-centered sphere space
  • the plurality of display objects are arranged on the surface of the sphere space by horizontal 360 degrees and vertical 360 degrees, and each display object is to the human eye. The distance is equal.
  • the beneficial effect of the wraparound interface layout method provided by the embodiment of the present invention is that the present invention adopts a user-centered wraparound layout in a stereoscopic space, and the number of display objects that can be laid out is more, and the scalability is strong;
  • the display object on the line of sight is clearly displayed to the user, effectively highlighting the main content in the interface; and enabling the user to find their own sense of presence and have a better user experience.
  • the distance of the display object to the human eye is corrected such that each display object is in a golden position of the line of sight, avoiding a poor display effect that is near and far, providing a more comfortable viewing experience.
  • the present invention provides a content switching method in a three-dimensional immersive environment, including:
  • each content unit is arranged in a certain order, and only the current content unit is displayed within the user's line of sight, and other content units are not displayed;
  • the dynamic effect of the content unit switching is quickly displayed within the user's line of sight
  • Switching the current content unit to a content unit adjacent thereto according to the content switching instruction is displayed within a user's line of sight.
  • the displaying only the current content unit in the user's line of sight includes: dividing the current content unit into a plurality of rows and columns according to the user's needs, and storing one content object in each of the ranks; each content object in the current content unit is Arranged around the side of the cylinder, each content object is displayed as a surface that fits the side of the cylinder.
  • the dynamic effect of quickly displaying the content unit switching within the user's line of sight includes: after receiving the content switching instruction sent by the user, adjacent to the current content unit A portion of the content object of a content unit is rapidly rotated around the side of the cylinder to the user's line of sight for display along with a portion of the content object of the current content unit.
  • the content switching instruction is a gesture operation, including sliding the control area from right to left, left to right, top to bottom or bottom to top; or the content switching instruction is an operation on the handle button, including operation Left arrow key, right arrow key, down arrow key, or up arrow key.
  • the present invention fully utilizes the spatial characteristics in the three-dimensional immersive environment, and divides the content to be displayed into a plurality of content units, in the line of sight of the user. Only the current content unit is displayed, other content units are not displayed, effectively highlighting the main content, and visually enhancing The sense of space enhances the user's three-dimensional immersive experience, and simplifies the user's switching operation, overcoming the user's unclear operation when using the virtual reality headset, and the user can complete the content switching through a very simple small-scale action.
  • the current content unit is divided into a plurality of rows and columns, each of which stores a content object, each content object is arranged in a manner surrounding a cylindrical side, and each content object is displayed as a surface conformable to the side of the cylinder. Further effectively utilize the three-dimensional characteristics to enhance the spatial stereoscopic effect.
  • the present invention provides a method for switching a list in a three-dimensional immersive environment, including:
  • the dynamic effect of the list switching is quickly displayed within the user's line of sight
  • the current list is switched to a list adjacent to it, and the other list is displayed after the current list after switching.
  • the current list is displayed at the front end of the user's line of sight, and the other lists are displayed after the current list is displayed: displaying each list in a different row, wherein the current list is placed in the middle row, and the list of each row is displayed as a pasteable The plane or surface of the side of the cylinder.
  • the dynamic effect of quickly displaying the list switching within the user's line of sight includes: after receiving the list switching instruction sent by the user, surrounding the column adjacent to the current list Quickly rotate to the front of the user's line of sight and display with the current list.
  • the list switching instruction is a gesture operation, including sliding the manipulation area from top to bottom or from bottom to top; or the list switching instruction is an operation on a handle button, including operating a down direction key or an up direction key.
  • the method further includes: loading only the current list of applications in the system background.
  • the beneficial effect of the list switching method in the three-dimensional immersive environment is that the present invention fully utilizes the spatial characteristics in the three-dimensional immersive environment, and displays a certain number of lists in the form of a surrounding cylindrical side in the user's line of sight.
  • the current list is displayed at the front end of the user's line of sight, and other lists are displayed after the current list, effectively highlighting the main content, visually enhancing the sense of space, enhancing the user's three-dimensional immersive experience, and simplifying the user's
  • the switching operation overcomes the problem that the user is unclear when using the virtual reality wearing device, and the user can complete the list switching through a very simple small-scale action, enjoying a smooth and accurate list switching experience; receiving the list issued by the user After switching the command, the user's spatial awareness and spatial experience are further enhanced by quickly displaying the dynamic effect of the list switching within the user's line of sight.
  • only the application data of the current list is loaded in the background of the system, and the application of the other list is not loaded, which can effectively reduce the utilization of resources and reduce the load of the device.
  • FIG. 1 is a specific flowchart of a method for layout of a wraparound interface according to an embodiment of the present invention
  • FIG. 2 is a specific flowchart of a wraparound interface layout method according to a preferred embodiment of the present invention
  • FIG. 3 is a schematic diagram of a three-dimensional effect of a 360-degree surround layout manner according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram of a three-dimensional effect of an omnidirectional surround layout manner according to an embodiment of the present invention.
  • FIG. 5 is a specific flowchart of a content switching method in a three-dimensional immersive environment according to an embodiment of the present invention
  • FIG. 6 is a schematic diagram of an arrangement manner of content objects in a content switching method in a three-dimensional immersive environment according to an embodiment of the present invention, wherein FIG. 6( a ) is an arrangement of two rows and five columns, and FIG. 6( b ) is three rows. The arrangement of the five columns, Figure 6 (c) is the arrangement of four rows and five columns;
  • FIG. 7( a ) is a schematic diagram of a dynamic effect of a left-to-right switching of a content unit in a content switching method in a three-dimensional immersive environment according to an embodiment of the present invention
  • FIG. 7(b) is a schematic diagram showing a dynamic effect of switching a content unit up and down in a content switching method in a three-dimensional immersive environment according to an embodiment of the present invention
  • FIG. 8 is a specific flowchart of a method for switching a list in a three-dimensional immersive environment according to an embodiment of the present invention
  • FIG. 9 is a schematic diagram of a list arrangement manner in a list switching method in a three-dimensional immersive environment according to an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of a dynamic effect of list switching in a list switching method in a three-dimensional immersive environment according to an embodiment of the present invention.
  • FIG. 11 is a schematic diagram of an arrangement sequence after list switching in a list switching method in a three-dimensional immersive environment according to an embodiment of the present invention.
  • FIG. 1 is a specific flowchart of a method for layout a wraparound interface according to an embodiment of the present invention. As shown in FIG. 1 , the wraparound interface layout method provided by the present invention includes:
  • Step S110 dividing the entire interface into a plurality of display objects, and arranging the display objects in a stereo space.
  • Step S120 Acquire a line of sight of the user, and clearly display the display object located on the line of sight of the user to the user according to the direction of the line of sight of the user.
  • the layout is performed in a three-dimensional space, and each display object is arranged around the user, and is diverged outwardly with the user as the center.
  • the direction of the line of sight changes, according to the user's line of sight.
  • the orientation will be clearly displayed to the user on the display object located on the user's line of sight.
  • the display object located on the user's line of sight can be enlarged, or the other display objects in the user's field of view can be blurred, so that the display object located on the user's line of sight is clearly displayed to the user, effectively highlighting the main content in the interface.
  • Layout in the three-dimensional space the number of display objects that can be laid out is more, and the scalability is stronger; the user-centric wrap-around layout enables users to find their own sense of presence and have a better user experience.
  • FIG. 2 is a specific flowchart of a wraparound interface layout method according to a preferred embodiment of the present invention. As shown in FIG. 2, based on the steps of FIG. 1, the preferred embodiment further includes:
  • Step S210 establishing a coordinate system in the three-dimensional space in which the interface layout is performed, and setting a three-dimensional space coordinate range for each display object.
  • Each point on a display object corresponds to a three-dimensional coordinate in the three-dimensional space, and the set of three-dimensional coordinates of all points is the three-dimensional coordinate range of the display object.
  • Step S220 Layout each display object in the three-dimensional space according to the three-dimensional space coordinate range of each display object, so that the position of each point on the display object corresponds to its three-dimensional space coordinates.
  • Step S230 Determine whether a three-dimensional space coordinate on a display object is on the line of sight of the user. If the three-dimensional coordinate of a point on the display object is on the line of sight of the user, step S240 is performed; otherwise, step S250 is performed.
  • Step S240 The display object is clearly displayed to the user.
  • Step S250 The display object is not clearly displayed to the user.
  • each display object has its own three-dimensional spatial coordinate range. By calculating the current line of sight of the user, it is determined whether the three-dimensional coordinate of a certain point on the display object is on the line of sight of the user on the line of sight of the user. If yes, the display object can be considered to be located on the user's line of sight, and then the display object is clearly displayed to the user.
  • FIG. 3 is a schematic diagram of a three-dimensional effect of a 360-degree surround layout manner according to an embodiment of the present invention.
  • the layout of the interface is performed in a cylindrical space.
  • the cylindrical space is centered on the user, and each display object is arranged at a certain position on the side of the cylindrical space. All the display objects are horizontally arranged 360 degrees around the user.
  • the user's line of sight rotates left and right, the corresponding display objects on the side of the cylindrical space can be seen.
  • the distance between each display object and the human eye is substantially equal, and the visually flat and small layout is not visually large and small.
  • the effect by adjusting the distance of the display object to the user, can make each display object in the golden position of the user's eyeglasses, and the viewing effect is better.
  • FIG. 4 is a schematic diagram of a three-dimensional effect of the omnidirectional surround layout mode according to an embodiment of the present invention.
  • the layout of the interface is performed in a sphere space, the sphere space is user-centered, and each display object is arranged at a certain position on the surface of the cylinder space, and all display objects are user-centered horizontal 360 and vertical 360 degrees.
  • Surround layout since the user is at the center of the sphere space, the distance from any point on the surface of the sphere space to the user is equal, and the visually flattened layout does not result in a visually large and small distance. The problem of adjusting this distance to the right size allows the user to experience a more comfortable viewing experience.
  • each display object arranged in the stereoscopic space it may be a planar object or a curved object.
  • the display object can be designed as a curved object that fits the surface of the layout space, for example, the cylindrical space or the spherical space can be matched, and the layout objects can be dispersed or spliced to Together as a whole covers the entire layout space surface.
  • the display object is a flat object
  • the display object can be set to be perpendicular to the user's line of sight, so that the user can view the angle better.
  • these flat display objects can also be arranged in a distributed manner or stitched together to surround the surface of the layout space as a whole. The user turns the body or head to change the line of sight, and the display object located on the user's line of sight is clearly displayed to the user according to the direction of the user's line of sight.
  • the wraparound interface layout method provided by the present invention can be widely applied to various computers, mobile terminals, virtual reality devices, and the like.
  • the virtual reality device can monitor the rotation of the user's head. When the user's head rotates, the direction of the line of sight changes.
  • the virtual reality device uses gravity sensing and a gyroscope to determine the direction of the user's line of sight and will be located.
  • the display object on the user's line of sight is clearly displayed to the user, and the operation is simple and the immersion is strong.
  • the wraparound interface layout method provided by the present invention has the following beneficial effects:
  • the application in the three-dimensional immersive environment is taken as an example to describe the interaction mode of the content switching and the interaction mode of the list switching in the wraparound interface layout.
  • FIG. 5 is a specific flowchart of a content switching method in a three-dimensional immersive environment according to an embodiment of the present invention. As shown in FIG. 5, the content switching method in the three-dimensional immersive environment provided by the present invention includes:
  • Step S510 Separating the content to be displayed into a plurality of content units, and each content unit is arranged in a certain order. Each content unit contains a portion of the content that needs to be displayed.
  • Step S520 only the current content unit is displayed within the user's line of sight, and other content units are not displayed. Only the content of one content unit is displayed within the user's line of sight as the current content unit. When users need to watch other content, they need to switch between content units.
  • Step S530 After receiving the content switching instruction sent by the user, quickly display the dynamic effect of the content unit switching within the user's line of sight. Specifically, a portion of the content object of a content unit adjacent to the current content unit is quickly rotated around the side of the cylinder to be displayed within the user's line of sight along with a portion of the content object of the current content unit to enhance the user's spatial awareness and spatial experience.
  • Step S540 Switch the current content unit to a content unit adjacent thereto according to the content switching instruction, and display the content unit within the user's line of sight.
  • the arrangement and the current content unit are switched to the user's line of sight as the new content unit, and the original content unit is no longer displayed.
  • FIG. 6 is a schematic diagram of an arrangement manner of content objects in a content switching method in a three-dimensional immersive environment according to an embodiment of the present invention; wherein FIG. 6( a ) is an arrangement of two rows and five columns; FIG. 6( b ) is three rows. The arrangement of the five columns; Figure 6 (c) shows the arrangement of four rows and five columns.
  • the current content unit can be divided into a plurality of rows and columns according to user needs, and each row is stored.
  • a content object for example, can be arranged in two rows, five columns, three rows and five columns, and four rows and five columns.
  • the content objects in all current content units are arranged in the form of a side of the surrounding cylinder, which is the most straight line of the user's line of sight.
  • each content object is displayed as a surface that fits the side of the cylinder, thereby fully utilizing the spatial characteristics of the three-dimensional scene, enhancing the user's spatial awareness and spatial experience.
  • FIG. 7( a ) is a schematic diagram showing a dynamic effect of a left-right switching of a content unit in a content switching method in a three-dimensional immersive environment according to an embodiment of the present invention
  • FIG. 7( b ) is a three-dimensional immersive environment according to an embodiment of the present invention
  • FIG. 7(a) and FIG. 7(b) after receiving the content switching instruction issued by the user, a part of the content object of a content unit adjacent to the current content unit is quickly rotated around the side of the cylinder to the user's line of sight. Displayed together with a portion of the content object of the current content unit.
  • the switching mode may be switching between left and right of the content unit, as shown in FIG. 7(a); or switching between upper and lower of the content unit, as shown in 7(a).
  • the user can issue a content switching instruction by a gesture operation, including sliding the control area from right to left, left to right, top to bottom, or bottom to top; or, by operating the handle button, switching the content.
  • a gesture operation including sliding the control area from right to left, left to right, top to bottom, or bottom to top; or, by operating the handle button, switching the content.
  • Commands including operating the left arrow key, right arrow key, down arrow key, or up arrow key.
  • the switching effect and the corresponding gesture can be arbitrarily set according to needs, such as setting to switch left and right, then when the user slides the control area from left to right or from top to bottom, and current
  • the previous content unit adjacent to the content unit switches to the user's line of sight range content as a new current content unit; when the user slides the manipulation area from right to left or from bottom to top, the next content unit adjacent to the current content unit switches The content to the user's line of sight as the new current content unit.
  • the user can enjoy a smooth and accurate content switching experience through a very simple and small action.
  • the content switching method in the three-dimensional immersive environment provided by the present invention has the following beneficial effects:
  • the current content unit is divided into a plurality of rows and columns, each of which stores a content object, each content object is arranged in the form of a surrounding cylindrical side, and each content object is displayed as a surface that can fit the side of the cylinder, and is further effectively utilized.
  • Three-dimensional space features enhance spatial stereoscopic effects.
  • FIG. 8 is a specific flowchart of a method for switching a list in a three-dimensional immersive environment according to an embodiment of the present invention. As shown in FIG. 8, the method for switching a list in a three-dimensional immersive environment provided by the present invention includes:
  • Step S810 Display a certain number of lists in the form of a surrounding cylindrical side within the user's line of sight, and place the current list at the forefront of the user's line of sight, and the other lists are displayed after the current list.
  • the current list is placed at the front end of the user's line of sight, and other lists are displayed after the current list, effectively highlighting the main content.
  • the current list is displayed within the scope of the user's implementation. This current list may be the default list when the user first enters an application, or may be a list selected by the user.
  • the current list is placed at the forefront of the user's line of sight, the user feels that the current list is closest to himself, and the list adjacent to the current list is placed at a position farther away from the user's line of sight, and the farther away from the current list in the order of arrangement The list is also visually farther away from the user.
  • Step S820 After receiving the list switching instruction sent by the user, quickly display the dynamic effect of the list switching within the user's line of sight. Specifically, after receiving the list switching instruction issued by the user, a list adjacent to the current list is quickly rotated around the side of the cylinder to the front end of the user's line of sight and displayed together with the current list, which can enhance the user's space awareness and spatial experience.
  • Step S830 The current list is switched to a list adjacent to it according to the list switching instruction, and the other list is displayed after the current list after the switching. Specifically, each list is displayed in a different row, where The list is placed in the middle row, and the list of rows is displayed as a plane or surface that fits the side of the cylinder. Therefore, the spatial characteristics in the three-dimensional immersive environment can be fully utilized, and a certain number of lists are displayed in the form of a surrounding cylindrical side in the user's line of sight, thereby visually enhancing the sense of space and enhancing the user's three-dimensional immersive experience.
  • the dynamic effect of the current list being replaced by other lists is displayed in the user's line of sight.
  • the current list is gradually away from the user, and a certain list selected by the user gradually approaches the user until the front of the user's line of sight. , become the new current list.
  • the user can browse the contents of the current list more comfortably, effectively highlighting the main content, and the visual effect is obvious, thereby guiding the user's operation behavior more effectively.
  • FIG. 9 is a schematic diagram of a list arrangement manner in a list switching method in a three-dimensional immersive environment according to an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of a dynamic effect of list switching in a list switching method in a three-dimensional immersive environment according to an embodiment of the present invention.
  • FIG. 11 is a schematic diagram of an arrangement sequence after list switching dynamics in a three-dimensional immersive environment list switching method according to an embodiment of the present invention.
  • the current list and other lists in step S810 may adopt the following arrangement: display each list in a different row, wherein the current list is placed in the middle row; each row The list is arranged in the form of a side around the cylinder.
  • the cylinder is placed horizontally in front of the user, the side is facing the user, the current list is placed at the front of the user's line of sight, the user feels closest to himself, and the other list positions are slightly rearward. For example, only the three-row list is displayed in FIG. 9, and the current list is displayed in the middle row.
  • the two lists adjacent to the current list are respectively placed at positions slightly above and below the current list, and the current list is visually highlighted. Increased sense of space.
  • the dynamic effect of the rotation of the sides of the list around the cylinder is presented to the user. For example, when the list is switched from bottom to top, it may be the dynamic effect shown in FIG. 10, and an adjacent list below the current list rapidly rotates around the side of the cylinder to the user.
  • the front end of the line of sight is displayed together with the current list, and then the new current list is displayed at the forefront of the user's line of sight.
  • the list of the original middle row is rotated to the top of the cylindrical side, and the list in the first line gradually disappears in the user's line of sight.
  • the third line displays a list adjacent to the new current list, visually rendering a three-dimensional effect. For example, if there are only three rows of lists, the order of the list in FIG. 9 after switching is as shown in FIG. Visually enhances the sense of space and enhances the user's 3D immersive experience.
  • the number of lists displayed to the user at the same time is reduced, the entire interface is cleaner, and the use of display resources is reduced. Although only a limited number of lists are displayed, the total number of lists can be expanded indefinitely and can be set as needed.
  • the list switching instruction in step S820 may be issued by the user through a gesture operation, including sliding the control area from top to bottom or from bottom to top, and may be a gesture in a space in which the gesture recognition device is disposed. It is also possible to slide the finger up and down on a touch-enabled surface, the upper and lower directions need not be precise upper and lower, and the upper left and upper right are regarded as upper.
  • the user can also operate the handle button to issue a list switching instruction, such as operating a down arrow key or an up arrow key. Users can enjoy a smooth and accurate list switching experience with very simple and small movements.
  • the user can be set to issue a list switching instruction to complete the cutting of the current list and the adjacent list. For example, if the user slides the control area from bottom to top, a list below the current list switches to the forefront of the user's line of sight, which makes the operation more flexible, and the user does not have to accurately select the desired list, as long as the list is switched one by one in order. It is possible to accurately perform the switching operation to find the required list, and overcome the problem that the user is unclear when using the virtual reality wearing device, thereby guiding the user's operation behavior more effectively. This allows the user to perform precise operations without having to perform precise operations.
  • the system background only loads the application of the current list.
  • the user needs to manipulate the content displayed in the list, such as the list as a program entry, the user enters an application by clicking on the list.
  • all displayed lists will load the application data in the background, but Users will not use all the application data, which will cause the background data to be loaded too much, waste cache resources and network resources, and increase the load on the device.
  • the system only loads the application of the current list in the background, and only provides the display function for other displayed lists, and can display various image characters normally. Wait for the data, but the user cannot perform other operations on the non-current list.
  • the three-dimensional immersive environment list switching method provided by the invention provides a simpler and more convenient interactive experience, which allows the user to better perform the three-dimensional immersive experience, optimizes and simplifies the user's limb operation, and increases its immersion in three dimensions. Spatial awareness in the application.
  • the method for switching a list in a three-dimensional immersive environment provided by the present invention has the following beneficial effects:

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种环绕式界面布局方法，采用在立体空间中以用户为中心环绕式布局的方式，可布局的显示对象数量更多，可扩展性强；将位于用户视线上的显示对象清晰地显示给用户，有效突出了界面中的主要内容；并且能够让用户找到自身的存在感，有更好的用户体验，并且校正了显示对象到人眼的距离，避免了近大远小的不良显示效果，提供了更舒适的观看体验。一种三维沉浸式环境下内容切换方法和列表切换方法，充分地利用了三维沉浸式环境下的空间特性，在用户视线范围内仅显示当前内容单元或当前列表，有效地突出了要显示的内容，在视觉上增强了空间感，强化了用户的三维沉浸式体验，并可简化用户的切换操作，用户通过非常简单的小幅度的动作就能完成内容或列表切换，享受到流畅精准的切换体验。

Description

一种环绕式界面布局方法、三维沉浸式环境下内容切换方法和列表切换方法 技术领域
本发明涉及界面布局设计技术领域，特别涉及一种环绕式界面布局方法、三维沉浸式环境下内容切换方法和列表切换方法。
发明背景
目前各种计算机、移动终端以及虚拟现实设备等的显示界面都处于平面平铺式布局，布局对象数量有限，只能通过滑动屏幕更换内容，界面功能扩展性不强，同时这种界面布局无法让用户找到自身存在感。当在一个较大的显示设备上布局若干对象时，在用户的视觉上，距离近的对象较大，距离远的对象较小，观看效果不好。显然这种平面平铺式布局用户交互体验也不好。
以三维沉浸式环境下的应用为例，目前无论内容切换的交互方式或者列表切换的交互方式，基本上还保留着二维模式的手势操作及视觉切换方式，例如使用者采用由左至右或由右至左手势操作，界面平铺由左至右或由右至左推出或消失。但在沉浸式体验过程中，这种方式在操作上，使用者在三维场景中手部操作幅度过大，还要分辨物理触屏操作的方向是否正确且精准。在视觉上导致使用者对于三维沉浸式的体验效果变差，令使用者依然有看平板电视或其它二维应用的视觉体验，严重影响用户的直观视觉感受。这就在一定程度上降低了三维沉浸式产品的用户黏度。
发明内容
有鉴于此，本发明实施例提供了一种环绕式界面布局方法、三维沉浸式环境下内容切换方法和列表切换方法，能够让用户找到自身存在感，在视觉上增强空间感，提高用户黏度。
依据本发明的一个方面，本发明提供了一种环绕式界面布局方法，包括：
将整个界面分割成若干个显示对象，在立体空间中环绕布局所述若干个显示对象；
获取用户视线，根据用户视线的方向将位于用户视线上的显示对象清晰地展示给用户。
其中，所述方法还包括：
为每一个显示对象设置三维空间坐标范围；
根据所述三维空间坐标范围将每一个显示对象布局在立体空间中；
若一个显示对象上某一点的三维空间坐标在用户的视线上，则判断该显示对象位于用户视线上。
其中，每一个显示对象是能够与所述立体空间的表面贴合的曲面对象；或者，每一个显 示对象是垂直于用户视线的平面对象。
其中，所述立体空间为以用户为中心的圆柱体空间，所述若干个显示对象采用360度环绕布局在所述圆柱体空间的侧面上。
其中，所述立体空间为以用户为中心的球体空间，所述若干个显示对象采用水平360度与垂直360度全方位环绕布局在所述球体空间的表面上，每一个显示对象到人眼的距离相等。
本发明实施例提供的环绕式界面布局方法的有益效果是：本发明采用在立体空间中以用户为中心环绕式布局的方式，可布局的显示对象数量更多，可扩展性强；将位于用户视线上的显示对象清晰地展示给用户，有效地突出了界面中的主要内容；并且能够让用户找到自身的存在感，有更好的用户体验。在优选实施例中，校正了显示对象到人眼的距离，使每一个显示对象都处在视线的黄金位置，避免了近大远小的不良显示效果，提供了更舒适的观看体验。
依据本发明的另一个方面，本发明提供了一种三维沉浸式环境下内容切换方法，包括：
将需要展示的内容分隔成若干个内容单元，各内容单元按一定顺序排列，在用户视线范围内仅显示当前内容单元，其他内容单元不显示；
接收到用户发出的内容切换指令后，在用户视线范围内快速展示内容单元切换的动态效果；
根据所述内容切换指令将所述当前内容单元切换为一个与其相邻的内容单元显示在用户视线范围内。
其中，所述在用户视线范围内仅显示当前内容单元包括：根据用户需要，将当前内容单元分成若干行和列，每个行列中存储一个内容对象；所述当前内容单元中的各内容对象以环绕圆柱侧面形式排列，每一个内容对象显示为可贴合所述圆柱侧面的曲面。
其中，所述接收到用户发出的内容切换指令后，在使用者视线范围内快速展示内容单元切换的动态效果包括：接收到用户发出的内容切换指令后，将与所述当前内容单元相邻的一个内容单元的一部分内容对象环绕圆柱侧面快速转动到用户视线范围内与所述当前内容单元的一部分内容对象一起显示。
其中，所述内容切换指令为手势操作，包括由右至左、由左至右、由上至下或由下至上滑动操控区；或者，所述内容切换指令为对手柄按键的操作，包括操作向左方向键、向右方向键、向下方向键或向上方向键。
本发明实施例提供的三维沉浸式环境下内容切换方法的有益效果是：本发明充分地利用了三维沉浸式环境下的空间特性，将需要展示的内容分隔成若干个内容单元，在用户视线范围内仅显示当前内容单元，其他内容单元不显示，有效地突出了主要内容，在视觉上增强了 空间感，强化了用户的三维沉浸式体验，并可简化用户的切换操作，克服用户在使用虚拟现实头戴设备时操作不明确的问题，用户通过非常简单的小幅度的动作就能完成内容切换，享受到流畅精准的内容切换体验；在接收到用户发出的内容切换指令后，通过在用户视线范围内快速展示内容单元切换的动态效果，进一步增强用户的空间意识和空间感受。优选实施例中，将当前内容单元分成若干行和列，每个行列中存储一个内容对象，各内容对象以环绕圆柱侧面形式排列，每一个内容对象显示为可贴合所述圆柱侧面的曲面，进一步有效利用三维空间特性，增强空间立体视觉效果。
依据本发明的再一个方面，本发明提供了一种三维沉浸式环境下列表切换方法，包括：
在用户视线范围内以环绕圆柱侧面形式显示一定数量的列表，且将当前列表置于用户视线最前端显示，其它列表置于当前列表之后显示；
接收到用户发出的列表切换指令后，在用户视线范围内快速展示列表切换的动态效果；
根据所述列表切换指令将当前列表切换为一个与其相邻的列表置于最前端显示，其它列表置于切换后的当前列表之后显示。
其中，所述将当前列表置于用户视线最前端显示，其它列表置于当前列表之后显示包括：将每个列表显示在不同的行，其中当前列表置于中间一行，各行的列表显示为可贴合圆柱侧面的平面或曲面。
其中，所述接收到用户发出的列表切换指令后，在用户视线范围内快速展示列表切换的动态效果包括：接收到用户发出的列表切换指令后，将与当前列表相邻的一个列表环绕圆柱侧面快速转动到用户视线最前端与所述当前列表一起显示。
其中，所述列表切换指令为手势操作，包括由上至下或由下至上滑动操控区；或者，所述列表切换指令为对手柄按键的操作，包括操作向下方向键或向上方向键。
其中，所述方法还包括：在***后台仅加载当前列表的应用程序。
本发明实施例提供的三维沉浸式环境下列表切换方法的有益效果是：本发明充分地利用了三维沉浸式环境下的空间特性，在用户视线范围内以环绕圆柱侧面形式显示一定数量的列表，且将当前列表置于用户视线最前端显示，其它列表置于当前列表之后显示，有效地突出了主要内容，在视觉上增强了空间感，强化了用户的三维沉浸式体验，并可简化用户的切换操作，克服用户在使用虚拟现实头戴设备时操作不明确的问题，用户通过非常简单的小幅度的动作就能完成列表切换，享受到流畅精准的列表切换体验；在接收到用户发出的列表切换指令后，通过在用户视线范围内快速展示列表切换的动态效果，进一步增强用户的空间意识和空间感受。在优选实施例中，在***后台仅加载当前列表的应用程序数据，不加载其他列表的应用程序，可以有效降低资源的利用率，降低设备的负荷。
附图简要说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其它的附图。
图1为本发明实施例提供的一种环绕式界面布局方法的具体流程图；
图2为本发明一优选实施例提供的一种环绕式界面布局方法的具体流程图；
图3为本发明实施例提供的360度环绕布局方式的立体效果示意图；
图4为本发明实施例提供的全方位环绕布局方式的立体效果示意图；
图5为本发明实施例提供的一种三维沉浸式环境下内容切换方法的具体流程图；
图6为本发明实施例提供的一种三维沉浸式环境下内容切换方法中内容对象的排列方式示意图，其中图6(a)为两行五列的排列方式，图6(b)为三行五列的排列方式，图6(c)为四行五列的排列方式；
图7(a)为本发明实施例提供的一种三维沉浸式环境下内容切换方法中内容单元左右切换的动态效果示意图；
图7(b)为本发明实施例提供的一种三维沉浸式环境下内容切换方法中内容单元上下切换的动态效果示意图；
图8为本发明实施例提供的一种三维沉浸式环境下列表切换方法的具体流程图；
图9为本发明实施例提供的一种三维沉浸式环境下列表切换方法中列表排列方式示意图；
图10为本发明实施例提供的一种三维沉浸式环境下列表切换方法中列表切换动态效果示意图；
图11为本发明实施例提供的一种三维沉浸式环境下列表切换方法中列表切换之后排列顺序示意图。
具体实施方式
为使本发明的目的、技术方案和优点更加清楚，下面将结合附图对本发明实施方式作进一步地详细描述。
应当明确，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其它实施例，都属于本发明保护的范围。
图1为本发明实施例提供的一种环绕式界面布局方法的具体流程图。如图1所示，为本发明提供的环绕式界面布局方法包括：
步骤S110：将整个界面分割成若干个显示对象，在立体空间中环绕布局这些显示对象。
步骤S120：获取用户视线，根据用户视线的方向将位于用户视线上的显示对象清晰地展示给用户。
本实施例中，在立体空间中进行布局，将各显示对象环绕布置在用户周围，以用户为中心向外发散，当用户身体或头部转动时，视线的方向会发生改变，根据用户的视线方向将在位于用户视线上的显示对象清晰地展示给用户。可以将位于用户视线上的显示对象放大，或者对用户视野中的其他的显示对象做模糊处理，从而将位于用户视线上的显示对象清晰地展示给用户，有效地突出了界面中的主要内容。在立体空间中布局，使可布局的显示对象的数量更多，可扩展性更强；采用以用户为中心环绕式布局的方式能够让用户找到自身的存在感，有更好的用户体验。
图2为本发明一优选实施例提供的一种环绕式界面布局方法的具体流程图。如图2所示，在图1步骤的基础上，该优选实施例还包括：
步骤S210：在进行界面布局的立体空间中建立坐标系，为每一个显示对象设置三维空间坐标范围。一个显示对象上的每一点都对应一个在这个立体空间中的三维空间坐标，所有点的三维空间坐标的集合就是该显示对象的三维空间坐标范围。
步骤S220：根据每一个显示对象的三维空间坐标范围将每一个显示对象布局在立体空间中，使显示对象上的每一点的位置与其三维空间坐标相对应。
步骤S230：判断一个显示对象上是否有一点的三维空间坐标在用户的视线上。若该显示对象上某一点的三维空间坐标在用户的视线上，则执行步骤S240；否则执行步骤S250。
步骤S240：将该显示对象清晰地展示给用户。
步骤S250：不将该显示对象清晰地展示给用户。
在本优选实施例中，每一个显示对象都有自己的三维空间坐标范围，通过计算用户当前的视线，判断在用户的视线上，该显示对象上是否某一点的三维空间坐标在用户的视线上，若是则可以认为该显示对象位于用户视线上，然后将该显示对象清晰地展示给用户。
在本发明的一个优选实施例中，如图3所示，图3为本发明实施例提供的360度环绕布局方式的立体效果示意图。在一个圆柱体空间内进行界面布局，这个圆柱体空间以用户为中心，每一个显示对象布置在这个圆柱体空间的侧面上的某一个位置，所有显示对象以用户为中心水平360度环绕布局。用户视线左右转动时能看到位于圆柱体空间侧面上的相应的显示对象，每一个显示对象到人眼的距离基本相等，不会产生平面平铺式布局中视觉上近大远小 的效果，通过调整显示对象到用户的距离，可以使每一个显示对象处于用户眼镜视线的黄金位置，观看效果更好。
在本发明的另一个优选实施例中，如图4所示，图4为本发明实施例提供的全方位环绕布局方式的立体效果示意图。在一个球体空间内进行界面布局，这个球体空间以用户为中心，每一个显示对象布置在这个圆柱体空间表面上的某一个位置，所有显示对象以用户为中心水平360和垂直360度全方位度环绕布局。在这一优选实施例中，由于用户处于这个球体空间的中心位置，所以球体空间表面上任意一点到用户的距离都是相等的，同样不会产生平面平铺式布局中视觉上近大远小的问题，将这一距离调整到合适的大小，可以使用户体验到更舒适的观看效果。
对于在立体空间中布置的每一个显示对象，可以是平面对象或曲面对象。显示对象是曲面对象时，可以将这些显示对象设计成与布局空间的表面贴合的曲面对象，例如可以贴合上述的圆柱形空间或球形空间等，各布局对象可以分散布置，也可以拼接到一起作为一个整体覆盖整个布局空间的表面。显示对象是平面对象时，可以将显示对象设置成与用户视线垂直，这样用户观看的角度更好。同样，这些平面显示对象也可以分散布置，或是拼接到一起，作为一个整体环绕布局空间的表面。用户转动身体或头部改变视线，根据用户视线的方向将位于用户视线上的显示对象清晰地展示给用户。
本发明提供的环绕式界面布局方法可广泛应用与各种计算机、移动终端以及虚拟现实设备等。例如应用于虚拟现实设备，虚拟现实设备可以监测用户头部的转动，当用户的头部转动时视线的方向会发生改变，虚拟现实设备利用重力感应和陀螺仪等判断用户的视线方向并将位于用户视线上的显示对象清晰地展示给用户，操作简便，沉浸感强。
与现有技术相比，本发明提供的一种环绕式界面布局方法具有以下有益效果：
1、采用在立体空间中以用户为中心环绕式布局的方式，可布局的显示对象数量更多，可扩展性强；将位于用户视线上的显示对象清晰地展示给用户，有效地突出了界面中的主要内容；并且能够让用户找到自身的存在感，有更好的用户体验。
2、校正了显示对象到人眼的距离，使每一个显示对象都处在视线的黄金位置，避免了近大远小的不良显示效果，提供了更舒适的观看体验。
下面以三维沉浸式环境下的应用为例，对环绕式界面布局下的内容切换的交互方式和列表切换的交互方式分别进行详细说明。
图5为本发明实施例提供的一种三维沉浸式环境下内容切换方法的具体流程图。如图5所示，本发明提供的三维沉浸式环境下内容切换方法包括：
步骤S510：将需要展示的内容分隔成若干个内容单元，各内容单元按一定顺序排列。每个内容单元中包含需要展示内容的一部分。
步骤S520：在用户视线范围内仅显示当前内容单元，其他内容单元不显示。只将一个内容单元的内容显示在用户的视线范围内，作为当前内容单元。用户需要观看其他内容时，需要进行内容单元之间的切换。
步骤S530：接收到用户发出的内容切换指令后，在用户视线范围内快速展示内容单元切换的动态效果。具体地，将与当前内容单元相邻的一个内容单元的一部分内容对象环绕圆柱侧面快速转动到用户视线范围内与当前内容单元的一部分内容对象一起显示，以增强用户的空间意识和空间感受。
步骤S540：根据内容切换指令将当前内容单元切换为一个与其相邻的内容单元在用户视线范围内显示。当用户需要观看其他内容时，根据其发出的内容切换指令，将排列上与当前内容单元切换到用户视线范围内，作为新的内容单元，原来的内容单元不再显示。
图6为本发明实施例提供的一种三维沉浸式环境下内容切换方法中内容对象的排列方式示意图；其中图6(a)为两行五列的排列方式；图6(b)为三行五列的排列方式；图6(c)为四行五列的排列方式。如图6(a)、图6(b)、图6(c)所示，在本发明的优选实施例中，可以根据用户需要，将当前内容单元分成若干行和列，每个行列中存储一个内容对象，例如可以采用两行五列、三行五列和四行五列等形式进行排列，所有当前内容单元中的内容对象以环绕圆柱侧面的形式排列，这个圆柱直立于用户视线的最前方，每一个内容对象显示为可贴合圆柱侧面的曲面，从而充分地利用了三维场景的空间特性，增强用户的空间意识和空间感受。
图7(a)为本发明实施例提供的一种三维沉浸式环境下内容切换方法中内容单元左右切换的动态效果示意图；图7(b)为本发明实施例提供的一种三维沉浸式环境下内容切换方法中内容单元上下切换的动态效果示意图。如图7(a)、图7(b)所示，当接收到用户发出的内容切换指令后，将与当前内容单元相邻的一个内容单元的一部分内容对象环绕圆柱侧面快速转动到用户视线范围内与当前内容单元的一部分内容对象一起显示。切换方式可以是内容单元的左右之间的切换，如图7(a)所示；也可以是内容单元的上下之间的切换，如7(a)所示。
在优选实施例中，用户可以通过手势操作发出内容切换指令，包括由右至左、由左至右、由上至下或由下至上滑动操控区；或者，也可以通过操作手柄按键发出内容切换指令，包括操作向左方向键、向右方向键、向下方向键或向上方向键。切换效果与对应的手势可以根据需要任意设定，如设置成左右切换，那么当用户由左至右或由上至下滑动操控区时，与当前 内容单元相邻的前一个内容单元切换到用户视线范围内容，作为新的当前内容单元；当用户由右至左或由下至上滑动操控区时，与当前内容单元相邻的后一个内容单元切换到用户视线范围内容，作为新的当前内容单元。这样用户可以通过非常简单的小幅度的动作，就可以享受到流畅精准的内容切换体验。
与现有技术相比，本发明提供的一种三维沉浸式环境下内容切换方法具有以下有益效果：
1、充分地利用了三维沉浸式环境下的空间特性，将需要展示的内容分隔成若干个内容单元，在用户视线范围内仅显示当前内容单元，其他内容单元不显示，有效地突出了主要内容，在视觉上增强了空间感，强化了用户的三维沉浸式体验。
2、简化了用户的操作，克服了用户在使用虚拟现实头戴设备时操作不明确的问题，户通过非常简单的小幅度的动作就能完成内容单元切换，享受到流畅精准的内容切换体验，并且在接收到用户发出的内容切换指令后，通过在用户视线范围内快速展示内容单元切换的动态效果，进一步增强用户的空间意识和空间感受。
3、将当前内容单元分成若干行和列，每个行列中存储一个内容对象，各内容对象以环绕圆柱侧面形式排列，每一个内容对象显示为可贴合所述圆柱侧面的曲面，进一步有效利用三维空间特性，增强空间立体视觉效果。
图8为本发明实施例提供的一种三维沉浸式环境下列表切换方法的具体流程图。如图8所示，本发明提供的三维沉浸式环境下列表切换方法包括：
步骤S810：在用户视线范围内以环绕圆柱侧面形式显示一定数量的列表，且将当前列表置于用户视线最前端显示，其它列表置于当前列表之后显示。将当前列表置于用户视线最前端显示，其它列表置于当前列表之后显示，有效地突出了主要内容。首先在用户的实现范围内显示当前列表，这一当前列表可以是用户首次进入某一个应用时的默认列表，也可以是被用户选择的某一个列表。在视觉效果上，当前列表放置在用户视线的最前端，用户感觉当前列表距离自己最近，与当前列表相邻的列表放置在用户视线稍远的位置，在排列顺序上与当前列表距离越远的列表在视觉效果上也距离用户越远。
步骤S820：接收到用户发出的列表切换指令后，在用户视线范围内快速展示列表切换的动态效果。具体地，接收到用户发出的列表切换指令后，将与当前列表相邻的一个列表环绕圆柱侧面快速转动到用户视线最前端与当前列表一起显示，能够增强用户的空间意识和空间感受。
步骤S830：根据列表切换指令将当前列表切换为一个与其相邻的列表置于最前端显示，其它列表置于切换后的当前列表之后显示。具体地，将每个列表显示在不同的行，其中当前 列表置于中间一行，各行的列表显示为可贴合圆柱侧面的平面或曲面。从而可充分地利用了三维沉浸式环境下的空间特性，在用户视线范围内以环绕圆柱侧面形式显示一定数量的列表，视觉上增强了空间感，强化了用户的三维沉浸式体验。
用户通过某种形式发出列表切换指令后，在用户的视线范围内展示当前列表被其他列表代替的动态效果，当前列表逐渐远离用户，被用户选中的某一个列表逐渐接近用户直到用户视线的最前端，成为新的当前列表。用户可以更舒适地浏览当前列表的内容，有效地突出了主要内容，在视觉上效果明显，从而更优效的引导用户的操作行为。
图9为本发明实施例提供的一种三维沉浸式环境下列表切换方法中列表排列方式示意图。图10为本发明实施例提供的一种三维沉浸式环境下列表切换方法中列表切换动态效果示意图。图11为本发明实施例提供的一种三维沉浸式环境下列表切换方法中列表切换动态之后排列顺序示意图。如图9、图10、图11所示，作为优选方案，步骤S810中当前列表与其他列表可以采取以下的排列方式：将每个列表显示在不同的行，其中当前列表置于中间一行；各行列表以环绕圆柱侧面的形式排列，这一圆柱横置在用户实现正前方，侧面朝向用户，当前列表置于用户视线的最前端显示，用户感觉最靠近自己，其它列表位置稍微置后。例如图9示出的仅显示三行列表，中间一行显示当前列表，与当前列表相邻的两个列表分别放在当前列表的上下方稍微置后的位置上，在视觉上突出了当前列表，增强了空间感。进行切换时，呈现给用户各列表环绕圆柱侧面转动的动态效果，例如当列表由下至上切换时可以是图10示出的动态效果，当前列表下方的一个相邻列表环绕圆柱侧面快速转动到用户视线最前端与当前列表一起显示，而后成为新的当前列表在用户视线的最前端显示，原本中间一行的列表环绕圆柱侧面转动到上方，原本在第一行的列表则逐渐消失在用户的视线中，第三行则显示一个与新的当前列表相邻的一个列表，在视觉上完全呈现三维效果。例如若一共只有3行列表，图9中的列表切换之后排列顺序如图11所示。在视觉上增强了空间感，强化了用户的三维沉浸式体验。另外减少了同时展示给用户的列表数量，是整个界面更整洁，而且减少了对显示资源的利用。虽然仅显示有限数量的列表，但是列表的总数是可以无限扩展的，可以根据需要设定。
优选地，步骤S820中的列表切换指令可以是用户通过手势操作发出的，包括由上至下或由下至上滑动操控区，可以是在一个空间中做出手势，这个空间中设置有手势识别设备；也可以是在一个支持触控的表面上下滑动手指，上下方向不必是精确的上和下，左上、右上等都视为上方。另外用户也可以操作手柄按键发出列表切换指令，例如操作向下方向键或向上方向键等。用户通过非常简单的小幅度的动作，就可以享受到流畅精准的列表切换体验。
进一步地，可以设置为用户发出一个列表切换指令，完成一个当前列表与相邻列表的切 换，例如用户由下至上滑动一次操控区，在当前列表下方的一个列表切换到用户视线的最前方，这样在操作上更灵活，用户不必精准选定需要的列表，只要按顺序一个一个切换列表就能精准的进行切换操作找到需要的列表，克服了用户在使用虚拟现实头戴设备时操作不明确的问题，从而更优效的引导用户的操作行为。这样就使用户不必进行精准的操作，也能精准的进行切换操作。
在本发明的另一优选实施例中，***后台仅加载当前列表的应用程序。通常，用户需要操作列表中显示的内容，例如列表作为一个程序的入口，用户通过点击这个列表进入一个应用中，传统的列表显示切换方法中，所有显示的列表都会在后台加载应用程序数据，但是用户不会用到所有的应用程序数据，这样就会导致后台数据加载量过大，浪费缓存资源和网络资源，增加设备的负荷。为有效降低资源的利用率，降低设备的负荷，在本优选实施例中，***后台仅加载当前列表的应用程序，对于其他显示的列表，仅提供显示的功能，可以正常的显示各种图像文字等数据，但是用户不可以对非当前列表进行其他操作。
本发明提供的三维沉浸式环境下列表切换方法提供了一种更简单便捷的交互体验，可以让用户更好的进行三维沉浸式体验，优化并简化了用户的肢体操作，增加了其在三维沉浸式应用中的空间意识。
与现有技术相比，本发明提供的一种三维沉浸式环境下列表切换方法具有以下有益效果：
1、充分地利用了三维沉浸式环境下的空间特性，在用户视线范围内以环绕圆柱侧面形式显示一定数量的列表，且将当前列表置于用户视线最前端显示，其它列表置于当前列表之后显示，有效地突出了主要内容，在视觉上增强了空间感，强化了用户的三维沉浸式体验。
2、简化了用户的操作，克服了用户在使用虚拟现实头戴设备时操作不明确的问题，用户通过非常简单的小幅度的动作就能完成列表切换，享受到流畅精准的列表切换体验，并且在接收到用户发出的列表切换指令后，通过在用户视线范围内快速展示列表切换的动态效果，进一步增强用户的空间意识和空间感受。
3、在***后台仅加载当前列表的应用程序数据，不加载其他列表的应用程序，可以有效降低资源的利用率，降低设备的负荷。
以上所述，仅为本发明的具体实施方式，但本发明的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到的变化或替换，都应涵盖在本发明的保护范围之内。因此，本发明的保护范围应以权利要求的保护范围为准。

Claims (14)

  1. 一种环绕式界面布局方法，其特征在于，所述方法包括：
    将整个界面分割成若干个显示对象，在立体空间中环绕布局所述若干个显示对象；
    获取用户视线，根据用户视线的方向将位于用户视线上的显示对象清晰地展示给用户。
  2. 如权利要求1所述的方法，其特征在于，所述方法还包括：
    为每一个显示对象设置三维空间坐标范围；
    根据所述三维空间坐标范围将每一个显示对象布局在立体空间中；
    若一个显示对象上某一点的三维空间坐标在用户的视线上，则判断该显示对象位于用户视线上。
  3. 如权利要求2所述的方法，其特征在于，每一个显示对象是能够与所述立体空间的表面贴合的曲面对象；或者，每一个显示对象是垂直于用户视线的平面对象。
  4. 如权利要求3所述的方法，其特征在于，所述立体空间为以用户为中心的圆柱体空间，所述若干个显示对象采用360度环绕布局在所述圆柱体空间的侧面上。
  5. 如权利要求3所述的方法，其特征在于，所述立体空间为以用户为中心的球体空间，所述若干个显示对象采用水平360度与垂直360度全方位环绕布局在所述球体空间的表面上，每一个显示对象到人眼的距离相等。
  6. 一种三维沉浸式环境下内容切换方法，其特征在于，所述方法包括：
    将需要展示的内容分隔成若干个内容单元，各内容单元按一定顺序排列，在用户视线范围内仅显示当前内容单元，其他内容单元不显示；
    接收到用户发出的内容切换指令后，在用户视线范围内快速展示内容单元切换的动态效果；
    根据所述内容切换指令将所述当前内容单元切换为一个与其相邻的内容单元显示在用户视线范围内。
  7. 如权利要求6所述的方法，其特征在于，所述在用户视线范围内仅显示当前内容单元包括：
    根据用户需要，将当前内容单元分成若干行和列，每个行列中存储一个内容对象；
    所述当前内容单元中的各内容对象以环绕圆柱侧面形式排列，每一个内容对象显示为可贴合所述圆柱侧面的曲面。
  8. 如权利要求7所述的方法，其特征在于，所述接收到用户发出的内容切换指令后，在使用者视线范围内快速展示内容单元切换的动态效果包括：
    接收到用户发出的内容切换指令后，将与所述当前内容单元相邻的一个内容单元的一部分内容对象环绕圆柱侧面快速转动到用户视线范围内与所述当前内容单元的一部分内容对象一起显示。
  9. 如权利要求7所述的方法，其特征在于，所述内容切换指令为手势操作，包括由右至左、由左至右、由上至下或由下至上滑动操控区；
    或者，所述内容切换指令为对手柄按键的操作，包括操作向左方向键、向右方向键、向下方向键或向上方向键。
  10. 一种三维沉浸式环境下列表切换方法，其特征在于，所述方法包括：
    在用户视线范围内以环绕圆柱侧面形式显示一定数量的列表，且将当前列表置于用户视线最前端显示，其它列表置于当前列表之后显示；
    接收到用户发出的列表切换指令后，在用户视线范围内快速展示列表切换的动态效果；
    根据所述列表切换指令将当前列表切换为一个与其相邻的列表置于最前端显示，其它列表置于切换后的当前列表之后显示。
  11. 如权利要求10所述的方法，其特征在于，所述将当前列表置于用户视线最前端显示，其它列表置于当前列表之后显示包括：
    将每个列表显示在不同的行，其中当前列表置于中间一行，各行的列表显示为可贴合圆柱侧面的平面或曲面。
  12. 如权利要求11所述的方法，其特征在于，所述接收到用户发出的列表切换指令后，在用户视线范围内快速展示列表切换的动态效果包括：
    接收到用户发出的列表切换指令后，将与当前列表相邻的一个列表环绕圆柱侧面快速转动到用户视线最前端与所述当前列表一起显示。
  13. 如权利要求12所述的方法，其特征在于，
    所述列表切换指令为手势操作，包括由上至下或由下至上滑动操控区；
    或者，所述列表切换指令为对手柄按键的操作，包括操作向下方向键或向上方向键。
  14. 如权利要求10所述的方法，其特征在于，所述方法还包括：在***后台仅加载当前列表的应用程序。
PCT/CN2016/090295 2015-12-31 2016-07-18 一种环绕式界面布局方法、三维沉浸式环境下内容切换方法和列表切换方法 WO2017113757A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/117,348 US10372289B2 (en) 2015-12-31 2016-07-18 Wraparound interface layout method, content switching method under three-dimensional immersive environment, and list switching method

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
CN201511029860.9A CN105653034A (zh) 2015-12-31 2015-12-31 一种三维沉浸式环境下内容切换方法和装置
CN201511029860.9 2015-12-31
CN201511026691.3 2015-12-31
CN201511029344.6A CN105677275B (zh) 2015-12-31 2015-12-31 一种界面布局方法和环绕式界面***
CN201511029344.6 2015-12-31
CN201511026691.3A CN105677165A (zh) 2015-12-31 2015-12-31 一种三维沉浸式环境下列表切换方法和装置

Publications (1)

Publication Number Publication Date
WO2017113757A1 true WO2017113757A1 (zh) 2017-07-06

Family

ID=59224374

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/090295 WO2017113757A1 (zh) 2015-12-31 2016-07-18 一种环绕式界面布局方法、三维沉浸式环境下内容切换方法和列表切换方法

Country Status (2)

Country Link
US (1) US10372289B2 (zh)
WO (1) WO2017113757A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017113757A1 (zh) 2015-12-31 2017-07-06 北京小鸟看看科技有限公司 一种环绕式界面布局方法、三维沉浸式环境下内容切换方法和列表切换方法
CN110506419B (zh) 2017-02-03 2021-12-28 华纳兄弟娱乐公司 在虚拟现实中渲染扩展视频
US10671237B2 (en) * 2017-10-16 2020-06-02 Microsoft Technology Licensing, Llc Human-machine interface for presenting a user interface on a virtual curved visual surface
US10585294B2 (en) * 2018-02-19 2020-03-10 Microsoft Technology Licensing, Llc Curved display on content in mixed reality
US11599238B2 (en) * 2019-04-02 2023-03-07 Vyaire Medical, Inc. System and method for generating a virtual reality interface for displaying patient health data
CN117999535A (zh) * 2021-09-24 2024-05-07 苹果公司 用于内容项目的门户视图

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010035536A1 (ja) * 2008-09-24 2010-04-01 ブラザー工業株式会社 ヘッドマウントディスプレイ
CN102819397A (zh) * 2012-08-02 2012-12-12 广东欧珀移动通信有限公司 一种手持设备相册的快速浏览查找方法
CN103631364A (zh) * 2012-08-20 2014-03-12 联想(北京)有限公司 一种控制方法及电子设备
CN104536650A (zh) * 2015-01-15 2015-04-22 成都品果科技有限公司 一种基于ios***的视差翻页人机交互方法
CN105208368A (zh) * 2015-09-23 2015-12-30 北京奇虎科技有限公司 显示全景数据的方法及装置
CN105653034A (zh) * 2015-12-31 2016-06-08 北京小鸟看看科技有限公司 一种三维沉浸式环境下内容切换方法和装置
CN105677275A (zh) * 2015-12-31 2016-06-15 北京小鸟看看科技有限公司 一种界面布局方法和环绕式界面***
CN105677165A (zh) * 2015-12-31 2016-06-15 北京小鸟看看科技有限公司 一种三维沉浸式环境下列表切换方法和装置

Family Cites Families (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2253825B (en) * 1991-03-20 1994-06-22 Rediffusion Simulation Ltd Vehicle simulator
JP3318680B2 (ja) * 1992-04-28 2002-08-26 サン・マイクロシステムズ・インコーポレーテッド 画像生成方法及び画像生成装置
US6198484B1 (en) * 1996-06-27 2001-03-06 Kabushiki Kaisha Toshiba Stereoscopic display system
US6351273B1 (en) * 1997-04-30 2002-02-26 Jerome H. Lemelson System and methods for controlling automatic scrolling of information on a display or screen
US6603491B2 (en) * 2000-05-26 2003-08-05 Jerome H. Lemelson System and methods for controlling automatic scrolling of information on a display or screen
US9274598B2 (en) * 2003-08-25 2016-03-01 International Business Machines Corporation System and method for selecting and activating a target object using a combination of eye gaze and key presses
US7379047B2 (en) * 2004-06-30 2008-05-27 Microsoft Corporation Using a physical object to control an attribute of an interactive display application
KR100746008B1 (ko) 2005-10-31 2007-08-06 삼성전자주식회사 3차원 모션 그래픽 유저 인터페이스, 이를 제공하는 장치및 방법
US8725729B2 (en) * 2006-04-03 2014-05-13 Steven G. Lisa System, methods and applications for embedded internet searching and result display
WO2009146130A2 (en) 2008-04-05 2009-12-03 Social Communications Company Shared virtual area communication environment based apparatus and methods
US8677284B2 (en) 2009-11-04 2014-03-18 Alpine Electronics, Inc. Method and apparatus for controlling and displaying contents in a user interface
KR20110054415A (ko) 2009-11-17 2011-05-25 삼성전자주식회사 화면 표시 방법 및 장치
US9282947B2 (en) * 2009-12-01 2016-03-15 Inneroptic Technology, Inc. Imager focusing based on intraoperative data
US10007393B2 (en) 2010-01-19 2018-06-26 Apple Inc. 3D view of file structure
US9507418B2 (en) * 2010-01-21 2016-11-29 Tobii Ab Eye tracker based contextual action
US9134799B2 (en) 2010-07-16 2015-09-15 Qualcomm Incorporated Interacting with a projected user interface using orientation sensors
CN101924892B (zh) 2010-08-20 2013-03-20 深圳市同洲电子股份有限公司 数字电视接收终端的菜单展示方法、***及接收终端
CN101986254A (zh) 2010-11-05 2011-03-16 福州瑞芯微电子有限公司 渐变推进式三维用户界面实现方法及移动终端
WO2012083042A1 (en) * 2010-12-16 2012-06-21 Lockheed Martin Corporation Collimating display with pixel lenses
JP2012212340A (ja) 2011-03-31 2012-11-01 Sony Corp 情報処理装置、画像表示装置、および情報処理方法
CN109271029B (zh) 2011-08-04 2022-08-26 视力移动技术有限公司 无触摸手势识别***、无触摸手势识别方法和介质
CN102981743B (zh) 2011-09-05 2016-05-25 联想(北京)有限公司 控制操作对象的方法及电子设备
KR101916742B1 (ko) 2011-11-10 2018-11-09 삼성전자 주식회사 휴대 단말기의 사용자 인터페이스 제공 방법 및 장치
CN103207664B (zh) 2012-01-16 2016-04-27 联想(北京)有限公司 一种图像处理方法和设备
KR101850035B1 (ko) * 2012-05-02 2018-04-20 엘지전자 주식회사 이동 단말기 및 그 제어방법
CN102902485A (zh) 2012-10-25 2013-01-30 北京华达诺科技有限公司 360度全景多点触控展示平台构建方法
CN103019519B (zh) 2012-12-17 2016-01-13 天津三星通信技术研究有限公司 一种触控终端应用图标的显示控制方法及其触控终端
US11747895B2 (en) * 2013-03-15 2023-09-05 Intuitive Surgical Operations, Inc. Robotic system providing user selectable actions associated with gaze tracking
KR20140133353A (ko) 2013-05-10 2014-11-19 삼성전자주식회사 디스플레이 장치 및 그 ui 화면 제공 방법
TWI509463B (zh) * 2013-06-03 2015-11-21 Utechzone Co Ltd 一種使螢幕中的游標移至可按物件的方法及用於實現該方法的電腦系統與電腦程式產品
US9563331B2 (en) * 2013-06-28 2017-02-07 Microsoft Technology Licensing, Llc Web-like hierarchical menu display configuration for a near-eye display
CN103412700B (zh) 2013-07-24 2016-05-11 天脉聚源(北京)传媒科技有限公司 一种分场景展示多媒体资源的方法及装置
US10089786B2 (en) * 2013-08-19 2018-10-02 Qualcomm Incorporated Automatic customization of graphical user interface for optical see-through head mounted display with user interaction tracking
US9264702B2 (en) * 2013-08-19 2016-02-16 Qualcomm Incorporated Automatic calibration of scene camera for optical see-through head mounted display
US10073518B2 (en) * 2013-08-19 2018-09-11 Qualcomm Incorporated Automatic calibration of eye tracking for optical see-through head mounted display
US10152495B2 (en) * 2013-08-19 2018-12-11 Qualcomm Incorporated Visual search in real world using optical see-through head mounted display with augmented reality and user interaction tracking
ES2633016T3 (es) * 2013-08-23 2017-09-18 Tobii Ab Sistemas y métodos para proveer audio a un usuario según una entrada de mirada
US9143880B2 (en) * 2013-08-23 2015-09-22 Tobii Ab Systems and methods for providing audio to a user based on gaze input
US20150187224A1 (en) * 2013-10-15 2015-07-02 Mbfarr, Llc Driving assessment and training method and apparatus
US9990034B2 (en) * 2013-11-15 2018-06-05 Lg Electronics Inc. Transparent display device and control method therefor
US20150138244A1 (en) * 2013-11-18 2015-05-21 Tobii Technology Ab Component determination and gaze provoked interaction
CN103793060B (zh) 2014-02-14 2017-07-28 杨智 一种用户交互***和方法
CN106462231A (zh) * 2014-03-17 2017-02-22 Itu 商业发展公司 计算机实现的视线交互方法和装置
WO2015163529A1 (en) 2014-04-23 2015-10-29 Lg Electronics Inc. Head mounted display device displaying thumbnail image and method of controlling therefor
WO2016018487A2 (en) * 2014-05-09 2016-02-04 Eyefluene, Inc. Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
KR102004990B1 (ko) * 2014-05-13 2019-07-29 삼성전자주식회사 영상 처리 장치 및 방법
CN104166497A (zh) 2014-06-13 2014-11-26 广州市久邦数码科技有限公司 一种立体桌面快捷栏及其切换方法
US9846522B2 (en) * 2014-07-23 2017-12-19 Microsoft Technology Licensing, Llc Alignable user interface
US9508195B2 (en) * 2014-09-03 2016-11-29 Microsoft Technology Licensing, Llc Management of content in a 3D holographic environment
CN104244019B (zh) 2014-09-18 2018-01-19 孙轩 一种全景视频影像室内分屏显示方法及显示***
CN204679953U (zh) 2014-11-14 2015-09-30 西安中科微光医疗技术有限公司 一种基于方位传感器的头戴式3d影音播放器
US9690104B2 (en) * 2014-12-08 2017-06-27 Hyundai Motor Company Augmented reality HUD display method and device for vehicle
US20160259405A1 (en) * 2015-03-03 2016-09-08 Microsoft Technology Licensing, Llc Eye Gaze for Automatic Paging
US9396588B1 (en) * 2015-06-30 2016-07-19 Ariadne's Thread (Usa), Inc. (Dba Immerex) Virtual reality virtual theater system
CN105183288B (zh) 2015-08-31 2020-07-10 惠州Tcl移动通信有限公司 单窗口多任务显示方法及其智能移动终端
US10613713B2 (en) * 2015-10-07 2020-04-07 Google Llc Integration of content in non-browser applications
US9990044B2 (en) * 2015-10-30 2018-06-05 Intel Corporation Gaze tracking system
WO2017113757A1 (zh) 2015-12-31 2017-07-06 北京小鸟看看科技有限公司 一种环绕式界面布局方法、三维沉浸式环境下内容切换方法和列表切换方法

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010035536A1 (ja) * 2008-09-24 2010-04-01 ブラザー工業株式会社 ヘッドマウントディスプレイ
CN102819397A (zh) * 2012-08-02 2012-12-12 广东欧珀移动通信有限公司 一种手持设备相册的快速浏览查找方法
CN103631364A (zh) * 2012-08-20 2014-03-12 联想(北京)有限公司 一种控制方法及电子设备
CN104536650A (zh) * 2015-01-15 2015-04-22 成都品果科技有限公司 一种基于ios***的视差翻页人机交互方法
CN105208368A (zh) * 2015-09-23 2015-12-30 北京奇虎科技有限公司 显示全景数据的方法及装置
CN105653034A (zh) * 2015-12-31 2016-06-08 北京小鸟看看科技有限公司 一种三维沉浸式环境下内容切换方法和装置
CN105677275A (zh) * 2015-12-31 2016-06-15 北京小鸟看看科技有限公司 一种界面布局方法和环绕式界面***
CN105677165A (zh) * 2015-12-31 2016-06-15 北京小鸟看看科技有限公司 一种三维沉浸式环境下列表切换方法和装置

Also Published As

Publication number Publication date
US10372289B2 (en) 2019-08-06
US20180004391A1 (en) 2018-01-04

Similar Documents

Publication Publication Date Title
WO2017113757A1 (zh) 一种环绕式界面布局方法、三维沉浸式环境下内容切换方法和列表切换方法
US11557102B2 (en) Methods for manipulating objects in an environment
US11714592B2 (en) Gaze-based user interactions
US10241582B2 (en) Information processing device, information processing method, and program for graphical user interface
EP3396511B1 (en) Information processing device and operation reception method
US9459784B2 (en) Touch interaction with a curved display
CN106873767B (zh) 一种虚拟现实应用的运行控制方法和装置
US20170024935A1 (en) Computer and computer system for controlling object manipulation in immersive virtual space
JP5914739B1 (ja) ヘッドマウントディスプレイシステムを制御するプログラム
US20160041619A1 (en) Information processing apparatus, information processing method, and program
US20100128112A1 (en) Immersive display system for interacting with three-dimensional content
US9779702B2 (en) Method of controlling head-mounted display system
CN106873886B (zh) 一种立体显示的控制方法、装置和电子设备
US9294670B2 (en) Lenticular image capture
US10216357B2 (en) Apparatus and method for controlling the apparatus
US20170003837A1 (en) Systems and Methods for Generating, Presenting, and Adjusting Adjustable Virtual Keyboards
US20150213784A1 (en) Motion-based lenticular image display
WO2022218146A1 (en) Devices, methods, systems, and media for an extended screen distributed user interface in augmented reality
JP6121496B2 (ja) ヘッドマウントディスプレイシステムを制御するプログラム
US10936148B1 (en) Touch interaction in augmented and virtual reality applications
US20230316634A1 (en) Methods for displaying and repositioning objects in an environment
US20230106627A1 (en) Devices, Methods, And Graphical User Interfaces for Interacting with Three-Dimensional Environments
WO2013103968A2 (en) Touchscreen controller
CN113703571B (zh) 一种虚拟现实人机交互的方法、装置、设备和介质
JP6121495B2 (ja) ヘッドマウントディスプレイシステムを制御するプログラム

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 15117348

Country of ref document: US

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16880554

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16880554

Country of ref document: EP

Kind code of ref document: A1