CN107870702B - User operation prompting method and device based on head-mounted display equipment - Google Patents
User operation prompting method and device based on head-mounted display equipment Download PDFInfo
- Publication number
- CN107870702B CN107870702B CN201610847467.9A CN201610847467A CN107870702B CN 107870702 B CN107870702 B CN 107870702B CN 201610847467 A CN201610847467 A CN 201610847467A CN 107870702 B CN107870702 B CN 107870702B
- Authority
- CN
- China
- Prior art keywords
- control
- content area
- preset content
- preset
- head
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 29
- 230000003190 augmentative effect Effects 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 14
- 230000009471 action Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 230000002452 interceptive effect Effects 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 238000007654 immersion Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention provides a user operation prompting method based on head-mounted display equipment, which comprises the following steps of: displaying an identification control in a display interface; and displaying a prompt identifier in the identifier control according to the relative position of the identifier control and a preset content area. The invention also provides a user operation prompting device based on the head-mounted display equipment. According to the user operation prompting method and device based on the head-mounted display equipment, a user can be prompted to adjust and display the preset content area to the screen display area through the operation instruction when the preset content area is not displayed in the current screen display area, so that the complexity of user operation is effectively reduced, the user experience is remarkably improved, and the method and device are suitable for the head-mounted virtual reality equipment and the head-mounted augmented reality equipment.
Description
Technical Field
The invention relates to the technical field of intelligent wearable equipment and man-machine interaction, in particular to a user operation prompting method and device based on head-mounted display equipment.
Background
Virtual Reality (VR) technology simulates a Virtual three-dimensional world through a computer system, and with the help of a display system and an interaction system, simulation experiences of senses such as vision, hearing, touch and the like are provided for a user, and meanwhile, the user can interact with a Virtual scene, so that the user can feel personally on the scene.
Along with the continuous improvement of software and hardware technical level, the volume of virtual reality system is miniaturized gradually, and wear-type virtual reality equipment becomes comparatively common virtual reality system at present, and the user is through wearing wear-type virtual reality equipment, and the sight is isolated with external real environment to immerse in the virtual environment scene that the system found.
The virtual reality system is a comprehensive system which covers a real-time three-dimensional graphic modeling technology, a wide-view angle stereo display technology, a real-time motion tracking technology, an interactive feedback technology and the like. The interactive technology is one of the key technologies for implementing the virtual reality system, and determines how a user interacts with a target in a virtual world.
Disclosure of Invention
The invention aims to provide a user operation prompting method and device based on a head-mounted display device, which can prompt a user to adjust an area of a virtual panoramic interface displayed in a screen according to the relative position between an identification control and a preset content area in the virtual panoramic interface, so that the preset content area is displayed in a screen display area.
In view of the above, an aspect of the present invention provides a method for prompting user manipulation based on a head-mounted display device, including the following steps: displaying an identification control in a display interface; and displaying a prompt identifier in the identifier control according to the relative position of the identifier control and a preset content area.
Preferably, whether the distance between the identifier control and the preset content area is greater than a first preset threshold value or not is judged, and if yes, the prompt identifier is displayed in the identifier control.
Preferably, the prompt identifier includes a direction prompt identifier, and the direction prompt identifier indicates a direction of the preset content area relative to the identifier control.
Preferably, the method further comprises the following steps: judging whether the distance between the identification control and the preset content area is smaller than a second preset threshold value or not, if so, adjusting the display interface to enable the identification control to be located in the preset content area; or judging whether the distance between the identification control and the function control in the preset content area is smaller than a third preset threshold value, if so, adjusting the position of the function control to enable the identification control to be located on the function control.
In another aspect, the present invention provides a user manipulation prompting apparatus based on a head-mounted display device, including: the control display module: the display interface is used for displaying the identification control; a position determination module: the system comprises a display screen, a control module and a display screen, wherein the display screen is used for displaying an identification control; the control display module is further used for displaying a prompt identification in the identification control.
Preferably, the position determination module: the identification control is also used for judging whether the distance between the identification control and the preset content area is larger than a first preset threshold value or not; and the control display module is further configured to display the prompt identification in the identification control when the position determination module determines that the distance between the identification control and the preset content area is greater than a first preset threshold.
Preferably, the prompt identifier includes a direction prompt identifier, and the direction prompt identifier indicates a direction of the preset content area relative to the identifier control.
Preferably, the user operation prompting device based on the head-mounted display device further includes: an interface adjusting module: the display interface is adjusted to enable the identification control to be located in the preset content area; and the position of the function control in the preset content area is adjusted, so that the identification control is positioned on the function control in the preset content area.
Preferably, the position determining module is further configured to determine whether a distance between the identifier control and the preset content region is smaller than a second preset threshold, and determine whether a distance between the identifier control and a function control in the preset content region is smaller than a third preset threshold.
The invention also provides head-mounted display equipment which comprises the user operation prompting device based on the head-mounted display equipment.
According to the user operation prompting method and device based on the head-mounted display equipment, the identification control is displayed in the display interface of the head-mounted display equipment, the prompt identification is displayed in the identification control according to the relative position of the identification control and the preset content area, and when the preset content area is not displayed in the current screen display area, a user can be prompted to adjust and display the preset content area to the screen display area through an operation instruction, so that the complexity of user operation is effectively reduced, the user experience is remarkably improved, and the method and device are suitable for the head-mounted virtual reality equipment and the head-mounted augmented reality equipment.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without inventive exercise:
fig. 1 is a flowchart illustrating a method for prompting a user to manipulate based on a head-mounted display device according to a first embodiment of the present invention;
FIG. 2 is a schematic diagram of a first display interface of a head mounted display device according to an embodiment of the invention;
FIG. 3 is a schematic diagram of a second display interface of a head mounted display device according to an embodiment of the invention;
FIG. 4 is a schematic diagram of a third display interface of a head mounted display device according to an embodiment of the invention;
FIG. 5a is a first diagram illustrating a preset content area in a display interface of a head-mounted display device according to an embodiment of the present invention;
FIG. 5b is a second diagram of a preset content area in a display interface of a head-mounted display device according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram illustrating a user manipulation prompting device based on a head-mounted display device according to a second embodiment of the present invention.
Detailed Description
So that the objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention, briefly summarized above, may be had by reference to the embodiments thereof that are illustrated in the appended drawings. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, this is merely an example of the present invention, which may be embodied in other ways than is specifically described herein, and therefore the scope of the present invention is not limited by the specific examples disclosed below.
Example one
Fig. 1 is a flowchart illustrating a method for prompting a user to manipulate based on a head-mounted display device according to a first embodiment of the present invention.
According to the embodiment of the invention, the method for prompting user manipulation based on the head-mounted display device, as shown in fig. 1, comprises the following steps: step S101, displaying an identification control in a display interface; and S102, displaying a prompt identifier in the identifier control according to the relative position of the identifier control and a preset content area.
In the technical scheme, the head-mounted display equipment can present a virtual 360-degree panoramic interface to a user, when the user wears the head-mounted display equipment, the user can see a partial area of the virtual panoramic interface displayed in the screen display area at a certain moment through a display screen of the head-mounted display equipment, and the partial area of the virtual panoramic interface displayed in the screen display area is the same as or similar to the natural visual field range of a human after being amplified by an optical system of the head-mounted display equipment, so that the user can feel the reality of the virtual scene environment. The user can control different areas in the display screen for displaying the virtual panoramic interface through control instructions including voice instructions, gesture instructions, action instructions and the like, so that the complete virtual panoramic interface can be browsed, for example, the user rotates the head, and the area of the virtual panoramic interface displayed in the display screen is adjusted according to the rotating direction and the rotating angle of the head of the user, so that the user can feel the immersion in the virtual environment.
In the above technical solution, one or more content areas are further preset in the virtual panoramic interface, where the content areas may include contents such as text, images, and videos, and may also include function controls or function buttons, which are not limited herein. When a user wears the head-mounted display device, a certain area of the virtual panoramic interface is displayed in the device display screen, and when the area of the virtual panoramic interface currently displayed by the display screen does not contain a preset content area, the area of the virtual panoramic interface displayed in the display screen is adjusted according to a control instruction of the user, for example, the head rotation action of the user is detected, so that the area containing the preset content area in the virtual panoramic interface is displayed in the display screen.
In the foregoing technical solution, preferably, in step S101, specifically, an identification control is displayed in a current display interface of a display screen of the head-mounted display device, where the identification control is displayed at a preset position of the display area of the display screen, for example, the identification control may be displayed at a center position of the display area of the display screen. Further, the head-mounted display device displays the identification control in the current display interface of the display screen all the time in the process of adjusting and displaying different areas of the virtual panoramic interface according to the detected head action of the user, and the identification control is displayed in the center of the display area of the display screen.
In this technical solution, preferably, the identification control may include an interactive control displayed in the head-mounted display device, for example, a visual anchor point, for identifying a position where a user looks focused on the virtual panoramic interface, or for identifying a position where a certain position area on the virtual panoramic interface executes a user instruction. As shown in fig. 2, in a screen display area 110 of the head-mounted display device, a partial area of the virtual panoramic interface is displayed, and an identification control 111 is displayed in a central position of the screen display area.
In the above technical solution, preferably, the step S102 specifically includes: and judging whether the distance between the identification control and the preset content area is greater than a first preset threshold value or not, and if so, displaying the prompt identification in the identification control. Specifically, a first preset threshold may be determined according to a size of a display screen of the head-mounted display device, a certain area of the virtual panoramic interface is displayed in the display screen of the head-mounted display device, the identifier control is displayed at a central position of the screen display area, and when a distance between the identifier control and the preset content area is greater than the first preset threshold, the preset content area is not displayed in the screen display area, and a user cannot judge a position of the preset content area, so that a prompt identifier is displayed in the identifier control to prompt the position of the preset content area.
In this technical solution, preferably, the prompt identifier includes a direction prompt identifier, and the direction prompt identifier indicates a direction of the preset content area relative to the identifier control. Specifically, when a preset content area is not contained in an area of a currently displayed virtual panoramic interface in a display screen of the head-mounted display device, a direction prompt identifier is displayed in the identifier control according to the relative position of the identifier control and the preset content area, and the direction prompt identifier indicates the direction of the preset content area relative to the identifier control, namely the direction prompt identifier prompts a user to adjust and display the area in the virtual panoramic interface along the corresponding direction through a control instruction, so that the preset content area is displayed in the display screen. As shown in fig. 3, in the screen display area 110 of the head-mounted display device, a partial area of the virtual panoramic interface is displayed, and the preset content area 112 is located on the left side of the currently displayed virtual panoramic interface area in the screen display area 110 and is not displayed in the screen display area 110, a direction prompt identifier is displayed in the identifier control 111, indicating the direction of the preset content area 112 relative to the identifier control 111.
In the foregoing technical solution, after the step S102, it is preferable that the method further includes: and judging whether the distance between the identification control and the preset content area is smaller than a second preset threshold value, if so, adjusting the display position of the preset content area to enable the identification control to be located in the preset content area. Specifically, according to the direction of the preset content area relative to the identification control indicated by the direction prompt identification, the user can adjust the area of the virtual panoramic interface displayed in the display screen of the head-mounted display device through the control instruction, so that the preset content area is displayed in the display screen. For example, as shown in fig. 4, when the preset content area 112 is located on the left side of the identifier control 111, the identifier is prompted according to the direction displayed in the identifier control 111, the head of the user rotates to the left, and according to the detected rotation direction and rotation speed of the head of the user, the area on the left side of the first area in the virtual panoramic interface is switched and displayed in the display screen, so that the preset content area 112 is displayed in the display area 110 of the display screen. Further, the distance between the identification control 111 and the preset content area 112 is judged in the rotation process of the head of the user, and if the distance between the identification control 111 and the preset content area 112 is smaller than a second preset threshold, the display interface is directly adjusted to enable the identification control to move into the preset content area, so that the rotation amplitude of the head of the user is reduced, and the complexity of user operation is reduced.
In the above technical solution, as shown in fig. 5a and 5b, when the preset content area 112 includes one or more functional controls, it is determined that a distance between the identifier control 111 and the functional control in the preset content area 112 is smaller than a third preset threshold value in a rotation process of the head of the user, and if the distance between the identifier control 111 and the functional control in the preset content area 112 is smaller than the third preset threshold value, a display position of the functional control is directly adjusted, so that the identifier control 111 is located on the functional control in the preset content area 112, and the user can directly operate the functional control through a control instruction, thereby improving convenience of user operation.
In the above technical solution, preferably, a certain position area in the virtual panoramic interface is preset as an initial position area, and when it is detected that an action of wearing the head-mounted display device by a user is completed, the initial position area of the virtual panoramic interface is displayed in a display screen, specifically, the initial position area of the virtual panoramic interface may include menu options, function controls, and the like, and the user can conveniently execute function control after wearing the head-mounted display device. Similarly, when a user wears the head-mounted display device, the virtual viewing angle can be adjusted through the control instruction, so that different areas of the virtual panoramic interface are displayed in the display screen of the head-mounted display device, and when a non-initial position area of the virtual panoramic interface is displayed in the display screen, the initial position area of the virtual panoramic interface can be rapidly switched and displayed in the display screen according to the received preset control instruction, wherein the control instruction can be a gesture instruction, a voice instruction, an action instruction and the like, for example, a touch panel double-click instruction.
According to the user operation prompting method based on the head-mounted display equipment, the identification control is displayed in the display interface of the head-mounted display equipment, the prompt identification is displayed in the identification control according to the relative position of the identification control and the preset content area, and when the preset content area is not displayed in the current screen display area, a user is prompted to adjust and display the preset content area to the screen display area through an operation instruction, so that the complexity of user operation is effectively reduced, and the user experience is remarkably improved.
Example two
Fig. 6 is a schematic structural diagram illustrating a user manipulation prompting device based on a head-mounted display device according to a second embodiment of the present invention.
As shown in fig. 6, the user manipulation prompting apparatus 200 based on a head-mounted display device according to an embodiment of the present invention includes: the control display module 201: the display interface is used for displaying the identification control; the position determination module 202: the system comprises a display screen, a control module and a display screen, wherein the display screen is used for displaying an identification control; the control display module 201 is further configured to display a prompt identifier in the identifier control.
In the technical scheme, the head-mounted display equipment can present a virtual 360-degree panoramic interface to a user, when the user wears the head-mounted display equipment, the user can see a partial area of the virtual panoramic interface displayed in the screen display area at a certain moment through a display screen of the head-mounted display equipment, and the partial area of the virtual panoramic interface displayed in the screen display area is the same as or similar to the natural visual field range of a human after being amplified by an optical system of the head-mounted display equipment, so that the user can feel the reality of the virtual scene environment. The user can control different areas in the display screen for displaying the virtual panoramic interface through control instructions including voice instructions, gesture instructions, action instructions and the like, so that the complete virtual panoramic interface can be browsed, for example, the user rotates the head, and the area of the virtual panoramic interface displayed in the display screen is adjusted according to the rotating direction and the rotating angle of the head of the user, so that the user can feel the immersion in the virtual environment.
In the above technical solution, one or more content areas are further preset in the virtual panoramic interface, where the content areas may include contents such as text, images, and videos, and may also include function controls or function buttons, which are not limited herein. When a user wears the head-mounted display device, a certain area of the virtual panoramic interface is displayed in the device display screen, and when the area of the virtual panoramic interface currently displayed by the display screen does not contain a preset content area, the area of the virtual panoramic interface displayed in the display screen is adjusted according to a control instruction of the user, for example, the head rotation action of the user is detected, so that the area containing the preset content area in the virtual panoramic interface is displayed in the display screen.
In the foregoing technical solution, preferably, the control display module 201 is specifically configured to display an identification control in a current display interface of a display screen of the head-mounted display device, where the identification control is displayed at a preset position of the display area of the display screen, for example, the identification control may be displayed at a center position of the display area of the display screen. Further, the head-mounted display device displays the identification control in the current display interface of the display screen all the time in the process of adjusting and displaying different areas of the virtual panoramic interface according to the detected head action of the user, and the identification control is displayed in the center of the display area of the display screen.
In this technical solution, preferably, the identification control may include an interactive control displayed in the head-mounted display device, for example, a visual anchor point, for identifying a position where a user looks focused on the virtual panoramic interface, or for identifying a position where a certain position area on the virtual panoramic interface executes a user instruction. As shown in fig. 2, in a screen display area 110 of the head-mounted display device, a partial area of the virtual panoramic interface is displayed, and an identification control 111 is displayed in a central position of the screen display area.
In the above technical solution, preferably, the position determining module 202 specifically includes: and the control display module 201 is further configured to determine whether a distance between the identifier control and the preset content area is greater than a first preset threshold, and if the distance between the identifier control and the preset content area is greater than the first preset threshold, display the prompt identifier in the identifier control. Specifically, a first preset threshold may be determined according to a size of a display screen of the head-mounted display device, a certain area of the virtual panoramic interface is displayed in the display screen of the head-mounted display device, the identifier control is displayed at a central position of the screen display area, and when a distance between the identifier control and the preset content area is greater than the first preset threshold, the preset content area is not displayed in the screen display area, and a user cannot judge a position of the preset content area, so that a prompt identifier is displayed in the identifier control to prompt the position of the preset content area.
In this technical solution, preferably, the prompt identifier includes a direction prompt identifier, and the direction prompt identifier indicates a direction of the preset content area relative to the identifier control. Specifically, when a preset content area is not contained in an area of a currently displayed virtual panoramic interface in a display screen of the head-mounted display device, a direction prompt identifier is displayed in the identifier control according to the relative position of the identifier control and the preset content area, and the direction prompt identifier indicates the direction of the preset content area relative to the identifier control, namely the direction prompt identifier prompts a user to adjust and display the area in the virtual panoramic interface along the corresponding direction through a control instruction, so that the preset content area is displayed in the display screen. As shown in fig. 3, in the screen display area 110 of the head-mounted display device, a partial area of the virtual panoramic interface is displayed, and the preset content area 112 is located on the left side of the currently displayed virtual panoramic interface area in the screen display area 110 and is not displayed in the screen display area 110, a direction prompt identifier is displayed in the identifier control 111, indicating the direction of the preset content area 112 relative to the identifier control 111.
In the above technical solution, preferably, the prompt apparatus 200 is operated by a user based on a head-mounted display device, and further includes an interface adjusting module 203, configured to adjust a display position of the preset content area, so that the identifier control is located in the preset content area. The position determining module 202 is further configured to determine whether a distance between the identifier control and the preset content region is smaller than a second preset threshold, and if the distance between the identifier control and the preset content region is smaller than the second preset threshold, the interface adjusting module 203 adjusts the display position of the preset content region, so that the identifier control is located in the preset content region. Specifically, according to the direction of the preset content area relative to the identification control indicated by the direction prompt identification, the user can adjust the area of the virtual panoramic interface displayed in the display screen of the head-mounted display device through the control instruction, so that the preset content area is displayed in the display screen. For example, as shown in fig. 4, when the preset content area 112 is located on the left side of the identifier control 111, the identifier is prompted according to the direction displayed in the identifier control 111, the head of the user rotates to the left, and according to the detected rotation direction and rotation speed of the head of the user, the area on the left side of the first area in the virtual panoramic interface is switched and displayed in the display screen, so that the preset content area 112 is displayed in the display area 110 of the display screen. Further, in the process of rotating the head of the user, the distance between the identification control 111 and the preset content area 112 is determined, and if the distance between the identification control 111 and the preset content area 112 is smaller than a second preset threshold, the display interface is directly adjusted to move the identification control to the preset content area, so that the head rotation amplitude of the user is reduced, and the complexity of user operation is reduced.
In the above technical solution, as shown in fig. 5a and 5b, when the preset content area 112 includes one or more functional controls, it is determined that a distance between the identifier control 111 and the functional control in the preset content area 112 is smaller than a third preset threshold value in a rotation process of the head of the user, and if the distance between the identifier control 111 and the functional control in the preset content area 112 is smaller than the third preset threshold value, a display position of the functional control is directly adjusted, so that the identifier control 111 is located on the functional control in the preset content area 112, and the user can directly operate the functional control through a control instruction, thereby improving convenience of user operation.
In the above technical solution, preferably, a certain position area in the virtual panoramic interface is preset as an initial position area, and when it is detected that an action of wearing the head-mounted display device by a user is completed, the initial position area of the virtual panoramic interface is displayed in a display screen, specifically, the initial position area of the virtual panoramic interface may include menu options, function controls, and the like, and the user can conveniently execute function control after wearing the head-mounted display device. Similarly, when a user wears the head-mounted display device, the virtual viewing angle can be adjusted through the control instruction, so that different areas of the virtual panoramic interface are displayed in the display screen of the head-mounted display device, and when a non-initial position area of the virtual panoramic interface is displayed in the display screen, the initial position area of the virtual panoramic interface can be rapidly switched and displayed in the display screen according to the received preset control instruction, wherein the control instruction can be a gesture instruction, a voice instruction, an action instruction and the like, for example, a touch panel double-click instruction.
According to the user operation prompting device based on the head-mounted display equipment, the identification control is displayed in the display interface of the head-mounted display equipment, the prompting identification is displayed in the identification control according to the relative position of the identification control and the preset content area, and when the preset content area is not displayed in the current screen display area, a user can be prompted to adjust and display the preset content area to the screen display area through an operation instruction, so that the complexity of user operation is effectively reduced, and the user experience is remarkably improved.
It is again stated that all of the features disclosed in this specification, or all of the steps in any method or process so disclosed, may be combined in any combination, except mutually exclusive features and/or steps.
Any feature disclosed in this specification (including any accompanying claims, abstract and drawings), may be replaced by alternative features serving equivalent or similar purposes, unless expressly stated otherwise. That is, unless expressly stated otherwise, each feature is only an example of a generic series of equivalent or similar features.
The invention is not limited to the foregoing embodiments. The invention extends to any novel feature or any novel combination of features disclosed in this specification, and to any novel method or process steps or any novel combination of features disclosed.
Claims (7)
1. A user manipulation prompting method based on a head-mounted display device is characterized by comprising the following steps:
displaying an identification control in a display interface;
displaying a prompt identifier in the identifier control according to a first preset threshold and a relative relation between the identifier control and a relative position of a preset content area;
judging whether the distance between the identification control and the preset content area is smaller than a second preset threshold or not, or judging whether the distance between the identification control and the function control in the preset content area is smaller than a third preset threshold or not, and adjusting the relative position of the identification control and the preset content area according to the judgment result;
the prompt mark comprises a direction prompt mark, and the direction prompt mark indicates the direction of the preset content area relative to the mark control;
the first preset threshold is used for representing whether the identification control and the preset content area are simultaneously displayed in the display interface or not;
the second preset threshold is used for representing the proximity degree between the identification control and the preset content area which are simultaneously displayed in the display interface.
2. The method according to claim 1, wherein the step of displaying a prompt identifier in the identifier control according to the first preset threshold and the relative relationship between the identifier control and the relative position of the preset content area includes:
and judging whether the distance between the identification control and the preset content area is greater than a first preset threshold value or not, and if so, displaying the prompt identification in the identification control.
3. The method according to claim 1, wherein the step of determining whether the distance between the identifier control and the preset content area is smaller than a second preset threshold, or determining whether the distance between the identifier control and a function control in the preset content area is smaller than a third preset threshold, and adjusting the relative position between the identifier control and the preset content area according to the determination result specifically comprises:
judging whether the distance between the identification control and the preset content area is smaller than a second preset threshold value or not, if so, adjusting the display interface to enable the identification control to be located in the preset content area; or,
and judging whether the distance between the identification control and the function control in the preset content area is smaller than a third preset threshold value, if so, adjusting the position of the function control to enable the identification control to be positioned on the function control.
4. A user manipulation prompting device based on a head-mounted display device is characterized by comprising:
the control display module: the display interface is used for displaying the identification control;
a position determination module: the system comprises a display unit, a control unit and a display unit, wherein the display unit is used for displaying a preset content area and a mark control; the system is also used for judging whether the distance between the identification control and the preset content area is smaller than a second preset threshold value or not and judging whether the distance between the identification control and the function control in the preset content area is smaller than a third preset threshold value or not;
the control display module is further used for displaying a prompt identifier in the identifier control;
the prompt mark comprises a direction prompt mark, and the direction prompt mark indicates the direction of the preset content area relative to the mark control;
the first preset threshold is used for representing whether the identification control and the preset content area are simultaneously displayed in the display interface or not;
the second preset threshold is used for representing the proximity degree between the identification control and the preset content area which are simultaneously displayed in the display interface.
5. The head-mounted display device-based user manipulation prompting device according to claim 4, wherein the position determining module is further configured to determine whether a distance between the identification control and the preset content area is greater than a first preset threshold; and the number of the first and second groups,
the control display module is further configured to display the prompt identification in the identification control when the position determination module determines that the distance between the identification control and the preset content area is greater than a first preset threshold.
6. The head-mounted display device based user manipulation prompt apparatus according to claim 4, further comprising:
an interface adjusting module: the position determining module is used for adjusting the display interface to enable the identification control to be located in the preset content area when the position determining module judges that the distance between the identification control and the preset content area is smaller than a second preset threshold value; and when the position determining module determines that the distance between the identification control and the function control in the preset content area is smaller than a third preset threshold, adjusting the position of the function control in the preset content area to enable the identification control to be located on the function control in the preset content area.
7. A head-mounted display device, characterized by comprising the user operation prompting device based on the head-mounted display device of any one of claims 4 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610847467.9A CN107870702B (en) | 2016-09-23 | 2016-09-23 | User operation prompting method and device based on head-mounted display equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610847467.9A CN107870702B (en) | 2016-09-23 | 2016-09-23 | User operation prompting method and device based on head-mounted display equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107870702A CN107870702A (en) | 2018-04-03 |
| CN107870702B true CN107870702B (en) | 2021-06-01 |
Family
ID=61751750
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610847467.9A Active CN107870702B (en) | 2016-09-23 | 2016-09-23 | User operation prompting method and device based on head-mounted display equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107870702B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114079764A (en) * | 2020-08-11 | 2022-02-22 | 北京芯海视界三维科技有限公司 | 3D display method, 3D display device and 3D display device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB1143355A (en) * | 1965-10-23 | 1969-02-19 | Adage Inc | Hybrid computer |
| CN105929953A (en) * | 2016-04-18 | 2016-09-07 | 北京小鸟看看科技有限公司 | Operation guide method and apparatus in 3D immersive environment and virtual reality device |
| CN105975146A (en) * | 2016-04-26 | 2016-09-28 | 乐视控股（北京）有限公司 | Content distribution display method and apparatus |
-
2016
- 2016-09-23 CN CN201610847467.9A patent/CN107870702B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB1143355A (en) * | 1965-10-23 | 1969-02-19 | Adage Inc | Hybrid computer |
| CN105929953A (en) * | 2016-04-18 | 2016-09-07 | 北京小鸟看看科技有限公司 | Operation guide method and apparatus in 3D immersive environment and virtual reality device |
| CN105975146A (en) * | 2016-04-26 | 2016-09-28 | 乐视控股（北京）有限公司 | Content distribution display method and apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107870702A (en) | 2018-04-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11307666B2 (en) | Systems and methods of direct pointing detection for interaction with a digital device | |
| EP3250983B1 (en) | Method and system for receiving gesture input via virtual control objects | |
| WO2016112017A2 (en) | System and method for controlling immersiveness of head-worn displays | |
| CN106873886B (en) | Control method and device for stereoscopic display and electronic equipment | |
| CN106445157B (en) | Method and device for adjusting picture display direction | |
| WO2017076224A1 (en) | User interaction method and system based on virtual reality | |
| JP6399692B2 (en) | Head mounted display, image display method and program | |
| EP3591503B1 (en) | Rendering of mediated reality content | |
| JP2022534639A (en) | Artificial Reality System with Finger Mapping Self-Tactile Input Method | |
| JP7495156B2 (en) | Dynamic display method, device, storage medium, and electronic device based on an operating object | |
| CN111459264A (en) | 3D object interaction system and method and non-transitory computer readable medium | |
| WO2019166005A1 (en) | Smart terminal, sensing control method therefor, and apparatus having storage function | |
| CN108121438B (en) | Virtual keyboard input method and device based on head-mounted display equipment | |
| CN107870702B (en) | User operation prompting method and device based on head-mounted display equipment | |
| JP6535699B2 (en) | INFORMATION PROCESSING METHOD, INFORMATION PROCESSING PROGRAM, AND INFORMATION PROCESSING APPARATUS | |
| JP7287172B2 (en) | Display control device, display control method, and program | |
| CN108268123A (en) | Instruction identification method and device based on head-mounted display apparatus | |
| CN113034701A (en) | Method for modifying the rendering of a region of a 3D scene in an immersive environment | |
| CN109144234A (en) | Virtual reality system and its control method with external tracking and built-in tracking | |
| CN108268126B (en) | Interaction method and device based on head-mounted display equipment | |
| US20240126372A1 (en) | Interactive method, apparatus, electronic device and readable storage medium | |
| WO2024131405A1 (en) | Object movement control method and apparatus, device, and medium | |
| CN107870701A (en) | Interaction control method and device based on head-mounted display apparatus | |
| CN108445624B (en) | Head-mounted display device with augmented reality function | |
| CN118349138A (en) | Man-machine interaction method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |