CN110770677A - Key operation prompting method and head-mounted display equipment - Google Patents

Key operation prompting method and head-mounted display equipment Download PDF

Info

Publication number
CN110770677A
CN110770677A CN201780092189.3A CN201780092189A CN110770677A CN 110770677 A CN110770677 A CN 110770677A CN 201780092189 A CN201780092189 A CN 201780092189A CN 110770677 A CN110770677 A CN 110770677A
Authority
CN
China
Prior art keywords
key
user
touch
receives
physical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201780092189.3A
Other languages
Chinese (zh)
Inventor
王乐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Royole Technologies Co Ltd
Original Assignee
Shenzhen Royole Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Royole Technologies Co Ltd filed Critical Shenzhen Royole Technologies Co Ltd
Publication of CN110770677A publication Critical patent/CN110770677A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A key operation prompting method is operated on a head-mounted display device (100). The head-mounted display device (100) comprises a display screen (140) and a plurality of operation keys (130). The key operation prompting method comprises the following steps: judging whether the operation key (130) receives the operation of the user (S110); when the operation keys (130) receive the operation of the user, the control unit displays a distribution diagram (141) of the area where the currently operated operation key is located on the display screen (140) (S120), wherein a virtual key icon (142) corresponding to each operation key is displayed on the distribution diagram (141), and the arrangement mode of the virtual key icons (142) is consistent with the actual arrangement mode of the operation keys (130).

Description

Key operation prompting method and head-mounted display equipment Technical Field
The present invention relates to a key operation prompting technology, and in particular, to a key operation prompting method and a head-mounted display device.
Background
An existing HMD (Head mounted Display) includes a Display screen and operation keys for facilitating user operations. When a user wears the head-mounted display device on the head, the user can see the display screen with eyes, but the user cannot see the external operation keys, at this time, if the user needs to process images or videos on the display screen, such as moving images or zooming images, the user can only operate the operation keys by memorizing or feeling, so that misoperation can be caused, and the user is inconvenient to operate the operation keys.
Disclosure of Invention
The technical problem to be solved by the embodiments of the present invention is to provide a key operation prompting method and a head-mounted display device. The operation of the operation keys by the user can be facilitated.
In order to solve the above technical problem, a first aspect of the present invention provides a key operation prompting method, which is executed on a head-mounted display device, where the head-mounted display device includes a display screen and a plurality of operation keys, and the key operation prompting method includes:
judging whether the operation key receives the operation of a user;
when the operation keys receive the operation of a user, controlling to display a distribution diagram of the area where the currently operated operation key is located on the display screen, wherein a virtual key icon corresponding to each operation key is displayed on the distribution diagram, and the arrangement mode of the virtual key icons is consistent with the actual arrangement mode of the operation keys.
The invention provides a head-mounted display device, which comprises a display screen, a plurality of operation keys, a memory, a processor and a connecting line, wherein the processor, the memory, the display screen and the operation keys are electrically connected through the connecting line, the memory stores a group of program codes, and the processor is used for calling the program codes stored in the memory and executing the following operations:
judging whether the operation key receives the operation of a user;
when the operation keys receive the operation of a user, controlling to display a distribution diagram of the area where the currently operated operation key is located on the display screen, wherein a virtual key icon corresponding to each operation key is displayed on the distribution diagram, and the arrangement mode of the virtual key icons is consistent with the actual arrangement mode of the operation keys.
The embodiment of the invention has the following beneficial effects:
as long as the operation keys receive the operation of the user, such as touching or pressing, icons and arrangement positions of all keys can be displayed on the head-mounted display equipment, so that the user wearing the head-mounted display equipment can conveniently watch the keys and apply corresponding operation to the keys.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flowchart of a key operation prompting method according to a first embodiment of the present invention;
FIG. 2-1 is a schematic diagram of a head mounted display device in an embodiment of the invention;
2-2 are enlarged schematic views of the operation key region of the head-mounted display device in FIG. 1;
FIG. 3 is a diagram illustrating a distribution diagram of operating keys displayed on a display screen according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a distribution diagram of operating keys displayed on a display screen according to another embodiment of the present invention;
FIG. 5 is a flowchart illustrating a method for prompting a key operation according to a second embodiment of the present invention;
FIG. 6 is a flowchart illustrating a method for prompting a key operation according to a third embodiment of the present invention;
FIG. 7 is a flowchart illustrating a method for prompting a key operation according to a fourth embodiment of the present invention;
FIG. 8 is a diagram of a hardware configuration of a head mounted display device according to an embodiment of the invention;
reference numbers of the drawings:
100-a head mounted display device; 121-left concha key area; 122-right ear shell button area; 130-operating keys; 140-a display screen; 141-profile; 142-virtual key icons; 210-a processor; 220-memory.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terms "comprising" and "having," and any variations thereof, as appearing in the specification, claims and drawings of this application, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus. Furthermore, the terms "first," "second," and "third," etc. are used to distinguish between different objects and are not used to describe a particular order.
First embodiment
The embodiment of the invention provides a key operation prompting method which is operated on a head-mounted display device 100. Referring to fig. 2-1 and 2-2, the head-mounted display device 100 includes a display end 110 and a head-mounted end 120 rotatably connected to the display end 110. The display terminal 110 includes at least one display screen 140 (see fig. 3). The head mounted display device 100 also includes a plurality of operation keys 130. The plurality of operation keys 130 are disposed on the outer side of the head mounted display device 100 for user operation. In the present embodiment, the plurality of operation keys 130 are all disposed at the position where the display end 110 is rotatably connected with the head-wearing end 120, and specifically, the plurality of operation keys 130 are disposed on the earphone housing of the head-wearing display device 100. When the user wears the head-mounted display device 100, the video or image displayed on the display screen 140 can be viewed through the eyepiece.
Referring to fig. 1, a flowchart illustrating steps of a key operation prompting method according to a first embodiment of the invention is shown. The method comprises the following steps:
step S110: judging whether the operation key receives the operation of a user; if yes, go to step S120. If not, the process ends.
In the embodiment of the present invention, the operation key 130 may receive an operation of a user, and the operation of the user may be a pressing operation, a touching operation, or the like. When the operation key 130 receives the operation of the user, the head-mounted display device 100 receives a corresponding signal.
Step S120: and controlling to display a distribution diagram of the region where the currently operated operation key is located on the display screen, wherein a virtual key icon corresponding to each operation key is displayed on the distribution diagram, and the arrangement mode of the virtual key icons is consistent with the actual arrangement mode of the operation keys.
Referring to fig. 2 and fig. 3, in the present invention, the operation keys 130 may be disposed in a concentrated manner in one area, or may be disposed in a concentrated manner in a plurality of areas. In the following description, the operation keys 130 are distributed in 2 areas, and the areas where the plurality of operation keys 130 are located on the left earphone housing and the right earphone housing of the head mounted display device 100 are respectively referred to as a left earphone key area 121, and the areas where the plurality of operation keys 130 are located on the right earphone housing are referred to as a right earphone key area 122. When a certain operation key 130 in the left concha key area 121 receives an operation from a user, for example, the user touches or presses the operation key 130 with a finger, the head-mounted display device 100 receives a signal of the user operating the operation key 130, and accordingly, the head-mounted display device 100 controls a distribution diagram 141 on the display screen 140 for displaying a region where the currently operated operation key 130 is located, wherein the distribution diagram 141 displays a virtual key icon 142 corresponding to each operation key 130 in the left concha key area 121 where the currently operated operation key 130 is located, that is, the virtual key icons 142 on the distribution diagram 141 correspond to the operation keys 130 in the left concha key area 121 one by one, and the plurality of virtual key icons 142 are provided with corresponding function indicators for prompting the user about functions corresponding to the virtual key icons 142, such as an upward prompting arrow, a downward prompting arrow, a left arrow, A left prompt arrow, a right prompt arrow, etc., and the arrangement of the virtual key icons 142 is consistent with the actual arrangement of the operation keys 130. Thus, the user can know the functions of the other operation keys 130 near the currently operated operation key 130 through the profile 141.
In the present embodiment, the head-mounted display device 100 is provided with 10 operation keys 130, the 10 operation keys 130 are evenly distributed in the left earshell key region 121 and the right earshell key region 122, 4 peripheral operation keys 130 surround one central operation key 130 in the left earshell key region 121, and the 4 peripheral operation keys 130 are an upward moving operation key 130(▲), a downward moving operation key 130 (xxx), and a leftward moving operation key 130 (130), respectively
Figure PCTCN2017099683-APPB-000001
And an operation key 130 moved rightward
Figure PCTCN2017099683-APPB-000002
The operation key 130 at the center position is an OK key 130 (OK). When the user operates one of the operation keys 130 in the left concha key region 121, for example, the user operates the operation key 130 moving upward, the head-mounted display device 100 receives a signal that the user operates the operation key 130 moving upward, and controls the display screen 140 to display the profile 141. Referring to fig. 3, the distribution graph 141 displays a virtual key icon 142 corresponding to each operation key 130 of the left concha key region 121, i.e. a sub-buttonThe layout 141 displays 5 virtual key icons 142, wherein 4 virtual key icons 142 surround a virtual key icon 142 located in the center, the 4 virtual key icons 142 respectively correspond to the operation keys 130 moving upward, downward, leftward and rightward in the left concha key area 121, the arrangement of the 4 virtual key icons 142 is consistent with the actual arrangement of the 4 operation keys 130, and the virtual key icon 142 in the center corresponds to the confirmation operation key 130 in the left concha key area 121. In another embodiment, referring to fig. 4, when a finger of a user operates any one of the operation keys 130, at this time, the corresponding operation key 130 receives the operation of the user, the head-mounted display device controls the display screen 140 to display the distribution diagram 141, the distribution diagram 141 includes a virtual key icon 142 corresponding to each operation key 130 on the head-mounted display device 100, that is, the distribution diagram 141 displays the virtual key icons 142 corresponding to each operation key 130 in the left concha key zone 121 and the right concha key zone 122, and an arrangement manner of the virtual key icons 142 is consistent with an actual arrangement manner of the operation keys 130.
In the invention, the key operation prompting method judges whether the operation key receives the operation of a user. When the operation keys receive the operation of a user, controlling to display a distribution diagram of the area where the currently operated operation key is located on the display screen, wherein a virtual key icon corresponding to each operation key is displayed on the distribution diagram, and the arrangement mode of the virtual key icons is consistent with the actual arrangement mode of the operation keys. Therefore, after the user wears the head-mounted display device, if the user needs to process images or videos on the display screen, even if the user cannot see the operation keys, the user only needs to operate any one of the operation keys, a distribution diagram of the operation keys is displayed on the display screen, and the virtual key icons on the distribution diagram correspond to the actual distribution diagram of the operation keys. Therefore, the user can know the arrangement of the operation keys through the displayed distribution diagram, the user can conveniently operate the operation keys, and misoperation is effectively avoided.
Second embodiment
In this embodiment, the operation keys 130 include physical keys and touch sensors located on the physical keys. The touch sensor is a capacitive touch sensor, a resistive touch sensor, an infrared touch sensor or an ultrasonic touch sensor. In the present embodiment, the physical keys are used for inputting operation instructions represented by the operation keys 130, for example, inputting operation instructions for moving a picture or video in the display screen 140 up, down, left, and right. The touch sensor is located on the surface of the physical key for the user to press, and the touch sensor senses the operation of the user on the operation key 130. In this embodiment, the touch sensor senses contact between the user and the operation key.
Referring to fig. 5, a flowchart of steps of the key operation prompting method according to the second embodiment of the present invention is described. The method comprises the following steps:
s111: judging whether the touch sensor receives touch operation of a user; if yes, go to step S121; if not, the process ends.
S121: and controlling to display the distribution diagram of the area where the currently operated operation key is located on the display screen.
S151: the virtual key icon corresponding to the currently operated operation key is highlighted on the distribution map.
In this embodiment, the manner of highlighting the virtual key icon 142 corresponding to the currently operated operation key 130 on the distribution map 141 may be, for example: the virtual key icon 142 corresponding to the currently operated operation key 130 is identified by highlighting, highlighting with a specific color, or adding a cursor. Therefore, the user can obviously know the currently operated operation key 130, and can know the operation keys 130 with some functions around the currently operated operation key 130 from the distribution map 141, thereby facilitating the operation of the user.
After knowing the function of the operation key 130, in order to execute the function corresponding to the operation key 130, in this embodiment, the method further includes, after step S151:
s131: judging whether the physical key receives a pressing operation of a user; if yes, go to step S141; if not, the process ends.
In this embodiment, the user presses the physical key with a finger to implement a corresponding function, and since the touch sensor is located above the physical key, the user necessarily needs to contact the touch sensor before pressing the physical key. When the user presses the physical key with a finger, the head-mounted display device 100 receives a signal that the physical key is pressed, and thus determines that the physical key receives the pressing operation of the user. When the function corresponding to the operation key is executed, the profile may or may not disappear on the display screen 140.
S141: and controlling to execute the function corresponding to the physical key.
In this embodiment, if the physical key receives a pressing operation of the user, the head mounted display device 100 executes a function corresponding to the physical key, for example, when the physical key is a control command that can input an upward movement, the head mounted display device 100 controls a video or an image currently displayed on the display screen 140 to move upward when the physical key receives the pressing operation of the user.
Third embodiment
The main difference between this embodiment and the second embodiment is that the operation key is a physical key, and the physical key can receive a first pressing operation and a second pressing operation of a user on the physical key. When the physical key receives a first pressing operation of the user, the head-mounted display device 100 controls the distribution graph 141 to be displayed on the display screen 140, and when the physical key receives a second pressing operation of the user, the head-mounted display device 100 executes a function corresponding to the physical key.
Referring to fig. 6, in the present embodiment, the method for prompting key operation includes the steps of:
s112, judging whether the physical key receives a first pressing operation of a user; if yes, go to step S122; if not, the process ends.
In this embodiment, it is determined that the physical key receives the first pressing operation or the second pressing operation of the user by the strength of pressing the physical key with the finger of the user, and the greater the strength is, the greater the sinking height of the physical key is. When the sinking height of the physical key pressed by the finger of the user is smaller than the preset height, judging that the physical key receives a first pressing operation of the user at the moment; when the height of the physical key sunk when the user presses by the fingers is larger than or equal to the preset height, the physical key is judged to receive the second pressing operation of the user, and in the embodiment, the force of the first pressing operation is smaller than that of the second pressing operation. Here, the physical key must receive the first pressing operation first to receive the second pressing operation. In this embodiment, the preset height is, for example, 1/4, 1/3, 1/2, which is the maximum height that the physical key can depress, and the preset height can be set according to the requirement of the user.
S122: and controlling the distribution diagram of the physical key to be displayed on the display screen.
In this embodiment, when the physical key receives a first pressing operation of a user, the head-mounted display device 100 controls the display screen 140 to display the distribution graph 141 of the area where the currently operated physical key is located, a virtual key icon 142 corresponding to each physical key is displayed on the distribution graph 141, and an arrangement manner of the virtual key icons 142 is consistent with an actual arrangement manner of the physical keys.
S151: the virtual key icon corresponding to the currently operated operation key is highlighted on the distribution map.
In this embodiment, the manner of highlighting the virtual key icon 142 corresponding to the currently operated operation key 130 on the distribution map 141 may be, for example: the virtual key icon 142 corresponding to the currently operated operation key 130 is identified by highlighting, highlighting with a specific color, or adding a cursor. Therefore, the user can obviously know the currently operated operation key 130, and can know the operation keys 130 with some functions around the currently operated operation key 130 from the distribution map 141, thereby facilitating the operation of the user.
S132: judging whether the physical key receives a second pressing operation of the user; if yes, go to step S142; if not, the process ends.
In this embodiment, when the user further increases the strength to press the physical key, and the pressed height of the physical key reaches the preset height, the head-mounted display device 100 determines that the physical key receives the second pressing operation of the user.
S142: and controlling the head-mounted display equipment to execute the function corresponding to the physical key.
In this embodiment, when the depressed height of the physical key reaches the preset height, the physical key receives a second pressing operation of the user, and the head-mounted display device 100 controls the physical key to execute a function corresponding to the physical key.
Fourth embodiment
The main difference between this embodiment and the above embodiments is that the operation key is a touch key. The touch key can receive a first touch operation and a second touch operation of a user on the touch key, when the touch key receives the first touch operation of the user, the head-mounted display device controls the distribution diagram to be displayed on the display screen, and when the touch key receives the second touch operation of the user, the head-mounted display device executes a function corresponding to the touch key.
Referring to fig. 7, in the present embodiment, the method for prompting the operation of the key includes the steps of:
s113: judging whether the touch key receives a first touch operation of a user; if yes, go to step S123; if not, the process ends.
In this embodiment, it is determined that the touch key receives a first touch operation or a second touch operation of a user according to a duration for the user to touch the touch key. When the time length for touching the touch key by the user is less than the preset time length, the touch key receives a first touch operation of the user; when the time length for which the user touches the touch key is greater than or equal to the preset time length, the touch key receives a second touch operation of the user, and in this embodiment, the touch time length of the first touch operation is less than the touch time length of the second touch operation. Here, the touch key must receive the first touch operation first to receive the second touch operation. In this embodiment, the preset time period is, for example, 100ms, 200ms, 300ms, and the like, and may be set according to a requirement of a user.
And S123, controlling the display screen to display the distribution diagram of the area where the currently operated touch key is located.
In this embodiment, when the touch key receives a first touch operation of a user, the head-mounted display device 100 controls the display screen 140 to display the distribution graph 141, where a virtual key icon 142 corresponding to each touch key in an area where the touch key is operated is displayed on the distribution graph 141, and an arrangement manner of the virtual key icons 142 is consistent with an actual arrangement manner of the touch key.
S151: the virtual key icon corresponding to the currently operated operation key is highlighted on the distribution map.
In this embodiment, the manner of highlighting the virtual key icon 142 corresponding to the currently operated operation key 130 on the distribution map 141 may be, for example: the virtual key icon 142 corresponding to the currently operated operation key 130 is identified by highlighting, highlighting with a specific color, or adding a cursor. Therefore, the user can obviously know the currently operated operation key 130, and can know the operation keys 130 with some functions around the currently operated operation key 130 from the distribution map 141, thereby facilitating the operation of the user.
S133: judging whether the touch key receives a second touch operation of the user; if yes, go to step S143; if not, the process ends.
In this embodiment, when the user always touches the touch key and the touch duration reaches the preset duration, at this time, the touch key receives the second touch operation of the user, and the head-mounted display device 100 determines that the touch key receives the second touch operation of the user.
And S143, controlling the head-mounted display equipment to execute the function corresponding to the touch key.
In this embodiment, when the touch key is touched for a preset time, the touch key receives a second touch operation of the user, and the head-mounted display device 100 controls the head-mounted display device to execute a function corresponding to the touch key.
A head-mounted display device provided by an embodiment of the present invention will be described in detail with reference to fig. 8. Referring to fig. 2-1, 2-2, 3 and 8, in the present embodiment, the head-mounted display device 100 includes a display screen 140, a plurality of operation keys 130, a memory 220, a processor 210 and a connection line. The processor 210, the memory 220, the display 140 and the plurality of operation keys 130 are electrically connected through a connection line, wherein the memory 220 stores one or more sets of program codes, and the processor 210 calls the program codes stored in the memory 220 to perform the following operations:
judging whether the operation key 130 receives the operation of the user;
when the operation keys 130 receive the operation of the user, the display screen 140 is controlled to display a distribution diagram 141 of the area where the currently operated operation key 130 is located, wherein a virtual key icon 142 corresponding to each operation key 130 is displayed on the distribution diagram 141, and the arrangement manner of the virtual key icons 142 is consistent with the actual arrangement manner of the operation keys 130.
In this embodiment, the operation key 130 includes a physical key and a touch sensor located on the physical key, and the touch sensor senses a touch operation of the user on the operation key 130. In this embodiment, the processor 210 is configured to determine whether the operation key 130 receives an operation of a user, and specifically configured to: judging whether the touch sensor receives touch operation of a user; the processor 210 executes, when the operation key 130 receives an operation of a user, a distribution graph 141 of a region where the currently operated operation key 130 is located is controlled to be displayed on the display screen 140, and specifically, is used to: when the touch sensor receives a touch operation of a user, the touch sensor controls the display screen 140 to display the distribution graph 141 of the area where the currently operated operation key 130 is located.
After knowing the function corresponding to the corresponding operation key 130, in order to execute the function corresponding to the operation key 130, in this embodiment, the processor 210 further executes the following operations: judging whether the physical key receives a pressing operation of a user; and when the physical key receives the pressing operation of the user, controlling to execute the function corresponding to the physical key.
In order to facilitate the user to know the currently operated operation key 130, in this embodiment, the processor 210 further performs the following operations: the virtual key icon 142 corresponding to the currently operated operation key 130 is highlighted on the map 141. In this embodiment, the manner of highlighting the virtual key icon 142 corresponding to the currently operated operation key 130 on the distribution map 141 may be, for example: the virtual key icon 142 corresponding to the currently operated operation key 130 is identified by highlighting, highlighting with a specific color, or adding a cursor. Therefore, the user can clearly know the currently operated operation key 130 from the profile 141, and can know the operation keys 130 of some functions around the currently operated operation key 130 from the profile 141, thereby facilitating the operation of the user. In addition, for detailed description of the head-mounted display device 100 according to the embodiment of the present invention, please refer to the description of the first embodiment, which is not repeated herein.
In addition, in other embodiments of the present invention, the operation key is a physical key; the physical key receives a first pressing operation and a second pressing operation of a user; the processor executes and judges whether the operation key receives the operation of the user, specifically: judging whether the physical key receives a first pressing operation of a user or not; the processor executes that when the operation key receives the operation of the user, the processor controls the display screen to display a distribution map of the area where the currently operated operation key is located, specifically: and when the physical key receives a first pressing operation of a user, controlling to display the distribution diagram of the physical key on the display screen. The processor further performs the following operations: judging whether the physical key receives a second pressing operation of the user; and when the physical key receives a second pressing operation of the user, controlling the head-mounted display equipment to execute a function corresponding to the physical key. Here, the strength of the first pressing operation is smaller than the strength of the second pressing operation, so that the sinking height of the physical key during the first pressing operation is smaller than the sinking height of the physical key during the second pressing operation. For a detailed description of the head-mounted display device, reference is made to the description of the second embodiment, which is not repeated herein.
In addition, in other embodiments of the present invention, the operation key is a touch key, and the touch key can receive a first touch operation and a second touch operation of a user on the touch key; the judging whether the operation key receives the operation of the user specifically comprises the following steps: judging whether the touch key receives a first touch operation of a user; when the operation key receives the operation of a user, controlling to display a distribution diagram of a region where the currently operated operation key is located on the display screen, specifically: and when the touch key receives a first touch operation of a user, controlling to display an operation key distribution diagram of the area where the currently operated touch key is located on the display screen. The processor further performs the following operations: judging whether the touch key receives a second touch operation of the user; and when the touch key receives a second touch operation of the user, controlling the head-mounted display equipment to execute a function corresponding to the touch key. Here, the touch duration of the first touch operation is less than the touch duration of the second touch operation. For a detailed description of the head-mounted display device, reference is made to the description of the third embodiment, which is not repeated herein.
It should be noted that, in the present specification, the embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other. For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.

Claims (20)

  1. A key operation prompting method runs on a head-mounted display device, the head-mounted display device comprises a display screen and a plurality of operation keys, and the key operation prompting method is characterized by comprising the following steps:
    judging whether the operation key receives the operation of a user;
    when the operation keys receive the operation of a user, controlling to display a distribution diagram of the area where the currently operated operation key is located on the display screen, wherein a virtual key icon corresponding to each operation key is displayed on the distribution diagram, and the arrangement mode of the virtual key icons is consistent with the actual arrangement mode of the operation keys.
  2. A key operation prompting method according to claim 1, wherein the operation key includes a physical key and a touch sensor located on the physical key, the touch sensor sensing a touch operation of a user on the operation key;
    the step of judging whether the operation key receives the operation of the user specifically comprises the following steps: judging whether the touch sensor receives touch operation of a user;
    when the operation key receives the operation of a user, controlling to display a distribution map of a region where the currently operated operation key is located on the display screen specifically as follows: when the touch sensor receives touch operation of a user, the touch sensor controls the display screen to display an operation key distribution diagram of the area where the currently operated operation key is located.
  3. The key operation prompting method according to claim 2, further comprising, after the step of controlling the display of the distribution map of the region where the currently operated operation key is located on the display screen:
    judging whether the physical key receives a pressing operation of a user;
    and when the physical key receives the pressing operation of the user, controlling to execute the function corresponding to the physical key.
  4. A key operation prompting method according to claim 1, wherein the operation key is a physical key; the physical key receives a first pressing operation and a second pressing operation of a user;
    the step of judging whether the operation key receives the operation of the user specifically comprises the following steps: judging whether the physical key receives a first pressing operation of a user or not;
    when the operation key receives the operation of a user, controlling to display a distribution map of a region where the currently operated operation key is located on the display screen specifically as follows: and when the physical key receives a first pressing operation of a user, controlling to display the actual distribution diagram of the physical key on the display screen.
  5. The key operation prompting method of claim 4, further comprising:
    judging whether the physical key receives a second pressing operation of the user;
    and when the physical key receives a second pressing operation of the user, controlling the head-mounted display equipment to execute a function corresponding to the physical key.
  6. A key operation prompting method according to claim 4 or 5, characterized in that the strength of the first pressing operation is smaller than the strength of the second pressing operation.
  7. A key operation prompting method according to claim 1, wherein the operation key is a touch key capable of receiving a first touch operation and a second touch operation of a user on the touch key;
    the step of judging whether the operation key receives the operation of the user specifically comprises the following steps: judging whether the touch key receives a first touch operation of a user;
    when the operation key receives the operation of a user, controlling to display a distribution map of a region where the currently operated operation key is located on the display screen specifically as follows: and when the touch key receives a first touch operation of a user, controlling to display an operation key distribution diagram of the area where the currently operated touch key is located on the display screen.
  8. The key operation prompting method of claim 7, further comprising:
    judging whether the touch key receives a second touch operation of the user;
    and when the touch key receives a second touch operation of the user, controlling the head-mounted display equipment to execute a function corresponding to the touch key.
  9. A key operation prompting method according to claim 7 or 8, characterized in that the touch duration of the first touch operation is shorter than the touch duration of the second touch operation.
  10. A key operation prompting method according to any one of claims 1-5, 7 and 8, characterized by simultaneously or after the step of controlling the display of the distribution map of the region where the currently operated operation key is located on the display screen, further comprising:
    the virtual key icon corresponding to the currently operated operation key is highlighted on the distribution map.
  11. A head-mounted display device, comprising a display screen, a plurality of operation keys, a memory, a processor and a connection circuit, wherein the processor, the memory, the display screen, and the plurality of operation keys are electrically connected through the connection circuit, wherein the memory stores one or more sets of program codes, and the processor calls the program codes stored in the memory to perform the following operations:
    judging whether the operation key receives the operation of a user;
    when the operation keys receive the operation of a user, controlling to display a distribution diagram of the area where the currently operated operation key is located on the display screen, wherein a virtual key icon corresponding to each operation key is displayed on the distribution diagram, and the arrangement mode of the virtual key icons is consistent with the actual arrangement mode of the operation keys.
  12. The head-mounted display device of claim 11, wherein the operation keys comprise physical keys and touch sensors positioned on the physical keys, and the touch sensors sense touch operations of users on the operation keys;
    the judging whether the operation key receives the operation of the user is specifically configured to: judging whether the touch sensor receives touch operation of a user;
    when the operation key receives the operation of a user, controlling to display a distribution diagram of a region where the currently operated operation key is located on the display screen, specifically: when the touch sensor receives touch operation of a user, the touch sensor controls the display screen to display an operation key distribution diagram of the area where the currently operated operation key is located.
  13. The head-mounted display device of claim 12, wherein the processor further performs the following operations:
    judging whether the physical key receives a pressing operation of a user;
    and when the physical key receives the pressing operation of the user, controlling to execute the function corresponding to the physical key.
  14. The head-mounted display device of claim 11, wherein the operation keys are physical keys; the physical key receives a first pressing operation and a second pressing operation of a user;
    the processor executes and judges whether the operation key receives the operation of the user, specifically: judging whether the physical key receives a first pressing operation of a user or not;
    the processor executes that when the operation key receives the operation of the user, the processor controls the display screen to display a distribution map of the area where the currently operated operation key is located, specifically: and when the physical key receives a first pressing operation of a user, controlling to display the distribution diagram of the physical key on the display screen.
  15. The head-mounted display device of claim 14, wherein the processor further performs the following operations:
    judging whether the physical key receives a second pressing operation of the user;
    and when the physical key receives a second pressing operation of the user, controlling the head-mounted display equipment to execute a function corresponding to the physical key.
  16. The head-mounted display device of claim 14 or 15, wherein a strength of the first pressing operation is less than a strength of the second pressing operation.
  17. The head-mounted display device of claim 14, wherein the operation key is a touch key, and the touch key can receive a first touch operation and a second touch operation of a user on the touch key;
    the judging whether the operation key receives the operation of the user specifically comprises the following steps: judging whether the touch key receives a first touch operation of a user;
    when the operation key receives the operation of a user, controlling to display a distribution diagram of a region where the currently operated operation key is located on the display screen, specifically: and when the touch key receives a first touch operation of a user, controlling to display an operation key distribution diagram of the area where the currently operated touch key is located on the display screen.
  18. The head-mounted display device of claim 17, wherein the processor further performs the following operations:
    judging whether the touch key receives a second touch operation of the user;
    and when the touch key receives a second touch operation of the user, controlling the head-mounted display equipment to execute a function corresponding to the touch key.
  19. The head-mounted display device of claim 17 or 18, wherein: the touch duration of the first touch operation is less than the touch duration of the second touch operation.
  20. The head-mounted display device of any one of claims 11-15, 17, 18, wherein the processor further performs the following:
    the virtual key icon corresponding to the currently operated operation key is highlighted on the distribution map.
CN201780092189.3A 2017-08-30 2017-08-30 Key operation prompting method and head-mounted display equipment Pending CN110770677A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/099683 WO2019041171A1 (en) 2017-08-30 2017-08-30 Key operation prompt method and head-mounted display device

Publications (1)

Publication Number Publication Date
CN110770677A true CN110770677A (en) 2020-02-07

Family

ID=65524608

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780092189.3A Pending CN110770677A (en) 2017-08-30 2017-08-30 Key operation prompting method and head-mounted display equipment

Country Status (2)

Country Link
CN (1) CN110770677A (en)
WO (1) WO2019041171A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11178384B2 (en) * 2019-07-10 2021-11-16 Nintendo Co., Ltd. Information processing system, storage medium, information processing apparatus and information processing method

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104615237A (en) * 2013-11-05 2015-05-13 精工爱普生株式会社 Image display system, method of controlling image display system, and head-mount type display device
CN106873763A (en) * 2016-12-26 2017-06-20 奇酷互联网络科技（深圳）有限公司 Virtual reality device and its data inputting method

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105867609A (en) * 2015-12-28 2016-08-17 乐视移动智能信息技术（北京）有限公司 Method and device for watching video based on virtual reality helmet
WO2017113194A1 (en) * 2015-12-30 2017-07-06 深圳市柔宇科技有限公司 Head-mounted display apparatus, head-mounted display system, and input method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104615237A (en) * 2013-11-05 2015-05-13 精工爱普生株式会社 Image display system, method of controlling image display system, and head-mount type display device
CN106873763A (en) * 2016-12-26 2017-06-20 奇酷互联网络科技（深圳）有限公司 Virtual reality device and its data inputting method

Also Published As

Publication number Publication date
WO2019041171A1 (en) 2019-03-07

Similar Documents

Publication Publication Date Title
US9880734B2 (en) Handwritten information inputting device and portable electronic apparatus including handwritten information inputting device
US20170293351A1 (en) Head mounted display linked to a touch sensitive input device
US8274484B2 (en) Tracking input in a screen-reflective interface environment
KR100454171B1 (en) Input device
US20110298743A1 (en) Information processing apparatus
CN102057345A (en) Haptic user interface
US20070268268A1 (en) Touchpad Device
JP5718475B2 (en) Tactile presentation device
US20090167715A1 (en) User interface of portable device and operating method thereof
JP2011077863A (en) Remote operation device, remote operation system, remote operation method and program
JP5522755B2 (en) INPUT DISPLAY CONTROL DEVICE, THIN CLIENT SYSTEM, INPUT DISPLAY CONTROL METHOD, AND PROGRAM
CN104423697A (en) Display control device, display control method, and program
JP5766398B2 (en) Tactile presentation device
JP5243379B2 (en) Input device
EP2790393B1 (en) Mobile device with selectable user interface
CN110770677A (en) Key operation prompting method and head-mounted display equipment
EP3252585A1 (en) Display apparatus and control method thereof
JP2006351219A (en) Electronic apparatus
JP5292244B2 (en) Input device
US20140320419A1 (en) Touch input device
CN110538460A (en) Mobile device
US10955962B2 (en) Electronic device and control method thereof that switches a touch panel between an independent mode and a dual input mode
JP2010079772A (en) Coordinate indicating device and information processing device using the same
US20110001716A1 (en) Key module and portable electronic device
JP2011095925A (en) Input device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20200207

WD01 Invention patent application deemed withdrawn after publication