WO2017066992A1 - Dispositif de visiocasque, et système et procédé d'affichage d'informations d'invite - Google Patents

Dispositif de visiocasque, et système et procédé d'affichage d'informations d'invite Download PDF

Info

Publication number
WO2017066992A1
WO2017066992A1 PCT/CN2015/092688 CN2015092688W WO2017066992A1 WO 2017066992 A1 WO2017066992 A1 WO 2017066992A1 CN 2015092688 W CN2015092688 W CN 2015092688W WO 2017066992 A1 WO2017066992 A1 WO 2017066992A1
Authority
WO
WIPO (PCT)
Prior art keywords
prompt information
wearer
display
display device
speaker
Prior art date
Application number
PCT/CN2015/092688
Other languages
English (en)
Chinese (zh)
Inventor
李金鑫
Original Assignee
深圳市柔宇科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市柔宇科技有限公司 filed Critical 深圳市柔宇科技有限公司
Priority to PCT/CN2015/092688 priority Critical patent/WO2017066992A1/fr
Priority to CN201580073257.2A priority patent/CN107209375A/zh
Publication of WO2017066992A1 publication Critical patent/WO2017066992A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output

Definitions

  • the present invention relates to the field of display devices, and in particular, to a head mounted display device, a prompt information display system, and a method.
  • a head mounted display device refers to a display device that can be worn on a head.
  • HMD generally uses "near-eye optical system" to display multimedia information such as graphic pictures on a display screen a few centimeters from the eyeball.
  • the HMD type currently includes a transmissive HMD that can see external and HMD display content and an immersive HMD that only sees HMD display content.
  • Immersive HMDs have many entertaining applications, but when the wearer is immersed in the multimedia content played by HMD, it is difficult for others to communicate with the wearer. In addition, when communicating with other people, it is usually more troublesome for the wearer to take off the HMD.
  • the invention provides a head-mounted display device, a prompt information display system and a method.
  • the wearer When the wearer is immersed in the multimedia content played by the head-mounted display device, the wearer can be prompted if necessary, and the person wants to wear The person communicates, and the wearer can know the approximate location of the speaker according to the prompt information.
  • the present invention provides a head mounted display device including a display screen, a camera disposed on a front side of the head mounted display device, a processor, and a memory, the processor controlling the display screen to display an image captured by the camera .
  • the head mounted display device further includes: a plurality of microphones disposed at different positions of the head mounted display device.
  • the memory stores computer executable program code.
  • the processor invoking the computer executable program code, configured to: determine whether the head mounted display device is in a multimedia playing state; and when the head mounted display device is in the multimedia playing state, receive the a sound collected by the plurality of microphones; determining whether the received sound meets a preset condition; and when the received sound satisfies the preset condition, collecting sounds according to the plurality of microphones Determining sequentially the position of the speaker relative to the wearer; setting the prompt information to be displayed according to the position of the speaker relative to the wearer and setting the display position of the prompt information in the display screen; and displaying the prompt information in the Show location.
  • the head mounted display device further includes a sensing unit for sensing a movement of the wearer, the processor invoking the computer executable program code for a preset time period during which the prompt information is displayed, And determining, according to an output of the sensing unit, that the wearer performs a preset action, turning on the camera, and controlling the display screen to display an image captured by the camera.
  • the present invention further provides a prompt information display system, which is applied to a head mounted display device, comprising: a state determination module, configured to determine whether the head mounted display device is in a multimedia play state; and a sound receiving module, configured to When the head mounted display device is in the multimedia playing state, receiving sounds collected by a plurality of microphones disposed at different positions of the head mounted display device; and a preset condition determining module configured to determine the received sound Whether the preset condition is met; the position determining module is configured to determine, according to the sequence of the sounds collected by the plurality of microphones, the position of the speaker relative to the wearer when the received sound meets the preset condition; And for setting a prompt information to be displayed according to the position of the speaker relative to the wearer and setting a display position of the prompt information in the display screen; and a display control module, configured to display the prompt information on the display position.
  • a state determination module configured to determine whether the head mounted display device is in a multimedia play state
  • a sound receiving module configured to When the head
  • the present invention also provides a prompt information display method, which is applied to a head mounted display device, the method comprising: determining whether the head mounted display device is in a multimedia play state; wherein the head mounted display device is in the multimedia Receiving a sound collected by a plurality of microphones disposed at different positions of the head mounted display device in a playback state; determining whether the received sound satisfies a preset condition; and satisfying the pre-satisfaction in the received sound When the condition is set, determining the position of the speaker relative to the wearer according to the sequence of the sounds collected by the plurality of microphones; setting the prompt information to be displayed according to the position of the speaker relative to the wearer and setting the prompt information on the display screen a display position in the display; and displaying the prompt information at the display position.
  • the present invention also provides a computer readable storage medium storing computer readable program code, the computer readable program code being operative in a head mounted display device for determining whether the head mounted display device is a multimedia playing state; receiving, when the head mounted display device is in the multimedia playing state, sounds collected by a plurality of microphones disposed at different positions of the head mounted display device; determining whether the received sound is Satisfying a preset condition; the received sound satisfies the When the condition is preset, the position of the speaker relative to the wearer is determined according to the sequence of the sounds collected by the plurality of microphones; and the prompt information that needs to be displayed and the setting prompt information are displayed on the display according to the position of the speaker relative to the wearer. a display position in the screen; and displaying the prompt information at the display position.
  • the prompt information when the wearer is immersed in the played multimedia content, when the sounds collected by the plurality of microphones satisfy the preset condition, the prompt information is displayed, which prevents unnecessary prompts from causing interference to the wearer.
  • the position of the speaker relative to the wearer can be determined according to the sequence of the sounds collected by the plurality of microphones, and the prompt information is displayed according to the position of the speaker relative to the wearer, so that the wearer can know the approximate position of the speaker according to the prompt information.
  • the camera is turned on, and the image captured by the camera is displayed, so that the wearer communicates with the outside world. In this way, the wearer is given a choice to prevent unnecessary interference when the wearer is immersed in the multimedia content.
  • FIG. 1 is a schematic diagram of a basic structure of a head mounted display device according to an embodiment of the present invention
  • FIG. 2 is a perspective view of a head mounted display device in accordance with an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a basic structure of a prompt information display system according to an embodiment of the present invention.
  • 4 to 8 are schematic diagrams showing prompt information in an embodiment of the present invention.
  • FIG. 9 is a flowchart of a method for displaying prompt information according to an embodiment of the present invention.
  • FIG. 10 is a flowchart of a method for displaying prompt information according to another embodiment of the present invention.
  • a head mounted display device 100 includes a display screen 11 , a camera 12 disposed on a front side of the head mounted display device 100 , and a plurality of cameras disposed at different positions of the head mounted display device 100 .
  • the processor 14 can display the image captured by the camera 12 in the display screen 11.
  • a plurality of microphones 13 are disposed in different orientations of the head mounted display device 100. For example, as shown in FIG. 2, four intervals are evenly disposed on a horizontal line on the front of the head mounted display device 100.
  • At least one is disposed behind the four microphones 13, such as the headband of the head mounted display device 100, and the microphone 13 is used to determine that the sound source is from the front compared with any of the four front microphones 13. Still behind.
  • the voice of the speaker can be collected by different microphones 13 in succession.
  • the prompt information display system 200 runs in the head mounted display device 100, and may include a state determining module 201, a sound receiving module 202, a preset condition determining module 203, a position determining module 204, and a setting.
  • Module 205 and display control module 206 The above various modules may be stored in the memory 15 and called by the processor 16 to perform the prompt information display function of the head mounted display device 100.
  • Each of the above modules may also be a software program that is cured in the processor 16.
  • the state determining module 201 is configured to determine whether the head mounted display device 100 is in a multimedia playing state. When in the multimedia playing state, it means that the wearer is immersed in the played multimedia content, and if others want to communicate with the wearer, it takes a lot of effort to attract the attention of the wearer.
  • the state determining module 201 can determine whether the head mounted display device 100 is in a multimedia playing state by determining whether the camera 12 is in an open state.
  • the camera 12 When the camera 12 is in the on state, it generally indicates that the wearer is communicating with the outside world using the head mounted display device 100.
  • the camera 12 When the camera 12 is not in the on state, it generally indicates that the multimedia display device 100 is in the multimedia playing state, and the wearer is immersed in the played multimedia content.
  • the state determining module 201 can determine whether the head mounted display device 100 is played in full screen.
  • the multimedia content determines whether the head mounted display device 100 is in a multimedia playing state. When the multimedia content is played in full screen, it means that the head mounted display device 100 is in the multimedia playing state, and the wearer is immersed in the played multimedia content.
  • the head mounted display device 100 is playing multimedia but is not playing in full screen mode, it is necessary to further determine whether the head mounted display device 100 is in the multimedia playing state by determining whether the camera 12 is in the on state. When it is further determined that the camera 12 is not turned on, it can be determined that the head mounted display device 100 is in a multimedia playing state, and the wearer is immersed in the played multimedia content. If it is further determined that the camera 12 is turned on, it can be judged that the wearer is watching the multimedia and also viewing the image captured by the camera 12, that is, may communicate with the outside world. At this time, it can be judged that the head mounted display device 100 is not in the multimedia playing state.
  • the sound receiving module 202 is configured to receive the sounds collected by the plurality of microphones 13 when determining that the head mounted display device 100 is in the multimedia playing state.
  • the preset condition determining module 203 is configured to determine whether the received sound meets the preset condition.
  • the preset condition determining module 203 determines that the received sound satisfies the preset condition when the received sound satisfies any one of the following multiple conditions.
  • the plurality of conditions include: the intensity of the received sound is greater than a preset value, the received sound includes at least one preset content, and the timbre of the received sound matches a preset timbre.
  • the preset condition determining module 203 determines that the received sound meets the preset condition when the received sound satisfies any one of the following multiple conditions.
  • the plurality of conditions include: the intensity of the received sound is greater than a preset value, the received sound includes at least one preset content, and the timbre of the received sound matches a preset timbre.
  • the content of interest to the wearer may be set in the head mounted display device 100 in advance, such as the name of the wearer and the wearer's interest. Sports and so on. If at least the timbre of the received sound is matched with a preset timbre as a determination condition, at least one timbre may be set in the head mounted display device 100 in advance, such as the timbre of the wearer's friend, the wearer's The tone of the child and so on.
  • the location determining module 204 is configured to, according to the multiple microphones, when the received sound meets the preset condition The order in which the wind 13 collects the sound determines the position of the speaker relative to the wearer.
  • the order in which the plurality of microphones 13 collect the sound is determined by first detecting an effective sound signal input by the speaker, and recording the time at which each of the microphones 13 collects the sound signal after detecting the effective sound signal. Next, the order in which the respective microphones 13 collect the sound signals is calculated based on the time at which the respective microphones 13 collect the sound signals.
  • determining the position of the speaker relative to the wearer according to the sequence of the sounds collected by the plurality of microphones 13 may specifically be: determining that the microphone 13 disposed in the left front of the head mounted display device 100 first collects the sound, and determines to speak. The person is located at the left front of the wearer; when it is judged that the microphone 13 disposed at the right front of the head mounted display device 100 first collects the sound, it is determined that the speaker is located at the right front of the wearer; and so on, when the speaker is located around the wearer
  • the position of the speaker relative to the wearer can be determined according to the order in which the sounds are collected by the plurality of microphones 13.
  • the setting module 205 is configured to set prompt information that needs to be displayed according to the position of the speaker relative to the wearer and set a display position of the prompt information in the display screen 11.
  • the setting information to be displayed according to the position of the speaker relative to the wearer and the display position of the setting prompt information in the display screen 11 may be specifically: the setting module 205 determines that the speaker is located in the shooting range of the camera 12 according to the position of the speaker relative to the wearer.
  • the prompt information to be displayed is set as the first prompt information
  • the display position of the first prompt information in the display screen 11 is set as the first display position according to the position of the speaker relative to the wearer, and the speaker is relatively worn according to the speaker.
  • the prompt information to be displayed is set as the first prompt information or the second prompt information different from the first prompt information, and according to the position of the speaker relative to the wearer.
  • the display position of the first prompt information in the display screen 11 is set to be a second display position different from the first display position.
  • the first prompt information and the second prompt information may be graphics, arrows, characters, and the like.
  • the difference between the first prompt information and the second prompt information may include a difference in color, graphics, and the like.
  • the needs can be set according to the speaker's position relative to the wearer and the setting of the judgment condition.
  • the prompt message displayed For example, when at least the preset content is matched as the determination condition, the prompt information that needs to be displayed may be set to include the preset content. Then, the display color of the presentation information and the like are determined based on the position of the speaker relative to the wearer. It is also possible to first determine the display color of the prompt information according to the position of the speaker relative to the wearer, and then set the specific content included in the displayed prompt information according to the judgment condition. When the displayed prompt information includes the preset content, the wearer can quickly judge whether it is necessary to communicate with the wearer according to the prompt information.
  • the prompt information to be displayed may be set to include the identity information of the speaker, such as the name of the speaker or the relationship between the speaker and the wearer, and the like. In this way, the wearer can determine the identity of the current speaker according to the displayed prompt information to quickly determine whether it is necessary to communicate with the speaker.
  • the display control module 206 is configured to display the prompt information at the display position.
  • the display of the prompt information will be exemplified below with reference to FIGS. 4 to 8.
  • the first prompt information may be a text (such as a caller in front of the left), an arrow (pointing to the position of the speaker), or a graphic.
  • FIG. 7 to FIG.
  • the second prompt information is displayed.
  • the first prompt information may be the same as the second prompt information.
  • the second prompt information (graphic) in FIG. 7 is the same as the first prompt information (graphic) in FIG. 6.
  • the first prompt information may also be different from the second prompt information.
  • the second prompt information in FIG. 8 is different from any one of the first prompt information in FIG. 4 to FIG. 6.
  • the figure shows that the same graphic has different filling effects, but is not limited thereto. Is the same graphics different colors, different graphics and so on.
  • the same prompt information may be displayed at different display positions, or may be set. Different prompt information is displayed at different display positions, so that the wearer can quickly determine the approximate position of the speaker according to the display of the prompt information, thereby judging whether it is necessary to turn the head or turn around to see the speaker.
  • the first display position 111 on which the presentation information is displayed may be changed according to the approximate position of the speaker determined based on the determined approximate position of the speaker.
  • the first display position 111 when the approximate position of the speaker is in the left front, the first display position 111 is located at the upper left of the display screen 11; and when it is determined that the approximate position of the speaker is directly in front, the first display position 111 is located on the display screen. Just above the top of the screen, the middle position above the display. Therefore, the first display position 111 may be an area between the upper display corner of the display screen 11 and the second display position of the upper right corner.
  • the prompt information when the wearer is immersed in the played multimedia content, when the sounds collected by the plurality of microphones 13 satisfy the preset condition, the prompt information is displayed, which prevents unnecessary prompts from causing interference to the wearer.
  • the position of the speaker relative to the wearer can be determined according to the sequence of the sounds collected by the plurality of microphones 13, and when the position of the relative wearer is different, the prompt information is displayed at different positions, so that the wearer can According to the prompt information, the approximate position of the speaker is quickly determined, thereby judging whether it is necessary to turn the head or turn around to see the speaker.
  • the head mounted display device 100 may further include a sensing unit 16 for sensing the movement of the wearer.
  • the prompt information display system 200 further includes a preset action determining module 207, configured to determine, according to the output of the sensing unit 15, whether the wearer performs a preset action within a preset time period during which the prompt information is displayed.
  • the sensing unit 15 may be a gyroscope for sensing the head motion of the wearer.
  • the preset action may be a head, a nod, a left swing, a right swing, or a shaking head.
  • the sensing unit 15 may be a camera for capturing an eye or a light sensor for sensing eye movements. Under these conditions, the preset action can be two consecutive eyes or two seconds of closing the eyes.
  • the display control module 206 is further configured to: when the wearer performs the preset action within the preset time period during which the prompt information is displayed, turn on the camera 12, control the display screen 11 to display the image captured by the camera 12, and stop displaying the prompt information.
  • the display control module 206 can control the display screen 11 to display the image captured by the camera 12 in full screen, or display the avatar captured by the camera 12 and the multimedia content being played by the head mounted display device 100 in a split screen display manner.
  • the display control module 206 is further configured to: the wearer does not execute within a preset time period during which the prompt information is displayed. When the preset action is reached, the prompt message is stopped when the preset time period is reached.
  • the camera 12 is turned on, and the image captured by the camera 12 is displayed so that the wearer can communicate with the outside world. In this way, the wearer is given a choice to prevent unnecessary interference when the wearer is immersed in the multimedia content.
  • an embodiment of the present invention provides a method for displaying a prompt information, which is applied to the above-described head mounted display device 100, and includes the following steps:
  • Step 301 Determine whether the head mounted display device 100 is in a multimedia playing state. If no. Proceed to step 301, and if yes, go to step 302.
  • whether the head mounted display device 100 is in a multimedia playing state can be determined by determining whether the camera 12 is in an open state.
  • the camera 12 When the camera 12 is in the on state, it generally indicates that the wearer is communicating with the outside world using the head mounted display device 100.
  • the camera 12 When the camera 12 is not in the on state, it generally indicates that the multimedia display device 100 is in the multimedia playing state, and the wearer is immersed in the played multimedia content.
  • whether the head mounted display device 100 is in the multimedia playing state can be determined by determining whether the head mounted display device 100 plays the multimedia content in full screen.
  • the multimedia content is played in full screen, it means that the head mounted display device 100 is in the multimedia playing state, and the wearer is immersed in the played multimedia content.
  • the head mounted display device 100 is playing the multimedia content but is not playing in the full screen mode, it is further determined whether the head mounted display device 100 is in the multimedia playing state by determining whether the camera 12 is in the on state. When it is further determined that the camera 12 is not turned on, it can be determined that the head mounted display device 100 is in a multimedia playing state, and the wearer is immersed in the played multimedia content. If it is further determined that the camera 12 is turned on, it can be determined that the wearer is watching the multimedia content and also viewing the image captured by the camera 12, that is, may communicate with the outside world. At this time, it can be judged that the head mounted display device 100 is not in the multimedia playing state.
  • Step 302 receiving sounds collected by the plurality of microphones 13.
  • Step 303 Determine whether the received sound meets a preset condition. If yes, go to step 304. Otherwise, return to step 301.
  • the received sound satisfies any one of the following conditions, it is determined that the received sound satisfies the preset condition.
  • the plurality of conditions include: the intensity of the received sound is greater than a preset value, the received sound includes at least one preset content, and the timbre of the received sound matches a preset timbre.
  • the received sound satisfies any one of the following multiple conditions, it is determined that the received sound satisfies a preset condition.
  • the plurality of conditions include: the intensity of the received sound is greater than a preset value, the received sound includes at least one preset content, and the timbre of the received sound matches a preset timbre.
  • the content of interest to the wearer may be set in the head mounted display device 100 in advance, such as the name of the wearer and the wearer's interest. Sports and so on. If at least the timbre of the received sound is matched with a preset timbre as a determination condition, at least one timbre may be set in the head mounted display device 100 in advance, such as the timbre of the wearer's friend, the wearer's The tone of the child and so on.
  • Step 304 Determine the position of the speaker relative to the wearer according to the order in which the plurality of microphones 13 collect the sound.
  • the order in which the plurality of microphones 13 collect the sound is determined by first detecting an effective sound signal input by the speaker, and recording the time at which each of the microphones 13 collects the sound signal after detecting the effective sound signal. Next, the order in which the respective microphones 13 collect the sound signals is calculated based on the time at which the respective microphones 13 collect the sound signals.
  • determining the position of the speaker relative to the wearer according to the sequence of the sounds collected by the plurality of microphones 13 may specifically be: determining that the microphone 13 disposed in the left front of the head mounted display device 100 first collects the sound, and determines to speak. The person is located at the left front of the wearer; it is judged that the microphone 13 disposed at the right front of the head mounted display device 100 first collects the sound, and determines that the speaker is located at the right front of the wearer; and so on, when the speaker is located around the wearer, The position of the speaker relative to the wearer can be determined according to the order in which the sounds are collected by the plurality of microphones 13.
  • Step 305 setting prompt information and setting according to the position of the speaker relative to the wearer.
  • the prompt information that needs to be displayed according to the position of the speaker relative to the wearer and the display position of the setting prompt information in the display screen 11 may be specifically determined according to the position of the speaker relative to the wearer that the speaker is located at the camera 12.
  • the prompt information to be displayed is set as the first prompt information
  • the display position of the first prompt information in the display screen 11 is set as the first display position according to the position of the speaker relative to the wearer, and according to the speaker
  • the prompt information to be displayed is set as the first prompt information or the second prompt information different from the first prompt information, and according to the speaker relative wearer
  • the position setting of the second prompt information in the display screen 11 is a second display position different from the first display position.
  • the first prompt information and the second prompt information may be graphics, arrows, characters, and the like.
  • the difference between the first prompt information and the second prompt information may include a difference in color, graphics, and the like.
  • the same prompt information may be displayed at different display positions, or may be set. Different prompt information is displayed at different display positions, so that the wearer can quickly determine the approximate position of the speaker according to the display of the prompt information, thereby judging whether it is necessary to turn the head or turn around to see the speaker.
  • the prompt information to be displayed may be set in common according to the position of the speaker relative to the wearer and the setting of the judgment condition. For example, when at least the preset content is matched as the determination condition, the prompt information that needs to be displayed may be set to include the preset content. Then, the display color of the presentation information and the like are determined based on the position of the speaker relative to the wearer. It is also possible to first determine the display color of the prompt information according to the position of the speaker relative to the wearer, and then set the specific content included in the displayed prompt information according to the judgment condition. When the displayed prompt information includes the preset content, the wearer can quickly judge whether it is necessary to communicate with the wearer according to the prompt information.
  • the prompt information to be displayed may be set to include the identity information of the speaker, such as the name of the speaker or the relationship between the speaker and the wearer, and the like. In this way, the wearer can determine the identity of the current speaker according to the displayed prompt information to quickly determine whether it is necessary to communicate with the speaker.
  • step 306 the prompt information is displayed at the display position.
  • the prompt information when the wearer is immersed in the played multimedia content, when the sounds collected by the plurality of microphones 13 satisfy the preset condition, the prompt information is displayed, which prevents unnecessary prompts from causing interference to the wearer.
  • the position of the speaker relative to the wearer can be determined according to the order in which the plurality of microphones 13 collect the sound, and when the position relative to the wearer is different, different prompt information is displayed, so that the wearer can The prompt information quickly determines the approximate position of the speaker, thereby judging whether it is necessary to turn around or turn around to see the speaker.
  • another embodiment of the present invention provides a method for displaying a prompt information, which is applied to the above-described head mounted display device 100, and includes the following steps:
  • Step 401 Determine whether the head mounted display device 100 is in a multimedia playing state. If no. Proceed to step 401, and if yes, perform step 402. Step 401 is similar to step 301, and details are not described herein again.
  • Step 402 receiving sounds collected by the plurality of microphones 13.
  • Step 403 Determine whether the received sound meets a preset condition. If yes, go to step 404, otherwise go back to step 401. Step 403 is similar to step 303, and details are not described herein again.
  • Step 404 determining the position of the speaker relative to the wearer according to the order in which the plurality of microphones 13 collect the sound. Step 404 is similar to step 304, and details are not described herein again.
  • Step 405 setting the prompt information to be displayed according to the position of the speaker relative to the wearer and setting the display position of the prompt information in the display screen 11.
  • Step 405 is similar to step 305, and details are not described herein again.
  • step 406 the prompt information is displayed at the display position.
  • Step 407 Determine whether the wearer performs a preset action within a preset time period during which the prompt information is displayed. If yes, go to step 408, otherwise go to step 409.
  • the sensing unit 15 may be a gyroscope for sensing the head motion of the wearer.
  • the preset action may be a head, a nod, a left swing, a right swing, or a shaking head.
  • the sensing unit 15 may be a camera for capturing an eye or a light sensor for sensing eye movements. Under such conditions, The preset action can be two consecutive eyes or two seconds of closing the eyes.
  • step 408 the camera 12 is turned on, the display screen 11 is displayed to display the image captured by the camera 12, and the prompt information is stopped, and the process ends.
  • the display screen 11 can be controlled to display the image captured by the camera 12 in full screen, or display the avatar captured by the camera 12 and the multimedia content being played by the head mounted display device 100 in a split screen display manner.
  • Step 409 after the preset time period elapses, the display of the prompt information is stopped, and the process returns to step 401.
  • the camera 12 is turned on, and the image captured by the camera 12 is displayed so that the wearer can communicate with the outside world. In this way, the wearer is given a choice to prevent unnecessary interference when the wearer is immersed in the multimedia content.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

La présente invention concerne un dispositif de visiocasque, et un système et un procédé d'affichage d'informations d'invite. Le procédé comprend les étapes consistant à : déterminer si un dispositif d'affichage est dans un état de lecture multimédia ; si le dispositif d'affichage est dans l'état de lecture multimédia, recevoir un son collecté par une pluralité de microphones disposés à différentes positions du dispositif d'affichage ; déterminer si le son reçu satisfait à une condition prédéfinie ; si le son reçu satisfait à la condition prédéfinie, déterminer la position d'un haut-parleur par rapport à un utilisateur en fonction de l'ordre dans lequel la pluralité de microphones collectent le son ; définir des informations d'invite qui doivent être affichées en fonction de la position du haut-parleur par rapport à l'utilisateur et définir une position d'affichage des informations d'invite dans un écran d'affichage ; et afficher les informations d'invite à la position d'affichage. Dans la présente invention, lorsqu'un utilisateur est immergé dans un contenu multimédia lu, l'utilisateur peut être informé, si nécessaire, que quelqu'un souhaite communiquer avec l'utilisateur, et l'utilisateur peut rapidement déterminer la position approximative d'un haut-parleur en fonction des informations d'invite.
PCT/CN2015/092688 2015-10-23 2015-10-23 Dispositif de visiocasque, et système et procédé d'affichage d'informations d'invite WO2017066992A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2015/092688 WO2017066992A1 (fr) 2015-10-23 2015-10-23 Dispositif de visiocasque, et système et procédé d'affichage d'informations d'invite
CN201580073257.2A CN107209375A (zh) 2015-10-23 2015-10-23 头戴式显示设备、提示信息显示***及方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2015/092688 WO2017066992A1 (fr) 2015-10-23 2015-10-23 Dispositif de visiocasque, et système et procédé d'affichage d'informations d'invite

Publications (1)

Publication Number Publication Date
WO2017066992A1 true WO2017066992A1 (fr) 2017-04-27

Family

ID=58556620

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/092688 WO2017066992A1 (fr) 2015-10-23 2015-10-23 Dispositif de visiocasque, et système et procédé d'affichage d'informations d'invite

Country Status (2)

Country Link
CN (1) CN107209375A (fr)
WO (1) WO2017066992A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110010138A (zh) * 2017-12-07 2019-07-12 松下知识产权经营株式会社 头戴式显示器及其控制方法
CN112637495A (zh) * 2020-12-21 2021-04-09 维沃移动通信有限公司 拍摄方法、装置、电子设备及可读存储介质

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110139016B (zh) * 2019-07-05 2024-06-07 昆山玖趣智能科技有限公司 一种头戴式摄像头多麦克风***
CN111818418A (zh) * 2020-07-12 2020-10-23 韶关市启之信息技术有限公司 一种耳机背景显示方法与***

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070195012A1 (en) * 2006-02-22 2007-08-23 Konica Minolta Holdings Inc. Image display apparatus and method for displaying image
CN102543099A (zh) * 2010-12-24 2012-07-04 索尼公司 声音信息显示装置、声音信息显示方法和程序
CN103946733A (zh) * 2011-11-14 2014-07-23 谷歌公司 在可穿戴计算***上显示声音指示
CN103995685A (zh) * 2013-02-15 2014-08-20 精工爱普生株式会社 信息处理装置以及信息处理装置的控制方法

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103049077A (zh) * 2011-10-14 2013-04-17 鸿富锦精密工业（深圳）有限公司 声音反馈装置及其工作方法
CN103067725A (zh) * 2012-12-14 2013-04-24 青岛歌尔声学科技有限公司 3d眼镜、3d影像***及其使用方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070195012A1 (en) * 2006-02-22 2007-08-23 Konica Minolta Holdings Inc. Image display apparatus and method for displaying image
CN102543099A (zh) * 2010-12-24 2012-07-04 索尼公司 声音信息显示装置、声音信息显示方法和程序
CN103946733A (zh) * 2011-11-14 2014-07-23 谷歌公司 在可穿戴计算***上显示声音指示
CN103995685A (zh) * 2013-02-15 2014-08-20 精工爱普生株式会社 信息处理装置以及信息处理装置的控制方法

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110010138A (zh) * 2017-12-07 2019-07-12 松下知识产权经营株式会社 头戴式显示器及其控制方法
CN110010138B (zh) * 2017-12-07 2023-11-21 松下知识产权经营株式会社 头戴式显示器及其控制方法
CN112637495A (zh) * 2020-12-21 2021-04-09 维沃移动通信有限公司 拍摄方法、装置、电子设备及可读存储介质

Also Published As

Publication number Publication date
CN107209375A (zh) 2017-09-26

Similar Documents

Publication Publication Date Title
US11962741B2 (en) Methods and system for generating and displaying 3D videos in a virtual, augmented, or mixed reality environment
US10437069B2 (en) Display control device, display control method, and computer program
US10497175B2 (en) Augmented reality virtual monitor
US9927948B2 (en) Image display apparatus and image display method
CN107924584B (zh) 增强现实
US9922464B2 (en) Occluded virtual image display
US9076033B1 (en) Hand-triggered head-mounted photography
WO2019216419A1 (fr) Programme, support d'enregistrement, dispositif de présentation de réalité augmentée et procédé de présentation de réalité augmentée
WO2017066992A1 (fr) Dispositif de visiocasque, et système et procédé d'affichage d'informations d'invite
CN109416562B (zh) 用于虚拟现实的装置、方法和计算机可读介质
JP6298563B1 (ja) ヘッドマウントデバイスによって仮想空間を提供するためのプログラム、方法、および当該プログラムを実行するための情報処理装置
CN110634189A (zh) 用于在沉浸式混合现实体验期间用户警报的***和方法
KR20190121758A (ko) 정보 처리 장치, 정보 처리 방법, 및 프로그램
WO2019019232A1 (fr) Procédé de lecture vidéo basé sur un dispositif formant casque à vr, et dispositif formant casque à vr
US20230341752A1 (en) External recording indicators
US20190080432A1 (en) Camera-based Transparent Display
WO2015129522A1 (fr) Récipient, système d'affichage d'image, procédé d'affichage d'image, programme d'affichage d'image et support d'enregistrement
WO2020071029A1 (fr) Dispositif de traitement d'informations, procédé de traitement d'informations et support d'enregistrement
US20210383097A1 (en) Object scanning for subsequent object detection
WO2017022769A1 (fr) Visiocasque, procédé de commande d'affichage, et programme
US11055533B1 (en) Translating sound events to speech and AR content
JP2017147512A (ja) コンテンツ再生装置、コンテンツ再生方法及びプログラム
TW202328871A (zh) 用於擴展現實系統的動態內容呈現
US20180300918A1 (en) Wearable device and method for displaying evacuation instruction
JP2019012509A (ja) ヘッドマウントデバイスによって仮想空間を提供するためのプログラム、方法、および当該プログラムを実行するための情報処理装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15906510

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 12/09/2018)

122 Ep: pct application non-entry in european phase

Ref document number: 15906510

Country of ref document: EP

Kind code of ref document: A1