WO2016087033A1 - Procédé de fonctionnement de lunettes de réalité virtuelle et dispositif d'affichage - Google Patents

Procédé de fonctionnement de lunettes de réalité virtuelle et dispositif d'affichage Download PDF

Info

Publication number
WO2016087033A1
WO2016087033A1 PCT/EP2015/002385 EP2015002385W WO2016087033A1 WO 2016087033 A1 WO2016087033 A1 WO 2016087033A1 EP 2015002385 W EP2015002385 W EP 2015002385W WO 2016087033 A1 WO2016087033 A1 WO 2016087033A1
Authority
WO
WIPO (PCT)
Prior art keywords
virtual reality
reality glasses
environment
virtual
displayed
Prior art date
Application number
PCT/EP2015/002385
Other languages
German (de)
English (en)
Inventor
Marcus KÜHNE
Original Assignee
Audi Ag
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Audi Ag filed Critical Audi Ag
Publication of WO2016087033A1 publication Critical patent/WO2016087033A1/fr

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality

Definitions

  • the invention relates to a method for operating a virtual reality goggle and to a display device with such a virtual reality goggle.
  • a virtual reality goggle is a particular form of a so-called head-mounted display, which is a head-worn visual output device. It presents images on a near-eye screen or projects them directly onto the retina.
  • a virtual reality glasses additionally has sensors for detecting the movement of the head.
  • the display of a calculated graphic can be adapted to a movement of the wearer of the glasses.
  • the displayed image areas of head-mounted displays are considerably larger than the freestanding screens and, in extreme cases, even cover the entire field of vision of the user. Since the display follows the wearer's head movement through the head posture, it gives the feeling of moving directly into a computer generated image field.
  • a virtual reality can be represented, whereby as a virtual reality usually the representation and simultaneous perception of reality in its physical properties is described in a real-time computer-generated, interactive virtual environment.
  • a virtual environment is displayed by means of the virtual reality glasses when the virtual reality glasses are operated in a first operating mode.
  • a camera image is displayed from a captured by a camera system environment of a person who has put on the virtual reality glasses, using the virtual reality glasses when the virtual reality glasses are operated in a second mode of operation.
  • a switchover between the operating modes ie between the first operating mode and the second operating mode, takes place as a function of an actuating signal provided by an operating device.
  • the camera system can have a mono or even a stereo camera, whereby the insertion of a real image by means of virtual reality glasses is made possible.
  • virtual reality glasses for example when using virtual reality glasses as part of a sales process, it can occur at a relatively high frequency that a wearer of the virtual reality glasses switches between the first and the second operating mode would like to.
  • a wearer of the virtual reality goggles only needs to operate the operator in a predetermined manner to provide the corresponding actuation signal. As a result, switching takes place between the first and second operating modes.
  • a person who has put on the virtual reality glasses can thus be displayed in a particularly simple manner both virtual content and real content using the virtual reality glasses.
  • the virtual environment is displayed as long as no actuation signal is provided by the operating device, and the real environment is displayed is as long as the actuating signal is provided by the operating device.
  • the display of the virtual environment corresponds to a standard mode, wherein the person who has put on the virtual reality glasses must make an active action, in the form of an operation of the operating device, to himself to display the real environment in the form of the camera image.
  • the real environment is displayed as long as no actuation signal is provided by the operating device, and the virtual environment is displayed as long as the actuation signal is provided by the operating device.
  • the display of the real environment can also be provided as the default setting or standard mode, whereby only a corresponding predetermined actuation of the operating device by a wearer of the virtual reality glasses causes the virtual reality glasses in the first operating mode is operated, so the virtual environment is displayed.
  • a correspondingly provided user interface for example via a tablet computer or a computer, it can be set which of the two operating modes is to be the standard operating mode and which of the two operating modes should only be activated when a corresponding actuation of the operating device has taken place.
  • This allows a wearer of the virtual reality glasses to adjust according to his preferences, whether he wants to display by default the virtual environment or the real environment.
  • a further advantageous embodiment of the invention provides that the operating device has a trough-shaped region, wherein the actuating signal is output, as long as by means of a sensor, in particular by means of a capacitive sensor is detected that there is no contact of the trough-shaped area.
  • the operating device may be formed such that when a wearer of the virtual reality glasses holds the operating device in his hand, his thumb or another finger rests in the trough-shaped region.
  • the wearer of the virtual reality glasses now deliberately changes this state, for example by extending the finger or thumb normally arranged in the trough-shaped area, it is detected by means of the sensor that there is no contact with the person trough-shaped area is more present, as a result of which the actuating signal is output from the operating device.
  • a wearer of the virtual reality glasses must actively move his thumb out of the trough-shaped area in order to achieve a ready position of the actuation signal by the operating device.
  • the actuation signal is output, as long as it is detected that the operating device is aligned according to a predetermined spatial position.
  • a wearer of the virtual reality glasses has to tilt or turn the operating device in a certain direction, whereby only then the actuation signal is output.
  • a wearer of the virtual reality glasses for example, rotate the operating device by rotating his wrist, so that the operating device is aligned in accordance with the predetermined spatial position, as a result of which the actuating signal is output.
  • the wearer of the virtual reality glasses can bring about a switchover between the two operating modes in a particularly simple manner.
  • the display device comprises a camera system which is designed to capture an environment of a person who has put on the virtual reality glasses in the form of a camera image.
  • the display device further includes a virtual reality goggle configured to display a virtual environment when the virtual reality goggles are operated in a first mode of operation and to display the camera image when the virtual reality goggles are in one second operating mode is operated.
  • the display device further comprises an operating device which is designed to provide an actuation signal.
  • the display device comprises a control device which is designed to switch between the operating modes in dependence on the provided actuating signal.
  • Figure 1 is a schematic representation of a display device, which comprises a camera system, a virtual reality glasses, an operating device and a control device.
  • Fig. 2 is a schematic perspective view of a person
  • 3 is a schematic plan view of the person with the virtual
  • Fig. 4 is a schematic side view of a possible embodiment of the operating device.
  • a display device 10 is shown in a schematic representation in FIG.
  • the display device 10 comprises a camera system 12, which is designed to detect an environment of a person who has put on a virtual reality glasses 14 of the display device 10 in the form of a camera image.
  • the virtual reality goggles 14 are configured to display a virtual environment when the virtual reality goggles 14 are operated in a first mode of operation and to display the camera image when the virtual reality goggles 14 are operated in a second mode of operation ,
  • the display device 10 further comprises an operating device 16, which is designed to provide an actuation signal.
  • the display device 10 comprises a control device 18, which is adapted to switch between the modes of operation in response to the provided actuation signal.
  • FIG. 2 shows a person 20 who has put on the virtual reality glasses 14.
  • the camera system 12 is arranged on the virtual reality glasses 14 and indicated only schematically.
  • the camera system 12 may, for example, have one or more cameras, which are arranged on an outer side of the virtual reality glasses 14.
  • the one or more cameras of the camera system 12 are preferably arranged on the virtual reality glasses 14, that by means of the camera system 12 that surrounding area of the person 20 can be detected, as the person 20 their environment with remote virtual reality glasses 14 would perceive itself.
  • the virtual reality glasses 14 can be used for example in a virtual sales talk, wherein by means of the virtual reality glasses 14, a virtual environment is displayed, in which, for example, a virtual motor vehicle is displayed.
  • FIG 3 shows a schematic plan view of a sales situation in a car dealership, with the person 20 who has put on the virtual reality glasses 14 and another person 22 shown, who is disposed opposite the person 20.
  • the other person 22 should in the present example be a car salesman and the person 20 a potential buyer of a motor vehicle.
  • the person 20 has put on the virtual reality glasses 14. If the virtual reality goggles 14 are now operated in a first operating mode, the virtual motor vehicle is displayed within the virtual environment by means of the virtual reality goggles 14. During a sales conversation by the other person 22, the person 20 may wish to see the opposite person standing 22 instead of the virtual environment with the virtual car. By means of a corresponding actuation of the operating device 16, the person 20 can cause the virtual reality glasses 14 instead of the virtual environment to display a camera image of an environment 24 of the person 20 detected by the camera system 12 by means of the virtual reality glasses 14 becomes. Either the display of the virtual environment may be set as a kind of standard mode, or the display of the real environment 24 may be set as the default mode.
  • the virtual environment is displayed as long as no actuation signal is provided by the operating device 16.
  • the real environment 24 is not displayed in such a case until the actuation signal is provided by the operator 16.
  • the display of the virtual environment is thus set as the default mode and the person 20 must actively act on the operating device 16 in order to display the real environment 24.
  • the real environment 24 is displayed as long as no actuation signal is provided by the operator 16, and the virtual environment is displayed only as long as the actuation signal is provided by the operator 16.
  • the display of the real environment 24 with attached virtual reality glasses 14 corresponds to a standard operating mode, the person 20 must actively act on the operating device 16 to the virtual environment, so for example the just displayed virtual car ,, using the virtual reality glasses 14 to make.
  • FIG. 4 shows in a schematic side view a possible embodiment of the operating device 16.
  • the operating device has a trough-shaped region 26, the said actuating signal being output as long as it is detected by means of a sensor 28, preferably by means of a capacitive sensor, that there is no contact of the trough-shaped region 26.
  • the person 20 who has put on the virtual reality goggles 14 can hold the operating device 16, for example, in his right hand, wherein in a standard posture, for example, a thumb of the person 20 is disposed within the trough 26.
  • the person 20 now wish to make a change between the operating modes - either instead of the virtual environment, the real environment is displayed or instead of the real environment 24, the virtual environment is displayed - so the person 20 can, for example, according to the thumb Move representation in Fig. 4 to the left by the person 20 her thumb stretches. As a result, the thumb is no longer in the trough 26, which is detected by the sensor 28.
  • the operating device 16 is embodied such that the actuating signal is output as long as it is detected by means of the sensor 28 that there is no contact of the trough-shaped region 26.
  • the said actuation signal is output by the operating device 16.
  • the said actuation signal is output as long as it is detected that the operating device is aligned in accordance with a predetermined spatial position. For example, rotation of the operating device 16 according to a predetermined inclination can cause the said actuating signal to be output.
  • the person 20 can thus cause, for example, by a rotation or other orientation of the operating device 16, that a switchover between the two modes of operation takes place, so either the virtual environment or the real environment 24 by means of the virtual reality glasses 14 is displayed.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un procédé de fonctionnement de lunettes de réalité virtuelle (14), selon lequel un environnement virtuel est affiché au moyen des lunettes de réalité virtuelle (14) lorsque les lunettes de réalité virtuelle (14) sont employées dans un premier mode de fonctionnement, et une image de caméra d'un environnement réel, détecté au moyen d'un système de caméras (12), d'une personne (20) qui a mis les lunettes de réalité virtuelle (14), est affichée au moyen des lunettes de réalité virtuelle (14) lorsque les lunettes de réalité virtuelle (14) sont employées dans un second mode de fonctionnement, une commutation entre les modes de fonctionnement étant effectuée en fonction d'un signal d'actionnement mis à disposition par un système de commande (16). L'invention concerne en outre un dispositif d'affichage (10) avec des lunettes de réalité virtuelle (14).
PCT/EP2015/002385 2014-12-05 2015-11-27 Procédé de fonctionnement de lunettes de réalité virtuelle et dispositif d'affichage WO2016087033A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102014018054.9 2014-12-05
DE102014018054.9A DE102014018054A1 (de) 2014-12-05 2014-12-05 Verfahren zum Betreiben einer Virtual-Reality-Brille und Anzeigevorrichtung

Publications (1)

Publication Number Publication Date
WO2016087033A1 true WO2016087033A1 (fr) 2016-06-09

Family

ID=54705551

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2015/002385 WO2016087033A1 (fr) 2014-12-05 2015-11-27 Procédé de fonctionnement de lunettes de réalité virtuelle et dispositif d'affichage

Country Status (2)

Country Link
DE (1) DE102014018054A1 (fr)
WO (1) WO2016087033A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112579029A (zh) * 2020-12-11 2021-03-30 上海影创信息科技有限公司 Vr眼镜的显示控制方法和***

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102019213740A1 (de) * 2019-09-10 2021-03-11 Audi Ag Verfahren zum Betreiben eines am Kopf tragbaren Anzeigegeräts in einem Kraftfahrzeug, Steuereinrichtung, und am Kopf tragbares Anzeigegerät

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008001220A2 (fr) * 2006-06-20 2008-01-03 Qrg Limited Capteur de position capacitif
US20100079356A1 (en) * 2008-09-30 2010-04-01 Apple Inc. Head-mounted display apparatus for retaining a portable electronic device with display
US20130222271A1 (en) * 2012-02-28 2013-08-29 Motorola Mobility, Inc. Methods and Apparatuses for Operating a Display in an Electronic Device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2501768A (en) * 2012-05-04 2013-11-06 Sony Comp Entertainment Europe Head mounted display
US9908048B2 (en) * 2013-06-08 2018-03-06 Sony Interactive Entertainment Inc. Systems and methods for transitioning between transparent mode and non-transparent mode in a head mounted display
DE102014001274B4 (de) * 2014-01-31 2020-08-20 Audi Ag Am Kopf tragbare Anzeigeeinrichtung mit einer Bildaufnahmeeinrichtung und Verfahren zum Anzeigen eines von einer Bildaufnahmeeinrichtung einer am Kopf tragbaren Anzeigeeinrichtung aufgenommenen Umgebungsbilds

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008001220A2 (fr) * 2006-06-20 2008-01-03 Qrg Limited Capteur de position capacitif
US20100079356A1 (en) * 2008-09-30 2010-04-01 Apple Inc. Head-mounted display apparatus for retaining a portable electronic device with display
US20130222271A1 (en) * 2012-02-28 2013-08-29 Motorola Mobility, Inc. Methods and Apparatuses for Operating a Display in an Electronic Device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112579029A (zh) * 2020-12-11 2021-03-30 上海影创信息科技有限公司 Vr眼镜的显示控制方法和***

Also Published As

Publication number Publication date
DE102014018054A1 (de) 2016-06-09

Similar Documents

Publication Publication Date Title
EP3394708B1 (fr) Procédé de fonctionnement d'un système de réalité virtuelle et système de réalité virtuelle associé
DE102014009303B4 (de) Verfahren zum Betreiben einer Virtual-Reality-Brille und System mit einer Virtual-Reality-Brille
DE102014009697A1 (de) Verfahren zum Betreiben eines mobilen Virtual-Reality-Systems in einem Kraftfahrzeug und mobiles Virtual-Reality-System
EP2653335B1 (fr) Procédé et dispositif d'affichage d'une main d'un utilisateur d'un élément de commande d'un véhicule
DE102011056714A1 (de) Systembereitschaftsschalter für ein Mensch-Maschine-Interaktionssteuerungssystem mit Augenverfolgung
WO2017211817A1 (fr) Dispositif de commande pourvu d'une unité de suivi des yeux et procédé d'étalonnage d'une unité de suivi des yeux d'un dispositif de commande
EP2924540B1 (fr) Procédé et système de fonctionnement d'un dispositif d'affichage
EP3394660B1 (fr) Procédé de fonctionnement d'un système de réalité virtuelle et système de réalité virtuelle associé
WO2016165799A1 (fr) Procédé pour faire fonctionner des lunettes de réalité virtuelle et système équipé de lunettes de réalité virtuelle
DE102014009302A1 (de) Verfahren zum Betreiben einer Virtual-Reality-Brille und System mit einer Virtual-Reality-Brille
WO2018219688A1 (fr) Procédé pour faire fonctionner un système de réalité virtuelle et système de réalité virtuelle
EP3411776B1 (fr) Procédé de fonctionnement d'un système de réalité virtuelle et système de réalité virtuelle
DE102016004581A1 (de) Fahrzeug, insbesondere Nutzfahrzeug, mit einem Spiegelersatzsystem
DE102014018056A1 (de) Verfahren zum Betreiben einer Virtual-Reality-Brille und Virtual-Reality-Brille
WO2016087033A1 (fr) Procédé de fonctionnement de lunettes de réalité virtuelle et dispositif d'affichage
DE102014009299A1 (de) Verfahren zum Betreiben einer Virtual-Reality-Brille und System mit einer Virtual-Reality-Brille
EP3421674B1 (fr) Procédé et dispositif de représentation des zones
DE102014009699B4 (de) Verfahren zum Betreiben einer Anzeigeeinrichtung und System mit einer Anzeigeeinrichtung
DE102014009301A1 (de) Verfahren zum Betreiben einer Virtual-Reality-Brille und System mit einer Virtual-Reality-Brille
DE102015003973B3 (de) Verfahren zum Betreiben einer in einem Kraftfahrzeug angeordneten Virtual-Reality-Brille und System mit einer Virtual-Reality-Brille
DE102015011589A1 (de) Verfahren zum Betreiben eines Virtual-Reality-Systems und Virtual-Reality-System
DE102014119323B4 (de) Verfahren zum Erzeugen einer personenspezifischen Information eines Fahrzeuginsassen, Einrichtung und Kraftfahrzeug
WO2016091361A1 (fr) Procédé de fonctionnement de lunettes de réalité virtuelle et système d'affichage équipé de lunettes de réalité virtuelle
DE102015016501A1 (de) Verfahren zum Betreiben eines Virtual-Reality-Systems und Virtual-Reality-System
DE102007001738A1 (de) Verfahren und Computerprogrammprodukt zur Blickerfassung

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15801330

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 15801330

Country of ref document: EP

Kind code of ref document: A1