JP6126305B2 - 頭部装着ディスプレイにおけるオペレーション・モード・スイッチング - Google Patents
頭部装着ディスプレイにおけるオペレーション・モード・スイッチング Download PDFInfo
- Publication number
- JP6126305B2 JP6126305B2 JP2016518342A JP2016518342A JP6126305B2 JP 6126305 B2 JP6126305 B2 JP 6126305B2 JP 2016518342 A JP2016518342 A JP 2016518342A JP 2016518342 A JP2016518342 A JP 2016518342A JP 6126305 B2 JP6126305 B2 JP 6126305B2
- Authority
- JP
- Japan
- Prior art keywords
- user
- hmd
- area
- display
- scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 claims description 81
- 238000004590 computer program Methods 0.000 claims description 15
- 238000005562 fading Methods 0.000 claims description 14
- 238000001514 detection method Methods 0.000 claims description 12
- 230000004044 response Effects 0.000 claims description 9
- 238000012790 confirmation Methods 0.000 claims 1
- 238000007726 management method Methods 0.000 claims 1
- 230000008569 process Effects 0.000 description 35
- 238000004891 communication Methods 0.000 description 30
- 230000006978 adaptation Effects 0.000 description 22
- 230000033001 locomotion Effects 0.000 description 20
- 230000003190 augmentative effect Effects 0.000 description 13
- 230000007704 transition Effects 0.000 description 13
- 238000009877 rendering Methods 0.000 description 11
- 238000012545 processing Methods 0.000 description 9
- 210000003128 head Anatomy 0.000 description 8
- 230000015654 memory Effects 0.000 description 8
- 208000013057 hereditary mucoepithelial dysplasia Diseases 0.000 description 7
- 230000000670 limiting effect Effects 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 6
- 230000002093 peripheral effect Effects 0.000 description 6
- 230000000007 visual effect Effects 0.000 description 6
- 208000002173 dizziness Diseases 0.000 description 5
- 238000012360 testing method Methods 0.000 description 5
- 230000008859 change Effects 0.000 description 4
- 239000003795 chemical substances by application Substances 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 125000002066 L-histidyl group Chemical group [H]N1C([H])=NC(C([H])([H])[C@](C(=O)[*])([H])N([H])[H])=C1[H] 0.000 description 3
- 230000009471 action Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 3
- 230000004438 eyesight Effects 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 238000010191 image analysis Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 239000003550 marker Substances 0.000 description 3
- 241000699666 Mus <mouse, genus> Species 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000004886 head movement Effects 0.000 description 2
- 230000001788 irregular Effects 0.000 description 2
- 230000004807 localization Effects 0.000 description 2
- 238000002604 ultrasonography Methods 0.000 description 2
- 230000004304 visual acuity Effects 0.000 description 2
- 241000699670 Mus sp. Species 0.000 description 1
- 230000003416 augmentation Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000010304 firing Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 210000004247 hand Anatomy 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 201000003152 motion sickness Diseases 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 230000010287 polarization Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000011112 process operation Methods 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000002829 reductive effect Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 238000013515 script Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 210000003813 thumb Anatomy 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
- G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04804—Transparency, e.g. transparent or translucent windows
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Description
Claims (14)
- 頭部装着装置(HMD)の画像表示の管理方法であって、
仮想世界の場面を表示する前記HMDを着用するユーザの凝視を追跡するステップと、
前記ユーザの前記凝視が所定エリアに第1所定時間固定されていることを検出するステップと、
前記検出するステップに応答して前記HMDの表示領域をフェードアウトする一方、前記領域外の表示エリア内の前記仮想世界の前記場面を維持するステップと、
前記領域を見通しているときに前記HMDが前記ユーザにとって透明であるかのように現実世界の情景を前記領域にフェードインするステップとを含み、
前記フェードインするステップは前記領域外の前記仮想世界の前記場面を維持するステップを含み、
前記方法は、前記現実世界の前記情景が前記領域に第2所定時間より長く表示されたとき、前記領域外の前記仮想世界の前記場面をフェードアウトするステップを含む、方法。 - 前記所定エリアは、前記表示の下方に形成されたエリア、前記表示の片側に形成されたエリア、前記表示の上方に形成されたエリアまたは前記表示の角に形成されたエリアの1つである請求項1に記載の方法。
- 前記所定エリアは前記表示の下方に形成され、前記領域は前記表示の下半分である請求項1に記載の方法。
- 前記領域は前記表示の中心にある長方形である請求項1に記載の方法。
- 前記領域の前記フェードアウトの前に前記ユーザに確認を求めるステップを更に含む請求項1に記載の方法。
- 前記現実世界の前記情景を終了するためのコマンドを前記ユーザから受信するステップと、
前記領域の前記現実世界の前記情景をフェードアウトすること及び前記仮想世界の前記情景を前記領域にフェードインするステップとを更に含む請求項1に記載の方法。 - 前記凝視を追跡するステップは、更に、
前記ユーザの眼の画像を前記HMD内のカメラで取り込むステップと、
前記ユーザの前記凝視を判断するために前記取り込んだ画像を分析するステップとを含む請求項1に記載の方法。 - 前記現実世界の前記情景は前記HMDの前のカメラによって取り込まれる請求項1に記載の方法。
- 前記第1所定時間が2秒である請求項1に記載の方法。
- 頭部装着装置(HMD)の画像表示を管理するために1つまたは複数のプロセッサによって稼働されているときに非一時的コンピュータ読取可能媒体に埋め込まれているコンピュータプログラムであって、
仮想世界の場面を表示する前記HMDを着用するユーザの凝視を追跡するプログラムインストラクションと、
前記ユーザの前記凝視が所定エリアに第1所定時間固定されていることを検出するプログラムインストラクションと、
前記検出に応答して、前記HMDの表示領域をフェードアウトする一方、前記領域外の表示エリアの前記仮想世界の前記場面を維持するプログラムインストラクションと、
前記領域を見通しているときに前記HMDが前記ユーザにとって透明であるかのように現実世界の情景を前記領域にフェードインするプログラムインストラクションとを含み、
前記フェードインするステップは前記領域外の前記仮想世界の前記場面を維持するステップを含み、
前記コンピュータプログラムは、前記現実世界の前記情景が前記領域に第2所定時間より長く表示されたとき、前記領域外の前記仮想世界の前記場面をフェードアウトするプログラムインストラクションを含む、コンピュータプログラム。 - 前記所定エリアは、前記表示の下方に形成されたエリア、前記表示の片側に形成されたエリア、前記表示の上方に形成されたエリアまたは前記表示の角に形成されたエリアの1つである請求項10に記載のコンピュータプログラム。
- 前記所定エリアは、前記表示の下方に形成され、前記領域は前記表示の下半分である請求項10に記載のコンピュータプログラム。
- 前記現実世界の前記情景を終了するためのコマンドを前記ユーザから受信するステップと、
前記領域の前記現実世界の前記情景をフェードアウトするステップと、
前記領域の前記仮想世界の情景をフェードインするステップとを更に含む請求項10に記載のコンピュータプログラム。 - 前記凝視を追跡するステップは、更に、
前記ユーザの眼の画像を前記HMD内のカメラで取り込むステップと、
前記ユーザの前記凝視を判断するために前記取り込んだ画像を分析するステップとを含む請求項10に記載のコンピュータプログラム。
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201361832758P | 2013-06-07 | 2013-06-07 | |
US61/832,758 | 2013-06-07 | ||
US14/206,219 | 2014-03-12 | ||
US14/206,219 US10019057B2 (en) | 2013-06-07 | 2014-03-12 | Switching mode of operation in a head mounted display |
PCT/US2014/039411 WO2014197231A2 (en) | 2013-06-07 | 2014-05-23 | Switching mode of operation in a head mounted display |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2017075820A Division JP6545744B2 (ja) | 2013-06-07 | 2017-04-06 | 頭部装着ディスプレイにおけるオペレーション・モード・スイッチング |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2016526237A JP2016526237A (ja) | 2016-09-01 |
JP6126305B2 true JP6126305B2 (ja) | 2017-05-10 |
Family
ID=52005034
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2016518342A Active JP6126305B2 (ja) | 2013-06-07 | 2014-05-23 | 頭部装着ディスプレイにおけるオペレーション・モード・スイッチング |
JP2017075820A Active JP6545744B2 (ja) | 2013-06-07 | 2017-04-06 | 頭部装着ディスプレイにおけるオペレーション・モード・スイッチング |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2017075820A Active JP6545744B2 (ja) | 2013-06-07 | 2017-04-06 | 頭部装着ディスプレイにおけるオペレーション・モード・スイッチング |
Country Status (5)
Country | Link |
---|---|
US (1) | US10019057B2 (ja) |
EP (1) | EP3005031B1 (ja) |
JP (2) | JP6126305B2 (ja) |
CN (1) | CN105324738B (ja) |
WO (1) | WO2014197231A2 (ja) |
Families Citing this family (183)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9298007B2 (en) | 2014-01-21 | 2016-03-29 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9952664B2 (en) | 2014-01-21 | 2018-04-24 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9965681B2 (en) | 2008-12-16 | 2018-05-08 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9229233B2 (en) | 2014-02-11 | 2016-01-05 | Osterhout Group, Inc. | Micro Doppler presentations in head worn computing |
US10099030B2 (en) | 2013-09-06 | 2018-10-16 | Iarmourholdings, Inc. | Mechanical and fluid system and method for the prevention and control of motion sickness, motion-induced vision sickness, and other variants of spatial disorientation and vertigo |
US9080868B2 (en) * | 2013-09-06 | 2015-07-14 | Wesley W. O. Krueger | Mechanical and fluid system and method for the prevention and control of motion sickness, motion-induced vision sickness, and other variants of spatial disorientation and vertigo |
KR102165818B1 (ko) * | 2013-09-10 | 2020-10-14 | 삼성전자주식회사 | 입력 영상을 이용한 사용자 인터페이스 제어 방법, 장치 및 기록매체 |
US20160019715A1 (en) | 2014-07-15 | 2016-01-21 | Osterhout Group, Inc. | Content presentation in head worn computing |
US10191279B2 (en) | 2014-03-17 | 2019-01-29 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9841599B2 (en) | 2014-06-05 | 2017-12-12 | Osterhout Group, Inc. | Optical configurations for head-worn see-through displays |
US10649220B2 (en) | 2014-06-09 | 2020-05-12 | Mentor Acquisition One, Llc | Content presentation in head worn computing |
US10254856B2 (en) | 2014-01-17 | 2019-04-09 | Osterhout Group, Inc. | External user interface for head worn computing |
US9939934B2 (en) | 2014-01-17 | 2018-04-10 | Osterhout Group, Inc. | External user interface for head worn computing |
US9746686B2 (en) | 2014-05-19 | 2017-08-29 | Osterhout Group, Inc. | Content position calibration in head worn computing |
US9299194B2 (en) | 2014-02-14 | 2016-03-29 | Osterhout Group, Inc. | Secure sharing in head worn computing |
US9575321B2 (en) | 2014-06-09 | 2017-02-21 | Osterhout Group, Inc. | Content presentation in head worn computing |
US9829707B2 (en) | 2014-08-12 | 2017-11-28 | Osterhout Group, Inc. | Measuring content brightness in head worn computing |
US11103122B2 (en) | 2014-07-15 | 2021-08-31 | Mentor Acquisition One, Llc | Content presentation in head worn computing |
US10684687B2 (en) | 2014-12-03 | 2020-06-16 | Mentor Acquisition One, Llc | See-through computer display systems |
US9594246B2 (en) | 2014-01-21 | 2017-03-14 | Osterhout Group, Inc. | See-through computer display systems |
US11737666B2 (en) | 2014-01-21 | 2023-08-29 | Mentor Acquisition One, Llc | Eye imaging in head worn computing |
US9523856B2 (en) | 2014-01-21 | 2016-12-20 | Osterhout Group, Inc. | See-through computer display systems |
US9532715B2 (en) | 2014-01-21 | 2017-01-03 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US11892644B2 (en) | 2014-01-21 | 2024-02-06 | Mentor Acquisition One, Llc | See-through computer display systems |
US11487110B2 (en) | 2014-01-21 | 2022-11-01 | Mentor Acquisition One, Llc | Eye imaging in head worn computing |
US11669163B2 (en) | 2014-01-21 | 2023-06-06 | Mentor Acquisition One, Llc | Eye glint imaging in see-through computer display systems |
US9836122B2 (en) | 2014-01-21 | 2017-12-05 | Osterhout Group, Inc. | Eye glint imaging in see-through computer display systems |
US9811152B2 (en) | 2014-01-21 | 2017-11-07 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US20150205135A1 (en) | 2014-01-21 | 2015-07-23 | Osterhout Group, Inc. | See-through computer display systems |
US9494800B2 (en) | 2014-01-21 | 2016-11-15 | Osterhout Group, Inc. | See-through computer display systems |
US9766463B2 (en) | 2014-01-21 | 2017-09-19 | Osterhout Group, Inc. | See-through computer display systems |
US9740280B2 (en) | 2014-01-21 | 2017-08-22 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9753288B2 (en) | 2014-01-21 | 2017-09-05 | Osterhout Group, Inc. | See-through computer display systems |
US9401540B2 (en) | 2014-02-11 | 2016-07-26 | Osterhout Group, Inc. | Spatial location presentation in head worn computing |
US20160187651A1 (en) | 2014-03-28 | 2016-06-30 | Osterhout Group, Inc. | Safety for a vehicle operator with an hmd |
US10853589B2 (en) | 2014-04-25 | 2020-12-01 | Mentor Acquisition One, Llc | Language translation with head-worn computing |
US9651787B2 (en) | 2014-04-25 | 2017-05-16 | Osterhout Group, Inc. | Speaker assembly for headworn computer |
US9741169B1 (en) * | 2014-05-20 | 2017-08-22 | Leap Motion, Inc. | Wearable augmented reality devices with object detection and tracking |
KR102236203B1 (ko) * | 2014-05-27 | 2021-04-05 | 삼성전자주식회사 | 서비스를 제공하는 방법 및 그 전자 장치 |
US10663740B2 (en) | 2014-06-09 | 2020-05-26 | Mentor Acquisition One, Llc | Content presentation in head worn computing |
US10007350B1 (en) | 2014-06-26 | 2018-06-26 | Leap Motion, Inc. | Integrated gestural interaction and multi-user collaboration in immersive virtual reality environments |
CN204480228U (zh) | 2014-08-08 | 2015-07-15 | 厉动公司 | 运动感测和成像设备 |
US9699436B2 (en) * | 2014-09-16 | 2017-07-04 | Microsoft Technology Licensing, Llc | Display with eye-discomfort reduction |
JP2016090773A (ja) | 2014-11-04 | 2016-05-23 | 株式会社ソニー・コンピュータエンタテインメント | ヘッドマウントディスプレイおよび輝度調整方法 |
US9684172B2 (en) | 2014-12-03 | 2017-06-20 | Osterhout Group, Inc. | Head worn computer display systems |
FR3029649B1 (fr) * | 2014-12-03 | 2016-12-23 | Commissariat Energie Atomique | Procede d'etalonnage d'un systeme de restitution visuelle en realite augmentee comprenant au moins un dispositif d'affichage partiellement transparent, par rapport a son utilisateur, et systeme associe |
USD751552S1 (en) | 2014-12-31 | 2016-03-15 | Osterhout Group, Inc. | Computer glasses |
US9740282B1 (en) * | 2015-01-05 | 2017-08-22 | Amazon Technologies, Inc. | Gaze direction tracking |
US10656720B1 (en) | 2015-01-16 | 2020-05-19 | Ultrahaptics IP Two Limited | Mode switching for integrated gestural interaction and multi-user collaboration in immersive virtual reality environments |
US20160210780A1 (en) * | 2015-01-20 | 2016-07-21 | Jonathan Paulovich | Applying real world scale to virtual content |
US10181219B1 (en) * | 2015-01-21 | 2019-01-15 | Google Llc | Phone control and presence in virtual reality |
US9999835B2 (en) * | 2015-02-05 | 2018-06-19 | Sony Interactive Entertainment Inc. | Motion sickness monitoring and application of supplemental sound to counteract sickness |
US20160239985A1 (en) | 2015-02-17 | 2016-08-18 | Osterhout Group, Inc. | See-through computer display systems |
US10055887B1 (en) * | 2015-02-19 | 2018-08-21 | Google Llc | Virtual/augmented reality transition system and method |
US9779554B2 (en) | 2015-04-10 | 2017-10-03 | Sony Interactive Entertainment Inc. | Filtering and parental control methods for restricting visual activity on a head mounted display |
US9690374B2 (en) * | 2015-04-27 | 2017-06-27 | Google Inc. | Virtual/augmented reality transition system and method |
EP3292700B1 (en) | 2015-05-05 | 2019-09-18 | Razer (Asia-Pacific) Pte. Ltd. | Methods for controlling a headset device, headset devices, computer readable media, and infrared sensors |
JP6356915B2 (ja) * | 2015-06-12 | 2018-07-11 | 株式会社ソニー・インタラクティブエンタテインメント | 制御装置、制御方法及びプログラム |
US9898865B2 (en) * | 2015-06-22 | 2018-02-20 | Microsoft Technology Licensing, Llc | System and method for spawning drawing surfaces |
WO2017015093A1 (en) * | 2015-07-17 | 2017-01-26 | Osterhout Group, Inc. | External user interface for head worn computing |
US11003246B2 (en) | 2015-07-22 | 2021-05-11 | Mentor Acquisition One, Llc | External user interface for head worn computing |
EP3671317B1 (en) * | 2015-07-20 | 2021-11-10 | Magic Leap, Inc. | Collimating fiber scanner design with inward pointing angles in virtual/augmented reality system |
US10545714B2 (en) | 2015-09-04 | 2020-01-28 | Samsung Electronics Co., Ltd. | Dual screen head mounted display |
JP6022709B1 (ja) * | 2015-09-04 | 2016-11-09 | 株式会社スクウェア・エニックス | プログラム、記録媒体、コンテンツ提供装置及び制御方法 |
US9857871B2 (en) | 2015-09-04 | 2018-01-02 | Sony Interactive Entertainment Inc. | Apparatus and method for dynamic graphics rendering based on saccade detection |
DE112016004437T5 (de) * | 2015-09-29 | 2018-07-05 | BinaryVR, Inc. | Head-Mounted-Display mit Gesichtsausdruck-Erkennungsfähigkeit |
US10710608B2 (en) | 2015-10-26 | 2020-07-14 | Active Knowledge Ltd. | Provide specific warnings to vehicle occupants before intense movements |
GB2545073A (en) | 2015-10-26 | 2017-06-07 | Active Knowledge Ltd | Combining video see-through that imitates an automobile window with other video |
US10059347B2 (en) | 2015-10-26 | 2018-08-28 | Active Knowledge Ltd. | Warning a vehicle occupant before an intense movement |
US11332061B2 (en) | 2015-10-26 | 2022-05-17 | Atnomity Ltd. | Unmanned carrier for carrying urban manned vehicles |
US10717406B2 (en) | 2015-10-26 | 2020-07-21 | Active Knowledge Ltd. | Autonomous vehicle having an external shock-absorbing energy dissipation padding |
US9851561B2 (en) * | 2015-12-23 | 2017-12-26 | Intel Corporation | Head-mounted device with rear-facing camera |
JP6725248B2 (ja) * | 2015-12-28 | 2020-07-15 | 株式会社バンダイナムコエンターテインメント | ゲーム装置及びプログラム |
TWI688879B (zh) * | 2016-01-22 | 2020-03-21 | 宏達國際電子股份有限公司 | 虛擬實境環境中與真實世界互動的方法、系統與記錄媒體 |
US20170230640A1 (en) * | 2016-02-05 | 2017-08-10 | Samsung Electronics Co., Ltd. | Portable image device with external display |
US10477157B1 (en) * | 2016-03-02 | 2019-11-12 | Meta View, Inc. | Apparatuses, methods and systems for a sensor array adapted for vision computing |
JP2017183829A (ja) * | 2016-03-28 | 2017-10-05 | 京セラ株式会社 | ヘッドマウントディスプレイ |
JP2017183825A (ja) * | 2016-03-28 | 2017-10-05 | 京セラ株式会社 | ヘッドマウントディスプレイ |
US20170287215A1 (en) * | 2016-03-29 | 2017-10-05 | Google Inc. | Pass-through camera user interface elements for virtual reality |
US10169846B2 (en) | 2016-03-31 | 2019-01-01 | Sony Interactive Entertainment Inc. | Selective peripheral vision filtering in a foveated rendering system |
US10192528B2 (en) | 2016-03-31 | 2019-01-29 | Sony Interactive Entertainment Inc. | Real-time user adaptive foveated rendering |
US10401952B2 (en) | 2016-03-31 | 2019-09-03 | Sony Interactive Entertainment Inc. | Reducing rendering computation and power consumption by detecting saccades and blinks |
US10372205B2 (en) | 2016-03-31 | 2019-08-06 | Sony Interactive Entertainment Inc. | Reducing rendering computation and power consumption by detecting saccades and blinks |
US10019131B2 (en) * | 2016-05-10 | 2018-07-10 | Google Llc | Two-handed object manipulations in virtual reality |
US10748339B2 (en) | 2016-06-03 | 2020-08-18 | A Big Chunk Of Mud Llc | System and method for implementing computer-simulated reality interactions between users and publications |
JP6668170B2 (ja) * | 2016-06-07 | 2020-03-18 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置、情報処理方法、およびコンピュータプログラム |
JP6389208B2 (ja) * | 2016-06-07 | 2018-09-12 | 株式会社カプコン | ゲームプログラム及びゲーム装置 |
CN106200908B (zh) * | 2016-06-28 | 2019-03-08 | 联想(北京)有限公司 | 一种控制方法及电子设备 |
US10471353B2 (en) * | 2016-06-30 | 2019-11-12 | Sony Interactive Entertainment America Llc | Using HMD camera touch button to render images of a user captured during game play |
US10191541B2 (en) * | 2016-06-30 | 2019-01-29 | Sony Interactive Entertainment Inc. | Augmenting virtual reality content with real world content |
US10482662B2 (en) * | 2016-06-30 | 2019-11-19 | Intel Corporation | Systems and methods for mixed reality transitions |
CN106101637A (zh) * | 2016-07-12 | 2016-11-09 | 姜正红 | 一种在虚拟环境中实现多界面显示及功能操作的视觉*** |
US10976549B2 (en) | 2016-09-28 | 2021-04-13 | Magic Leap, Inc. | Face model capture by a wearable device |
US9871774B1 (en) | 2016-09-29 | 2018-01-16 | International Business Machines Corporation | Secured file transfer management on augmented reality (AR) and virtual reality (VR) devices |
US9824206B1 (en) * | 2016-09-29 | 2017-11-21 | International Business Machines Corporation | Eye gazing passcode generation crossing augmented reality (AR) and virtual reality (VR) devices |
US10565777B2 (en) * | 2016-09-30 | 2020-02-18 | Sony Interactive Entertainment Inc. | Field of view (FOV) throttling of virtual reality (VR) content in a head mounted display |
CN106412563A (zh) * | 2016-09-30 | 2017-02-15 | 珠海市魅族科技有限公司 | 一种图像显示方法以及装置 |
US10845891B2 (en) * | 2016-09-30 | 2020-11-24 | Disney Enterprises, Inc. | Displaying proximate keys in a virtual reality environment |
US10573042B2 (en) * | 2016-10-05 | 2020-02-25 | Magic Leap, Inc. | Periocular test for mixed reality calibration |
US10032314B2 (en) | 2016-10-11 | 2018-07-24 | Microsoft Technology Licensing, Llc | Virtual reality headset |
US10168857B2 (en) * | 2016-10-26 | 2019-01-01 | International Business Machines Corporation | Virtual reality for cognitive messaging |
CN106529973A (zh) * | 2016-11-02 | 2017-03-22 | 深圳市幻实科技有限公司 | 一种基于增强现实的防伪方法及装置 |
WO2018127782A1 (en) * | 2017-01-03 | 2018-07-12 | Xing Zhou | Wearable augmented reality eyeglass communication device including mobile phone and mobile computing via virtual touch screen gesture control and neuron command |
US20180190029A1 (en) * | 2017-01-05 | 2018-07-05 | Honeywell International Inc. | Head mounted combination for industrial safety and guidance |
JP6654158B2 (ja) * | 2017-01-23 | 2020-02-26 | ティフォン インコーポレーテッドTyffon Inc. | 映像提供システム、映像提供方法及び映像提供プログラム |
US11096004B2 (en) * | 2017-01-23 | 2021-08-17 | Nokia Technologies Oy | Spatial audio rendering point extension |
US10531219B2 (en) | 2017-03-20 | 2020-01-07 | Nokia Technologies Oy | Smooth rendering of overlapping audio-object interactions |
WO2018175620A1 (en) | 2017-03-22 | 2018-09-27 | A Big Chunk Of Mud Llc | Convertible satchel with integrated head-mounted display |
CN108496107A (zh) * | 2017-03-28 | 2018-09-04 | 深圳市柔宇科技有限公司 | 头戴式显示设备及其显示切换方法 |
US10747301B2 (en) * | 2017-03-28 | 2020-08-18 | Magic Leap, Inc. | Augmented reality system with spatialized audio tied to user manipulated virtual object |
US10475243B2 (en) * | 2017-03-31 | 2019-11-12 | Intel Corporation | Transition between virtual reality and real world |
ES2902979T3 (es) * | 2017-04-11 | 2022-03-30 | Dolby Laboratories Licensing Corp | Experiencias de entretenimiento aumentadas estratificadas |
US10688396B2 (en) * | 2017-04-28 | 2020-06-23 | Sony Interactive Entertainment Inc. | Second screen virtual window into VR environment |
GB2555501B (en) * | 2017-05-04 | 2019-08-28 | Sony Interactive Entertainment Europe Ltd | Head mounted display and method |
US11074036B2 (en) | 2017-05-05 | 2021-07-27 | Nokia Technologies Oy | Metadata-free audio-object interactions |
JP6580624B2 (ja) * | 2017-05-11 | 2019-09-25 | 株式会社コロプラ | 仮想空間を提供するための方法、当該方法をコンピュータに実行させるためのプログラム、および当該プログラムを実行するための情報処理装置 |
CN107368184B (zh) | 2017-05-12 | 2020-04-14 | 阿里巴巴集团控股有限公司 | 一种虚拟现实场景中的密码输入方法和装置 |
CN108881706B (zh) * | 2017-05-16 | 2023-10-10 | 北京三星通信技术研究有限公司 | 控制多媒体设备工作的方法及装置 |
CN106950701A (zh) * | 2017-05-19 | 2017-07-14 | 深圳市帝泰光电有限公司 | 一种环境无缝增强多模式mr*** |
EP3631601A1 (en) * | 2017-05-23 | 2020-04-08 | PCMS Holdings, Inc. | System and method for prioritizing ar information based on persistence of real-life objects in the user's view |
US10394315B2 (en) * | 2017-05-25 | 2019-08-27 | Acer Incorporated | Content-aware virtual reality systems and related methods |
US10747386B2 (en) | 2017-06-01 | 2020-08-18 | Samsung Electronics Co., Ltd. | Systems and methods for window control in virtual reality environment |
TWI622808B (zh) * | 2017-06-13 | 2018-05-01 | 群光電子股份有限公司 | 頭戴式顯示裝置 |
US10748340B1 (en) | 2017-07-31 | 2020-08-18 | Apple Inc. | Electronic device with coordinated camera and display operation |
US10627635B2 (en) * | 2017-08-02 | 2020-04-21 | Microsoft Technology Licensing, Llc | Transitioning into a VR environment and warning HMD users of real-world physical obstacles |
US10178457B1 (en) * | 2017-08-03 | 2019-01-08 | Facebook Technologies, Llc | Audio output assembly for a head-mounted display |
US11351453B2 (en) * | 2017-09-12 | 2022-06-07 | Sony Interactive Entertainment LLC | Attention-based AI determination of player choices |
US10556185B2 (en) * | 2017-09-29 | 2020-02-11 | Sony Interactive Entertainment America Llc | Virtual reality presentation of real world space |
US11395087B2 (en) | 2017-09-29 | 2022-07-19 | Nokia Technologies Oy | Level-based audio-object interactions |
KR101875550B1 (ko) * | 2017-10-18 | 2018-07-06 | 주식회사 한컴지엠디 | 가상 현실 콘텐츠 제공 시스템 |
CN107918955A (zh) * | 2017-11-15 | 2018-04-17 | 百度在线网络技术(北京)有限公司 | 增强现实方法和装置 |
CN109814413A (zh) * | 2017-11-21 | 2019-05-28 | 宏碁股份有限公司 | 头戴式显示设备、电子***以及相关控制方法 |
US10726626B2 (en) * | 2017-11-22 | 2020-07-28 | Google Llc | Interaction between a viewer and an object in an augmented reality environment |
KR20200108857A (ko) | 2018-01-17 | 2020-09-21 | 매직 립, 인코포레이티드 | 디스플레이와 사용자의 눈들 사이의 정합을 결정하기 위한 디스플레이 시스템들 및 방법들 |
KR20200110771A (ko) | 2018-01-18 | 2020-09-25 | 삼성전자주식회사 | 증강 현실 콘텐츠 조정 방법 및 장치 |
CN110115842B (zh) * | 2018-02-06 | 2023-01-13 | 日本聚逸株式会社 | 应用处理***、应用处理方法以及应用处理程序 |
US10845601B1 (en) * | 2018-02-07 | 2020-11-24 | Apple Inc. | AR/VR controller with event camera |
US10726765B2 (en) | 2018-02-15 | 2020-07-28 | Valve Corporation | Using tracking of display device to control image display |
CN110494792B (zh) | 2018-03-07 | 2021-07-09 | 奇跃公司 | ***设备的视觉跟踪 |
US11417296B2 (en) * | 2018-03-13 | 2022-08-16 | Sony Corporation | Information processing device, information processing method, and recording medium |
GB2579760B (en) * | 2018-03-29 | 2023-03-22 | Displaylink Uk Ltd | Position error measurement in an extended reality mobile display device |
JP7014007B2 (ja) * | 2018-03-29 | 2022-02-01 | コベルコ建機株式会社 | 作業機械の遠隔操作システム |
US10942564B2 (en) | 2018-05-17 | 2021-03-09 | Sony Interactive Entertainment Inc. | Dynamic graphics rendering based on predicted saccade landing point |
US11262839B2 (en) | 2018-05-17 | 2022-03-01 | Sony Interactive Entertainment Inc. | Eye tracking with prediction and late update to GPU for fast foveated rendering in an HMD environment |
CN110547759A (zh) * | 2018-05-31 | 2019-12-10 | 托比股份公司 | 鲁棒会聚信号 |
US20210089638A1 (en) * | 2018-06-12 | 2021-03-25 | Hewlett-Packard Development Company, L.P. | Gesture based accesses |
US20190385372A1 (en) * | 2018-06-15 | 2019-12-19 | Microsoft Technology Licensing, Llc | Positioning a virtual reality passthrough region at a known distance |
CN112368668B (zh) * | 2018-07-03 | 2024-03-22 | 瑞典爱立信有限公司 | 用于混合现实头戴式耳机的便携式电子设备 |
US10540824B1 (en) | 2018-07-09 | 2020-01-21 | Microsoft Technology Licensing, Llc | 3-D transitions |
WO2020018938A1 (en) * | 2018-07-19 | 2020-01-23 | Magic Leap, Inc. | Content interaction driven by eye metrics |
JP7382387B2 (ja) | 2018-07-24 | 2023-11-16 | マジック リープ, インコーポレイテッド | ディスプレイとユーザの眼との間の位置合わせを決定するためのディスプレイシステムおよび方法 |
DE112019004485T5 (de) | 2018-09-07 | 2021-07-01 | Apple Inc. | Wechseln zwischen bildern und tönen einer virtuellen umgebung und einer realen umgebung |
JP6659789B2 (ja) * | 2018-09-10 | 2020-03-04 | グリー株式会社 | 仮想画像表示プログラム、仮想画像表示装置及び仮想画像表示方法 |
US10740918B2 (en) * | 2018-09-12 | 2020-08-11 | Dell Products, L.P. | Adaptive simultaneous localization and mapping (SLAM) using world-facing cameras in virtual, augmented, and mixed reality (xR) applications |
US10855978B2 (en) * | 2018-09-14 | 2020-12-01 | The Toronto-Dominion Bank | System and method for receiving user input in virtual/augmented reality |
US10777012B2 (en) * | 2018-09-27 | 2020-09-15 | Universal City Studios Llc | Display systems in an entertainment environment |
US10810825B2 (en) * | 2018-10-11 | 2020-10-20 | Igt | Systems and methods for providing safety and security features for users of immersive video devices |
CN111309142A (zh) * | 2018-12-11 | 2020-06-19 | 托比股份公司 | 用于切换显示设备的输入模态的方法和设备 |
CN109547773B (zh) * | 2018-12-12 | 2021-01-08 | 维沃移动通信有限公司 | 控制方法及电子设备 |
JP7089113B2 (ja) * | 2019-03-29 | 2022-06-21 | 株式会社ソニー・インタラクティブエンタテインメント | 境界設定装置、境界設定方法及びプログラム |
US10992926B2 (en) | 2019-04-15 | 2021-04-27 | XRSpace CO., LTD. | Head mounted display system capable of displaying a virtual scene and a real scene in a picture-in-picture mode, related method and related non-transitory computer readable storage medium |
JP7391950B2 (ja) * | 2019-04-23 | 2023-12-05 | マクセル株式会社 | ヘッドマウントディスプレイ装置 |
JP6835916B2 (ja) * | 2019-07-18 | 2021-02-24 | グリー株式会社 | ゲーム処理プログラム、ゲーム処理装置及びゲーム処理方法 |
KR102641117B1 (ko) | 2019-08-26 | 2024-02-27 | 삼성전자주식회사 | 영상을 증강하는 방법 및 장치 |
CA3058447A1 (en) * | 2019-10-10 | 2021-04-10 | Spacecard Inc. | A system for generating and displaying interactive mixed-reality video on mobile devices |
EP3839699A1 (en) * | 2019-12-19 | 2021-06-23 | Koninklijke KPN N.V. | Augmented virtuality self view |
WO2021169881A1 (zh) * | 2020-02-24 | 2021-09-02 | Oppo广东移动通信有限公司 | 头戴式设备的显示控制方法、设备及计算机存储介质 |
US20210264007A1 (en) * | 2020-02-25 | 2021-08-26 | Lenovo (Singapore) Pte. Ltd. | Authentication method for head-mounted display |
FR3111446A1 (fr) * | 2020-06-19 | 2021-12-17 | Orange | Procédé, dispositif et système d’immersion d’un utilisateur dans une application de réalité virtuelle |
US11705762B2 (en) * | 2020-06-25 | 2023-07-18 | Sony Interactive Entertainment LLC | Method for game console operation based on detection of change in controller state |
CN112462937B (zh) * | 2020-11-23 | 2022-11-08 | 青岛小鸟看看科技有限公司 | 虚拟现实设备的局部透视方法、装置及虚拟现实设备 |
US11514875B1 (en) * | 2021-07-07 | 2022-11-29 | Htc Corporation | Method for mitigating dizziness, electronic device, and computer readable medium |
US11813537B2 (en) * | 2021-07-09 | 2023-11-14 | Gel Blaster, Inc. | Smart target co-witnessing hit attribution system and method |
US11994358B2 (en) | 2021-07-09 | 2024-05-28 | Gel Blaster, Inc. | Toy projectile shooter firing mode assembly and system |
EP4366848A2 (en) * | 2021-07-09 | 2024-05-15 | Gel Blaster, LLC | Extended-reality projectile-firing gaming system and method |
US11986739B2 (en) | 2021-07-09 | 2024-05-21 | Gel Blaster, Inc. | Smart target co-witnessing hit attribution system and method |
CN113655927B (zh) * | 2021-08-24 | 2024-04-26 | 亮风台(上海)信息科技有限公司 | 一种界面交互方法与设备 |
US20230094370A1 (en) * | 2021-09-27 | 2023-03-30 | Juliette Laroche | Dive mask for underwater communication |
US20240036318A1 (en) * | 2021-12-21 | 2024-02-01 | Alexander Sarris | System to superimpose information over a users field of view |
US20230298221A1 (en) * | 2022-03-15 | 2023-09-21 | Zeality Inc. | Method and system for controlling access to virtual and real-world environments for head mounted device |
US11935201B2 (en) * | 2022-04-28 | 2024-03-19 | Dell Products Lp | Method and apparatus for using physical devices in extended reality environments |
US20240160017A1 (en) * | 2022-06-15 | 2024-05-16 | Lumileds Llc | Transparent optical element with line-of-sight infrared light source for eye tracking |
JP2024034133A (ja) * | 2022-08-31 | 2024-03-13 | 株式会社Jvcケンウッド | 提供装置および提供方法 |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6522325B1 (en) * | 1998-04-02 | 2003-02-18 | Kewazinga Corp. | Navigable telepresence method and system utilizing an array of cameras |
JPH11309269A (ja) * | 1998-04-27 | 1999-11-09 | Sony Corp | ゲーム装置、シミュレーション装置及びゲーム画像表示方法 |
JP2000242195A (ja) * | 1999-02-24 | 2000-09-08 | Sony Corp | 表示制御装置および表示制御方法、並びに提供媒体 |
US6603491B2 (en) | 2000-05-26 | 2003-08-05 | Jerome H. Lemelson | System and methods for controlling automatic scrolling of information on a display or screen |
JP4378118B2 (ja) * | 2003-06-27 | 2009-12-02 | 学校法人早稲田大学 | 立体映像呈示装置 |
EP2486450B1 (en) | 2008-11-02 | 2021-05-19 | David Chaum | Near to eye display system and appliance |
US20120200601A1 (en) * | 2010-02-28 | 2012-08-09 | Osterhout Group, Inc. | Ar glasses with state triggered eye control interaction with advertising facility |
JP5664006B2 (ja) * | 2010-08-09 | 2015-02-04 | カシオ計算機株式会社 | 光源制御装置およびプログラム |
US8780014B2 (en) * | 2010-08-25 | 2014-07-15 | Eastman Kodak Company | Switchable head-mounted display |
US10036891B2 (en) * | 2010-10-12 | 2018-07-31 | DISH Technologies L.L.C. | Variable transparency heads up displays |
US9213405B2 (en) * | 2010-12-16 | 2015-12-15 | Microsoft Technology Licensing, Llc | Comprehension and intent-based content for augmented reality displays |
US8625847B2 (en) * | 2011-03-21 | 2014-01-07 | Blackberry Limited | Login method based on direction of gaze |
JP2013044836A (ja) * | 2011-08-23 | 2013-03-04 | Canon Inc | 映像表示装置 |
JP5808985B2 (ja) * | 2011-09-05 | 2015-11-10 | 任天堂株式会社 | 情報処理プログラム、情報処理装置、情報処理システムおよび情報処理方法 |
-
2014
- 2014-03-12 US US14/206,219 patent/US10019057B2/en active Active
- 2014-05-23 WO PCT/US2014/039411 patent/WO2014197231A2/en active Application Filing
- 2014-05-23 JP JP2016518342A patent/JP6126305B2/ja active Active
- 2014-05-23 EP EP14733441.1A patent/EP3005031B1/en active Active
- 2014-05-23 CN CN201480035753.4A patent/CN105324738B/zh active Active
-
2017
- 2017-04-06 JP JP2017075820A patent/JP6545744B2/ja active Active
Also Published As
Publication number | Publication date |
---|---|
WO2014197231A2 (en) | 2014-12-11 |
US10019057B2 (en) | 2018-07-10 |
CN105324738B (zh) | 2018-12-18 |
JP2016526237A (ja) | 2016-09-01 |
EP3005031A2 (en) | 2016-04-13 |
WO2014197231A3 (en) | 2015-01-22 |
JP6545744B2 (ja) | 2019-07-17 |
EP3005031B1 (en) | 2019-07-31 |
CN105324738A (zh) | 2016-02-10 |
JP2017182809A (ja) | 2017-10-05 |
US20140361976A1 (en) | 2014-12-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6545744B2 (ja) | 頭部装着ディスプレイにおけるオペレーション・モード・スイッチング | |
US11654358B2 (en) | Head mounted displays (HMDs) with front facing cameras for transitioning between non-transparent modes and transparent modes | |
US11199705B2 (en) | Image rendering responsive to user actions in head mounted display | |
JP6847148B2 (ja) | 眼追跡によるリアルタイムレンズ収差補正 | |
US10489983B2 (en) | Sensory stimulus management in head mounted display | |
EP3003122B1 (en) | Systems and methods for customizing optical representation of views provided by a head mounted display based on optical prescription of a user | |
JP2020171721A (ja) | Vr観戦のための拡大された視野再レンダリング | |
WO2018005331A1 (en) | Display screen front panel of hmd for viewing by users viewing the hmd player |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20160927 |
|
A601 | Written request for extension of time |
Free format text: JAPANESE INTERMEDIATE CODE: A601 Effective date: 20161128 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20161129 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20170307 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20170406 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 6126305 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |