JP6359649B2 - 多ステップ仮想オブジェクト選択 - Google Patents
多ステップ仮想オブジェクト選択 Download PDFInfo
- Publication number
- JP6359649B2 JP6359649B2 JP2016521461A JP2016521461A JP6359649B2 JP 6359649 B2 JP6359649 B2 JP 6359649B2 JP 2016521461 A JP2016521461 A JP 2016521461A JP 2016521461 A JP2016521461 A JP 2016521461A JP 6359649 B2 JP6359649 B2 JP 6359649B2
- Authority
- JP
- Japan
- Prior art keywords
- user
- focus
- virtual object
- gaze
- selectable virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012795 verification Methods 0.000 claims description 55
- 238000000034 method Methods 0.000 claims description 40
- 230000033001 locomotion Effects 0.000 claims description 16
- 230000009471 action Effects 0.000 claims description 7
- 238000009877 rendering Methods 0.000 claims description 4
- 238000010200 validation analysis Methods 0.000 claims description 3
- 230000000875 corresponding effect Effects 0.000 claims 10
- 238000001514 detection method Methods 0.000 claims 1
- 230000000977 initiatory effect Effects 0.000 claims 1
- 238000012545 processing Methods 0.000 description 71
- 210000001508 eye Anatomy 0.000 description 54
- 210000003128 head Anatomy 0.000 description 27
- 238000004891 communication Methods 0.000 description 22
- 230000003287 optical effect Effects 0.000 description 15
- 238000005516 engineering process Methods 0.000 description 13
- 230000006870 function Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 210000001747 pupil Anatomy 0.000 description 10
- 238000005286 illumination Methods 0.000 description 7
- 238000007726 management method Methods 0.000 description 7
- 230000000007 visual effect Effects 0.000 description 7
- 238000013459 approach Methods 0.000 description 5
- 238000005259 measurement Methods 0.000 description 4
- 239000011521 glass Substances 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 239000000758 substrate Substances 0.000 description 3
- 239000011149 active material Substances 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 239000002131 composite material Substances 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 210000004087 cornea Anatomy 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000004886 head movement Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000010076 replication Effects 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
- G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Optics & Photonics (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
- Position Input By Displaying (AREA)
Description
Claims (13)
- シースルーディスプレイによってレンダリングされる仮想オブジェクトを選択するための方法において、
1つ又は複数の仮想オブジェクトを前記シースルーディスプレイにおいてレンダリングすることであって、レンダリングされた仮想オブジェクトの少なくとも1つは、前記オブジェクトに関して機能に関わるユーザによって選択された選択可能な仮想オブジェクトであり、前記選択可能な仮想オブジェクトの完全に実行可能な選択は、前記選択可能な仮想オブジェクトに対応する自動アクションを開始する、ことと、
ユーザの注視、頭部位置、及び視野を決定することであって、前記注視、頭部位置、及び視野は、対応するユーザフォーカスを決定する、ことと、
前記ユーザの、決定された対応するフォーカスがレンダリングされ且つ選択可能な仮想オブジェクトと交差する場合、交点を、フォーカスされた選択可能な仮想オブジェクトの初期ではあるがまだ完全に実行可能ではない選択として指定することと、
前記フォーカスされた選択可能な仮想オブジェクトの初期選択の指定に応答して、初期に選択された仮想オブジェクトに近接して検証オブジェクトを追加的に表示するために、前記シースルーディスプレイにおいてレンダリングを実行することと、
前記ユーザの前記フォーカスが前記検証オブジェクトと交差するかどうかを検出し、前記検証オブジェクトにフォーカスを向ける交差の検出に応答して、初期ではあるがまだ完全に実行可能ではない選択の前記指定を完全に実行可能な選択の指定にスイッチし、前記選択可能な仮想オブジェクトの前記完全に実行可能な選択に関連づけられた前記対応するアクションを開始することと、を含み、前記ユーザフォーカスが前記検証オブジェクトと交差するかどうかを検出することは、
前記選択可能な仮想オブジェクトの前記選択を開始するために、前記選択可能な仮想オブジェクトにおける前記ユーザの初期フォーカス位置と前記検証オブジェクトにおける新規フォーカス位置との間の前記ユーザフォーカスに対応する注視動き経路を検出することをさらに含み、
前記選択可能な仮想オブジェクトと前記検証オブジェクトとの間の注視動きパターンを検出することは、前記注視動きパターンが前記選択可能な仮想オブジェクトと前記検証オブジェクトとの間の前記ユーザの注視が辿る所定の経路に対応するとき、前記ユーザのフォーカスが前記検証オブジェクトにあることを決定することをさらに含む、
方法。 - 検証オブジェクトを表示する前に、前記ユーザフォーカスが、第1の時間期間の間、依然として前記選択可能な仮想オブジェクトにあるかどうかを決定することをさらに含む、請求項1に記載の方法。
- 前記検出することは、前記ユーザフォーカスが、第2の時間期間の間、依然として前記検証オブジェクトにあるかどうかを決定することを含む、請求項1に記載の方法。
- 前記ユーザの前記注視を決定することは、前記ユーザの注視が前記選択可能な仮想オブジェクト又は前記検証オブジェクトのうちの一方と交差するかどうかを決定することを含む、請求項1に記載の方法。
- 前記注視動き経路を検出することは、前記注視動きパターンを検出することを含む、請求項1に記載の方法。
- 前記注視動きパターンを検出することは、前記選択可能なオブジェクトにおける前記ユーザの初期フォーカス位置と新規フォーカス位置との間の注視経路への前記ユーザのフォーカスに対応する注視動きパターンを検出することをさらに含む、請求項1に記載の方法。
- 前記検証オブジェクトは、前記所定の経路に沿って、前記ユーザのフォーカスを前記検証オブジェクトに引き込む、請求項1に記載の方法。
- シースルーディスプレイと、
前記シースルーディスプレイに連結されたプロセッサと
を備えるシースルーディスプレイ装置であって、
前記プロセッサは、
前記シースルーディスプレイにおいて少なくとも1つの選択可能な仮想オブジェクトをレンダリングし、
ユーザの注視及び頭部位置を決定し、それによって、前記ユーザのユーザフォーカスを識別し、
前記ユーザフォーカスに基づいて、前記選択可能な仮想オブジェクトの初期ではあるがまだ完全に実行可能ではない選択を決定し、
初期ではあるがまだ完全に実行可能ではない選択の決定の後に、前記シースルーディスプレイに、前記初期ではあるがまだ完全に実行可能ではなく選択された選択可能な仮想オブジェクトに近接して検証オブジェクトのレンダリングを追加し、
前記ユーザの前記フォーカスが前記検証オブジェクトに向けられるとき、前記ユーザによる初期に選択された選択可能な仮想オブジェクトの完全に実行可能な選択を決定するようにプログラムされ、前記ユーザフォーカスが前記検証オブジェクトと交差するかどうかを検出することは、
前記選択可能な仮想オブジェクトの前記選択を開始するために、前記選択可能な仮想オブジェクトにおける前記ユーザの初期フォーカス位置と前記検証オブジェクトにおける新規フォーカス位置との間の前記ユーザのフォーカスに対応する注視動き経路を検出することをさらに含み、
前記選択可能な仮想オブジェクトと前記検証オブジェクトとの間の注視動きパターンを検出することは、前記注視動きパターンが前記選択可能な仮想オブジェクトと前記検証オブジェクトとの間の前記ユーザの注視が辿る所定の経路に対応するとき、前記ユーザのフォーカスが前記検証オブジェクトにあることを決定することをさらに含む、
装置。 - 前記プロセッサは、前記ユーザフォーカスが、第1の時間期間の間、依然として前記選択可能な仮想オブジェクトにあるかどうかを決定するようにプログラムされている、請求項8に記載の装置。
- 前記プロセッサは、前記ユーザフォーカスが、第2の時間期間の間、依然として前記検証オブジェクトにあるかどうかを検出するようにプログラムされている、請求項9に記載の装置。
- 前記第1の時間期間は、前記第2の時間期間より短い、請求項10に記載の装置。
- 前記プロセッサは、前記ユーザの前記フォーカスが前記選択可能な仮想オブジェクトから離れたかどうかを決定し、前記仮想オブジェクトの選択解除を開始するようにプログラムされている、請求項11に記載の装置。
- 前記注視動き経路を検出することは、前記選択可能な仮想オブジェクトにおける前記ユーザの初期フォーカス位置と前記新規フォーカス位置との間の注視経路への前記ユーザのフォーカスに対応する注視動きパターンを検出することをさらに含む、請求項8に記載の装置。
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/921,109 US9329682B2 (en) | 2013-06-18 | 2013-06-18 | Multi-step virtual object selection |
US13/921,109 | 2013-06-18 | ||
PCT/US2014/041961 WO2014204755A1 (en) | 2013-06-18 | 2014-06-11 | Multi-step virtual object selection |
Publications (3)
Publication Number | Publication Date |
---|---|
JP2016530600A JP2016530600A (ja) | 2016-09-29 |
JP2016530600A5 JP2016530600A5 (ja) | 2017-06-22 |
JP6359649B2 true JP6359649B2 (ja) | 2018-07-18 |
Family
ID=51168384
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2016521461A Active JP6359649B2 (ja) | 2013-06-18 | 2014-06-11 | 多ステップ仮想オブジェクト選択 |
Country Status (6)
Country | Link |
---|---|
US (1) | US9329682B2 (ja) |
EP (1) | EP3011419B1 (ja) |
JP (1) | JP6359649B2 (ja) |
KR (1) | KR102296122B1 (ja) |
CN (1) | CN105359076B (ja) |
WO (1) | WO2014204755A1 (ja) |
Families Citing this family (163)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9965681B2 (en) | 2008-12-16 | 2018-05-08 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9400390B2 (en) | 2014-01-24 | 2016-07-26 | Osterhout Group, Inc. | Peripheral lighting for head worn computing |
US9715112B2 (en) | 2014-01-21 | 2017-07-25 | Osterhout Group, Inc. | Suppression of stray light in head worn computing |
US9952664B2 (en) | 2014-01-21 | 2018-04-24 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US20150205111A1 (en) | 2014-01-21 | 2015-07-23 | Osterhout Group, Inc. | Optical configurations for head worn computing |
US9229233B2 (en) | 2014-02-11 | 2016-01-05 | Osterhout Group, Inc. | Micro Doppler presentations in head worn computing |
US9298007B2 (en) | 2014-01-21 | 2016-03-29 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9654563B2 (en) | 2012-12-14 | 2017-05-16 | Biscotti Inc. | Virtual remote functionality |
US9485459B2 (en) * | 2012-12-14 | 2016-11-01 | Biscotti Inc. | Virtual window |
US20140280644A1 (en) | 2013-03-15 | 2014-09-18 | John Cronin | Real time unified communications interaction of a predefined location in a virtual reality location |
US20140267581A1 (en) | 2013-03-15 | 2014-09-18 | John Cronin | Real time virtual reality leveraging web cams and ip cams and web cam and ip cam networks |
US20140280502A1 (en) | 2013-03-15 | 2014-09-18 | John Cronin | Crowd and cloud enabled virtual reality distributed location network |
US9838506B1 (en) | 2013-03-15 | 2017-12-05 | Sony Interactive Entertainment America Llc | Virtual reality universe representation changes viewing based upon client side parameters |
DE102013013698A1 (de) * | 2013-08-16 | 2015-02-19 | Audi Ag | Verfahren zum Betreiben einer elektronischen Datenbrille und elektronische Datenbrille |
KR102077105B1 (ko) * | 2013-09-03 | 2020-02-13 | 한국전자통신연구원 | 사용자 인터랙션을 위한 디스플레이를 설계하는 장치 및 방법 |
US9829707B2 (en) | 2014-08-12 | 2017-11-28 | Osterhout Group, Inc. | Measuring content brightness in head worn computing |
US11227294B2 (en) | 2014-04-03 | 2022-01-18 | Mentor Acquisition One, Llc | Sight information collection in head worn computing |
US9841599B2 (en) | 2014-06-05 | 2017-12-12 | Osterhout Group, Inc. | Optical configurations for head-worn see-through displays |
US9810906B2 (en) | 2014-06-17 | 2017-11-07 | Osterhout Group, Inc. | External user interface for head worn computing |
US9594246B2 (en) | 2014-01-21 | 2017-03-14 | Osterhout Group, Inc. | See-through computer display systems |
US10191279B2 (en) | 2014-03-17 | 2019-01-29 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US10684687B2 (en) | 2014-12-03 | 2020-06-16 | Mentor Acquisition One, Llc | See-through computer display systems |
US20150277118A1 (en) | 2014-03-28 | 2015-10-01 | Osterhout Group, Inc. | Sensor dependent content position in head worn computing |
US10649220B2 (en) | 2014-06-09 | 2020-05-12 | Mentor Acquisition One, Llc | Content presentation in head worn computing |
US10254856B2 (en) | 2014-01-17 | 2019-04-09 | Osterhout Group, Inc. | External user interface for head worn computing |
US9671613B2 (en) | 2014-09-26 | 2017-06-06 | Osterhout Group, Inc. | See-through computer display systems |
US9529195B2 (en) | 2014-01-21 | 2016-12-27 | Osterhout Group, Inc. | See-through computer display systems |
US9746686B2 (en) | 2014-05-19 | 2017-08-29 | Osterhout Group, Inc. | Content position calibration in head worn computing |
US9575321B2 (en) | 2014-06-09 | 2017-02-21 | Osterhout Group, Inc. | Content presentation in head worn computing |
US9939934B2 (en) | 2014-01-17 | 2018-04-10 | Osterhout Group, Inc. | External user interface for head worn computing |
US11103122B2 (en) | 2014-07-15 | 2021-08-31 | Mentor Acquisition One, Llc | Content presentation in head worn computing |
US20160019715A1 (en) | 2014-07-15 | 2016-01-21 | Osterhout Group, Inc. | Content presentation in head worn computing |
US9448409B2 (en) | 2014-11-26 | 2016-09-20 | Osterhout Group, Inc. | See-through computer display systems |
US20150228119A1 (en) | 2014-02-11 | 2015-08-13 | Osterhout Group, Inc. | Spatial location presentation in head worn computing |
US9299194B2 (en) * | 2014-02-14 | 2016-03-29 | Osterhout Group, Inc. | Secure sharing in head worn computing |
US9753288B2 (en) | 2014-01-21 | 2017-09-05 | Osterhout Group, Inc. | See-through computer display systems |
US9651784B2 (en) | 2014-01-21 | 2017-05-16 | Osterhout Group, Inc. | See-through computer display systems |
US9766463B2 (en) | 2014-01-21 | 2017-09-19 | Osterhout Group, Inc. | See-through computer display systems |
US20150205135A1 (en) | 2014-01-21 | 2015-07-23 | Osterhout Group, Inc. | See-through computer display systems |
US11669163B2 (en) | 2014-01-21 | 2023-06-06 | Mentor Acquisition One, Llc | Eye glint imaging in see-through computer display systems |
US9494800B2 (en) | 2014-01-21 | 2016-11-15 | Osterhout Group, Inc. | See-through computer display systems |
US9523856B2 (en) | 2014-01-21 | 2016-12-20 | Osterhout Group, Inc. | See-through computer display systems |
US9740280B2 (en) | 2014-01-21 | 2017-08-22 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9836122B2 (en) | 2014-01-21 | 2017-12-05 | Osterhout Group, Inc. | Eye glint imaging in see-through computer display systems |
US9532715B2 (en) | 2014-01-21 | 2017-01-03 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US9811152B2 (en) | 2014-01-21 | 2017-11-07 | Osterhout Group, Inc. | Eye imaging in head worn computing |
US11487110B2 (en) | 2014-01-21 | 2022-11-01 | Mentor Acquisition One, Llc | Eye imaging in head worn computing |
US11892644B2 (en) | 2014-01-21 | 2024-02-06 | Mentor Acquisition One, Llc | See-through computer display systems |
US11737666B2 (en) | 2014-01-21 | 2023-08-29 | Mentor Acquisition One, Llc | Eye imaging in head worn computing |
US9846308B2 (en) | 2014-01-24 | 2017-12-19 | Osterhout Group, Inc. | Haptic systems for head-worn computers |
US9588343B2 (en) * | 2014-01-25 | 2017-03-07 | Sony Interactive Entertainment America Llc | Menu navigation in a head-mounted display |
US9401540B2 (en) | 2014-02-11 | 2016-07-26 | Osterhout Group, Inc. | Spatial location presentation in head worn computing |
US9852545B2 (en) | 2014-02-11 | 2017-12-26 | Osterhout Group, Inc. | Spatial location presentation in head worn computing |
US20160187651A1 (en) | 2014-03-28 | 2016-06-30 | Osterhout Group, Inc. | Safety for a vehicle operator with an hmd |
US10853589B2 (en) | 2014-04-25 | 2020-12-01 | Mentor Acquisition One, Llc | Language translation with head-worn computing |
US9672210B2 (en) | 2014-04-25 | 2017-06-06 | Osterhout Group, Inc. | Language translation with head-worn computing |
US9651787B2 (en) | 2014-04-25 | 2017-05-16 | Osterhout Group, Inc. | Speaker assembly for headworn computer |
US9423842B2 (en) | 2014-09-18 | 2016-08-23 | Osterhout Group, Inc. | Thermal management for head-worn computer |
US10663740B2 (en) | 2014-06-09 | 2020-05-26 | Mentor Acquisition One, Llc | Content presentation in head worn computing |
US10416760B2 (en) * | 2014-07-25 | 2019-09-17 | Microsoft Technology Licensing, Llc | Gaze-based object placement within a virtual reality environment |
US10451875B2 (en) | 2014-07-25 | 2019-10-22 | Microsoft Technology Licensing, Llc | Smart transparency for virtual objects |
US10311638B2 (en) | 2014-07-25 | 2019-06-04 | Microsoft Technology Licensing, Llc | Anti-trip when immersed in a virtual reality environment |
US9766460B2 (en) | 2014-07-25 | 2017-09-19 | Microsoft Technology Licensing, Llc | Ground plane adjustment in a virtual reality environment |
US9865089B2 (en) | 2014-07-25 | 2018-01-09 | Microsoft Technology Licensing, Llc | Virtual reality environment with real world objects |
US9904055B2 (en) | 2014-07-25 | 2018-02-27 | Microsoft Technology Licensing, Llc | Smart placement of virtual objects to stay in the field of view of a head mounted display |
US9858720B2 (en) | 2014-07-25 | 2018-01-02 | Microsoft Technology Licensing, Llc | Three-dimensional mixed-reality viewport |
US20180133593A1 (en) * | 2014-08-07 | 2018-05-17 | Fove, Inc. | Algorithm for identifying three-dimensional point-of-gaze |
KR102309281B1 (ko) * | 2014-11-07 | 2021-10-08 | 삼성전자주식회사 | 오브젝트를 표시하는 방향 기반 전자 장치 및 방법 |
US9684172B2 (en) | 2014-12-03 | 2017-06-20 | Osterhout Group, Inc. | Head worn computer display systems |
USD743963S1 (en) | 2014-12-22 | 2015-11-24 | Osterhout Group, Inc. | Air mouse |
USD751552S1 (en) | 2014-12-31 | 2016-03-15 | Osterhout Group, Inc. | Computer glasses |
USD753114S1 (en) | 2015-01-05 | 2016-04-05 | Osterhout Group, Inc. | Air mouse |
US9659411B2 (en) | 2015-01-14 | 2017-05-23 | Oculus Vr, Llc | Passive locators for a virtual reality headset |
US9846968B2 (en) | 2015-01-20 | 2017-12-19 | Microsoft Technology Licensing, Llc | Holographic bird's eye view camera |
US20160239985A1 (en) | 2015-02-17 | 2016-08-18 | Osterhout Group, Inc. | See-through computer display systems |
US9558760B2 (en) | 2015-03-06 | 2017-01-31 | Microsoft Technology Licensing, Llc | Real-time remodeling of user voice in an immersive visualization system |
JP6587421B2 (ja) * | 2015-05-25 | 2019-10-09 | キヤノン株式会社 | 情報処理装置、情報処理方法、及びプログラム |
US9959677B2 (en) * | 2015-05-26 | 2018-05-01 | Google Llc | Multidimensional graphical method for entering and exiting applications and activities in immersive media |
WO2017024118A1 (en) * | 2015-08-04 | 2017-02-09 | Google Inc. | Hover behavior for gaze interactions in virtual reality |
TWI736542B (zh) * | 2015-08-06 | 2021-08-21 | 日商新力股份有限公司 | 資訊處理裝置、資料配訊伺服器及資訊處理方法、以及非暫時性電腦可讀取之記錄媒體 |
EP3341816A1 (en) * | 2015-08-28 | 2018-07-04 | Thomson Licensing | Assisted item selection for see through glasses |
US10127725B2 (en) | 2015-09-02 | 2018-11-13 | Microsoft Technology Licensing, Llc | Augmented-reality imaging |
US10082865B1 (en) * | 2015-09-29 | 2018-09-25 | Rockwell Collins, Inc. | Dynamic distortion mapping in a worn display |
IL307648A (en) | 2015-10-20 | 2023-12-01 | Magic Leap Inc | Selection of virtual objects in three-dimensional space |
US10962780B2 (en) * | 2015-10-26 | 2021-03-30 | Microsoft Technology Licensing, Llc | Remote rendering for virtual images |
US20170212582A1 (en) * | 2016-01-21 | 2017-07-27 | Cisco Technology, Inc. | User interface selection |
US10229541B2 (en) * | 2016-01-28 | 2019-03-12 | Sony Interactive Entertainment America Llc | Methods and systems for navigation within virtual reality space using head mounted display |
CN105824409A (zh) * | 2016-02-16 | 2016-08-03 | 乐视致新电子科技(天津)有限公司 | 虚拟现实的交互控制方法及装置 |
US10591728B2 (en) | 2016-03-02 | 2020-03-17 | Mentor Acquisition One, Llc | Optical systems for head-worn computers |
US10667981B2 (en) | 2016-02-29 | 2020-06-02 | Mentor Acquisition One, Llc | Reading assistance system for visually impaired |
US9824500B2 (en) * | 2016-03-16 | 2017-11-21 | Microsoft Technology Licensing, Llc | Virtual object pathing |
JP6630607B2 (ja) * | 2016-03-28 | 2020-01-15 | 株式会社バンダイナムコエンターテインメント | シミュレーション制御装置及びシミュレーション制御プログラム |
JP6200023B1 (ja) * | 2016-03-28 | 2017-09-20 | 株式会社バンダイナムコエンターテインメント | シミュレーション制御装置及びシミュレーション制御プログラム |
JP6625467B2 (ja) * | 2016-03-28 | 2019-12-25 | 株式会社バンダイナムコエンターテインメント | シミュレーション制御装置及びシミュレーション制御プログラム |
US10048751B2 (en) | 2016-03-31 | 2018-08-14 | Verizon Patent And Licensing Inc. | Methods and systems for gaze-based control of virtual reality media content |
EP3436863B1 (en) | 2016-03-31 | 2024-07-10 | Magic Leap, Inc. | Interactions with 3d virtual objects using poses and multiple-dof controllers |
EP3236363A1 (en) * | 2016-04-18 | 2017-10-25 | Nokia Technologies Oy | Content search |
JP6968800B2 (ja) * | 2016-04-27 | 2021-11-17 | ロヴィ ガイズ, インコーポレイテッド | 仮想現実環境を表示するヘッドアップディスプレイ上に付加的コンテンツを表示するための方法およびシステム |
CN114040153B (zh) | 2016-05-09 | 2024-04-12 | 格拉班谷公司 | 用于在环境内计算机视觉驱动应用的*** |
AU2016203135A1 (en) | 2016-05-13 | 2017-11-30 | Canon Kabushiki Kaisha | Method, system and apparatus for selecting a video frame |
EP3249497A1 (en) * | 2016-05-24 | 2017-11-29 | Harman Becker Automotive Systems GmbH | Eye tracking |
US11468111B2 (en) | 2016-06-01 | 2022-10-11 | Microsoft Technology Licensing, Llc | Online perspective search for 3D components |
US10788888B2 (en) * | 2016-06-07 | 2020-09-29 | Koninklijke Kpn N.V. | Capturing and rendering information involving a virtual environment |
US10990169B2 (en) | 2016-06-28 | 2021-04-27 | Rec Room Inc. | Systems and methods for assisting virtual gestures based on viewing frustum |
US10268266B2 (en) | 2016-06-29 | 2019-04-23 | Microsoft Technology Licensing, Llc | Selection of objects in three-dimensional space |
US10659247B2 (en) | 2016-07-09 | 2020-05-19 | Grabango Co. | Computer vision for ambient data acquisition |
US10496163B2 (en) | 2016-09-22 | 2019-12-03 | Apple Inc. | Eye and head tracking |
US20180082476A1 (en) * | 2016-09-22 | 2018-03-22 | International Business Machines Corporation | Collaborative search for out of field of view augmented reality objects |
CN107885316A (zh) * | 2016-09-29 | 2018-04-06 | 阿里巴巴集团控股有限公司 | 一种基于手势的交互方法及装置 |
US20180095635A1 (en) * | 2016-10-04 | 2018-04-05 | Facebook, Inc. | Controls and Interfaces for User Interactions in Virtual Spaces |
US20180095618A1 (en) | 2016-10-04 | 2018-04-05 | Facebook, Inc. | Controls and Interfaces for User Interactions in Virtual Spaces |
JP2018064836A (ja) * | 2016-10-20 | 2018-04-26 | 株式会社Bbq | バーチャルゲーム装置 |
WO2018081125A1 (en) * | 2016-10-24 | 2018-05-03 | Snap Inc. | Redundant tracking system |
CN106774821B (zh) * | 2016-11-08 | 2020-05-19 | 广州视源电子科技股份有限公司 | 基于虚拟现实技术的显示方法和*** |
KR102104705B1 (ko) * | 2016-11-23 | 2020-05-29 | 최해용 | 휴대용 혼합 현실 장치 |
GB2558284B (en) | 2016-12-23 | 2021-12-08 | Sony Interactive Entertainment Inc | Virtual reality |
CN110462669B (zh) | 2017-02-10 | 2023-08-11 | 格拉班谷公司 | 自动化购物环境内的动态顾客结账体验 |
WO2018209156A1 (en) | 2017-05-10 | 2018-11-15 | Grabango Co. | Series-configured camera array for efficient deployment |
CN109804332B (zh) * | 2017-06-15 | 2020-08-14 | 腾讯科技(深圳)有限公司 | 即时预览沉浸式内容的***和方法 |
US20190005479A1 (en) | 2017-06-21 | 2019-01-03 | William Glaser | Interfacing with a point of sale system from a computer vision system |
EP3672478A4 (en) | 2017-08-23 | 2021-05-19 | Neurable Inc. | BRAIN COMPUTER INTERFACE WITH HIGH SPEED EYE TRACKING |
DE102017215074A1 (de) * | 2017-08-29 | 2019-02-28 | Siemens Healthcare Gmbh | Verfahren und Auswahleinheit zum Auswählen eines virtuellen Objekts oder eines Bildparameterwerts |
CN107562199B (zh) * | 2017-08-31 | 2020-10-09 | 北京金山安全软件有限公司 | 一种页面对象设置方法、装置、电子设备及存储介质 |
US20190079591A1 (en) | 2017-09-14 | 2019-03-14 | Grabango Co. | System and method for human gesture processing from video input |
KR102518404B1 (ko) | 2017-09-29 | 2023-04-06 | 삼성전자주식회사 | 전자 장치 및 그의 시선 정보를 이용한 컨텐트 실행 방법 |
WO2019063706A1 (en) * | 2017-09-29 | 2019-04-04 | Motognosis UG (haftungsbeschränkt) | DEVICE FOR DETERMINING AND ANALYZING THE MOTOR SKILLS AND THE CURRENT SKILLS OF A PERSON |
US10963704B2 (en) | 2017-10-16 | 2021-03-30 | Grabango Co. | Multiple-factor verification for vision-based systems |
CN111542800A (zh) | 2017-11-13 | 2020-08-14 | 神经股份有限公司 | 具有对于高速、精确和直观的用户交互的适配的大脑-计算机接口 |
US11481805B2 (en) | 2018-01-03 | 2022-10-25 | Grabango Co. | Marketing and couponing in a retail environment using computer vision |
US20190212815A1 (en) * | 2018-01-10 | 2019-07-11 | Samsung Electronics Co., Ltd. | Method and apparatus to determine trigger intent of user |
JP6587364B2 (ja) * | 2018-01-22 | 2019-10-09 | 株式会社コナミデジタルエンタテインメント | プログラムおよび画像表示システム |
WO2019142817A1 (ja) * | 2018-01-22 | 2019-07-25 | 株式会社コナミデジタルエンタテインメント | 画像表示システムおよびそのプログラムを記録した記録媒体 |
JP6628331B2 (ja) * | 2018-01-22 | 2020-01-08 | 株式会社コナミデジタルエンタテインメント | プログラムおよび画像表示システム |
WO2019172678A1 (en) * | 2018-03-07 | 2019-09-12 | Samsung Electronics Co., Ltd. | System and method for augmented reality interaction |
US11145096B2 (en) | 2018-03-07 | 2021-10-12 | Samsung Electronics Co., Ltd. | System and method for augmented reality interaction |
KR102086779B1 (ko) * | 2018-05-14 | 2020-03-09 | 단국대학교 산학협력단 | 포커스 설정 모듈 및 방법, 그것을 포함하는 버추얼 영상 재생 시스템 |
US10768426B2 (en) * | 2018-05-21 | 2020-09-08 | Microsoft Technology Licensing, Llc | Head mounted display system receiving three-dimensional push notification |
EP3803688A4 (en) * | 2018-06-05 | 2021-08-04 | Magic Leap, Inc. | MATCHING CONTENT WITH A 3D SPATIAL ENVIRONMENT |
JP7457453B2 (ja) * | 2018-07-27 | 2024-03-28 | 株式会社栗本鐵工所 | 仮想オブジェクト触覚提示装置およびプログラム |
JP6780865B2 (ja) * | 2018-07-31 | 2020-11-04 | 株式会社コナミデジタルエンタテインメント | 端末装置、及びプログラム |
CN112805750A (zh) | 2018-08-13 | 2021-05-14 | 奇跃公司 | 跨现实*** |
US11227435B2 (en) | 2018-08-13 | 2022-01-18 | Magic Leap, Inc. | Cross reality system |
US10664050B2 (en) | 2018-09-21 | 2020-05-26 | Neurable Inc. | Human-computer interface using high-speed and accurate tracking of user interactions |
US11232635B2 (en) | 2018-10-05 | 2022-01-25 | Magic Leap, Inc. | Rendering location specific virtual content in any location |
US11288648B2 (en) | 2018-10-29 | 2022-03-29 | Grabango Co. | Commerce automation for a fueling station |
CA3131604A1 (en) | 2019-03-01 | 2020-09-10 | Grabango Co. | Cashier interface for linking customers to virtual data |
WO2021020068A1 (ja) * | 2019-07-26 | 2021-02-04 | ソニー株式会社 | 情報処理装置、情報処理方法、およびプログラム |
WO2021076748A1 (en) | 2019-10-15 | 2021-04-22 | Magic Leap, Inc. | Cross reality system with wireless fingerprints |
US11568605B2 (en) | 2019-10-15 | 2023-01-31 | Magic Leap, Inc. | Cross reality system with localization service |
JP2022551734A (ja) | 2019-10-15 | 2022-12-13 | マジック リープ, インコーポレイテッド | 複数のデバイスタイプをサポートするクロスリアリティシステム |
EP4059007A4 (en) | 2019-11-12 | 2023-11-01 | Magic Leap, Inc. | CROSS-REALLY SYSTEM WITH LOCATION SERVICE AND SHARED LOCATION-BASED CONTENT |
CN114762008A (zh) | 2019-12-09 | 2022-07-15 | 奇跃公司 | 简化的虚拟内容编程的交叉现实*** |
EP4104145A4 (en) | 2020-02-13 | 2024-01-24 | Magic Leap, Inc. | CROSS-REALLY SYSTEM PRIORITIZING GEOLOCALIZATION INFORMATION FOR LOCALIZATION |
CN115427758A (zh) | 2020-02-13 | 2022-12-02 | 奇跃公司 | 具有精确共享地图的交叉现实*** |
EP4104001A4 (en) | 2020-02-13 | 2024-03-13 | Magic Leap, Inc. | CROSS-REALLY SYSTEM WITH MAP PROCESSING USING MULTIPLE RESOLUTION FRAME DESCRIPTORS |
CN115461787A (zh) | 2020-02-26 | 2022-12-09 | 奇跃公司 | 具有快速定位的交叉现实*** |
KR20210130281A (ko) | 2020-04-21 | 2021-11-01 | 삼성디스플레이 주식회사 | 사용자 지정 알고리즘을 이용한 이동 통신 단말기의 제어 방법, 및 이동 통신 단말기 |
US11900547B2 (en) | 2020-04-29 | 2024-02-13 | Magic Leap, Inc. | Cross reality system for large scale environments |
GB202009876D0 (en) * | 2020-06-29 | 2020-08-12 | Microsoft Technology Licensing Llc | Visual interface for a computer system |
GB202009874D0 (en) * | 2020-06-29 | 2020-08-12 | Microsoft Technology Licensing Llc | Visual interface for a computer system |
US12008160B2 (en) | 2022-03-30 | 2024-06-11 | Apple Inc. | Eye tracking based selection of a user interface (UI) element based on targeting criteria |
US20240103676A1 (en) * | 2022-09-24 | 2024-03-28 | Apple Inc. | Methods for interacting with user interfaces based on attention |
WO2024064388A1 (en) * | 2022-09-24 | 2024-03-28 | Apple Inc. | Devices, methods, for interacting with graphical user interfaces |
Family Cites Families (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4595990A (en) | 1980-12-31 | 1986-06-17 | International Business Machines Corporation | Eye controlled information transfer |
JPH09204287A (ja) * | 1996-01-25 | 1997-08-05 | Canon Inc | 処理選択方法及び装置 |
GB2377147A (en) * | 2001-06-27 | 2002-12-31 | Nokia Corp | A virtual reality user interface |
US7046924B2 (en) | 2002-11-25 | 2006-05-16 | Eastman Kodak Company | Method and computer program product for determining an area of importance in an image using eye monitoring information |
US7401920B1 (en) * | 2003-05-20 | 2008-07-22 | Elbit Systems Ltd. | Head mounted eye tracking and display system |
JP2005038008A (ja) * | 2003-07-15 | 2005-02-10 | Canon Inc | 画像処理方法、画像処理装置 |
US20050047629A1 (en) * | 2003-08-25 | 2005-03-03 | International Business Machines Corporation | System and method for selectively expanding or contracting a portion of a display using eye-gaze tracking |
US9274598B2 (en) * | 2003-08-25 | 2016-03-01 | International Business Machines Corporation | System and method for selecting and activating a target object using a combination of eye gaze and key presses |
JP4883774B2 (ja) * | 2006-08-07 | 2012-02-22 | キヤノン株式会社 | 情報処理装置及びその制御方法、プログラム |
PL2242419T3 (pl) | 2008-02-14 | 2016-05-31 | Nokia Technologies Oy | Urządzenie i sposób określania kierunku spojrzenia |
US8494215B2 (en) * | 2009-03-05 | 2013-07-23 | Microsoft Corporation | Augmenting a field of view in connection with vision-tracking |
US9507418B2 (en) * | 2010-01-21 | 2016-11-29 | Tobii Ab | Eye tracker based contextual action |
US20130314303A1 (en) * | 2010-02-28 | 2013-11-28 | Osterhout Group, Inc. | Ar glasses with user action control of and between internal and external applications with feedback |
US20120005624A1 (en) | 2010-07-02 | 2012-01-05 | Vesely Michael A | User Interface Elements for Use within a Three Dimensional Scene |
US8593375B2 (en) | 2010-07-23 | 2013-11-26 | Gregory A Maltz | Eye gaze user interface and method |
US20120086645A1 (en) | 2010-10-11 | 2012-04-12 | Siemens Corporation | Eye typing system using a three-layer user interface |
US9213405B2 (en) * | 2010-12-16 | 2015-12-15 | Microsoft Technology Licensing, Llc | Comprehension and intent-based content for augmented reality displays |
US9043042B2 (en) | 2011-07-19 | 2015-05-26 | GM Global Technology Operations LLC | Method to map gaze position to information display in vehicle |
US8629815B2 (en) | 2011-08-09 | 2014-01-14 | Google Inc. | Laser alignment of binocular head mounted display |
US9285592B2 (en) | 2011-08-18 | 2016-03-15 | Google Inc. | Wearable device with input and output structures |
US9323325B2 (en) * | 2011-08-30 | 2016-04-26 | Microsoft Technology Licensing, Llc | Enhancing an object of interest in a see-through, mixed reality display device |
US9081177B2 (en) * | 2011-10-07 | 2015-07-14 | Google Inc. | Wearable computer with nearby object response |
US20130326364A1 (en) * | 2012-05-31 | 2013-12-05 | Stephen G. Latta | Position relative hologram interactions |
US9116666B2 (en) * | 2012-06-01 | 2015-08-25 | Microsoft Technology Licensing, Llc | Gesture based region identification for holograms |
US20130335405A1 (en) * | 2012-06-18 | 2013-12-19 | Michael J. Scavezze | Virtual object generation within a virtual environment |
US20140049462A1 (en) * | 2012-08-20 | 2014-02-20 | Google Inc. | User interface element focus based on user's gaze |
US20140125698A1 (en) * | 2012-11-05 | 2014-05-08 | Stephen Latta | Mixed-reality arena |
-
2013
- 2013-06-18 US US13/921,109 patent/US9329682B2/en active Active
-
2014
- 2014-06-11 EP EP14737401.1A patent/EP3011419B1/en active Active
- 2014-06-11 CN CN201480034944.9A patent/CN105359076B/zh active Active
- 2014-06-11 KR KR1020167001428A patent/KR102296122B1/ko active IP Right Grant
- 2014-06-11 WO PCT/US2014/041961 patent/WO2014204755A1/en active Application Filing
- 2014-06-11 JP JP2016521461A patent/JP6359649B2/ja active Active
Also Published As
Publication number | Publication date |
---|---|
CN105359076A (zh) | 2016-02-24 |
KR20160020571A (ko) | 2016-02-23 |
CN105359076B (zh) | 2019-06-18 |
EP3011419A1 (en) | 2016-04-27 |
WO2014204755A1 (en) | 2014-12-24 |
JP2016530600A (ja) | 2016-09-29 |
US20140372957A1 (en) | 2014-12-18 |
KR102296122B1 (ko) | 2021-08-30 |
US9329682B2 (en) | 2016-05-03 |
EP3011419B1 (en) | 2018-03-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6359649B2 (ja) | 多ステップ仮想オブジェクト選択 | |
KR102208376B1 (ko) | Hmd 상의 하이브리드 월드/바디 락 hud | |
JP5965410B2 (ja) | 拡張現実ディスプレイ用最適焦点エリア | |
US9230368B2 (en) | Hologram anchoring and dynamic positioning | |
US10955665B2 (en) | Concurrent optimal viewing of virtual objects | |
KR101912958B1 (ko) | 증강 현실 디스플레이를 위한 자동 가변 가상 초점 | |
US9116666B2 (en) | Gesture based region identification for holograms | |
US20130342572A1 (en) | Control of displayed content in virtual environments | |
US20130326364A1 (en) | Position relative hologram interactions | |
US20130328925A1 (en) | Object focus in a mixed reality environment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20170509 |
|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20170509 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20180125 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20180124 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20180418 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20180528 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20180620 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 6359649 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |