WO2020143546A1 - 增强现实***及控制方法 - Google Patents
增强现实***及控制方法 Download PDFInfo
- Publication number
- WO2020143546A1 WO2020143546A1 PCT/CN2020/070257 CN2020070257W WO2020143546A1 WO 2020143546 A1 WO2020143546 A1 WO 2020143546A1 CN 2020070257 W CN2020070257 W CN 2020070257W WO 2020143546 A1 WO2020143546 A1 WO 2020143546A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- display device
- display
- user
- augmented reality
- eyeball
- Prior art date
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 69
- 238000000034 method Methods 0.000 title claims description 14
- 238000006073 displacement reaction Methods 0.000 claims abstract description 12
- 210000005252 bulbus oculi Anatomy 0.000 claims description 64
- 230000003287 optical effect Effects 0.000 claims description 6
- 210000001747 pupil Anatomy 0.000 claims description 4
- 238000012545 processing Methods 0.000 description 21
- 230000005540 biological transmission Effects 0.000 description 8
- 210000001508 eye Anatomy 0.000 description 8
- 230000001815 facial effect Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 7
- 210000000056 organ Anatomy 0.000 description 5
- 238000010586 diagram Methods 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U10/00—Type of UAV
- B64U10/10—Rotorcrafts
- B64U10/13—Flying platforms
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U30/00—Means for producing lift; Empennages; Arrangements thereof
- B64U30/20—Rotors; Rotor supports
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/193—Preprocessing; Feature extraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/197—Matching; Classification
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U2101/00—UAVs specially adapted for particular uses or applications
- B64U2101/30—UAVs specially adapted for particular uses or applications for imaging, photography or videography
- B64U2101/31—UAVs specially adapted for particular uses or applications for imaging, photography or videography for surveillance
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- B64U50/00—Propulsion; Power supply
- B64U50/30—Supply or distribution of electrical power
- B64U50/31—Supply or distribution of electrical power generated by photovoltaics
Definitions
- augmented reality products mainly include functional modules such as optical modules, sensor modules, camera modules, headphone modules, and structural wearable modules. Users can wear these functional modules on their limbs through the structural wearable modules.
- the augmented reality module includes a display system and a display module.
- the display system is used to generate image information; the display module is used to generate the virtual image according to the image information.
- the adjustment module is used to adjust the flying attitude of the aircraft according to the user's eyeball position, so that the user can obtain the virtual image.
- the present disclosure provides a display device including a display configured to display an image; a tracking module configured to acquire position information of a target object; and a movement controller configured to control the location based on the received displacement instruction information The moving state of the display device, so that the display image and the target object conform to a first mutual position relationship.
- the display device provided by the present disclosure further includes a displacement judgment processor configured to generate the displacement instruction information according to the target object position information acquired by the tracking module.
- the displacement instruction information is embodied as information for adjusting the flying attitude of the aircraft in the following embodiments.
- the display device may be an augmented reality system, a virtual reality system, and other devices with display functions. This disclosure only takes the augmented reality system as an example for description, but does not constitute a limitation to this disclosure.
- the augmented reality module is fixed to the aircraft for generating virtual images; the tracking module is provided on the aircraft to detect the position information of the user's eyeballs; the adjustment module 4 is provided on the aircraft 1 for
- the position information of the user's eyeball adjusts the flying attitude of the aircraft, so that the user's eyeball can acquire the virtual image.
- adjusting the flying attitude of the aircraft includes adjusting the height of the aircraft and the azimuth of the fuselage.
- the relative position of the augmented reality module and the user's eyeball can be adjusted by adjusting the flying attitude of the aircraft.
- the user's eyeball can acquire the virtual image.
- the position information of the eyeball may include the frontal direction of the eyeball.
- the tracking module is used to detect the position information of the user's eyeballs. It should be understood that, in other exemplary embodiments, the tracking module may also have more implementation methods, which all fall within the protection scope of the present disclosure.
- the augmented reality system may further include a power supply system 7, and the power supply system may include a solar panel arranged on the aircraft.
- the power supply system may further include a storage battery, and the storage battery may store electrical energy generated by the solar panel, so that the augmented reality system is used in a low-light environment.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Mechanical Engineering (AREA)
- Aviation & Aerospace Engineering (AREA)
- Ophthalmology & Optometry (AREA)
- Computer Hardware Design (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- Remote Sensing (AREA)
- Geometry (AREA)
- Computer Vision & Pattern Recognition (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
Claims (14)
- 一种显示装置,包括:显示器,被配置为显示图像;以及移动控制器,被配置为根据接收到的位移指令信息,控制所述显示装置的移动状态,以使所述显示图像与所述目标对象符合第一相互位置关系。
- 根据权利要求1所述的显示装置,其中,所述目标对象为用户眼球。
- 根据权利要求2所述的显示装置,其中,所述显示装置包括飞行器。
- 根据权利要求3所述的显示装置,其中,所述显示装置为增强现实***。
- 根据权利要求4所述的显示装置,其中,所述增强现实***还包括:偏光单元,用于将所述显示图像传输到所述用户眼球。
- 根据权利要求5所述的显示装置,其中,所述偏光单元为衍射光栅、自由曲面棱镜、光波导中的一种或多种。
- 根据权利要求1所述的显示装置,其中,所述显示装置还包括:定位模块,用于获取所述显示装置的位置信息。
- 根据权利要求1所述的显示装置,其中,所述显示装置还包括:供电***,所述供电***包括布置在所述显示装置上的太阳能电池板。
- 根据前述权利要求4所述的显示装置,其中,所述第一相互位置关系为所述显示图像位于所述增强现实***的出瞳区域内。
- 根据前述权利要求9所述的显示装置,其中,所述第一相互位置关系包括所述显示图像与用户眼球的距离关系和所述显示图像与用户眼球的偏转角度关系。
- 根据前述权利要求10所述的显示装置,其中,所述距离关系的范围在25mm-50mm之间,所述偏转角度关系的范围在以所述用户眼球中心为参考,向左偏转60°、向上偏转75°和向下偏转60°。
- 根据前述权利要求任一项所述的显示装置,其中,所述显示装置还包括:追踪模组,被配置为获取目标对象的位置信息;以及位移判断处理器,被配置为根据所述追踪模组获取的目标对象的位置信息生成所述位移指令信息。
- 一种显示***,包括位于云端的具有判断位移功能的处理器以及根据权利要求1-12中任一项所述的显示装置。
- 一种显示装置控制方法,用于控制权利要求1-12任一项所述的显示装置,包括:利用显示器显示图像;利用移动控制器,根据接收到的位移指令信息控制所述显示装置的移动状态,以使所述显示图像与所述目标对象符合第一相互位置关系。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/966,113 US11402900B2 (en) | 2019-01-07 | 2020-01-03 | Augmented reality system comprising an aircraft and control method therefor |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910013109.1A CN109727317B (zh) | 2019-01-07 | 2019-01-07 | 增强现实***及控制方法 |
CN201910013109.1 | 2019-01-07 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020143546A1 true WO2020143546A1 (zh) | 2020-07-16 |
Family
ID=66298167
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/070257 WO2020143546A1 (zh) | 2019-01-07 | 2020-01-03 | 增强现实***及控制方法 |
Country Status (3)
Country | Link |
---|---|
US (1) | US11402900B2 (zh) |
CN (1) | CN109727317B (zh) |
WO (1) | WO2020143546A1 (zh) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109727317B (zh) * | 2019-01-07 | 2021-02-09 | 京东方科技集团股份有限公司 | 增强现实***及控制方法 |
KR102670582B1 (ko) * | 2023-12-15 | 2024-05-30 | (주)프리뉴 | 엄폐 기능을 가지는 드론 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130265331A1 (en) * | 2012-04-09 | 2013-10-10 | National Applied Research Laboratories | Virtual Reality Telescopic Observation System of Intelligent Electronic Device and Method Thereof |
CN106444023A (zh) * | 2016-08-29 | 2017-02-22 | 北京知境科技有限公司 | 一种超大视场角的双目立体显示的透射式增强现实*** |
CN107027015A (zh) * | 2017-04-28 | 2017-08-08 | 广景视睿科技(深圳)有限公司 | 基于增强现实的3d动向投影***以及用于该***的投影方法 |
CN107027014A (zh) * | 2017-03-23 | 2017-08-08 | 广景视睿科技(深圳)有限公司 | 一种动向智能投影***及其方法 |
CN109727317A (zh) * | 2019-01-07 | 2019-05-07 | 京东方科技集团股份有限公司 | 增强现实***及控制方法 |
Family Cites Families (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2363273A (en) * | 2000-06-09 | 2001-12-12 | Secr Defence | Computation time reduction for three dimensional displays |
CN103426282A (zh) * | 2013-07-31 | 2013-12-04 | 深圳市大疆创新科技有限公司 | 遥控方法及终端 |
EP3140716B1 (en) * | 2014-05-08 | 2020-04-01 | Sony Corporation | Portable electronic equipment and method of controlling a portable electronic equipment |
JP6342302B2 (ja) * | 2014-11-10 | 2018-06-13 | トヨタ紡織株式会社 | 乗物の制御方法 |
KR102353231B1 (ko) * | 2015-04-24 | 2022-01-20 | 삼성디스플레이 주식회사 | 비행 표시장치 |
CN204937488U (zh) | 2015-06-06 | 2016-01-06 | 昆山玖趣智能科技有限公司 | 一种ar增强现实3d视觉智能四翼飞行器 |
US20170169612A1 (en) * | 2015-12-15 | 2017-06-15 | N.S. International, LTD | Augmented reality alignment system and method |
WO2017117298A1 (en) * | 2015-12-28 | 2017-07-06 | Dezso Molnar | Unmanned aerial system with transportable screen |
CN105677206A (zh) * | 2016-01-08 | 2016-06-15 | 北京乐驾科技有限公司 | 一种基于视觉的抬头显示器控制***及方法 |
WO2017181429A1 (en) | 2016-04-22 | 2017-10-26 | SZ DJI Technology Co., Ltd. | Systems and methods for processing image data based on region-of-interest (roi) of a user |
CN205942090U (zh) | 2016-04-29 | 2017-02-08 | 深圳市大疆创新科技有限公司 | 可穿戴设备及无人机*** |
CN107562179B (zh) * | 2016-06-30 | 2024-04-26 | 上海青研科技有限公司 | 一种用于眼球追踪和虹膜识别的一体化镜杯 |
WO2018039278A1 (en) | 2016-08-22 | 2018-03-01 | Magic Leap, Inc. | Multi-layer diffractive eyepiece |
CN106094857A (zh) * | 2016-08-22 | 2016-11-09 | 京东方科技集团股份有限公司 | 无人机、穿戴设备及无人机的飞行控制方法、装置 |
CN106571084A (zh) | 2016-10-19 | 2017-04-19 | 广东容祺智能科技有限公司 | 一种基于增加现实的无人机模拟飞行*** |
CN109117692B (zh) * | 2017-06-23 | 2024-03-29 | 深圳荆虹科技有限公司 | 一种虹膜识别装置、***及方法 |
CN108475442A (zh) * | 2017-06-29 | 2018-08-31 | 深圳市大疆创新科技有限公司 | 用于无人机航拍的增强现实方法、处理器及无人机 |
US11366259B2 (en) * | 2017-09-26 | 2022-06-21 | Lg Chem, Ltd. | Optical film, optical element, and imaging device |
CN107657235A (zh) * | 2017-09-28 | 2018-02-02 | 北京小米移动软件有限公司 | 基于增强现实的识别方法及装置 |
CN108257145B (zh) * | 2017-12-13 | 2021-07-02 | 北京华航无线电测量研究所 | 一种基于ar技术的无人机智能侦察处理***及方法 |
TWI642972B (zh) * | 2018-03-07 | 2018-12-01 | 和碩聯合科技股份有限公司 | 抬頭顯示系統及其控制方法 |
CN208429245U (zh) * | 2018-05-31 | 2019-01-25 | 宁波蓝科电子工程有限公司 | 一种节能环保型led智能交通导流显示屏 |
CN109035873A (zh) * | 2018-08-14 | 2018-12-18 | 黄芷姗 | 一种无人机控制权限的调整方法及调整装置 |
-
2019
- 2019-01-07 CN CN201910013109.1A patent/CN109727317B/zh active Active
-
2020
- 2020-01-03 WO PCT/CN2020/070257 patent/WO2020143546A1/zh active Application Filing
- 2020-01-03 US US16/966,113 patent/US11402900B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130265331A1 (en) * | 2012-04-09 | 2013-10-10 | National Applied Research Laboratories | Virtual Reality Telescopic Observation System of Intelligent Electronic Device and Method Thereof |
CN106444023A (zh) * | 2016-08-29 | 2017-02-22 | 北京知境科技有限公司 | 一种超大视场角的双目立体显示的透射式增强现实*** |
CN107027014A (zh) * | 2017-03-23 | 2017-08-08 | 广景视睿科技(深圳)有限公司 | 一种动向智能投影***及其方法 |
CN107027015A (zh) * | 2017-04-28 | 2017-08-08 | 广景视睿科技(深圳)有限公司 | 基于增强现实的3d动向投影***以及用于该***的投影方法 |
CN109727317A (zh) * | 2019-01-07 | 2019-05-07 | 京东方科技集团股份有限公司 | 增强现实***及控制方法 |
Also Published As
Publication number | Publication date |
---|---|
US11402900B2 (en) | 2022-08-02 |
CN109727317A (zh) | 2019-05-07 |
US20210041947A1 (en) | 2021-02-11 |
CN109727317B (zh) | 2021-02-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3195105B1 (en) | Management of content in a 3d holographic environment | |
US9728010B2 (en) | Virtual representations of real-world objects | |
US11340606B2 (en) | System and method for controller-free user drone interaction | |
US9552060B2 (en) | Radial selection by vestibulo-ocular reflex fixation | |
US10001857B2 (en) | Display apparatus and method of controlling display apparatus | |
US20160210780A1 (en) | Applying real world scale to virtual content | |
US20140152558A1 (en) | Direct hologram manipulation using imu | |
JP2013258614A (ja) | 画像生成装置および画像生成方法 | |
US11609428B2 (en) | Information processing apparatus and information processing method | |
WO2020143546A1 (zh) | 增强现实***及控制方法 | |
US11151804B2 (en) | Information processing device, information processing method, and program | |
JP2021060627A (ja) | 情報処理装置、情報処理方法、およびプログラム | |
CN102197932A (zh) | 化妆镜调整***、方法及具有该调整***的化妆镜 | |
WO2021237952A1 (zh) | 一种增强现实的显示***及方法 | |
WO2020209167A1 (ja) | 情報処理装置、情報処理方法、及びプログラム | |
JP6479835B2 (ja) | 入出力装置、入出力プログラム、および入出力方法 | |
US20230063386A1 (en) | Eyewear synchronized with uav image capturing system | |
US20230062433A1 (en) | Eyewear controlling an uav |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20738582 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20738582 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 16.02.2022) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20738582 Country of ref document: EP Kind code of ref document: A1 |