WO2018145463A1 - 一种实现增强现实的装置及方法 - Google Patents

一种实现增强现实的装置及方法 Download PDF

Info

Publication number
WO2018145463A1
WO2018145463A1 PCT/CN2017/102439 CN2017102439W WO2018145463A1 WO 2018145463 A1 WO2018145463 A1 WO 2018145463A1 CN 2017102439 W CN2017102439 W CN 2017102439W WO 2018145463 A1 WO2018145463 A1 WO 2018145463A1
Authority
WO
WIPO (PCT)
Prior art keywords
image light
module
light
virtual image
lens
Prior art date
Application number
PCT/CN2017/102439
Other languages
English (en)
French (fr)
Inventor
陈建江
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2018145463A1 publication Critical patent/WO2018145463A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays

Definitions

  • the present invention relates to virtual technologies, and more particularly to an apparatus and method for implementing augmented reality.
  • Augmented Reality (AR) technology can integrate virtual information such as objects, pictures, videos, sounds, etc. into the real environment, enrich the real world and build a more comprehensive and better world.
  • AR Augmented Reality
  • augmented reality shows a gradual development trend, and famous technology companies such as Google and Microsoft have begun to develop related equipment in this area.
  • Augmented reality is in the starting stage of education, entertainment, and daily life.
  • the augmented reality system mainly includes: a micro display, an optical waveguide, and a related baseband circuit, and the like, and a software application.
  • the hardware of the augmented reality device generates left and right eye images through two microdisplays, and the image is projected to the human eye through the optical waveguide, so that the virtual image is superimposed with the real image transmitted through the optical waveguide, thereby realizing the augmented reality visual effect.
  • the present invention provides an apparatus and method for realizing augmented reality, which can easily implement augmented reality.
  • an embodiment of the present invention provides an apparatus for implementing augmented reality, including: an imaging module and a second processing module;
  • An imaging module configured to image a virtual image light
  • the second processing module is configured to reflect the virtual image light and enter the viewpoint to transmit the real image light from the outside to the viewpoint.
  • the imaging module is a lens group, including a left lens and a right lens;
  • the second processing module is a half lens including a left half lens and a right half lens; the second processing module is specifically configured to:
  • the left half lens reflects the virtual image light from the left lens and enters a left viewpoint
  • the right half lens reflects the virtual image light from the right lens and enters a right viewpoint
  • the left half lens transmits the real image light
  • the right half lens transmits the real image light and enters the right viewpoint.
  • the device further includes: a first processing module, configured to adjust a propagation direction of the virtual image light to enter the imaging module.
  • the first processing module is a reflector.
  • the device further includes: an adjustment module configured to adjust an intensity of the real image light.
  • the whole module is a liquid crystal film; or a photosensitive dimming glass.
  • the device further includes: a light shielding module configured to adjust the light intensity of the real image before entering the second processing module.
  • the device further includes: a protection module disposed to be integral with the light shielding module.
  • the device further includes: a control unit configured to sense the intensity of the external light and convert the data into control data;
  • the adjustment module is specifically configured to: according to the control data of the control unit, adjust the voltage of the adjustment module by adjusting the voltage control circuit of the module to control the transmittance of the adjustment module.
  • the embodiment of the invention further provides a method for implementing augmented reality, comprising:
  • the virtual image light is reflected and then enters the viewpoint; the real image light from the outside is transmitted to the viewpoint.
  • the method further includes: adjusting a direction of propagation of the virtual image light The imaging process is performed.
  • the method further includes:
  • the intensity of the virtual image light and/or the intensity of the real image light from the outside is adjusted.
  • the intensity of the virtual image light and/or the intensity of the real image light is adjusted by controlling the transmittance and reflectivity of the liquid crystal film or the photosensitive light-adjusting glass.
  • the technical solution of the present application at least includes an imaging module and a second processing module; wherein, the imaging module is configured to image the virtual image light; and the second processing module is configured to reflect the virtual image light and enter The viewpoint transmits light from the real image from the outside to the viewpoint.
  • the device for realizing augmented reality provided by the embodiment of the present invention simply implements augmented reality.
  • the second processing unit in the embodiment of the present invention is implemented by using a half lens, which reduces the implementation cost of the augmented reality.
  • the embodiment of the present invention utilizes a smart terminal such as a popular smart phone as a virtual image provider of the augmented reality system, which greatly reduces the threshold for the augmented reality system and facilitates the popularization of the augmented reality system.
  • the present invention balances the brightness of the virtual image light with the outside by adjusting the liquid crystal film of the external light amount through the light sensor.
  • the brightness of the light in the real image can also adjust the brightness of the virtual image light.
  • the above light sensor may utilize a smart terminal such as a sensor provided in a popular smartphone.
  • FIG. 1 is a device for implementing augmented reality according to the present invention
  • FIG. 2 is a schematic structural diagram of a first embodiment of a system for implementing augmented reality according to the present invention
  • FIG. 3 is a schematic structural diagram of a second embodiment of a system for implementing augmented reality according to the present invention.
  • FIG. 4 is a flow chart of a method for implementing augmented reality in accordance with the present invention.
  • the method includes at least an imaging module and a second processing module.
  • An imaging module configured to image virtual image light.
  • the second processing module is configured to reflect the virtual image light and enter the viewpoint to transmit the real image light from the outside to the viewpoint.
  • the imaging module can be implemented with a lens set.
  • the second processing module can be implemented with a half mirror.
  • the virtual image may be from a device capable of generating a virtual display image, such as a smart mobile terminal, a handheld game console, a mini tablet, or the like.
  • the lens set includes a left lens and a right lens;
  • the half lens includes a left half lens and a right half lens
  • the second processing module is specifically configured to: the left half lens reflects the virtual image light from the left lens and enters the left view, the right half lens The virtual image light from the right lens is reflected and enters the right viewpoint; the left half lens transmits the real image light into the left viewpoint, and the right half lens transmits the real image light into the right viewpoint.
  • the device for realizing the augmented reality of the present invention further includes: a first processing module configured to adjust a propagation direction of the virtual image light and enter the imaging module.
  • the first processing module can be implemented using a reflector.
  • the adjusting may include: adjusting a light image propagation direction of the virtual image by using a reflector, so that the display screen is in an erect state.
  • This adjustment method makes the position of the mobile terminal biased toward the direction of the person's head, adjusts the center of gravity of the device for realizing the augmented reality, thereby making the wearing device more comfortable; on the other hand, adjusting the front of the mobile terminal
  • the camera shooting direction is in the same direction as the human eye angle, and the image seen by the human eye can be captured.
  • the rear camera can capture the image behind the person to monitor the environment behind the person.
  • the device for realizing augmented reality of the present invention further comprises: an adjustment module configured to adjust the intensity of the real image light from the outside, for example, adjusting the amount of light entering the outside in a high-brightness natural environment to balance the brightness and the trueness of the virtual image.
  • the brightness of the image is a high-brightness natural environment.
  • the device for realizing augmented reality of the present invention further includes: a control unit configured to sense the intensity of the external light and convert the data into control data; accordingly,
  • the adjustment module is specifically configured to: according to the control data of the control unit, adjust the voltage of the adjustment module by adjusting the voltage control circuit of the module to control the transmittance of the adjustment module.
  • control module can be implemented by using a smart terminal such as a light sensor in a popular smartphone, related software, a data port, and the like.
  • the adjustment module can be implemented using a liquid crystal diaphragm; it can also be replaced with a photosensitive dimming glass.
  • the device for realizing augmented reality of the invention further comprises:
  • the shading module is configured to adjust the light intensity of the real image of the real environment to the second processing module, or enter the second processing module via the adjustment module.
  • the shading module can be implemented by using a hood.
  • the light shielding module is further configured to: protect the half lens and the liquid crystal film to prevent dust, external collision, touch, and the like.
  • the device for realizing the augmented reality of the invention further comprises: a protection module arranged to cooperate with the light shielding module to form a whole body, preventing dust from entering the half lens, the cavity formed by the lens group.
  • the protection module can be implemented using a protective cover.
  • the device for realizing augmented reality provided by the invention is simple, and adopts an off-the-shelf intelligent mobile terminal to complete image processing and environment detection, and simply realizes augmented reality.
  • the half lens is used as the core component, the expensive optical waveguide lens is eliminated, and the realization cost of the augmented reality is reduced.
  • the present invention utilizes a smart terminal such as a popular smartphone as a provider of virtual images of an augmented reality system, greatly reducing the barrier to entry of the augmented reality system, and facilitating the popularization of the augmented reality system.
  • a smart terminal such as a popular smartphone as a provider of virtual images of an augmented reality system
  • the present invention balances the brightness of the virtual image light with the external reality by adjusting the liquid crystal film of the external light amount through the light sensor.
  • the light level of the image At the same time, the light sensor can also adjust the brightness of the virtual image light.
  • the above-described light sensor can utilize a sensor provided in a smart terminal such as a popular smartphone.
  • FIG. 2 is a schematic structural diagram of a first embodiment of a system for implementing augmented reality according to the present invention.
  • a smart phone is used as a device capable of generating a virtual display image, as shown in FIG. 2 .
  • the system for realizing augmented reality in the first embodiment includes:
  • Smartphone 1 the display of the smartphone 1 is the image display of the augmented reality device.
  • the front and rear cameras, sensors, and the like of the smartphone 1 can be adjusted in accordance with the augmented reality device to the direction of propagation of the virtual image light, the intensity of the real image light from the outside, and the like.
  • the reflector 2 is arranged to adjust the propagation direction of the virtual image light displayed on the display screen of the smartphone 1.
  • the structural support device 3 is provided as a constituent unit of the fixed augmented reality device.
  • the lens group 4 is arranged to image the content displayed on the display screen of the smartphone 1; wherein the lens group 4 comprises a left eyeglass lens group and a right eyeglass lens group.
  • the hood 5 is arranged to adjust the intensity of the real image light from the outside into the human eye, thereby adjusting the light of the virtual image projected by the display screen and the light of the real image from the outside.
  • the half lens 6 and the liquid crystal film 7 are protected from dust, external impact, and the like.
  • the half lens sheet 6 is arranged to reflect the virtual image light formed by the display screen of the smartphone 1 into the human eye, and the real image light from the outside enters the human eye.
  • the half lens sheet 6 includes a left half lens sheet and a right half lens sheet.
  • the light transmittance and reflectance of the semi-lens sheet 6 can be set or adjusted according to the needs of the entire system. specifically,
  • the light sensing sensor of the smart phone 1 senses the intensity of the external light, and is converted into control data by the related software operation of the smart phone 1, and is transmitted from the data port of the smart phone 1 to the bias control circuit of the liquid crystal film 7. After the bias control circuit of the liquid crystal film 7 obtains the control data, the voltage applied to the liquid crystal film 7 is adjusted to control the light transmittance of the liquid crystal film 7.
  • the liquid crystal film 7 can be disposed on a side of the half lens close to the hood, and is arranged to adjust the brightness of the light, and adjust the amount of light entering the outside in a high brightness environment to balance the display screen of the smart phone 1.
  • the liquid crystal film 7 can also be replaced with a photosensitive dimming glass.
  • the protective cover 8 is integrally formed with the hood 5 to prevent dust from entering the half lens and the cavity formed by the lens group.
  • the display screen of the smartphone 1 displays an image in the left and right format, and the left image is reflected by the reflector 2 into the left lens, and is reflected again on the left half lens to enter the left eye.
  • the reflector 2 reflects the right image into the right lens and re-reflects on the right half lens to enter the right eye. Its light propagation path is shown by the solid arrow in Figure 2.
  • the half lens sheet 6 reflects, transmits and superimposes the virtual image light of the display screen of the smartphone 1 and the light of the real scene image of the outside world to form an augmented reality image into the viewpoint.
  • the front and rear cameras and various sensors in the smartphone 1 in the first embodiment are arranged to capture surrounding environment information and are applied to the augmented reality image processing to adjust the light transmittance and reflection of the liquid crystal film 7.
  • the rate allows the human eye to see both the virtual image and the real image.
  • FIG. 3 is a schematic structural diagram of a second embodiment of a system for implementing augmented reality according to the present invention.
  • a smart phone is also used as a device capable of generating a virtual display image
  • the second embodiment and the first implementation are used as an example.
  • the difference in the example is that the reflection plate 2 is omitted in the second embodiment. That is to say, in the second embodiment, the virtual image light displayed on the display screen of the smartphone 1 enters the viewpoint only by one reflection of the half lens sheet 6.
  • the device for realizing enhanced display of the present invention can be applied in many scenarios.
  • the user uses a certain method (such as remote control, voice recognition, wired control, or touchpad, etc.) to open the smartphone navigation map, wear the device for realizing the augmented reality provided by the present invention, and adjust it to the front.
  • the location of the augmented reality navigation map is superimposed on the current external real image.
  • FIG. 4 is a flowchart of a method for implementing augmented reality according to the present invention. As shown in FIG. 4, the method includes:
  • Step 400 Imaging the virtual image light.
  • This step can be achieved by using a lens set.
  • This step also includes: You can use the reflector to adjust the direction of propagation of the virtual image light and then apply the image processing in the past and the present.
  • Step 401 Reflecting the virtual image light into the viewpoint to transmit the real image light from the outside to the viewpoint.
  • the semi-lens including the left semi-lens and the right semi-lens may be used.
  • the left semi-lens reflects the virtual image light from the left lens and enters the left viewpoint, and the right semi-lens pairs from the right lens.
  • the virtual image light is reflected and enters the right viewpoint; the left half lens transmits the real image light into the left viewpoint, and the right half lens transmits the real image light into the right viewpoint.
  • the method of the present invention further includes adjusting the intensity of the virtual image light and/or the intensity of the real image light from the outside.
  • the adjustment of the intensity of the virtual image light and/or the intensity of the real image light can be achieved by controlling the light transmittance and the reflectance of the liquid crystal film, or the photosensitive light-adjusting glass.
  • adjusting the intensity of the virtual image light and/or the intensity of the real image light from the outside includes:
  • the light sensor of the intelligent terminal is used to sense the intensity of the external light, and is converted into control data through the relevant software operation of the terminal, and is transmitted from the data port of the terminal to the bias control circuit of the liquid crystal film or the photosensitive dimming glass.
  • the voltage applied to the liquid crystal film or the photosensitive light-adjusting glass is adjusted under the control of the bias control circuit to control the light transmittance of the liquid crystal film or the photosensitive light-adjusting glass.
  • the present invention also provides a computer readable storage medium storing computer executable instructions for performing the method of implementing augmented reality of any of the present invention.
  • the imaging module in the embodiment of the present invention is configured to image the virtual image light; the second processing module is configured to reflect the virtual image light into the viewpoint, and transmit the real image light from the outside to the viewpoint, simply Augmented reality has been achieved.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Processing Or Creating Images (AREA)

Abstract

一种实现增强现实的装置，至少包括成像模块（④）、第二处理模块（⑥）；其中，成像模块（④）设置为对虚拟图像光线进行成像，第二处理模块（⑥）设置为对虚拟图像光线进行反射后进入视点、将来自外界的真实图像光线透射到视点。这种装置简单地实现了增强现实。还提供了一种实现增强现实的方法。

Description

一种实现增强现实的装置及方法 技术领域
本发明涉及虚拟技术，尤指一种实现增强现实的装置及方法。
背景技术
增强现实(AR，Augmented Reality)技术能够把虚拟信息如物体、图片、视频、声音等融合在现实环境中，将现实世界丰富起来，构建一个更加全面、更加美好的世界。目前，增强现实呈现逐步发展趋势，谷歌，微软等著名科技企业开始在这方面研制相关设备装置。
增强现实在教育，娱乐，日常生活等方面处于启动阶段。
相关技术中，增强现实***主要包括：微型显示器、光波导、以及相关基带电路等、软件应用等。增强现实设备的硬件是通过两个微型显示器生成左右眼图像，该图像再通过光波导投射到人眼，这样，虚拟图像与透过光波导的现实图像叠加，实现了增强现实视觉效果。
目前的增强现实设备价格昂贵，普及困难。如何大幅度降低成本，是增强现实普及的关键。
发明内容
为了解决上述技术问题，本发明提供一种实现增强现实的装置及方法，能够简单实现增强现实。
为了达到本发明实施例目的，本发明实施例提供了一种实现增强现实的装置，包括：成像模块、第二处理模块；其中，
成像模块，设置为对虚拟图像光线进行成像；
第二处理模块，设置为对虚拟图像光线进行反射后进入视点，将来自外界的真实图像光线透射到视点。
可选地，所述成像模块为镜片组，包括左镜片和右镜片；
所述第二处理模块为包括左半透镜和右半透镜的半透镜；所述第二处理模块具体设置为：
左半透镜对来自左镜片的所述虚拟图像光线进行反射后进入左视点，右半透镜对来自右镜片的所述虚拟图像光线进行反射后进入右视点；左半透镜将所述真实图像光线透射后进入左视点，右半透镜将所述真实图像光线透射后进入右视点。
可选地，所述装置还包括：第一处理模块，设置为调整所述虚拟图像光线的传播方向后进入所述成像模块。
可选地，所述第一处理模块为反射板。
可选地，所述装置还包括：调整模块，设置为对所述真实图像光线的强度进行调整。
可选地，所述整模块为液晶膜片；或者光敏调光玻璃。
可选地，所述装置还包括：遮光模块，设置为对所述真实图像的光线强度进行调整后，再进入所述第二处理模块。
可选地，所述装置还包括：保护模块，设置为与所述遮光模块形成整体。
可选地，所述装置还包括，控制单元，设置为对外界光线强度的感知，并转化为控制数据；
所述调整模块具体设置为：根据来所述控制单元的控制数据，通过调整模块的电压控制电路调整给所述调整模块的电压，以控制调整模块的透光率。
本发明实施例还提供了一种实现增强现实的方法，包括：
对虚拟图像光线进行成像；
对虚拟图像光线进行反射后进入视点；将来自外界的真实图像光线透射到视点。
可选地，所述方法之前还包括：调整所述虚拟图像光线的传播方向后 进行所述成像处理。
可选地，所述方法还包括：
对所述虚拟图像光线的强度和/或所述来自外界的真实图像光线的强度进行调整。
可选地，通过对液晶膜片、或光敏调光玻璃的透光率、反射率的控制，实现对所述虚拟图像光线的强度和/或所述真实图像光线的强度的调整。
与现有技术相比，本申请技术方案至少包括成像模块、第二处理模块；其中，成像模块，设置为对虚拟图像光线进行成像；第二处理模块，设置为对虚拟图像光线进行反射后进入视点，将来自外界的真实图像光线透射到视点。本发明实施例提供的实现增强现实的装置，简单地实现了增强现实。
可选地，本发明实施例中的第二处理单元采用半透镜实现，降低了增强现实的实现成本。
特别地，本发明实施例利用智能终端如普及的智能手机作为增强现实***的虚拟图像的提供者，大幅度降低了增强现实***的准入门槛，有利于增强现实***的普及推广。
可选地，为平衡在半透镜的虚拟图像光线与自然光外界的真实图像光线之间的反射强度，本发明通过光线传感器调整外界的进光量的液晶膜片，平衡了虚拟图像光线的亮度与外界真实图像的光线亮度。同时，光线感应器也可对虚拟图像光线的亮度进行调整。
可选地，上述光线传感器可以利用智能终端如普及的智能手机中设置的传感器。
本发明实施例的其它特征和优点将在随后的说明书中阐述，并且，部分地从说明书中变得显而易见，或者通过实施本发明而了解。本发明的目的和其他优点可通过在说明书、权利要求书以及附图中所特别指出的结构来实现和获得。
附图说明
此处所说明的附图用来提供对本发明的进一步理解，构成本申请的一部分，本发明的示意性实施例及其说明用于解释本发明，并不构成对本发明的不当限定。在附图中：
图1为本发明实现增强现实的装置；
图2为本发明实现增强现实的***的第一实施例的组成结构示意图；
图3为本发明实现增强现实的***的第二实施例的组成结构示意图；
图4为本发明实现增强现实的方法的流程图。
具体实施方式
为使本发明的目的、技术方案和优点更加清楚明白，下文中将结合附图对本发明的实施例进行详细说明。需要说明的是，在不冲突的情况下，本申请中的实施例及实施例中的特征可以相互任意组合。
图1为本发明实现增强现实的装置，如图1所示，至少包括：成像模块、第二处理模块；其中，
成像模块，设置为对虚拟图像光线进行成像。
第二处理模块，设置为对虚拟图像光线进行反射后进入视点，将来自外界的真实图像光线透射到视点。
可选地，成像模块可以采用镜片组来实现。
可选地，第二处理模块可以采用半透镜来实现。
可选地，虚拟图像可以来自能产生虚拟显示图像的设备，如智能移动终端、掌上游戏机、微型平板电脑等。
通常，镜片组包括左镜片和右镜片；
通常，半透镜包括左半透镜和右半透镜，第二处理模块具体设置为：左半透镜对来自左镜片的虚拟图像光线进行反射后进入左视点，右半透镜 对来自右镜片的虚拟图像光线进行反射后进入右视点；左半透镜将真实图像光线透射后进入左视点，右半透镜将真实图像光线透射后进入右视点。
可选地，
本发明实现增强现实的装置还包括：第一处理模块，设置为调整虚拟图像光线的传播方向后进入成像模块。
可选地，第一处理模块可以采用反射板来实现。
其中，调整可以包括：利用反射板调整虚拟图像光线传播方向，使得显示屏处于竖立状态。这种调整方式，一方面，使得移动终端的位置，偏向人的头部方向，调整了实现增强现实的装置的重心，从而让头戴装置时更加舒适；另一方面，调整后移动终端的前置摄像头拍摄方向与人眼视角处于同一方向，可拍摄人眼看到的图像，这样，如有必要，后置摄像头可拍摄人身后的图像，以实现监控人身后的环境。
可选地，
本发明实现增强现实的装置还包括：调整模块，设置为对来自外界的真实图像光线的强度进行调整，比如：在高亮度自然环境下，调整外界的进光量，以平衡虚拟图像的亮度与真实图像的亮度。
具体地，
本发明实现增强现实的装置还包括，控制单元，设置为对外界光线强度的感知，并转化为控制数据；相应地，
调整模块具体设置为：根据来所述控制单元的控制数据，通过调整模块的电压控制电路调整给所述调整模块的电压，以控制调整模块的透光率。
实际应用中，控制模块可以利用智能终端如普及的智能手机中的光线传感器、相关软件、数据口等来实现。
可选地，调整模块可以采用液晶膜片来实现；也可以采用光敏调光玻璃来替换。
可选地，
本发明实现增强现实的装置还包括：
遮光模块，设置为对外界真实环境的真实图像的光线强度进行调整后，再进入第二处理模块，或者再经由调整模块进入第二处理模块。
可选地，遮光模块可以采用遮光罩来实现。
可选地，遮光模块还设置为：保护半透镜和液晶膜片，防止灰尘、外界的碰撞、触及等。
可选地，
本发明实现增强现实的装置还包括：保护模块，设置为与遮光模块一起配合形成整体，防止灰尘进入半透镜，镜片组构成的腔体。
可选地，保护模块可以采用保护罩来自实现。
本发明提供的实现增强现实的装置简单，并采取兼容现成的智能移动终端完成图像处理及环境侦测，简单地实现了增强现实。
进一步地，由于采用半透镜作为核心部件，省去了价格昂贵的光波导镜片，降低了增强现实的实现成本。
特别地，本发明利用智能终端如普及的智能手机作为增强现实***的虚拟图像的提供者，大幅度降低了增强现实***的准入门槛，有利于增强现实***的普及推广。
进一步地，为平衡在半透镜的虚拟图像光线与自然光外界的真实图像光线之间的反射强度，本发明通过光线传感器调整外界的进光量的液晶膜片，平衡了虚拟图像光线的亮度与外界真实图像的光线亮度。同时，光线感应器也可对虚拟图像光线的亮度进行调整。
特别地，上述光线传感器可以利用智能终端如普及的智能手机中设置的传感器。
下面结合具体实施例对本发明实现增强现实的装置进行详细描述。
图2为本发明实现增强现实的***的第一实施例的组成结构示意图，第一实施例中，以智能手机为能产生虚拟显示图像的设备为例，如图2所 示，第一实施例中的实现增强现实的***包括：
智能手机①，智能手机①的显示屏即为增强现实装置的图像显示屏。
进一步地，智能手机①的前后摄像头，传感器等，可以配合增强现实装置对虚拟图像光线的传播方向、来自外界的真实图像光线的强度等进行调整。
反射板②，设置为调整智能手机①的显示屏显示的虚拟图像光线的传播方向。
结构支撑装置③，设置为固定增强现实装置的组成单元。
镜片组④，设置为将智能手机①的显示屏显示的内容进行成像；其中，镜片组④包括左眼镜片组，右眼镜片组。
遮光罩⑤，设置为调整来自外界的真实图像光线进入人眼的强度，从而调整显示屏投射的虚拟图像的光线与来自外界的真实图像的光线。同时保护半透镜⑥和液晶膜片⑦，防止灰尘，外界碰撞触及等。
半透镜片⑥，设置为反射智能手机①的显示屏形成的虚拟图像光线进入人眼，以及来自外界的真实图像光线进入人眼。其中，半透镜片⑥包括左半透镜片，右半透镜片。
进一步地，半透镜片⑥的透光率，反射率可根据整个***需要进行设置或调整。具体地，
利用智能手机①的光线感应传感器，感知外界光线的强度，通过智能手机①的相关软件运算，转化为控制数据，由智能手机①的数据口传递给液晶膜片⑦的偏压控制电路。液晶膜片⑦的偏压控制电路获得控制数据后，调整给液晶膜片⑦的电压，以控制液晶膜片⑦的透光率。
可选地，
第一实施例中的实现增强现实的***还包括：
液晶膜片⑦，可以设置在半透镜靠近遮光罩的一侧，设置为调节光线亮度，在高亮度环境下，调整外界的进光量，以平衡智能手机①的显示屏 形成的虚拟图像光线的亮度与来自外界的真实图像光线的亮度。
其中，液晶膜片⑦也可以用光敏调光玻璃来替换。
可选地，
第一实施例中的实现增强现实的***还包括：
保护罩⑧，与遮光罩⑤一起配合形成整体，以防止灰尘进入半透镜，镜片组构成的腔体。
在如图2所示的第一实施例中，智能手机①的显示屏显示左右格式的图像，由反射板②将左图像反射进入左镜片，并在左半透镜上发生再次反射后进入左眼；反射板②将右图像反射进入右镜片，并在右半透镜上发生再次反射后进入右眼。其光线传播路径如图2中的实线箭头所示。
来自外界的真实图像的自然光线通过遮光罩⑤，再通过左半透镜进入左眼、通过右半透镜进入右眼。其光线传播路径如图2中的虚线箭头所示。
半透镜片⑥将智能手机①的显示屏的虚拟图像光线，外界的真实景物图像的光线，通过反射、透射并叠加以形成增强现实图像进入视点。
进一步地，第一实施例中的智能手机①中的前后摄像头、各种传感器，设置为捕获周边环境信息，并应用于增强现实图像处理中，以通过调整液晶膜片⑦的光线透射率、反射率，使人眼既能看清虚拟图像，也能看清真实图像。
图3为本发明实现增强现实的***的第二实施例的组成结构示意图，在第二实施例中，同样以智能手机为能产生虚拟显示图像的设备为例，第二实施例与第一实施例的区别在于，第二实施例中省略了反射板②。也就是说，在第二实施例中，智能手机①的显示屏显示的虚拟图像光线只经过半透镜片⑥的一次反射就进入视点。
本发明实现增强显示的装置可以应用在诸多场景下。比如，用户使用某种方式(如遥控器，语音识别，有线控制，或触摸板等)打开智能手机导航地图，佩戴上本发明提供的实现增强现实的装置，并调整到眼前合适 的位置，增强现实的导航地图就叠加在了当前外界实景图像中了。
图4为本发明实现增强现实的方法的流程图，如图4所示，包括：
步骤400：对虚拟图像光线进行成像。
本步骤可以利用镜片组实现成像。
本步骤之前还包括：可以利用反射板调整虚拟图像光线的传播方向后在今昔你给成像处理。
步骤401：对虚拟图像光线进行反射后进入视点，将来自外界的真实图像光线透射到视点。
本步骤中，可以利用包括左半透镜和右半透镜的半透镜来实现，具体包括：左半透镜对来自左镜片的所述虚拟图像光线进行反射后进入左视点，右半透镜对来自右镜片的所述虚拟图像光线进行反射后进入右视点；左半透镜将所述真实图像光线透射后进入左视点，右半透镜将所述真实图像光线透射后进入右视点。
可选地，
本发明方法还包括：对虚拟图像光线的强度和/或对来自外界的真实图像光线的强度进行调整。其中，可以通过对液晶膜片、或光敏调光玻璃等的透光率、反射率的控制实现对虚拟图像光线的强度和/或真实图像光线的强度的调整。
具体地，以虚拟图像由智能终端的显示屏产生为例，对虚拟图像光线的强度和/或对来自外界的真实图像光线的强度进行调整包括：
利用智能终端的光线感应传感器，感知外界光线的强度，通过终端的相关软件运算，转化为控制数据，由终端的数据口传递给液晶膜片或光敏调光玻璃等的偏压控制电路。在偏压控制电路的控制下调整给液晶膜片或光敏调光玻璃的电压，以控制液晶膜片或光敏调光玻璃的透光率。
本发明还提供了一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令用于执行本发明任一项的实现增强现实的方法。
以上所述，仅为本发明的较佳实例而已，并非用于限定本发明的保护范围。凡在本发明的精神和原则之内，所做的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。
工业实用性
通过本发明实施例的中的成像模块，设置为对虚拟图像光线进行成像；第二处理模块，设置为对虚拟图像光线进行反射后进入视点，将来自外界的真实图像光线透射到视点，简单地实现了增强现实。

Claims (14)

  1. 一种实现增强现实的装置，包括：成像模块、第二处理模块；其中，
    成像模块，设置为对虚拟图像光线进行成像；
    第二处理模块，设置为对虚拟图像光线进行反射后进入视点，将来自外界的真实图像光线透射到视点。
  2. 根据权利要求1所述的装置，其中，所述成像模块为镜片组，包括左镜片和右镜片；
    所述第二处理模块为包括左半透镜和右半透镜的半透镜；所述第二处理模块具体设置为：
    左半透镜对来自左镜片的所述虚拟图像光线进行反射后进入左视点，右半透镜对来自右镜片的所述虚拟图像光线进行反射后进入右视点；左半透镜将所述真实图像光线透射后进入左视点，右半透镜将所述真实图像光线透射后进入右视点。
  3. 根据权利要求1所述的装置，其中，所述装置还包括：第一处理模块，设置为调整所述虚拟图像光线的传播方向后进入所述成像模块。
  4. 根据权利要求3所述的装置，其中，所述第一处理模块为反射板。
  5. 根据权利要求1或3所述的装置，其中，所述装置还包括：调整模块，设置为对所述真实图像光线的强度进行调整。
  6. 根据权利要求5所述的装置，其中，所述整模块为液晶膜片；或者光敏调光玻璃。
  7. 根据权利要求1或3所述的装置，其中，所述装置还包括：遮光模块，设置为对所述真实图像的光线强度进行调整后，再进入所述第二处理模块。
  8. 根据权利要求7所述的装置，其中，所述装置还包括：保护模块，设置为与所述遮光模块形成整体。
  9. 根据权利要求6所述的装置，其中，所述装置还包括，控制单元，设置为对外界光线强度的感知，并转化为控制数据；
    所述调整模块具体设置为：根据来所述控制单元的控制数据，通过调整模块的电压控制电路调整给所述调整模块的电压，以控制调整模块的透光率。
  10. 一种实现增强现实的方法，包括：
    对虚拟图像光线进行成像；
    对虚拟图像光线进行反射后进入视点；将来自外界的真实图像光线透射到视点。
  11. 根据权利要求10所述的方法，其中，所述方法之前还包括：调整所述虚拟图像光线的传播方向后进行所述成像处理。
  12. 根据权利要求10或11所述的方法，其中，所述方法还包括：
    对所述虚拟图像光线的强度和/或所述来自外界的真实图像光线的强度进行调整。
  13. 根据权利要求12所述的方法，其中，通过对液晶膜片、或光敏调光玻璃的透光率、反射率的控制，实现对所述虚拟图像光线的强度和/或所述真实图像光线的强度的调整。
  14. 一种存储介质，所述存储介质包括存储的程序，其中，所述程序运行时执行权利要求10至13中任一项所述的方法。
PCT/CN2017/102439 2017-02-10 2017-09-20 一种实现增强现实的装置及方法 WO2018145463A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710072924.6 2017-02-10
CN201710072924.6A CN108415158A (zh) 2017-02-10 2017-02-10 一种实现增强现实的装置及方法

Publications (1)

Publication Number Publication Date
WO2018145463A1 true WO2018145463A1 (zh) 2018-08-16

Family

ID=63107185

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/102439 WO2018145463A1 (zh) 2017-02-10 2017-09-20 一种实现增强现实的装置及方法

Country Status (2)

Country Link
CN (1) CN108415158A (zh)
WO (1) WO2018145463A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111292703A (zh) * 2019-12-20 2020-06-16 深圳光启空间技术有限公司 一种屏幕亮度调节方法及装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101661163A (zh) * 2009-09-27 2010-03-03 合肥工业大学 增强现实***的立体头盔显示器
CN104317055A (zh) * 2014-10-31 2015-01-28 成都理想境界科技有限公司 与移动终端配合使用的头戴式设备
CN204613517U (zh) * 2015-05-27 2015-09-02 王志健 基于移动设备的头戴式显示装置
CN105974589A (zh) * 2016-06-24 2016-09-28 赵宇 一种头戴式护目镜的近眼式显示器

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090052169A (ko) * 2007-11-20 2009-05-25 삼성전자주식회사 두부(頭部) 장착 디스플레이

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101661163A (zh) * 2009-09-27 2010-03-03 合肥工业大学 增强现实***的立体头盔显示器
CN104317055A (zh) * 2014-10-31 2015-01-28 成都理想境界科技有限公司 与移动终端配合使用的头戴式设备
CN204613517U (zh) * 2015-05-27 2015-09-02 王志健 基于移动设备的头戴式显示装置
CN105974589A (zh) * 2016-06-24 2016-09-28 赵宇 一种头戴式护目镜的近眼式显示器

Also Published As

Publication number Publication date
CN108415158A (zh) 2018-08-17

Similar Documents

Publication Publication Date Title
US9223138B2 (en) Pixel opacity for augmented reality
US10459230B2 (en) Compact augmented reality / virtual reality display
US9711114B1 (en) Display apparatus and method of displaying using projectors
US9360671B1 (en) Systems and methods for image zoom
US8810600B2 (en) Wearable display device calibration
US9076033B1 (en) Hand-triggered head-mounted photography
JP2016040865A (ja) 頭部装着型表示装置およびその制御方法、並びにコンピュータープログラム
US10067415B2 (en) Method for displaying image using projector and wearable electronic device for implementing the same
KR20140125183A (ko) 프로젝터 장착 안경 및 그 제어 방법
KR101690646B1 (ko) 시 스루 디스플레이를 위한 카메라 구동 장치 및 그 방법
US11720996B2 (en) Camera-based transparent display
US9348211B2 (en) Camera module and portable device using the same
US11681148B2 (en) Compact catadioptric projector
US11442342B2 (en) Recording indicators
US20150138235A1 (en) Collimated display device for augmented reality and method thereof
US11054652B2 (en) Augmented reality apparatus
WO2020001043A1 (zh) 一种增强现实眼镜装置
WO2018145463A1 (zh) 一种实现增强现实的装置及方法
KR20220111144A (ko) HMD(head mounted display)의 영상 처리 방법 및 이 방법을 실행하는 HMD
JP2019106723A (ja) 表示装置、およびコンテキストディスプレイとプロジェクタを用いた表示方法
CN104239877A (zh) 图像处理的方法和图像采集设备
CN114446262B (zh) 色偏矫正方法和头戴显示装置
WO2023098228A1 (zh) 显示装置、电子设备以及交通工具
JP2021017064A (ja) ヘッドアップディスプレイ装置
US20190258066A1 (en) Imaging device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17895704

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17895704

Country of ref document: EP

Kind code of ref document: A1