CN107229119A - The method that near-eye display device and nearly eye are shown - Google Patents

The method that near-eye display device and nearly eye are shown Download PDF

Info

Publication number
CN107229119A
CN107229119A CN201610170301.8A CN201610170301A CN107229119A CN 107229119 A CN107229119 A CN 107229119A CN 201610170301 A CN201610170301 A CN 201610170301A CN 107229119 A CN107229119 A CN 107229119A
Authority
CN
China
Prior art keywords
light
image
display panel
display device
eye
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610170301.8A
Other languages
Chinese (zh)
Inventor
洪涛
周明才
李炜明
刘志花
王再冉
王海涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Samsung Telecom R&D Center
Beijing Samsung Telecommunications Technology Research Co Ltd
Samsung Electronics Co Ltd
Original Assignee
Beijing Samsung Telecommunications Technology Research Co Ltd
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Samsung Telecommunications Technology Research Co Ltd, Samsung Electronics Co Ltd filed Critical Beijing Samsung Telecommunications Technology Research Co Ltd
Priority to CN201610170301.8A priority Critical patent/CN107229119A/en
Priority to PCT/KR2017/002910 priority patent/WO2017164573A1/en
Publication of CN107229119A publication Critical patent/CN107229119A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/22Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type
    • G02B30/25Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type using polarisation techniques
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/26Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
    • G02B30/27Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving lenticular arrays
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0112Head-up displays characterised by optical features comprising device for genereting colour display
    • G02B2027/0114Head-up displays characterised by optical features comprising device for genereting colour display comprising dichroic elements
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0132Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

The invention provides a kind of near-eye display device, including lighting module and optical modulation element:Lighting module is used for output image;Optical modulation element is used to carry out integration imaging to image, to show three-dimensional virtual image.Near-eye display device may include the near-eye display device for virtual reality, what the principle that the near-eye display device is shown using integration imaging to be presented on human eye is natural three-dimensional body, the visual fatigue that long-term viewing three-dimensional image is brought is solved the problems, such as, for needing the application scenarios of this equipment of long periods of wear particularly important.

Description

The method that near-eye display device and nearly eye are shown
Technical field
It is specifically, aobvious the present invention relates to a kind of nearly eye the present invention relates to the technical field of terminal device Show a kind of method that equipment and nearly eye are shown.
Background technology
AR (Augmented Reality, augmented reality) display device can be superimposed in real scene Virtual object, it is perceived virtual Information application to real world by human sensory, so that The sensory experience of exceeding reality is reached, really environment and virtual object will be added in real time Same picture or space exist simultaneously.
A kind of existing Display Technique, which there is provided, a kind of can improve the aobvious of light efficiency and viewing visual angle Showing device.As shown in figure 1, the device includes:Lighting module, the first polarizing beam splitter, polarization rotation Turn device and end reflector.Wherein, lighting module includes:Display panel 250, scattering surface 255, Second polarizing beam splitter, light source, convergent lens 240.The light of light source passes through convergent lens directive second Polarizing beam splitter, the light of S-polarization state reflexes to display panel 250 by the second polarizing beam splitter, through aobvious Show that panel 250 becomes the light of P polarization state after reflecting, the light of P polarization state by the second polarizing beam splitter, First polarizing beam splitter and polarization rotator are transmitted to end reflector, then, and end reflector is by light Reflect, by polarization rotator, light becomes the light of S-polarization state, and the light of S-polarization state passes through One polarizing beam splitter reflexes to human eye, forms 3D rendering.The light of light source passes through convergent lens directive During two polarizing beam splitters, the light of P polarization state is transmitted to scattering surface 255 by the second polarizing beam splitter, Scattering surface falls the light scattering of this part.In this scenario, light efficiency can be improved by polarization spectroscope Rate, and improve by recessed speculum the visual angle of viewing.But, the display device can not show nature Three-dimensional body, causes that when viewing stereo-picture the visual fatigue of human eye can be caused;Therefore, for a long time Wear such a display device to cause to be unfavorable for human eye health, wearing for user experiences poor.
In summary, existing related display device is present easily causes when showing three-dimensional virtual object The problem of human eye vision is tired.
The content of the invention
The purpose of the present invention is intended at least solve one of above-mentioned technological deficiency, particularly three-dimensional empty in display Intend easily causing the problem of human eye vision is tired during object.
The invention provides a kind of display device for augmented reality, including lighting module and light modulation Element:
Lighting module is used for output image;
Optical modulation element is used to carry out integration imaging to described image, to show three-dimensional virtual image.
Wherein, optical modulation element includes microlens array or microwell array;Microlens array or micropore battle array Row can be the microlens array of curved surface or the microwell array of curved surface.Optical modulation element can include by liquid Crystal cell constitutes dynamic microlens array or microwell array.
Preferably, lighting module includes at least two display panels and light-splitting device:
Specifically, at least two display panels are located at the both sides of light-splitting device, and with light-splitting device into pre- Determine angle;
Wherein, display panel is used for display image, and light-splitting device is used to conduct the figure that display panel is shown Picture.
Preferably, at least two display panels and light-splitting device are into 45 degree of angles.
Alternatively, when display panel is non-self-luminous surface plate, lighting module also includes light source and convergence Mirror:
Convergent mirror is located between light source and display panel, and the light that light source is launched is by convergent mirror to display Panel is illuminated.
Preferably, light-splitting device is polarized light splitting device:Polarized light splitting device reflection is logical from light source The light of the first polarization direction component after overconvergence mirror collimation, and it is inclined to transmit orthogonal to that second The light of the polarization direction of the light for durection component of shaking, transmission and reflection is used for the illumination of non-self-luminous surface plate.
Alternatively, when display panel is self-emission panel, light-splitting device transmission and reflection are from spontaneous The light of optic panel.
Alternatively, when display panel is monochromatic self-emission panel, light-splitting device is band logical color dispersing Device:Band logical color dispersing device is reflected from monochromatic self-emission panel and same color Light, and transmit the light of other colors.
Preferably, at least two display panels to be to switch display image more than predetermined refresh frequency, and The image that each display panel is shown is in predetermined ratio pixel of both horizontally and vertically interlocking.
It is highly preferred that when the number of display panel is n, n display panel is with more than n × 30Hz Frequency switch display image, and the image that each display panel is shown both horizontally and vertically handing over Wrong 1/n pixel.
Preferably, optical modulation element is located in lighting module and each preset distance of display panel first At position.
Preferably, display device also includes light conduction cell, and light conduction cell includes at least one lens; The conducting images that light conduction cell shows display panel are to the optical modulation element preset distance At position, integration imaging is carried out for the optical modulation element.
Alternatively, when light conduction cell includes two lens, at least one display panel is located at one thoroughly At one times of focal length of mirror, the distance between two lens are two focus length;Optical modulation element is located at image After being conducted by light conduction cell at the second preset distance of image space.
Alternatively, when light conduction cell includes a lens, at least one display panel is located at the lens Two focus length at;Optical modulation element is located at the of image space after image is conducted by light conduction cell At three preset distances.
Preferably, in addition to reflecting element:Reflecting element is located on the optical path direction of lighting module, will Three-dimensional virtual image is oriented to human eye.
Wherein, reflecting element includes reflective mirror or spectroscope.
Preferably, when near-eye display device is the near-eye display device for augmented reality, nearly eye shows Show that equipment also includes correction module, reflecting element is spectroscope;
The light of three-dimensional virtual image and extraneous true picture is divided into two-way by spectroscope, is individually directed people Eye and the correction module;
Correction module, for the three-dimensional virtual image and extraneous true picture conducted based on the spectroscope Processing is corrected to three-dimensional virtual image, and three-dimensional virtual image will be obtained after correction by illuminating mould Block is shown.
Preferably, correction module includes:
Image capturing unit, for obtaining from spectroscopical three-dimensional virtual image and extraneous true figure Picture;
Unit is corrected, for analyzing three-dimensional virtual image and extraneous true picture, and according to dividing Analysis result is corrected to three-dimensional virtual image;
Image rendering unit, for being rendered to obtaining three-dimensional virtual image after correction.
It is highly preferred that correction module also includes:
Light source control unit, for according to obtaining three-dimensional virtual image after correction to source emissioning light line Brightness is adjusted.
The invention also provides a kind of method that nearly eye is shown, including:
The lighting module output image of near-to-eye;
Described image is carried out integration imaging by the optical modulation element of near-to-eye, to show three-dimensional Image.
Wherein, optical modulation element includes microlens array or microwell array;Microlens array or micropore battle array It is classified as the microlens array of curved surface or the microwell array of curved surface.Optical modulation element is included by liquid crystal cell structure Into dynamic microlens array or microwell array.
Preferably, lighting module includes at least two display panels and light-splitting device:
Specifically, at least two display panels are located at the both sides of light-splitting device, and with light-splitting device into pre- Determine angle;
Wherein, display panel is used for display image, and light-splitting device is used to conduct the figure that display panel is shown Picture.
Preferably, at least two display panels and light-splitting device are into 45 degree of angles.
Alternatively, when display panel is non-self-luminous surface plate, lighting module also includes light source and convergence Mirror:
Convergent mirror is located between light source and display panel, and the light that light source is launched is by convergent mirror to display Panel is illuminated.
Preferably, light-splitting device is polarized light splitting device:Polarized light splitting device reflection is logical from light source The light of the first polarization direction component after overconvergence mirror collimation, and it is inclined to transmit orthogonal to that second The light of the polarization direction of the light for durection component of shaking, transmission and reflection is used for the illumination of non-self-luminous surface plate.
Alternatively, when display panel is self-emission panel, light-splitting device transmission and reflection are from spontaneous The light of optic panel.
Alternatively, when display panel is monochromatic self-emission panel, light-splitting device is band logical color dispersing Device:Band logical color dispersing device is reflected from monochromatic self-emission panel and same color Light, and transmit the light of other colors.
Preferably, at least two display panels to be to switch display image more than predetermined refresh frequency, and The image that each display panel is shown is in predetermined ratio pixel of both horizontally and vertically interlocking.
It is highly preferred that when the number of display panel is n, n display panel is with more than n × 30Hz Frequency switch display image, and the image that each display panel is shown both horizontally and vertically handing over Wrong 1/n pixel.
Preferably, optical modulation element is located in lighting module and each preset distance of display panel first At position.
Preferably, display device also includes light conduction cell, and light conduction cell includes at least one lens; The conducting images that light conduction cell shows display panel are to the optical modulation element preset distance At position, integration imaging is carried out for the optical modulation element.
Alternatively, when light conduction cell includes two lens, at least one display panel is located at one thoroughly At one times of focal length of mirror, the distance between two lens are two focus length;Optical modulation element is located at image After being conducted by light conduction cell at the second preset distance of image space.
Alternatively, when light conduction cell includes a lens, at least one display panel is located at the lens Two focus length at;Optical modulation element is located at the of image space after image is conducted by light conduction cell At three preset distances.The invention provides a kind of near-eye display device, for example, the near-eye display device It can be shown for the near-eye display device for virtual reality, the near-eye display device using integration imaging Principle to be presented on human eye is natural three-dimensional body, solve long-term viewing 3 dimensional drawing The visual fatigue problem that image-tape comes, for needing the application scenarios of this equipment of long periods of wear particularly important; Further, such as near-eye display device is the near-eye display device for augmented reality, and the nearly eye is shown Equipment can be real according to the extraneous true picture and the match condition of three-dimensional virtual image that get in real time Shi Jiaozheng is adjusted and renders three-dimensional virtual image, the perfect function of near-eye display device.Further Ground, the method that the near-eye display device can be multiplexed using multi-display improves display quality;Utilize simultaneously Polarization spectroscope improves light efficiency.Meanwhile, such scheme proposed by the present invention changes to existing system Dynamic very little, does not interfere with the compatibility of system, and realize simple, efficient.
The additional aspect of the present invention and advantage will be set forth in part in the description, and these will be from following Description in become obvious, or by the present invention practice recognize.
Brief description of the drawings
The above-mentioned and/or additional aspect of the present invention and advantage to embodiment from retouching below in conjunction with the accompanying drawings It will be apparent and be readily appreciated that in stating, wherein:
Fig. 1 is a kind of apparatus structure schematic diagram of existing Display Technique in the present invention;
The equipment that Fig. 2 shows the display device for virtual reality of first embodiment in the present invention Schematic diagram;
Fig. 3 shows the equipment schematic diagram of the display device that one is used for augmented reality in the present invention;
Fig. 4 is the equipment schematic diagram of another display device for augmented reality in the present invention;
Fig. 5 a show the structural representation of the first embodiment of lighting module in the present invention;
Fig. 5 b show the structural representation of the second embodiment of lighting module in the present invention;
Fig. 5 c show the structural representation of the 3rd embodiment of lighting module in the present invention;
Fig. 5 d show the structural representation of the 4th embodiment of lighting module in the present invention;
Fig. 6 a show the structural representation of the first embodiment of light conduction cell in the present invention;
Fig. 6 b show the structural representation of the second embodiment of light conduction cell in the present invention;
Fig. 7 shows the structural representation of midplane lens array of the present invention;
Fig. 8 shows the structural representation of mean camber lens array of the present invention;
Fig. 9 shows the structural representation of microwell array in the present invention;
Figure 10 shows schematic diagram when human eye watches two dimensional image;
Figure 11 shows schematic diagram when human eye watches common 3-D view;
Figure 12 shows schematic diagram during human eye viewing integration imaging display in the present invention;
Figure 13 shows binocular near-eye light field display schematic diagram in the present invention;
Figure 14 shows the display device for augmented reality of second embodiment in the present invention;
Figure 15 shows the display device for augmented reality of 3rd embodiment in the present invention;
Figure 16 shows the display device for virtual reality of fourth embodiment in the present invention;
Figure 17 shows the schematic flow sheet of the three-dimensional enhanced reality of one embodiment of the invention;
Figure 18 is the schematic flow sheet of the three-dimensional enhanced reality engine of a preferred embodiment of the invention;
The schematic flow sheet that Figure 19 renders for the 3 d light fields of a preferred embodiment of the invention.
Embodiment
Embodiments of the invention are described below in detail, the example of the embodiment is shown in the drawings, its In from beginning to end same or similar label represent same or similar element or with same or like The element of function.The embodiments described below with reference to the accompanying drawings are exemplary, is only used for explaining this Invention, and be not construed as limiting the claims.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singulative used herein " one ", " one ", " described " and "the" may also comprise plural form.It is to be further understood that The wording " comprising " used in the specification of the present invention refers to there is the feature, integer, step, behaviour Make, element and/or component, but it is not excluded that in the presence of or add other one or more features, it is whole Number, step, operation, element, component and/or their group.It should be understood that when we claim element It is " connected " or during " coupled " to another element, it can be directly connected or coupled to other elements, or Person can also have intermediary element.In addition, " connection " used herein or " coupling " can be included wirelessly Connection or wireless coupling.Wording "and/or" used herein includes one or more associated list The whole or any cell of item and all combination.
Those skilled in the art of the present technique are appreciated that unless otherwise defined, all terms used herein (including technical term and scientific terminology), with the those of ordinary skill in art of the present invention General understanding identical meaning.It should also be understood that those arts defined in such as general dictionary Language, it should be understood that with the consistent meaning of the meaning in the context with prior art, and remove It is non-as here by specific definitions, otherwise will not be explained with idealization or excessively formal implication. It should be noted that the near-eye display device of the present invention includes the display device of virtual reality or strengthens existing Real display device.
In one embodiment of the present of invention, display device includes lighting module and optical modulation element;Wherein, Lighting module output image;Optical modulation element carries out integration imaging to image, to show three-dimensional figure Picture.In the present embodiment, what the principle shown using integration imaging to be presented on human eye is natural three Object is tieed up, the visual fatigue that long-term viewing three-dimensional image is brought is solved the problems, such as.
Preferably, the display device also includes reflecting element:Reflecting element is located at the light path of lighting module On direction, the three-dimensional virtual image that optical modulation element is shown is oriented to human eye.Wherein, reflecting element bag Include reflective mirror or spectroscope.
Fig. 2 shows the display device for virtual reality of first embodiment in the present invention, and display is set It is standby to include lighting module, optical modulation element and reflective mirror.In the present embodiment, optical modulation element will be shown The image procossing of Display panel is the dummy object light field of three-dimensional virtual image, by spectroscope by three-dimensional Virtual image projects human eye.By the present embodiment, human eye it is observed that virtual three-dimensional object, so that Realize the display of virtual reality.
Preferably, optical modulation element is located in lighting module and each preset distance of display panel first At position.
It should be noted that the structure and nearly eye of the display device for virtual reality shown in Fig. 2 are aobvious Show that method can be used for the display device of augmented reality.Now, beam splitter can be spectroscope.
Preferably, near-eye display device also includes light conduction cell, and light conduction cell includes at least one Lens;The conducting images that light conduction cell shows display panel are to optical modulation element preset distance At position, integration imaging is carried out for optical modulation element.Preferably, as shown in figure 3, when nearly eye When display device is the display device for augmented reality, display device also includes correction module, reflective Element is spectroscope;
The light of three-dimensional virtual image and extraneous true picture is divided into two-way by spectroscope, is individually directed people Eye and the correction module;
The three-dimensional virtual image and extraneous true picture that correction module is conducted based on spectroscope are to three-dimensional empty Intend image and be corrected processing, and shown three-dimensional virtual image is obtained after correction by lighting module Show.
Preferably, as shown in figure 4, correction module includes image capturing unit, correction unit and image Rendering unit;Image capturing unit can be camera.
Image capturing unit is obtained from spectroscopical three-dimensional virtual image and extraneous true picture;Correction Unit is analyzed three-dimensional virtual image and extraneous true picture, and according to analysis result to three-dimensional empty Intend image to be corrected;Image rendering unit is rendered to obtaining three-dimensional virtual image after correction.
Be changed to reflective mirror in the spectroscope that Fig. 3 is used in the display device of augmented reality, or will and Spectroscope in Fig. 4 is changed to after reflective mirror and removal image capturing unit, for the aobvious of augmented reality Showing that equipment is variable is more used for the display device of virtual reality.
It is highly preferred that correction module also includes light source control unit;After light source control unit is according to correction Brightness of the three-dimensional virtual image to source emissioning light line is obtained to be adjusted.For example, when display panel is During light-emitting display panel, it is single that the image that display panel is shown passes to light conduction by light-splitting device The image that display panel is shown is imaged on the position with optical modulation element preset distance by member, light conduction cell Put, so as to constitute the three-dimensional virtual image that integration imaging is shown.The dummy object light field of display is by dividing Light microscopic respectively enters human eye and image capturing unit.Human eye and image capturing unit can obtain the external world simultaneously True picture.Image capturing unit can receive the identical picture material that same eye-observation is arrived, i.e., three The augmented reality display image of virtual image and extraneous true picture superposition is tieed up, by correcting unit three-dimensional Virtual image is corrected, and the three-dimensional virtual image after correction is carried out by image rendering unit real-time Again render, realize the purpose being adjusted in real time to three-dimensional virtual image.
In another example, when display panel is non-light-emitting display panel, the illumination light of light source transmitting passes through Light-splitting device illuminates display panel, and the image that display panel is shown is imaged on and adjusted with light by light conduction cell The position of the preset distance of element second processed, shows so as to constitute integration imaging.Optical modulation element will be shown The image procossing of Display panel is the three-dimensional virtual image that integration imaging is shown, the void of three-dimensional virtual image Intend object light field and human eye and image capturing unit are respectively enterd by spectroscope.Human eye and image capture list Member can obtain extraneous true picture simultaneously.Image capturing unit can receive arrived with eye-observation identical Picture material, i.e. three-dimensional virtual image and the augmented reality display image of extraneous true picture superposition, It is corrected by correcting unit three-dimensional virtual image, by image rendering unit to the three-dimensional after correction Virtual image render again in real time, realizes the mesh being adjusted in real time to three-dimensional virtual image 's.
The implementation to each part of first embodiment is illustrated separately below.
First, lighting module
Lighting module includes at least two display panels and light-splitting device;At least two display panels are located at The both sides of light-splitting device, and with light-splitting device into predetermined angular;Preferably, at least two display panel With light-splitting device into 45 degree of angles.
Wherein, display panel display image, the image that light-splitting device conduction display panel is shown.
Alternatively, when display panel is non-self-luminous surface plate, lighting module also includes light source and convergence Mirror:Convergent mirror is located between light source and display panel, and the light that light source is launched is by convergent mirror to display Panel is illuminated.
Alternatively, when display panel is self-emission panel, e.g., OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) display panel, lighting module need not have attached Plus light source, light-splitting device transmission and reflection the light from self-emission panel.
Alternatively, when display panel is monochromatic self-emission panel, light-splitting device is band logical color dispersing Device:Band logical color dispersing device is reflected from monochromatic self-emission panel and same color Light, and transmit the light of other colors.
Preferably, at least two display panels to be to switch display image more than predetermined refresh frequency, and The image that each display panel is shown is in predetermined ratio pixel of both horizontally and vertically interlocking.For example, By two display panels to switch display image more than predetermined refresh frequency, and each display panel Image both horizontally and vertically interlock 1/2 pixel, then resolution ratio can be doubled.
It is highly preferred that when the number of display panel is n, n display panel is with more than n × 30Hz Frequency switch display image, and the image that each display panel is shown both horizontally and vertically handing over Wrong 1/n pixel.For example, n display panel switches display image with n × 60Hz frequency, So that the imperceptible flicker of human eye.
Lighting module in the present embodiment includes any implementation:
Scheme one:Lighting module has used polylith display panel, and polylith display panel is positioned over optical splitter Part surrounding, and with light-splitting device into predetermined angular, for example, into 45 degree of angles.As shown in Figure 5 a, Display panel can be two pieces, and light-splitting device can be polarization spectroscope.Polarized light splitting device reflection comes The light of the first polarization direction component after from being collimated by convergent mirror of light source, and transmit orthogonal to that Second of polarization direction component light, transmission and reflection polarization direction light be used for non-self-luminous surface The illumination of plate.
After the illumination light of light source is by convergent mirror, collimate as directional light, with polarization spectroscope into 45 degree Angle directive polarization spectroscope.The light of first polarization state in illumination light is reflexed to display surface by polarization spectroscope Plate 1, is that display panel 1 provides illumination light, by the light transmission of the second polarization state to display panel 2, Illumination light is provided for display panel 2.The light of first polarization state is changed into the after the reflection of display panel 1 The light of two polarization states, carries display image information, for example, the image that display panel 1 is shown, passes through Polarization spectroscope is transmitted away.It is inclined that the light of second polarization state becomes first after the reflection of display panel 2 The light of polarization state, carries display image information, for example, the image that display panel 2 is shown, by polarization Dichroic mirror is gone out.
In the present embodiment, by using two pieces of display panels and polarization spectroscope, the illumination from light source Light will not be reflected back toward light source position or be scattered, and all light are all used to irradiate display panel and carry Subsequent optical path is supplied, so that the utilization ratio of illumination light is effectively improved, than using in the prior art The method of scattering film scattered portion illumination light reduces the loss of light, reduces energy consumption, can be effectively Improve the cruising time of device battery.
Two pieces of time-multiplexed methods of display panel are specific as follows, utilize two pieces of display panel display images Content, two display panels are to switch display image, predetermined refresh frequency more than predetermined refresh frequency The refreshing frequency that human eye can be differentiated is exceeded well over, for example, predetermined refresh frequency is more than 2 × 30Hz=60Hz, Simultaneously display image both horizontally and vertically all interlock half of display panel pixel distance, so Human eye is in synthesis, and the resolution ratio of display image will increase twice.N blocks display panel is time-multiplexed Method And Principle it is similar with two pieces of time-multiplexed methods of display panel, the predetermined refresh frequency of every piece of panel Rate be more than n × 30Hz, and every piece of display panel image both horizontally and vertically interlock 1/n picture Element, thus image resolution ratio will n times of improve.
In this programme, display image is on the one hand improved using the time-multiplexed method of polylith display panel Resolution ratio, it is possible to provide good display quality, on the other hand also take full advantage of illumination light, improve The utilization ratio of illumination light.
Scheme two:Lighting module uses polylith display panel, and polylith display panel is positioned over light-splitting device Surrounding, and with light-splitting device into 45 degree of angles.Light-splitting device is used only without using polarization spectroscope Common spectroscope, can be two pieces shown here as panel as shown in Figure 5 b, light-splitting device can be Common spectroscope.
After the illumination light of light source is by convergent mirror, collimation turns into directional light, with spectroscope into 45 degree of angles Directive spectroscope.A part of light is reflected to display panel 1, is that display panel 1 provides illumination light, Another part light transmission, to display panel 2, is that display panel 2 provides illumination light.Illumination light is by aobvious Show that panel 1 reflects, carry the display image information of image, transmitted by spectroscope, into light conduction Unit;Another part illumination light reflects by display panel 2, carries the display image information of image, Entered dichroic mirror, into light conduction cell.Thus, the resolution ratio of display image is as with top Be will be enhanced in case one using time-multiplexed method, but the utilization ratio of illumination light can be less than with Upper scheme one.
Scheme three:Lighting module has used polylith oled panel, and polylith oled panel is positioned over Light-splitting device surrounding, and with light-splitting device into 45 degree of angles.As shown in Figure 5 c, using two pieces of OLED Panel, beam splitter uses common spectroscope.
The light of the display image information for the carrying image that two pieces of oled panels are sent is split respectively Mirror reflects and transmitted, into light conduction cell.It will be sent using scattering surface by oled panel By dichroic mirror and be transmitted on scattering surface without using light scattered, make it will not Into conduction light path, it is to avoid the influence for causing ambient noise to display image.
Present embodiment improves the resolution ratio of display device by using two oled panels.
Scheme four:Lighting module has used three pieces of monochromatic oled panels, such as red, green, blue OLED Panel, three pieces of monochromatic oled panels are positioned over beam splitter surrounding, and all with beam splitter into 45 degree of angles.As fig 5d, three pieces of monochromatic oled panels send red, green, blue three coloured light respectively, Light-splitting device employs the colored spectroscope of green and blueness of band logical, and green and blue light are carried out respectively Reflection, and transmit the light of other colors.
The monochrome image that three kinds of monochromatic oled panels are sent forms coloured image, entered by fusion Enter light conduction cell.The monochrome image that three pieces of monochromatic oled panels are shown merges the coloured image to be formed Resolution ratio gets a promotion, and resolution ratio is with respect to 3 times of lifting for monolithic display panel in theory.Due to making With color dispersing unit, the utilization ratio of light can be improved, and can further reduce equipment energy consumption.
2nd, light conduction cell
Light conduction cell in the present embodiment can include one of following scheme.Scheme one:When light conduction When unit includes two lens, at least one display panel is located at one times of focal length of a lens, and two The distance between individual lens are two focus length;Optical modulation element is conducted positioned at image by light conduction cell Afterwards at the second preset distance of image space.The 4f optical systems of 2 lens compositions can be thought, Display panel is located at 1 times of focal length of previous lens, and the distance between 2 lens are 2 times of focal lengths, Imaging surface is located at 1 times of focal length of latter lens, as shown in Figure 6 a.
For example, when display panel is light-emitting display panel, the image that display panel is shown is by dividing Optical device passes to light conduction cell, when display panel is non-light-emitting display panel, and illumination light passes through Light-splitting device illuminates display panel;The image that display panel is shown is imaged on light modulation by light conduction cell At the position of second preset distance of element, so as to constitute the three-dimensional virtual image that integration imaging is shown. The image procossing that i.e. optical modulation element shows display panel is the dummy object light of three-dimensional virtual image , project human eye.In the present embodiment, the image of display panel is imaged onto light and adjusted by light conduction cell Near element processed so that display panel and optical modulation element constitute an integration imaging display device. This structure causes whole system more simple, it is to avoid uses multiple optical modulation elements, reduces cost, And the distance of optical modulation element and human eye is shortened, is conducive to the visible angle of user improved.
Meanwhile, multiple display panels can improve point that integration imaging is shown using time-multiplexed mode Resolution, embodiment is as previously described.Integration imaging display content is respectively human eye by spectroscope Captured with camera, extraneous real scene image can also be captured by human eye and camera simultaneously, it is real The augmented reality for having showed display dummy object and real scene superposition is shown.
Scheme two:When light conduction cell includes a lens, it is saturating that at least one display panel is located at this At the two focus length of mirror;Optical modulation element is located at image space after image is conducted by light conduction cell At 3rd preset distance.For example, being made up of 1 lens.Display panel is located at 2 times of focal lengths of lens Place, imaging surface also is located at 2 times of focal lengths of lens, the close position with microlens array, such as Fig. 6 b It is shown.
It should be noted that the structure of the display device for augmented reality shown in the present embodiment can For the display device of virtual reality, specifically, augmented reality will be used in Fig. 6 a and Fig. 6 b Spectroscope in display device is changed to after reflective mirror, and the display device for augmented reality is variable more to be used In the display device of virtual reality.
3rd, optical modulation element
Scheme one:Optical modulation element is microlens array
The image that display panel is shown is imaged onto near microlens array by light conduction cell, formed One integration imaging shows system.In integration imaging is shown, many members can be shown on display panel Sketch map, each elemental map is imaged by corresponding lenticule, forms a three-dimensional body in space Light field, human eye is by capturing this three-dimensional body light field, with regard to that can perceive a real three-dimensional body.
In the present embodiment, lens array is planar lens array.Visual angle during integration imaging is shown can be by It is limited to the region that each elemental map can be shown on a display panel.Generally, each lenticule exists One viewing area of correspondence on display panel, in order to prevent the overlapping of image, beyond this viewing area Display content will be cast out, as shown in fig. 7, elemental map can not be in the corresponding display of border lens Region completely shows, therefore, the quantity of corresponding elemental map be it is limited, can not beyond visual angle It was observed that integrated image.
Preferably, planar lens array can be changed into toroidal lens array to solve the above problems, curved surface The corresponding viewing area of edge lenticule of lens array will increase, can complete display elements figure, correspondence Elemental map with regard to that can be increased, therefore the angle of visual field will largely be increased, as shown in Figure 8.
Scheme two:Optical modulation element is microwell array
In the present invention, microlens array can use microwell array to substitute, as shown in figure 9, forming collection Into imaging display system.
Microwell array and microlens array all have the light for causing ad-hoc location along specific direction The effect of conduction.Microlens array and microwell array in the present invention can be made up of liquid crystal cell Dynamic liquid crystal lens or liquid crystal microwell array, so by control liquid crystal cell cause part or The microlens array or microwell array of Zone Full have refractive power effect or do not have refractive power effect, do not have Transparent element can be turned into by having during refractive power effect, so as to realize the switching of two dimension, Three-dimensional Display, or The mixed display of person's two and three dimensions object.
Display device is worn in augmented reality, and display plane two-dimensional bodies can not meet people Demand., can be by being worn on binocular if necessary to display three-dimensional body, two width are projected respectively to be had The image of parallax, forms stereoscopic vision.All it is in right and left eyes pair in existing 3 D stereo is shown The image of parallax is shown on the screen answered, such image can form three-dimensional vertical by the processing of human brain Body vision.But, this mode can cause the contradiction of human eye focal adjustments and convergence regulation, long-term to wear Wearing can make eyes feel fatigue.As shown in Figure 10, on screen is watched when a two-dimensional bodies, The focusing distance of each eye is consistent with convergence distance, therefore viewing does not result in human eye for a long time Fatigue;But in the case where watching three-dimensional body, observe that see is the image that has parallax due to two, In order to watch clearly image, human eye can adjust eyes to focus on screen, but be due to parallax, Human brain can handle image so that 3-D view has a certain distance, focusing distance and convergence distance with screen It is inconsistent, as shown in figure 11.Now, the regulation of human eye can allow eyes to converge at this 3-D view Position, due to eyes focal adjustments on the display screen, and the convergence of eyes focuses on space Picture point, eyes continuous balance adjustment, adaptive between both, therefore, long periods of wear is this The display device of augmented reality can cause human eye vision fatigue.
In the present invention, integration imaging is shown by microlens array or microwell array so that reconstruction Three-dimensional body is into these spot lights are by being shown on display panel by spatially many point light source groups Image convergence acted on by the refractive power of microlens array formed, these spot lights constitute a three-dimensional Spatially the object optical field distribution of necessary being, watches a real object, such as just as human eye Shown in Figure 12.Integration imaging show cause human eye focus and convergence completely matching, will not bring because The visual fatigue problem produced for long periods of wear equipment.Present invention uses the original that integration imaging is shown Reason so that the three-dimensional body that each eye is watched all is by real three-dimensional body light field institute group Into, watch extraneous real scene just as human eye the same, therefore can obtain natural Three-dimensional Display, Alleviate focus and the contradiction of convergence regulation, it is to avoid the visual fatigue that is produced because wearing display device, So as to be beneficial to the eye health of beholder.
The present invention is as shown in figure 13 for the situation that binocular near-eye light field is shown, due in certain scape Continuous convergence regulation is provided in deep scope, this Binocular displays can solve common binocular stereoscopic display The problem of middle focal adjustments are with convergence regulation contradiction.It should be noted that will be used to increase in Figure 13 Spectroscope in the display device of strong reality is changed to reflective mirror, and removes after camera, existing for strengthening Real display device is variable to be more used for the display device of virtual reality.
It should be noted that the structure of near-eye display device in the present invention shown in first embodiment and near Eye display methods can be used for the display device of augmented reality and the display device for virtual reality.
Figure 14 shows the display device for augmented reality of second embodiment in the present invention, and this shows Show that equipment includes lighting module, light conduction cell and optical modulation element, wherein, optical modulation element bag Include microlens array or microwell array.
Wherein, lighting module includes:At least two display panels and light-splitting device, light-splitting device include Polarization spectroscope.
When display panel is light-emitting display panel, for example, display panel is OLED display panel, Lighting module need not have additional light source.When display panel is non-light-emitting display panel, illumination Module can also include:Light source and convergent mirror.
When display panel is light-emitting display panel, optical modulation element is arranged in lighting module and each At the position of first preset distance of individual display panel, shown with forming integration imaging.Optical modulation element The image procossing that display panel is shown is dummy object light field, and is conducted by light conduction cell, i.e., Conducted by relay optical system, project human eye.By the present embodiment, human eye it is observed that superposition Virtual three-dimensional object into real scene, so as to realize the display of augmented reality.
When display panel is non-light-emitting display panel, illumination light illuminates display surface by light-splitting device Plate, position of the optical modulation element in lighting module with the first preset distance of each display panel Place is put, is shown with forming integration imaging.The image procossing that optical modulation element shows display panel is void Intend object light field, and conducted by light conduction cell, i.e., conducted, projected by relay optical system Human eye.By the present embodiment, human eye it is observed that the virtual three-dimensional object being added in real scene, So as to realize the display of augmented reality.
In this embodiment, two display panels are more than predetermined refresh frequency to switch display image, Predetermined refresh frequency exceeds well over the refreshing frequency that human eye can be differentiated, while the image of display is in level and hangs down Nogata utilizes the time-multiplexed method of display panel to the pixel distance for half of the display panel that all interlocks To improve resolution ratio.The half-pixel for example, location of pixels of two display panels staggers, then resolution ratio It can double.
The equipment also includes correction module, wherein, the correction module includes:Image capturing unit, such as Camera, spectroscope, correction unit, image rendering unit and light source control unit.
When display panel is light-emitting display panel, optical modulation element is directly in lighting module with showing Show that integration imaging is formed at the position of the preset distance of panel first to be shown, optical modulation element is by display panel The image procossing of display is dummy object light field, and is conducted by light conduction cell, dummy object light field Human eye and image capturing unit are respectively enterd by spectroscope.Human eye and image capturing unit can be obtained simultaneously Take extraneous real scene image.Image capturing unit can receive the identical image that same eye-observation is arrived Content, i.e. three-dimensional virtual image and extraneous true picture superposition generation augmented reality display image, pass through Correction unit is corrected to three-dimensional virtual image, empty to the three-dimensional after correction by image rendering unit Intend image render again in real time, realize the mesh being adjusted in real time to the dummy object of display 's.
When display panel is non-light-emitting display panel, illumination light illuminates display surface by light-splitting device Plate, optical modulation element in lighting unit with shape at the position of the preset distance of display panel first Shown into integration imaging, the image procossing that optical modulation element shows display panel is three-dimensional virtual image Dummy object light field, and conducted by light conduction cell, dummy object light field is distinguished by spectroscope Into human eye and image capturing unit.Human eye and image capturing unit can obtain extraneous real scene simultaneously Image.Image capturing unit can receive the identical picture material that same eye-observation is arrived, i.e., three-dimensional empty Intend image and extraneous true picture superposition generation augmented reality display image, by correcting unit to three-dimensional Virtual image is corrected, and the three-dimensional virtual image after correction is carried out by image rendering unit real-time Again render, realize the purpose being adjusted in real time to the dummy object of display.
The implementation of lighting module in the second embodiment of the present invention can be of the invention more than First embodiment in lighting module various implementations.
The implementation of light conduction cell in the second embodiment of the present invention can be using this hair above The various implementations of light conduction cell in bright first embodiment.
It should be noted that the display device for augmented reality in the present invention shown in second embodiment Structure can be used for virtual reality display device, specifically, will in Figure 14 be used for augmented reality Display device in spectroscope be changed to reflective mirror, and after removing camera, for augmented reality Display device is variable to be more used for the display device of virtual reality.
Figure 15 shows the display device for virtual reality of 3rd embodiment in the present invention.This sets It is standby to include:Lighting module and optical modulation element, wherein, optical modulation element include microlens array or Person's microwell array.
Wherein, lighting module includes:At least two display panels and light-splitting device;Light-splitting device includes Polarization spectroscope.
When display panel is light-emitting display panel, for example, display panel is OLED display panel, The light source that lighting module need not be added.When display panel is non-light-emitting display panel, mould is illuminated Block also includes:Light source and convergent mirror.
When display panel is light-emitting display panel, optical modulation element in lighting module with display surface At the position of the preset distance of plate first, shown with forming integration imaging, optical modulation element is by display panel The image procossing of display is dummy object light field, and then projects human eye.Pass through the present embodiment, human eye It is observed that the virtual three-dimensional object being added in real scene, so as to realize the display of augmented reality.
When display panel is non-light-emitting display panel, illumination light illuminates display surface by light-splitting device Plate, optical modulation element in lighting module with the position of the preset distance of display panel first, with formed Integration imaging shows that the image procossing that optical modulation element shows display panel is dummy object light field, And then project human eye.By the present embodiment, human eye it is observed that being added to virtual in real scene Three-dimensional body, so as to realize the display of augmented reality.
In this embodiment, two display panels are more than predetermined refresh frequency to switch display image, Predetermined refresh frequency exceeds well over the refreshing frequency that human eye can be differentiated, while the image of display is in level and hangs down Nogata utilizes the time-multiplexed method of display panel to the pixel distance for half of the display panel that all interlocks To improve resolution ratio.The half-pixel for example, location of pixels of two display panels staggers, then resolution ratio It can double.
The above first embodiment of the present invention and second embodiment are contrasted, this embodiment eliminates light conduction Unit so that equipment is more compact, available for some to the conditional situation of bulk.
The display device also includes correction module, wherein, correction module includes:Image capturing unit, Such as camera, spectroscope, correction unit, image rendering unit and light source control unit.
When display panel is light-emitting display panel, optical modulation element is located in lighting module and display At the position of the preset distance of panel first, shown with forming integration imaging, optical modulation element is by display surface The image procossing that plate is shown is the dummy object light field of three-dimensional virtual image, and dummy object light field is by dividing Light microscopic respectively enters human eye and image capturing unit.Human eye and image capturing unit can obtain the external world simultaneously Real scene image.Image capturing unit can receive the identical picture material that same eye-observation is arrived, I.e. three-dimensional virtual image and extraneous true picture superposition generation augmented reality display image, single by correcting Member is corrected to three-dimensional virtual image, by image rendering unit to the three-dimensional virtual image after correction Progress is rendered again in real time, realizes the purpose being adjusted in real time to the dummy object of display.
When display panel is non-light-emitting display panel, illumination light illuminates display surface by light-splitting device Plate, optical modulation element in lighting module with the position of the preset distance of display panel first, Shown with forming integration imaging, the image procossing that optical modulation element shows display panel is three-dimensional The dummy object light field of image, dummy object light field respectively enters human eye and image capture by spectroscope Unit.Human eye and image capturing unit can obtain extraneous real scene image simultaneously.Image capturing unit The identical picture material that same eye-observation is arrived, i.e. three-dimensional virtual image and extraneous true figure can be received As superposition generation augmented reality display image, three-dimensional virtual image is corrected by correcting unit, The three-dimensional virtual image after correction is carried out by image rendering unit to render again in real time, realized real-time The purpose that ground is adjusted to the dummy object of display.
The scheme of lighting module in third embodiment of the invention can be real using the present invention first above Apply the various schemes of lighting module in example.
It should be noted that the display device for virtual reality in the present invention shown in 3rd embodiment Structure can be used for augmented reality display device, specifically, will in Figure 15 be used for augmented reality Display device in spectroscope be changed to reflective mirror, and after removing camera, for augmented reality Display device is variable to be more used for the display device of virtual reality.
Figure 16 shows the display device for virtual reality of fourth embodiment in the present invention.This shows Show that equipment includes lighting module and optical modulation element;Alternatively, when the viewing location of human eye is in illumination mould When in the light path of block emergent ray, without other elements;Alternatively, when the viewing location and photograph of human eye The light path of bright module emergent ray it is angled when, it is necessary to which speculum, Figure 16 shows the viewing of human eye The light path of position and lighting module emergent ray is into set-up mode at 90 degree;From lighting module The three-dimensional virtual image that image is shown by optical modulation element formation integration imaging;Speculum is arranged in photograph The opposite end of bright module, human eye is oriented to by three-dimensional virtual image.The display device also includes correction module, Correction module includes:Image capturing unit, image rendering unit and light source control unit, image capture Unit obtains the three-dimensional virtual image from speculum;Image rendering unit is carried out to three-dimensional virtual image Rendered, and conducted by lighting module after correction process;Light source control unit is according to correction Brightness of the three-dimensional virtual image afterwards to source emissioning light line is adjusted.
I.e. on the basis of above three embodiment of the present invention, remove image capturing unit and image calibration Positive unit, is changed to speculum, the dummy object light field of three-dimensional image information will be only by human eye by spectroscope Captured.It is described below by taking the scheme transformed by first embodiment as an example, second embodiment and the 3rd is in fact Applying example can also obtain being similarly used for the display device of virtual reality by identical transformation.
As shown in figure 16, the display device includes:Lighting module, light conduction cell and light modulation Element, wherein, optical modulation element includes microlens array or microwell array.
Wherein, lighting module includes:At least two display panels and light-splitting device, light-splitting device are specific Including polarization spectroscope.
When display panel is light-emitting display panel, for example, display panel is OLED display panel, Lighting module need not have additional light source.When display panel is non-light-emitting display panel, illumination Module also includes:Light source and convergent mirror.
When display panel is light-emitting display panel, the image that display panel is shown passes through light-splitting device Light conduction cell is passed to, the image that display panel is shown is imaged on and optical modulating element by light conduction cell At the position of second preset distance of part, shown so as to constitute integration imaging, optical modulation element will be shown The image procossing of Display panel is dummy object light field, projects human eye.Pass through the present embodiment, human eye It is observed that virtual three-dimensional object, so as to realize the display of virtual reality.
When display panel is non-light-emitting display panel, illumination light is illuminated aobvious by light light-splitting device Show panel, light conduction cell by the image that display panel is shown be imaged on it is the second of optical modulation element pre- At the position of set a distance, shown so as to constitute integration imaging, optical modulation element shows display panel Image procossing is dummy object light field, projects human eye.By the present embodiment, human eye it is observed that void Intend three-dimensional body, so as to realize the display of virtual reality.
In this embodiment, two display panels are more than predetermined refresh frequency to switch display image, Predetermined refresh frequency exceeds well over the refreshing frequency that human eye can be differentiated, while the image of display is in level and hangs down Nogata utilizes the time-multiplexed method of display panel to the pixel distance for half of the display panel that all interlocks To improve resolution ratio.The half-pixel for example, location of pixels of two display panels staggers, then resolution ratio It can double.
The display device includes correction module, and correction module includes:Image capturing unit, speculum, Image rendering unit and light source control unit.
When display panel is light-emitting display panel, the image that display panel is shown passes through light-splitting device Light conduction cell is passed to, the image that display panel is shown is imaged on and optical modulating element by light conduction cell At the position of second preset distance of part, shown so as to constitute integration imaging, optical modulation element will be shown The image procossing of Display panel is the dummy object light field of three-dimensional virtual image, the dummy object light of display Field enters human eye by speculum.Real-time rendering is carried out by image rendering unit, it is right in real time to realize The purpose that the dummy object of display is adjusted.
When display panel is non-light-emitting display panel, illumination light is illuminated aobvious by light light-splitting device Show panel, light conduction cell by the image that display panel is shown be imaged on it is the second of optical modulation element pre- At the position of set a distance, shown so as to constitute integration imaging, optical modulation element shows display panel Image procossing is dummy object light field, and the dummy object light field of display enters human eye by spectroscope.It is logical Cross image rendering unit and carry out real-time rendering, realize the dummy object of display is adjusted in real time Purpose.The scheme of lighting module in fourth embodiment of the invention can be real using the present invention first above Apply the various schemes of lighting module in example.
The scheme of light conduction cell in fourth embodiment of the invention is referred to the above present invention first The various schemes of light conduction cell in embodiment.
In another preferred embodiment of the present invention, the basic drafting stream of three-dimensional enhanced reality is detailed Journey, as shown in figure 17, image capturing unit obtain the folded of extraneous true picture and three-dimensional virtual image Plus image;Then, by the image input processing unit captured, new conspicuousness object is carried out Detection, is tracked to original object;Then new conspicuousness object is identified;Pass through GPS and the direction of motion carry out the verification of new conspicuousness object;Then produced for new conspicuousness object Three-dimensional virtual image model, including word or image;Three-dimensional is adjusted according to tracking data in real time The position of image;And contrast calculating is carried out to the region of original object;It is three-dimensional according to setting contrast The color of virtual image, size, shape;And then 3-D view is carried out to all three-dimensional virtual images Render;The three-dimensional virtual image rendered is added in real scene by display unit.
Figure 18 is the schematic flow sheet of the three-dimensional enhanced reality engine of a preferred embodiment of the invention. User can select suitable three-dimensional enhancement mode as needed, and three-dimensional enhancement mode includes foregoing basic Drawing mode, intelligent eye tracking pattern or particular category pattern.Under basic drawing mode, scene In all obvious objects all will be detected and recognize, be then fed into drafting module and adaptively painted System.Under intelligent eye tracking pattern, system will recognize the direction of visual lines of active user, according to sight Direction determines region to be reinforced in scene, and then detection recognizes obvious object and the progress in this region Adaptive enhancing display.Under particular category display pattern, user can set oneself class interested Not, such as hotel, cinema, bank, famous sites in scene etc., then according to the choosing of user Select detection scene in particular category content and carry out adaptive augmented reality.3 kinds of patterns except more than Outside, other enhancement modes be can be devised by.The invention provides a variety of three-dimensional enhancement modes for Family selection is used.Mode selection interface can use menu setecting or shortcut command mode, such as pass through Predetermined efficiently voice command sets three-dimensional enhancement mode.
Flow is rendered substantially there is provided 3 d light fields in another preferred embodiment of the present invention. , it is necessary to two above-mentioned near-eye display devices (nearly eye field display can also be turned into) in practical application The left eye of work, the two nearly eye field displays difference corresponding A R displays or VR displays and The display of right eye, is respectively used to show the picture that left eye and right eye are seen, it is therefore desirable near to two The rendering content of field display is associated adjustment., can be based on two nearly eyes when implementing Spacing between field display is carried out to the position of two nearly eye field display rendering contents and angle Adjustment.As shown in figure 19, the display device with two above-mentioned nearly eye field displays determines to need The three-dimensional model information of superposition, obtains the parameter of each nearly eye field display, wherein, the ginseng of acquisition Number includes at least one of:Each two dimension panel pel spacing, microlens array spacing, panel and Lenticule spacing etc..The display device also obtains the spacing of the nearly eye field display of right and left eyes, so as to The interpupillary distance of beholder is matched.The display device is according to the spacing of the two nearly eye field displays in left and right The position of two virtual cameras in left and right in 3 D rendering engine is set, threedimensional model to be drawn is put into In 3 D rendering engine, respectively according to the ginseng of the parameter setting virtual camera of each nearly eye field display Number, the parameter of setting includes resolution ratio and angle of visual field etc..Then, respectively to the virtual camera of left and right two, The image of multi-angle is drawn according to pixel distribution under lenticule, respectively to multiple angles of left and right camera Image is interleaved fusion, generates two element image arrays (elemental image array), will The element image array of left and right two after merging that interweaves is sent to the two nearly eye field displays in left and right respectively It is middle to be shown.
Described above is only some embodiments of the present invention, it is noted that for the art For those of ordinary skill, under the premise without departing from the principles of the invention, some improvement can also be made And retouching, these improvements and modifications also should be regarded as protection scope of the present invention.

Claims (23)

1. a kind of near-eye display device, including lighting module and optical modulation element:
Lighting module is used for output image;
Optical modulation element is used to carry out integration imaging to described image, to show three-dimensional virtual image.
2. near-eye display device according to claim 1, wherein, the optical modulation element includes Microlens array or microwell array.
3. near-eye display device according to claim 2, wherein, microlens array or micropore battle array It is classified as the microlens array of curved surface or the microwell array of curved surface.
4. the near-eye display device according to Claims 2 or 3, wherein, the optical modulation element Including constituting dynamic microlens array or microwell array by liquid crystal cell.
5. near-eye display device according to claim 1, wherein, the lighting module is included extremely Few two display panels and light-splitting device:
At least two display panel be located at the light-splitting device both sides, and with the light-splitting device Into predetermined angular;
Wherein, the display panel is used for display image, and the light-splitting device is used to conduct the display The image of Display panel.
6. near-eye display device according to claim 5, wherein, at least two display surface Plate and the light-splitting device are into 45 degree of angles.
7. near-eye display device according to claim 5, wherein, when the display panel is non- During self-emission panel, the lighting module also includes light source and convergent mirror:
Convergent mirror is located between light source and display panel, and the light of the light source transmitting is assembled by described Mirror is illuminated to the display panel.
8. near-eye display device according to claim 7, wherein, the light-splitting device is polarization Light-splitting device:
Polarized light splitting device reflection passes through the first after convergent mirror collimation from the light source The light of polarization direction component, and the light of orthogonal to that second of the polarization direction component of transmission, transmission and The light of the polarization direction of reflection is used for the illumination of non-self-luminous surface plate.
9. near-eye display device according to claim 5, wherein, when the display panel is certainly During luminescent panel, the light-splitting device transmission and light of the reflection from self-emission panel.
10. near-eye display device according to claim 5, wherein, when the display panel is During monochromatic self-emission panel, the light-splitting device is band logical color dispersing device:
Band logical color dispersing device reflects the light from monochromatic self-emission panel and same color, And transmit the light of other colors.
11. near-eye display device according to claim 5, wherein, at least two display Panel is to switch display image more than predetermined refresh frequency, and the image that each display panel is shown exists Both horizontally and vertically interlock predetermined ratio pixel.
12. near-eye display device according to claim 11, wherein, when the number of display panel For n when, n display panel switches display image with the frequency more than n × 30Hz, and each The image that display panel is shown is in 1/n pixel of both horizontally and vertically interlocking.
13. near-eye display device according to claim 5, wherein, the optical modulation element position In lighting module with the position of each preset distance of display panel first.
14. near-eye display device according to claim 5, wherein, the display device is also wrapped Light conduction cell is included, the light conduction cell includes at least one lens;The light conduction cell will be aobvious Show the conducting images of Display panel to at the position of the optical modulation element preset distance, for institute State optical modulation element and carry out integration imaging.
15. near-eye display device according to claim 14, wherein, the light conduction cell bag When including two lens, at least one display panel is located at one times of focal length of a lens, two lens The distance between be two focus length;The optical modulation element is passed positioned at image by the light conduction cell Lead at the second preset distance of rear image space.
16. near-eye display device according to claim 14, wherein, the light conduction cell bag When including a lens, at least one display panel is located at the two focus length of the lens;The light modulation Element is located at after image is conducted by the light conduction cell at the 3rd preset distance of image space.
17. near-eye display device according to claim 1, in addition to reflecting element:
The reflecting element is located on the optical path direction of the lighting module, and three-dimensional virtual image is oriented to Human eye.
18. near-eye display device according to claim 17, the reflecting element includes reflective mirror Or spectroscope.
19. near-eye display device according to claim 1, when the near-eye display device is use When the near-eye display device of augmented reality, the near-eye display device also includes correction module, described Reflecting element is spectroscope;
The light of three-dimensional virtual image and extraneous true picture is divided into two-way by spectroscope, is individually directed people Eye and the correction module;
Correction module, for the three-dimensional virtual image and extraneous true picture conducted based on the spectroscope Processing is corrected to three-dimensional virtual image, and three-dimensional virtual image will be obtained after correction and is shone by described Bright module is shown.
20. near-eye display device according to claim 19, the correction module includes:
Image capturing unit, it is true from spectroscopical three-dimensional virtual image and the external world for obtaining Image;
Unit is corrected, for analyzing three-dimensional virtual image and extraneous true picture, and according to dividing Analysis result is corrected to three-dimensional virtual image;
Image rendering unit, for being rendered to obtaining three-dimensional virtual image after correction.
21. near-eye display device according to claim 20, wherein, the correction module is also wrapped Include:
Light source control unit, for according to obtaining three-dimensional virtual image after correction to the source emissioning light The brightness of line is adjusted.
22. a kind of method that nearly eye is shown, including:
The lighting module output image of near-to-eye;
Described image is carried out integration imaging by the optical modulation element of near-to-eye, to show three-dimensional Image.
23. method according to claim 22, wherein, the optical modulation element is lenticule battle array Row or microwell array.
CN201610170301.8A 2016-03-23 2016-03-23 The method that near-eye display device and nearly eye are shown Pending CN107229119A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201610170301.8A CN107229119A (en) 2016-03-23 2016-03-23 The method that near-eye display device and nearly eye are shown
PCT/KR2017/002910 WO2017164573A1 (en) 2016-03-23 2017-03-17 Near-eye display apparatus and near-eye display method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610170301.8A CN107229119A (en) 2016-03-23 2016-03-23 The method that near-eye display device and nearly eye are shown

Publications (1)

Publication Number Publication Date
CN107229119A true CN107229119A (en) 2017-10-03

Family

ID=59931812

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610170301.8A Pending CN107229119A (en) 2016-03-23 2016-03-23 The method that near-eye display device and nearly eye are shown

Country Status (1)

Country Link
CN (1) CN107229119A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108037591A (en) * 2017-12-29 2018-05-15 张家港康得新光电材料有限公司 Light field display system
CN109870820A (en) * 2019-03-26 2019-06-11 成都工业学院 Pin hole reflection mirror array integration imaging augmented reality device and method
CN110031978A (en) * 2019-05-28 2019-07-19 深圳市思坦科技有限公司 A kind of nearly eye display device
WO2019144634A1 (en) * 2018-01-29 2019-08-01 京东方科技集团股份有限公司 Augmented reality device, augmented reality system and information prompting method therefor
CN110308563A (en) * 2018-03-27 2019-10-08 精工爱普生株式会社 Optical unit and display device
CN110308562A (en) * 2018-03-27 2019-10-08 精工爱普生株式会社 Optical unit and display device
CN110308555A (en) * 2018-03-20 2019-10-08 精工爱普生株式会社 Virtual image display apparatus

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090105749A (en) * 2008-04-03 2009-10-07 경희대학교 산학협력단 Integral imaging display system using real and virtual modes
CN205787364U (en) * 2016-03-23 2016-12-07 北京三星通信技术研究有限公司 Near-eye display device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090105749A (en) * 2008-04-03 2009-10-07 경희대학교 산학협력단 Integral imaging display system using real and virtual modes
CN205787364U (en) * 2016-03-23 2016-12-07 北京三星通信技术研究有限公司 Near-eye display device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
DOUGLAS LANMAN ET AL: "Near-Eye Light Field Displays"", 《ACM TRANSACTIONS ON GRAPHICS》 *

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108037591A (en) * 2017-12-29 2018-05-15 张家港康得新光电材料有限公司 Light field display system
CN110095866B (en) * 2018-01-29 2020-07-28 京东方科技集团股份有限公司 Augmented reality device, augmented reality system and information prompting method thereof
US11460699B2 (en) 2018-01-29 2022-10-04 Beijing Boe Technology Development Co., Ltd. Augmented reality device, augmented reality system and information prompt method thereof
WO2019144634A1 (en) * 2018-01-29 2019-08-01 京东方科技集团股份有限公司 Augmented reality device, augmented reality system and information prompting method therefor
CN110095866A (en) * 2018-01-29 2019-08-06 京东方科技集团股份有限公司 Augmented reality device, augmented reality system and its information cuing method
US11249311B2 (en) 2018-03-20 2022-02-15 Seiko Epson Corporation Virtual-image display apparatus
CN110308555A (en) * 2018-03-20 2019-10-08 精工爱普生株式会社 Virtual image display apparatus
CN110308562A (en) * 2018-03-27 2019-10-08 精工爱普生株式会社 Optical unit and display device
CN110308563A (en) * 2018-03-27 2019-10-08 精工爱普生株式会社 Optical unit and display device
CN110308563B (en) * 2018-03-27 2022-03-29 精工爱普生株式会社 Optical unit and display device
CN109870820A (en) * 2019-03-26 2019-06-11 成都工业学院 Pin hole reflection mirror array integration imaging augmented reality device and method
CN109870820B (en) * 2019-03-26 2023-10-17 成都工业学院 Pinhole reflector array integrated imaging augmented reality device and method
CN110031978A (en) * 2019-05-28 2019-07-19 深圳市思坦科技有限公司 A kind of nearly eye display device

Similar Documents

Publication Publication Date Title
CN205787364U (en) Near-eye display device
CN107229119A (en) The method that near-eye display device and nearly eye are shown
CN107894666B (en) Head-mounted multi-depth stereo image display system and display method
Hu et al. Design and assessment of a depth-fused multi-focal-plane display prototype
CN100476505C (en) Three dimension/two dimension switchable color projection display device and method thereof
US20180122143A1 (en) Hybrid photonic vr/ar systems
CN101518096B (en) Three-dimensional display system
US11683472B2 (en) Superstereoscopic display with enhanced off-angle separation
CN101414425B (en) Display device and display method
US10554960B2 (en) Unassisted stereoscopic display device using directional backlight structure
CN107272199A (en) Virtual and augmented reality System and method for
CN109188700A (en) Optical presentation system and AR/VR display device
CN102540485A (en) Stereo display module capable of displaying combined image in overlapped manner
CN109725462B (en) Display device, display apparatus, and driving method of display device
KR20110125416A (en) Three dimensional image display apparatus and driving method thereof
US20090295909A1 (en) Device and Method for 2D-3D Switchable Autostereoscopic Viewing
US9151958B2 (en) Display system using a pair of polarized sources with a 3-D display mode and two 2-D display modes
CN103176277A (en) Hybrid multiplexed 3D display and displaying method thereof
CN204479842U (en) A kind of head mounted display
US10142619B2 (en) Wide angle viewing device II
WO2021185730A1 (en) Display apparatus for rendering three-dimensional image and method therefor
JP2004258594A (en) Three-dimensional image display device realizing appreciation from wide angle
Kovacs et al. 3D Display technologies and effects on the human vision system
US9612447B2 (en) Wide angle viewing device
US20230359061A1 (en) Display apparatus providing immersive image

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination