US20230176380A1 - Pupil-replicating lightguide with switchable out-coupling efficiency distribution and display based thereon - Google Patents
Pupil-replicating lightguide with switchable out-coupling efficiency distribution and display based thereon Download PDFInfo
- Publication number
- US20230176380A1 US20230176380A1 US17/698,996 US202217698996A US2023176380A1 US 20230176380 A1 US20230176380 A1 US 20230176380A1 US 202217698996 A US202217698996 A US 202217698996A US 2023176380 A1 US2023176380 A1 US 2023176380A1
- Authority
- US
- United States
- Prior art keywords
- pupil
- slab
- image light
- grating
- replicating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000010168 coupling process Methods 0.000 title claims abstract description 70
- 238000005859 coupling reaction Methods 0.000 title claims abstract description 70
- 238000009826 distribution Methods 0.000 title claims abstract description 22
- 239000012780 transparent material Substances 0.000 claims abstract description 10
- 239000004973 liquid crystal related substance Substances 0.000 claims description 65
- 210000001747 pupil Anatomy 0.000 claims description 35
- 230000010287 polarization Effects 0.000 claims description 18
- 238000000034 method Methods 0.000 claims description 12
- 230000001419 dependent effect Effects 0.000 claims description 5
- 239000012530 fluid Substances 0.000 description 34
- 230000005684 electric field Effects 0.000 description 14
- 230000003287 optical effect Effects 0.000 description 11
- 229920000642 polymer Polymers 0.000 description 10
- 239000000758 substrate Substances 0.000 description 9
- 230000000007 visual effect Effects 0.000 description 7
- XLOMVQKBTHCTTD-UHFFFAOYSA-N Zinc monoxide Chemical compound [Zn]=O XLOMVQKBTHCTTD-UHFFFAOYSA-N 0.000 description 6
- 125000000524 functional group Chemical group 0.000 description 5
- 230000000737 periodic effect Effects 0.000 description 5
- 239000000203 mixture Substances 0.000 description 4
- 230000001902 propagating effect Effects 0.000 description 4
- 125000003118 aryl group Chemical group 0.000 description 3
- 230000003190 augmentative effect Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 239000005276 holographic polymer dispersed liquid crystals (HPDLCs) Substances 0.000 description 3
- 230000002209 hydrophobic effect Effects 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 239000004094 surface-active agent Substances 0.000 description 3
- XOLBLPGZBRYERU-UHFFFAOYSA-N tin dioxide Chemical compound O=[Sn]=O XOLBLPGZBRYERU-UHFFFAOYSA-N 0.000 description 3
- 229910001887 tin oxide Inorganic materials 0.000 description 3
- 239000011787 zinc oxide Substances 0.000 description 3
- 229910019142 PO4 Inorganic materials 0.000 description 2
- VYPSYNLAJGMNEJ-UHFFFAOYSA-N Silicium dioxide Chemical compound O=[Si]=O VYPSYNLAJGMNEJ-UHFFFAOYSA-N 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000003098 cholesteric effect Effects 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 125000002887 hydroxy group Chemical group [H]O* 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 229910003437 indium oxide Inorganic materials 0.000 description 2
- PJXISJQVUVHSOJ-UHFFFAOYSA-N indium(iii) oxide Chemical compound [O-2].[O-2].[O-2].[In+3].[In+3] PJXISJQVUVHSOJ-UHFFFAOYSA-N 0.000 description 2
- AMGQUBHHOARCQH-UHFFFAOYSA-N indium;oxotin Chemical compound [In].[Sn]=O AMGQUBHHOARCQH-UHFFFAOYSA-N 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000000178 monomer Substances 0.000 description 2
- 235000021317 phosphate Nutrition 0.000 description 2
- 125000002924 primary amino group Chemical group [H]N([H])* 0.000 description 2
- 229920002545 silicone oil Polymers 0.000 description 2
- 230000000087 stabilizing effect Effects 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- FOXSXNJTWXVMEA-UHFFFAOYSA-N 1,3-bis(phenylsulfanyl)benzene Chemical compound C=1C=CC(SC=2C=CC=CC=2)=CC=1SC1=CC=CC=C1 FOXSXNJTWXVMEA-UHFFFAOYSA-N 0.000 description 1
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 description 1
- 239000004986 Cholesteric liquid crystals (ChLC) Substances 0.000 description 1
- GYHNNYVSQQEPJS-UHFFFAOYSA-N Gallium Chemical compound [Ga] GYHNNYVSQQEPJS-UHFFFAOYSA-N 0.000 description 1
- 239000004983 Polymer Dispersed Liquid Crystal Substances 0.000 description 1
- BQCADISMDOOEFD-UHFFFAOYSA-N Silver Chemical compound [Ag] BQCADISMDOOEFD-UHFFFAOYSA-N 0.000 description 1
- 239000002042 Silver nanowire Substances 0.000 description 1
- 125000001931 aliphatic group Chemical group 0.000 description 1
- 125000000129 anionic group Chemical group 0.000 description 1
- 229910052799 carbon Inorganic materials 0.000 description 1
- 239000002041 carbon nanotube Substances 0.000 description 1
- 229910021393 carbon nanotube Inorganic materials 0.000 description 1
- 125000002915 carbonyl group Chemical group [*:2]C([*:1])=O 0.000 description 1
- 125000003178 carboxy group Chemical group [H]OC(*)=O 0.000 description 1
- 150000007942 carboxylates Chemical group 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000002019 doping agent Substances 0.000 description 1
- 230000001747 exhibiting effect Effects 0.000 description 1
- 239000005350 fused silica glass Substances 0.000 description 1
- 229910052733 gallium Inorganic materials 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 229910052738 indium Inorganic materials 0.000 description 1
- APFVFJFRJDLVQX-UHFFFAOYSA-N indium atom Chemical compound [In] APFVFJFRJDLVQX-UHFFFAOYSA-N 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 125000001997 phenyl group Chemical group [H]C1=C([H])C([H])=C(*)C([H])=C1[H] 0.000 description 1
- NBIIXXVUZAFLBC-UHFFFAOYSA-K phosphate Chemical compound [O-]P([O-])([O-])=O NBIIXXVUZAFLBC-UHFFFAOYSA-K 0.000 description 1
- 239000010452 phosphate Substances 0.000 description 1
- 150000003013 phosphoric acid derivatives Chemical group 0.000 description 1
- 230000000379 polymerizing effect Effects 0.000 description 1
- 229920013636 polyphenyl ether polymer Polymers 0.000 description 1
- 229920006389 polyphenyl polymer Polymers 0.000 description 1
- 239000010453 quartz Substances 0.000 description 1
- 238000007348 radical reaction Methods 0.000 description 1
- 229910052594 sapphire Inorganic materials 0.000 description 1
- 239000010980 sapphire Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000000392 somatic effect Effects 0.000 description 1
- 238000004611 spectroscopical analysis Methods 0.000 description 1
- QAOWNCQODCNURD-UHFFFAOYSA-L sulfate group Chemical group S(=O)(=O)([O-])[O-] QAOWNCQODCNURD-UHFFFAOYSA-L 0.000 description 1
- BDHFUVZGWQCTTF-UHFFFAOYSA-M sulfonate Chemical group [O-]S(=O)=O BDHFUVZGWQCTTF-UHFFFAOYSA-M 0.000 description 1
- 150000003568 thioethers Chemical class 0.000 description 1
- 125000003396 thiol group Chemical group [H]S* 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 238000009827 uniform distribution Methods 0.000 description 1
- YVTHLONGBIQYBO-UHFFFAOYSA-N zinc indium(3+) oxygen(2-) Chemical compound [O--].[Zn++].[In+3] YVTHLONGBIQYBO-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/22—Measuring arrangements characterised by the use of optical techniques for measuring depth
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
- G01S17/10—Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/4865—Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
- G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
- G02B26/0816—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light by means of one or more reflecting elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0081—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. enlarging, the entrance or exit pupil
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/42—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
- G02B27/4205—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having a diffractive optical element [DOE] contributing to image formation, e.g. whereby modulation transfer function MTF or optical aberrations are relevant
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/42—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
- G02B27/44—Grating systems; Zone plate systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0013—Means for improving the coupling-in of light from the light source into the light guide
- G02B6/0015—Means for improving the coupling-in of light from the light source into the light guide provided on the surface of the light guide or in the bulk of it
- G02B6/0016—Grooves, prisms, gratings, scattering particles or rough surfaces
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0013—Means for improving the coupling-in of light from the light source into the light guide
- G02B6/0023—Means for improving the coupling-in of light from the light source into the light guide provided by one optical element, or plurality thereof, placed between the light guide and the light source, or around the light source
- G02B6/0031—Reflecting element, sheet or layer
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0033—Means for improving the coupling-out of light from the light guide
- G02B6/0035—Means for improving the coupling-out of light from the light guide provided on the surface of the light guide or in the bulk of it
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0033—Means for improving the coupling-out of light from the light guide
- G02B6/005—Means for improving the coupling-out of light from the light guide provided by one optical element, or plurality thereof, placed on the light output side of the light guide
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/0001—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems
- G02B6/0011—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form
- G02B6/0066—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings specially adapted for lighting devices or systems the light guides being planar or of plate-like form characterised by the light source being coupled to the light guide
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B6/00—Light guides; Structural details of arrangements comprising light guides and other optical elements, e.g. couplings
- G02B6/24—Coupling light guides
- G02B6/26—Optical coupling means
- G02B6/35—Optical coupling means having switching means
- G02B6/351—Optical coupling means having switching means involving stationary waveguides with moving interposed optical elements
- G02B6/3512—Optical coupling means having switching means involving stationary waveguides with moving interposed optical elements the optical element being reflective, e.g. mirror
- G02B6/3518—Optical coupling means having switching means involving stationary waveguides with moving interposed optical elements the optical element being reflective, e.g. mirror the reflective optical element being an intrinsic part of a MEMS device, i.e. fabricated together with the MEMS device
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
- G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
- G02F1/1333—Constructional arrangements; Manufacturing methods
- G02F1/1335—Structural association of cells with optical devices, e.g. polarisers or reflectors
- G02F1/133504—Diffusing, scattering, diffracting elements
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
- G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
- G02F1/1333—Constructional arrangements; Manufacturing methods
- G02F1/1335—Structural association of cells with optical devices, e.g. polarisers or reflectors
- G02F1/133526—Lenses, e.g. microlenses or Fresnel lenses
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/29—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the position or the direction of light beams, i.e. deflection
- G02F1/292—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the position or the direction of light beams, i.e. deflection by controlled diffraction or phased-array beam steering
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/29—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the position or the direction of light beams, i.e. deflection
- G02F1/294—Variable focal length devices
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/29—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the position or the direction of light beams, i.e. deflection
- G02F1/33—Acousto-optical deflection devices
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/29—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the position or the direction of light beams, i.e. deflection
- G02F1/33—Acousto-optical deflection devices
- G02F1/335—Acousto-optical deflection devices having an optical waveguide structure
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/02—Details of features involved during the holographic process; Replication of holograms without interference recording
- G03H1/024—Hologram nature or properties
- G03H1/0248—Volume holograms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/163—Wearable computers, e.g. on a belt
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4038—Scaling the whole image or part thereof for image mosaicing, i.e. plane images composed of plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
- G09G3/002—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/3406—Control of illumination source
- G09G3/3413—Details of control of colour illumination sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B27/0103—Head-up displays characterised by optical features comprising holographic elements
- G02B2027/0105—Holograms with particular structures
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
- G02B2027/0174—Head mounted characterised by optical features holographic
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
- G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2310/00—Command of the display device
- G09G2310/02—Addressing, scanning or driving the display screen or processing steps related thereto
- G09G2310/0235—Field-sequential colour display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
Definitions
- the present disclosure relates to tunable optical devices, and in particular to lightguides usable in visual displays, as well as components, modules, and methods for lightguides and visual displays.
- Visual displays provide information to viewer(s) including still images, video, data, etc. Visual displays have applications in diverse fields including entertainment, education, engineering, science, professional training, advertising, to name just a few examples. Some visual displays such as TV sets display images to several users, and some visual display systems such s near-eye displays (NEDs) are intended for individual users.
- NEDs near-eye displays
- An artificial reality system generally includes an NED (e.g., a headset or a pair of glasses) configured to present content to a user.
- the near-eye display may display virtual objects or combine images of real objects with virtual objects, as in virtual reality (VR), augmented reality (AR), or mixed reality (MR) applications.
- VR virtual reality
- AR augmented reality
- MR mixed reality
- a user may view images of virtual objects (e.g., computer-generated images (CGIs)) superimposed with the surrounding environment by seeing through a “combiner” component.
- the combiner component including its light routing optics may be transparent to external light.
- Head-mounted display devices can benefit from a compact and energy-efficient configuration, including efficient light sources and illuminators providing illumination of a display panel, high-throughput combiner components and ocular lenses, and other optical elements in the image forming train that can provide an image to a user’s eye with minimal image distortions and artifacts.
- FIG. 1 is a schematic side view of a pupil-replicating lightguide with switchable out-coupling efficiency distribution
- FIG. 2 is a schematic side view of an embodiment of an out-coupling grating structure of the pupil-replicating lightguide of FIG. 1 , the out-coupling grating structure having a plurality of switchable diffraction gratings;
- FIG. 3 is a schematic side view of a near-eye display including a pupil-replicating lightguide of FIG. 1 ;
- FIG. 4 is a flow chart of a method for displaying an image
- FIG. 5 is side cross-sectional views of a tunable liquid crystal (LC) surface-relief grating usable in a pupil-replicating lightguide of this disclosure;
- LC liquid crystal
- FIG. 6 A is a side cross-sectional view of a polarization volumetric grating (PVH) usable in a pupil-replicating lightguide of this disclosure;
- PVH polarization volumetric grating
- FIG. 6 B is a diagram illustrating optical performance of the PVH of FIG. 6 A ;
- FIG. 7 A is a side cross-sectional view of a fluidic grating usable in a pupil-replicating lightguide of this disclosure, in an OFF state;
- FIG. 7 B is a side cross-sectional view of the fluidic grating of FIG. 7 A in an ON state
- FIG. 8 is a side cross-sectional view of a pair of wavelength-selective Bragg gratings usable in a pupil-replicating lightguide of this disclosure
- FIG. 9 is a plan view of a near-eye display of this disclosure having a form factor of a pair of eyeglasses.
- FIG. 10 is a three-dimensional view of a head-mounted display (HMD) of this disclosure.
- HMD head-mounted display
- Near-eye displays may use pupil-replicating lightguides to carry images to user’s eyes.
- Pupil-replicating lightguides have an advantage of not requiring ocular lenses for viewing the image.
- Pupil-replicating lightguides can transmit the outside light without refocusing or redirection, allowing their use as combiner elements in augmented reality (AR) display systems.
- AR augmented reality
- Pupil-replicating lightguides may have a drawback of low optical throughput, in part due to having to spread the input image light beam over a large area of an eyebox of the display. Since a user’s eye, more precisely user’s eye pupil, occupies only a small portion of a total eyebox area, most of the light out-coupled by a pupil-replicating lightguide is lost. Most of the broadly spread light does not enter the eye pupil, instead illuminating outer areas of the user’s eyes and user’s face. Another source of optical throughput loss is related to having to optimize the out-coupling grating of the pupil-replicating lightguide to operate in a uniform manner over the entire eyebox.
- Such parameters as grating strength, grating fringes slant angles, etc. need to be optimized to account for losses of optical power as the image light propagates through the waveguides while being out-coupled, for the purpose of providing a uniform distribution of the image light over the entire eyebox area.
- the optimization of grating parameters for uniformity may result in a drop of overall optical throughput.
- an overall effective throughput of a pupil-replicating lightguide may be increased by providing an out-coupling grating structure having a switchable distribution of out-coupling efficiency.
- the switchable out-coupling efficiency may be provided by a grating having structure a variable or switchable slant angle of the grating fringes.
- the slant angle of the grating fringes that out-couple the image light may be varied to direct more light energy towards a particular location of the eye pupil.
- the current eye pupil location may be determined by an eye tracking system.
- a switchable out-coupling grating structure may include a plurality of diffraction gratings having different local slant angles of grating fringes.
- the diffraction gratings of the grating structure may be made switchable between a high-efficiency state where a percentage of the image light out-coupled from the slab is above a first threshold, and a low-efficiency state where a percentage of the image light out-coupled from the slab is below a second threshold lower than the first threshold, e.g. 10 times or even 100 times lower.
- the gratings may be physically switched ON and OFF.
- the gratings may have a wavelength-selective refractive index contrast, and the switching may be achieved by quickly switching the illuminating wavelength causing one grating to diffract the light being guided by the pupil-replicating lightguide and another grating to be transparent to such light.
- a pupil-replicating lightguide for expanding image light.
- the pupil-replicating lightguide includes a slab of transparent material for guiding the image light in the slab by a series of internal reflections from opposed surfaces of the slab, and an out-coupling grating structure supported by the slab for out-coupling portions of the image light from the slab. The portions are laterally offset from one another along a path of the image light in the slab.
- the out-coupling grating structure has a switchable distribution of out-coupling efficiency.
- the out-coupling grating structure may include a plurality of diffraction gratings having different local slant angles of grating fringes.
- the diffraction gratings are switchable between a high-efficiency state, in which a percentage of the image light out-coupled from the slab is above a first threshold, and a low-efficiency state, in which a percentage of the image light out-coupled from the slab is below a second threshold lower than the first threshold.
- the second threshold may be e.g. at least 10 times, or at least 100 lower than the first threshold.
- the plurality of switchable diffraction gratings may include switchable gratings with spatially varying slant angle of the grating fringes along the path of the image light.
- the switchable gratings may be disposed in a stack configuration parallel to the opposed surfaces of the slab.
- the plurality of diffraction gratings may include a polarization volume hologram (PVH) grating, a tunable liquid crystal (LC) surface-relief grating, a fluidic grating, etc.
- the out-coupling grating structure may include a grating having a wavelength-dependent refractive index contrast.
- a near-eye display comprising a projector for providing image light, and an above described pupil-replicating lightguide coupled to the projector.
- the near-eye display may further include an eye tracker for determining a position of a pupil of a user’s eye at an eyebox of the near-eye display, and a controller operably coupled to the projector, the eye tracker, and the pupil-replicating lightguide, and configured to cause the eye tracker to determine the position of the pupil, and, responsive to the determined position of the pupil, switch the angular distribution of diffraction efficiency to increase an amount of the image light illuminating the pupil at the determined position.
- the near-eye display may further include an eye tracker for determining a position of a pupil of the user’s eye at an eyebox of the near-eye display, and a controller operably coupled to the projector, the eye tracker, and the pupil-replicating lightguide, and configured to cause the eye tracker to determine the position of the pupil; and, responsive to the determined position of the pupil, switch a diffraction grating of the plurality of diffraction gratings to the high-efficiency state.
- the controller may be further configured to switch the remaining diffraction gratings of the plurality of diffraction gratings to the low-efficiency state.
- a method for displaying an image includes providing image light to a pupil-replicating lightguide comprising a slab of transparent material, guiding the image light in the slab by a series of internal reflections from opposed surfaces of a slab of transparent material, out-coupling portions of the image light from the slab by an out-coupling grating structure, wherein the portions are laterally offset from one another along a path of the image light in the slab, and switching angular distribution of out-coupling efficiency of a plurality of grating fringes of the out-coupling grating structure.
- the switching of the angular distribution of the out-coupling efficiency may include switching a plurality of diffraction gratings having different local slant angles of grating fringes, where the diffraction gratings are switched between a high-efficiency state, in which a percentage of the image light out-coupled from the slab is above a first threshold, and a low-efficiency state, in which a percentage of the image light out-coupled from the slab is below a second threshold lower than the first threshold.
- the method may further include using an eye tracker to determine a position of a pupil of a user’s eye at an eyebox of the near-eye display; and, responsive to the determined position of the pupil, switching the angular distribution of diffraction efficiency to increase an amount of the image light illuminating the pupil at the determined position.
- a pupil-replicating lightguide 100 includes a slab 102 of optically transparent material, i.e. transparent in visible wavelength range, configured for guiding image light 104 in the slab 102 by a series of internal reflections from opposed surfaces 111 , 112 of the slab 102 .
- An in-coupler 106 supported by the slab 102 may be provided to in-couple the image light 104 into the slab 102 .
- An out-coupling grating structure 108 supported by the slab 102 may out-couple portions 114 of the image light 104 from the slab 102 .
- the portions 114 of the image light 104 may be laterally offset from one another along a path 116 of the image light 104 in the slab 102 .
- the path 116 is denoted with dashed lines.
- the slab 102 is parallel to the XY plane in FIG. 1 , and the image light 104 propagates in XY plane, so that the portions 114 are offset along both X- and Y-directions in FIG. 1 .
- the pupil-replicating lightguide 100 expands the image light in XY plane. Only several possible locations of the portions 114 are shown for brevity.
- the out-coupling grating structure 108 has a switchable or tunable distribution of out-coupling efficiency, enabling the control of locations and/or distribution of angles of out-coupling the image light portions 114 with high efficiency at the account of other locations and angles where the image light portions 114 are out-coupled with a lesser efficiency.
- the distribution of the out-coupling efficiency in XY plane and/or out-coupling angle direction may be tuned or switched.
- the terms “tunable” and “switchable” are used interchangeably.
- the image light portions 114 can be out-coupled with maximum light energy converging at locations A, B, or C, as required.
- the image light portions 114 can be out-coupled with maximum light energy converging at locations D, E, or F, as needed.
- the out-coupling angles depend on the in-coupling angles and the grating pitch of the in-coupler 106 and the out-coupling gratings structure 108
- the maximum flow of energy in a particular direction or location on the out-coupling grating structure 108 depends on refractive index contrast and the local grating slant angle.
- an out-coupling grating structure 208 is an embodiment of the out-coupling grating structure 108 of the pupil-replicating lightguide 100 of FIG. 1 .
- the out-coupling grating structure 208 of FIG. 2 includes first 201 and second 202 diffraction gratings having different local slant angles of grating fringes 211 and 212 , respectively.
- the first 201 and second 202 diffraction gratings have a spatially varying slant angle of the grating fringes 211 and 212 , respectively, along Y-direction, going from more parallel to XY plane to more orthogonal to the XY plane from left to right in the non-limiting example of FIG.
- the angle between the planes of the fringes and Z axis increases in going from left to right.
- the slant angle of the grating fringes 211 and 212 may vary along the path 116 of the image light 104 in the slab 102 .
- the first 201 and second 202 diffraction gratings may be disposed in a stack configuration as shown, parallel to the opposed surfaces 111 , 112 .
- the diffraction gratings 201 and 202 of FIG. 2 are switchable between a high-efficiency or ON state, in which a percentage of the image light 104 out-coupled from the slab 102 is above a first threshold, and a low-efficiency or OFF state, in which a percentage of the image light 104 out-coupled from the slab 102 is below a second threshold lower than the first threshold.
- the second threshold may be e.g. at least ten times lower than the first threshold, or in some embodiments, at least one hundred times lower than the first threshold.
- the slant angle of the fringes of the first diffraction grating 201 is spatially varies along the Y-axis, so as to redirect, concentrate, or converge the first portion 214 at the first location 221 , providing a better illumination of the first location 221 .
- the controller 368 may be configured to switch at least one of the diffraction gratings to the ON state while, optionally, switching the remaining diffraction gratings of the stack to the OFF state.
- a near-eye display 350 includes a projector 352 coupled to the pupil-replicating lightguide 100 of FIG. 1 .
- the projector 352 of FIG. 3 includes a microdisplay panel 354 coupled to a collimator 356 e.g. a lens and/or a reflective element having optical power, for converting an image in linear domain into an image in angular domain.
- a collimator 356 e.g. a lens and/or a reflective element having optical power
- image in angular domain means an image where which different elements of an image in linear or spatial domain, i.e.
- pixels of the image displayed by the microdisplay panel 354 are represented by angles of corresponding rays of the image light 104 downstream of the collimator 356 , the rays carrying optical power levels and/or color composition corresponding to brightness and/or color values of the image pixels.
- a scanning projector may be used in place of the microdisplay-based projector 352 .
- a scanning projector may scan or raster an image in angular domain pixel by pixel, or in group of pixels.
- the pupil-replicating lightguide 100 carries the image light 304 generated by the microdisplay 354 to an eyebox 360 by delivering portions of the image light 304 to the eyebox 360 , enabling a user’s eye 362 to directly view the image.
- the image can be viewed in superposition with, or overlaid upon, a view of external environment of the user, because external light 364 can propagate through the pupil-replicating lightguide 100 without being refocused or redirected.
- the pupil-replicating lightguide 100 functions as an effective combiner element superimposing the display-generated imagery with views of surrounding real-life environment.
- the near-eye display 350 may utilize an eye tracker 366 for determining a position of a pupil of the user’s eye 362 at the eyebox 360 of the near-eye display 350 , and a controller 368 operably coupled to the projector 352 , the eye tracker 366 , and the pupil-replicating lightguide 100 .
- the controller 368 may be suitably configured, e.g. programmed via software and/or firmware, hardwired, etc., to cause the eye tracker 366 to determine the position of the eye pupil. Responsive to the determined position of the eye pupil, the controller 368 may switch the angular distribution of diffraction efficiency of the out-coupling grating structure 108 as explained above with reference to FIGS. 1 and 2 , to increase an amount of the image light 304 illuminating the pupil at the determined position.
- the controller 368 may be configured to cause the eye tracker 366 to determine the position of the pupil of the eye 362 to be a first position 321 . Responsive to the determined position of the eye pupil to be at the first location 321 , the controller 368 may switch the first diffraction grating 201 to the high-efficiency state while optionally switching the second diffraction grating 202 to the low-efficiency state.
- the controller 368 may switch the first diffraction grating 201 to the low-efficiency state while switching the second diffraction grating 202 to the high-efficiency state. This causes a second out-coupled light portion 315 of the image light 304 to be directed at the second location 322 while suppressing the first out-coupled light portion 314 and thus preserving energy.
- the out-coupled light portions may be directed to more locations at the eyebox 360 .
- a method 400 for displaying an image includes providing ( 402 ) image light to a pupil-replicating lightguide.
- the image light 304 may be provided by the projector 352 to the pupil-replicating lightguide 100 for propagation in the slab 102 .
- the image light 304 is guided ( 404 ) in the slab 102 by a series of internal reflections from opposed surfaces of the slab 102 .
- Portions of the image light 304 are out-coupled ( 406 ) from the slab 102 by an out-coupling grating structure, e.g. the out-coupling grating structure 208 of FIG. 2 .
- the portions may be laterally offset from one another along a path of the image light 304 in the slab 102 .
- Angular distribution of out-coupling efficiency of a plurality of grating fringes of the out-coupling grating structure is switched ( 408 ) to direct the image light portions to a desired location.
- the switching of the angular distribution of the out-coupling efficiency may include switching a plurality of diffraction gratings having different local slant angles of grating fringes, e.g. the first 201 and second 202 diffraction gratings of the out-coupling grating structure 208 of FIG. 2 .
- the first 201 and second 202 diffraction gratings are switched between the high-efficiency state, in which a percentage of the image light out-coupled from the slab is above a first threshold, and the low-efficiency state, in which a percentage of the image light out-coupled from the slab is below a second threshold lower than the first threshold.
- the 4 may further include using an eye tracker, e.g. the eye tracker 366 of FIG. 3 , to determine ( 410 ) a position of a pupil of the user’s eye 362 at an eyebox 360 of the near-eye display 350 . Responsive to the determined position of the pupil, the angular distribution of diffraction efficiency may be switched ( 412 ) to increase an amount of the image light illuminating the pupil at the determined position.
- an eye tracker e.g. the eye tracker 366 of FIG. 3
- Non-limiting illustrative examples of switchable diffraction gratings usable in lightguides and displays of this disclosure will now be presented.
- a tunable liquid crystal (LC) surface-relief grating 500 may be used as a switchable diffraction grating of the out-coupling grating structure 208 of FIG. 2 .
- the tunable LC surface-relief grating 500 includes a first substrate 501 supporting a first conductive layer 511 and a surface-relief grating structure 504 having a plurality of ridges 506 extending from the first substrate 501 and/or the first conductive layer 511 .
- a second substrate 502 is spaced apart from the first substrate 501 .
- the second substrate 502 supports a second conductive layer 512 .
- a cell is formed by the first 511 and second 512 conductive layers.
- the cell is filled with a LC fluid, forming an LC layer 508 .
- the LC layer 508 includes nematic LC molecules 510 , which may be oriented by an electric field across the LC layer 508 .
- the electric field may be provided by applying a voltage V to the first 511 and second 512 conductive layers.
- the surface-relief grating structure 504 may be polymer-based, e.g. it may be formed from a polymer having an isotropic refractive index n p of about 1.5, for example.
- the LC fluid has an anisotropic refractive index.
- the LC fluid For light polarization parallel to a director of the LC fluid, i.e. to the direction of orientation of the nematic LC molecules 510 , the LC fluid has an extraordinary refractive index n e , which may be higher than an ordinary refractive index n o of the LC fluid for light polarization perpendicular to the director.
- the extraordinary refractive index n e may be about 1.7
- the ordinary refractive index n o may be about 1.5, i.e. matched to the refractive index n p of the surface-relief grating structure 504 .
- the LC molecules 510 are aligned approximately parallel to the grooves of the surface-relief grating structure 504 .
- a linearly polarized light beam 521 with e-vector oriented along the grooves of the surface-relief grating structure 504 will undergo diffraction, since the surface-relief grating structure 504 will have a non-zero refractive index contrast.
- the LC molecules 510 are aligned approximately perpendicular to the grooves of the surface-relief grating structure 504 .
- a linearly polarized light beam 521 with e-vector oriented along the grooves of the surface-relief grating structure 504 will not undergo diffraction because the surface-relief grating structure 504 will appear to be index-matched and, accordingly, will have a substantially zero refractive index contrast.
- the linearly polarized light beam 521 with e-vector oriented perpendicular to the grooves of the surface-relief grating structure 504 no diffraction will occur in either case (i.e. when the voltage is applied and when it is not) because at this polarization of the linearly polarized light beam 521 , the surface-relief grating structure 504 are index-matched.
- the tunable LC surface-relief grating 500 can be switched on and off (for polarized light) by controlling the voltage across the LC layer 508 .
- Several such gratings with differing pitch / slant angle / refractive index contrast may be used to switch between several grating configurations.
- the surface-relief grating structure 504 may be formed from an anisotropic polymer with substantially the same or similar ordinary n o and extraordinary n e refractive indices as the LC fluid itself.
- the refractive index contrast is close to zero at any polarization of impinging light, and there is no diffraction.
- the refractive index contrast is non-zero for any or most polarizations of the impinging light, and accordingly there is diffraction and beam deflection.
- a polarization volume hologram (PVH) grating 600 may be used as a switchable diffraction grating of the out-coupling grating structure 208 of FIG. 2 .
- the PVH grating 600 of FIG. 6 A includes an LC layer 604 bound by opposed top 605 and bottom 606 parallel surfaces.
- the LC layer 604 may include an LC fluid containing rod-like LC molecules 607 with positive dielectric anisotropy, i.e. nematic LC molecules.
- a chiral dopant may be added to the LC fluid, causing the LC molecules in the LC fluid to self-organize into a periodic helical configuration including helical structures 608 extending between the top 605 and bottom 606 parallel surfaces of the LC layer 604 .
- Such a configuration of the LC molecules 607 termed herein a cholesteric configuration, includes a plurality of helical periods p, e.g. at least two, at least five, at least ten, at least twenty, or at least fifty helical periods p between the top 605 and bottom 606 parallel surfaces of the LC layer 604 .
- Boundary LC molecules 607 b at the top surface 605 of the LC layer 604 may be oriented at an angle to the top surface 605 .
- the boundary LC molecules 607 b may have a spatially varying azimuthal angle, e.g. linearly varying along X-axis parallel to the top surface 605 , as shown in FIG. 6 A .
- an alignment layer 612 may be provided at the top surface 605 of the LC layer 604 .
- the alignment layer 612 may be configured to provide the desired orientation pattern of the boundary LC molecules 607 b , such as the linear dependence of the azimuthal angle on the X-coordinate.
- a pattern of spatially varying polarization directions of the UV light may be selected to match a desired orientation pattern of the boundary LC molecules 607 b at the top surface 605 and/or the bottom surface 606 of the LC layer 604 .
- the boundary LC molecules 607 b are oriented along the photopolymerized chains of the alignment layer 612 , thus adopting the desired surface orientation pattern.
- Adjacent LC molecules adopt helical patterns extending from the top 605 to the bottom 606 surfaces of the LC layer 604 , as shown.
- the boundary LC molecules 607 b define relative phases of the helical structures 608 having the helical period p.
- the helical structures 608 form a volume grating comprising helical fringes 614 tilted at an angle ⁇ , as shown in FIG. 6 A .
- the steepness of the tilt angle ⁇ depends on the rate of variation of the azimuthal angle of the boundary LC molecules 607 b at the top surface 605 and p.
- the tilt angle ⁇ is determined by the surface alignment pattern of the boundary LC molecules 607 b at the alignment layer 612 .
- the volume grating has a period ⁇ x along X-axis and ⁇ y along Y-axis.
- the periodic helical structures 608 of the LC molecules 607 may be polymer-stabilized by mixing in a stabilizing polymer into the LC fluid, and curing (polymerizing) the stabilizing polymer.
- the helical nature of the fringes 614 of the volume grating makes the PVH grating 600 preferably responsive to light of polarization having one particular handedness, e.g. left- or right- circular polarization, while being substantially non-responsive to light of the opposite handedness of polarization.
- the helical fringes 614 make the PVH grating 600 polarization-selective, causing the PVH grating 600 to diffract light of only one handedness of circular polarization. This is illustrated in FIG. 6 B , which shows a light beam 620 impinging onto the PVH grating 600 .
- the light beam 620 includes a left circular polarized (LCP) beam component 621 and a right circular polarized (RCP) beam component 622 .
- the LCP beam component 621 propagates through the PVH grating 600 substantially without diffraction.
- substantially without diffraction means that, even though an insignificant portion of the beam (the LCP beam component 621 in this case) might diffract, the portion of the diffracted light energy is so small that it does not impact the intended performance of the PVH grating 600 .
- the RCP beam component 622 of the light beam 620 undergoes diffraction, producing a diffracted beam 622 ′.
- the polarization selectivity of the PVH grating 600 results from the effective refractive index of the grating being dependent on the relationship between the handedness, or chirality, of the impinging light beam and the handedness, or chirality, of the grating fringes 614 . Changing the handedness of the impinging light may be used to switch the performance of the PVH grating 600 .
- the PVH grating 600 may also be made tunable by applying voltage to the LC layer 604 , which distorts or erases the above-described helical structure. It is further noted that sensitivity of the PVH 600 to right circular polarized light in particular is only meant as an illustrative example.
- the PVH 600 may be made sensitive to left circular polarized light.
- the operation of the PVH 600 may be controlled by controlling the polarization state of the impinging light beam 620 .
- the PVH 600 may be made tunable by application of electric field across the LC layer 604 , which erases the periodic helical structures 608 .
- a fluidic grating 700 may be used as a switchable diffraction grating of the out-coupling grating structure 208 of FIG. 2 .
- the fluidic grating 700 includes first 701 and second 702 immiscible fluids separated by an inter-fluid boundary 703 .
- One of the first 701 and second 702 fluids may be a hydrophobic fluid such as oil, e.g. silicone oil, while the other fluid may be water-based.
- One of the first 701 and second 702 fluids may be a gas in some embodiments.
- the first 701 and second 702 fluids may be contained in a cell formed by first 711 and second 712 substrates supporting first 721 and second 722 electrode structures.
- the first 721 and/or second 722 electrode structures may be at least partially transparent, absorptive, and/or reflective.
- At least one of the first 721 and second 722 electrode structures may be patterned for imposing a spatially variant electric field onto the first 701 and second 702 fluids.
- the first electrode 721 is patterned, and the second electrodes 722 is not patterned, i.e. the second electrodes 722 is a backplane electrode.
- both the first 721 and second 722 electrodes are substantially transparent.
- the first 721 and second 722 electrodes may be indium tin oxide (ITO) electrodes.
- FIG. 7 A shows the fluidic grating 700 in a non-driven state when no electric field is applied across the inter-fluid boundary 703 .
- the inter-fluid boundary 703 is straight and smooth; accordingly, a light beam 705 impinging onto the fluidic grating 700 does not diffract, propagating right through as illustrated.
- FIG. 7 B shows the fluidic grating 700 in a driven state when a voltage V is applied between the first 721 and second 722 electrodes, producing a spatially variant electric field across the first 701 and second 702 fluids separated by the inter-fluid boundary 703 .
- the application of the spatially variant electric field causes the inter-fluid boundary 703 to distort as illustrated in FIG. 7 B , forming a periodic variation of effective refractive index, i.e. a surface-relief diffraction grating.
- the light beam 705 impinging onto the fluidic grating 700 will diffract, forming first 731 and second 732 diffracted sub-beams.
- the strength of the fluidic grating 700 may be varied.
- the grating period and, accordingly, the diffraction angle may be varied.
- varying the effective voltage between separate sub-electrodes or pixels of the first electrode 721 may result in a three-dimensional conformal change of the fluidic interface i.e. the inter-fluid boundary 703 inside the fluidic volume to impart a desired optical response to the fluidic grating 700 , including grating pitch, slant angle, etc.
- the applied voltage pattern may be pre-biased to compensate or offset gravity effects, i.e. gravity-caused distortions of the inter-fluid boundary 703 .
- Portions of a patterned electrode may be individually addressable.
- the patterned electrode 721 may be replaced with a continuous, non-patterned electrode coupled to a patterned dielectric layer for creating a spatially nonuniform electric field across the first 701 and second 702 fluids.
- the backplane electrode is omitted, and the voltage is applied between the segmented electrodes themselves.
- the thickness of the first 721 and second 722 electrodes may be e.g. between 10 nm and 50 nm.
- the materials of the first 721 and second 722 electrodes besides ITO may be e.g. indium zinc oxide (IZO), zinc oxide (ZO), indium oxide (IO), tin oxide (TO), indium gallium zinc oxide (IGZO), silver nanowires, carbon nanotubes, indium tin oxide (ITO), ITO/Ag/ITO trilayer film, etc.
- the first 701 and second 702 fluids may have a refractive index difference of at least 0.1, and may be as high as 0.2 and higher.
- first 701 or second 702 fluids may include polyphenylether, 1,3-bis(phenylthio)benzene, etc.
- the first 711 and/or second 712 substrates may include e.g. fused silica, quartz, sapphire, etc.
- the first 711 and/or second 712 substrates may be straight or curved, and may include vias and other electrical interconnects.
- the applied voltage may be varied in amplitude and/or duty cycle when applied at a frequency of between 100 Hz and 100 kHz.
- the applied voltage can change polarity and/or be bipolar.
- Individual first 701 and/r second 702 fluid layers may have a thickness of between 0.5-5 micrometers, more preferably between 0.5-2 micrometer.
- surfactants containing one hydrophilic end functional group and one hydrophobic end functional group may be used.
- the examples of a hydrophilic end functional group are hydroxyl, carboxyl, carbonyl, amino, phosphate, sulfhydryl.
- the hydrophilic functional groups may also be anionic groups such as sulfate, sulfonate, carboxylates, phosphates, for example.
- Non-limiting examples of a hydrophobic end functional group are aliphatic groups, aromatic groups, fluorinated groups.
- a surfactant containing aromatic end group and fluronirated end group may be used.
- phenyl silicone oil and water are selected as the fluid pair, a surfactant containing aromatic end group and hydroxyl (or amino, or ionic) end group may be used.
- a wavelength-selective grating structure 800 is a variant of the out-coupling grating structure 208 of FIG. 2 .
- the wavelength-selective grating structure 800 comprises a slab 802 of transparent material, a first volume Bragg grating (VBG) 804 , and a second VBG 805 , which may be at different pitch (spatial period) and/or different slant angle as illustrated.
- the first 804 and second 805 VBGs are wavelength-selective: the first VBG 804 diffracts light at a first wavelength while not diffracting light at a second, different wavelength, while the second VBG 805 diffracts light at the second wavelength while not diffracting light at the first wavelength.
- the two wavelengths may belong to a same color channel, and a quickly tunable or switchable laser, with a switching time of the emission wavelength on the order of microseconds, may be used to select between the first 804 and second 805 VBGs.
- the pair of VBGs 804 , 805 has a performance similar to that of a single VBG switchable in pitch and/or slant angle.
- the wavelength selectivity of the VBGs 804 , 805 may be provided e.g. by a wavelength-dependent refractive index contrast.
- the refractive index contrast is defined herein as a difference between the refractive index of the fringes and the refractive index of the slab 802 supporting the VBG fringes.
- Some switchable gratings include a material with tunable refractive index.
- a holographic polymer-dispersed liquid crystal (H-PDLC) grating may be manufactured by causing interference between two coherent laser beams in a photosensitive monomer/liquid crystal (LC) mixture contained between two substrates coated with a conductive layer. Upon irradiation, a photoinitiator contained within the mixture initiates a free-radical reaction, causing the monomer to polymerize. As the polymer network grows, the mixture phase separates into polymer-rich and liquid-crystal rich regions.
- H-PDLC holographic polymer-dispersed liquid crystal
- the refractive index modulation between the two phases causes light passing through the cell to be scattered in the case of traditional PDLC or diffracted in the case of H-PDLC.
- an electric field is applied across the cell, the index modulation is removed and light passing through the cell is unaffected. This is described in an article entitled “Electrically Switchable Bragg Gratings from Liquid Crystal/Polymer Composites” by Pogue et al., Applied Spectroscopy, v. 54 No. 1, 2000, which is incorporated herein by reference in its entirety.
- Tunable or switchable gratings with a variable grating period may be produced e.g. by using flexoelectric LC.
- flexoelectric LC For LCs with a non-zero flexoelectric coefficient difference (e1-e3) and low dielectric anisotropy, electric fields exceeding certain threshold values result in transitions from the homogeneous planar state to a spatially periodic one.
- Field-induced grating is characterized by rotation of the LC director about the alignment axis with the wavevector of the grating oriented perpendicular to the initial alignment direction. The rotation sign is defined by both the electric field vector and the sign of the (e1-e3) difference.
- the wavenumber characterizing the field-induced periodicity is increased linearly with the applied voltage starting from a threshold value of about ⁇ /d, where d is the thickness of the layer.
- Tunable gratings with a variable grating period or a slant angle may be provided e.g. by using helicoidal LC.
- Tunable gratings with helicoidal LCs have been described e.g. in an article entitled “Electrooptic Response of Chiral Nematic Liquid Crystals with Oblique Helicoidal Director” by Xiang et al. Phys. Rev. Lett. 112, 217801, 2014, which is incorporated herein by reference in its entirety.
- VBG volumetric Bragg grating
- a near-eye display (NED) 900 is one possible implementation of a display apparatus of this disclosure.
- the NED 900 includes a frame 901 supporting, for each eye: a projector 908 ; a pupil-replicating lightguide 910 for guiding the illuminating light beam inside and out-coupling portions of the illuminating light beam as disclosed herein; an eye tracker 904 for obtaining images of a user’s eye in an eyebox 912 ; and a plurality of eyebox illuminators 906 shown as black dots.
- the eyebox illuminators 906 may be supported by the pupil-replicating lightguide 910 for illuminating the eyebox 912 .
- the purpose of the eye trackers 904 is to determine position and/or orientation of both eyes of the user to enable steering the output image light to the locations of the user’s eyes as disclosed herein.
- the eyebox illuminators 906 illuminate the eyes at the corresponding eyeboxes 912 , to enable the eye trackers 904 to obtain the images of the eyes, as well as to provide reference reflections i.e. glints.
- the glints may function as reference points in the captured eye image, facilitating the eye gazing direction determination by determining position of the eye pupil images relative to the glints images.
- the light illuminating the eyeboxes 912 may be made invisible to the user. For example, infrared light may be used to illuminate the eyeboxes 912 .
- an HMD 1000 is an example of an AR/VR wearable display system which encloses the user’s face, for a greater degree of immersion into the AR/VR environment.
- the HMD 1000 may generate the entirely virtual 3D imagery.
- the HMD 1000 may include a front body 1002 and a band 1004 that can be secured around the user’s head.
- the front body 1002 is configured for placement in front of eyes of a user in a reliable and comfortable manner.
- a display system 1080 may be disposed in the front body 1002 for presenting AR/VR imagery to the user. Sides 1006 of the front body 1002 may be opaque or transparent.
- the front body 1002 includes locators 1008 and an inertial measurement unit (IMU) 1010 for tracking acceleration of the HMD 1000 , and position sensors 1012 for tracking position of the HMD 1000 .
- the IMU 1010 is an electronic device that generates data indicating a position of the HMD 1000 based on measurement signals received from one or more of position sensors 1012 , which generate one or more measurement signals in response to motion of the HMD 1000 .
- position sensors 1012 include: one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, a type of sensor used for error correction of the IMU 1010 , or some combination thereof.
- the position sensors 1012 may be located external to the IMU 1010 , internal to the IMU 1010 , or some combination thereof.
- the locators 1008 are traced by an external imaging device of a virtual reality system, such that the virtual reality system can track the location and orientation of the entire HMD 1000 .
- Information generated by the IMU 1010 and the position sensors 1012 may be compared with the position and orientation obtained by tracking the locators 1008 , for improved tracking accuracy of position and orientation of the HMD 1000 .
- Accurate position and orientation is important for presenting appropriate virtual scenery to the user as the latter moves and turns in 3D space.
- the HMD 1000 may further include a depth camera assembly (DCA) 1011 , which captures data describing depth information of a local area surrounding some or all of the HMD 1000 .
- the depth information may be compared with the information from the IMU 1010 , for better accuracy of determination of position and orientation of the HMD 1000 in 3D space.
- DCA depth camera assembly
- the HMD 1000 may further include an eye tracking system 1014 for determining orientation and position of user’s eyes in real time.
- the obtained position and orientation of the eyes also allows the HMD 1000 to determine the gaze direction of the user and to adjust the image generated by the display system 1080 accordingly.
- the determined gaze direction and vergence angle may be used to adjust the display system 1080 to reduce the vergence-accommodation conflict.
- the direction and vergence may also be used for displays’ exit pupil steering as disclosed herein.
- the determined vergence and gaze angles may be used for interaction with the user, highlighting objects, bringing objects to the foreground, creating additional objects or pointers, etc.
- An audio system may also be provided including e.g. a set of small speakers built into the front body 1002 .
- Embodiments of the present disclosure may include, or be implemented in conjunction with, an artificial reality system.
- An artificial reality system adjusts sensory information about outside world obtained through the senses such as visual information, audio, touch (somatosensation) information, acceleration, balance, etc., in some manner before presentation to a user.
- artificial reality may include virtual reality (VR), augmented reality (AR), mixed reality (MR), hybrid reality, or some combination and/or derivatives thereof.
- Artificial reality content may include entirely generated content or generated content combined with captured (e.g., real-world) content.
- the artificial reality content may include video, audio, somatic or haptic feedback, or some combination thereof.
- artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, that are used to, for example, create content in artificial reality and/or are otherwise used in (e.g., perform activities in) artificial reality.
- the artificial reality system that provides the artificial reality content may be implemented on various platforms, including a wearable display such as an HMD connected to a host computer system, a standalone HMD, a near-eye display having a form factor of eyeglasses, a mobile device or computing system, or any other hardware platform capable of providing artificial reality content to one or more viewers.
Abstract
A pupil-replicating lightguide includes a slab of transparent material for guiding image light in the slab, and an out-coupling structure supported by the slab for out-coupling portions of the image light from the slab. The portions are laterally offset from one another along a path of the image light in the slab. The out-coupling grating structure has a switchable distribution of out-coupling efficiency for redirecting the portions of out-coupled light to a desired location such as a current location of an eye of the viewer determined by an eye tracking system. The out-coupling grating structure may include a plurality of diffraction gratings having different local slant angles of grating fringes.
Description
- This application claims priority from U.S. Provisional Pat. App. No. 63/286,381 entitled “Display Applications of Switchable Gratings”, and U.S. Provisional Pat. App. No. 63/286,230 entitled “Active Fluidic Optical Element”, both filed on Dec. 6, 2021 and incorporated herein by reference in their entireties.
- The present disclosure relates to tunable optical devices, and in particular to lightguides usable in visual displays, as well as components, modules, and methods for lightguides and visual displays.
- Visual displays provide information to viewer(s) including still images, video, data, etc. Visual displays have applications in diverse fields including entertainment, education, engineering, science, professional training, advertising, to name just a few examples. Some visual displays such as TV sets display images to several users, and some visual display systems such s near-eye displays (NEDs) are intended for individual users.
- An artificial reality system generally includes an NED (e.g., a headset or a pair of glasses) configured to present content to a user. The near-eye display may display virtual objects or combine images of real objects with virtual objects, as in virtual reality (VR), augmented reality (AR), or mixed reality (MR) applications. For example, in an AR system, a user may view images of virtual objects (e.g., computer-generated images (CGIs)) superimposed with the surrounding environment by seeing through a “combiner” component. The combiner component including its light routing optics may be transparent to external light.
- An NED is usually worn on the head of a user. Consequently, a large, bulky, unbalanced, and heavy display device with a heavy battery would be cumbersome and uncomfortable for the user to wear. Head-mounted display devices can benefit from a compact and energy-efficient configuration, including efficient light sources and illuminators providing illumination of a display panel, high-throughput combiner components and ocular lenses, and other optical elements in the image forming train that can provide an image to a user’s eye with minimal image distortions and artifacts.
- Exemplary embodiments will now be described in conjunction with the drawings, in which:
-
FIG. 1 is a schematic side view of a pupil-replicating lightguide with switchable out-coupling efficiency distribution; -
FIG. 2 is a schematic side view of an embodiment of an out-coupling grating structure of the pupil-replicating lightguide ofFIG. 1 , the out-coupling grating structure having a plurality of switchable diffraction gratings; -
FIG. 3 is a schematic side view of a near-eye display including a pupil-replicating lightguide ofFIG. 1 ; -
FIG. 4 is a flow chart of a method for displaying an image; -
FIG. 5 is side cross-sectional views of a tunable liquid crystal (LC) surface-relief grating usable in a pupil-replicating lightguide of this disclosure; -
FIG. 6A is a side cross-sectional view of a polarization volumetric grating (PVH) usable in a pupil-replicating lightguide of this disclosure; -
FIG. 6B is a diagram illustrating optical performance of the PVH ofFIG. 6A ; -
FIG. 7A is a side cross-sectional view of a fluidic grating usable in a pupil-replicating lightguide of this disclosure, in an OFF state; -
FIG. 7B is a side cross-sectional view of the fluidic grating ofFIG. 7A in an ON state; -
FIG. 8 is a side cross-sectional view of a pair of wavelength-selective Bragg gratings usable in a pupil-replicating lightguide of this disclosure; -
FIG. 9 is a plan view of a near-eye display of this disclosure having a form factor of a pair of eyeglasses; and -
FIG. 10 is a three-dimensional view of a head-mounted display (HMD) of this disclosure. - While the present teachings are described in conjunction with various embodiments and examples, it is not intended that the present teachings be limited to such embodiments. On the contrary, the present teachings encompass various alternatives and equivalents, as will be appreciated by those of skill in the art. All statements herein reciting principles, aspects, and embodiments of this disclosure, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure.
- As used herein, the terms “first”, “second”, and so forth are not intended to imply sequential ordering, but rather are intended to distinguish one element from another, unless explicitly stated. Similarly, sequential ordering of method steps does not imply a sequential order of their execution, unless explicitly stated.
- Near-eye displays may use pupil-replicating lightguides to carry images to user’s eyes. Pupil-replicating lightguides have an advantage of not requiring ocular lenses for viewing the image. Pupil-replicating lightguides can transmit the outside light without refocusing or redirection, allowing their use as combiner elements in augmented reality (AR) display systems.
- Pupil-replicating lightguides may have a drawback of low optical throughput, in part due to having to spread the input image light beam over a large area of an eyebox of the display. Since a user’s eye, more precisely user’s eye pupil, occupies only a small portion of a total eyebox area, most of the light out-coupled by a pupil-replicating lightguide is lost. Most of the broadly spread light does not enter the eye pupil, instead illuminating outer areas of the user’s eyes and user’s face. Another source of optical throughput loss is related to having to optimize the out-coupling grating of the pupil-replicating lightguide to operate in a uniform manner over the entire eyebox. Such parameters as grating strength, grating fringes slant angles, etc., need to be optimized to account for losses of optical power as the image light propagates through the waveguides while being out-coupled, for the purpose of providing a uniform distribution of the image light over the entire eyebox area. The optimization of grating parameters for uniformity may result in a drop of overall optical throughput.
- In accordance with this disclosure, an overall effective throughput of a pupil-replicating lightguide may be increased by providing an out-coupling grating structure having a switchable distribution of out-coupling efficiency. The switchable out-coupling efficiency may be provided by a grating having structure a variable or switchable slant angle of the grating fringes. The slant angle of the grating fringes that out-couple the image light may be varied to direct more light energy towards a particular location of the eye pupil. The current eye pupil location may be determined by an eye tracking system.
- In some embodiments, a switchable out-coupling grating structure may include a plurality of diffraction gratings having different local slant angles of grating fringes. The diffraction gratings of the grating structure may be made switchable between a high-efficiency state where a percentage of the image light out-coupled from the slab is above a first threshold, and a low-efficiency state where a percentage of the image light out-coupled from the slab is below a second threshold lower than the first threshold, e.g. 10 times or even 100 times lower.
- The gratings may be physically switched ON and OFF. In some embodiments, the gratings may have a wavelength-selective refractive index contrast, and the switching may be achieved by quickly switching the illuminating wavelength causing one grating to diffract the light being guided by the pupil-replicating lightguide and another grating to be transparent to such light.
- In accordance with the present disclosure, there is provided a pupil-replicating lightguide for expanding image light. The pupil-replicating lightguide includes a slab of transparent material for guiding the image light in the slab by a series of internal reflections from opposed surfaces of the slab, and an out-coupling grating structure supported by the slab for out-coupling portions of the image light from the slab. The portions are laterally offset from one another along a path of the image light in the slab. The out-coupling grating structure has a switchable distribution of out-coupling efficiency.
- The out-coupling grating structure may include a plurality of diffraction gratings having different local slant angles of grating fringes. The diffraction gratings are switchable between a high-efficiency state, in which a percentage of the image light out-coupled from the slab is above a first threshold, and a low-efficiency state, in which a percentage of the image light out-coupled from the slab is below a second threshold lower than the first threshold. The second threshold may be e.g. at least 10 times, or at least 100 lower than the first threshold. The plurality of switchable diffraction gratings may include switchable gratings with spatially varying slant angle of the grating fringes along the path of the image light. The switchable gratings may be disposed in a stack configuration parallel to the opposed surfaces of the slab. The plurality of diffraction gratings may include a polarization volume hologram (PVH) grating, a tunable liquid crystal (LC) surface-relief grating, a fluidic grating, etc. The out-coupling grating structure may include a grating having a wavelength-dependent refractive index contrast.
- In accordance with the present disclosure, there is provided a near-eye display comprising a projector for providing image light, and an above described pupil-replicating lightguide coupled to the projector. The near-eye display may further include an eye tracker for determining a position of a pupil of a user’s eye at an eyebox of the near-eye display, and a controller operably coupled to the projector, the eye tracker, and the pupil-replicating lightguide, and configured to cause the eye tracker to determine the position of the pupil, and, responsive to the determined position of the pupil, switch the angular distribution of diffraction efficiency to increase an amount of the image light illuminating the pupil at the determined position.
- In some embodiments, the near-eye display may further include an eye tracker for determining a position of a pupil of the user’s eye at an eyebox of the near-eye display, and a controller operably coupled to the projector, the eye tracker, and the pupil-replicating lightguide, and configured to cause the eye tracker to determine the position of the pupil; and, responsive to the determined position of the pupil, switch a diffraction grating of the plurality of diffraction gratings to the high-efficiency state. The controller may be further configured to switch the remaining diffraction gratings of the plurality of diffraction gratings to the low-efficiency state.
- In accordance with the present disclosure, there is further provided a method for displaying an image. The method includes providing image light to a pupil-replicating lightguide comprising a slab of transparent material, guiding the image light in the slab by a series of internal reflections from opposed surfaces of a slab of transparent material, out-coupling portions of the image light from the slab by an out-coupling grating structure, wherein the portions are laterally offset from one another along a path of the image light in the slab, and switching angular distribution of out-coupling efficiency of a plurality of grating fringes of the out-coupling grating structure. The switching of the angular distribution of the out-coupling efficiency may include switching a plurality of diffraction gratings having different local slant angles of grating fringes, where the diffraction gratings are switched between a high-efficiency state, in which a percentage of the image light out-coupled from the slab is above a first threshold, and a low-efficiency state, in which a percentage of the image light out-coupled from the slab is below a second threshold lower than the first threshold. The method may further include using an eye tracker to determine a position of a pupil of a user’s eye at an eyebox of the near-eye display; and, responsive to the determined position of the pupil, switching the angular distribution of diffraction efficiency to increase an amount of the image light illuminating the pupil at the determined position.
- Referring now to
FIG. 1 , a pupil-replicatinglightguide 100 includes aslab 102 of optically transparent material, i.e. transparent in visible wavelength range, configured for guiding image light 104 in theslab 102 by a series of internal reflections fromopposed surfaces slab 102. An in-coupler 106 supported by theslab 102 may be provided to in-couple theimage light 104 into theslab 102. An out-couplinggrating structure 108 supported by theslab 102 may out-couple portions 114 of the image light 104 from theslab 102. The portions 114 of theimage light 104 may be laterally offset from one another along apath 116 of theimage light 104 in theslab 102. Thepath 116 is denoted with dashed lines. Theslab 102 is parallel to the XY plane inFIG. 1 , and theimage light 104 propagates in XY plane, so that the portions 114 are offset along both X- and Y-directions inFIG. 1 . The pupil-replicatinglightguide 100 expands the image light in XY plane. Only several possible locations of the portions 114 are shown for brevity. - The out-coupling
grating structure 108 has a switchable or tunable distribution of out-coupling efficiency, enabling the control of locations and/or distribution of angles of out-coupling the image light portions 114 with high efficiency at the account of other locations and angles where the image light portions 114 are out-coupled with a lesser efficiency. In other words, the distribution of the out-coupling efficiency in XY plane and/or out-coupling angle direction may be tuned or switched. Herein and throughout the rest of the specification, the terms “tunable” and “switchable” are used interchangeably. - For example, at a
first location 121, the image light portions 114 can be out-coupled with maximum light energy converging at locations A, B, or C, as required. At asecond location 122, the image light portions 114 can be out-coupled with maximum light energy converging at locations D, E, or F, as needed. It is further noted that, while the out-coupling angles depend on the in-coupling angles and the grating pitch of the in-coupler 106 and the out-coupling gratings structure 108, the maximum flow of energy in a particular direction or location on the out-couplinggrating structure 108 depends on refractive index contrast and the local grating slant angle. - Referring to
FIG. 2 , an out-couplinggrating structure 208 is an embodiment of the out-couplinggrating structure 108 of the pupil-replicatinglightguide 100 ofFIG. 1 . The out-couplinggrating structure 208 ofFIG. 2 includes first 201 and second 202 diffraction gratings having different local slant angles of gratingfringes grating fringes FIG. 2 . In other words, the angle between the planes of the fringes and Z axis increases in going from left to right. The slant angle of thegrating fringes path 116 of theimage light 104 in theslab 102. The first 201 and second 202 diffraction gratings may be disposed in a stack configuration as shown, parallel to theopposed surfaces - The
diffraction gratings FIG. 2 are switchable between a high-efficiency or ON state, in which a percentage of theimage light 104 out-coupled from theslab 102 is above a first threshold, and a low-efficiency or OFF state, in which a percentage of theimage light 104 out-coupled from theslab 102 is below a second threshold lower than the first threshold. The second threshold may be e.g. at least ten times lower than the first threshold, or in some embodiments, at least one hundred times lower than the first threshold. When thefirst diffraction grating 201 is in the ON state while thesecond diffraction grating 202 is in the OFF state, a major portion of theimage light 104 propagating along thepath 116 is out-coupled as afirst portion 214 at afirst location 221. The slant angle of the fringes of thefirst diffraction grating 201 is spatially varies along the Y-axis, so as to redirect, concentrate, or converge thefirst portion 214 at thefirst location 221, providing a better illumination of thefirst location 221. When thefirst diffraction grating 201 is in the OFF state while thesecond diffraction grating 202 is in the ON state, a major portion of theimage light 104 propagating along thepath 116 is out-coupled as asecond portion 215 converging at asecond location 222. The slant angle variation of thefringes switchable diffraction gratings grating structure 208, and may be disposed in a stack configuration. Thecontroller 368 may be configured to switch at least one of the diffraction gratings to the ON state while, optionally, switching the remaining diffraction gratings of the stack to the OFF state. - Turning to
FIG. 3 with further reference toFIGS. 1 and 2 , a near-eye display 350 includes aprojector 352 coupled to the pupil-replicatinglightguide 100 ofFIG. 1 . Theprojector 352 ofFIG. 3 includes amicrodisplay panel 354 coupled to acollimator 356 e.g. a lens and/or a reflective element having optical power, for converting an image in linear domain into an image in angular domain. Herein, the term “image in angular domain” means an image where which different elements of an image in linear or spatial domain, i.e. pixels of the image displayed by themicrodisplay panel 354, are represented by angles of corresponding rays of theimage light 104 downstream of thecollimator 356, the rays carrying optical power levels and/or color composition corresponding to brightness and/or color values of the image pixels. A scanning projector may be used in place of the microdisplay-basedprojector 352. A scanning projector may scan or raster an image in angular domain pixel by pixel, or in group of pixels. - The pupil-replicating
lightguide 100 carries theimage light 304 generated by themicrodisplay 354 to aneyebox 360 by delivering portions of theimage light 304 to theeyebox 360, enabling a user’seye 362 to directly view the image. The image can be viewed in superposition with, or overlaid upon, a view of external environment of the user, becauseexternal light 364 can propagate through the pupil-replicatinglightguide 100 without being refocused or redirected. Thus, the pupil-replicatinglightguide 100 functions as an effective combiner element superimposing the display-generated imagery with views of surrounding real-life environment. - The near-
eye display 350 may utilize aneye tracker 366 for determining a position of a pupil of the user’seye 362 at theeyebox 360 of the near-eye display 350, and acontroller 368 operably coupled to theprojector 352, theeye tracker 366, and the pupil-replicatinglightguide 100. Thecontroller 368 may be suitably configured, e.g. programmed via software and/or firmware, hardwired, etc., to cause theeye tracker 366 to determine the position of the eye pupil. Responsive to the determined position of the eye pupil, thecontroller 368 may switch the angular distribution of diffraction efficiency of the out-couplinggrating structure 108 as explained above with reference toFIGS. 1 and 2 , to increase an amount of theimage light 304 illuminating the pupil at the determined position. - For example, in embodiments where the pupil-replicating
lightguide 100 ofFIGS. 1 and 3 includes the out-couplinggrating structure 208 ofFIG. 2 having the first 201 and second 202 switchable diffraction gratings, thecontroller 368 may be configured to cause theeye tracker 366 to determine the position of the pupil of theeye 362 to be afirst position 321. Responsive to the determined position of the eye pupil to be at thefirst location 321, thecontroller 368 may switch thefirst diffraction grating 201 to the high-efficiency state while optionally switching thesecond diffraction grating 202 to the low-efficiency state. This causes a first out-coupledlight portion 314 of theimage light 304 to be directed at thefirst location 321. When theeye tracker 366 determines that theeye 362 is at asecond position 322, thecontroller 368 may switch thefirst diffraction grating 201 to the low-efficiency state while switching thesecond diffraction grating 202 to the high-efficiency state. This causes a second out-coupledlight portion 315 of theimage light 304 to be directed at thesecond location 322 while suppressing the first out-coupledlight portion 314 and thus preserving energy. When more than two switchable diffraction gratings are provided in the out-couplinggrating structure 208, the out-coupled light portions may be directed to more locations at theeyebox 360. - Referring now to
FIG. 4 with further reference toFIGS. 2 and 3 , amethod 400 for displaying an image includes providing (402) image light to a pupil-replicating lightguide. For example, theimage light 304 may be provided by theprojector 352 to the pupil-replicatinglightguide 100 for propagation in theslab 102. Theimage light 304 is guided (404) in theslab 102 by a series of internal reflections from opposed surfaces of theslab 102. Portions of theimage light 304 are out-coupled (406) from theslab 102 by an out-coupling grating structure, e.g. the out-couplinggrating structure 208 ofFIG. 2 . The portions may be laterally offset from one another along a path of theimage light 304 in theslab 102. Angular distribution of out-coupling efficiency of a plurality of grating fringes of the out-coupling grating structure is switched (408) to direct the image light portions to a desired location. - As explained above with reference to
FIGS. 2 and 3 , the switching of the angular distribution of the out-coupling efficiency may include switching a plurality of diffraction gratings having different local slant angles of grating fringes, e.g. the first 201 and second 202 diffraction gratings of the out-couplinggrating structure 208 ofFIG. 2 . The first 201 and second 202 diffraction gratings are switched between the high-efficiency state, in which a percentage of the image light out-coupled from the slab is above a first threshold, and the low-efficiency state, in which a percentage of the image light out-coupled from the slab is below a second threshold lower than the first threshold. Themethod 400 ofFIG. 4 may further include using an eye tracker, e.g. theeye tracker 366 ofFIG. 3 , to determine (410) a position of a pupil of the user’seye 362 at aneyebox 360 of the near-eye display 350. Responsive to the determined position of the pupil, the angular distribution of diffraction efficiency may be switched (412) to increase an amount of the image light illuminating the pupil at the determined position. - Non-limiting illustrative examples of switchable diffraction gratings usable in lightguides and displays of this disclosure will now be presented.
- Referring first to
FIG. 5 , a tunable liquid crystal (LC) surface-relief grating 500 may be used as a switchable diffraction grating of the out-couplinggrating structure 208 ofFIG. 2 . The tunable LC surface-relief grating 500 includes afirst substrate 501 supporting a firstconductive layer 511 and a surface-reliefgrating structure 504 having a plurality ofridges 506 extending from thefirst substrate 501 and/or the firstconductive layer 511. - A
second substrate 502 is spaced apart from thefirst substrate 501. Thesecond substrate 502 supports a secondconductive layer 512. A cell is formed by the first 511 and second 512 conductive layers. The cell is filled with a LC fluid, forming anLC layer 508. TheLC layer 508 includesnematic LC molecules 510, which may be oriented by an electric field across theLC layer 508. The electric field may be provided by applying a voltage V to the first 511 and second 512 conductive layers. - The surface-relief
grating structure 504 may be polymer-based, e.g. it may be formed from a polymer having an isotropic refractive index np of about 1.5, for example. The LC fluid has an anisotropic refractive index. For light polarization parallel to a director of the LC fluid, i.e. to the direction of orientation of thenematic LC molecules 510, the LC fluid has an extraordinary refractive index ne, which may be higher than an ordinary refractive index no of the LC fluid for light polarization perpendicular to the director. For example, the extraordinary refractive index ne may be about 1.7, and the ordinary refractive index no may be about 1.5, i.e. matched to the refractive index np of the surface-reliefgrating structure 504. - When the voltage V is not applied (left side of
FIG. 5 ), theLC molecules 510 are aligned approximately parallel to the grooves of the surface-reliefgrating structure 504. At this configuration, a linearlypolarized light beam 521 with e-vector oriented along the grooves of the surface-reliefgrating structure 504 will undergo diffraction, since the surface-reliefgrating structure 504 will have a non-zero refractive index contrast. When the voltage V is applied (right side ofFIG. 5 ), theLC molecules 510 are aligned approximately perpendicular to the grooves of the surface-reliefgrating structure 504. At this configuration, a linearlypolarized light beam 521 with e-vector oriented along the grooves of the surface-reliefgrating structure 504 will not undergo diffraction because the surface-reliefgrating structure 504 will appear to be index-matched and, accordingly, will have a substantially zero refractive index contrast. For the linearlypolarized light beam 521 with e-vector oriented perpendicular to the grooves of the surface-reliefgrating structure 504, no diffraction will occur in either case (i.e. when the voltage is applied and when it is not) because at this polarization of the linearlypolarized light beam 521, the surface-reliefgrating structure 504 are index-matched. Thus, the tunable LC surface-relief grating 500 can be switched on and off (for polarized light) by controlling the voltage across theLC layer 508. Several such gratings with differing pitch / slant angle / refractive index contrast may be used to switch between several grating configurations. - In some embodiments of the LC surface-
relief grating 500, the surface-reliefgrating structure 504 may be formed from an anisotropic polymer with substantially the same or similar ordinary no and extraordinary ne refractive indices as the LC fluid itself. When the LC director aligns with the optic axis of the birefringent polymer, the refractive index contrast is close to zero at any polarization of impinging light, and there is no diffraction. When the LC director is misaligned with the optic axis of the birefringent polymer e.g. due to application of an external electric field, the refractive index contrast is non-zero for any or most polarizations of the impinging light, and accordingly there is diffraction and beam deflection. - Turning to
FIG. 6A , a polarization volume hologram (PVH) grating 600 may be used as a switchable diffraction grating of the out-couplinggrating structure 208 ofFIG. 2 . The PVH grating 600 ofFIG. 6A includes anLC layer 604 bound by opposed top 605 and bottom 606 parallel surfaces. TheLC layer 604 may include an LC fluid containing rod-like LC molecules 607 with positive dielectric anisotropy, i.e. nematic LC molecules. A chiral dopant may be added to the LC fluid, causing the LC molecules in the LC fluid to self-organize into a periodic helical configuration including helical structures 608 extending between the top 605 and bottom 606 parallel surfaces of theLC layer 604. Such a configuration of theLC molecules 607, termed herein a cholesteric configuration, includes a plurality of helical periods p, e.g. at least two, at least five, at least ten, at least twenty, or at least fifty helical periods p between the top 605 and bottom 606 parallel surfaces of theLC layer 604. -
Boundary LC molecules 607 b at thetop surface 605 of theLC layer 604 may be oriented at an angle to thetop surface 605. Theboundary LC molecules 607 b may have a spatially varying azimuthal angle, e.g. linearly varying along X-axis parallel to thetop surface 605, as shown inFIG. 6A . To that end, analignment layer 612 may be provided at thetop surface 605 of theLC layer 604. Thealignment layer 612 may be configured to provide the desired orientation pattern of theboundary LC molecules 607 b, such as the linear dependence of the azimuthal angle on the X-coordinate. A pattern of spatially varying polarization directions of the UV light may be selected to match a desired orientation pattern of theboundary LC molecules 607 b at thetop surface 605 and/or thebottom surface 606 of theLC layer 604. When thealignment layer 612 is coated with the cholesteric LC fluid, theboundary LC molecules 607 b are oriented along the photopolymerized chains of thealignment layer 612, thus adopting the desired surface orientation pattern. Adjacent LC molecules adopt helical patterns extending from the top 605 to the bottom 606 surfaces of theLC layer 604, as shown. - The
boundary LC molecules 607 b define relative phases of the helical structures 608 having the helical period p. The helical structures 608 form a volume grating comprisinghelical fringes 614 tilted at an angle ϕ, as shown inFIG. 6A . The steepness of the tilt angle ϕ depends on the rate of variation of the azimuthal angle of theboundary LC molecules 607 b at thetop surface 605 and p. Thus, the tilt angle ϕ is determined by the surface alignment pattern of theboundary LC molecules 607 b at thealignment layer 612. The volume grating has a period Λx along X-axis and Λy along Y-axis. In some embodiments, the periodic helical structures 608 of theLC molecules 607 may be polymer-stabilized by mixing in a stabilizing polymer into the LC fluid, and curing (polymerizing) the stabilizing polymer. - The helical nature of the
fringes 614 of the volume grating makes the PVH grating 600 preferably responsive to light of polarization having one particular handedness, e.g. left- or right- circular polarization, while being substantially non-responsive to light of the opposite handedness of polarization. Thus, thehelical fringes 614 make the PVH grating 600 polarization-selective, causing the PVH grating 600 to diffract light of only one handedness of circular polarization. This is illustrated inFIG. 6B , which shows alight beam 620 impinging onto the PVH grating 600. Thelight beam 620 includes a left circular polarized (LCP)beam component 621 and a right circular polarized (RCP)beam component 622. TheLCP beam component 621 propagates through the PVH grating 600 substantially without diffraction. Herein, the term “substantially without diffraction” means that, even though an insignificant portion of the beam (theLCP beam component 621 in this case) might diffract, the portion of the diffracted light energy is so small that it does not impact the intended performance of the PVH grating 600. TheRCP beam component 622 of thelight beam 620 undergoes diffraction, producing a diffractedbeam 622′. The polarization selectivity of the PVH grating 600 results from the effective refractive index of the grating being dependent on the relationship between the handedness, or chirality, of the impinging light beam and the handedness, or chirality, of thegrating fringes 614. Changing the handedness of the impinging light may be used to switch the performance of the PVH grating 600. The PVH grating 600 may also be made tunable by applying voltage to theLC layer 604, which distorts or erases the above-described helical structure. It is further noted that sensitivity of thePVH 600 to right circular polarized light in particular is only meant as an illustrative example. When the handedness of thehelical fringes 614 is reversed, thePVH 600 may be made sensitive to left circular polarized light. Thus, the operation of thePVH 600 may be controlled by controlling the polarization state of the impinginglight beam 620. ThePVH 600 may be made tunable by application of electric field across theLC layer 604, which erases the periodic helical structures 608. - Referring now to
FIGS. 7A and 7B , afluidic grating 700 may be used as a switchable diffraction grating of the out-couplinggrating structure 208 ofFIG. 2 . Thefluidic grating 700 includes first 701 and second 702 immiscible fluids separated by aninter-fluid boundary 703. One of the first 701 and second 702 fluids may be a hydrophobic fluid such as oil, e.g. silicone oil, while the other fluid may be water-based. One of the first 701 and second 702 fluids may be a gas in some embodiments. The first 701 and second 702 fluids may be contained in a cell formed by first 711 and second 712 substrates supporting first 721 and second 722 electrode structures. The first 721 and/or second 722 electrode structures may be at least partially transparent, absorptive, and/or reflective. - At least one of the first 721 and second 722 electrode structures may be patterned for imposing a spatially variant electric field onto the first 701 and second 702 fluids. For example, in
FIGS. 7A and 7B , thefirst electrode 721 is patterned, and thesecond electrodes 722 is not patterned, i.e. thesecond electrodes 722 is a backplane electrode. In the embodiment shown, both the first 721 and second 722 electrodes are substantially transparent. For example, the first 721 and second 722 electrodes may be indium tin oxide (ITO) electrodes. -
FIG. 7A shows thefluidic grating 700 in a non-driven state when no electric field is applied across theinter-fluid boundary 703. When no electric field is present, theinter-fluid boundary 703 is straight and smooth; accordingly, alight beam 705 impinging onto thefluidic grating 700 does not diffract, propagating right through as illustrated.FIG. 7B shows thefluidic grating 700 in a driven state when a voltage V is applied between the first 721 and second 722 electrodes, producing a spatially variant electric field across the first 701 and second 702 fluids separated by theinter-fluid boundary 703. - The application of the spatially variant electric field causes the
inter-fluid boundary 703 to distort as illustrated inFIG. 7B , forming a periodic variation of effective refractive index, i.e. a surface-relief diffraction grating. Thelight beam 705 impinging onto thefluidic grating 700 will diffract, forming first 731 and second 732 diffracted sub-beams. By varying the amplitude of the applied voltage V, the strength of thefluidic grating 700 may be varied. By applying different patterns of the electric field e.g. with individually addressable sub-electrodes or pixels of thefirst electrode 721, the grating period and, accordingly, the diffraction angle, may be varied. More generally, varying the effective voltage between separate sub-electrodes or pixels of thefirst electrode 721 may result in a three-dimensional conformal change of the fluidic interface i.e. theinter-fluid boundary 703 inside the fluidic volume to impart a desired optical response to thefluidic grating 700, including grating pitch, slant angle, etc. The applied voltage pattern may be pre-biased to compensate or offset gravity effects, i.e. gravity-caused distortions of theinter-fluid boundary 703. - Portions of a patterned electrode may be individually addressable. In some embodiments, the patterned
electrode 721 may be replaced with a continuous, non-patterned electrode coupled to a patterned dielectric layer for creating a spatially nonuniform electric field across the first 701 and second 702 fluids. Also in some embodiments, the backplane electrode is omitted, and the voltage is applied between the segmented electrodes themselves. - The thickness of the first 721 and second 722 electrodes may be e.g. between 10 nm and 50 nm. The materials of the first 721 and second 722 electrodes besides ITO may be e.g. indium zinc oxide (IZO), zinc oxide (ZO), indium oxide (IO), tin oxide (TO), indium gallium zinc oxide (IGZO), silver nanowires, carbon nanotubes, indium tin oxide (ITO), ITO/Ag/ITO trilayer film, etc. The first 701 and second 702 fluids may have a refractive index difference of at least 0.1, and may be as high as 0.2 and higher. One of the first 701 or second 702 fluids may include polyphenylether, 1,3-bis(phenylthio)benzene, etc. The first 711 and/or second 712 substrates may include e.g. fused silica, quartz, sapphire, etc. The first 711 and/or second 712 substrates may be straight or curved, and may include vias and other electrical interconnects. The applied voltage may be varied in amplitude and/or duty cycle when applied at a frequency of between 100 Hz and 100 kHz. The applied voltage can change polarity and/or be bipolar. Individual first 701 and/r second 702 fluid layers may have a thickness of between 0.5-5 micrometers, more preferably between 0.5-2 micrometer.
- To separate the first 701 and second 702 fluids, surfactants containing one hydrophilic end functional group and one hydrophobic end functional group may be used. The examples of a hydrophilic end functional group are hydroxyl, carboxyl, carbonyl, amino, phosphate, sulfhydryl. The hydrophilic functional groups may also be anionic groups such as sulfate, sulfonate, carboxylates, phosphates, for example. Non-limiting examples of a hydrophobic end functional group are aliphatic groups, aromatic groups, fluorinated groups. For example, when polyphenyl thioether and fluorinated fluid may be selected as a fluid pair, a surfactant containing aromatic end group and fluronirated end group may be used. When phenyl silicone oil and water are selected as the fluid pair, a surfactant containing aromatic end group and hydroxyl (or amino, or ionic) end group may be used. These are only non-limiting examples.
- Referring to
FIG. 8 , a wavelength-selectivegrating structure 800 is a variant of the out-couplinggrating structure 208 ofFIG. 2 . The wavelength-selectivegrating structure 800 comprises aslab 802 of transparent material, a first volume Bragg grating (VBG) 804, and asecond VBG 805, which may be at different pitch (spatial period) and/or different slant angle as illustrated. The first 804 and second 805 VBGs are wavelength-selective: thefirst VBG 804 diffracts light at a first wavelength while not diffracting light at a second, different wavelength, while thesecond VBG 805 diffracts light at the second wavelength while not diffracting light at the first wavelength. The two wavelengths may belong to a same color channel, and a quickly tunable or switchable laser, with a switching time of the emission wavelength on the order of microseconds, may be used to select between the first 804 and second 805 VBGs. The pair ofVBGs VBGs slab 802 supporting the VBG fringes. - Some switchable gratings include a material with tunable refractive index. By way of a non-limiting example, a holographic polymer-dispersed liquid crystal (H-PDLC) grating may be manufactured by causing interference between two coherent laser beams in a photosensitive monomer/liquid crystal (LC) mixture contained between two substrates coated with a conductive layer. Upon irradiation, a photoinitiator contained within the mixture initiates a free-radical reaction, causing the monomer to polymerize. As the polymer network grows, the mixture phase separates into polymer-rich and liquid-crystal rich regions. The refractive index modulation between the two phases causes light passing through the cell to be scattered in the case of traditional PDLC or diffracted in the case of H-PDLC. When an electric field is applied across the cell, the index modulation is removed and light passing through the cell is unaffected. This is described in an article entitled “Electrically Switchable Bragg Gratings from Liquid Crystal/Polymer Composites” by Pogue et al., Applied Spectroscopy, v. 54 No. 1, 2000, which is incorporated herein by reference in its entirety.
- Tunable or switchable gratings with a variable grating period may be produced e.g. by using flexoelectric LC. For LCs with a non-zero flexoelectric coefficient difference (e1-e3) and low dielectric anisotropy, electric fields exceeding certain threshold values result in transitions from the homogeneous planar state to a spatially periodic one. Field-induced grating is characterized by rotation of the LC director about the alignment axis with the wavevector of the grating oriented perpendicular to the initial alignment direction. The rotation sign is defined by both the electric field vector and the sign of the (e1-e3) difference. The wavenumber characterizing the field-induced periodicity is increased linearly with the applied voltage starting from a threshold value of about π/d, where d is the thickness of the layer. A description of flexoelectric LC gratings may be found e.g. in an article entitled “Dynamic and Photonic Properties of Field-Induced Gratings in Flexoelectric LC Layers” by Palto in Crystals 2021, 11, 894, which is incorporated herein by reference in its entirety.
- Tunable gratings with a variable grating period or a slant angle may be provided e.g. by using helicoidal LC. Tunable gratings with helicoidal LCs have been described e.g. in an article entitled “Electrooptic Response of Chiral Nematic Liquid Crystals with Oblique Helicoidal Director” by Xiang et al. Phys. Rev. Lett. 112, 217801, 2014, which is incorporated herein by reference in its entirety.
- For gratings exhibiting strong wavelength dependence of grating efficiency, several gratings, e.g. several volumetric Bragg grating (VBG) gratings, may be provided in the lightguide. The gratings that diffract light at any given moment of time may be switched by switching the VBG grating on and off, and/or by switching the wavelength of the light propagating in the waveguide.
- Referring now to
FIG. 9 , a near-eye display (NED) 900 is one possible implementation of a display apparatus of this disclosure. TheNED 900 includes aframe 901 supporting, for each eye: aprojector 908; a pupil-replicatinglightguide 910 for guiding the illuminating light beam inside and out-coupling portions of the illuminating light beam as disclosed herein; aneye tracker 904 for obtaining images of a user’s eye in aneyebox 912; and a plurality ofeyebox illuminators 906 shown as black dots. Theeyebox illuminators 906 may be supported by the pupil-replicatinglightguide 910 for illuminating theeyebox 912. - The purpose of the
eye trackers 904 is to determine position and/or orientation of both eyes of the user to enable steering the output image light to the locations of the user’s eyes as disclosed herein. The eyebox illuminators 906 illuminate the eyes at thecorresponding eyeboxes 912, to enable theeye trackers 904 to obtain the images of the eyes, as well as to provide reference reflections i.e. glints. The glints may function as reference points in the captured eye image, facilitating the eye gazing direction determination by determining position of the eye pupil images relative to the glints images. To avoid distracting the user with the light of theeyebox illuminators 906, the light illuminating theeyeboxes 912 may be made invisible to the user. For example, infrared light may be used to illuminate theeyeboxes 912. - Turning to
FIG. 10 , anHMD 1000 is an example of an AR/VR wearable display system which encloses the user’s face, for a greater degree of immersion into the AR/VR environment. TheHMD 1000 may generate the entirely virtual 3D imagery. TheHMD 1000 may include afront body 1002 and aband 1004 that can be secured around the user’s head. Thefront body 1002 is configured for placement in front of eyes of a user in a reliable and comfortable manner. Adisplay system 1080 may be disposed in thefront body 1002 for presenting AR/VR imagery to the user.Sides 1006 of thefront body 1002 may be opaque or transparent. - In some embodiments, the
front body 1002 includeslocators 1008 and an inertial measurement unit (IMU) 1010 for tracking acceleration of theHMD 1000, andposition sensors 1012 for tracking position of theHMD 1000. TheIMU 1010 is an electronic device that generates data indicating a position of theHMD 1000 based on measurement signals received from one or more ofposition sensors 1012, which generate one or more measurement signals in response to motion of theHMD 1000. Examples ofposition sensors 1012 include: one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, a type of sensor used for error correction of theIMU 1010, or some combination thereof. Theposition sensors 1012 may be located external to theIMU 1010, internal to theIMU 1010, or some combination thereof. - The
locators 1008 are traced by an external imaging device of a virtual reality system, such that the virtual reality system can track the location and orientation of theentire HMD 1000. Information generated by theIMU 1010 and theposition sensors 1012 may be compared with the position and orientation obtained by tracking thelocators 1008, for improved tracking accuracy of position and orientation of theHMD 1000. Accurate position and orientation is important for presenting appropriate virtual scenery to the user as the latter moves and turns in 3D space. - The
HMD 1000 may further include a depth camera assembly (DCA) 1011, which captures data describing depth information of a local area surrounding some or all of theHMD 1000. The depth information may be compared with the information from theIMU 1010, for better accuracy of determination of position and orientation of theHMD 1000 in 3D space. - The
HMD 1000 may further include aneye tracking system 1014 for determining orientation and position of user’s eyes in real time. The obtained position and orientation of the eyes also allows theHMD 1000 to determine the gaze direction of the user and to adjust the image generated by thedisplay system 1080 accordingly. The determined gaze direction and vergence angle may be used to adjust thedisplay system 1080 to reduce the vergence-accommodation conflict. The direction and vergence may also be used for displays’ exit pupil steering as disclosed herein. Furthermore, the determined vergence and gaze angles may be used for interaction with the user, highlighting objects, bringing objects to the foreground, creating additional objects or pointers, etc. An audio system may also be provided including e.g. a set of small speakers built into thefront body 1002. - Embodiments of the present disclosure may include, or be implemented in conjunction with, an artificial reality system. An artificial reality system adjusts sensory information about outside world obtained through the senses such as visual information, audio, touch (somatosensation) information, acceleration, balance, etc., in some manner before presentation to a user. By way of non-limiting examples, artificial reality may include virtual reality (VR), augmented reality (AR), mixed reality (MR), hybrid reality, or some combination and/or derivatives thereof. Artificial reality content may include entirely generated content or generated content combined with captured (e.g., real-world) content. The artificial reality content may include video, audio, somatic or haptic feedback, or some combination thereof. Any of this content may be presented in a single channel or in multiple channels, such as in a stereo video that produces a three-dimensional effect to the viewer. Furthermore, in some embodiments, artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, that are used to, for example, create content in artificial reality and/or are otherwise used in (e.g., perform activities in) artificial reality. The artificial reality system that provides the artificial reality content may be implemented on various platforms, including a wearable display such as an HMD connected to a host computer system, a standalone HMD, a near-eye display having a form factor of eyeglasses, a mobile device or computing system, or any other hardware platform capable of providing artificial reality content to one or more viewers.
- The present disclosure is not to be limited in scope by the specific embodiments described herein. Indeed, other various embodiments and modifications, in addition to those described herein, will be apparent to those of ordinary skill in the art from the foregoing description and accompanying drawings. Thus, such other embodiments and modifications are intended to fall within the scope of the present disclosure. Further, although the present disclosure has been described herein in the context of a particular implementation in a particular environment for a particular purpose, those of ordinary skill in the art will recognize that its usefulness is not limited thereto and that the present disclosure may be beneficially implemented in any number of environments for any number of purposes. Accordingly, the claims set forth below should be construed in view of the full breadth and spirit of the present disclosure as described herein.
Claims (20)
1. A pupil-replicating lightguide for expanding image light, the pupil-replicating lightguide comprising:
a slab of transparent material for guiding the image light therein by a series of internal reflections from opposed surfaces of the slab; and
an out-coupling grating structure supported by the slab for out-coupling portions of the image light from the slab, wherein the portions are laterally offset from one another along a path of the image light in the slab, and wherein the out-coupling grating structure has a switchable distribution of out-coupling efficiency.
2. The pupil-replicating lightguide of claim 1 , wherein the out-coupling grating structure comprises a plurality of diffraction gratings having different local slant angles of grating fringes, wherein the diffraction gratings are switchable between a high-efficiency state, in which a percentage of the image light out-coupled from the slab is above a first threshold, and a low-efficiency state, in which a percentage of the image light out-coupled from the slab is below a second threshold lower than the first threshold.
3. The pupil-replicating lightguide of claim 2 , wherein the second threshold is at least ten times lower than the first threshold.
4. The pupil-replicating lightguide of claim 2 , wherein the plurality of switchable diffraction gratings comprises switchable gratings with spatially varying slant angle of the grating fringes along the path of the image light.
5. The pupil-replicating lightguide of claim 4 , wherein the switchable gratings are disposed in a stack configuration parallel to the opposed surfaces of the slab.
6. The pupil-replicating lightguide of claim 2 , wherein the plurality of diffraction gratings comprises a polarization volume hologram (PVH) grating.
7. The pupil-replicating lightguide of claim 2 , wherein the plurality of diffraction gratings comprises a tunable liquid crystal (LC) surface-relief grating.
8. The pupil-replicating lightguide of claim 1 , wherein the out-coupling grating structure comprises a fluidic grating.
9. The pupil-replicating lightguide of claim 1 , wherein the out-coupling grating structure comprises a grating having a wavelength-dependent refractive index contrast.
10. A near-eye display comprising:
a projector for providing image light; and
a pupil-replicating lightguide coupled to the projector and comprising:
a slab of transparent material for guiding the image light therein by a series of internal reflections from opposed surfaces of the slab; and
an out-coupling grating structure supported by the slab for out-coupling portions of the image light from the slab, wherein the portions are laterally offset from one another along a path of the image light in the slab, wherein the out-coupling grating structure comprises a plurality of grating fringes having a switchable distribution of out-coupling efficiency.
11. The near-eye display of claim 10 , further comprising:
an eye tracker for determining a position of a pupil of a user’s eye at an eyebox of the near-eye display; and
a controller operably coupled to the projector, the eye tracker, and the pupil-replicating lightguide, and configured to:
cause the eye tracker to determine the position of the pupil; and,
responsive to the determined position of the pupil, switch the angular distribution of diffraction efficiency to increase an amount of the image light illuminating the pupil at the determined position.
12. The near-eye display of claim 10 , wherein the out-coupling grating structure comprises a plurality of diffraction gratings having different local slant angles of grating fringes, wherein the diffraction gratings are switchable between a high-efficiency state, in which a percentage of the image light out-coupled from the slab is above a first threshold, and a low-efficiency state, in which a percentage of the image light out-coupled from the slab is below a second threshold lower than the first threshold.
13. The near-eye display of claim 12 , wherein the plurality of switchable diffraction gratings comprises switchable gratings with spatially varying slant angle of the grating fringes along the path of the image light.
14. The near-eye display of claim 12 , wherein the second threshold is at least ten times lower than the first threshold.
15. The near-eye display of claim 12 , wherein the plurality of diffraction gratings comprises at least one of: a polarization volume hologram (PVH) grating; a fluidic grating; or a grating having a wavelength-dependent refractive index contrast.
16. The near-eye display of claim 12 , further comprising:
an eye tracker for determining a position of a pupil of the user’s eye at an eyebox of the near-eye display; and
a controller operably coupled to the projector, the eye tracker, and the pupil-replicating lightguide, and configured to cause the eye tracker to determine the position of the pupil; and, responsive to the determined position of the pupil, switch a diffraction grating of the plurality of diffraction gratings to the high-efficiency state.
17. The near-eye display of claim 16 , wherein the controller is further configured to switch the remaining diffraction gratings of the plurality of diffraction gratings to the low-efficiency state.
18. A method for displaying an image, the method comprising:
providing image light to a pupil-replicating lightguide comprising a slab of transparent material;
guiding the image light in the slab by a series of internal reflections from opposed surfaces of a slab of transparent material;
out-coupling portions of the image light from the slab by an out-coupling grating structure, wherein the portions are laterally offset from one another along a path of the image light in the slab; and
switching angular distribution of out-coupling efficiency of a plurality of grating fringes of the out-coupling grating structure.
19. The method of claim 18 , wherein the switching of the angular distribution of the out-coupling efficiency comprises switching a plurality of diffraction gratings having different local slant angles of grating fringes, wherein the diffraction gratings are switched between a high-efficiency state, in which a percentage of the image light out-coupled from the slab is above a first threshold, and a low-efficiency state, in which a percentage of the image light out-coupled from the slab is below a second threshold lower than the first threshold.
20. The method of claim 18 , further comprising:
using an eye tracker to determine a position of a pupil of a user’s eye at an eyebox of the near-eye display; and, responsive to the determined position of the pupil,
switching the angular distribution of diffraction efficiency to increase an amount of the image light illuminating the pupil at the determined position.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/698,996 US20230176380A1 (en) | 2021-12-06 | 2022-03-18 | Pupil-replicating lightguide with switchable out-coupling efficiency distribution and display based thereon |
TW111136402A TW202328726A (en) | 2021-12-06 | 2022-09-26 | Pupil-replicating lightguide with switchable out-coupling efficiency distribution and display based thereon |
PCT/US2022/051388 WO2023107309A1 (en) | 2021-12-06 | 2022-11-30 | Pupil-replicating lightguide with switchable out-coupling efficiency distribution and display based thereon |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US202163286230P | 2021-12-06 | 2021-12-06 | |
US202163286381P | 2021-12-06 | 2021-12-06 | |
US17/698,996 US20230176380A1 (en) | 2021-12-06 | 2022-03-18 | Pupil-replicating lightguide with switchable out-coupling efficiency distribution and display based thereon |
Publications (1)
Publication Number | Publication Date |
---|---|
US20230176380A1 true US20230176380A1 (en) | 2023-06-08 |
Family
ID=85017913
Family Applications (6)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/671,446 Pending US20230176377A1 (en) | 2021-12-06 | 2022-02-14 | Directional illuminator and display apparatus with switchable diffuser |
US17/697,592 Active US11846774B2 (en) | 2021-12-06 | 2022-03-17 | Eye tracking with switchable gratings |
US17/697,600 Pending US20230176444A1 (en) | 2021-12-06 | 2022-03-17 | Eye tracking with switchable gratings |
US17/698,996 Pending US20230176380A1 (en) | 2021-12-06 | 2022-03-18 | Pupil-replicating lightguide with switchable out-coupling efficiency distribution and display based thereon |
US17/699,012 Pending US20230176274A1 (en) | 2021-12-06 | 2022-03-18 | Adjustable focal length illuminator for a display panel |
US17/701,558 Pending US20230176368A1 (en) | 2021-12-06 | 2022-03-22 | Grating-assisted field of view expansion |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/671,446 Pending US20230176377A1 (en) | 2021-12-06 | 2022-02-14 | Directional illuminator and display apparatus with switchable diffuser |
US17/697,592 Active US11846774B2 (en) | 2021-12-06 | 2022-03-17 | Eye tracking with switchable gratings |
US17/697,600 Pending US20230176444A1 (en) | 2021-12-06 | 2022-03-17 | Eye tracking with switchable gratings |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/699,012 Pending US20230176274A1 (en) | 2021-12-06 | 2022-03-18 | Adjustable focal length illuminator for a display panel |
US17/701,558 Pending US20230176368A1 (en) | 2021-12-06 | 2022-03-22 | Grating-assisted field of view expansion |
Country Status (3)
Country | Link |
---|---|
US (6) | US20230176377A1 (en) |
TW (4) | TW202328766A (en) |
WO (1) | WO2023107351A1 (en) |
Family Cites Families (122)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB422680A (en) | 1933-06-09 | 1935-01-16 | Neyret Beylier Atel | Improvements in apparatus for grinding, refining and hydrating fibrous substances |
JP3323548B2 (en) | 1992-09-07 | 2002-09-09 | レーザーテック株式会社 | Beam deflector |
US6400885B1 (en) | 2000-08-18 | 2002-06-04 | Agilent Technologies, Inc. | Controllable optical attenuator |
KR101046019B1 (en) | 2003-05-15 | 2011-07-01 | 코니카 미놀타 옵토 인코포레이티드 | Optical system and imaging device |
GB2422680B (en) | 2005-01-27 | 2010-04-14 | Univ Nottingham Trent | Switchable phase grating |
IL166799A (en) | 2005-02-10 | 2014-09-30 | Lumus Ltd | Substrate-guided optical device utilizing beam splitters |
JP4655771B2 (en) | 2005-06-17 | 2011-03-23 | ソニー株式会社 | Optical device and virtual image display device |
FR2889633A1 (en) | 2005-08-08 | 2007-02-09 | Commissariat Energie Atomique | FLEXIBLE MEMBRANE ACTUATING DEVICE CONTROLLED BY ELECTROMOUILLAGE |
JP2007219106A (en) | 2006-02-16 | 2007-08-30 | Konica Minolta Holdings Inc | Optical device for expanding diameter of luminous flux, video display device and head mount display |
JP4333708B2 (en) | 2006-08-02 | 2009-09-16 | コニカミノルタビジネステクノロジーズ株式会社 | Method, apparatus, and computer program for processing input data related to generation of electronic file |
US8086044B2 (en) * | 2006-08-25 | 2011-12-27 | Ricoh Co., Ltd. | Block-based iterative multi-pass data filling technique for compound document compression |
US8368720B2 (en) * | 2006-12-13 | 2013-02-05 | Adobe Systems Incorporated | Method and apparatus for layer-based panorama adjustment and editing |
US20080212942A1 (en) * | 2007-01-12 | 2008-09-04 | Ictv, Inc. | Automatic video program recording in an interactive television environment |
JP2008310076A (en) * | 2007-06-15 | 2008-12-25 | Panasonic Corp | Current driving device |
US20090196460A1 (en) * | 2008-01-17 | 2009-08-06 | Thomas Jakobs | Eye tracking system and method |
US8982313B2 (en) | 2009-07-31 | 2015-03-17 | North Carolina State University | Beam steering devices including stacked liquid crystal polarization gratings and related methods of operation |
EP2494388B1 (en) | 2009-10-27 | 2018-11-21 | DigiLens Inc. | Compact holographic eyeglass display |
US20110234750A1 (en) * | 2010-03-24 | 2011-09-29 | Jimmy Kwok Lap Lai | Capturing Two or More Images to Form a Panoramic Image |
DE102010019667B4 (en) * | 2010-04-28 | 2014-02-20 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Circuit arrangement for arranged in a two-dimensional matrix organic light-emitting diodes |
US8878773B1 (en) | 2010-05-24 | 2014-11-04 | Amazon Technologies, Inc. | Determining relative motion as input |
US9557812B2 (en) * | 2010-07-23 | 2017-01-31 | Gregory A. Maltz | Eye gaze user interface and calibration method |
JP5269026B2 (en) | 2010-09-29 | 2013-08-21 | 日立建機株式会社 | Work machine ambient monitoring device |
US9618746B2 (en) | 2010-11-19 | 2017-04-11 | SA Photonics, Inc. | High resolution wide field of view digital night vision system |
GB2489674A (en) * | 2011-03-29 | 2012-10-10 | Sony Corp | 3D image generation |
GB2489675A (en) * | 2011-03-29 | 2012-10-10 | Sony Corp | Generating and viewing video highlights with field of view (FOV) information |
JP5845608B2 (en) * | 2011-03-31 | 2016-01-20 | 株式会社ニデック | Ophthalmic imaging equipment |
WO2012139232A1 (en) * | 2011-04-11 | 2012-10-18 | Liberovision Ag | Image processing |
EP2751611B1 (en) | 2011-08-29 | 2018-01-10 | Vuzix Corporation | Controllable waveguide for near-eye display applications |
US9274597B1 (en) * | 2011-12-20 | 2016-03-01 | Amazon Technologies, Inc. | Tracking head position for rendering content |
WO2013167864A1 (en) | 2012-05-11 | 2013-11-14 | Milan Momcilo Popovich | Apparatus for eye tracking |
US10025089B2 (en) | 2012-10-05 | 2018-07-17 | Microsoft Technology Licensing, Llc | Backlight for viewing three-dimensional images from a display from variable viewing angles |
JP2014106368A (en) | 2012-11-27 | 2014-06-09 | Fujifilm Corp | Electrowetting display dye composition, and electrowetting display device |
EP2767852A1 (en) | 2013-02-15 | 2014-08-20 | BAE Systems PLC | Display comprising an optical waveguide and switchable diffraction gratings and method of producing the same |
WO2014091204A1 (en) | 2012-12-10 | 2014-06-19 | Bae Systems Plc | Display comprising an optical waveguide and switchable diffraction gratings and method of producing the same |
GB201305726D0 (en) * | 2013-03-28 | 2013-05-15 | Eye Tracking Analysts Ltd | A method for calibration free eye tracking |
US9785235B2 (en) * | 2014-02-19 | 2017-10-10 | Mitsubishi Electric Corporation | Display control apparatus, display control method of display control apparatus, and eye gaze direction detection system |
US9449994B2 (en) * | 2014-02-25 | 2016-09-20 | Lg Display Co., Ltd. | Display backplane having multiple types of thin-film-transistors |
US10852838B2 (en) | 2014-06-14 | 2020-12-01 | Magic Leap, Inc. | Methods and systems for creating virtual and augmented reality |
US9494799B2 (en) | 2014-09-24 | 2016-11-15 | Microsoft Technology Licensing, Llc | Waveguide eye tracking employing switchable diffraction gratings |
WO2016046514A1 (en) | 2014-09-26 | 2016-03-31 | LOKOVIC, Kimberly, Sun | Holographic waveguide opticaltracker |
JP2018510320A (en) | 2014-12-09 | 2018-04-12 | ビーエーエスエフ ソシエタス・ヨーロピアBasf Se | Optical detector |
KR102533555B1 (en) * | 2015-02-17 | 2023-05-18 | 네버마인드 캐피탈 엘엘씨 | Methods and apparatus for generating and using reduced resolution images and/or communicating such images to a playback or content distribution device |
EP3062142B1 (en) * | 2015-02-26 | 2018-10-03 | Nokia Technologies OY | Apparatus for a near-eye display |
WO2017025167A1 (en) | 2015-08-11 | 2017-02-16 | Merck Patent Gmbh | Material combination |
KR20170063806A (en) * | 2015-09-03 | 2017-06-08 | 쓰리엠 이노베이티브 프로퍼티즈 컴파니 | Magnifying device |
US10217286B1 (en) | 2015-09-21 | 2019-02-26 | Amazon Technologies, Inc. | Realistic rendering for virtual reality applications |
WO2017134412A1 (en) | 2016-02-04 | 2017-08-10 | Milan Momcilo Popovich | Holographic waveguide optical tracker |
US10197804B2 (en) | 2016-04-25 | 2019-02-05 | Microsoft Technology Licensing, Llc | Refractive coating for diffractive optical elements |
US20180073686A1 (en) | 2016-09-14 | 2018-03-15 | Osram Sylvania Inc. | Solid state lighting device with electronically adjustable light beam distribution |
US10108144B2 (en) | 2016-09-16 | 2018-10-23 | Microsoft Technology Licensing, Llc | Holographic wide field of view display |
US10133070B2 (en) | 2016-10-09 | 2018-11-20 | Lumus Ltd. | Aperture multiplier using a rectangular waveguide |
US20180143586A1 (en) | 2016-11-22 | 2018-05-24 | United States Of America As Represented By The Secretary Of The Navy | Volume Phase Holographic Grating |
US10108014B2 (en) | 2017-01-10 | 2018-10-23 | Microsoft Technology Licensing, Llc | Waveguide display with multiple focal depths |
KR20180092362A (en) | 2017-02-09 | 2018-08-20 | 엘지이노텍 주식회사 | Camera module and optical device including liquid lens |
IL301881B1 (en) | 2017-02-23 | 2024-04-01 | Magic Leap Inc | Display system with variable power reflector |
CN106597658B (en) | 2017-03-09 | 2020-05-22 | 京东方科技集团股份有限公司 | Display panel and display device |
IL303471B1 (en) | 2017-03-21 | 2024-04-01 | Magic Leap Inc | Eye-imaging apparatus using diffractive optical elements |
US20180307047A1 (en) * | 2017-04-19 | 2018-10-25 | Thalmic Labs Inc. | Systems, devices, and methods for holographic optical elements |
CN110603476B (en) * | 2017-05-17 | 2021-12-03 | 苹果公司 | Head mounted display device with vision correction |
GB201709199D0 (en) * | 2017-06-09 | 2017-07-26 | Delamont Dean Lindsay | IR mixed reality and augmented reality gaming system |
KR102365726B1 (en) | 2017-06-13 | 2022-02-22 | 한국전자통신연구원 | Method for providing composite image based on optical see-through and apparatus using the same |
US10571699B1 (en) | 2017-06-14 | 2020-02-25 | Facebook Technologies, Llc | Multi-layered substrates for waveguide displays |
CN110753861A (en) | 2017-06-19 | 2020-02-04 | 奇跃公司 | Dynamically actuatable diffractive optical element |
US10466779B1 (en) * | 2017-07-24 | 2019-11-05 | Facebook Technologies, Llc | Event camera for eye tracking |
US20190079296A1 (en) | 2017-09-12 | 2019-03-14 | Thalmic Labs Inc. | Systems, devices, and methods for optical waveguides |
US11841481B2 (en) * | 2017-09-21 | 2023-12-12 | Magic Leap, Inc. | Augmented reality display with waveguide configured to capture images of eye and/or environment |
US10712576B1 (en) | 2017-10-24 | 2020-07-14 | Facebook Technologies, Llc | Pupil steering head-mounted display |
EP3487162B1 (en) | 2017-11-16 | 2021-03-17 | Axis AB | Method, device and camera for blending a first and a second image having overlapping fields of view |
US10466484B1 (en) | 2017-12-14 | 2019-11-05 | Facebook Technologies, Llc | Compact head-mounted display for artificial reality |
US11314083B2 (en) | 2018-02-06 | 2022-04-26 | Google Llc | Beam steering optics for near-eye and head mounted displays |
CN111742254B (en) * | 2018-02-09 | 2022-09-02 | 伊奎蒂公司 | Image light guide with circular polarizer |
US11327306B2 (en) | 2018-03-15 | 2022-05-10 | Facebook Technologies, Llc | Angular performance of apochromatic pancharatnam berry phase components using a C-plate |
US11175507B2 (en) | 2018-03-15 | 2021-11-16 | Facebook Technologies, Llc | Polarization-sensitive components in optical systems for large pupil acceptance angles |
US10775633B1 (en) | 2018-04-10 | 2020-09-15 | Facebook Technologies, Llc | Exit pupil steering for near-eye displays |
US11561507B2 (en) | 2018-04-17 | 2023-01-24 | Meta Platforms Technologies, Llc | Methods for three-dimensional arrangement of anisotropic molecules, patterned anisotropic films, and optical elements therewith |
US10295723B1 (en) | 2018-05-01 | 2019-05-21 | Facebook Technologies, Llc | 2D pupil expander using holographic Bragg grating |
US10502963B1 (en) * | 2018-07-16 | 2019-12-10 | Facebook Technologies, Llc | Immersed fresnel structure with curable liquid polymer |
US20200043398A1 (en) | 2018-08-01 | 2020-02-06 | David Viveros Salazar | Photoexcited Quantum Dot Based Augmented Reality Displays |
US10838132B1 (en) * | 2018-08-21 | 2020-11-17 | Facebook Technologies, Llc | Diffractive gratings for eye-tracking illumination through a light-guide |
US10725291B2 (en) | 2018-10-15 | 2020-07-28 | Facebook Technologies, Llc | Waveguide including volume Bragg gratings |
US20200116996A1 (en) | 2018-10-16 | 2020-04-16 | Facebook Technologies, Llc | Display waveguide assembly with color cross-coupling |
US11087680B2 (en) * | 2018-11-07 | 2021-08-10 | Canon Kabushiki Kaisha | Display device, image capturing device, illumination device, mobile body, and electronic apparatus |
TWM642752U (en) | 2018-11-08 | 2023-06-21 | 以色列商魯姆斯有限公司 | Light-guide display with reflector |
JP2020076926A (en) * | 2018-11-09 | 2020-05-21 | キヤノン株式会社 | Display device and imaging device |
JP2022514489A (en) * | 2018-12-10 | 2022-02-14 | フェイスブック・テクノロジーズ・リミテッド・ライアビリティ・カンパニー | Adaptive viewport for hypervocal viewport (HVP) displays |
CN113544570A (en) | 2019-01-11 | 2021-10-22 | 奇跃公司 | Time multiplexed display of virtual content at various depths |
US11372246B2 (en) | 2019-02-22 | 2022-06-28 | Facebook Technologies, Llc | Near-eye display system having optical combiner |
JP7365133B2 (en) * | 2019-04-19 | 2023-10-19 | キヤノン株式会社 | Communication device, its control method, and program |
US11176367B1 (en) * | 2019-05-01 | 2021-11-16 | Facebook Technologies, Llc | Apparatuses, systems, and methods for mapping a surface of an eye via an event camera |
US11119343B2 (en) | 2019-05-20 | 2021-09-14 | Facebook Technologies, Llc | Optical waveguide beam splitter with polarization volume gratings for display |
CN210323583U (en) | 2019-06-13 | 2020-04-14 | 句容福芯电子有限公司 | Near-eye display based on holographic waveguide |
KR20220021904A (en) * | 2019-06-23 | 2022-02-22 | 루머스 리미티드 | Display by Foveated Optical Correction |
JP2021005053A (en) * | 2019-06-27 | 2021-01-14 | キヤノン株式会社 | Display control device and method for controlling the same, imaging apparatus, program, and storage medium |
GB2585211B (en) | 2019-07-02 | 2021-12-08 | Dualitas Ltd | Spatial light modulation |
KR20210004776A (en) | 2019-07-04 | 2021-01-13 | 삼성전자주식회사 | Apparatus and method of displaying augmented reality |
US11609424B2 (en) | 2019-07-08 | 2023-03-21 | Meta Platforms Technologies, Llc | Apodized reflective optical elements for eye-tracking and optical artifact reduction |
US11360557B2 (en) | 2019-08-06 | 2022-06-14 | Apple Inc. | Eye tracking system |
WO2021030093A1 (en) | 2019-08-13 | 2021-02-18 | Apple Inc. | Display system with time interleaving |
US20210055551A1 (en) | 2019-08-23 | 2021-02-25 | Facebook Technologies, Llc | Dispersion compensation in volume bragg grating-based waveguide display |
US11270114B2 (en) | 2019-08-30 | 2022-03-08 | Lg Electronics Inc. | AR device and method for controlling the same |
US10890823B1 (en) | 2019-10-18 | 2021-01-12 | Facebook Technologies, Llc | Pitch variable optical devices and systems containing the same |
US20220390746A1 (en) | 2019-11-06 | 2022-12-08 | Arizona Board Of Regents On Behalf Of The University Of Arizona | Augmented near to eye display |
WO2021090235A2 (en) * | 2019-11-08 | 2021-05-14 | Evolution Optiks Limited | System and method for implementing a viewer-specific image perception adjustment within a defined view zone, and vision correction system and method using same |
WO2021118850A1 (en) | 2019-12-12 | 2021-06-17 | Akalana Management Llc | Optical systems with resolution-enhancing holographic elements |
US11428938B2 (en) | 2019-12-23 | 2022-08-30 | Meta Platforms Technologies, Llc | Switchable diffractive optical element and waveguide containing the same |
US11796813B2 (en) | 2019-12-30 | 2023-10-24 | Meta Platforms Technologies, Llc | Optical system and method for providing compressed eyebox |
US11668932B2 (en) | 2020-01-06 | 2023-06-06 | Meta Platforms Technologies, Llc | Switchable Pancharatnam-Berry phase grating stack |
US11294184B2 (en) | 2020-01-06 | 2022-04-05 | Facebook Technologies, Llc | Foveated display system |
US10885843B1 (en) * | 2020-01-13 | 2021-01-05 | Sharp Kabushiki Kaisha | TFT pixel threshold voltage compensation circuit with a source follower |
WO2021188926A1 (en) * | 2020-03-20 | 2021-09-23 | Magic Leap, Inc. | Systems and methods for retinal imaging and tracking |
US11215712B2 (en) * | 2020-04-27 | 2022-01-04 | Facebook Technologies, Llc | Time-to-digital converter for depth sensing |
JP2021189278A (en) * | 2020-05-28 | 2021-12-13 | キヤノン株式会社 | Light-emitting device and electronic apparatus |
US20230221557A1 (en) | 2020-05-28 | 2023-07-13 | Arizona Board Of Regents On Behalf Of The University Of Arizona | Optical see-through head-mounted lightfield displays based on substrate-guided combiners |
CN114167606B (en) | 2020-09-11 | 2023-11-10 | 宁波舜宇光电信息有限公司 | Optical waveguide assembly and display apparatus including the same |
WO2022133048A1 (en) * | 2020-12-17 | 2022-06-23 | Zinn Labs, Inc. | Event camera system for pupil detection and eye tracking |
US20220299754A1 (en) | 2021-03-18 | 2022-09-22 | Facebook Technologies, Llc | Mems with polarization conversion and optical beam scanner based thereon |
CN113075793B (en) | 2021-04-06 | 2023-06-02 | 业成科技(成都)有限公司 | Display device and method of operating the same |
US20220382064A1 (en) * | 2021-06-01 | 2022-12-01 | Microsoft Technology Licensing, Llc | Metalens for use in an eye-tracking system of a mixed-reality display device |
US11972042B2 (en) * | 2021-06-15 | 2024-04-30 | Microsoft Technology Licensing, Llc | Variable intensity distributions for gaze detection assembly |
US20220413603A1 (en) * | 2021-06-25 | 2022-12-29 | Microsoft Technology Licensing, Llc | Multiplexed diffractive elements for eye tracking |
US11852836B2 (en) | 2021-07-13 | 2023-12-26 | Meta Platforms Technologies, Llc | Directional illuminator and display device with pupil steering by tiltable reflector |
US20230055268A1 (en) * | 2021-08-18 | 2023-02-23 | Meta Platforms Technologies, Llc | Binary-encoded illumination for corneal glint detection |
-
2022
- 2022-02-14 US US17/671,446 patent/US20230176377A1/en active Pending
- 2022-03-17 US US17/697,592 patent/US11846774B2/en active Active
- 2022-03-17 US US17/697,600 patent/US20230176444A1/en active Pending
- 2022-03-18 US US17/698,996 patent/US20230176380A1/en active Pending
- 2022-03-18 US US17/699,012 patent/US20230176274A1/en active Pending
- 2022-03-22 US US17/701,558 patent/US20230176368A1/en active Pending
- 2022-09-23 TW TW111136183A patent/TW202328766A/en unknown
- 2022-09-23 TW TW111136163A patent/TW202340801A/en unknown
- 2022-09-26 TW TW111136400A patent/TW202340792A/en unknown
- 2022-09-26 TW TW111136402A patent/TW202328726A/en unknown
- 2022-12-03 WO PCT/US2022/051755 patent/WO2023107351A1/en unknown
Also Published As
Publication number | Publication date |
---|---|
US20230176444A1 (en) | 2023-06-08 |
US11846774B2 (en) | 2023-12-19 |
US20230176370A1 (en) | 2023-06-08 |
US20230176368A1 (en) | 2023-06-08 |
US20230176377A1 (en) | 2023-06-08 |
TW202328726A (en) | 2023-07-16 |
TW202340801A (en) | 2023-10-16 |
TW202328766A (en) | 2023-07-16 |
WO2023107351A1 (en) | 2023-06-15 |
US20230176274A1 (en) | 2023-06-08 |
TW202340792A (en) | 2023-10-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
TWI769191B (en) | Liquid crystal diffractive devices with nano-scale pattern and methods of manufacturing the same | |
US10890823B1 (en) | Pitch variable optical devices and systems containing the same | |
US11428977B1 (en) | Occluder / dimmer based on polarization-selective scatterer and near-eye display containing same | |
JP2022547252A (en) | Magnetic field-driven liquid crystal patterning control system | |
US11262638B2 (en) | Liquid crystal mixtures for pitch variable optical elements | |
US20230176380A1 (en) | Pupil-replicating lightguide with switchable out-coupling efficiency distribution and display based thereon | |
WO2023107309A1 (en) | Pupil-replicating lightguide with switchable out-coupling efficiency distribution and display based thereon | |
US20230176379A1 (en) | Lightguide with eye-following out-coupler | |
US20230367124A1 (en) | Lightguide assembly with switchable inputs | |
KR20220141278A (en) | resonant liquid crystal devices | |
US20230176273A1 (en) | Display device with running out-coupling grating | |
US20240094611A1 (en) | Optical modulator and image projector based on leaky-mode waveguide with temporal multiplexing | |
WO2023107348A1 (en) | Directional illuminator and display apparatus with switchable diffuser | |
WO2023107367A1 (en) | Eye tracking with switchable gratings | |
WO2023107370A1 (en) | Lightguides with tunable gratings for dynamically variable field-of-view | |
WO2023107336A1 (en) | Lightguides with color- and time-sequential gratings | |
WO2023107319A1 (en) | Lightguides with color- and time-sequential gratings | |
WO2023107373A1 (en) | Grating-assisted field of view expansion | |
WO2023107360A1 (en) | Display device with running out-coupling grating | |
US20230367073A1 (en) | Waveguide with tunable bulk reflectors | |
WO2023220353A1 (en) | Field of view expansion by image light redirection | |
CN115903235A (en) | Display device for displaying hologram and method thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |