WO2020060989A1 - Mask with integrated display system - Google Patents

Mask with integrated display system Download PDF

Info

Publication number
WO2020060989A1
WO2020060989A1 PCT/US2019/051432 US2019051432W WO2020060989A1 WO 2020060989 A1 WO2020060989 A1 WO 2020060989A1 US 2019051432 W US2019051432 W US 2019051432W WO 2020060989 A1 WO2020060989 A1 WO 2020060989A1
Authority
WO
WIPO (PCT)
Prior art keywords
display system
image
holographic
user
mask
Prior art date
Application number
PCT/US2019/051432
Other languages
French (fr)
Inventor
William Parker
Julie Parker
Original Assignee
Marsupial Holdings, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Marsupial Holdings, Inc. filed Critical Marsupial Holdings, Inc.
Publication of WO2020060989A1 publication Critical patent/WO2020060989A1/en

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0081Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. enlarging, the entrance or exit pupil
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/42Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
    • G02B27/4205Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having a diffractive optical element [DOE] contributing to image formation, e.g. whereby modulation transfer function MTF or optical aberrations are relevant
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0118Head-up displays characterised by optical features comprising devices for improving the contrast of the display / brillance control visibility
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • G02B2027/0174Head mounted characterised by optical features holographic

Definitions

  • the present invention generally relates to optics for displaying images in a user’s field of view.
  • the present invention is directed to a Mask with Integrated Display System.
  • Augmented reality can be used to provide information in a user’s visual field to enhance situational awareness.
  • the user’s field of view is augmented with images that overlay the scene in the field of view. These images may include information about the scene being viewed, and that information can be displayed independently from the scene or integrated within it (e.g., augmenting information may include the direction the user is looking, the distance an object being viewed is from the user, or an identification of the nature of an object being viewed).
  • an augmented reality display system that displays a see-through image representative of information to a user
  • the display system comprising: a light engine for receiving and processing the information so as to develop a see-through image; a lens optically coupled to the light engine, the lens sized and configured to focus the see-through image; an image guide optically coupled to the lens so as to receive the see-through image; an input holographic expander grating disposed on the image guide; and an output holographic expander grating disposed within the image guide, wherein the see-through image is directed to the input holographic expander grating by the lens, wherein the input holographic expander grating expands the image and redirects the expanded image into the image guide where the image is internally reflected until reaching the output holographic expander grating, and wherein the output holographic expander grating expands the received image and redirects the expanded image toward a user’s eye.
  • a holographic display system capable of displaying information to a user based upon data received by the system is disclosed, the system
  • a housing comprising: a housing; a light engine contained within the housing; an image guide optically coupled to the light engine, the image guide residing substantially outside the housing; wherein the light engine receives the data and generates a light-based image, and wherein the image guide propagates the light-based image along its length and produces a holographic display that is viewable by the user.
  • the mask comprising: a mask lens, the mask lens sized and configured to create a cavity between the user’s face and the mask lens; a coupling device mounted on or proximate the mask lens; a holographic display system coupled to the coupling device, the holographic display system including an outside portion and an inside portion, the outside portion residing outside the cavity and the inside portion residing inside the cavity, the holographic display system including: a light engine residing in the outside portion; an image guide optically coupled to the light engine and included with the inside portion; a first diffraction grating coupled to a distal end of the image guide proximate the light engine; and a second diffraction grating coupled to a proximate end of the image guide, wherein the light engine, image guide, and first and second diffraction gratings operate to provide the substantially see-through information to the user.
  • FIG. l is a block diagram of a holographic display system according to an embodiment of the present invention
  • FIG. 2 is a block diagram showing the expansion of an image using a holographic display system according to an embodiment of the present invention
  • FIG. 3 is a block diagram of another holographic display system according to an embodiment of the present invention.
  • FIG. 4 is a block diagram of yet another holographic display system according to an embodiment of the present invention.
  • FIG. 5 is a perspective view of a holographic display system according to an embodiment of the present invention.
  • FIG. 6 is an illustration of a holographic display system integrated into a firefighter helmet according to an embodiment of the present invention.
  • FIG. 7 is an illustration of a holographic display system integrated into a firefighter full face mask according to an embodiment of the present invention.
  • FIG. 8 is an illustration of a holographic display system integrated into a full face scuba mask according to an embodiment of the present invention.
  • FIG. 9 is a process diagram of integrating sensor input to produce a holographic display with augmenting information according to embodiment of the present invention.
  • a mask with integrated display system includes a holographic image guide as part of an optical device.
  • the integrated display system shows augmenting information that is overlaid, in a substantially see-through fashion, upon the images that are viewable through the optical device.
  • a reduced form factor allows the integrated display system to be ergonomically integrated into existing and to-be-developed optical devices, such as glasses, helmets, masks, and goggles.
  • the integrated display system can be used behind other optical enhancement devices, such as night vision goggles.
  • the integrated display system is relatively lightweight and can provide sufficient visible light intensities (e.g., 14,000 nits) so that the display is readable when the scene viewed by the user is in bright sunlight.
  • Variable intensity control for the images also allows for augmenting information to be displayed and viewed in a wide range of other conditions, including low light, night, underwater, and low visibility (e.g., due to smoke or fog).
  • the augmenting information may be displayed within a resolution range of about 960 x 540 to 1980 x 1080 pixels in three colors (red-blue-green/RGB), which allows full-color rendering of information for increased comprehension and prioritization, and can encompass approximately 40 degrees of the user’s field of view.
  • the holographic display system is applicable to many augmented reality uses, including low light multispectral imaging, information overlay for ground troops, pilots and mission command, see-through cockpit sensor fusion, and situational awareness enhancement.
  • a holographic display system 100 provides additional information to the user that is overlaid, in a substantially see-through fashion, upon the scene that is viewable by the user, with or without, another optical element, such as a mask lens 104.
  • another optical element such as a mask lens 104.
  • holographic display system 100 includes a light engine 108, lens 112, holographic optical elements (HOE) 116 (HOEs 116A and 116B), and an image guide 120 that combine to produce a holographic image display (HID) 124 for viewing by the user.
  • HOE holographic optical elements
  • HOEs 116A and 116B holographic image display
  • image guide 120 that combine to produce a holographic image display (HID) 124 for viewing by the user.
  • HOE holographic optical elements
  • HOEs 116A and 116B holographic image display
  • HOE 116A and 116B are holographic expander gratings, input holographic expander grating 116A and output holographic expander grating 116B.
  • an image (including for videos) to be presented within a user’s field of view, such as a message, symbol, color, or shape, is projected from light engine 108 toward lens 112, which focuses the image and passes it through image guide 120 towards input holographic expander grating 116 A.
  • HOEs 116 are shown on a given side of image guide 120 in FIG. 1, the HOEs can be positioned in other suitable locations including within the image guide.
  • Input holographic expander grating 116A expands the image horizontally (as shown schematically in FIG. 2) and redirects the image along image guide 120 such that total internal reflection occurs and the image reaches output holographic expander grating 116B.
  • Output holographic expander grating 116B expands the image vertically (as shown schematically in FIG. 2) and redirects the image to the user’s eye 130.
  • image guide 120 which is a thin sheet of transparent or semi-transparent substrate (e.g., glass, plastic, etc.)
  • an image is sent from light engine 108 to eye 130 with appropriate horizontal and vertical expansion.
  • holographic display system 100 allows the user to see a largely unobstructed view of the real-world while also allowing the user to see augmenting information. This arrangement also allows holographic display system 100 to be easily used in conjunction with other optical devices, such as dive goggles, binoculars, scopes, and night vision equipment.
  • holographic display system 100 attenuates less than 1% of the light entering mask lens 104 (notable when comparing system 100 with, for example, beam splitting technologies which inherently attenuate 10% to 30% of the incoming light, which limits use in low light conditions).
  • holographic display system 100 can include a camera 132 (as seen in FIG. 1) to view and track the user’s eyeball (along light path 136) for various inputs, e.g., retinal authentication or identification, or can allow the user to interact with the display or allow tracking of wherein the field of view the user is focused.
  • illumination such as infrared light
  • camera 132 can also be provided at camera 132 so as to assist with the analysis of the location of the eyeball
  • infrared light can be used to“pull” an image of the user’s eye by sending infrared light down it). The light illuminates the user’s iris and retina. This light is then sent back up the image guide where a camera captures the image and then is processed. In this way, the image guide is used to display an image to the user and to gather an image from the eye.
  • Light engine 108 can produce a full color, sunlight readable, high resolution holographic image for transmission to a user of mask 104.
  • the image produced by light engine 108 can be read against the brightest scenery (e.g., a sunlit cloud in the sky), while still dimming enough to be compatible with night vision goggles. Beam splitting prisms cannot handle full color without further attenuation over the attenuation discussed above and cannot produce images with the desired clarity/readability in bright light (sunlight).
  • light engine 108 includes a processor 140 and receives information from one or more inputs 144.
  • Processor 140 is preferably a high performance, low power processor, with accelerated image processing, capable of executing a set of instructions (described in more detail below) such that light engine 108 can produce homographic image display 124 from inputs 144.
  • Processor 140 can provide real-time image processing for inputted video, such as high dynamic range processing, sensor fusion, contrast enhancement, and low light processing.
  • processor 140 in combination with inputs 144, provides geo-referenced augmented reality information when connected real-time or with preloaded object location information.
  • Lens 112 is sized and configured to transmit the display information from light engine 108 to HOE 116A such that the display information can be transmitted through image guide 120.
  • HOE 116A may also have the optical functions of lens 112 included into its design, thus eliminating the need for the extra optic(s).
  • HOEs 116 are translucent selective wavelength gratings that are designed and configured to steer displayable information 128 into and out of image guide 120.
  • HOEs 116 are capable of directing displayable information 128 through image guide 120 using total internal reflections.
  • HOE 116A modifies displayable information 128 received from light engine 108 so as to guide the display information through image guide 120 toward HOE 116B.
  • HOE 116B directs the display information to the user so that it can be viewed when looking through mask 104.
  • HOEs 116 are prepared using laser beam interference techniques.
  • two laser beams may be directed at a substrate so as to produce a pattern of straight lines with a sinusoidal cross section, with the pitch of the grating being approximately l / sin Q.
  • FIG. 1 shows HOE 116A positioned between lens 112 and image guide 120, the HOE could also be positioned on the opposite side of the image guide.
  • Image guide 120 is a translucent plate that propagates wavelengths substantially internally.
  • Image guide 120 can be many different shapes including, but not limited to, rectangular, circular, curvilinear, and can make up only a portion of lens 112.
  • Image guide components have been made within various glasses for commercial photonic devices. The devices are based on planar image guides, in which light is confined to substrate-surface channels. Silica, SiON, fluoroaluminates, chalcogenides and doped glasses are possible glasses for making optical image guide devices. Bulk silica (Si02) and silica-on-silicon (Si02/Si) are common materials used to manufacture planar light wave circuits (PLCs), due to their refractive- index match with silica-based optical fiber.
  • PLCs planar light wave circuits
  • Glass/silica image guide PLCs typically consist of a planar arrangement of glass image guides with a higher index of refraction buried in glass all on a silicon or glass substrate.
  • glass used to image guide 120 is suitable for the creating of diffraction gratings within the glass using a femtolaser.
  • Suitable parameters of a laser for producing refractive index changes in a wide variety of transparent material include those described in U.S. Pat. No. 6,573,026, (Aitken et ah), U.S. Pat. No. 6,884,960 (Bourne et ah), and U.S. Pat. No. 6,853,785 (Dunn et ah), which are all incorporated herein by reference in their entirety.
  • light engine 108 receives one or more inputs 144 (shown in FIG. 3).
  • the sources for inputs 144 can include, but are not limited to, a video input, a rangefinder input, a global position system coordinate or related information (e.g., a direction, an elevation, and/or a cant), an inertial measurement unit, and one or more sensor inputs (such as, but not limited to, temperature, pressure, humidity, wind speed, and light).
  • the light engine associated with the holographic display system includes one or more software modules that are accessible by a processor. The software modules assist in importing, correlating, processing, and generating data from external sources, image processing, and the display to the user.
  • holographic display system 200 provides useful information to a user of eyewear that is overlaid upon what the user can view through the optics provided with the eyewear, the useful information being collected/received from a plurality of source devices 212 (212A - 212G).
  • source devices 212 212A - 212G
  • additional information that may be useful to the user depending on the situation includes, but is not limited to, environmental information and situational information, which may be provided to the user via holographic display system 200.
  • holographic display system 200 includes a processor 204 that receives information from one or more ports 208 (208A-208B) and one or more source devices 212 (sensors or similar information gathering devices).
  • Processor 204 interacts with a video processor 216 which can receive inputs from video inputs 220 (220 A- 220B).
  • Video processor 216 provides information to projector 224, which transmits the images that appear on holographic image display 228.
  • Processor 204 can be a microprocessor suitable for processing large volumes of information without requiring a significant power source (preferably less than 0.5 watt).
  • Processor 204 can be designed and configured to allow for the transmission of information from one or more ports 208, such as a RS-232 serial port, micro-USB port, USB-A, B, or C port, and the like, that may be coupled to the processor via coupling hardware known in the art.
  • ports 208 can allow for information collection and alignment from ancillary equipment such as thermal cameras, optical zooms, night vision equipment, or communication devices that couple via an internet protocol to the Internet so as to provide additional information to the user.
  • Processor 204 can also receive information from one or more source devices 212, such as, but not limited to, GPS sensor 212A, temperature sensor 212B, pressure sensor 212C, humidity sensor 212D, and one or more inertial measurement units (IMU) 212E-F, and a rangefinder 212G. Combinations of information from one or more of source devices 212 may be used by processor 204 to provide valuable information to the user. IMUs 212E and F can produce a compass heading as well as a 9-degree freedom of pose estimation (heading, inclination, and cant/roll).
  • IMU inertial measurement units
  • Processor 204 can be also designed and configured to allow for the transmission of information wirelessly via any wireless standard or protocols, such as, but not limited to, RFID, Bluetooth, Wi-Fi, ZigBee, WiMax, WiGig, ETltra Wide Band, or a Wireless Wide Area Network (e g., TDMA, CDMA, GSM, UMTS, EV-DO, LTE), etc.
  • any wireless standard or protocols such as, but not limited to, RFID, Bluetooth, Wi-Fi, ZigBee, WiMax, WiGig, ETltra Wide Band, or a Wireless Wide Area Network (e g., TDMA, CDMA, GSM, UMTS, EV-DO, LTE), etc.
  • Video processor 216 is specially configured to perform low power video processing.
  • video processor 216 is capable of processing information from up to six video inputs 220.
  • Video processor 216 also drives the projector 224 and the display of information onto holographic image display 228.
  • Video processor 216 can receive an external power supply from video input 220 A and can receive external video feed(s) from video input 220B.
  • Projector 224 receives display information from video processor 216 and projects it to holographic image display 228.
  • the combination of projector 224 and holographic image display 228 can be similar to the setup of holographic display system 100, with projector 224 sending display information through a lens, into a HOE, through an image guide, and to another HOE, before it is displayed to the user.
  • holographic display system 300 Another example of a holographic display system, holographic display system 300, is shown in FIG. 5.
  • holographic display system 300 has a form factor that allows for a light engine (found in enclosure 304) to reside external to a direct view optic while at least a portion of wave guide 308 (image portion 312) can reside inside a mask or similar at a desired location.
  • a light engine found in enclosure 304
  • wave guide 308 image portion 312
  • the form factor of holographic display system 300 is versatile and adaptable to a number of applications.
  • FIG. 6 shows an implementation of a holographic display system 400 coupled to a military style helmet.
  • Holographic display system 400 can be constructed and configured similarly to one of the systems discussed above.
  • holographic display system 400 is mounted to helmet 404 via a mounting system 408.
  • Mounting system 408 includes a bracket 412 that is coupled directly to helmet 404 and a positioning member 416, which is removably slidably engaged with bracket 412.
  • Positioning member 416 is designed and configured to place a portion of holographic display system 400 outside the view of the user (e.g., an enclosure with the light engine) while positioning the image guide and holographic image display within the view of the user.
  • Positioning member 416 may have a swivel 420 that allows the user to move the holographic display system 400 away from the user’s face.
  • Power and communications may be provided to holographic display system 400 via auxiliary equipment carried by the user and coupled to the holographic display system via helmet 404 (such as by cable 424).
  • FIG. 7 shows a holographic display system 500 coupled to a full fire-fighter’s mask 504.
  • an outside portion 508 of holographic display system 500 resides outside mask 504, while an inside portion 512 resides inside the mask.
  • a coupler 516 that securely mounts holographic display system 500 to mask 504, and prevents ingress of smoke, fumes, and unwanted particles from entering the user’s internal mask area 518.
  • holographic display system 500 receives information and power via connection 520 and includes a thermal camera 524 and light engine 108 inside outside portion 508.
  • FIG. 8 shows a holographic display system 600 coupled to a scuba mask 604.
  • holographic display system 600 has an outer portion 608 that resides outside mask 604 and an inside portion 612 that resides inside the mask.
  • outer portion 608 includes an enclosure 616 designed and configured to address these environmental concerns.
  • enclosure 616 would be water-proof, but, so as to allow for cooling of the processor and electronics associated with the light engine (inside enclosure 616), may include a plurality of fins 620 that serve to cool those components.
  • FIG. 9 shows a diagrammatic representation of one implementation of a
  • an example holographic display system may be implemented as part of a direct view optic; however, other embodiments of the holographic display system may be implemented as a wearable or body-mountable display device (also referred to as a wearable computing device), such as a head-mountable device (HMD), or display that may be attached or mounted to a user, such as by an arm-band, wrist band, wrist mount, or a chest-mount system, among other possibilities.
  • HMD head-mountable device
  • Device 700 includes a processor 704 and a memory 708 that communicate with each other, and with other components, such as inputs 144, via a bus 712.
  • Processor 704 can be, for example, a micro-processor or a digital signal processor.
  • Bus 712 may include any of several types of communication structures including, but not limited to, a memory bus, a memory controller, a peripheral bus, a local bus, and any combinations thereof, using any of a variety of architectures.
  • Memory 708 may include various components (e.g., machine-readable media) including, but not limited to, a random-access memory component (e.g., a static RAM“SRAM”, a dynamic RAM“DRAM”, etc.), a read-only component, and any combinations thereof.
  • a random-access memory component e.g., a static RAM“SRAM”, a dynamic RAM“DRAM”, etc.
  • a basic input/output system 716 (BIOS), including basic routines that help to transfer information between elements within device 700, such as during start-up, may be stored in memory 708.
  • BIOS basic input/output system
  • Memory 708 may also include (e.g., stored on one or more machine-readable media) instructions (e.g., software) 720 embodying any one or more of the aspects and/or methodologies of the present disclosure.
  • memory 708 may further include any number of program modules including, but not limited to, an operating system, one or more application programs, other program modules, program data, and any combinations thereof.
  • Device 700 may also include a storage device 724.
  • a storage device e.g., storage device 724.
  • Examples of a storage device include, but are not limited to, a hard disk drive for reading from and/or writing to a hard disk, a flash-drive, solid-state memory device, or other memory devices known in the art and any combinations thereof.
  • Storage device 724 may be connected to bus 712 by an appropriate interface (not shown).
  • Example interfaces include, but are not limited to, SCSI, advanced technology attachment (ATA), serial ATA, universal serial bus (all types) (ETSB),
  • storage device 724 may be removably interfaced with device 700 (e.g., via an external port connector). Particularly, storage device 724 and an associated machine-readable medium 728 may provide nonvolatile and/or volatile storage of machine-readable instructions, data structures, program modules, and/or other data for light engine 108.
  • instructions 720 may reside, completely or partially, within machine-readable medium 728. In another example, instructions 720 may reside, completely or partially, within processor 704.
  • Device 700 may also include a connection to one or more inputs/sensors, such as inputs 144 and/or source devices 212. Sensors may be interfaced to bus 712 via any of a variety of interfaces (not shown) including, but not limited to, a serial interface, a parallel interface, a game port, a USB interface, a FIREWIRE interface, a direct connection to bus 712, wireless, and any combinations thereof. Alternatively, in one example, a user of device 700 may enter commands and/or other information into device 700 via an input device (not shown).
  • Examples of an input device 732 include, but are not limited to, an alpha-numeric input device (e.g., a keyboard), a pointing device, an audio input device (e.g., a microphone, a voice response system, etc.), a cursor control device (e.g., a mouse), a touchpad, an optical scanner, a video capture device (e.g., a still camera, a video camera), touchscreen, and any combinations thereof.
  • an alpha-numeric input device e.g., a keyboard
  • a pointing device e.g., an audio input device (e.g., a microphone, a voice response system, etc.), a cursor control device (e.g., a mouse), a touchpad, an optical scanner, a video capture device (e.g., a still camera, a video camera), touchscreen, and any combinations thereof.
  • an audio input device e.g., a microphone, a voice response system, etc.
  • a user may also input commands and/or other information to device 700 via storage device 724 (e.g., a removable disk drive, a flash drive, etc.) and/or a network interface device 736.
  • a network interface device such as network interface device 736, may be utilized for connecting device 700 to one or more of a variety of networks, such as network 740, and one or more remote devices 744 connected thereto. Examples of a network interface device include, but are not limited to, a network interface card, a modem, and any combination thereof.
  • Examples of a network include, but are not limited to, a wide area network (e.g., the Internet, an enterprise network), a local area network (e.g., a network associated with an office, a building, a campus or other relatively small geographic space), a telephone network, a direct connection between two computing devices, and any combinations thereof.
  • a network such as network 740, may employ a wired and/or a wireless mode of communication. In general, any network topology may be used.
  • Information e.g., data, instructions 720, etc.
  • device 700 may receive video, sensor or other data wirelessly according to one or more wireless standards or protocols, such as, but not limited to, RFID, Bluetooth, Wi-Fi, ZigBee, WiMax, WiGig, Ultra Wide Band, or a Wireless Wide Area Network (e.g., TDMA, CDMA, GSM, UMTS, EV-DO, LTE), etc.
  • processing device 330 may receive the video, sensor or other data by one or more wired protocols such as, but not limited to, a Universal Serial Bus protocol, a Registered Jack protocol (e.g., RJ-25), or a wired Local Area Network protocol (e.g., Ethernet).
  • video, sensor and other data may be received by the processing device from a portable storage device such as a memory card, flash drive, or zip drive.
  • Device 700 may further include a video display adapter 748 for communicating a displayable image to a display device 752.
  • a display device 752 include, but are not limited to, a holographic display, a liquid crystal display (LCD), a plasma display, and any combinations thereof.
  • device 700 may include a connection to one or more other peripheral output devices including, for example, an audio speaker.
  • Peripheral output devices may be connected to bus 712 via a peripheral interface 756.
  • Examples of a peripheral interface include, but are not limited to, a serial port, a USB connection, a FIREWIRE connection, a parallel connection, a wireless connection, and any combinations thereof.
  • an augmented reality display system that displays a see-through image representative of information to a user
  • the display system comprising: a light engine for receiving and processing the information so as to develop a see-through image; a lens optically coupled to the light engine, the lens sized and configured to focus the see-through image; an image guide optically coupled to the lens so as to receive the see-through image; an input holographic expander grating disposed on the image guide; and an output holographic expander grating disposed within the image guide, wherein the see-through image is directed to the input holographic expander grating by the lens, wherein the input holographic expander grating expands the image and redirects the expanded image into the image guide where the image is internally reflected until reaching the output holographic expander grating, and wherein the output holographic expander grating expands the received image and redirects the expanded image toward a user’s eye.
  • a housing and wherein the light engine and the lens are contained within the housing. Additionally or alternatively, wherein the image guide, the input holographic expander grating, and the output holographic expander grating reside outside the housing. Additionally or alternatively, wherein the input holographic expander grating expands the image horizontally. Additionally or alternatively, wherein the output holographic expander grating expands the image vertically. Additionally or alternatively, further including a mask, and wherein the display system is coupled to the mask. Additionally or alternatively, wherein the mask includes a mask lens, and wherein the image guide is disposed in between a face of the user and the mask lens.
  • a helmet further including a helmet, and wherein the display system is coupled to the helmet. Additionally or alternatively, further including a bracket mounted to the helmet and a positioning member coupled to the bracket, wherein positioning member rotates to allow the user to position the image guide within a field of view of the user.
  • a holographic display system capable of displaying information to a user based upon data received by the system is disclosed, the system
  • a housing comprising: a housing; a light engine contained within the housing; an image guide optically coupled to the light engine, the image guide residing substantially outside the housing; wherein the light engine receives the data and generates a light-based image, and wherein the image guide propagates the light-based image along its length and produces a holographic display that is viewable by the user.
  • further including a plurality of diffraction gratings wherein one of the plurality of diffraction gratings optically couples the light engine to the image guide. Additionally or alternatively, wherein one of the plurality of diffraction gratings directs the light-based image out of the image guide to an eye of the user.
  • one of the plurality of diffraction gratings expands the light-based image in a vertical direction. Additionally or alternatively, wherein one of the plurality of diffraction gratings expands the light-based image in a horizontal direction. Additionally or alternatively, further including a mask, and wherein the display system is coupled to the mask. Additionally or alternatively, wherein the mask includes a mask lens, and wherein the image guide is disposed in between a face of the user and the mask lens.
  • a helmet further including a helmet, and wherein the display system is coupled to the helmet. Additionally or alternatively, further including a bracket mounted to the helmet and a positioning member coupled to the bracket, wherein positioning member rotates to allow the user to position the image guide within a field of view of the user.
  • the mask comprising: a mask lens, the mask lens sized and configured to create a cavity between the user’s face and the mask lens; a coupling device mounted on or proximate the mask lens; a holographic display system coupled to the coupling device, the holographic display system including an outside portion and an inside portion, the outside portion residing outside the cavity and the inside portion residing inside the cavity, the holographic display system including: a light engine residing in the outside portion; an image guide optically coupled to the light engine and included with the inside portion; a first diffraction grating coupled to a distal end of the image guide proximate the light engine; and a second diffraction grating coupled to a proximate end of the image guide, wherein the light engine, image guide, and first and second diffraction gratings operate to provide the substantially see-through information to the user.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Holo Graphy (AREA)

Abstract

A display system with a holographic image guide provides an integrated display for optical devices that allows augmenting information to be overlaid on a user's field of view. The display system has a reduced form factor that allows the display to ergonomically integrate into existing and future optical devices, such as glasses, helmets, masks, and goggles. The holographic display system can be used behind other optical enhancement devices, such as night vision goggles. The display system is relatively lightweight and can provide sufficient visible light intensities (e.g., 14,000 nits) so that the augmenting information is readable when the scene viewed by the user is in bright sunlight. Variable intensity control also allows the augmenting information to be displayed and viewed in a wide range of other conditions, including low light, night vision, underwater, and low visibility.

Description

MASK WITH INTEGRATED DISPLAY SYSTEM
FIELD OF INVENTION
[0001] The present invention generally relates to optics for displaying images in a user’s field of view. In particular, the present invention is directed to a Mask with Integrated Display System.
BACKGROUND
[0002] Augmented reality can be used to provide information in a user’s visual field to enhance situational awareness. In an augmented reality system using a see-through lens, the user’s field of view is augmented with images that overlay the scene in the field of view. These images may include information about the scene being viewed, and that information can be displayed independently from the scene or integrated within it (e.g., augmenting information may include the direction the user is looking, the distance an object being viewed is from the user, or an identification of the nature of an object being viewed).
[0003] While a variety of augmented reality systems have been developed, there is a need for an augmented reality system that can withstand rugged environments and that is implemented with display hardware that has a minimal impact on the user’s field of view.
SUMMARY
[0004] In an embodiment, an augmented reality display system that displays a see-through image representative of information to a user is disclosed, the display system comprising: a light engine for receiving and processing the information so as to develop a see-through image; a lens optically coupled to the light engine, the lens sized and configured to focus the see-through image; an image guide optically coupled to the lens so as to receive the see-through image; an input holographic expander grating disposed on the image guide; and an output holographic expander grating disposed within the image guide, wherein the see-through image is directed to the input holographic expander grating by the lens, wherein the input holographic expander grating expands the image and redirects the expanded image into the image guide where the image is internally reflected until reaching the output holographic expander grating, and wherein the output holographic expander grating expands the received image and redirects the expanded image toward a user’s eye.
[0005] In another embodiment, a holographic display system capable of displaying information to a user based upon data received by the system is disclosed, the system
comprising: a housing; a light engine contained within the housing; an image guide optically coupled to the light engine, the image guide residing substantially outside the housing; wherein the light engine receives the data and generates a light-based image, and wherein the image guide propagates the light-based image along its length and produces a holographic display that is viewable by the user.
[0006] In yet another embodiment, a mask with integrated display for displaying
substantially see-through information to a user without interference with the user’s field of view is disclosed, the mask comprising: a mask lens, the mask lens sized and configured to create a cavity between the user’s face and the mask lens; a coupling device mounted on or proximate the mask lens; a holographic display system coupled to the coupling device, the holographic display system including an outside portion and an inside portion, the outside portion residing outside the cavity and the inside portion residing inside the cavity, the holographic display system including: a light engine residing in the outside portion; an image guide optically coupled to the light engine and included with the inside portion; a first diffraction grating coupled to a distal end of the image guide proximate the light engine; and a second diffraction grating coupled to a proximate end of the image guide, wherein the light engine, image guide, and first and second diffraction gratings operate to provide the substantially see-through information to the user.
BRIEF DESCRIPTION OF THE DRAWINGS
[0007] For the purpose of illustrating the invention, the drawings show aspects of one or more embodiments of the invention. However, it should be understood that the present invention is not limited to the precise arrangements and instrumentalities shown in the drawings, wherein:
FIG. l is a block diagram of a holographic display system according to an embodiment of the present invention; FIG. 2 is a block diagram showing the expansion of an image using a holographic display system according to an embodiment of the present invention;
FIG. 3 is a block diagram of another holographic display system according to an embodiment of the present invention;
FIG. 4 is a block diagram of yet another holographic display system according to an embodiment of the present invention;
FIG. 5 is a perspective view of a holographic display system according to an embodiment of the present invention;
FIG. 6 is an illustration of a holographic display system integrated into a firefighter helmet according to an embodiment of the present invention;
FIG. 7 is an illustration of a holographic display system integrated into a firefighter full face mask according to an embodiment of the present invention;
FIG. 8 is an illustration of a holographic display system integrated into a full face scuba mask according to an embodiment of the present invention; and
FIG. 9 is a process diagram of integrating sensor input to produce a holographic display with augmenting information according to embodiment of the present invention.
DESCRIPTION OF THE DISCLOSURE
[0008] A mask with integrated display system according to embodiments of the present invention includes a holographic image guide as part of an optical device. The integrated display system shows augmenting information that is overlaid, in a substantially see-through fashion, upon the images that are viewable through the optical device. A reduced form factor allows the integrated display system to be ergonomically integrated into existing and to-be-developed optical devices, such as glasses, helmets, masks, and goggles. The integrated display system can be used behind other optical enhancement devices, such as night vision goggles. The integrated display system is relatively lightweight and can provide sufficient visible light intensities (e.g., 14,000 nits) so that the display is readable when the scene viewed by the user is in bright sunlight. Variable intensity control for the images also allows for augmenting information to be displayed and viewed in a wide range of other conditions, including low light, night, underwater, and low visibility (e.g., due to smoke or fog).
[0009] The augmenting information may be displayed within a resolution range of about 960 x 540 to 1980 x 1080 pixels in three colors (red-blue-green/RGB), which allows full-color rendering of information for increased comprehension and prioritization, and can encompass approximately 40 degrees of the user’s field of view. The holographic display system is applicable to many augmented reality uses, including low light multispectral imaging, information overlay for ground troops, pilots and mission command, see-through cockpit sensor fusion, and situational awareness enhancement.
[0010] Turning to FIG. 1, a holographic display system 100 provides additional information to the user that is overlaid, in a substantially see-through fashion, upon the scene that is viewable by the user, with or without, another optical element, such as a mask lens 104. In an
embodiment, holographic display system 100 includes a light engine 108, lens 112, holographic optical elements (HOE) 116 (HOEs 116A and 116B), and an image guide 120 that combine to produce a holographic image display (HID) 124 for viewing by the user. At a high level, holographic display system 100 produces viewable information 128 by sending inputs from light engine 108 to lens 112, then to HOE 116A for propagation along image guide 120 to HOE 116B, which reflects the information to the user in the form of holographic image display 124.
[0011] In certain embodiments, HOE 116A and 116B are holographic expander gratings, input holographic expander grating 116A and output holographic expander grating 116B. As an example, and with reference to FIGS. 1 and 2, an image (including for videos) to be presented within a user’s field of view, such as a message, symbol, color, or shape, is projected from light engine 108 toward lens 112, which focuses the image and passes it through image guide 120 towards input holographic expander grating 116 A. It should be noted that while HOEs 116 are shown on a given side of image guide 120 in FIG. 1, the HOEs can be positioned in other suitable locations including within the image guide. Input holographic expander grating 116A expands the image horizontally (as shown schematically in FIG. 2) and redirects the image along image guide 120 such that total internal reflection occurs and the image reaches output holographic expander grating 116B. Output holographic expander grating 116B expands the image vertically (as shown schematically in FIG. 2) and redirects the image to the user’s eye 130. With this combination of specialized holographic diffraction gratings residing inside image guide 120, which is a thin sheet of transparent or semi-transparent substrate (e.g., glass, plastic, etc.), an image is sent from light engine 108 to eye 130 with appropriate horizontal and vertical expansion. Additionally, as image guide 120 is thin and transparent, holographic display system 100 allows the user to see a largely unobstructed view of the real-world while also allowing the user to see augmenting information. This arrangement also allows holographic display system 100 to be easily used in conjunction with other optical devices, such as dive goggles, binoculars, scopes, and night vision equipment.
[0012] In an embodiment, holographic display system 100 attenuates less than 1% of the light entering mask lens 104 (notable when comparing system 100 with, for example, beam splitting technologies which inherently attenuate 10% to 30% of the incoming light, which limits use in low light conditions). In an embodiment, holographic display system 100 can include a camera 132 (as seen in FIG. 1) to view and track the user’s eyeball (along light path 136) for various inputs, e.g., retinal authentication or identification, or can allow the user to interact with the display or allow tracking of wherein the field of view the user is focused. In certain embodiments, illumination, such as infrared light, can also be provided at camera 132 so as to assist with the analysis of the location of the eyeball (infrared light can be used to“pull” an image of the user’s eye by sending infrared light down it). The light illuminates the user’s iris and retina. This light is then sent back up the image guide where a camera captures the image and then is processed. In this way, the image guide is used to display an image to the user and to gather an image from the eye.
[0013] Light engine 108 can produce a full color, sunlight readable, high resolution holographic image for transmission to a user of mask 104. The image produced by light engine 108 can be read against the brightest scenery (e.g., a sunlit cloud in the sky), while still dimming enough to be compatible with night vision goggles. Beam splitting prisms cannot handle full color without further attenuation over the attenuation discussed above and cannot produce images with the desired clarity/readability in bright light (sunlight). [0014] With reference to FIG. 3, light engine 108 includes a processor 140 and receives information from one or more inputs 144. Processor 140 is preferably a high performance, low power processor, with accelerated image processing, capable of executing a set of instructions (described in more detail below) such that light engine 108 can produce homographic image display 124 from inputs 144. Processor 140 can provide real-time image processing for inputted video, such as high dynamic range processing, sensor fusion, contrast enhancement, and low light processing. In certain embodiments, processor 140, in combination with inputs 144, provides geo-referenced augmented reality information when connected real-time or with preloaded object location information.
[0015] Lens 112 is sized and configured to transmit the display information from light engine 108 to HOE 116A such that the display information can be transmitted through image guide 120. HOE 116A may also have the optical functions of lens 112 included into its design, thus eliminating the need for the extra optic(s).
[0016] HOEs 116 are translucent selective wavelength gratings that are designed and configured to steer displayable information 128 into and out of image guide 120. In an embodiment, HOEs 116 are capable of directing displayable information 128 through image guide 120 using total internal reflections. As shown in FIG. 1, HOE 116A modifies displayable information 128 received from light engine 108 so as to guide the display information through image guide 120 toward HOE 116B. HOE 116B directs the display information to the user so that it can be viewed when looking through mask 104. In an embodiment, HOEs 116 are prepared using laser beam interference techniques. For example, two laser beams may be directed at a substrate so as to produce a pattern of straight lines with a sinusoidal cross section, with the pitch of the grating being approximately l / sin Q. Although FIG. 1 shows HOE 116A positioned between lens 112 and image guide 120, the HOE could also be positioned on the opposite side of the image guide.
[0017] Image guide 120 is a translucent plate that propagates wavelengths substantially internally. Image guide 120 can be many different shapes including, but not limited to, rectangular, circular, curvilinear, and can make up only a portion of lens 112. Image guide components have been made within various glasses for commercial photonic devices. The devices are based on planar image guides, in which light is confined to substrate-surface channels. Silica, SiON, fluoroaluminates, chalcogenides and doped glasses are possible glasses for making optical image guide devices. Bulk silica (Si02) and silica-on-silicon (Si02/Si) are common materials used to manufacture planar light wave circuits (PLCs), due to their refractive- index match with silica-based optical fiber. Glass/silica image guide PLCs typically consist of a planar arrangement of glass image guides with a higher index of refraction buried in glass all on a silicon or glass substrate. In certain embodiments, glass used to image guide 120 is suitable for the creating of diffraction gratings within the glass using a femtolaser. Suitable parameters of a laser for producing refractive index changes in a wide variety of transparent material include those described in U.S. Pat. No. 6,573,026, (Aitken et ah), U.S. Pat. No. 6,884,960 (Bourne et ah), and U.S. Pat. No. 6,853,785 (Dunn et ah), which are all incorporated herein by reference in their entirety.
[0018] As discussed above, light engine 108 receives one or more inputs 144 (shown in FIG. 3). The sources for inputs 144 can include, but are not limited to, a video input, a rangefinder input, a global position system coordinate or related information (e.g., a direction, an elevation, and/or a cant), an inertial measurement unit, and one or more sensor inputs (such as, but not limited to, temperature, pressure, humidity, wind speed, and light). The light engine associated with the holographic display system includes one or more software modules that are accessible by a processor. The software modules assist in importing, correlating, processing, and generating data from external sources, image processing, and the display to the user.
[0019] Turning now to FIG. 4, there is shown another embodiment of a holographic display system for inclusion with other eyewear, masks, helmets, or optical devices, holographic display system 200. At a high level, holographic display system 200 provides useful information to a user of eyewear that is overlaid upon what the user can view through the optics provided with the eyewear, the useful information being collected/received from a plurality of source devices 212 (212A - 212G). For example, additional information that may be useful to the user depending on the situation (e.g., a mask for a firefighter) includes, but is not limited to, environmental information and situational information, which may be provided to the user via holographic display system 200. In the embodiment shown in FIG. 4, holographic display system 200 includes a processor 204 that receives information from one or more ports 208 (208A-208B) and one or more source devices 212 (sensors or similar information gathering devices). Processor 204 interacts with a video processor 216 which can receive inputs from video inputs 220 (220 A- 220B). Video processor 216 provides information to projector 224, which transmits the images that appear on holographic image display 228.
[0020] Processor 204 can be a microprocessor suitable for processing large volumes of information without requiring a significant power source (preferably less than 0.5 watt).
Processor 204 can be designed and configured to allow for the transmission of information from one or more ports 208, such as a RS-232 serial port, micro-USB port, USB-A, B, or C port, and the like, that may be coupled to the processor via coupling hardware known in the art. These ports 208 can allow for information collection and alignment from ancillary equipment such as thermal cameras, optical zooms, night vision equipment, or communication devices that couple via an internet protocol to the Internet so as to provide additional information to the user.
Processor 204 can also receive information from one or more source devices 212, such as, but not limited to, GPS sensor 212A, temperature sensor 212B, pressure sensor 212C, humidity sensor 212D, and one or more inertial measurement units (IMU) 212E-F, and a rangefinder 212G. Combinations of information from one or more of source devices 212 may be used by processor 204 to provide valuable information to the user. IMUs 212E and F can produce a compass heading as well as a 9-degree freedom of pose estimation (heading, inclination, and cant/roll). Processor 204 can be also designed and configured to allow for the transmission of information wirelessly via any wireless standard or protocols, such as, but not limited to, RFID, Bluetooth, Wi-Fi, ZigBee, WiMax, WiGig, ETltra Wide Band, or a Wireless Wide Area Network (e g., TDMA, CDMA, GSM, UMTS, EV-DO, LTE), etc.
[0021] Video processor 216 is specially configured to perform low power video processing. In an embodiment, video processor 216 is capable of processing information from up to six video inputs 220. Video processor 216 also drives the projector 224 and the display of information onto holographic image display 228. Video processor 216 can receive an external power supply from video input 220 A and can receive external video feed(s) from video input 220B. [0022] Projector 224 receives display information from video processor 216 and projects it to holographic image display 228. The combination of projector 224 and holographic image display 228 can be similar to the setup of holographic display system 100, with projector 224 sending display information through a lens, into a HOE, through an image guide, and to another HOE, before it is displayed to the user.
[0023] Another example of a holographic display system, holographic display system 300, is shown in FIG. 5. In this embodiment, holographic display system 300 has a form factor that allows for a light engine (found in enclosure 304) to reside external to a direct view optic while at least a portion of wave guide 308 (image portion 312) can reside inside a mask or similar at a desired location. As exemplified in the examples discussed below, the form factor of holographic display system 300 is versatile and adaptable to a number of applications.
[0024] FIG. 6 shows an implementation of a holographic display system 400 coupled to a military style helmet. Holographic display system 400 can be constructed and configured similarly to one of the systems discussed above. As shown in FIG. 6, holographic display system 400 is mounted to helmet 404 via a mounting system 408. Mounting system 408 includes a bracket 412 that is coupled directly to helmet 404 and a positioning member 416, which is removably slidably engaged with bracket 412. Positioning member 416 is designed and configured to place a portion of holographic display system 400 outside the view of the user (e.g., an enclosure with the light engine) while positioning the image guide and holographic image display within the view of the user. Positioning member 416 may have a swivel 420 that allows the user to move the holographic display system 400 away from the user’s face. Power and communications may be provided to holographic display system 400 via auxiliary equipment carried by the user and coupled to the holographic display system via helmet 404 (such as by cable 424).
[0025] FIG. 7 shows a holographic display system 500 coupled to a full fire-fighter’s mask 504. In this embodiment, an outside portion 508 of holographic display system 500 resides outside mask 504, while an inside portion 512 resides inside the mask. Also included is a coupler 516 that securely mounts holographic display system 500 to mask 504, and prevents ingress of smoke, fumes, and unwanted particles from entering the user’s internal mask area 518. As can be seen in FIG. 7, holographic display system 500 receives information and power via connection 520 and includes a thermal camera 524 and light engine 108 inside outside portion 508.
[0026] FIG. 8 shows a holographic display system 600 coupled to a scuba mask 604.
Similar to the previous example, holographic display system 600 has an outer portion 608 that resides outside mask 604 and an inside portion 612 that resides inside the mask. As scuba masks are used in liquid environments and under high pressures, outer portion 608 includes an enclosure 616 designed and configured to address these environmental concerns. For example, enclosure 616 would be water-proof, but, so as to allow for cooling of the processor and electronics associated with the light engine (inside enclosure 616), may include a plurality of fins 620 that serve to cool those components.
[0027] FIG. 9 shows a diagrammatic representation of one implementation of a
machine/computing device 700 that can be used to implement a set of instructions for causing one or more components of a holographic display system, for example, light engine 108, to perform any one or more of the aspects and/or methodologies of the present disclosure. In general, an example holographic display system may be implemented as part of a direct view optic; however, other embodiments of the holographic display system may be implemented as a wearable or body-mountable display device (also referred to as a wearable computing device), such as a head-mountable device (HMD), or display that may be attached or mounted to a user, such as by an arm-band, wrist band, wrist mount, or a chest-mount system, among other possibilities.
[0028] Device 700 includes a processor 704 and a memory 708 that communicate with each other, and with other components, such as inputs 144, via a bus 712. Processor 704 can be, for example, a micro-processor or a digital signal processor. Bus 712 may include any of several types of communication structures including, but not limited to, a memory bus, a memory controller, a peripheral bus, a local bus, and any combinations thereof, using any of a variety of architectures. [0029] Memory 708 may include various components (e.g., machine-readable media) including, but not limited to, a random-access memory component (e.g., a static RAM“SRAM”, a dynamic RAM“DRAM”, etc.), a read-only component, and any combinations thereof. In one example, a basic input/output system 716 (BIOS), including basic routines that help to transfer information between elements within device 700, such as during start-up, may be stored in memory 708. Memory 708 may also include (e.g., stored on one or more machine-readable media) instructions (e.g., software) 720 embodying any one or more of the aspects and/or methodologies of the present disclosure. In another example, memory 708 may further include any number of program modules including, but not limited to, an operating system, one or more application programs, other program modules, program data, and any combinations thereof.
[0030] Device 700 may also include a storage device 724. Examples of a storage device (e.g., storage device 724) include, but are not limited to, a hard disk drive for reading from and/or writing to a hard disk, a flash-drive, solid-state memory device, or other memory devices known in the art and any combinations thereof. Storage device 724 may be connected to bus 712 by an appropriate interface (not shown). Example interfaces include, but are not limited to, SCSI, advanced technology attachment (ATA), serial ATA, universal serial bus (all types) (ETSB),
IEEE 1395, and any combinations thereof. In one example, storage device 724 may be removably interfaced with device 700 (e.g., via an external port connector). Particularly, storage device 724 and an associated machine-readable medium 728 may provide nonvolatile and/or volatile storage of machine-readable instructions, data structures, program modules, and/or other data for light engine 108. In one example, instructions 720 may reside, completely or partially, within machine-readable medium 728. In another example, instructions 720 may reside, completely or partially, within processor 704.
[0031] Device 700 may also include a connection to one or more inputs/sensors, such as inputs 144 and/or source devices 212. Sensors may be interfaced to bus 712 via any of a variety of interfaces (not shown) including, but not limited to, a serial interface, a parallel interface, a game port, a USB interface, a FIREWIRE interface, a direct connection to bus 712, wireless, and any combinations thereof. Alternatively, in one example, a user of device 700 may enter commands and/or other information into device 700 via an input device (not shown). Examples of an input device 732 include, but are not limited to, an alpha-numeric input device (e.g., a keyboard), a pointing device, an audio input device (e.g., a microphone, a voice response system, etc.), a cursor control device (e.g., a mouse), a touchpad, an optical scanner, a video capture device (e.g., a still camera, a video camera), touchscreen, and any combinations thereof.
[0032] A user may also input commands and/or other information to device 700 via storage device 724 (e.g., a removable disk drive, a flash drive, etc.) and/or a network interface device 736. A network interface device, such as network interface device 736, may be utilized for connecting device 700 to one or more of a variety of networks, such as network 740, and one or more remote devices 744 connected thereto. Examples of a network interface device include, but are not limited to, a network interface card, a modem, and any combination thereof. Examples of a network include, but are not limited to, a wide area network (e.g., the Internet, an enterprise network), a local area network (e.g., a network associated with an office, a building, a campus or other relatively small geographic space), a telephone network, a direct connection between two computing devices, and any combinations thereof. A network, such as network 740, may employ a wired and/or a wireless mode of communication. In general, any network topology may be used. Information (e.g., data, instructions 720, etc.) may be communicated to and/or from device 700 via network interface device 736.
[0033] In some embodiments, device 700 may receive video, sensor or other data wirelessly according to one or more wireless standards or protocols, such as, but not limited to, RFID, Bluetooth, Wi-Fi, ZigBee, WiMax, WiGig, Ultra Wide Band, or a Wireless Wide Area Network (e.g., TDMA, CDMA, GSM, UMTS, EV-DO, LTE), etc. In other embodiments, processing device 330 may receive the video, sensor or other data by one or more wired protocols such as, but not limited to, a Universal Serial Bus protocol, a Registered Jack protocol (e.g., RJ-25), or a wired Local Area Network protocol (e.g., Ethernet). In other examples, video, sensor and other data may be received by the processing device from a portable storage device such as a memory card, flash drive, or zip drive.
[0034] Device 700 may further include a video display adapter 748 for communicating a displayable image to a display device 752. Examples of a display device 752 include, but are not limited to, a holographic display, a liquid crystal display (LCD), a plasma display, and any combinations thereof.
[0035] In addition to display device 752, device 700 may include a connection to one or more other peripheral output devices including, for example, an audio speaker. Peripheral output devices may be connected to bus 712 via a peripheral interface 756. Examples of a peripheral interface include, but are not limited to, a serial port, a USB connection, a FIREWIRE connection, a parallel connection, a wireless connection, and any combinations thereof.
[0036] In an embodiment, an augmented reality display system that displays a see-through image representative of information to a user is disclosed, the display system comprising: a light engine for receiving and processing the information so as to develop a see-through image; a lens optically coupled to the light engine, the lens sized and configured to focus the see-through image; an image guide optically coupled to the lens so as to receive the see-through image; an input holographic expander grating disposed on the image guide; and an output holographic expander grating disposed within the image guide, wherein the see-through image is directed to the input holographic expander grating by the lens, wherein the input holographic expander grating expands the image and redirects the expanded image into the image guide where the image is internally reflected until reaching the output holographic expander grating, and wherein the output holographic expander grating expands the received image and redirects the expanded image toward a user’s eye. Additionally or alternatively, further including a housing and wherein the light engine and the lens are contained within the housing. Additionally or alternatively, wherein the image guide, the input holographic expander grating, and the output holographic expander grating reside outside the housing. Additionally or alternatively, wherein the input holographic expander grating expands the image horizontally. Additionally or alternatively, wherein the output holographic expander grating expands the image vertically. Additionally or alternatively, further including a mask, and wherein the display system is coupled to the mask. Additionally or alternatively, wherein the mask includes a mask lens, and wherein the image guide is disposed in between a face of the user and the mask lens. Additionally or alternatively, further including a helmet, and wherein the display system is coupled to the helmet. Additionally or alternatively, further including a bracket mounted to the helmet and a positioning member coupled to the bracket, wherein positioning member rotates to allow the user to position the image guide within a field of view of the user.
[0037] In another embodiment, a holographic display system capable of displaying information to a user based upon data received by the system is disclosed, the system
comprising: a housing; a light engine contained within the housing; an image guide optically coupled to the light engine, the image guide residing substantially outside the housing; wherein the light engine receives the data and generates a light-based image, and wherein the image guide propagates the light-based image along its length and produces a holographic display that is viewable by the user. Additionally or alternatively, further including a plurality of diffraction gratings. Additionally or alternatively, wherein one of the plurality of diffraction gratings optically couples the light engine to the image guide. Additionally or alternatively, wherein one of the plurality of diffraction gratings directs the light-based image out of the image guide to an eye of the user. Additionally or alternatively, wherein one of the plurality of diffraction gratings expands the light-based image in a vertical direction. Additionally or alternatively, wherein one of the plurality of diffraction gratings expands the light-based image in a horizontal direction. Additionally or alternatively, further including a mask, and wherein the display system is coupled to the mask. Additionally or alternatively, wherein the mask includes a mask lens, and wherein the image guide is disposed in between a face of the user and the mask lens.
Additionally or alternatively, further including a helmet, and wherein the display system is coupled to the helmet. Additionally or alternatively, further including a bracket mounted to the helmet and a positioning member coupled to the bracket, wherein positioning member rotates to allow the user to position the image guide within a field of view of the user.
[0038] In yet another embodiment, a mask with integrated display for displaying
substantially see-through information to a user without interference with the user’s field of view is disclosed, the mask comprising: a mask lens, the mask lens sized and configured to create a cavity between the user’s face and the mask lens; a coupling device mounted on or proximate the mask lens; a holographic display system coupled to the coupling device, the holographic display system including an outside portion and an inside portion, the outside portion residing outside the cavity and the inside portion residing inside the cavity, the holographic display system including: a light engine residing in the outside portion; an image guide optically coupled to the light engine and included with the inside portion; a first diffraction grating coupled to a distal end of the image guide proximate the light engine; and a second diffraction grating coupled to a proximate end of the image guide, wherein the light engine, image guide, and first and second diffraction gratings operate to provide the substantially see-through information to the user.
[0039] Exemplary embodiments have been disclosed above and illustrated in the accompanying drawings. It will be understood by those skilled in the art that various changes, omissions and additions may be made to that which is specifically disclosed herein without departing from the spirit and scope of the present invention.

Claims

What is claimed is:
1. An augmented reality display system that displays a see-through image representative of information to a user, the display system comprising:
a light engine for receiving and processing the information so as to develop a see- through image;
a lens optically coupled to the light engine, the lens sized and configured to focus the see-through image;
an image guide optically coupled to the lens so as to receive the see-through
image;
an input holographic expander grating disposed on the image guide; and an output holographic expander grating disposed within the image guide, wherein the see-through image is directed to the input holographic expander grating by the lens, wherein the input holographic expander grating expands the image and redirects the expanded image into the image guide where the image is internally reflected until reaching the output holographic expander grating, and wherein the output holographic expander grating expands the received image and redirects the expanded image toward a user’s eye.
2. An augmented reality display system according to claim 1, further including a housing and wherein the light engine and the lens are contained within the housing.
3. An augmented reality display system according to claim 2, wherein the image guide, the input holographic expander grating, and the output holographic expander grating reside outside the housing.
4. An augmented reality display system according to claim 1, wherein the input holographic expander grating expands the image horizontally.
5. An augmented reality display system according to claim 1, wherein the output
holographic expander grating expands the image vertically.
6. An augmented reality display system according to claim 1, further including a mask, and wherein the display system is coupled to the mask.
7. An augmented reality display system according to claim 6, wherein the mask includes a mask lens, and wherein the image guide is disposed in between a face of the user and the mask lens.
8. An augmented reality display system according to claim 1, further including a helmet, and wherein the display system is coupled to the helmet.
9. An augmented reality display system according to claim 8, further including a bracket mounted to the helmet and a positioning member coupled to the bracket, wherein positioning member rotates to allow the user to position the image guide within a field of view of the user.
10. A holographic display system capable of displaying information to a user based upon data received by the system, the system comprising:
a housing;
a light engine contained within the housing;
an image guide optically coupled to the light engine, the image guide residing substantially outside the housing;
wherein the light engine receives the data and generates a light-based image, and wherein the image guide propagates the light-based image along its length and produces a holographic display that is viewable by the user.
11. A holographic display system according to claim 10, further including a plurality of diffraction gratings.
12. A holographic display system according to claim 11, wherein one of the plurality of diffraction gratings optically couples the light engine to the image guide.
13. A holographic display system according to claim 11, wherein one of the plurality of diffraction gratings directs the light-based image out of the image guide to an eye of the user.
14. A holographic display system according to claim 11, wherein one of the plurality of diffraction gratings expands the light-based image in a vertical direction.
15. A holographic display system according to claim 11, wherein one of the plurality of diffraction gratings expands the light-based image in a horizontal direction.
16. A holographic display system according to claim 10, further including a mask, and wherein the display system is coupled to the mask.
17. A holographic display system according to claim 16, wherein the mask includes a mask lens, and wherein the image guide is disposed in between a face of the user and the mask lens.
18. A holographic display system according to claim 10, further including a helmet, and wherein the display system is coupled to the helmet.
19. A holographic display system according to claim 18, further including a bracket mounted to the helmet and a positioning member coupled to the bracket, wherein positioning member rotates to allow the user to position the image guide within a field of view of the user.
20. A mask with integrated display for displaying substantially see-through information to a user without interference with the user’s field of view, the mask comprising:
a mask lens, the mask lens sized and configured to create a cavity between the user’s face and the mask lens;
a coupling device mounted on or proximate the mask lens;
a holographic display system coupled to the coupling device, the holographic display system including an outside portion and an inside portion, the outside portion residing outside the cavity and the inside portion residing inside the cavity, the holographic display system including:
a light engine residing in the outside portion;
an image guide optically coupled to the light engine and included with the inside portion;
a first diffraction grating coupled to a distal end of the image guide proximate the light engine; and
a second diffraction grating coupled to a proximate end of the image guide,
wherein the light engine, image guide, and first and second
diffraction gratings operate to provide the substantially see- through information to the user.
PCT/US2019/051432 2018-09-17 2019-09-17 Mask with integrated display system WO2020060989A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201862732361P 2018-09-17 2018-09-17
US201862732370P 2018-09-17 2018-09-17
US62/732,370 2018-09-17
US62/732,361 2018-09-17

Publications (1)

Publication Number Publication Date
WO2020060989A1 true WO2020060989A1 (en) 2020-03-26

Family

ID=69887929

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/US2019/051432 WO2020060989A1 (en) 2018-09-17 2019-09-17 Mask with integrated display system
PCT/US2019/051501 WO2020123006A2 (en) 2018-09-17 2019-09-17 Multi-use mask with optional display and integrated pressurization and equalization

Family Applications After (1)

Application Number Title Priority Date Filing Date
PCT/US2019/051501 WO2020123006A2 (en) 2018-09-17 2019-09-17 Multi-use mask with optional display and integrated pressurization and equalization

Country Status (1)

Country Link
WO (2) WO2020060989A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113391448A (en) 2021-04-27 2021-09-14 青岛小鸟看看科技有限公司 Packaging structure that VR wore wears and VR head

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5093567A (en) * 1989-07-14 1992-03-03 Gec-Marconi Limited Helmet systems with eyepiece and eye position sensing means
US6384982B1 (en) * 1996-10-08 2002-05-07 The Microoptical Corporation Compact image display system for eyeglasses or other head-borne frames
US9927614B2 (en) * 2015-12-29 2018-03-27 Microsoft Technology Licensing, Llc Augmented reality display system with variable focus

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7762252B2 (en) * 2006-04-26 2010-07-27 Mine Safety Appliances Company Devices, systems and methods for operation of breathing apparatuses in multiple modes
JP5402293B2 (en) * 2009-06-22 2014-01-29 ソニー株式会社 Head-mounted display and image display method in head-mounted display
US8810913B2 (en) * 2010-01-25 2014-08-19 Bae Systems Plc Projection display
WO2011106797A1 (en) * 2010-02-28 2011-09-01 Osterhout Group, Inc. Projection triggering through an external marker in an augmented reality eyepiece
DE102011082208A1 (en) * 2011-09-06 2013-03-07 Carl Zeiss Ag Diving or swimming goggles has spectacle lens, which has coupling region and decoupling region, where image module couples image produced on coupling region into spectacle lens
US9213178B1 (en) * 2014-04-21 2015-12-15 Google Inc. Lens with lightguide insert for head wearable display
US9557569B2 (en) * 2014-05-02 2017-01-31 Microsoft Technology Licensing, Llc Augmented reality system eye relief adjustment mechanism
CA2994231C (en) * 2015-10-16 2022-06-21 Leia Inc. Multibeam diffraction grating-based near-eye display
US10185151B2 (en) * 2016-12-20 2019-01-22 Facebook Technologies, Llc Waveguide display with a small form factor, a large field of view, and a large eyebox

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5093567A (en) * 1989-07-14 1992-03-03 Gec-Marconi Limited Helmet systems with eyepiece and eye position sensing means
US6384982B1 (en) * 1996-10-08 2002-05-07 The Microoptical Corporation Compact image display system for eyeglasses or other head-borne frames
US9927614B2 (en) * 2015-12-29 2018-03-27 Microsoft Technology Licensing, Llc Augmented reality display system with variable focus

Also Published As

Publication number Publication date
WO2020123006A2 (en) 2020-06-18
WO2020123006A3 (en) 2020-08-20

Similar Documents

Publication Publication Date Title
CN108292048B (en) Extended field of view in near-eye displays using wide spectrum imagers
JP6387825B2 (en) Display system and information display method
US11092796B2 (en) Long range infrared imager systems and methods
US9323061B2 (en) Viewer with display overlay
US7436568B1 (en) Head mountable video display
JP7087481B2 (en) Head-mounted display device, display control method, and computer program
CN106707508A (en) Cap type virtual reality display image system
KR20170042332A (en) Waveguide eye tracking employing volume bragg grating
US10520724B2 (en) Multi-wavelength head up display systems and methods
US10642038B1 (en) Waveguide based fused vision system for a helmet mounted or head worn application
US7746551B2 (en) Vision system with eye dominance forced to fusion channel
US11206341B2 (en) Fusion night vision system
JP6590050B2 (en) Display device, display system, display device control method, and program
US10412378B2 (en) Resonating optical waveguide using multiple diffractive optical elements
JP7353174B2 (en) Apparatus and method for augmented reality
US6674493B2 (en) Head mounted display using single display including only one liquid crystal shutter
North et al. Compact and high-brightness helmet-mounted head-up display system by retinal laser projection
KR100713024B1 (en) Projection type head mounted display apparatus
WO2016101861A1 (en) Head-worn display device
WO2020060989A1 (en) Mask with integrated display system
US20190011702A1 (en) Helmet-Mounted Visualization Device Without Parallax and its Operation Method
US20230360290A1 (en) Reticle alignment
US20130127986A1 (en) Common holographic imaging platform
US11514649B2 (en) Camera for augmented reality display
US11867908B2 (en) Folded optic augmented reality display

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19863475

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19863475

Country of ref document: EP

Kind code of ref document: A1