WO2024041034A1 - 一种显示模组、光学显示***、终端设备及成像方法 - Google Patents
一种显示模组、光学显示***、终端设备及成像方法 Download PDFInfo
- Publication number
- WO2024041034A1 WO2024041034A1 PCT/CN2023/093125 CN2023093125W WO2024041034A1 WO 2024041034 A1 WO2024041034 A1 WO 2024041034A1 CN 2023093125 W CN2023093125 W CN 2023093125W WO 2024041034 A1 WO2024041034 A1 WO 2024041034A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- light source
- light
- position information
- component
- control signal
- Prior art date
Links
- 230000003287 optical effect Effects 0.000 title claims abstract description 119
- 238000003384 imaging method Methods 0.000 title claims abstract description 35
- 238000007493 shaping process Methods 0.000 claims abstract description 58
- 238000000034 method Methods 0.000 claims description 41
- 210000001508 eye Anatomy 0.000 description 174
- 238000010586 diagram Methods 0.000 description 59
- 230000015654 memory Effects 0.000 description 36
- 230000000875 corresponding effect Effects 0.000 description 31
- 238000012545 processing Methods 0.000 description 29
- 230000006870 function Effects 0.000 description 28
- 238000003860 storage Methods 0.000 description 15
- 230000008569 process Effects 0.000 description 14
- 238000004891 communication Methods 0.000 description 12
- 238000004590 computer program Methods 0.000 description 12
- 238000005516 engineering process Methods 0.000 description 11
- 239000011521 glass Substances 0.000 description 10
- 230000004075 alteration Effects 0.000 description 7
- 230000004438 eyesight Effects 0.000 description 6
- 239000000463 material Substances 0.000 description 6
- 230000004888 barrier function Effects 0.000 description 5
- 238000009826 distribution Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 229920001621 AMOLED Polymers 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 4
- 230000033001 locomotion Effects 0.000 description 4
- 238000003491 array Methods 0.000 description 3
- 230000003190 augmentative effect Effects 0.000 description 3
- 230000001276 controlling effect Effects 0.000 description 3
- 238000013500 data storage Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 230000000737 periodic effect Effects 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 230000005236 sound signal Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 230000004424 eye movement Effects 0.000 description 2
- 239000000446 fuel Substances 0.000 description 2
- 230000014509 gene expression Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 239000011347 resin Substances 0.000 description 2
- 229920005989 resin Polymers 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- FOXXZZGDIAQPQI-XKNYDFJKSA-N Asp-Pro-Ser-Ser Chemical compound OC(=O)C[C@H](N)C(=O)N1CCC[C@H]1C(=O)N[C@@H](CO)C(=O)N[C@@H](CO)C(O)=O FOXXZZGDIAQPQI-XKNYDFJKSA-N 0.000 description 1
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000004308 accommodation Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 239000011248 coating agent Substances 0.000 description 1
- 238000000576 coating method Methods 0.000 description 1
- 239000013078 crystal Substances 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000003921 oil Substances 0.000 description 1
- 239000005304 optical glass Substances 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 229920001690 polydopamine Polymers 0.000 description 1
- 239000002096 quantum dot Substances 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 238000010408 sweeping Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/55—Specular reflectivity
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
Definitions
- the present application relates to the field of display technology, and in particular, to a display module, an optical display system, a terminal device and an imaging method.
- Three-dimensional (3D) display can give the observer a strong sense of three-dimensional realism, increase the display depth of field, and enhance the richness of the display content.
- 3D technology is based on two sets of image information for the left eye and the right eye, and projects them onto the screen.
- the observer uses polarized glasses to separate the image information, so that the left eye acquires a set of image information and the right eye Eyes obtain another set of image information.
- naked-eye 3D display technology also known as parallax barrier or parallax barrier technology
- naked-eye 3D display technology can achieve stereoscopic visual effects through light barrier technology without the use of external tools such as polarized glasses.
- 3D images displayed based on light barrier technology will cause a loss of resolution.
- the present application provides a display module, optical display system, terminal equipment and imaging method to reduce or eliminate the problem of resolution loss in displayed images.
- the present application provides a display module.
- the display module includes a light source component, an optical shaping component, a light modulating component and a reflecting component.
- the optical shaping component is located between the light source component and the light modulating component.
- the light source component is used to emit the first beam and the second beam in a time-sharing manner, and the first beam and the second beam have different exit positions.
- the optical shaping component is used to adjust the direction of the first light beam to obtain the third light beam, and adjust the direction of the second light beam to obtain the fourth light beam.
- the light modulation component is used to modulate the third light beam to obtain first image light carrying first image information, and to modulate the fourth light beam to obtain second image light carrying second image information.
- the reflective component is used to reflect the first image light to the observer's left eye for imaging, and to reflect the second image light to the observer's right eye for imaging.
- the optical shaping component is located between the light source component and the light modulation component, the light source component can cooperate with the optical shaping component to generate directional backlight, and the light modulation component loads the first image information or the second image information in a time-division manner.
- the observer can see the first image information or the second image information modulated by all pixels of the light modulation component with a single eye, therefore, the loss of resolution of the displayed image can be reduced or avoided.
- the first image light is imaged on the left eye
- the second image light is imaged on the right eye.
- the observer can observe different parallax images. If the first image information and the second image information are different, At the same time, a three-dimensional 3D image effect can be obtained.
- the light source assembly includes a light source array, and the light source array includes a first light source and a second light source.
- the light source component is configured to, according to the received first control signal, the first light source emit the first light beam during the first period, and the second light source emit the second light beam during the second period.
- the light source array can realize the division of multiple viewing areas in the eye box, so that observers can watch at different positions of the eye box.
- the first control signal includes position information of the first light source and position information of the second light source.
- the light sources in the light source array are distributed in a plane.
- the planarly distributed light source array can reduce the thickness of the display module and facilitate the processing of dense light source arrays.
- the light sources in the light source array are distributed in a curved surface.
- the light source array distributed through the curved surface can make the images seen by the observer at the edge and the center basically the same, thereby expanding the eye box range of the display module.
- the light sources in the light source array are distributed in polygonal rows.
- the light source array distributed in a polygon can make the image seen by the observer at the edge and center as consistent as possible while reducing the thickness of the display module as much as possible, thereby expanding the eye box range of the display module.
- the light source assembly includes a surface light source and a light valve; the surface light source is used to emit a surface beam; the light valve is used to open the light valve in the first position in the third period according to the received second control signal, The first beam of the surface beam is emitted through the first position, and the light valve of the second position is opened during the fourth period, and the second beam of the surface beam is emitted through the second position.
- the second control signal includes the first position information of the light valve and the second position information of the light valve.
- a pixelated light source with high modulation accuracy can be achieved, making the switching between the first beam and the second beam smoother in the eye tracking state, and the image flicker observed by the observer moving within the eye box is less , more stable; and by controlling the opening width of the light valve, it can accurately match a larger viewing depth range.
- the surface light source may be a planar surface light source, and/or the light valve may be a planar light valve.
- Using a flat surface light source and/or a flat light valve helps reduce the thickness of the display module.
- the optical shaping component includes a lens array. Further, the lenses in the lens array are distributed in a plane.
- the thickness of the display module can be further reduced. Furthermore, the lens array helps to improve the uniformity of the image formed based on the first image light or the second image light.
- the lens array includes an aspherical lens array.
- the aspherical lens array can focus the light beams in different directions on the same fixed point. Therefore, the aspherical lens can reduce the edge of the field of view of the display module. aberration.
- the aspherical lens array can not only reduce the aberration of the display module, but also in the case of a larger field of view (FOV), the light source component can also be designed as a planar light source array, which can reduce processing and assembly costs. the complexity.
- the lens array includes a Fresnel lens array.
- the edge of the image can be imaged through the Fresnel lens. The difference is small.
- the pitch p of the lenses in the lens array (referring to the effective diameter or effective aperture size of a single lens in the lens array) satisfies the following formula 1:
- ⁇ is the divergence angle of the first light beam and the divergence angle of the second light beam, whichever is larger
- h is the lateral luminous width of the first light source or the second light source
- t is the distance between the luminous surface of the light source component and the optical shaping component. The distance between faces close to the light modulating component.
- the light source i.e. the first light source or the second light source
- the light source array that is turned on once can illuminate the entire corresponding lens, thereby avoiding the existence of dark areas at the edge of the lens and affecting the display of the display module.
- Image uniformity i.e. the first light source or the second light source
- the pitch p of the lenses in the lens array satisfies the following formula 2:
- W eye is the distance between the virtual eyes on the virtual eye box surface
- d is the distance between the optical shaping component and the virtual eye box surface
- the virtual eye box surface is the virtual image formed by the reflection of the actual eye box surface by the reflective component
- t is the light source. The distance between the light-emitting surface of the component and the surface of the optical shaping component close to the light modulation component.
- the optical shaping component may also include an aspherical lens.
- the aspherical lens Since the curvature of the aspherical lens changes continuously from the center to the edge, the light beams in different directions can be focused on the same fixed point. Therefore, the aspherical lens can reduce the aberration at the edge of the field of view of the display module.
- the reflective component includes at least one reflective element, and the reflective element may include but is not limited to a plane mirror, a spherical mirror, a free-form mirror, or a semi-transparent mirror.
- the present application provides an optical display system, which includes a control module and the above-mentioned first aspect or any one of the display modules in the first aspect.
- the control module is used to control the display module for image display.
- the light source assembly includes a light source array, the light sources in the light source array are distributed in a plane, and the light source array includes a first light source and a second light source.
- the control module is used to obtain the left eye position information and right eye position information of the observer; determine the position information of the first light source according to the left eye position information, and determine the position information of the second light source according to the right eye position information; according to the first light source
- the position information of the second light source and the position information of the second light source generate a first control signal, and the first control signal is sent to the light source assembly.
- the light source assembly is configured to, according to the received first control signal, the first light source emit the first light beam during the first period, and the second light source emit the second light beam during the second period.
- the first control signal includes position information of the first light source and position information of the second light source.
- the light source component includes a surface light source and a light valve
- the control module is used to obtain the observer's left eye position information and right eye position information; and determine the first position information of the light valve according to the left eye position information, and determining the second position information of the light valve according to the right eye position information; generating a second control signal according to the first position information of the light valve and the second position information of the light valve and sending the second control signal to the light source assembly.
- the surface light source is used to emit the surface beam; the light valve is used to open the light valve at the first position in the third period according to the received second control signal, and the first beam in the surface beam is emitted through the first position; and In the fourth period, the light valve at the second position is opened, and the second beam of the surface beam is emitted through the second position.
- the surface light source is a planar surface light source and/or the light valve is a planar light valve.
- the second control signal includes first position information of the light valve and second position information of the light valve.
- the optical display system also includes an eye tracking module, and the eye tracking module is connected to the control module. catch. Further, optionally, the control module is configured to receive left eye position information and right eye position information from the eye tracking module.
- the present application provides a terminal device, including the above-mentioned first aspect or any one of the optical display systems in the first aspect, and the optical display system is installed on the terminal device.
- the reflective component included in the display module may be a windshield on the terminal device.
- the present application provides an imaging method that can be applied to a display module.
- the display module includes a light source component, an optical shaping component, a light modulation component and a reflection component.
- the optical shaping component is located between the light source component and the light modulation component. between.
- the method includes controlling a light source component to emit a first beam and a second beam in a time-sharing manner. The first beam and the second beam have different exit positions. The first beam is adjusted to a third beam by an optical shaping component, and the second beam is adjusted by an optical shaping component.
- Be the fourth light beam and control the light modulation component to optically modulate the third light beam to obtain the first image light carrying the first image information, and optically modulate the fourth light beam to obtain the second image light carrying the second image information;
- first The image light is reflected by the reflective component to the observer's left eye for imaging, and the second image light is reflected by the reflective component to the observer's right eye for imaging; a first control signal is sent to the light source component, and a third control signal is sent to the light modulation component.
- control method can be executed by the control module.
- the observer's left eye position information and right eye position information are obtained, a control signal is generated based on the left eye position information and the right eye position information, and the control signal is sent to the light source component.
- the control signal is used to control the light source component to emit the first light beam and the second light beam in a time-divided manner.
- left eye position information and right eye position information are received from the eye tracking module.
- the control signal includes a first control signal
- the light source component includes a light source array
- the position information of the first light source is determined according to the left eye position information
- the position information of the second light source is determined according to the right eye position information
- a first control signal is generated according to the position information of the first light source and the position information of the second light source.
- the first control signal is used to control the first light source in the light source array to emit the first light beam in the first period, and to control the second light source in the light source array to emit the second light beam in the second period.
- the control signal includes a second control signal
- the light source component includes a surface light source and a light valve
- the first position information of the light valve is determined according to the left eye position information
- the first position information of the light valve is determined according to the right eye position.
- the information determines second position information of the light valve
- a second control signal is generated based on the first position information of the light valve and the second position information of the light valve.
- the second control signal is used to control the light valve at the first position to be opened during the third period, and the light valve at the second position to be opened during the fourth period.
- the present application provides a control device, which is used to implement the method in the above-mentioned fourth aspect or any possible implementation of the fourth aspect, including corresponding functional modules, respectively used to implement the above method. step.
- Functions can be implemented by hardware, or by hardware executing corresponding software.
- Hardware or software includes one or more modules corresponding to the above functions.
- the control device may include: an interface circuit and a processor.
- the processor is used to implement the corresponding functions of the first aspect through logic circuits or execution code instructions.
- the interface circuit is used to receive signals from other control devices other than the control device and transmit them to the processor or to transfer signals from the processor. Sent to other control devices besides the control device.
- the interface circuit can be an independent receiver, an independent transmitter, or a transceiver with integrated transceiver functions.
- the control device may also include a memory, which may be coupled to the processor and which stores necessary program instructions and data for the control device.
- the processor cooperates with the interface circuit to control the light source component to emit the first beam and the second beam in a time-sharing manner.
- the first beam and the second beam have different exit positions.
- the first beam is adjusted to the third beam by the optical shaping component.
- the second beam passes through The optical shaping component is adjusted to the fourth light beam; and the light modulation component is controlled to modulate the third light beam to obtain the first image light carrying the first image information, and modulate the fourth light beam to obtain the second image light carrying the second image information; first The image light is reflected by the reflective component to the observer's left eye for imaging, and the second image light is reflected by the reflective component to the observer's right eye for imaging.
- the interface circuit is used to obtain the left eye position information and the right eye position information of the observer; the processor is used to generate a control signal according to the left eye position information and the right eye position information, and the control signal is used to
- the light source component is controlled to emit a first light beam in a first period and a second light beam in a second period; the interface circuit is also used to send a control signal to the light source component.
- the interface circuit is used to receive left eye position information and right eye position information from the eye tracking module.
- control signal includes a first control signal
- the light source assembly includes a light source array.
- the processor is specifically configured to: determine the position information of the first light source based on the left eye position information, and determine the position information of the second light source based on the right eye position information; and generate the third light source based on the position information of the first light source and the position information of the second light source. a control signal.
- control signal includes a second control signal
- the light source assembly includes a surface light source and a light valve
- the processor is specifically configured to determine the first position information of the light valve according to the left eye position information, and to determine the first position information of the light valve according to the right eye position information. Determine second position information of the light valve; and generate the second control signal based on the first position information of the light valve and the second position information of the light valve.
- the present application provides a control device, which is used to implement the method in the above-mentioned fourth aspect or any possible implementation of the fourth aspect, including corresponding functional modules, respectively used to implement the above method. step.
- Functions can be implemented by hardware, or by hardware executing corresponding software.
- Hardware or software includes one or more modules corresponding to the above functions.
- the processing module cooperates with the transceiver module to control the light source component to emit the first beam and the second beam in a time-sharing manner.
- the first beam is adjusted to the third beam through the optical shaping component, and the second beam is adjusted to the fourth beam through the optical shaping component. ; and control the light modulation component to modulate the third light beam to obtain the first image light carrying the first image information, and modulate the fourth light beam to obtain the second image light carrying the second image information;
- the first image light is reflected to the observation through the reflective component
- the left eye of the observer is imaged, and the second image light is reflected to the observer's right eye through the reflective component.
- the transceiver module is used to obtain the left eye position information and the right eye position information of the observer; the processing module is used to generate a control signal according to the left eye position information and the right eye position information, and the control signal is In order to control the light source component to emit the first light beam in the first time period and the second light beam in the second time period, the transceiver module is also used to send a control signal to the light source component.
- the transceiver module is used to receive left eye position information and right eye position information from the eye tracking module.
- control signal includes a first control signal
- the light source assembly includes a light source array.
- the processing module is specifically configured to: determine the position information of the first light source based on the left eye position information, and determine the position information of the second light source based on the right eye position information; and generate the third light source based on the position information of the first light source and the position information of the second light source.
- a control signal is used to control the light source assembly to emit a first light beam from the first light source during a first period and to emit a second light beam from the second light source during a second period.
- control signal includes a second control signal
- the light source assembly includes a surface light source and a light valve
- the processing module is specifically configured to determine the first position information of the light valve according to the left eye position information, and determine the first position information of the light valve according to the right eye position information. Determine second position information of the light valve; and generate a second control signal based on the first position information of the light valve and the second position information of the light valve.
- the second control signal is used to control the light valve to open the light valve at the first position during the third period, emit the first beam of the surface beam emitted by the surface light source through the first position, and open the light valve at the second position during the fourth period. , the second of the surface beams emitted by the surface light source The light beam is emitted through the second position.
- the present application provides a computer-readable storage medium.
- Computer programs or instructions are stored in the computer-readable storage medium.
- the control device is caused to execute the fourth aspect or the third aspect. Methods in any possible implementation of the four aspects.
- the present application provides a computer program product.
- the computer program product includes a computer program or instructions.
- the control device causes the control device to execute the fourth aspect or any of the fourth aspects.
- Figure 1a is a schematic diagram of a scene applied to HUD provided by this application.
- Figure 1b is a schematic diagram of a scenario applied to NED equipment provided by this application.
- Figure 1c is a schematic diagram of a scene applied to a vehicle-mounted display screen provided by this application.
- FIG. 2 is a schematic structural diagram of a display module provided by this application.
- Figure 3 is a schematic diagram of an optical path in a display module provided by this application.
- Figure 4 is a schematic diagram of the relationship between a first light source and a second light source provided by this application;
- Figure 5a is a schematic structural diagram of a one-dimensional light source array provided by this application.
- Figure 5b is a schematic structural diagram of a two-dimensional light source array provided by this application.
- Figure 5c is a schematic structural diagram of a staggered arrangement of a light source array provided by this application.
- Figure 5d is a schematic structural diagram of yet another staggered arrangement of light source arrays provided by this application.
- Figure 5e is a schematic structural diagram of yet another staggered arrangement of light source arrays provided by this application.
- Figure 5f is a schematic structural diagram of another light source array provided by the present application in which the light sources are arranged staggered in the column direction;
- Figure 5g is a schematic structural diagram of a light source array provided by the present application, in which part of the light source array is arranged in a staggered arrangement at equal intervals in the row direction and partially arranged in a staggered arrangement at non-equal intervals;
- Figure 5h is a schematic structural diagram of a light source array provided by the present application in which the staggered arrangement is partially equally spaced in the column direction and the other is non-equally spaced staggered arrangement;
- Figure 6a is a schematic diagram of a polygonal distribution of light sources in a light source array provided by this application;
- Figure 6b is a three-dimensional diagram of a regular hexagonally distributed light source array provided by this application.
- Figure 7a is a schematic structural diagram of a light source array provided by the present application in which the light sources are distributed on a curved surface;
- Figure 7b is a three-dimensional diagram of a light source array with curved surface distribution provided by this application.
- Figure 7c is a three-dimensional diagram of a light source array with curved surface distribution provided by this application.
- Figure 8a is a schematic structural diagram of a surface light source and light valve provided by this application.
- Figure 8b is a schematic structural diagram of another surface light source and light valve provided by this application.
- Figure 9a is a schematic structural diagram of a Fresnel lens provided by this application.
- Figure 9b is a schematic structural diagram of an aspherical lens array provided by this application.
- Figure 9c is a schematic structural diagram of a spherical lens array provided by this application.
- Figure 9d is a schematic structural diagram of a Fresnel lens array provided by this application.
- Figure 10a is a schematic structural diagram of a display screen provided by this application.
- Figure 10b is a schematic structural diagram of a display screen provided by this application.
- Figure 11 is a schematic diagram of the optical path of a display screen provided by this application.
- Figure 12 is a schematic structural diagram of another display module provided by this application.
- FIG. 13 is a schematic structural diagram of another display module provided by this application.
- Figure 14 is a schematic structural diagram of another display module provided by this application.
- Figure 15 is a schematic structural diagram of an optical display system provided by this application.
- Figure 16 is a principle of convergence adjustment conflict provided by this application.
- Figure 17 is a schematic circuit diagram of an optical display system provided by this application.
- Figure 18 is an exemplary functional block diagram of a vehicle provided by this application.
- Figure 19 is a schematic flow chart of an imaging method provided by this application.
- Figure 20a is a schematic optical path diagram of an observer's left eye and right eye at position 1 provided by this application;
- Figure 20b is a schematic optical path diagram of an observer's left eye and right eye at position 2 provided by this application;
- FIG. 21 is a schematic structural diagram of a control device provided by this application.
- Figure 22 is a schematic structural diagram of a control device provided by this application.
- the display module provided by this application can also be integrated into a head-up display device (HUD).
- HUD head-up display device
- Figure 1a takes the HUD installed in a vehicle as an example.
- HUD can project the formed image (called HUD virtual image) into the driver's front field of view and fuse it with real road information, thereby enhancing the driver's perception of the actual driving environment.
- the HUD can carry navigation information (such as direction arrows, distance, and/or driving time, etc.) and/or vehicle status information (such as driving speed, driving mileage, rotation speed, temperature, fuel level, and/or car light status).
- HUD includes but is not limited to windshield-head up device (W-HUD), or AR-HUD, etc.
- the display module provided by this application can also be integrated into a near eye display (NED) device.
- the NED device may be, for example, an AR device or a virtual reality (VR) device.
- the AR device may include but is not limited to AR glasses or an AR helmet.
- the VR device may include but is not limited to VR glasses or a VR helmet. Please refer to Figure 1b, taking AR glasses as an example. Users can wear AR glasses to play games, watch videos, participate in virtual meetings, or video shopping, etc.
- the display module provided by this application can also be integrated into a vehicle-mounted display screen.
- the vehicle-mounted display screen can be installed on the back of the vehicle's seat or in the passenger seat. This application covers the installation of vehicle-mounted display screens. The position is not limited.
- Figure 1c shows an example of being installed on the back of the seat.
- the display module provided by this application can also be integrated into a device including a picture generation unit (picture generation unit, PGU) and a reflective component, or other possible smart virtual images.
- a picture generation unit picture generation unit
- a reflective component or other possible smart virtual images.
- display scenarios such as light display, void display, etc., and are not limited to the scenes illustrated in the above examples.
- this application provides a display module.
- the display module can be used without losing the resolution of the displayed image.
- the display module includes a light source component, an optical shaping component, a light modulating component and a reflecting component.
- the optical shaping component is located between the light source component and the light modulating component.
- the light source component is used to emit the first light beam and the second light beam in a time-sharing manner, and the first light beam and the second light beam emit different positions from the light source component. It can also be understood that the light source component emits different light beams from different positions at different time periods.
- the optical shaping component is used to adjust the direction of the first light beam to obtain the third light beam, and adjust the direction of the second light beam to obtain the fourth light beam.
- the light modulation component is used to modulate the third light beam to obtain first image light carrying first image information, and to modulate the fourth light beam to obtain second image light carrying second image information.
- the reflective component is used to reflect the first image light to the observer's left eye for imaging, and to reflect the second image light to the observer's right eye for imaging.
- the propagation light path of the first beam is: the light source component emits the first beam, the first beam is adjusted by the optical shaping component to obtain a third beam, and the third beam modulates the first image information into the third beam through the light modulation component.
- the first image light is obtained, and the first image light is emitted to the observer's left eye for imaging through the reflective component.
- the propagation light path of the second beam is: the light source component emits the second beam, the second beam is adjusted by the optical shaping component to obtain a fourth beam, and the fourth beam is modulated by the light modulation component to modulate the second image information into the fourth beam to obtain the second image.
- the second image light is reflected by the reflective component to the observer's right eye for imaging.
- the optical shaping component is located between the light source component and the light modulation component, the light source component can cooperate with the optical shaping component to generate directional backlight, and the light modulation component loads the first image information or the second image information in a time-division manner.
- the observer can see the first image information or the second image information modulated by all the pixels of the light modulation component with one eye. It can also be understood that the observer can see the complete first image information or the second image information modulated by the light modulation component with one eye.
- the second image information therefore, can reduce or avoid the loss of resolution of the displayed image.
- the first image light is imaged on the left eye
- the second image light is imaged on the right eye.
- the observer can observe different parallax images. If the first image information and the second image information are different, a three-dimensional 3D image effect can be obtained. It can be understood that if the first image information and the second image information are the same, the display module can also display a two-dimensional image effect.
- the light source component is configured to emit the first light beam and the second light beam in a time-divided manner according to the received control signal.
- the following shows two possible structures of the light source assembly based on examples, and the process of the light source assembly emitting the first light beam and the second light beam in a time-division manner is introduced in detail respectively.
- the light source component includes a light source array.
- the light source array includes a first light source and a second light source. According to the received first control signal, the light source array emits the first light beam from the first light source during the first period and the second light beam from the second light source during the second period. That , the first control signal includes position information of the first light source and position information of the second light source.
- the first period T 1 during which the first light source is turned on and the second period T 2 during which the second light source is turned on can be set during the initialization process of the display module; or, the first period T 1 and T 2 during which the first light source is turned on can be set.
- the second period T2 during which the second light source is turned on may also be carried in the first control signal. It should be noted that there is a preset time period ⁇ t between turning on the first light source and the second light source. Please refer to Figure 4. Usually, the preset time period ⁇ t is equal to the modulation time length T 5 of the light modulation component.
- the light source array can determine the first light source that needs to be turned on based on the position information of the first light source in the first control signal.
- the first light source is turned on in the first period T1 , and the turned on first light source is used to emit the first light beam;
- the second light source that needs to be turned on is determined according to the position information of the second light source.
- the second light source is turned on in the second period T2 , and the turned on second light source is used to emit the second light beam.
- the light sources in the light source array are distributed in a plane.
- the light source array includes m ⁇ n light sources, m is an integer greater than 1, and n is a positive integer; or, m is a positive integer, and n is an integer greater than 1.
- the light source array may be a one-dimensional array (or called a linear array), or it may be a two-dimensional array (or called an area array).
- the light source array includes 6 ⁇ 1 light sources as an example. It can also be understood that these six light sources are arranged in strips along the row direction.
- Case 2 The light sources in the light source array are arranged two-dimensionally.
- the method can be further divided into the following five situations.
- the light source array includes 6 ⁇ 6 light sources.
- the lights are aligned in the row direction and also in the column direction.
- the light sources in the light source array are staggered at equal intervals in the row direction and aligned in the column direction.
- FIG. 5c it is a schematic structural diagram of a staggered arrangement of a light source array provided by the present application.
- the light sources in the light source array are staggered at equal intervals in the row direction.
- a staggered arrangement with a three-row period (or period called a staggered arrangement) is taken as an example.
- the staggered size of any two adjacent light sources in the row direction is equal. is ⁇ 1 . It should be noted that the misalignment size ⁇ 1 in the row direction is smaller than the distance S 1 between the centers of two adjacent light sources.
- the light sources in the light source array are staggered at equal intervals in the column direction, but are aligned in the row direction.
- FIG. 5d it is a schematic structural diagram of another staggered arrangement of light source array provided by the present application.
- the light sources in the light source array are staggered at equal intervals in the column direction.
- a three-column periodic staggered arrangement is taken as an example.
- the stagger size of any two adjacent light sources in the column direction is ⁇ 2 . It should be noted that the dislocation size ⁇ 2 in the column direction is smaller than the distance H 1 between the centers of two adjacent light sources.
- dislocation size ⁇ 1 in the above-mentioned Fig. 5c may be the same as the dislocation size ⁇ 2 in the above-mentioned Fig. 5d, or may be different, and this application does not limit this.
- Case 2.4 The light sources in the light source array are staggered at unequal intervals in the row direction and aligned in the column direction.
- FIG. 5e it is a schematic structural diagram of yet another staggered arrangement in a light source array provided by this application.
- the light sources in the light source array have at least two different dislocation sizes in the row direction.
- a 2-row periodic dislocation arrangement is taken as an example, that is, there are two different dislocation sizes in the row direction.
- the misalignment size of two adjacent light sources in the row direction is ⁇ 3 or ⁇ 4 . In this example, ⁇ 3 is smaller than ⁇ 4 .
- the misalignment size ⁇ 3 of any two adjacent light sources in the row direction is less than the distance S 1 between the centers of the two adjacent light sources, and the misalignment size ⁇ 4 of any two adjacent light sources in the row direction is also smaller than the distance S 1 between the centers of the two adjacent light sources.
- offset sizes in the offset arrangements at unequal intervals in the row direction may be different from each other, or may be partially the same and partially different, which is not limited in this application.
- FIG. 5f it is a schematic structural diagram of another light source array provided by the present application in which the light sources are arranged staggered in the column direction.
- the light sources in the light source array have at least two different dislocation sizes in the column direction.
- a two-column periodic dislocation arrangement is taken as an example, that is, there are two different dislocation sizes in the column direction.
- the misalignment size of two adjacent light sources in the column direction is ⁇ 5 or ⁇ 6 . In this example, ⁇ 5 is smaller than ⁇ 6 .
- the misalignment size ⁇ 5 of any two adjacent light sources in the column direction is smaller than the distance H 1 between the centers of the two adjacent light sources, and the misalignment size ⁇ 6 of any two adjacent light sources in the column direction is smaller than the distance H 1 between the centers of the two adjacent light sources.
- the distance between the centers is H 1 .
- the stagger sizes may be different from each other, or may be partially the same and partially different, which is not limited in this application.
- the staggered arrangement of the light sources in the row direction in the light source array can also be a combination of the above situations 2.2 and 2.5, that is, some are equally spaced staggered arrangements, and some are non-equally spaced staggered arrangements.
- the misalignment sizes in the row direction are ⁇ 7 , ⁇ 8 and ⁇ 7 .
- the staggered arrangement of the light sources in the column direction in the light source array can also be a combination of the above scenarios 2.3 and 2.5, that is, some are equally spaced staggered arrangements, and some are non-equally spaced staggered arrangements.
- the misalignment sizes in the column direction are ⁇ 9 , ⁇ 0 and ⁇ 9 . It can be understood that, in order to reduce optical crosstalk as much as possible, the distance between two adjacent light sources can be set larger. For example, the distance between two adjacent light sources can be set to 400 microns or greater.
- the light sources in the light source array given above are all rectangular as examples, and the shape of the light source can also be any other possible shape, such as a circle, an ellipse, a polygon, etc., which is not limited in this application.
- the light sources in the light source array are distributed in polygonal rows.
- Figure 6a is a schematic diagram of a polygonal distribution of light sources in a light source array provided by the present application.
- the light sources in the light source array are distributed in a regular hexagon.
- Figure 6b is a three-dimensional diagram of a regular hexagonally distributed light source array.
- the thickness of the display module can be reduced as much as possible, so that the images seen by the observer at the edges and the center are as consistent as possible, thereby expanding the eye box range of the display module.
- Scenario 3 The light sources in the light source array are distributed on a curved surface.
- Figure 7a is a schematic structural diagram of a light source array provided by the present application in which the light sources are distributed on a curved surface.
- Figure 7b or Figure 7c which is a three-dimensional diagram of a light source array distributed on a curved surface.
- the light source array given above can achieve independent addressing.
- Independent addressing means that the light sources in the light source array can be independently gated (or called on or turned on or powered on), and the gated light sources are used to emit the first beam or the second beam.
- a driving current is input to a first light source in the light source array to strobe the first light source.
- a driving current is input to the second light source in the light source array to strobe the second light source.
- the addressing mode of the light source array is related to the physical connection relationship of the light sources in the light source array.
- the light sources can be gated point by point, or the light sources can be gated on demand, where, for example, the gate on demand can be gated on a specific position at a certain time.
- Light source etc.
- the light sources in the same column in the light source array are connected in series and different columns are connected in parallel
- the light source array can be gated column by column.
- the light source in the column For another example, if the light sources in the same row of the light source array are connected in series and different rows are connected in parallel, the light sources in the light source array can be gated row by row.
- the light sources in the light source array can be gated according to the diagonal lines, etc., which will not be listed one by one here.
- the light source in the light source array may be a laser diode (LD), a light-emitting diode (LED), a vertical cavity surface emitting laser (VCSEL), an edge laser Emitting laser (edge emitting laser, EEL), all-solid-state semiconductor laser (diode pumped solid state laser, DPSS), or fiber laser, etc.
- LD laser diode
- LED light-emitting diode
- VCSEL vertical cavity surface emitting laser
- EEL edge laser Emitting laser
- DPSS all-solid-state semiconductor laser
- the light source component includes an area light source and a light valve.
- the light source component may include a surface light source and a light valve.
- the surface light source can be a planar surface light source
- the light valve can be a planar light valve.
- the light valve can cover the complete area light source. When the light valve at a certain position is opened, the area beam emitted by the area light source can be emitted from the position where the light valve is opened.
- the surface light source is used to emit surface beams, and usually the surface light source is always on.
- the light valve is used to open the light valve at the first position in the third period according to the received second control signal.
- the first beam of the surface beam emitted by the surface light source is emitted through the first position.
- the light valve is used to open the light valve at the second position in the fourth period according to the second control signal, and the second light beam in the surface beam emitted by the surface light source is emitted through the second position, please refer to (2) in Figure 8b.
- the second control signal includes the first position information of the light valve and the second position information of the light valve.
- the first position information of the light valve includes the first width and the first center coordinate of the light valve that needs to be opened, or includes the first starting position and the first end position of the light valve that needs to be opened.
- the second position information of the light valve includes the second width and the second center coordinate of the light valve that needs to be opened, or includes the second starting position and the second end position of the light valve that needs to be opened.
- the first width may be the same as the second width or may be different, which is not limited in this application.
- the third period T 3 during which the light valve is opened at the first position and the fourth period T 4 during which the light valve is opened at the second position can be set during the initialization process of the display module; or, the light valve at the first position is opened.
- the third period T 3 of opening and the fourth period T 4 of the light valve opening of the second position may also be carried in the first control signal.
- the interval between opening the light valve in the first position and opening the light valve in the second position is a preset time period ⁇ t.
- the preset time period ⁇ t can be found in the above-mentioned relevant introduction, and will not be described again here.
- the light valve opens the light valve at the first position in the third period according to the received second control signal, and in the third period, the first light beam in the surface beam emitted by the surface light source is emitted through the first position; and In the fourth period, the light valve at the second position is opened. In the fourth period, the second beam of the surface beam emitted by the surface light source is emitted through the second position.
- the first light beam is a partial light beam in the surface beam
- the second light beam is also a partial light beam in the surface light beam. The first light beam and the second light beam emit from the light valve at different positions.
- the first beam and the second beam can be adjusted more accurately, so that in the eye tracking state, the switching of the first beam and the second beam is smoother, and the image flickering observed by the observer moving within the eye box Fewer and more stable; and by controlling the opening width of the light valve, it can accurately match a larger viewing depth range.
- the optical shaping component is used to adjust the direction of the first light beam to obtain the third light beam, and adjust the direction of the second light beam to obtain the fourth light beam.
- the optical shaping component is used to change the propagation direction of the first light beam from the light source assembly so that the first light beam is focused to a certain position, and to change the propagation direction of the second light beam from the light source assembly so that the second light beam is focused. to another location.
- optical shaping component The following exemplarily illustrates two possible structures of the optical shaping component.
- the optical shaping component includes a lens.
- the lens includes a spherical lens, an aspheric lens or a Fresnel lens (see Figure 9a).
- Fresnel lenses can also be called threaded lenses.
- One side of the surface of the Fresnel lens is smooth, and the other side is inscribed with concentric circles (or textures or Fresnel strips) from small to large. Therefore, the Fresnel lens can make the aberration at the edge of the image smaller. Since the curvature of the aspherical lens continuously changes from the center to the edge, the aspherical lens can focus the light beams in different directions on the same fixed point, thus reducing the aberration at the edge of the display module's field of view.
- the material of the lens may be optical materials such as glass, resin, or crystal.
- the material of the lens is resin, the quality of the display module can be reduced.
- the material of the lens is glass, it helps to improve the imaging quality of the display module and suppress temperature drift. This application does not limit the material of the lens.
- the optical shaping component includes a lens array.
- the lens array includes a spherical lens array (see Figure 9b), an aspherical lens array (see Figure 9c) or a Fresnel lens array (see Figure 9d).
- the pitch p of the lens array refers to the effective diameter or effective aperture size of a single lens in the lens array. Due to the aspherical lens array, the aberration at the edge of the field of view of the display module can be reduced, and in the case of a larger field of view (FOV), the light source component can also be designed as a planar light source array, thus Processing and assembly complexity can be reduced.
- the lens array may be a planarly distributed lens array. Based on this, it helps to reduce the thickness of the display module.
- the optical shaping component includes a lens array.
- one lens in the lens array corresponds to at least two light sources in the light source array.
- part of the light sources among the plurality of light sources corresponding to one lens serve as the first light source
- other part of the light sources serve as the second light source.
- one lens can correspond to two light sources, one of which serves as the first light source and the other as the second light source.
- one lens can correspond to at least four light sources. It can also be understood that for each lens in the lens array, it has a light source corresponding to the position of an observer's left eye and a light source corresponding to the position of the right eye.
- the number of first light sources (or second light sources) turned on in a certain period of time is related to the lateral width of the first light source (or second light source), the first light source array (or second light source array)
- the density is related to the number of lenses included in the lens array, where the lateral direction of the first light source (or the second light source) refers to the direction parallel to the pitch p of the lenses.
- the total lateral width of the first light source (or second light source) that needs to be turned on each time is certain, and the number of first light sources (or second light sources) turned on is the same as a single
- the lateral width of the first light source (or second light source) is related to the density of the first light source array (or second light source array). The smaller the lateral width and the greater the density, the first light source (or second light source) that is turned on once The greater the number.
- the light modulation component is used to modulate the third light beam to obtain a first image light carrying the first image information; and to modulate the fourth light beam to obtain a second light beam carrying the second image information.
- Image light can load (or modulate) the first image information into the third light beam to obtain the first image light carrying the image information; load the second image information into the fourth light beam to obtain the third light beam carrying the image information.
- the third beam and the fourth beam may be called optical carriers. It can be understood that in order to achieve a 3D display effect, the first image information and the second image information are different.
- the light modulation component can switch the first image information and the second image information at high frequency, so that it can be This makes the images reaching the left and right eyes of the observer different, thereby achieving 3D display.
- the light modulation component can be a liquid crystal on silicon (LCOS) display, a liquid crystal display (LCD), a digital light processing (DLP) display, a laser line scan ( laser beam scanning (LBS) display, organic light emitting diode (OLED), micro light emitting diode (micro light emitting diode, micro-LED), active matrix organic light emitting diode or active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (FLED), quantum dot light emitting diode (QLED), digital micro-mirror device , DMD) reflective display screen, etc.
- LCOS liquid crystal on silicon
- LCD liquid crystal display
- DLP digital light processing
- LBS laser line scan
- OLED organic light emitting diode
- micro light emitting diode micro light emitting diode
- micro-LED active matrix organic light emitting diode or active matrix organic light emitting diode
- the display screen may include a light source component, an optical shaping component and a light modulation component.
- the light source component takes a surface light source and a light valve as an example.
- the position of the light valve can emit part of the surface beam emitted by the surface light source (called the first beam or the second beam).
- the emitted first beam or the second beam The divergence angle ⁇ .
- the optical shaping component takes a spherical lens array as an example
- the light modulation component takes an LCD as an example.
- the display screen may include a light source component, an optical shaping component and a light modulation component.
- the light source component is a planarly distributed light source array disposed on the substrate as an example
- the optical shaping component is a planarly distributed aspherical lens array as an example
- the light modulation component is an LCD as an example.
- the planarly distributed aspherical lens array and the planarly distributed light source array can realize a dense light source array and a short-focus lens array with a small lateral width, thereby reducing the thickness of the display module.
- display modules can be compressed to the millimeter level.
- the aspherical lens array can make the aberration of the edge field of view smaller, thereby reducing the complexity of processing and assembly of the display module in the case of a large FOV.
- the illuminated light source array can realize the division of multiple viewing areas in the eye box, allowing observers to perform 3D viewing at different positions of the eye box.
- Figure 11 is a schematic diagram of an optical path of a display screen provided in this application.
- the first light source in the light source array is turned on, and the turned on first light source is used to emit the first light beam (indicated by a solid line).
- the first light beam is directed through the corresponding aspherical lens in the aspherical lens array to obtain the third
- the third light beam is modulated by the LCD to obtain the first image light carrying the first image information, and the first image light is used for imaging in the left eye.
- the second light source in the light source array is turned on.
- the turned on second light source is used to emit a second light beam (indicated by a dotted line).
- the second light beam is adjusted by the corresponding aspherical lens in the aspherical lens array to obtain a fourth light beam.
- the fourth light beam is After being modulated by the LCD, the second image light carrying the second image information is obtained, and the second image light is used for imaging in the right eye.
- the reflective component is used to reflect the first image light to the observer's left eye for imaging, and to reflect the second image light to the observer's right eye for imaging, so that the observer can observe a 3D image.
- Figure 12 is an example in which the reflective component includes a free-form surface reflector.
- the reflective assembly includes at least one reflective element.
- the reflective element may include, for example, but is not limited to, a plane reflector, a spherical reflector, a free-curved mirror or a semi-transparent and semi-reflective mirror (semi-transparent and semi-reflective mirror).
- a semi-transparent mirror can also be called a beam splitter, a beam splitter or a semi-reflective semi-reflective mirror. It is a semi-reflective film coated on optical glass, or a semi-transparent and semi-reflective film is coated on an optical surface of a lens. , an optical element that changes the original transmission and reflection ratio of the incident light beam. By coating the film layer, you can increase the light intensity by increasing the transmittance; you can also increase the reflection and reduce the light intensity.
- the display module includes a display screen and a reflective component.
- the display screen may include a light source component, an optical shaping component and a light modulation component.
- the light source component is a planarly distributed light source array disposed on the substrate as an example
- the optical shaping component is a planarly distributed aspherical lens array as an example
- the light modulation component is an LCD as an example.
- the reflective component takes the reflective component shown in Figure 12 as an example.
- L is the length of the formed light spot (or light bar), and L needs to cover the left eye without affecting the right eye, or it needs to cover the right eye without affecting the left eye.
- the pitch p of the aspherical lenses in the aspherical lens array satisfies the following formula 1.
- ⁇ is the larger divergence angle of the first beam and the second beam
- t is the distance between the light-emitting surface of the light source array and the surface of the aspherical lens array close to the LCD
- h is the first The lateral luminous width of the light source or second light source.
- the lateral width can be understood as the sum of the lateral widths of all the first light sources corresponding to an aspherical lens or the sum of the lateral widths of all the corresponding second light sources.
- an aspherical lens corresponds to two first light sources and two second light sources.
- h is the sum of the lateral widths of the two first light sources, or h is the sum of the lateral widths of the two second light sources.
- t satisfies the following imaging formula 2, and may be 10 mm, for example.
- the divergence angle of the first light beam and the divergence angle of the second light beam can be set.
- the divergence angle of the first light source and the emission angle of the second light source can be set, or a light valve that opens the first position can be set. a first width and a second width that opens the light valve in a second position.
- the divergence angle of the first light beam may be the same as the divergence angle of the second light beam, or may be different, which is not limited in this application.
- the divergence angle of the first light source in the light source array is the divergence angle of the first light beam
- the divergence angle of the second light source is the divergence angle of the second light beam.
- f2 is the equivalent focal length of the aspherical lens array
- d is the distance between the aspherical lens array and the virtual eyebox surface
- d satisfies the following formula 3.
- W is the inter-eye distance between the observer's left eye and right eye, usually about 65mm
- d1 is the distance between the actual eye box surface and the reflective component
- d3 is the distance between the virtual eye box surface and the reflective component distance.
- d1 and d3 satisfy the following imaging formula 4.
- f1 is the equivalent focal length of the reflective component.
- the reflective component is a planar reflective element
- the size of the actual eye box surface is the same as the size of the virtual eye box surface
- the distance d1 between the actual eye box surface and the reflective component and the distance d1 between the virtual eye box surface and the reflective component The distance d3 is the same
- the pitch p of the aspherical lenses in the aspherical lens array also satisfies the following formula 5.
- W eye is the virtual eye distance on the virtual eye box surface
- the virtual eye box surface is the virtual image formed by the reflection of the actual eye box surface by the reflective component.
- W eye satisfies the following formula 6.
- the aspherical lens when the aspherical lens is close to the light source, the light energy emitted by the light source covers a very small range.
- an aspherical lens array composed of small-pitch aspherical lenses combined with a corresponding dense light source array, the uniformity of the image displayed by the display module can be improved.
- the above-mentioned display module may include, but is not limited to, NED equipment, vehicle-mounted display screen or HUD, etc.
- this application can also provide an optical display system.
- Figure 15 is a schematic structural diagram of an optical display system provided by this application.
- the optical display system may include the display module in any of the above embodiments, and the details will not be repeated here.
- the optical display system may also include a control module, and the control module is connected to the display module.
- the control module is used to control the display module to display images.
- the optical display system may also include an eye tracking module, and the eye tracking module is connected to the control module.
- the control module can receive left eye position information and right eye position information from the eye tracking module.
- control module and eye tracking module are introduced separately below.
- the control module can receive the observer's left eye position information and right eye position information from the eye tracking module, and determine that the light source component needs to be turned on based on the left eye position information.
- the position information of the first light source, and the position information of the second light source that the light source component needs to be turned on is determined based on the right eye position information; the first control signal is generated based on the position information of the first light source and the position information of the second light source.
- the control module can determine the first position information of the light valve based on the left eye position information, and determine the second position information of the light valve based on the right eye position information; and based on the third position information of the light valve.
- the first position information and the second position information of the light valve generate a second control signal.
- the control module may include a processor.
- the processor may be a circuit with signal (or data) processing capabilities.
- the processor may be a circuit with instruction reading and execution capabilities.
- a central processing unit CPU
- a microprocessor e.g., a central processing unit (CPU)
- GPU graphics processing unit
- DSP digital signal processor
- the processor can implement certain functions through the logical relationship of the hardware circuit, and the logical relationship of the hardware circuit is fixed or reconfigurable.
- the processor is an application-specific integrated circuit (application-specific integrated circuit, Hardware circuits implemented by ASIC) or programmable logic device (PLD), such as field programmable gate array (FPGA).
- FPGA field programmable gate array
- the processor loads the configuration file,
- the process of realizing hardware circuit configuration can be understood as the process of loading instructions by the processor to realize the functions of some or all of the above units.
- the processor can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (neural network processing unit, NPU), tensor processing unit (TPU), deep learning Processing unit (deep learning processing unit, DPU), etc.
- AP application processor
- ISP image signal processor
- eye tracking refers to tracking eye movement by measuring the position of the gaze point of the eye or the movement of the eyeball relative to the head.
- the eye tracking module is a device that can track and measure eye position and eye movement information.
- the eye tracking module tracks and outputs the position of the observer's eyes in real time and transmits it to the control module, so that the control module controls to turn on the first light source or the second light source corresponding to the position of the human eye, and switches the left eye corresponding to the first light source at high speed.
- the eye tracking module continuously monitors the position of the human eye. When the human eye position moves, the eye tracking module obtains new position information and transmits the position information to the control module.
- the eye tracking module can specifically determine the convergence depth of the binocular gaze image (i.e., binocular viewpoint).
- the principle of convergence adjustment conflict is exemplarily shown.
- the vergence accommodation conflict is due to the fact that when the human eye observes three-dimensional (3D) content, the correct binocular lens focus depth is always fixed on the screen, while the binocular vergence converges at the target distance defined by the parallax, which may be located In front of the screen, it may also be located behind the screen.
- the mismatch between the focus depth and the vergence depth causes a convergence adjustment conflict.
- the eye tracking module may include, but is not limited to, a camera, an infrared emitter or an infrared detector, etc. Further, optionally, the eye tracking module also includes a processor.
- FIG. 17 is a schematic circuit diagram of an optical display system provided by this application.
- the circuit in the optical display system mainly includes a processor 1701, an external memory interface 1702, an internal memory 1703, an audio module 1704, a video module 1705, a power module 1706, a wireless communication module 1707, input/output (I/O ) interface 1708, video interface 1709, display circuit 1710, modulator 1711, light source 1712, etc.
- the processor 1701 and its peripheral components such as external memory interface 1702, internal memory 1703, audio module 1704, video module 1705, power module 1706, wireless communication module 1707, I/O interface 1708, video interface 1709, display circuit 1710 Can be connected via bus.
- the circuit diagram schematically illustrated in this application does not constitute a specific limitation on the optical display system.
- the optical display system may include more or fewer components than shown in the figures, or some components may be combined, or some components may be separated, or may be arranged differently.
- the components illustrated may be implemented in hardware, software, or a combination of software and hardware.
- the processor 1701 includes one or more processing units.
- the processing unit may be a circuit with signal (or data) processing capabilities.
- signal (or data) processing capabilities For details, please refer to the above-mentioned relevant introductions, which will not be repeated here.
- different processing units can be independent devices or integrated in one or more processors.
- the processor 1701 may also be provided with a memory for storing instructions and data.
- the memory in processor 1701 is cache memory. This memory can store instructions or data that have just been used or recycled by the processor 1701. according to. If the processor 1701 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 1701 is reduced, thereby improving the efficiency of the optical display system.
- the processor 1701 can execute stored instructions to perform the above imaging method.
- the optical display system may also include a plurality of input/output (I/O) interfaces 1708 connected to the processor 1701 .
- the I/O interface 1708 may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and universal asynchronous reception and transmission.
- I2C integrated circuit
- I2S integrated circuit built-in audio
- PCM pulse code modulation
- UART Universal asynchronous receiver/transmitter
- MIPI mobile industry processor interface
- GPIO general-purpose input/output
- SIM subscriber identity module
- USB universal serial bus
- the above-mentioned I/O interface 1708 can be connected to devices such as a mouse, touch pad, keyboard, camera, speaker/speaker, microphone, etc., or can be connected to physical buttons on the optical display system (such as volume keys, brightness adjustment keys, power on/off keys, etc.).
- the external memory interface 1702 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the optical display system.
- the external memory card communicates with the processor 1701 through the external memory interface 1702 to implement the data storage function.
- Internal memory 1703 may be used to store computer executable program code, which includes instructions.
- the internal memory 1703 may include a program storage area and a data storage area.
- the stored program area can store the operating system, at least one application program required for the function, etc.
- the storage data area can store data created during the use of the optical display system, etc.
- the internal memory 1703 may include random access memory (RAM), flash memory, universal flash storage (UFS), read-only memory (ROM), programmable read-only memory (programmable ROM, PROM), erasable programmable read-only memory (erasable PROM, EPROM), electrically erasable programmable read-only memory (electrically EPROM, EEPROM), register, hard disk, mobile hard disk, CD-ROM or in this field any other well-known storage medium.
- the processor 1701 executes various functional applications and data processing of the optical display system by executing instructions stored in the internal memory 1703 and/or instructions stored in a memory provided in the processor 1701 .
- An exemplary storage medium is coupled to the processor such that the processor can read information from the storage medium and write information to the storage medium.
- the storage medium may also be an integral part of the processor.
- the processor and storage media may be located in an ASIC.
- the ASIC can be located in an optical display system.
- the processor and storage medium may also exist as discrete components in the optical display system.
- the optical display system can implement audio functions through the audio module 1704 and application processor. For example, music playback, phone calls, etc.
- the audio module 1704 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals.
- the audio module 1704 can also be used to encode and decode audio signals, such as playing or recording.
- the audio module 1704 may be provided in the processor 1701, or some functional modules of the audio module 1704 may be provided in the processor 1701.
- the video interface 1709 can receive external input audio and video signals, which can specifically be a high definition multimedia interface (HDMI), a digital visual interface (DVI), or a video graphics array (VGA). , display port (display port, DP), etc., the video interface 1709 can also output video to the outside.
- HDMI high definition multimedia interface
- DVI digital visual interface
- VGA video graphics array
- display port display port, DP
- the video interface 1709 can also output video to the outside.
- the video interface 1709 can receive speed signals and power signals input from peripheral devices, and can also receive externally input AR video signals.
- the optical display system acts as a projection
- the video interface 1709 can receive video signals input from an external computer or terminal device.
- the video module 1705 can decode the video input by the video interface 1709, for example, perform H.264 decoding.
- the video module can also encode the video collected by the optical display system, such as H.264 encoding of the video collected by an external camera.
- the processor 1701 can also decode the video input from the video interface 1709 and then output the decoded image signal to the display circuit 1710 .
- the power module 1706 is used to provide power to the processor 1701 and the light source 1712 according to the input power (such as direct current).
- the power module 1706 may include a rechargeable battery, and the rechargeable battery may provide power to the processor 1701 and the light source 1712.
- the light emitted by the light source 1712 can be transmitted to the modulator 1711 for imaging, thereby forming an image light signal.
- the wireless communication module 1707 can enable the optical display system to communicate wirelessly with the outside world, and can provide wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (bluetooth, BT) , Global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
- WLAN wireless local area networks
- Wi-Fi wireless fidelity
- Bluetooth bluetooth, BT
- GNSS Global navigation satellite system
- FM frequency modulation
- NFC near field communication technology
- infrared technology infrared, IR
- the wireless communication module 1707 may be one or more devices integrating at least one communication processing module.
- the wireless communication module 1707 receives electromagnetic waves through the antenna, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 1701 .
- the wireless communication module 1707 can also receive the signal to be sent from the processor 1701, frequency modulate it
- the video data decoded by the video module 1705 can also be received wirelessly through the wireless communication module 1707 or read from an external memory.
- the optical display system can use the wireless LAN in the car. Receive video data from the terminal device or car entertainment system, the optical display system can also read the audio and video data stored in the external memory.
- the display circuit 1710 and the modulator 1711 are used to display corresponding images.
- the video interface 1709 receives an externally input video source signal.
- the video module 1705 decodes and/or digitizes the signal and outputs one or more image signals to the display circuit 1710.
- the display circuit 1710 drives the modulation according to the input image signal.
- the detector 1711 images the incident polarized light, and then outputs at least two channels of image light.
- the processor 1701 can also output one or more image signals to the display circuit 1710 .
- the optical display system may include but is not limited to HUD, projector, display, vehicle display screen, AR device, VR device, or smart car lights, etc.
- the AR device may include but is not limited to AR glasses or AR helmet, etc.
- VR equipment may include but is not limited to VR glasses or VR helmets, etc.
- the present application can also provide a terminal device. Based on the structure and functional principles of the optical display device described above, the present application can also provide a terminal device.
- the terminal device may include the display module in any of the above embodiments.
- the terminal device may be a vehicle (such as an unmanned vehicle, a smart vehicle, an electric vehicle, or a digital vehicle, etc.), a robot, a mapping device, a drone, or a smart home device (such as a television, a sweeping robot, or a smart desk lamp).
- audio system intelligent lighting system, electrical control system, home background music, home theater system, intercom system, or video surveillance, etc.
- intelligent manufacturing equipment such as industrial equipment
- intelligent transportation equipment such as AGV, unmanned transport vehicle
- smart terminals mobile phones, computers, tablets, PDAs, desktops, headsets, speakers, wearable devices, vehicle-mounted devices, virtual reality devices, augmented reality devices, etc.
- terminal device 1800 may include propulsion system 1801, sensing system 1802, Control system 1803, computer system 1804, user interface 1805 and optical display system 1806.
- the components of terminal device 1800 may be configured to operate in interconnection with each other and/or with other components coupled to various systems.
- computer system 1804 may be configured to receive data from and control propulsion system 1801, sensing system 1802, control system 1803, and the like.
- Computer system 1804 may also be configured to generate a display of the image on user interface 1805 and receive input from user interface 1805 .
- Propulsion system 1801 may provide powered motion for terminal device 1800.
- Propulsion system 1801 may include an engine/motor, energy source, transmission, and wheels/tyres. Additionally, propulsion system 1801 may additionally or alternatively include other components in addition to those shown in FIG. 18 . This application does not specifically limit this.
- the sensing system 1802 may include several sensors for sensing information about the environment in which the terminal device 1800 is located, and the like.
- the sensors of the sensing system 1802 may include, but are not limited to, global positioning system (GPS), inertial measurement unit (IMU), millimeter wave radar, lidar, cameras, and sensors for modifying the position and/or orientation of the brake.
- Millimeter wave radar may utilize radio signals to sense targets in the surrounding environment of the terminal device 1800 .
- millimeter wave radar may be used to sense the speed and/or heading of the target.
- LiDAR can utilize laser light to sense targets in the environment where the terminal device 1800 is located.
- a lidar may include one or more laser sources and one or more detectors, among other system components.
- the camera may be used to capture multiple images of the surrounding environment of the terminal device 1800 .
- the camera can be a still camera or a video camera.
- GPS may be any sensor used to estimate the geographic location of terminal device 1800 .
- the GPS may include a transceiver that estimates the position of the terminal device 1800 relative to the Earth based on satellite positioning data.
- computer system 1804 may be used to estimate the road traveled by terminal device 1800 using GPS in conjunction with map data.
- the IMU may be used to sense changes in position and orientation of the terminal device 1800 based on inertial acceleration and any combination thereof.
- the combination of sensors in the IMU may include, for example, an accelerometer and a gyroscope. Additionally, other combinations of sensors in the IMU are possible.
- the sensing system 1802 may also include sensors of internal systems of the terminal device 1800 being monitored (eg, in-vehicle air quality monitor, fuel gauge, oil temperature gauge, etc.). Sensor data from one or more of these sensors can be used to detect objects and their corresponding properties (position, shape, orientation, speed, etc.). This detection and identification is a critical function for the secure operation of terminal device 1800. Sensing system 1802 may also include other sensors. This application does not specifically limit this.
- the control system 1803 controls the operation of the terminal device 1800 and its components.
- the control system 1803 may include various elements, including steering units, throttles, braking units, sensor fusion algorithms, computer vision systems, route control systems, and obstacle avoidance systems.
- the steering system is operable to adjust the forward direction of the terminal device 1800.
- it may be a steering wheel system.
- the throttle is used to control the operating speed of the engine and thus the speed of the terminal device 1800 .
- Control system 1803 may additionally or alternatively include other components in addition to those shown in FIG. 18 . This application does not specifically limit this.
- the braking unit is used to control the terminal equipment 1800 to decelerate. Braking units use friction to slow down the wheels.
- the braking unit may convert the kinetic energy of the wheels into electrical current.
- the braking unit may also take other forms to slow down the wheel speed to control the speed of the terminal device 1800 .
- the computer vision system may be operable to process and analyze images captured by the camera in order to identify objects and/or features in the environment surrounding the terminal device 1800 . Objects and/or features may include traffic signals, road boundaries, and obstacles.
- Computer vision systems can use target recognition algorithms, structure from motion (SFM) algorithms, video tracking, and other computer vision techniques. In some embodiments, computer vision systems can be used to map an environment, track targets, estimate a target's speed, and so on. Route control systems are used to determine terminal equipment 1800 driving route.
- the route control system may combine data from the sensing system 1802, GPS, and one or more predetermined maps to determine a driving route for the terminal device 1800.
- An obstacle avoidance system is used to identify, evaluate, and avoid or otherwise negotiate potential obstacles in the environment of terminal device 1800 .
- control system 1803 may additionally or alternatively include components in addition to those shown and described. Alternatively, some of the components shown above may be reduced.
- the computer system 1804 may include at least one processor 18041. Further, the computer system 1804 may also include an interface circuit 18042. Processor 18041 executes instructions stored in a non-transitory computer-readable medium such as memory 18043. Computer system 1804 may also be multiple computing devices that control individual components or subsystems of terminal device 1800 in a distributed manner.
- the processor 18041 may be a circuit with signal (or data) processing capabilities. For details, please refer to the above related introduction, which will not be described again here.
- FIG. 18 functionally illustrates the processor, memory, and other elements of computer system 1804 in the same block
- the processor and memory may not actually be stored in the same physical enclosure. multiple processors or memories within.
- the memory may be a hard drive or other storage medium located in a housing different from computer system 1804.
- some components such as the steering component and the deceleration component, may each have their own processor that only performs calculations related to component-specific functionality.
- the processor can also be remote from the vehicle but can communicate wirelessly with the vehicle.
- memory 18043 may contain instructions (eg, program logic) that may be read by processor 18041 to perform various functions of terminal device 1800, including the functions described above.
- Memory 18043 may also contain additional instructions, including instructions to send data to, receive data from, interact with, and/or control one or more of propulsion system 1801 , sensing system 1802 , and control system 1803 .
- the memory 18043 may also store data such as road maps, route information, data detected by sensors, vehicle position, direction, speed and other such vehicle data, as well as other information. This information may be used by terminal device 1800 and computer system 1804 when terminal device 1800 is in autonomous, semi-autonomous and/or manual modes.
- User interface 1805 used to provide information to or receive information from the user of the terminal device 1800.
- user interface 1805 may include one or more input/output devices within a collection of peripheral devices, which may include, for example, a wireless communication system, a touch screen, a microphone and/or a speaker, and the like.
- Computer system 1804 may control the functionality of terminal device 1800 based on input received from various subsystems (eg, propulsion system 1801 , sensing system 1802 , and control system 1803 ) and from user interface 1805 .
- computer system 1804 may utilize input from control system 1803 in order to control the steering unit to avoid obstacles detected by sensing system 1802 and obstacle avoidance system.
- computer system 1804 is operable to provide control over many aspects of terminal device 1800 and its subsystems.
- the optical display system 1806 can be referred to the introduction of any of the previous embodiments, and will not be described again here. It should be noted that the functions of some components in the optical display system can also be implemented by other subsystems of the vehicle.
- the controller can also be a component in the control system.
- one or more of the components described above may be installed separately from or associated with the terminal device 1800 .
- the memory 18043 may exist partially or completely separately from the terminal device 1800.
- the components described above may be communicatively coupled together in wired and/or wireless manners.
- terminal device functional framework shown in Figure 18 is just an example.
- the terminal device 1800 may include more, fewer, or different systems, and each system may include more, less, or different components.
- systems and components shown can be combined or divided in any way, which is not specifically limited in this application.
- this application provides an imaging method, please refer to the introduction of Figure 19.
- This imaging method can be applied to the display module or optical display system or terminal device shown in any of the above embodiments. It can also be understood that the imaging method can be implemented based on the display module or optical display system or terminal device shown in any of the above embodiments.
- the following takes the light source component as a light source array as an example. The method includes the following steps:
- Step 1901 The eye tracking module detects the position of the observer's left eye and right eye.
- the process and principle of the eye tracking module detecting the position of the observer's left eye and right eye can be found in the relevant introduction mentioned above and will not be described again here.
- Step 1902 The eye tracking module sends left eye position information and right eye position information to the control module.
- the control module receives left eye position information and right eye position information from the eye tracking module.
- the eye tracking module is connected with the control module.
- Step 1903 The control module determines the position information of the first light source based on the left eye position information and the first corresponding relationship, and determines the position information of the second light source based on the right eye position information and the second corresponding relationship.
- the first correspondence relationship includes the relationship between the position of the left eye and the position information of the first light source
- the second correspondence relationship includes the correspondence relationship between the position of the right eye and the position information of the second light source. It should be noted that the first correspondence relationship and the second correspondence relationship may be in the form of a table, or may be in other possible forms, which is not limited in this application.
- Table 1 and Table 2 exemplarily show the first correspondence relationship and the second correspondence relationship.
- the position information of the first light source and the position information of the second light source in Table 1 and Table 2 are both represented by the rows and columns of the first light source and the second light source in the light source array.
- control module can also obtain the first period T 1 during which the first light source is turned on, the second period T 2 during which the second light source is turned on, the switching frequency v1 of the first light source, and the switching frequency v2 of the second light source. wait.
- the first period T 1 during which the first light source is turned on and the switching frequency v1 of the first light source can be carried in the first control signal and sent to the light source array.
- the second period T 2 during which the second light source is turned on and the switching frequency v2 of the second light source may be carried in the second control signal and sent to the light source array.
- Step 1904 The control module generates a first control signal based on the position information of the first light source and the position information of the second light source.
- the first control signal includes position information of the first light source and position information of the second light source.
- Step 1905 The control module generates a third control signal based on the position information of the first light source and the position information of the second light source.
- the third control signal is used to control the light modulation component to switch the frequency of the first image information and the second image information.
- Step 1904 may be executed first and then step 1905, or step 1905 may be executed first and then step 1904, or step 1904 and step 1905 may be synchronized. Execution, that is, the first control signal and the third control signal are generated synchronously, which is not limited in this application.
- Step 1906 The control module sends a first control signal to the light source component and a third control signal to the light modulation component.
- the light source component receives the first control signal from the control module
- the light modulation component receives the third control signal from the control module.
- Step 1907 The light source component turns on the first light source in the light source array during the first period and turns on the second light source in the light source array during the second period according to the received first control signal.
- the first light source that is turned on is used to emit a first light beam
- the second light source that is turned on is used to emit a second light beam.
- Step 1908 The light modulation component modulates the third light beam according to the third control signal to obtain the first image light carrying the first image information, and modulates the fourth light beam to obtain the second image light carrying the second image information.
- the third control signal includes the switching frequency of the first image information and the second image information.
- This switching frequency can be changed based on minimum requirements (i.e. the flicker frequency cannot be distinguished by the human eye) and user needs.
- the switching frequency of the first image information and the second image information is equal to the sum of the switching frequency of the first light source and the switching frequency of the second light source.
- the switching frequency of the first light source ⁇ 1 1/60 second
- the switching frequency of the second light source ⁇ 2 1/60 second. It can be understood that after the optical display system starts to operate, the switching frequency of the first image information and the second image information is usually fixed.
- the interval between the switching time of the light modulation component and the turning on time of the first light source is ⁇ T, where ⁇ T can also be preset during the initialization process of the display module. It should be understood that ⁇ T may be equal to 0 or not equal to 0, and this application does not limit this.
- the display module can be controlled to display images. If the first image information and the second image information are the same, the display module can realize two-dimensional image display. If the first image information and the second image information are different, the display module can realize three-dimensional image display.
- the eye tracking module continues to monitor the position of the human eye, and the eye tracking module continues to perform the above step 1901.
- the eye tracking module detects the new positions of the left eye and the right eye, and repeats the above steps 1902 to 1908.
- the first control signal in step 1902 does not change, and the first control signal continues to be sent to light the corresponding first light source or second light source.
- Figure 20a is an optical path diagram of an observer's left eye and right eye at position 1 provided by this application.
- the eye tracking module detects that the observer's left eye and right eye are at position 2, the optical path based on the display module can be seen in Figure 20b.
- the control module determines the first position information of the light valve according to the left eye position information and the third corresponding relationship, and determines the first position information of the light valve according to the right eye position information. and the fourth pair The second position information of the light valve should be determined according to the relationship.
- Table 3 and Table 4 exemplarily show the third correspondence relationship and the fourth correspondence relationship.
- the first position information of the light valve includes the first width and the first center coordinate of the light valve as an example.
- the second position information of the light valve includes the second width and the second center coordinate of the light valve. example.
- first width 11, the first width 12... the first width 1n in the above Table 3 can be the same or different
- second width 21, the second width 22... the second width 2n can be the same or different.
- the first width and the second width may be the same or different, which is not limited in this application.
- the above examples are based on the third correspondence relationship and the fourth correspondence relationship in different tables. It should be understood that the third corresponding relationship and the fourth corresponding relationship may also be in the same table, and this application does not limit this.
- the above step 1904 may specifically include the control module generating a second control signal based on the first position information of the light valve and the second position information of the light valve.
- control device includes corresponding hardware structures and/or software modules that perform each function.
- modules and method steps of each example described in conjunction with the embodiments disclosed in this application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software driving the hardware depends on the specific application scenarios and design constraints of the technical solution.
- FIG. 21 and FIG. 22 are schematic structural diagrams of possible control devices provided by the present application. These control devices can be used to implement the functions of the control devices in the above method embodiments, and therefore can also achieve the beneficial effects of the above method embodiments.
- control device 2100 includes a processing module 2101 and a transceiver module 2102.
- the control device 2100 is used to implement the functions of the control device in the method embodiment shown in FIG. 19 .
- the processing module 2101 coordinates with the transceiver module 2102 to control the light source component to emit the first beam and the second beam in a time-sharing manner, the first beam and The exit position of the second beam is different.
- the first beam is adjusted to a third beam through the optical shaping component, and the second beam is adjusted to a fourth beam through the optical shaping component.
- the light modulating component is controlled to modulate the third beam to carry the first image information.
- the first image light is optically modulated on the fourth beam to obtain the second image light carrying the second image information; the first image light is reflected to the observer through the reflective component The left eye of the observer is imaged, and the second image light is reflected by the reflective component to the observer's right eye for imaging.
- processing module 2101 in the embodiment of the present application can be implemented by a processor or processor-related circuit components
- transceiver module 2102 can be implemented by a transceiver or transceiver-related circuit components.
- the control device 2200 may include a processor 2201 and an interface circuit 2202.
- the processor 2201 and the interface circuit 2202 are coupled to each other.
- the interface circuit 2202 may be a transceiver or an input-output interface.
- the control device 2200 may also include a memory 2203 for storing instructions executed by the processor 2201 or input data required for the processor 2201 to run the instructions or data generated after the processor 2201 executes the instructions.
- control device 2200 When the control device 2200 is used to implement the method shown in Figure 19, the processor 2201 is used to perform the functions of the above-mentioned processing module 2101, and the interface circuit 2202 is used to perform the functions of the above-mentioned transceiver module 2102.
- a computer program product includes one or more computer programs or instructions.
- the computer may be a general purpose computer, a special purpose computer, a computer network, a control device, user equipment or other programmable device.
- a computer program or instructions may be stored in or transmitted from one computer-readable storage medium to another, e.g., a computer program or instructions may be transferred from a website, computer, server, or data center Transmission by wired or wireless means to another website site, computer, server or data center.
- Computer-readable storage media can be any available media that can be accessed by a computer, or data storage devices such as servers and data centers that integrate one or more available media. Available media can be magnetic media, such as floppy disks, hard disks, tapes; optical media, such as digital video discs (DVD); or semiconductor media, such as solid state drives (SSD) ).
- a, b or c can mean: a, b, c, "a and b", “a and c", “b and c”, or “a and b and c” ”, where a, b, c can be single or multiple.
- the character “/” generally indicates that the related objects are in an "or” relationship.
- the character “/” indicates that the related objects are in a “division” relationship.
- the word “exemplary” is used to mean an example, illustration, or illustration. Any embodiment or design described herein as “example” is not intended to be construed as preferred or advantageous over other embodiments or designs. Alternatively, it can be understood that the use of the word “example” is intended to present concepts in a specific manner and does not constitute a limitation on this application.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Optics & Photonics (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
一种显示模组、光学显示***、终端设备及成像方法。用于解决现有技术中图像显示存在分辨率损失的问题。应用于抬头显示设备HUD、近眼显示NED设备或车载显示等。显示模组包括:光源组件用于分时发射第一光束及第二光束,第一光束和第二光束的出射位置不同。光学整形组件用于调整第一光束的指向得到第三光束以及调整第二光束的指向得到第四光束。光调制组件用于对第三光束进行调制得到携带第一图像信息的第一图像光、以及对第四光束进行调制得到携带第二图像信息的第二图像光。反射组件用于将第一图像光反射至观察者的左眼成像及将第二图像光反射至观察者的右眼成像。光学整形组件位于光源组件与光调制组件之间。如此可避免损失图像的分辨率。
Description
本申请要求于2022年8月26日提交中国国家知识产权局、申请号202211033849.X、申请名称为“一种显示模组、光学显示***、终端设备及成像方法”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及显示技术领域,尤其涉及一种显示模组、光学显示***、终端设备及成像方法。
三维(three dimensional,3D)显示可以给观察者很强的立体逼真感,而且会增加显示景深以及提升显示内容的丰富性。通常3D技术的实现是基于左眼和右眼两组图像信息,并将其投影到荧幕之上,观测者使用偏振光眼镜来分离图像信息,使得左眼获取一组图像信息,右眼获取另外一组图像信息。
随着3D显示技术的发展,裸眼3D显示技术(或称为视差屏障或视差障栅技术)已成为研究的热点之一。目前裸眼3D显示技术可以在不借助偏振光眼镜等外部工具,通过光屏障技术实现立体视觉效果。然而,基于光屏障技术显示的3D图像会造成分辨率的损失。
综上所示,如何在不损失分辨率的情况下实现图像显示,是当前亟需解决的技术问题。
发明内容
本申请提供一种显示模组、光学显示***、终端设备及成像方法,用于减小或消除显示的图像存在分辨率损失的问题。
第一方面,本申请提供一种显示模组,该显示模组包括光源组件、光学整形组件、光调制组件和反射组件,光学整形组件位于光源组件与光调制组件之间。光源组件用于分时发射第一光束及第二光束,第一光束和第二光束的出射位置不同。光学整形组件用于调整第一光束的指向得到第三光束,以及调整第二光束的指向得到第四光束。光调制组件用于对第三光束进行调制得到携带第一图像信息的第一图像光、以及对第四光束进行调制得到携带第二图像信息的第二图像光。反射组件用于将第一图像光反射至观察者的左眼成像,以及将第二图像光反射至观察者的右眼成像。
基于上述显示模组,由于光学整形组件位于光源组件与光调制组件之间,光源组件可以与光学整形组件配合生成方向性背光,光调制组件通过时分的方式加载第一图像信息或第二图像信息,观察者单眼即可看到光调制组件的所有像素调制的第一图像信息或第二图像信息,因此,可以减小或避免显示的图像的分辨率的损失。进一步,第一图像光在左眼成像,第二图像光在右眼成像,观察者可以观察到不同的视差图像,若第一图像信息和第二图像信息不
同,可获得立体的3D图像效果。
在一种可能的实现方式中,光源组件包括光源阵列,光源阵列包括第一光源和第二光源。光源组件用于根据接收到的第一控制信号,在第一时段第一光源发射第一光束、及在第二时段第二光源发射第二光束。
通过光源阵列可以实现在眼盒中多视区的划分,使观察者在眼盒的不同位置都能进行观看。
进一步,可选的,第一控制信号包括第一光源的位置信息、及第二光源的位置信息。
在一种可能的实现方式中,光源阵列中的光源呈平面分布。
通过平面分布的光源阵列可以减小显示模组的厚度,而且便于密集的光源阵列的加工。
在另一种可能的实现方式中,光源阵列中的光源呈曲面分布。
通过曲面分布的光源阵列可以使得观察者在边缘和中央看到的图像基本一致,从而可以扩大显示模组的眼盒范围。
在又一种可能的实现方式中,光源阵列中的光源呈多边行分布。
通过多边形分布的光源阵列可以在尽可能减小显示模组的厚度的情况下,使得观察者在边缘和中央看到的图像尽可能一致,从而可以扩大显示模组的眼盒范围。
在一种可能的实现方式中,光源组件包括面光源和光阀;面光源用于发射面光束;光阀用于根据接收到的第二控制信号,在第三时段打开第一位置的光阀,面光束中的第一光束经第一位置射出,以及在第四时段打开第二位置的光阀,面光束中的第二光束经第二位置射出。
进一步,可选的,第二控制信号包括光阀的第一位置信息、及光阀的第二位置信息。
通过光阀配合面光源可实现调制精度较高的像素化光源,使得在眼跟踪状态下,第一光束和第二光束的切换更平滑,观察者在眼盒内移动观察到的图像闪烁更少、更加稳定;且通过控制光阀开启的宽度,能够精准匹配更大的观看深度范围。
进一步,面光源可以为平面型面光源,和/或,光阀可以为平面型光阀。
通过平面型面光源和/或平面型光阀有助于减小显示模组的厚度。
在一种可能的实现方式中,光学整形组件包括透镜阵列。进一步,透镜阵列中的透镜呈平面分布。
通过平面分布的透镜阵列,可以进一步减小显示模组的厚度。而且,通过透镜阵列有助于提高基于第一图像光或第二图像光形成的图像的均匀度。
在一种可能的实现方式中,透镜阵列包括非球面透镜阵列。
由于非球面透镜从中心到边缘的曲率连续发生变化,通过非球面透镜阵列可以使得不同方向的光束都会聚焦在同一个定点上,因此,通过非球面透镜,可以减小显示模组的视场边缘的像差。通过非球面透镜阵列不仅可以减小显示模组的像差,而且可以在较大视场(field of view,FOV)的情况下,光源组件也可以设计为平面光源阵列,进而可以降低加工和组装复杂度。
在另一种可能的实现方式中,透镜阵列包括菲涅尔透镜阵列。
由于菲涅尔透镜的表面的一面为光面,另一面刻录了由小到大的同心圆(或称为纹路或菲涅尔带),因此,通过菲涅尔透镜可以使得图像的边缘的像差较小。
在一种可能的实现方式中,透镜阵列中透镜的节距(是指透镜阵列中单个透镜的有效直径或有效口径的大小)p满足下述公式1:
其中,α为第一光束的发散角和第二光束的发散角中较大的发散角,h为第一光源或第二光源的横向发光宽度,t为光源组件的发光面与光学整形组件中靠近光调制组件的面之间的距离。
通过上述公式1,可以保证光源阵列中单次开启的光源(即第一光源或第二光源)即可照亮对应的整个透镜,从而可以避免透镜的边缘存在暗区,影响显示模组显示的图像的均匀性。
进一步,可选的,透镜阵列中透镜的节距p满足下述公式2:
其中,Weye为虚拟眼盒面上的虚拟眼间距,d为光学整形组件与虚拟眼盒面之间的距离,虚拟眼盒面为实际眼盒面经反射组件反射形成的虚像,t为光源组件的发光面与光学整形组件靠近所述光调制组件的面之间的距离。
通过上述公式2,可以保证经过相邻透镜的第一光束或第二光束在观察面(或称为实际眼盒面)不发生串扰。
在一种可能的实现方式中,光学整形组件也可以包括非球面透镜。
由于非球面透镜从中心到边缘的曲率连续发生变化,可以使得不同方向的光束都会聚焦在同一个定点上,因此,通过非球面透镜可以减小显示模组的视场边缘的像差。
在一种可能的实现方式中,反射组件包括至少一个反射元件,反射元件可以包括但不限于平面反射镜、球面反射镜、自由曲面镜、或半透半反镜。
第二方面,本申请提供一种光学显示***,该光学显示***包括控制模组以及上述第一方面或第一方面中的任意一种显示模组。控制模组用于控制显示模组进行图像显示。
在一种可能的实现方式中,光源组件包括光源阵列,光源阵列中的光源呈平面分布,光源阵列包括第一光源和第二光源。控制模组用于获取观察者的左眼位置信息和右眼位置信息;根据左眼位置信息确定第一光源的位置信息,以及根据右眼位置信息确定第二光源的位置信息;根据第一光源的位置信息和第二光源的位置信息生成第一控制信号,向光源组件发送第一控制信号。进一步,光源组件用于根据接收到的第一控制信号,在第一时段第一光源发射第一光束、及在第二时段第二光源发射第二光束。
示例性的,第一控制信号包括第一光源的位置信息及第二光源的位置信息。
在一种可能的实现方式中,光源组件包括面光源和光阀;控制模组用于获取观察者的左眼位置信息和右眼位置信息;根据左眼位置信息确定光阀的第一位置信息,以及根据右眼位置信息确定光阀的第二位置信息;根据光阀的第一位置信息和光阀的第二位置信息生成第二控制信号向光源组件发送第二控制信号。进一步,面光源用于发射面光束;光阀,用于根据接收到的第二控制信号,在第三时段打开第一位置的光阀,面光束中的第一光束经第一位置射出,以及在第四时段打开第二位置的光阀,面光束中的第二光束经第二位置射出。
其中,面光源为平面型面光源和/或光阀为平面型光阀。
在一种可能的实现方式中,第二控制信号包括光阀的第一位置信息、及光阀的第二位置信息。
在一种可能的实现方式中,光学显示***还包括眼跟踪模组,眼跟踪模组与控制模组连
接。进一步,可选的,控制模组用于接收来自眼跟踪模组的左眼位置信息和右眼位置信息。
第三方面,本申请提供一种终端设备,包括上述第一方面或第一方面中的任意一种光学显示***,光学显示***安装于终端设备上。
在一种可能的实现方式中,显示模组包括的反射组件可以为终端设备上的风挡。
第四方面,本申请提供一种成像方法,该方法可应用于显示模组,显示模组包括光源组件、光学整形组件、光调制组件和反射组件,光学整形组件位于光源组件与光调制组件之间。该方法包括控制光源组件分时发射第一光束及第二光束,第一光束和第二光束的出射位置不同,第一光束经光学整形组件调整为第三光束,第二光束经光学整形组件调整为第四光束;以及控制光调制组件对第三光束经光调制得到携带第一图像信息的第一图像光,对第四光束经光调制得到携带第二图像信息的第二图像光;第一图像光经反射组件反射至观察者的左眼成像,第二图像光经反射组件反射至观察者的右眼成像;向光源组件发送第一控制信号、以及向光调制组件发送第三控制信号。
示例性的,上述控制方法可由控制模组执行。
在一种可能的实现方式中,获取观察者的左眼位置信息和右眼位置信息,根据左眼位置信息和右眼位置信息,生成控制信号,并向光源组件发送控制信号。其中,控制信号用于控制所述光源组件分时发射所述第一光束及所述第二光束。
在一种可能的实现方式中,接收来自眼跟踪模组的左眼位置信息和右眼位置信息。
在一种可能的实现方式中,控制信号包括第一控制信号,光源组件包括光源阵列;根据左眼位置信息确定第一光源的位置信息,以及根据右眼位置信息确定第二光源的位置信息;进一步,根据第一光源的位置信息和第二光源的位置信息生成第一控制信号。进一步,第一控制信号用于控制所述光源阵列中的第一光源在第一时段发射第一光束、及控制光源阵列中的第二光源在第二时段发射第二光束。
在一种可能的实现方式中,控制信号包括第二控制信号,光源组件包括面光源和光阀;根据所述左眼位置信息确定所述光阀的第一位置信息,以及根据所述右眼位置信息确定所述光阀的第二位置信息;根据光阀的第一位置信息和光阀的第二位置信息生成第二控制信号。进一步,第二控制信号用于控制在第三时段打开第一位置的光阀,在第四时段打开第二位置的光阀。
第五方面,本申请提供一种控制装置,该控制装置用于实现上述第四方面或第四方面的任意可能的实现方式中的方法,包括相应的功能模块,分别用于实现以上方法中的步骤。功能可以通过硬件实现,也可以通过硬件执行相应的软件实现。硬件或软件包括一个或多个与上述功能相对应的模块。
在一种可能的实现方式中,该控制装置可以包括:接口电路和处理器。该处理器通过逻辑电路或执行代码指令用于实现上述第一方面的相应功能,该接口电路用于接收来自控制装置之外的其它控制装置的信号并传输至处理器或将来自处理器的信号发送给控制装置之外的其它控制装置。其中,接口电路可以为独立的接收器、独立的发射器、集成收发功能的收发器。可选地,该控制装置还可以包括存储器,该存储器可以与处理器耦合,其保存该控制装置必要的程序指令和数据。
其中,处理器与接口电路协作,用于控制光源组件分时发射第一光束及第二光束,第一光束和第二光束的出射位置不同,第一光束经光学整形组件调整为第三光束,第二光束经光
学整形组件调整为第四光束;以及控制光调制组件对第三光束调制得到携带第一图像信息的第一图像光,对第四光束调制得到携带第二图像信息的第二图像光;第一图像光经反射组件反射至观察者的左眼成像,第二图像光经反射组件反射至观察者的右眼成像。
在一种可能的实现方式中,接口电路用于获取所述观察者的左眼位置信息和右眼位置信息;处理器用于根据左眼位置信息和右眼位置信息生成控制信号,控制信号用于控制所述光源组件在第一时段发射第一光束、及在第二时段发射第二光束;接口电路还用于向光源组件发送控制信号。
进一步,可选的,接口电路用于接收来自眼跟踪模组的左眼位置信息和右眼位置信息。
在一种可能的实现方式中,控制信号包括第一控制信号,光源组件包括光源阵列。处理器具体用于:根据左眼位置信息确定第一光源的位置信息,以及根据右眼位置信息确定第二光源的位置信息;并根据第一光源的位置信息和第二光源的位置信息生成第一控制信号。
在一种可能的实现方式中,控制信号包括第二控制信号,光源组件包括面光源和光阀;处理器具体用于根据左眼位置信息确定光阀的第一位置信息,以及根据右眼位置信息确定光阀的第二位置信息;并根据所述光阀的第一位置信息和所述光阀的第二位置信息生成所述第二控制信号。
第六方面,本申请提供一种控制装置,该控制装置用于实现上述第四方面或第四方面的任意可能的实现方式中的方法,包括相应的功能模块,分别用于实现以上方法中的步骤。功能可以通过硬件实现,也可以通过硬件执行相应的软件实现。硬件或软件包括一个或多个与上述功能相对应的模块。
其中,处理模块与收发模块协作,用于控制光源组件分时发射第一光束及第二光束,第一光束经光学整形组件调整为第三光束,第二光束经光学整形组件调整为第四光束;以及控制光调制组件对第三光束调制得到携带第一图像信息的第一图像光,对第四光束调制得到携带第二图像信息的第二图像光;第一图像光经反射组件反射至观察者的左眼成像,第二图像光经反射组件反射至观察者的右眼成像。
在一种可能的实现方式中,收发模块用于获取所述观察者的左眼位置信息和右眼位置信息;处理模块用于根据左眼位置信息和右眼位置信息生成控制信号,控制信号用于控制所述光源组件在第一时段发射第一光束、及在第二时段发射第二光束;收发模块还用于向光源组件发送控制信号。
进一步,可选的,收发模块用于接收来自眼跟踪模组的左眼位置信息和右眼位置信息。
在一种可能的实现方式中,控制信号包括第一控制信号,光源组件包括光源阵列。处理模块具体用于:根据左眼位置信息确定第一光源的位置信息,以及根据右眼位置信息确定第二光源的位置信息;并根据第一光源的位置信息和第二光源的位置信息生成第一控制信号。第一控制信号用于控制光源组件在第一时段第一光源发射第一光束、及在第二时段第二光源发射第二光束。
在一种可能的实现方式中,控制信号包括第二控制信号,光源组件包括面光源和光阀;处理模块具体用于根据左眼位置信息确定光阀的第一位置信息,以及根据右眼位置信息确定光阀的第二位置信息;并根据光阀的第一位置信息和光阀的第二位置信息生成第二控制信号。第二控制信号用于控制光阀在第三时段打开第一位置的光阀、面光源发射的面光束中的第一光束经第一位置射出,以及在第四时段打开第二位置的光阀、面光源发射的面光束中的第二
光束经第二位置射出。
第七方面,本申请提供一种计算机可读存储介质,计算机可读存储介质中存储有计算机程序或指令,当计算机程序或指令被控制装置执行时,使得该控制装置执行上述第四方面或第四方面的任意可能的实现方式中的方法。
第八方面,本申请提供一种计算机程序产品,该计算机程序产品包括计算机程序或指令,当该计算机程序或指令被控制装置执行时,使得该控制装置执行上述第四方面或第四方面的任意可能的实现方式中的方法。
上述第二方面至第八方面中任一方面可以达到的技术效果可以参照上述第一方面中有益效果的描述,此处不再重复赘述。
图1a为本申请提供的一种应用于HUD的场景示意图;
图1b为本申请提供的一种应用于NED设备的场景示意图;
图1c为本申请提供的一种应用于车载显示屏的场景示意图;
图2为本申请提供的一种显示模组的结构示意图;
图3为本申请提供的一种显示模组中的光路示意图;
图4为本申请提供的一种第一光源和第二光源的关系示意图;
图5a为本申请提供的一种一维光源阵列的结构示意;
图5b为本申请提供的一种二维光源阵列的结构示意图;
图5c为本申请提供的一种光源阵列的错位排列的结构示意图;
图5d为本申请提供的又一种光源阵列的错位排列的结构示意图;
图5e为本申请提供的又一种光源阵列中的错位排列的结构示意图;
图5f为本申请提供的另一种光源阵列中的光源在列方向上错位排列的结构示意图;
图5g为本申请提供的一种光源阵列在行方向上部分等间隔的错位排列部分非等间隔错位排列的结构示意图;
图5h为本申请提供的一种光源阵列在列方向部分等间隔的错位排列部分非等间隔错位排列的结构示意图;
图6a为本申请提供的一种光源阵列中的光源为多边形分布的示意图;
图6b为本申请提供的一种正六边形分布的光源阵列的三维图;
图7a为本申请提供的一种光源阵列中的光源为曲面分布的结构示意图;
图7b为本申请提供的一种曲面分布的光源阵列的三维图;
图7c为本申请提供的一种曲面分布的光源阵列的三维图;
图8a为本申请提供的一种面光源和光阀的结构示意图;
图8b为本申请提供的另一种面光源和光阀的结构示意图;
图9a为本申请提供的一种菲涅尔透镜的结构示意图;
图9b为本申请提供的一种非球面透镜阵列的结构示意图;
图9c为本申请提供的一种球面透镜阵列的结构示意图;
图9d为本申请提供的一种菲涅尔透镜阵列的结构示意图;
图10a为本申请提供的一种显示屏的结构示意图;
图10b为本申请提供的一种显示屏的结构示意图;
图11为本申请提供的一种显示屏的光路示意图;
图12为本申请提供的又一种显示模组的结构示意图;
图13为本申请提供的又一种显示模组的结构示意图;
图14为本申请提供的又一种显示模组的结构示意图;
图15为本申请提供的一种光学显示***的结构示意图;
图16为本申请提供的一种辐辏调节冲突的原理;
图17为本申请提供的一种光学显示***的电路示意图;
图18为本申请提供的一种车辆的示例性功能框图;
图19为本申请提供的一种成像方法流程示意图;
图20a为本申请提供的一种观察者的左眼和右眼在位置1的光路图示意图;
图20b为本申请提供的一种观察者的左眼和右眼在位置2的光路图示意图;
图21为本申请提供的一种控制装置的结构示意图;
图22为本申请提供的一种控制装置的结构示意图。
下面将结合附图,对本申请实施例进行详细描述。
下面对本申请可能的应用场景进行介绍。
在一种可能的应用场景中,本申请提供的显示模组也可以集成于抬头显示设备(head-up device,HUD),请参阅图1a,以HUD安装于车辆为例介绍。HUD可将形成的图像(称为HUD虚像)投射在驾驶员的前方视野范围,并与真实路面信息融合起来,从而可增强驾驶员对于实际驾驶环境的感知。例如,HUD可以将携带导航信息(如方向箭头、距离、和/或行驶时间等)和/或车辆的状态信息(如行驶速度、行驶里程、转速、温度、油量、和/或车灯状态等信息)的HUD虚像叠加在车辆外的真实环境(如安全车距、周围障碍物、和/或倒车影像等)上,使得驾驶员可获得增强现实的视觉效果。基于此,车辆可以实现增强现实(augmented reality,AR)导航、自适应巡航、车道偏离预警等功能。或者,可以结合高级驾驶辅助***(advanced driving assistant system,ADAS)的功能,实现车辆的辅助驾驶或智能驾驶等。通常,为了不干扰路况,基于车辆的状态信息形成的HUD虚像的虚像距约在2~3米。为了使得基于导航信息形成的HUD虚像与真实路面能够更好的融合,基于导航信息形成的HUD虚像的虚像距约为7~15米。其中,HUD包括但不限于挡风玻璃(windshield-head up device,W-HUD)、或AR-HUD等。
在又一种可能的应用场景中,本申请提供的显示模组也可以集成于近眼显示(near eye display,NED)设备。NED设备例如可以是AR设备或虚拟(virtual reality,VR)设备,AR设备可以包括但不限于AR眼镜或AR头盔,VR设备可以包括但不限于VR眼镜或VR头盔。请参阅图1b,以AR眼镜为例示例,用户可佩戴AR眼镜进行游戏、观看视频、参加虚拟会议、或视频购物等。
在又一种可能的应用场景中,本申请提供的显示模组也可以集成于车载显示屏。请参阅图1c,车载显示屏可以安装在车辆的座椅后背或副驾驶位置等,本申请对车载显示屏安装的
位置不作限定,图1c是以安装于座椅后背示例的。
应理解,上述给出的可能的应用场景仅是举例,本申请提供的显示模组还可以集成于包括图像生成单元(picture generation unit,PGU)和反射组件的设备中,或者其它可能的智能虚像光显、虚空显示等其它可能显示场景,而不限于上述示例出的场景。
如背景技术介绍,目前基于光屏障技术的图像显示会造成分辨率的损失。鉴于此,本申请提供一种显示模组。该显示模组可以不损失显示的图像的分辨率。
基于上述内容,下面结合附图对本申请提出的显示模组进行具体阐述。
如图2所示,为本申请提供的一种显示模组的结构示意图。该显示模组包括光源组件、光学整形组件、光调制组件和反射组件,光学整形组件位于光源组件与光调制组件之间。其中,光源组件用于分时发射第一光束和第二光束,第一光束和第二光束从光源组件的出射位置不同。也可以理解为,光源组件在不同的时段从不同位置发射出不同的光束。光学整形组件用于调整第一光束的指向得到第三光束,以及调整第二光束的指向得到第四光束。光调制组件用于对第三光束进行调制得到携带第一图像信息的第一图像光,以及对第四光束进行调制得到携带第二图像信息的第二图像光。反射组件用于将第一图像光反射至观察者的左眼成像,以及将第二图像光反射至观察者的右眼成像。
结合图3,第一光束的传播光路为:光源组件发射第一光束,第一光束经光学整形组件调整指向得到第三光束,第三光束经光调制组件将第一图像信息调制于第三光束得到第一图像光,第一图像光经反射组件发射至观察者的左眼成像。第二光束的传播光路为:光源组件发射第二光束,第二光束经光学整形组件调整指向得到第四光束,第四光束经光调制组件将第二图像信息调制于第四光束得到第二图像光,第二图像光经反射组件反射至观察者的右眼成像。
基于上述显示模组,由于光学整形组件位于光源组件与光调制组件之间,光源组件可以与光学整形组件配合生成方向性背光,光调制组件通过时分的方式加载第一图像信息或第二图像信息,观察者单眼即可看到光调制组件的所有像素调制的第一图像信息或第二图像信息,也可以理解为,观察者单眼即可看到光调制组件调制的完整的第一图像信息或第二图像信息,因此,可以减小或避免显示的图像的分辨率的损失。进一步,第一图像光在左眼成像,第二图像光在右眼成像,观察者可以观察到不同的视差图像,若第一图像信息和第二图像信息不同,可获得立体的3D图像效果。可以理解的是,若第一图像信息与第二图像信息相同,显示模组也可以显示二维图像效果。
下面对图2所示的各个功能组件和结构分别进行介绍说明,以给出示例性的具体实现方案。
一、光源组件
在一种可能的实现方式中,光源组件用于根据接收到的控制信号,分时发射第一光束和第二光束。
如下基于示例性的示出了两种可能的光源组件的结构,分别详细介绍光源组件分时发射第一光束和第二光束的过程。
结构一,光源组件包括光源阵列。
在一种可能的实现方式中,光源阵列包括第一光源和第二光源。光源阵列根据接收到的第一控制信号,在第一时段第一光源发射第一光束,在第二时段第二光源发射第二光束。其
中,第一控制信号包括第一光源的位置信息及第二光源的位置信息。可以理解的是,第一光源开启的第一时段T1、第二光源开启的第二时段T2可以在显示模组初始化过程中可以设置;或者,第一光源开启的第一时段T1、第二光源开启的第二时段T2也可以携带于第一控制信号中。需要说明的是,开启第一光源和第二光源间隔预设时长Δt,请参阅图4,通常预设时长Δt等于光调制组件的调制时长T5。
具体的,光源阵列可根据第一控制信号中的第一光源的位置信息确定需要开启的第一光源,第一光源在第一时段T1开启,开启的第一光源用于发射第一光束;根据第二光源的位置信息确定需要开启的第二光源,第二光源在第二时段T2开启,开启的第二光源用于发射第二光束。
下面基于光源阵列的分布方式,如下示例性的示出了三种可能的情形。
情形一,光源阵列中的光源呈平面分布。
在一种可能的实现方式中,光源阵列包括m×n个光源,m为大于1的整数,n为正整数;或者,m为正整数,n为大于1的整数。具体的,光源阵列可以是一维阵列(或称为线列型),或者也可以是二维阵列(或称为面阵型)。
如下基于光源阵列中光源的排列方式分两种情形介绍。
情形1,光源阵列中的光源为一维排列。
如图5a所示,为本申请提供的一种一维光源阵列的结构示意。该示例中以光源阵列包括6×1个光源为例示例。也可以理解为,这6个光源沿行方向呈条状排列。
情形2,光源阵列中的光源为二维排列。
基于光源阵列中的光源在行方向和/或列方向的对齐方式可进一步分如下五种情形介绍。
情形2.1,光源阵列中的光源在行方向和列方向上均是对齐排列的。
如图5b所示,为本申请提供的一种二维光源阵列的结构示意图。该示例中以光源阵列包括6×6个光源为例。该示例中光源在行方向上是对齐的,在列方向上也是对齐的。
情形2.2,光源阵列中的光源在行方向等间隔的错位排列,在列方向是对齐排列的。
如图5c所示,为本申请提供的一种光源阵列的错位排列的结构示意图。该光源阵列中的光源在行方向上等间隔的错位排列,该示例中以3行为周期的错位排列(或称为错位排列的周期)为例,任意相邻两个光源在行方向的错位大小均为Δ1。需要说明的是,在行方向的错位大小Δ1小于相邻两个光源的中心之间的距离S1。
情形2.3,光源阵列中的光源在列方向等间隔的错位排列,在行方向是对齐排列的。
如图5d所示,为本申请提供的又一种光源阵列的错位排列的结构示意图。其中,该光源阵列中的光源在列方向上是等间隔的错位排列的,该示例中以3列为周期的错位排列为例,任意相邻两个光源在列方向的错位大小为Δ2。需要说明的是,在列方向的错位大小Δ2小于相邻两个光源的中心之间的距离H1。
应理解,上述图5c中的错位大小Δ1可以与上述图5d中的错位大小Δ2相同,也可以不相同,本申请对此不作限定。
情形2.4,光源阵列中的光源在行方向不等间隔的错位排列,在列方向是对齐排列的。
如图5e所示,为本申请提供的又一种光源阵列中的错位排列的结构示意图。该光源阵列中的光源在行方向上的错位大小中存在至少两种不同的错位大小,该示例中以2行为周期的错位排列为例,即在行方向包括两种不同的错位大小。相邻两个光源在行方向的错位大小为
Δ3或Δ4,该示例中以Δ3小于Δ4为例。任意相邻两个光源在行方向的错位大小Δ3小于相邻两个光源的中心之间的距离S1、且任意相邻两个光源在行方向的错位大小Δ4也小于相邻两个光源的中心之间的距离S1。
需要说明的是,在行方向不等间隔的错位排列中的错位大小可以互不相同,或者也可以部分相同部分不同,本申请对此不作限定。
情形2.5,光源阵列中的光源在列方向不等间隔的错位排列,在行方向是对齐排列的。
如图5f所示,为本申请提供的另一种光源阵列中的光源在列方向上错位排列的结构示意图。该光源阵列中的光源在列方向上的错位大小中存在至少两种不同的错位大小,该示例中以2列为周期的错位排列为例,即在列方向包括两种不同的错位大小。相邻两个光源在列方向的错位大小为Δ5或Δ6,该示例中以Δ5小于Δ6为例。任意相邻两个光源在列方向的错位大小Δ5小于相邻两个光源的中心之间的距离H1、且任意相邻两个光源在列方向的错位大小Δ6小于相邻两个光源的中心之间的距离H1。
需要说明的是,在列方向不等间隔的错位排列中错位大小可以互不相同,也可以部分相同部分不相同,本申请对此不作限定。
可以理解的是,光源阵列中光源在行方向上错位排列方式也可以是上述情形2.2和情形2.5的组合,即部分是等间隔的错位排列,部分是非等间隔错位排列。可参见图5g,在行方向的错位大小为Δ7、Δ8和Δ7。类似的,光源阵列中光源在列方向上错位排列方式也可以是上述情形2.3和情形2.5的组合,即部分是等间隔的错位排列,部分是非等间隔错位排列。可参见图5h,在列方向的错位大小为Δ9、Δ0和Δ9。可以理解的是,为了尽可能的减小光学串扰,相邻两个光源之间的间隔可以设置的大些,例如,相邻两个光源之间的间隔可设置为400微米或更大。
应理解,上述给出的光源阵列中的光源均是以矩形为例的,光源的形状也可以是其它可能的任意形状,例如圆形、椭圆形或多边形等,本申请对此不作限定。
情形二,光源阵列中的光源呈多边行分布。
请参阅图6a,为本申请提供的一种光源阵列中的光源为多边形分布的示意图。该示例中以光源阵列中的光源为正六边形分布为例。图6b为正六边形分布的光源阵列的三维图。
通过光源阵列为多边行分布,可以在尽可能的减小显示模组的厚度的情况下,使得观察者在边缘和中央看到的图像尽可能一致,从而可以扩大显示模组的眼盒范围。
情形三,光源阵列中的光源呈曲面分布。
请参阅图7a,为本申请提供的一种光源阵列中的光源为曲面分布的结构示意图。请参阅图7b或图7c,为曲面分布的光源阵列的三维图。通过曲面分布的光源,可以使得观察者在边缘和中央看到的图像尽基本一致,从而可以扩大显示模组的眼盒范围。
需要说明的是,上述给出的光源阵列可以实现独立寻址。独立寻址是指可独立选通(或称为点亮或开启或通电)光源阵列中的光源,选通的光源用于发射第一光束或第二光束。例如,向光源阵列中的第一光源输入驱动电流,以选通第一光源。向光源阵列中的第二光源输入驱动电流,以选通第二光源。可以理解的是,光源阵列的寻址方式与光源阵列中光源的物理连接关系相关。例如,若光源阵列中各个光源的物理连接方式为并联,则可以逐点选通光源,或者也可以按需选通光源,其中,按需选通例如可以是在某一时刻选通特定位置的光源等。再比如,光源阵列中的同一列内的光源串联,不同列之间并联,则可以逐列选通光源阵
列中的光源。再比如,光源阵列同一行内的光源串联,不同行之间并联,则可以逐行选通光源阵列中的光源。再比如,若光源阵列中各斜对角线上的光源串联,不同斜对角线上光源并联,则可以按斜对角线选通光源阵列中的光源等,此处不再逐一列举。
示例性地,光源阵列中的光源例如可以是激光二极管(laser diode,LD)、发光二级管(light-emitting diode,LED)、垂直腔面发射激光器(vertical cavity surface emitting laser,VCSEL)、边缘发射激光器(edge emitting laser,EEL)、全固态半导体激光器(diode pumped solid state laser,DPSS)、或光纤激光器等。可以理解的是,上述给出的光源仅是示例,本申请对此不作限定。
结构二,光源组件包括面光源和光阀。
在一种可能的实现方式中,光源组件可以包括面光源和光阀。进一步,面光源可以为平面型面光源,光阀可以为平面型光阀。请参阅图8a,光阀可以覆盖完整的面光源,当某一位置的光阀打开,面光源发射的面光束可以从打开光阀的位置射出。
其中,面光源用于发射面光束,通常面光源为常亮状态。光阀用于根据接收到的第二控制信号在第三时段打开第一位置的光阀,面光源发射的面光束中的第一光束经第一位置射出,请参阅图8b中的(1)。进一步,光阀用于根据第二控制信号在第四时段打开第二位置的光阀,面光源发射的面光束中的第二光束经第二位置射出,请参阅图8b中的(2)。
也可以理解为,第二控制信号包括光阀的第一位置信息、及光阀的第二位置信息。其中,光阀的第一位置信息包括需要打开的光阀的第一宽度和第一中心坐标,或者,包括需要打开的光阀的第一起始位置和第一终止位置。光阀的第二位置信息包括需要打开的光阀的第二宽度和第二中心坐标,或者,包括需要打开的光阀的第二起始位置和第二终止位置。其中,第一宽度可以与第二宽度相同也可以不同,本申请对此不作限定。可以理解的是,第一位置的光阀打开的第三时段T3和第二位置的光阀打开的第四时段T4可以在显示模组初始化过程中设置;或者,第一位置的光阀打开的第三时段T3和第二位置的光阀打开的第四时段T4也可以携带于第一控制信号中。需要说明的是,打开第一位置的光阀和打开第二位置的光阀间隔预设时长Δt,预设时长Δt可参见前述相关介绍,此处不再赘述。
具体的,光阀根据接收到的第二控制信号,在第三时段打开第一位置的光阀,在第三时段内,面光源发射的面光束中的第一光束经第一位置射出;以及在第四时段打开第二位置的光阀,在第四时段内,面光源发射的面光束中的第二光束经第二位置射出。可以理解的是,第一光束为面光束中的部分光束,第二光束也为面光束中的部分光束,第一光束和第二光束从光阀出射的位置不同。
通过光阀配合面光源可更精确的调整第一光束和第二光束,使得在眼跟踪状态下,第一光束和第二光束的切换更平滑,观察者在眼盒内移动观察到的图像闪烁更少、更加稳定;且通过控制光阀开启的宽度,能够精准匹配更大的观看深度范围。
二、光学整形组件
在一种可能的实现方式中,光学整形组件用于调整第一光束的指向得到第三光束,以及调整第二光束的指向得到第四光束。具体的,光学整形组件用于改变来自光源组件的第一光束的传播方向,以使得第一光束聚焦至某一位置,以及改变来自光源组件的第二光束的传播方向,以使得第二光束聚焦至另一位置。
如下示例性的示出了两种可能的光学整形组件的结构。
结构A,光学整形组件包括透镜。
在一种可能的实现方式中,透镜包括球面透镜、或非球面透镜或菲涅尔透镜(请参阅图9a)。菲涅尔透镜(fresnel lens)也可以称为螺纹透镜,菲涅尔透镜的表面的一面为光面,另一面刻录了由小到大的同心圆(或称为纹路或菲涅尔带),因此,通过菲涅尔透镜可以使得图像的边缘的像差较小。由于非球面透镜从中心到边缘的曲率连续发生变化,因此,通过非球面透镜可以使得不同方向的光束都会聚焦在同一个定点上,因此,可以减小显示模组的视场边缘的像差。
示例性的,透镜的材料可以是玻璃、树脂、或晶体等光学材料。当透镜的材料为树脂时,可以减轻显示模组的质量。当透镜的材料为玻璃时,有助于提高显示模组的成像质量以及抑制温漂。本申请对透镜的材料不作限定。
结构B,光学整形组件包括透镜阵列。
在一种可能的实现方式中,透镜阵列包括球面透镜阵列(请参阅图9b)、非球面透镜阵列(请参阅图9c)或菲涅尔透镜阵列(请参阅图9d)。关于透镜阵列中透镜的材料可参见前述相关介绍,此处不再赘述。其中,透镜阵列的节距p是指透镜阵列中单个透镜的有效直径或有效口径的大小。由于非球面透镜阵列,既可以减小显示模组的视场边缘的像差,而且可以在较大视场(field of view,FOV)的情况下,光源组件也可以设计为平面光源阵列,进而可以降低加工和组装复杂度。
进一步,可选的,透镜阵列可以为平面分布的透镜阵列。基于此,有助于减小显示模组的厚度。
若光源组件包括光源阵列,光学整形组件包括透镜阵列。在一种可能的实现方式中,透镜阵列中的一个透镜对应光源阵列中的至少两个光源。换言之,一个透镜对应的多个光源中的部分光源作为第一光源,另外部分光源作为第二光源。例如,一个观察者在观看,一个透镜下可对应两个光源,其中一个作为第一光源,另一个作为第二光源。为了满足多个观察者可以同时观看,一个透镜可对应至少四个光源。也可以理解为,对于透镜阵列中的每个透镜,其都有一个与一个观察者的左眼位置对应的光源以及和右眼位置对应的光源。
可以理解的是,对于光源阵列,某一时段开启的第一光源(或第二光源)的数量与第一光源(或第二光源)的横向宽度、第一光源阵列(或第二光源阵列)的密度、透镜阵列包括的透镜的数量有关,其中,第一光源(或第二光源)的横向是指平行于透镜的节距p的方向。每一次需要开启的第一光源(或第二光源)的横向总宽度(或称为横向发光宽度相当于透镜的物高)是一定的,开启的第一光源(或第二光源)数量与单个第一光源(或第二光源)的横向宽度和第一光源阵列(或第二光源阵列)的密度有关,横向宽度越小且密度越大,单次开启的第一光源(或第二光源)的数量越多。
三、光调制组件
在一种可能的实现方式中,光调制组件用于对第三光束进行调制,得到携带第一图像信息的第一图像光;以及对第四光束进行调制,得到携带第二图像信息的第二图像光。具体的,光调制组件可将第一图像信息加载(或称为调制)于第三光束,得到携带图像信息的第一图像光;将第二图像信息加载于第四光束得到携带图像信息的第二图像光束。其中,第三光束和第四光束可以称为光载波。可以理解的是,为了实现3D显示效果,第一图像信息和第二图像信息不同。此外,光调制组件可以高频切换第一图像信息和第二图像信息,从而可以是
使得到达观察者的左右眼的图像不同,进而实现3D显示。
示例性的,光调制组件例如可以是硅基液晶(liquid crystal on silicon,LCOS)显示屏、液晶显示器(liquid crystal display,LCD)、数字光处理(digital light procession,DLP)显示器、激光线扫描(laser beam scanning,LBS)显示器、有机发光二极管(organic light emitting diode,OLED)、微型发光二极管(micro light emitting diode,micro-LED)、有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode,AMOLED)、柔性发光二极管(flex light-emitting diode,FLED)、量子点发光二极管(quantum dot light emitting diodes,QLED)、基于字微镜器件(digital micro-mirror device,DMD)的反射式显示屏等。需要说明的是,上述给出的光调制组件仅是示例,本申请对此不作限定,其它可以对光学整形组件输出的第三光束和第四光束进行调制的组件也在本申请的保护范围。
基于上述内容,如下示例性的示出了两种可能的显示屏的结构。
如图10a所示,为本申请提供的一种显示屏的结构示意图。该显示屏可包括光源组件、光学整形组件和光调制组件。该示例中光源组件以面光源和光阀为例,打开光阀的位置可以出射面光源发射的面光束的部分光束(称为第一光束或第二光束),出射的第一光束或第二光束的发散角α。其中,光学整形组件以球面透镜阵列为例,光调制组件以LCD为例。关于光源组件、光学整形组件和光调制组件的详细介绍可参见前述内容,此处不再赘述。
请参阅图10b,为本申请提供的另一种显示屏的结构示意图。该显示屏可包括光源组件、光学整形组件和光调制组件。该示例中的光源组件以设置于基板上的平面分布的光源阵列为例,光学整形组件以平面分布的非球面透镜阵列为例,光调制组件以LCD为例。关于光源组件、光学整形组件和光调制组件的详细介绍可参见前述内容,此处不再赘述。
基于图10b的显示屏,平面分布的非球面透镜阵列和平面分布的光源阵列,可以实现小的横向宽度的密集的光源阵列和短焦透镜阵列,从而可以减小显示模组的厚度。例如,显示模组可以压缩至毫米级。通过非球面透镜阵列可以使得边缘视场的像差较小,从而可以在较大FOV情况下降低显示模组的加工和组装的复杂度。而且,光源化的光源阵列可以实现在眼盒中多视区的划分,使观察者在眼盒的不同位置都能进行3D观看。
请参阅图11,为本申请提供的一种显示屏的光路示意图。该示例中,光源阵列中的第一光源开启,开启的第一光源用于发射第一光束(用实线表示),第一光束经非球面透镜阵列中对应的非球面透镜调整指向得到第三光束,第三光束经LCD调制后得到携带第一图像信息的第一图像光,第一图像光用于在左眼成像。光源阵列中的第二光源开启,开启的第二光源用于发射第二光束(用虚线表示),第二光束经非球面透镜阵列中对应的非球面透镜调整指向得到第四光束,第四光束经LCD调制后得到携带第二图像信息的第二图像光,第二图像光用于在右眼成像。
四、反射组件
请参阅图12,反射组件用于将第一图像光反射至观察者的左眼成像,以及将第二图像光反射至观察者的右眼成像,从而可以使得观察者观察到3D图像。图12是以反射组件包括一个自由曲面反射镜为例示例的。
示例性的,反射组件包括至少一个反射元件,反射元件例如可以包括但不限于平面反射镜、球面反射镜、自由曲面镜或半透半反镜(semi-transparent and semi-reflective mirro)等。
其中,半透半反镜又可称为分光镜、分光片或半反半透镜,是一种在光学玻璃上镀制半反射膜,或者在透镜的一个光学面上镀制半透半反膜,以改变入射光束原来的透射和反射的比例的光学元件。通过镀制膜层可以增透加大光强;也可以增反减少光强。
基于上述内容,下面给出上述显示模组的一种具体实现方式。以便于进一步理解上述显示模组的结构及图像显示的实现过程。需要说明的是,上述给出各个组件中,如果没有特殊说明以及逻辑冲突,根据其内在的逻辑关系可以组合形成其它可能的显示模组。
如图13所示,为本申请提供的又一种显示模组的结构示意图。该显示模组包括显示屏和反射组件。其中,显示屏可包括光源组件、光学整形组件和光调制组件。该示例中的光源组件以设置于基板上的平面分布的光源阵列为例,光学整形组件以平面分布的非球面透镜阵列为例,光调制组件以LCD为例。关于光源组件、光学整形组件和光调制组件的详细介绍可参见前述内容,此处不再赘述。反射组件以上述图12所示的反射组件为例,具体可参见前述相关介绍,此处不再赘述。可以理解的是,L为形成的光斑(或光条)的长度,L需要满足可以覆盖左眼且不影响右眼,或者需要覆盖右眼且不影响左眼。
结合上述图13,为了保证光源阵列中单个光源也可以照亮对应的非球面透镜,非球面透镜阵列中的非球面透镜的节距p满足下述公式1。
其中,α为第一光束的发散角和第二光束的发散角中较大的发散角,t为光源阵列的发光面与非球面透镜阵列中靠近LCD的面之间的距离,h为第一光源或第二光源的横向发光宽度。横向宽度可以理解为一个非球面透镜对应的全部的第一光源的横向宽度之和或者对应的全部的第二光源的横向宽度之和。结合上述图13,一个非球面透镜对应两个第一光源和两个第二光源,h即为两个第一光源的横向宽度之和,或者h为两个第二光源的横向宽度之和。其中,t满足下述成像公式2,例如可以为10mm。可以理解的是,第一光束的发散角与第二光束的发散角是可以设置的,例如,可以设置第一光源的发散角和第二光源的发射角,或者设置打开第一位置的光阀的第一宽度和打开第二位置的光阀的第二宽度。此外,第一光束的发散角可以与第二光束的发散角相同,或者也可以不同,本申请对此不作限定。需要说明的是,光源阵列中第一光源的发散角即为第一光束的发散角,第二光源的发散角即为第二光束的发散角。
其中,f2为非球面透镜阵列的等效焦距,d为非球面透镜阵列与虚拟眼盒面之间的距离,d满足下述公式3。
d=|d3-d1| 公式3
d=|d3-d1| 公式3
结合图14,W为观察者的左眼和右眼之间的眼间距,通常约为65mm,d1为实际眼盒面与反射组件之间的距离,d3为虚拟眼盒面与反射组件之间的距离。d1和d3满足下述成像公式4。
其中,f1为反射组件的等效焦距。
需要说明的是,若反射组件为平面反射元件,实际眼盒面的大小与虚拟眼盒面的大小相同,实际眼盒面与反射组件之间的距离d1和虚拟眼盒面与反射组件之间的距离d3的大小相同,且实际眼盒面与虚拟眼盒面位于平面反射元件的两侧。以平面反射元件为中心,则d1=-d3。
进一步,为了保证经过相邻非球面透镜的第一光束或第二光束在实际眼盒面不发生串扰,非球面透镜阵列中的非球面透镜的节距p还满足下述公式5。
其中,Weye为虚拟眼盒面上的虚拟眼间距,虚拟眼盒面为实际眼盒面经反射组件反射形成的虚像。Weye满足下述公式6。
由于光源阵列中的光源的发散角都有一定的局限,当非球面透镜离光源较近时,光源发出的光能覆盖的范围很小。通过使用小节距的非球面透镜组成的非球面透镜阵列,并结合相对应的密集的光源阵列可以提高显示模组显示的图像的均匀性。
示例性的,上述显示模组例如可以包括但不限于NED设备、车载显示屏或HUD等。
基于上述描述的显示模组的结构和功能原理,本申请还可以提供一种光学显示***。请参阅图15,为本申请提供的一种光学显示***的结构示意图。该光学显示***可以包括上述任一实施例中的显示模组,此处不再重复赘述。进一步,该光学显示***还可包括控制模组,控制模组与显示模组连接。控制模组用于控制所述显示模组进行图像显示。
进一步,可选的,光学显示***还可包括眼跟踪模组,眼跟踪模组与控制模组连接。在一种可能的实现方式中,控制模组可接收来自眼跟踪模组的左眼位置信息和右眼位置信息。
下面对控制模组和眼跟踪模组分别进行介绍。
五、控制模组
在一种可能的实现方式中,若光源组件为光源阵列,控制模组可以接收来自眼跟踪模组的观察者的左眼位置信息和右眼位置信息,根据左眼位置信息确定光源组件需要开启的第一光源的位置信息,以及根据右眼位置信息确定光源组件需要开启的第二光源的位置信息;根据第一光源的位置信息和第二光源的位置信息生成第一控制信号。或者,若光源组件为面光源和光阀,控制模组可以根据左眼位置信息确定光阀的第一位置信息,以及根据右眼位置信息确定光阀的第二位置信息;并根据光阀的第一位置信息和光阀的第二位置信息生成第二控制信号。
示例性的,控制模组可以包括处理器,处理器可以是一种具有信号(或数据)的处理能力的电路,在一种实现中,处理器可以是具有指令读取与运行能力的电路,例如中央处理单元(central processing unit,CPU)、微处理器、图形处理器(graphics processing unit,GPU)(可以理解为一种微处理器)、或数字信号处理器(digital singnal processor,DSP)等;在另一种实现中,处理器可以通过硬件电路的逻辑关系实现一定功能,该硬件电路的逻辑关系是固定的或可以重构的,例如处理器为专用集成电路(application-specific integrated circuit,ASIC)或可编程逻辑器件(programmable logic device,PLD)实现的硬件电路,例如现场可编程门阵列(field programmable gate array,FPGA)。在可重构的硬件电路中,处理器加载配置文档,
实现硬件电路配置的过程,可以理解为处理器加载指令,以实现以上部分或全部单元的功能的过程。此外,处理器还可以是针对人工智能设计的硬件电路,其可以理解为一种ASIC,例如神经网络处理单元(neural network processing pnit,NPU)张量处理单元(tensor processing unit,TPU)、深度学习处理单元(deep learning processing unit,DPU)等。例如还可以是应用处理器(application processor,AP)、图像信号处理器(image signal processor,ISP)、或者其它可编程逻辑器件、晶体管逻辑器件,硬件部件或者其任意组合等。
六、眼跟踪模组
在一种可能的实现方式中,眼跟踪是指通过测量眼睛的注视点的位置或者眼球相对头部的运动而实现对眼球运动的跟踪。眼跟踪模组是一种能够跟踪测量眼球位置及眼球运动信息的一种设备。
眼跟踪模组实时跟踪并输出观察者人眼的位置,并传输给控制模组,以使得控制模组控制开启对应人眼位置的第一光源或第二光源,并高速切换左眼对应第一光源的开关和右眼对应的第二光源的开关。眼跟踪模块持续监测人眼位置,当人眼位置移动时,眼跟踪模块获取新的位置信息,将位置信息传输给控制模组。
具体的,当显示的图像发生移动时,用户的双目视线需实时跟踪虚像的移动,眼跟踪模组具体可确定双目注视图像的辐辏深度(即双目视点)。如图16所示,示例性地示出了辐辏调节冲突的原理。辐辏调节冲突是由于人眼在观察三维(three dimensional,3D)内容时,双目的正确的晶状体聚焦深度始终固定在屏幕上,而双目辐辏则会聚在由视差定义的目标距离上,可能位于屏幕前方,也可能位于屏幕后方,由于聚焦深度与辐辏深度的不匹配造成辐辏调节冲突。
示例性的,眼跟踪模组例如可以包括但不限于摄像头、红外线发射器或红外线探测器等。进一步,可选的,眼跟踪模组还包括处理器。
基于上述内容,图17是本申请提供的一种光学显示***的电路示意图。该光学显示***中的电路主要包括处理器1701,外部存储器接口1702,内部存储器1703,音频模块1704,视频模块1705,电源模块1706,无线通信模块1707,输入/输出(input/output,I/O)接口1708、视频接口1709、显示电路1710、调制器1711和光源1712等。其中,处理器1701与其周边的元件,例如外部存储器接口1702,内部存储器1703,音频模块1704,视频模块1705,电源模块1706,无线通信模块1707,I/O接口1708、视频接口1709、显示电路1710可以通过总线连接。
需要说明的是,本申请示意的电路图并不构成对光学显示***的具体限定。在本申请另一些实施例中,光学显示***可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
其中,处理器1701包括一个或多个处理单元,处理单元可以是一种具有信号(或数据)的处理能力的电路,具体可参见前述相关介绍,此处不再重复赘述。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
处理器1701中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器1701中的存储器为高速缓冲存储器。该存储器可以保存处理器1701刚用过或循环使用的指令或数
据。如果处理器1701需要再次使用该指令或数据,可从存储器中直接调用。避免了重复存取,减少了处理器1701的等待时间,因而提高了光学显示***的效率。其中,处理器1701可以执行存储的指令,执行上述成像方法。
在一些实施例中,光学显示***还可以包括多个连接到处理器1701的输入输出(input/output,I/O)接口1708。I/O接口1708可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。上述I/O接口1708可以连接鼠标、触摸板、键盘、摄像头、扬声器/喇叭、麦克风等设备,也可以连接光学显示***上的物理按键(例如音量键、亮度调节键、开关机键等)。
外部存储器接口1702可以用于连接外部存储卡,例如Micro SD卡,实现扩展光学显示***的存储能力。外部存储卡通过外部存储器接口1702与处理器1701通信,实现数据存储功能。
内部存储器1703可以用于存储计算机可执行程序代码,可执行程序代码包括指令。内部存储器1703可以包括存储程序区和存储数据区。其中,存储程序区可存储操作***,至少一个功能所需的应用程序等。存储数据区可存储光学显示***使用过程中所创建的数据等。此外,内部存储器1703可以包括随机存取存储器(random access memory,RAM)、闪存、通用闪存存储器(universal flash storage,UFS)、只读存储器(read-only memory,ROM)、可编程只读存储器(programmable ROM,PROM)、可擦除可编程只读存储器(erasable PROM,EPROM)、电可擦除可编程只读存储器(electrically EPROM,EEPROM)、寄存器、硬盘、移动硬盘、CD-ROM或者本领域熟知的任何其它形式的存储介质中。处理器1701通过运行存储在内部存储器1703的指令,和/或存储在设置于处理器1701中的存储器的指令,执行光学显示***的各种功能应用以及数据处理。一种示例性的存储介质耦合至处理器,从而使处理器能够从该存储介质读取信息,且可向该存储介质写入信息。另一种示例中,存储介质也可以是处理器的组成部分。处理器和存储介质可以位于ASIC中。另外,该ASIC可以位于光学显示***中。当然,处理器和存储介质也可以作为分立组件存在于光学显示***中。
光学显示***可以通过音频模块1704以及应用处理器等实现音频功能。例如音乐播放,通话等。
音频模块1704用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块1704还可以用于对音频信号编码和解码,例如进行放音或录音。在一些实施例中,音频模块1704可以设置于处理器1701中,或将音频模块1704的部分功能模块设置于处理器1701中。
视频接口1709可以接收外部输入的音视频信号,其具体可以为高清晰多媒体接口(high definition multimedia interface,HDMI),数字视频接口(digital visual interface,DVI),视频图形阵列(video graphics array,VGA),显示端口(display port,DP)等,视频接口1709还可以向外输出视频。当光学显示***作为抬头显示使用时,视频接口1709可以接收周边设备输入的速度信号、电量信号,还可以接收外部输入的AR视频信号。当光学显示***作为投
影仪使用时,视频接口1709可以接收外部电脑或终端设备输入的视频信号。
视频模块1705可以对视频接口1709输入的视频进行解码,例如进行H.264解码。视频模块还可以对光学显示***采集到的视频进行编码,例如对外接的摄像头采集到的视频进行H.264编码。此外,处理器1701也可以对视频接口1709输入的视频进行解码,然后将解码后的图像信号输出到显示电路1710。
电源模块1706用于根据输入的电力(例如直流电)为处理器1701和光源1712提供电源,电源模块1706中可以包括可充电电池,可充电电池可以为处理器1701和光源1712提供电源。光源1712发出的光可以传输到调制器1711进行成像,从而形成图像光信号。
无线通信模块1707可以使得光学显示***与外界进行无线通信,其可以提供无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星***(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near Field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块1707可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块1707经由天线接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器1701。无线通信模块1707还可以从处理器1701接收待发送的信号,对其进行调频,放大,经天线转为电磁波辐射出去。
另外,视频模块1705进行解码的视频数据除了通过视频接口1709输入之外,还可以通过无线通信模块1707以无线的方式接收或从外部存储器中读取,例如光学显示***可以通过车内的无线局域网从终端设备或车载娱乐***接收视频数据,光学显示***还可以读取外部存储器中存储的音视频数据。
显示电路1710和调制器1711用于显示对应的图像。在本实施例中,视频接口1709接收外部输入的视频源信号,视频模块1705进行解码和/或数字化处理后输出一路或多路图像信号至显示电路1710,显示电路1710根据输入的图像信号驱动调制器1711将入射的偏振光进行成像,进而输出至少两路图像光。此外,处理器1701也可以向显示电路1710输出一路或多路图像信号。
示例性地,光学显示***可以包括但不限于HUD、投影机、显示器、车载显示屏、AR设备、VR设备、或智能车灯等,其中,AR设备可以包括但不限于AR眼镜或AR头盔等,VR设备可以包括但不限于VR眼镜或VR头盔等。
基于上述描述的光学显示***的结构和功能原理,本申请还可以提供一种终端设备。基于上述描述的光学显示装置的结构和功能原理,本申请还可以提供一种终端设备。该终端设备可包括上述任一实施例中的显示模组。示例性地,该终端设备例如可以是车辆(例如无人车、智能车、电动车、或数字汽车等)、机器人、测绘设备、无人机、智能家居设备(例如电视、扫地机器人、智能台灯、音响***、智能照明***、电器控制***、家庭背景音乐、家庭影院***、对讲***、或视频监控等)、智能制造设备(例如工业设备)、智能运输设备(例如AGV、无人运输车、或货车等)、或智能终端(手机、计算机、平板电脑、掌上电脑、台式机、耳机、音响、穿戴设备、车载设备、虚拟现实设备、增强现实设备等)等。
以终端设备为车辆为例,请参阅图18,为本申请提供的一种车辆的示例性功能框图。耦合到终端设备1800或包括在终端设备1800中的组件可以包括推进***1801、传感***1802、
控制***1803、计算机***1804、用户接口1805以及光学显示***1806。终端设备1800的组件可以被配置为以与彼此互连和/或与耦合到各***的其它组件互连的方式工作。例如,计算机***1804可以被配置为从推进***1801、传感***1802和控制***1803等接收数据并对它们进行控制。计算机***1804还可以被配置为在用户接口1805上生成图像的显示并从用户接口1805接收输入。
推进***1801可以为终端设备1800提供动力运动。推进***1801可以包括引擎/发动机、能量源、传动装置(transmission)和车轮/轮胎。另外,推进***1801可以额外地或可替换地包括除了图18所示出的组件以外的其他组件。本申请对此不做具体限定。
传感***1802可以包括用于感测关于终端设备1800所位于的环境的信息等的若干个传感器。示例性的,传感***1802的传感器可以包括但不限于全球定位***(global positioning system,GPS)、惯性测量单元(inertial measurement unit,IMU)、毫米波雷达、激光雷达、相机以及用于修改传感器的位置和/或朝向的制动器。毫米波雷达可利用无线电信号来感测终端设备1800的周边环境内的目标。在一些实施例中,除了感测目标以外,毫米波雷达还可用于感测目标的速度和/或前进方向。激光雷达可利用激光来感测终端设备1800所位于的环境中的目标。在一些实施例中,激光雷达可包括一个或多个激光源以及一个或多个探测器,以及其他***组件。相机可用于捕捉终端设备1800的周边环境的多个图像。相机可以是静态相机或视频相机。在一些实施例中,GPS可以为用于估计终端设备1800的地理位置的任何传感器。为此,GPS可以包括收发器,基于卫星定位数据估计终端设备1800相对于地球的位置。在一些可能的示例中,计算机***1804可以用于结合地图数据使用GPS来估计终端设备1800行驶的道路。IMU可以用于基于惯性加速度及其任意组合来感测终端设备1800的位置和朝向变化。在一些示例中,IMU中传感器的组合可包括例如加速度计和陀螺仪。另外,IMU中传感器的其它组合也是可能的。
可以理解的是,传感***1802还可包括被监视终端设备1800的内部***的传感器(例如,车内空气质量监测器、燃油量表、机油温度表等)。来自这些传感器中的一个或多个的传感器数据可用于检测对象及其相应特性(位置、形状、方向、速度等)。这种检测和识别是终端设备1800的安全操作的关键功能。传感***1802还可以包括其它传感器。本申请对此不做具体限定。
控制***1803为控制终端设备1800及其组件的操作。控制***1803可包括各种元件,其中包括转向单元、油门、制动单元、传感器融合算法、计算机视觉***、路线控制***以及障碍物避免***。转向***可操作来调整终端设备1800的前进方向。例如在一个实施例中可以为方向盘***。油门用于控制引擎的操作速度并进而控制终端设备1800的速度。控制***1803可以额外地或可替换地包括除了图18所示出的组件以外的其他组件。本申请对此不做具体限定。制动单元用于控制终端设备1800减速。制动单元可使用摩擦力来减慢车轮。在其他实施例中,制动单元可将车轮的动能转换为电流。制动单元也可采取其他形式来减慢车轮转速从而控制终端设备1800的速度。计算机视觉***可以操作来处理和分析由相机捕捉的图像以便识别终端设备1800周边环境中的目标和/或特征。目标和/或特征可包括交通信号、道路边界和障碍物。计算机视觉***可使用目标识别算法、运动中恢复结构(structure from motion,SFM)算法、视频跟踪和其他计算机视觉技术。在一些实施例中,计算机视觉***可以用于为环境绘制地图、跟踪目标、估计目标的速度等等。路线控制***用于确定终端设备
1800的行驶路线。在一些实施例中,路线控制***可结合来自传感***1802、GPS和一个或多个预定地图的数据以为终端设备1800确定行驶路线。障碍物避免***用于识别、评估和避免或者以其他方式越过终端设备1800的环境中的潜在障碍物。当然,在一个实例中,控制***1803可以增加或替换地包括除了所示出和描述的那些以外的组件。或者也可以减少一部分上述示出的组件。
终端设备1800的部分或所有功能受计算机***1804控制。计算机***1804可包括至少一个处理器18041,进一步,该计算机***1804还可包括接口电路18042。处理器18041执行存储在例如存储器18043这样的非暂态计算机可读介质中的指令。计算机***1804还可以是采用分布式方式控制终端设备1800的个体组件或子***的多个计算设备。
处理器18041可以是一种具有信号(或数据)的处理能力的电路,具体可参见前述相关介绍,此处不再赘述。
尽管图18功能性地图示了处理器、存储器、和在相同块中的计算机***1804的其它元件,但是本领域的普通技术人员应该理解该处理器和存储器实际上可以不存储在相同的物理外壳内的多个处理器或存储器。例如,存储器可以是硬盘驱动器或位于不同于计算机***1804的外壳内的其它存储介质。不同于使用单一的处理器来执行此处所描述的步骤,诸如转向组件和减速组件的一些组件每个都可以具有其自己的处理器,处理器只执行与特定于组件的功能相关的计算。再比如,处理器也可以远离该车辆但可以与该车辆进行无线通信。
在一些实施例中,存储器18043可包含指令(例如,程序逻辑),指令可被处理器18041读取来执行终端设备1800的各种功能,包括以上描述的功能。存储器18043也可包含额外的指令,包括向推进***1801、传感***1802和控制***1803中的一个或多个发送数据、从其接收数据、与其交互和/或对其进行控制的指令。除了指令以外,存储器18043还可存储数据,例如道路地图,路线信息,传感器检测到的数据,车辆的位置、方向、速度以及其它这样的车辆数据,以及其他信息。这种信息可在终端设备1800在自主、半自主和/或手动模式中被终端设备1800和计算机***1804使用。
存储器可参见上述图19中的内部存储器1903的介绍,此处不再赘述。
用户接口1805,用于向终端设备1800的用户提供信息或从其接收信息。可选地,用户接口1805可包括在***设备的集合内的一个或多个输入/输出设备,***设备可以包括例如无线通信***、触摸屏、麦克风和/或扬声器等。
计算机***1804可基于从各种子***(例如,推进***1801、传感***1802和控制***1803)以及从用户接口1805接收的输入来控制终端设备1800的功能。例如,计算机***1804可利用来自控制***1803的输入以便控制转向单元来避免由传感***1802和障碍物避免***检测到的障碍物。在一些实施例中,计算机***1804可操作来对终端设备1800及其子***的许多方面提供控制。
光学显示***1806可参见前述任一实施例的介绍,此处不再赘述。需要说明的是,光学显示***中的部分元件的功能也可以由车辆的其它子***来实现,例如,控制器也可以为控制***中的元件。
可选地,上述这些组件中的一个或多个可与终端设备1800分开安装或关联。例如,存储器18043可以部分或完全地与终端设备1800分开存在。上述组件可以按有线和/或无线方式来通信地耦合在一起。
需要说明的是,图18给出的终端设备功能框架只是一个示例,在其它示例中,终端设备1800可以包括更多、更少或不同的***,并且每个***可以包括更多、更少或不同的组件。此外,示出的***和组件可以按任意种的方式进行组合或划分,本申请对此不做具体限定。
基于上述内容和相同的构思,本申请提供一种成像方法,请参阅图19的介绍。该成像方法可应用于上述任一实施例所示的显示模组或光学显示***或终端设备。也可以理解为,可以基于上述任一实施例所示的显示模组或光学显示***或终端设备来实现成像方法。为了便于方案的说明,如下以光源组件为光源阵列为例介绍。该方法包括以下步骤:
步骤1901,眼跟踪模组检测观察者的左眼位置和右眼位置。
其中,眼跟踪模组检测观察者的左眼位置和右眼位置的过程和原理可参见前述相关介绍,此处不再赘述。
步骤1902,眼跟踪模组向控制模组发送左眼位置信息和右眼位置信息。相应的,控制模组接收来自眼跟踪模组的左眼位置信息和右眼位置信息。
其中,眼跟踪模组与控制模组连接。
步骤1903,控制模组根据左眼位置信息及第一对应关系确定第一光源的位置信息,以及根据右眼位置信息及第二对应关系确定第二光源的位置信息。
其中,第一对应关系包括左眼位置与第一光源的位置信息的关系,第二对应关系包括右眼位置与第二光源的位置信息的对应关系。需要说明的是,第一对应关系和第二对应关系可以是表的形式,或者也可以是其它可能的形式,本申请对此不做限定。
表1和表2示例性的示出了第一对应关系和第二对应关系。表1和表2中的第一光源的位置信息和第二光源的位置信息均以第一光源和第二光源在光源阵列中的行和列表示。
表1第一对应关系
表2第二对应关系
可以理解的是,控制模组还可以获取到第一光源开启的第一时段T1、第二光源开启的第二时段T2、第一光源的切换频率v1、以及第二光源的切换频率v2等。其中,第一光源开启的第一时段T1和第一光源的切换频率v1可以携带于第一控制信号,并发送给光源阵列。第二光源开启的第二时段T2和第二光源的切换频率v2可以携带于第二控制信号,并发送给光源阵列。应理解,第一对应关系和第二对应关系也可以是在同一张表中,本申请对此不作限
定。
步骤1904,控制模组根据第一光源的位置信息和第二光源的位置信息生成第一控制信号。
在一种可能的实现方式中,第一控制信号包括第一光源的位置信息及第二光源的位置信息。
步骤1905,控制模组根据第一光源的位置信息和第二光源的位置信息生成第三控制信号。
其中,第三控制信号用于控制光调制组件切换第一图像信息和第二图像信息的频率。
需要说明的是,上述步骤1904与步骤1905之间没有先后顺序,可以先执行步骤1904后执行步骤1905,或者也可以是先执行步骤1905后执行步骤1904,或者也可以是步骤1904和步骤1905同步执行,即第一控制信号和第三控制信号同步生成,本申请对此不作限定。
步骤1906,控制模组向光源组件发送第一控制信号,并向光调制组件发送第三控制信号。相应的,光源组件接收来自控制模块的第一控制信号,光调制组件接收来自控制模组的第三控制信号。
步骤1907,光源组件根据接收到的第一控制信号,在第一时段开启光源阵列中的第一光源,在第二时段开启光源阵列中的第二光源。
其中,开启的第一光源用于发射第一光束,开启的第二光源用于发射第二光束。关于第一光束和第二光束的详细介绍可参见前述相关描述,此处不再赘述。
步骤1908,光调制组件根据第三控制信号,对第三光束进行调制得到携带第一图像信息的第一图像光,以及对第四光束进行调制得到携带第二图像信息的第二图像光。
其中,第三控制信号包括第一图像信息和第二图像信息的切换频率。该切换频率可以根据最低要求(即人眼不可分辨出闪烁频率)和用户需求改变。进一步,可选的,第一图像信息和第二图像信息的切换频率等于第一光源的切换频率和第二光源的切换频率之和。结合上述图4,ν3=ν1+ν2,ν3表示光调制组件的切换频率,ν1表示第一光源的切换频率,ν2表示第二光源的切换频率。通常ν1=ν2,ν3=2ν1=2ν2。例如,第一光源的切换频率ν1=1/60秒,第二光源的切换频率ν2=1/60秒。可以理解的是,光学显示***开始运作后,第一图像信息和第二图像信息的切换频率通常是固定的。
进一步,结合上述图4,光调制组件切换时间与第一光源开启时间的间隔为ΔT,其中,ΔT也可以是在显示模组初始化过程中预先设置的。应理解,ΔT可以等于0,也可以不等于0,本申请对此不作限定。
通过上述步骤1901至步骤1908,可以控制显示模组进行图像显示。若第一图像信息与第二图像信息相同,显示模组可以实现二维图像显示。若第一图像信息与第二图像信息不同,显示模组可以实现三维图像显示。
需要说明的是,眼跟踪模组持续监测人眼位置,眼跟踪模组持续执行上述步骤1901。当人眼位置移动时,眼跟踪模组检测到左眼和右眼的新的位置,重复执行上述步骤1902~步骤1908。当人眼位置不变动时,步骤1902中的第一控制信号不变,持续发送第一控制信号以点亮相应的第一光源或第二光源。
请参阅图20a,为本申请提供的一种观察者的左眼和右眼在位置1的光路图。当眼跟踪模组检测到观察者的左眼和右眼在位置2时,基于显示模组的光路可参见图20b。
需要说明的是,若光源组件为面光源和光阀,上述步骤1903的具体过程为:控制模组根据左眼位置信息及第三对应关系确定光阀的第一位置信息,以及根据右眼位置信息及第四对
应关系确定光阀的第二位置信息。
表3和表4示例性的示出了第三对应关系和第四对应关系。表3和表4中以光阀的第一位置信息包括光阀的第一宽度和第一中心坐标为例,以光阀的第二位置信息包括光阀的第二宽度和第二中心坐标为例。
表3第一对应关系
表4第二对应关系
需要说明的是,上述表3中的第一宽度11、第一宽度12…第一宽度1n可以相同也可以不同,第二宽度21、第二宽度22…第二宽度2n可以相同也可以不同,第一宽度与第二宽度可以相同也可以不同,本申请对此不作限定。此外,上述是以第三对应关系和第四对应关系在不同的表中示例的。应理解,第三对应关系和第四对应关系也可以是在同一张表中,本申请对此不作限定。
基于此,上述步骤1904具体可以为,控制模组根据光阀的第一位置信息和光阀的第二位置信息生成第二控制信号。
可以理解的是,为了实现上述实施例中功能,控制装置包括了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到,结合本申请中所公开的实施例描述的各示例的模块及方法步骤,本申请能够以硬件或硬件和计算机软件相结合的形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用场景和设计约束条件。
基于上述内容和相同构思,图21和图22为本申请的提供的可能的控制装置的结构示意图。这些控制装置可以用于实现上述方法实施例中控制装置的功能,因此也能实现上述方法实施例所具备的有益效果。
如图21所示,该控制装置2100包括处理模块2101和收发模块2102。控制装置2100用于实现上述图19中所示的方法实施例中控制装置的功能。
当控制装置2100用于实现图19所示的方法实施例的控制装置的功能时:处理模块2101与收发模块2102协调用于控制光源组件分时发射第一光束及第二光束,第一光束和第二光束的出射位置不同,第一光束经光学整形组件调整为第三光束,第二光束经光学整形组件调整为第四光束;并控制光调制组件对第三光束调制得到携带第一图像信息的第一图像光,对第四光束经光调制得到携带第二图像信息的第二图像光;第一图像光经反射组件反射至观察者
的左眼成像,第二图像光经反射组件反射至观察者的右眼成像。
有关上述处理模块2101和收发模块2102更详细的描述可以参考图19所示的方法实施例中相关描述直接得到,此处不再一一赘述。
应理解,本申请实施例中的处理模块2101可以由处理器或处理器相关电路组件实现,收发模块2102可以由收发器或收发器相关电路组件实现。
基于上述内容和相同构思,如图22所示,本申请还提供一种控制装置2200。该控制装置2200可包括处理器2201和接口电路2202。处理器2201和接口电路2202之间相互耦合。可以理解的是,接口电路2202可以为收发器或输入输出接口。可选地,控制装置2200还可包括存储器2203,用于存储处理器2201执行的指令或存储处理器2201运行指令所需要的输入数据或存储处理器2201运行指令后产生的数据。
当控制装置2200用于实现图19所示的方法时,处理器2201用于执行上述处理模块2101的功能,接口电路2202用于执行上述收发模块2102的功能。
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。计算机程序产品包括一个或多个计算机程序或指令。在计算机上加载和执行计算机程序或指令时,全部或部分地执行本申请实施例的流程或功能。计算机可以是通用计算机、专用计算机、计算机网络、控制装置、用户设备或者其它可编程装置。计算机程序或指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,计算机程序或指令可以从一个网站站点、计算机、服务器或数据中心通过有线或无线方式向另一个网站站点、计算机、服务器或数据中心进行传输。计算机可读存储介质可以是计算机能够存取的任何可用介质或者是集成一个或多个可用介质的服务器、数据中心等数据存储设备。可用介质可以是磁性介质,例如,软盘、硬盘、磁带;也可以是光介质,例如,数字视频光盘(digital video disc,DVD);还可以是半导体介质,例如,固态硬盘(solid state drive,SSD)。
在本申请的各个实施例中,如果没有特殊说明以及逻辑冲突,不同的实施例之间的术语和/或描述具有一致性、且可以相互引用,不同的实施例中的技术特征根据其内在的逻辑关系可以组合形成新的实施例。
本申请中,“均匀”不是指绝对的均匀,可以允许有一定工程上的误差。“垂直”不是指绝对的垂直,可以允许有一定工程上的误差。“至少一个”是指一个或者多个,“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B的情况,其中A,B可以是单数或者复数。“以下至少一项(个)”或其类似表达,是指这些项中的任意组合,包括单项(个)或复数项(个)的任意组合。例如,a,b或c中的至少一项(个),可以表示:a,b,c,“a和b”,“a和c”,“b和c”,或“a和b和c”,其中a,b,c可以是单个,也可以是多个。在本申请的文字描述中,字符“/”,一般表示前后关联对象是一种“或”的关系。在本申请的公式中,字符“/”,表示前后关联对象是一种“相除”的关系。另外,在本申请中,“示例性的”一词用于表示作例子、例证或说明。本申请中被描述为“示例”的任何实施例或设计方案不应被解释为比其它实施例或设计方案更优选或更具优势。或者可理解为,使用示例的一词旨在以具体方式呈现概念,并不对本申请构成限定。
可以理解的是,在本申请中涉及的各种数字编号仅为描述方便进行的区分,并不用来限
制本申请的实施例的范围。上述各过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定。术语“第一”、“第二”等类似表述,是用于分区别类似的对象,而不必用于描述特定的顺序或先后次序。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元。方法、***、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
以上,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以权利要求的保护范围为准。
Claims (25)
- 一种显示模组,其特征在于,包括光源组件、光学整形组件、光调制组件和反射组件,所述光学整形组件位于所述光源组件与所述光调制组件之间;所述光源组件,用于分时发射第一光束和第二光束,所述第一光束和所述第二光束的出射位置不同;所述光学整形组件,用于调整所述第一光束的指向得到第三光束,以及调整所述第二光束的指向得到第四光束;所述光调制组件,用于对所述第三光束进行调制得到携带第一图像信息的第一图像光、以及对所述第四光束进行调制得到携带第二图像信息的第二图像光;所述反射组件,用于将所述第一图像光反射至观察者的左眼,以及将所述第二图像光反射至所述观察者的右眼。
- 如权利要求1所述的模组,其特征在于,所述光学整形组件包括透镜阵列,所述透镜阵列中的透镜呈平面分布。
- 如权利要求2所述的模组,其特征在于,所述透镜阵列包括非球面透镜阵列或菲涅尔透镜阵列。
- 如权利要求2或3所述的模组,其特征在于,所述透镜阵列中的透镜的节距p满足下述公式:
其中,所述α为所述第一光束的发散角和所述第二光束的发散角中较大的发散角,所述t为所述光源组件的发光面与所述光学整形组件中靠近所述光调制组件的面之间的距离,所述h为所述第一光源或所述第二光源的横向发光宽度。 - 如权利要求2~4任一项所述的模组,其特征在于,所述透镜阵列中的透镜的节距p满足下述公式:
其中,Weye为虚拟眼盒面上的虚拟眼间距,所述d为所述光学整形组件与虚拟眼盒面之间的距离,所述虚拟眼盒面为实际眼盒面经所述反射组件反射形成的虚像,所述t为所述光源组件的发光面与所述光学整形组件靠近所述光调制组件的面之间的距离。 - 如权利要求1所述的模组,其特征在于,所述光学整形组件包括非球面透镜。
- 如权利要求1~6任一项所述的模组,其特征在于,所述光源组件包括光源阵列,所述光源阵列中的光源呈平面分布,所述光源阵列包括第一光源和第二光源;所述光源组件,用于根据接收到的第一控制信号,在第一时段所述第一光源发射所述第一光束、及在第二时段所述第二光源发射所述第二光束。
- 如权利要求7所述的模组,其特征在于,所述第一控制信号包括所述第一光源的位置信息、及所述第二光源的位置信息。
- 如权利要求1~6任一项所述的模组,其特征在于,所述光源组件包括面光源和光阀;所述面光源,用于发射面光束;所述光阀,用于根据接收到的第二控制信号,在第三时段打开第一位置的光阀,所述 面光束中的第一光束经所述第一位置射出,以及在第四时段打开第二位置的光阀,所述面光束中的第二光束经所述第二位置射出。
- 如权利要求9所述的模组,其特征在于,所述第二控制信号包括所述光阀的第一位置信息、及所述光阀的第二位置信息。
- 如权利要求9或10所述的模组,其特征在于,所述面光源为平面型面光源和/或光阀为平面型光阀。
- 如权利要求1~11任一项所述的模组,其特征在于,所述反射组件包括至少一个反射元件,所述反射元件包括以下任一项:平面反射镜、球面反射镜、自由曲面镜、或半透半反镜。
- 一种光学显示***,其特征在于,包括控制模组、及如权利要求1~6和12中任一项所述的显示模组;所述控制模组,用于控制所述显示模组进行图像显示。
- 如权利要求13所述的***,其特征在于,所述光源组件包括光源阵列,所述光源阵列中的光源呈平面分布,所述光源阵列包括第一光源和第二光源;所述控制模组,用于:获取所述观察者的左眼位置信息和右眼位置信息;根据所述左眼位置信息确定所述第一光源的位置信息,以及根据所述右眼位置信息确定所述第二光源的位置信息;根据所述第一光源的位置信息和所述第二光源的位置信息生成第一控制信号;向所述光源组件发送所述第一控制信号;所述光源组件,用于根据接收到的所述第一控制信号,在第一时段所述第一光源发射所述第一光束、及在第二时段所述第二光源发射所述第二光束。
- 如权利要求14所述的***,其特征在于,所述第一控制信号包括所述第一光源的位置信息、及所述第二光源的位置信息。
- 如权利要求13所述的***,其特征在于,所述光源组件包括面光源和光阀;所述控制模组,用于:获取所述观察者的左眼位置信息和右眼位置信息;根据所述左眼位置信息确定所述光阀的第一位置信息,以及根据所述右眼位置信息确定所述光阀的第二位置信息;根据所述光阀的第一位置信息和所述光阀的第二位置信息生成第二控制信号;向所述光源组件发送所述第二控制信号;所述面光源,用于发射面光束;所述光阀,用于根据接收到的所述第二控制信号,在第三时段打开第一位置的光阀,所述面光束中的第一光束经所述第一位置射出,以及在第四时段打开第二位置的光阀,所述面光束中的第二光束经所述第二位置射出。
- 如权利要求16所述的***,其特征在于,所述第二控制信号包括所述光阀的第一位置信息、及所述光阀的第二位置信息。
- 如权利要求16或17所述的***,其特征在于,所述面光源为平面型面光源和/或光阀为平面型光阀。
- 如权利要求14~18任一项所述的***,其特征在于,所述光学显示***还包括所述眼跟踪模组,所述眼跟踪模组与所述控制模组连接;所述控制模组,用于:接收来自眼跟踪模组的所述左眼位置信息和所述右眼位置信息。
- 一种终端设备,其特征在于,包括如权利要求13~19任一项所述的光学显示***,所述光学显示***安装于所述终端设备上。
- 一种成像方法,其特征在于,应用于显示模组,所述显示模组包括光源组件、光学整形组件、光调制组件和反射组件,所述光学整形组件位于所述光源组件与所述光调制组件之间,所述方法包括:控制所述光源组件分时发射第一光束和第二光束,所述第一光束和所述第二光束的出射位置不同,所述第一光束经所述光学整形组件调整为第三光束,所述第二光束经所述光学整形组件调整为第四光束;控制所述光调制组件对所述第三光束调制得到携带第一图像信息的第一图像光、以及对所述第四光束调制得到携带第二图像信息的第二图像光;所述第一图像光经所述反射组件反射至观察者的左眼成像,所述第二图像光经所述反射组件反射至所述观察者的右眼成像。
- 如权利要求21所述的方法,其特征在于,所述控制所述光源组件分时发射第一光束和第二光束,包括:获取所述观察者的左眼位置信息和右眼位置信息;根据所述左眼位置信息和所述右眼位置信息,生成控制信号,所述控制信号用于控制所述光源组件分时发射所述第一光束及所述第二光束;向所述光源组件发送所述控制信号。
- 如权利要求22所述的方法,其特征在于,所述获取观察者的左眼位置信息和右眼位置信息,包括:接收来自眼跟踪模组的所述左眼位置信息和所述右眼位置信息。
- 如权利要求22或23所述的方法,其特征在于,所述控制信号包括第一控制信号,所述光源组件包括光源阵列,所述光源阵列中的光源呈平面分布,所述光源阵列包括第一光源和第二光源;所述根据所述左眼位置信息和所述右眼位置信息生成控制信号,包括:根据所述左眼位置信息确定所述第一光源的位置信息,以及根据所述右眼位置信息确定所述第二光源的位置信息;根据所述第一光源的位置信息和所述第二光源的位置信息生成所述第一控制信号,所述第一控制信号用于控制所述光源组件在第一时段所述第一光源发射所述第一光束、及在第二时段所述第二光源发射所述第二光束。
- 如权利要求22或23所述的方法,其特征在于,所述控制信号包括第二控制信号,所述光源组件包括面光源和光阀;所述根据所述左眼位置信息和所述右眼位置信息生成控制信号,包括:根据所述左眼位置信息确定所述光阀的第一位置信息,以及根据所述右眼位置信息确定所述光阀的第二位置信息;根据所述光阀的第一位置信息和所述光阀的第二位置信息生成所述第二控制信号,所述第二控制信号用于控制所述光阀在第三时段打开第一位置的光阀、所述面光源发射的面光束中的第一光束经所述第一位置射出,以及在第四时段打开第二位置的光阀、所述面光源发射的面光束中的第二光束经所述第二位置射出。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211033849.XA CN117664924A (zh) | 2022-08-26 | 2022-08-26 | 一种显示模组、光学显示***、终端设备及成像方法 |
CN202211033849.X | 2022-08-26 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2024041034A1 true WO2024041034A1 (zh) | 2024-02-29 |
Family
ID=90012355
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2023/093125 WO2024041034A1 (zh) | 2022-08-26 | 2023-05-10 | 一种显示模组、光学显示***、终端设备及成像方法 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN117664924A (zh) |
WO (1) | WO2024041034A1 (zh) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050018288A1 (en) * | 2001-12-14 | 2005-01-27 | Peter-Andre Redert | Stereoscopic display apparatus and system |
CN104950459A (zh) * | 2015-05-27 | 2015-09-30 | 广东顺德中山大学卡内基梅隆大学国际联合研究院 | 一种视角增强型指向性背光裸眼立体显示装置 |
CN110187506A (zh) * | 2019-05-28 | 2019-08-30 | 京东方科技集团股份有限公司 | 光学显示***和增强现实设备 |
US20210392305A1 (en) * | 2020-06-16 | 2021-12-16 | Lightspace Technologies, SIA | Display Systems, Projection Units and Methods for Presenting Three-Dimensional Images |
CN216351537U (zh) * | 2021-07-12 | 2022-04-19 | 极瞳科技(北京)有限公司 | 一种全息近眼三维显示*** |
-
2022
- 2022-08-26 CN CN202211033849.XA patent/CN117664924A/zh active Pending
-
2023
- 2023-05-10 WO PCT/CN2023/093125 patent/WO2024041034A1/zh unknown
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050018288A1 (en) * | 2001-12-14 | 2005-01-27 | Peter-Andre Redert | Stereoscopic display apparatus and system |
CN104950459A (zh) * | 2015-05-27 | 2015-09-30 | 广东顺德中山大学卡内基梅隆大学国际联合研究院 | 一种视角增强型指向性背光裸眼立体显示装置 |
CN110187506A (zh) * | 2019-05-28 | 2019-08-30 | 京东方科技集团股份有限公司 | 光学显示***和增强现实设备 |
US20210392305A1 (en) * | 2020-06-16 | 2021-12-16 | Lightspace Technologies, SIA | Display Systems, Projection Units and Methods for Presenting Three-Dimensional Images |
CN216351537U (zh) * | 2021-07-12 | 2022-04-19 | 极瞳科技(北京)有限公司 | 一种全息近眼三维显示*** |
Also Published As
Publication number | Publication date |
---|---|
CN117664924A (zh) | 2024-03-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11270114B2 (en) | AR device and method for controlling the same | |
US11838689B2 (en) | Rotating LIDAR with co-aligned imager | |
US20220365345A1 (en) | Head-up display and picture display system | |
JP2023175794A (ja) | ヘッドアップディスプレイ | |
JP2024097819A (ja) | 画像生成装置及びヘッドアップディスプレイ | |
US20200257124A1 (en) | Electronic device | |
WO2021015171A1 (ja) | ヘッドアップディスプレイ | |
WO2024021852A1 (zh) | 立体显示装置、立体显示***和交通工具 | |
US11388390B2 (en) | Wearable electronic device on head | |
WO2024041034A1 (zh) | 一种显示模组、光学显示***、终端设备及成像方法 | |
WO2024021574A1 (zh) | 立体投影***、投影***和交通工具 | |
US20240036311A1 (en) | Head-up display | |
EP3961291B1 (en) | Vehicular head-up display and light source unit used therefor | |
WO2024065332A1 (zh) | 一种显示模组、光学显示***、终端设备及图像显示方法 | |
WO2023193210A1 (zh) | 光学发射模组、光学显示装置、终端设备及图像显示方法 | |
US20240069335A1 (en) | Head-up display | |
US11442279B2 (en) | Wearable glasses-type device and method for providing virtual images of the glasses-type device | |
WO2024032057A1 (zh) | 一种立体显示装置、立体显示设备以及立体显示方法 | |
WO2023130759A1 (zh) | 一种显示装置和交通工具 | |
WO2024098828A1 (zh) | 投影***、投影方法和交通工具 | |
WO2023190338A1 (ja) | 画像照射装置 | |
WO2023216670A1 (zh) | 立体显示装置和交通工具 | |
WO2023019442A1 (zh) | 一种探测***、终端设备及探测控制方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23856128 Country of ref document: EP Kind code of ref document: A1 |