CN117233972B - Near-to-eye display optical module, head-mounted display device and virtual reality system - Google Patents
Near-to-eye display optical module, head-mounted display device and virtual reality system Download PDFInfo
- Publication number
- CN117233972B CN117233972B CN202311457445.8A CN202311457445A CN117233972B CN 117233972 B CN117233972 B CN 117233972B CN 202311457445 A CN202311457445 A CN 202311457445A CN 117233972 B CN117233972 B CN 117233972B
- Authority
- CN
- China
- Prior art keywords
- lens
- optical
- display screen
- lens group
- eye
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003287 optical effect Effects 0.000 title claims abstract description 207
- 210000001508 eye Anatomy 0.000 claims abstract description 122
- 230000010287 polarization Effects 0.000 claims description 37
- 230000004424 eye movement Effects 0.000 claims description 34
- 238000000034 method Methods 0.000 claims description 18
- 230000008569 process Effects 0.000 claims description 13
- 230000005540 biological transmission Effects 0.000 claims description 3
- 238000012634 optical imaging Methods 0.000 abstract 1
- 238000001514 detection method Methods 0.000 description 21
- 210000005252 bulbus oculi Anatomy 0.000 description 18
- 238000005516 engineering process Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 9
- 238000004458 analytical method Methods 0.000 description 6
- 230000033001 locomotion Effects 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 238000010276 construction Methods 0.000 description 3
- 230000008921 facial expression Effects 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 101150059062 apln gene Proteins 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000002996 emotional effect Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 239000007888 film coating Substances 0.000 description 1
- 238000009501 film coating Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
Abstract
The application relates to the technical field of optical imaging, in particular to a near-eye display optical module, a head-mounted display device and a virtual reality system, wherein the near-eye display optical module comprises a display screen, and a second lens group, an optical receiving unit and a first lens group which are sequentially arranged along the light emitting direction of the display screen; the display light beam emitted by the display screen enters human eyes after passing through the second lens group and the first lens group; an optical selective reflecting surface is arranged between the optical receiving unit and the display screen and is used for reflecting target light beams in the human eye reflected light beams to the optical receiving unit according to target optical characteristics so as to realize an eye information acquisition function. According to the application, the optical receiving units are arranged between the lens groups, so that the optical receiving units are not protruded towards eyes, and the problems of attractive appearance, and easy pollution and collision are solved.
Description
Technical Field
The invention relates to the technical field of virtual reality equipment, in particular to a near-eye display optical module, head-mounted display equipment and a virtual reality system.
Background
The Virtual Reality (VR) technology includes a computer, electronic information, and a simulation technology, and the basic implementation manner is that the computer simulates a Virtual environment so as to bring the sense of environmental immersion to people. Today, virtual reality technology is rapidly developed, and the application field of the technology tends to be wide. In order to better promote user experience, the functions of VR products are also more diversified. At present, an eye information acquisition technology gradually becomes a major improvement breakthrough direction in VR products, and the eye information acquisition technology commonly comprises an eye movement tracking technology, an eyeball iris identification technology, an eye periocular image acquisition technology, a facial expression identification technology and the like.
In the current eye information acquisition technology, such as an eye movement tracking technology, detection light rays are emitted to eyes of human eyes, the detection light rays reflected by the eyes are acquired by using an image pickup device, and after image processing, the user's gaze direction is analyzed and deduced, so that the user's gaze direction is tracked.
At present, the mainstream eyeball tracking scheme is that an acquisition device of eye information is arranged outside a lens group and is close to one side of a human eye, so that the acquisition device is outstanding and unattractive due to the design, dirt and collision are easy to cause, and the acquisition effect is influenced.
Disclosure of Invention
In order to solve the problems, the application provides a near-to-eye display optical module, a head-mounted display device and a virtual reality system, wherein an optical receiving unit is arranged between lens groups, an optical selective reflecting surface is arranged in the optical module, and the acquisition of eye information is realized by adopting reflection, so that the optical receiving unit is prevented from protruding towards eyes, and the problems of attractive appearance, and easiness in pollution and collision are solved.
In order to achieve the above purpose, the technical scheme adopted by the embodiment of the application is as follows:
in a first aspect, the present application provides a near-eye display optical module, comprising: the display screen comprises a second lens group, an optical receiving unit and a first lens group which are sequentially arranged along the light emitting direction of the display screen;
The display light beam emitted by the display screen enters human eyes after passing through the second lens group and the first lens group;
An optical selective reflecting surface is arranged between the optical receiving unit and the display screen and is used for reflecting target light beams in the human eye reflected light beams to the optical receiving unit according to target optical characteristics so as to realize eye information acquisition.
In an alternative embodiment of the application, the target optical characteristic comprises at least one of: the polarization direction of the incident light, the angle of the incident light and the wavelength of the incident light; the optically selective reflective surface comprises at least one of: polarization-selective reflective films, angle-selective reflective films, and wavelength-selective reflective films.
It can be appreciated that the application provides a near-eye display optical module, which is provided with an optical receiving unit for realizing an eye movement tracking function, wherein the optical receiving unit is arranged between lens groups for amplifying display beams emitted by a display screen, so that the problems that the optical receiving unit protrudes towards eyes, is not attractive in appearance and is easy to cause dirt and collide are avoided.
The optical receiving unit is used as a demarcation point, a first lens group is formed between the optical receiving unit and human eyes, a second lens group is formed between the optical receiving unit and a display screen, an optical selective reflecting surface is arranged between the first lens group and the second lens group, the optical selective reflecting surface is used for reflecting a target light beam in a reflected light beam of the human eyes to the optical receiving unit, the target light beam carries eye information such as eyeball motion information, eye image information is collected according to the target light beam, and specific functions such as an eye motion tracking function are realized through an image processing method. In the process, the human eye reflected light beam is refracted through the first lens group and reflected by the optical selective reflecting surface, so that the inclination of the human eye reflected light beam can be reduced, and the problem of insufficient shooting definition caused by overlarge inclination of the human eye shooting due to overlarge distance from the human eye to the optical receiving unit is avoided.
In an alternative embodiment of the application, the optically selective reflective surface comprises at least one of:
an optically selective reflective film disposed on a target optical surface in the second lens group;
A reflecting mirror disposed between the first lens group and the second lens group, and an optically selective reflecting film laminated on the reflecting mirror.
In an alternative embodiment of the application, the optically selective reflective surface comprises at least one of:
an optically selective reflective film disposed on a target optical surface in the second lens group;
A reflecting mirror disposed between the first lens group and the second lens group, and an optically selective reflecting film laminated on the reflecting mirror.
In an alternative embodiment of the present application, the light emitting device for implementing the eye tracking function may be a display screen for generating a display beam, or may be an additional light emitting unit for emitting a tracking beam to the human eye. The display screen is directly used as the light-emitting equipment with the eye movement tracking function, so that the whole space and the construction cost of the near-eye display optical module can be saved; the light emitting unit is used as the light emitting device with the eye movement tracking function, the design and manufacturing difficulty requirements on the optical selective reflecting surface are lower, the brightness of the target light beam reflected into the optical receiving unit is higher, and the later calculation of the eye movement tracking is easier.
In an alternative embodiment of the present application, when the human eye reflected light beam is the display light beam emitted by the display screen, at least one of the following cases is included:
The optical selective reflection film is a polarization selective reflection film for reflecting light beams in a first polarization direction, the polarization selective reflection film is arranged on the target optical surface, the polarization direction of the display light beams which reach the polarization selective reflection film from the display screen is orthogonal to the first polarization direction, and a first quarter wave plate is further arranged on one side of the optical selective reflection film, which is close to the first lens group; the display light beam passes through the first quarter wave plate for the first time in the process of being injected into the human eye, and passes through the first quarter wave plate for the second time in the process of being reflected to the optical selective reflection film by the human eye;
The optical selective reflection film is arranged on the target optical surface and used for reflecting the light beams in the first incident angle range, the display light beams emitted by the display screen do not meet the first incident angle range, and the human eye reflected light beams meet the first incident angle range.
Optionally, the first incident angle range is a range in which the incident angle is greater than the first angle, and when the target optical surface is a reflective surface having negative optical power, the first angle is less than or equal to 40 °; when the target optical surface is a reflective surface having positive optical power, the first angle is less than or equal to 25 °; when the target optical surface is a plane, the first angle is less than or equal to 32 °.
In an optional embodiment of the application, the near-eye display optical module further includes a light emitting unit; the light emitting unit is used for emitting detection light beams meeting the target optical characteristics to the human eyes.
In an optional embodiment of the application, when the human eye reflected light beam is the detection light beam emitted by the light emitting unit, at least one of the following cases is included:
The optical selective reflection film is a polarization selective reflection film for reflecting the light beam with the first polarization direction, and the polarization direction of the detection light beam emitted by the light emitting unit is the first polarization direction;
the optical selective reflection film is an angle selective reflection film for reflecting light beams in a second incidence angle range, the display light beams emitted by the display screen do not meet the second incidence angle range, and the detection light beams meet the second incidence angle range;
The optical selective reflection film is a wavelength selective reflection film for reflecting a target wave band, the display light beam emitted by the display screen does not meet the target wave band, and the detection light beam meets the target wave band.
In an alternative embodiment of the present application, the second lens group includes a folded light path component, the folded light path component includes a second quarter wave plate, a partially transmissive partial mirror, a third quarter wave plate and a reflective polarizer sequentially disposed along a light emitting direction of the display screen, and the optically selective reflective surface is disposed between the first lens group and the reflective polarizer.
In an alternative embodiment of the application, the first lens group comprises a first lens having positive optical power;
the second lens group includes at least one of:
a second lens having positive optical power, the surface of the second lens facing away from the display screen being a plane;
a third lens and a second lens are sequentially arranged along the light emitting direction of the display screen, the second lens and the third lens both have positive focal power, and the surface of the second lens, which faces away from the display screen, is a convex surface;
The third lens and the second lens are sequentially arranged along the light emitting direction of the display screen, the third lens has positive focal power, the second lens has negative focal power, and the surface of the second lens, deviating from the display screen, is a concave surface.
In a second aspect, there is provided a head mounted display device comprising: the near-eye display optical module of any one of the first aspects.
In a third aspect, the present application provides a virtual reality system comprising a head mounted display device according to any of the second aspects, and an external operating unit establishing a connection with the head mounted display device.
The beneficial effects are that:
The near-eye display optical module provided by the application is provided with the optical receiving unit for collecting eyeball information, and the optical receiving unit is arranged between the lens groups for amplifying the display light beams emitted by the display screen, so that the problems that the optical receiving unit protrudes towards human eyes, is not attractive in appearance and is easy to cause dirt and collision are avoided. In the process that the human eye reflected light beam enters the optical receiving unit, the human eye reflected light beam is refracted through the first lens group and reflected by the optical selective reflecting surface, so that the inclination of the human eye reflected light beam can be reduced, and the problem of insufficient shooting definition caused by overlarge inclination of shooting in the process of acquiring the eye information due to overlarge distance from the human eye to the optical receiving unit is avoided.
The light emitting device for realizing the eye information acquisition function can be a display screen for generating display light beams, or can be an added light emitting unit for emitting detection light beams to human eyes. The display screen is directly used as the light-emitting equipment for eye information acquisition, so that the whole space and the construction cost of the near-eye display optical module can be saved; the light emitting unit is used as the light emitting equipment for eye information acquisition, the design and manufacturing difficulty requirements on the optical selective reflecting surface are lower, the brightness of the target light beam reflected into the optical receiving unit is higher, and the later calculation of eye information acquisition is easier.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
The methods, systems, and/or programs in the accompanying drawings will be described further in terms of exemplary embodiments. These exemplary embodiments will be described in detail with reference to the drawings. These exemplary embodiments are non-limiting exemplary embodiments, wherein the exemplary numbers represent like mechanisms throughout the various views of the drawings.
Fig. 1 is a schematic structural diagram of a first near-eye display optical module provided by the present application.
Fig. 2 is a schematic structural diagram of a second near-eye display optical module provided by the present application.
Fig. 3 is a schematic structural diagram of a third near-eye display optical module provided by the present application.
Fig. 4 is a schematic structural diagram of a fourth near-eye display optical module provided by the present application.
Fig. 5 is a schematic structural diagram of a fifth near-eye display optical module provided by the present application.
Fig. 6 is a schematic diagram of a first structure of a lens assembly in a near-eye display optical module according to the present application.
Fig. 7 is a schematic diagram of a second structure of a lens assembly in a near-eye display optical module according to the present application.
Fig. 8 is a schematic diagram of a third structure of a lens assembly in a near-eye display optical module according to the present application.
Fig. 9 is a schematic diagram of a fourth structure of a lens assembly in a near-eye display optical module according to the present application.
Detailed Description
Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present application unless it is specifically stated otherwise.
The following description of at least one exemplary embodiment is merely exemplary in nature and is in no way intended to limit the application, its application, or uses.
Techniques and equipment known to those of ordinary skill in the relevant art may not be discussed in detail, but should be considered part of the specification where appropriate.
In all examples shown and discussed herein, any specific values should be construed as merely illustrative, and not a limitation. Thus, other examples of exemplary embodiments may have different values.
It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further discussion thereof is necessary in subsequent figures.
The application provides a near-to-eye display optical module which is suitable for being applied to head-mounted display equipment (Head mounted display, HMD) such as VR head-mounted display equipment. The VR head mounted display device may include, for example, VR smart glasses or VR smart helmets, etc., to which embodiments of the present application are not limited with respect to the particular form of the head mounted display device. Of course, the optical module provided by the embodiment of the application can also be applied to other types of electronic equipment.
Along with the intelligent continuous promotion of wear-resisting display device product, the attention degree of eye information acquisition function is promoted gradually. The eye acquisition information can be used for eye movement tracking function, iris identification function, eye and periocular image acquisition, facial expression identification function and the like, and is mainly dependent on the acquired eye information of human eyes, and corresponding functions are realized through image processing and analysis. Taking an eye tracking function as an example, the current mainstream eye tracking structure generally has two sets of key devices, namely an infrared light source and an infrared camera (IR camera) capable of capturing an infrared light beam. Generally, the infrared light source is designed and positioned on the side, away from the display screen, of the near-eye display optical module, the infrared camera is generally positioned at the edge position of the product lens barrel, the requirements of the scheme on the placement position, the FOV, the depth of field, the inclination angle and the like of the infrared camera are relatively strict, and the infrared camera is placed at the edge position, so that the eyeball tracking precision is lower.
Against the above background, in a first aspect, the present application provides a near-eye display optical module, as shown in fig. 1 or fig. 2, including: a display screen 40, and a second lens group 03, an optical receiving unit 50, and a first lens group 02 which are sequentially disposed along the light-emitting direction of the display screen 40.
The display beam emitted by the display screen 40 enters the human eye after passing through the second lens group 03 and the first lens group 02. In the VR head-mounted display device, after being processed by the second lens group 03 and the first lens group 02, a magnified image can be seen by human eyes, and an immersive effect of virtual reality is presented.
An optical selective reflection surface is disposed between the optical receiving unit 50 and the display screen 40, and is configured to reflect a target light beam in the human eye reflected light beam to the optical receiving unit 50 according to the first optical characteristic, so as to implement an eye information collecting function.
In the present application, the eye information may include eyeball image information, eye and periocular image information, etc., and the method may be used for an eye movement tracking function by collecting eyeball image information, such as eyeball movement, or for identification by capturing iris images of the eyeball; the eyes and periocular images of human eyes can be acquired, the images can be displayed through the display area of the front panel, and eyes and facial images of a user can be observed outside the head-mounted display device; in addition, the change of the eyeballs and the eyes can be observed by shooting the images of the eyeballs and the eyes, so that the facial expression of the user is analyzed, and the emotional state of the user is obtained. In this embodiment, the eye information is preferably eyeball information, which is used for an eye tracking function of the head-mounted display device. In other embodiments, the eye information may be other image information, and the corresponding function is implemented through different image processing analysis modes.
It can be appreciated that the present application provides a near-eye display optical module, which is equipped with an optical receiving unit 50 for implementing an eye movement tracking function, wherein the optical receiving unit 50 is disposed between lens groups for magnifying display beams emitted from a display screen 40, so as to avoid the problems that the eye movement tracking device protrudes away from the display screen, is not attractive in appearance, and is easy to cause dirt and collision.
With the optical receiving unit 50 as a demarcation point, a lens between the optical receiving unit 50 and the human eye forms a first lens group 02, a lens between the optical receiving unit 50 and the display screen 40 forms a second lens group 03, and an optical selective reflecting surface is arranged between the optical receiving unit 50 and the display screen 40 and is used for reflecting a target light beam in a human eye reflected light beam to the optical receiving unit 50, wherein the target light beam carries eyeball movement information, an eye movement tracking image is formed according to the target light beam, and then an eye movement tracking function is realized by an image processing method. In this process, the reflected light beam of human eyes is refracted by the first lens group 02 and reflected by the optical selective reflecting surface, so that the inclination of the reflected light beam of human eyes can be reduced, and the problem of insufficient shooting definition caused by too large inclination of shooting eyes in the eye movement tracking image due to too close distance from human eyes to the optical receiving unit 50 is avoided.
In an embodiment of the present application, the optical receiving unit 50 may be an eye tracking camera, and in order to ensure effective recognition, the eye tracking camera may photograph a coverage area of the human eye that is larger than the eye movement area, and the diameter D of the photographing area is greater than 4mm.
In the embodiment of the present application, the display screen 40 may be a self-luminous screen such as LCD, LED, OLED, micro-OLED, ULED, etc., or a reflective screen such as DMD, etc.
In fig. 1 and 2, the first lens group 02 and the second lens group 03 show only one lens, and in practice, each of the first lens group 02 and the second lens group 03 may include at least one optical element. Preferably, the distance d between the edges of the first lens group 02 and the second lens group 03 in the optical axis direction is larger than 3mm.
In an alternative embodiment of the present application, the second lens group 03 includes a folded light path assembly including a second quarter wave plate, a partially transmissive partially reflective mirror, a third quarter wave plate, and a reflective polarizer disposed in this order along the light exiting direction of the display screen 40. The optical selective reflecting surface is disposed between the first lens group and the reflective polarizer, and the partially transmissive partially reflecting mirror is preferably a half mirror.
In this embodiment, the light emitted from the display screen is linearly polarized light, and is changed into circularly polarized light after passing through the second quarter wave plate, then sequentially passes through the partial transmission partial reflector and the third quarter wave plate, then is reflected by the reflective polarizer, passes through the third quarter wave plate, finally passes through the reflective polarizer, and forms a folded light path through the second quarter wave plate, the partial transmission partial reflector, the third quarter wave plate and the reflective polarizer which are sequentially arranged, so that the thickness of the optical module is greatly shortened, and the weight of the whole machine is reduced. In addition, because the optical selective reflection surface is arranged between the first lens group and the reflective polaroid, the optical selective reflection surface can not influence the folded light path, thereby facilitating the design of the folded light path and ensuring the imaging quality.
As shown in fig. 6, the lens group of the near-eye display optical module is a 2-piece optical module, wherein the first lens group 02 is a first lens 20 with positive optical power, the second lens group 03 is a second lens 30 with positive optical power, and a surface 301 of the second lens 30 facing away from the display screen is a plane. The display beam emitted from the display screen is reflected by the 202 surface of the first lens 20 after passing through the second lens 30, and after being reflected again by the surface 302 of the second lens 30, the beam enters the human eye through the first lens 20, and the human eye can see the enlarged image of the display screen at the position 101. After passing through the first lens 20, the human eye reflected light beam for eye movement tracking is reflected by the optical selective reflection surface and enters the optical receiving unit 50, the optical receiving unit 50 can clearly image human eyes, and the gazing direction of the human eyes is deduced through back end analysis, so that eye movement tracking is realized. Specific optical parameters of the first lens 20 and the second lens 30 are shown in the following table:
table 1 specific optical parameters of lenses 20 and 30
As shown in fig. 7, the first lens group 02 is a first lens 500 having positive optical power, the second lens group 03 includes a third lens 70 and a second lens 60 sequentially disposed along the light emitting direction of the display screen 40, the second lens 60 and the third lens 70 each have positive optical power, and a surface of the second lens 60 facing away from the display screen is convex. The display beam emitted from the display screen is reflected by the surface 602 of the second lens 60 after passing through the third lens 70, and after being reflected again by the surface 702 of the third lens 70, the beam enters the human eye through the first lens 500 and the second lens 60, and the human eye is located at the position 101, so that the image magnified by the display screen can be seen. After the reflected light beam of the human eye for eye movement tracking passes through the first lens 500, the reflected light beam is reflected by the surface 601 of the second lens 60 and enters the optical receiving unit 50, the optical receiving unit 50 can clearly image the human eye, and the gazing direction of the human eye is deduced through back end analysis, so that eye movement tracking is realized. Specific optical parameters of the first lens 500, the second lens 60, and the third lens 70 are shown in the following table:
Table 2 specific optical parameters of lens 500, lens 60 and lens 70
As shown in fig. 8, the first lens group 02 is a first lens 80 having positive optical power, the second lens group 03 includes a third lens 100 and a second lens 90 sequentially disposed along the light emitting direction of the display screen 40, the third lens 100 has positive optical power, the second lens 90 has negative optical power, and a surface 901 of the second lens 90 facing away from the display screen is concave. The display beam emitted from the display screen is reflected by the surface 902 of the second lens 90 after passing through the third lens 100, and after being reflected again by the surface 1002 of the third lens 100, the beam enters the human eye through the first lens 80 and the second lens 90, and the human eye is located at 101 to see the magnified image of the display screen. After the reflected light beam of the human eye for eye movement tracking passes through the first lens 80, the reflected light beam is reflected by the surface 901 of the second lens 90 and enters the optical receiving unit 50, the optical receiving unit 50 can clearly image the human eye, and the gazing direction of the human eye is deduced through back end analysis, so that eye movement tracking is realized. Specific optical parameters of the first lens 80, the second lens 90, and the third lens 100 are shown in the following table:
Table 3 specific optical parameters of lens 80, lens 90 and lens 100
As shown in fig. 9, when the first lens group 02 is the first lens 110 with negative optical power, the second lens group 03 includes the third lens 130 and the second lens 120 sequentially disposed along the light emitting direction of the display screen 40, the second lens 120 and the third lens 130 each have positive optical power, and a surface 1201 of the second lens 120 facing away from the display screen is concave.
The display beam emitted from the display screen is reflected by the surface 1202 of the second lens 120 after passing through the third lens 130, and after being reflected again by the surface 1302 of the third lens 130, the beam enters the human eye through the first lens 110 and the second lens 120, and the human eye can see the image enlarged by the display screen 40 at the position 101. After the reflected light beam of the human eye for eye movement tracking passes through the first lens 110, the reflected light beam is reflected by the surface 1201 of the second lens 120 and enters the optical receiving unit 50, the optical receiving unit 50 can perform clear imaging on the human eye, and the gazing direction of the human eye is deduced through back end analysis, so that eye movement tracking is realized. Specific optical parameters of the first lens 110, the second lens 120, and the third lens 130 are shown in the following table:
Table 4 specific optical parameters of lens 110, lens 120 and lens 130
| Surface of the body | Radius (mm) | Thickness (mm) | Material | Conic |
| 1 | -100 | 3 | APEL | 19.5782309 |
| 2 | Infinite number of cases | 2.6622544 | 0 | |
| 3 | -200 | 6.2691914 | OKP | -46.191696 |
| 4 | -64063996 | 4.6220937 | 0 | |
| 5 | -68.02882 | 7.0005629 | APEL | -3.9481777 |
| 6 | -48.6258 | 2.6 | -0.1925834 |
In an alternative embodiment of the application, the optically selective reflective surface comprises at least one of:
as shown in fig. 1, an optical selective reflection film provided on any one of the target optical surfaces 001 in the second lens group 03;
as shown in fig. 2, a mirror M1 provided between the first lens group 02 and the second lens group 03, and an optically selective reflective film laminated on the mirror M1.
In an alternative embodiment of the application, the first optical characteristic comprises at least one of: the polarization direction of the incident light, the angle of the incident light and the wavelength of the incident light; the optically selective reflective film comprises at least one of: polarization-selective reflective films, angle-selective reflective films, and wavelength-selective reflective films.
In an alternative embodiment of the present application, the light emitting device for implementing the eye tracking function may be the display screen 40 for generating the display beam, or may be an additional light emitting unit for emitting the tracking beam to the human eye. The display screen 40 is directly used as the light-emitting equipment with the eye movement tracking function, so that the whole space and the construction cost of the near-eye display optical module can be saved; the light emitting unit is used as the light emitting device with the eye movement tracking function, the design and manufacturing difficulty requirements of the optical selective reflecting surface are lower, the brightness of the target light beam reflected into the optical receiving unit 50 is higher, and the later calculation of the eye movement tracking is easier.
When the human eye reflected light beam is a display light beam emitted from the display screen 40, at least one of the following cases is included:
Case 1: the optical selective reflection film is used for reflecting the light beams in the first polarization direction, the polarization direction of the display light beams emitted by the display screen is perpendicular to the first polarization direction, and a first quarter wave plate is arranged between the optical selective reflection film and human eyes; the display light beam passes through the first quarter wave plate for the first time in the process of being injected into the human eye, and passes through the first quarter wave plate for the second time in the process of being reflected to the optical selective reflection film by the human eye. In case 1, the light exit surface of the display screen 40 may be provided with a polarizing plate for ensuring that the polarization direction of the display beam exiting the display screen is perpendicular to the first polarization direction.
Case 2: the optical selective reflection film is an angle selective reflection film for reflecting light beams in a first incidence angle range, display light beams emitted by the display screen do not meet the first incidence angle range, and human eye reflection light beams meet the first incidence angle range.
In the present embodiment, the display light beam emitted from the display screen and collected by the optical receiving unit is not limited to visible light.
Optionally, the first incident angle range is a range in which the incident angle is greater than the first angle, and when the target optical surface is a convex surface, the first angle is less than or equal to 40 °; when the target optical surface is a concave surface, the first angle is less than or equal to 25 degrees; when the target optical surface is a plane, the first angle is less than or equal to 32 °.
In an alternative embodiment of the present application, as shown in fig. 3 and fig. 4, when the reflected light beam of the human eye is the detection light beam emitted from the light emitting unit, the near-eye display optical module further includes the light emitting unit 50; the light emitting unit 50 is for emitting a detection light beam satisfying the first optical characteristic to the human eye 01. When the human eye reflected light beam is a detection light beam emitted by the light emitting unit, the method comprises at least one of the following conditions:
Case 1: when the optical selective reflection film is a polarization selective reflection film for reflecting the light beam in the first polarization direction, the polarization direction of the detection light beam emitted by the light emitting unit is the first polarization direction.
Case 2: the optical selective reflection film is an angle selective reflection film for reflecting the light beams in the second incidence angle range, the display light beams emitted by the display screen do not meet the second incidence angle range, and the detection light beams meet the second incidence angle range.
Case 3: the optical selective reflection film is a wavelength selective reflection film for reflecting a target wave band, the display light beam emitted by the display screen does not meet the target wave band, and the detection light beam meets the target wave band. It will be appreciated that the target band may be any band of the visible light band, or any band of the non-visible light band, for which the selectable ranges of the non-visible light are infrared light, ultraviolet light, and x-ray, in embodiments of the present application, infrared light is preferred.
In a second aspect, the present application further provides another near-eye display optical module, compared with the near-eye display optical module in the above-mentioned case 3, in addition to the wavelength selective reflection surface provided between the optical receiving unit 50 and the display screen 40, the detection light beam reflected by the human eye is reflected to the optical receiving unit to implement the eye movement tracking function, and the visible light splitting surface is provided between the optical receiving unit 50 and the display screen 40, for reflecting the display light beam reflected by the human eye to the optical receiving unit according to the second optical characteristic, so as to implement the eye movement tracking function.
It can be understood that the present application discloses a near-eye display optical module, and the second lens group disposed in the light emitting direction of the display screen 40 is provided with a visible light splitting surface in addition to the wavelength selective reflecting surface. The wavelength selective reflecting surface is used for reflecting a detection light beam which emits a non-visible light wave band to human eyes to an optical receiving unit for realizing eye movement tracking, namely a conventional light emitting unit which generates the detection light beam is used as a light emitting device with an eye movement tracking function, preferably, the detection light beam emitted by the light emitting unit is infrared light or only infrared light, and the wavelength range is 700nm < w <1400nm; a visible light splitting plane for reflecting the display light beam reflected by the human eye to an optical receiving unit for realizing eye movement tracking, i.e., the display screen 40 generating the display light beam is used as a light emitting device for eye movement tracking function. The near-eye display optical module is provided with the light-emitting device with the eye movement tracking function, so that the light-emitting device is convenient to temporarily switch, the using time of a single light source is reduced, and the failure rate of the light-emitting device is reduced.
It will be appreciated that the light emitting unit is controlled to be turned off when the display brightness of the display screen 40 is greater than the brightness threshold value, and turned on when the display brightness of the display screen is less than the brightness threshold value. Thus, the light emitting unit can be prevented from being in a starting state for a long time, and the energy consumption is increased invalidity.
More specifically, when the display screen 40 displays that the scene is in a bright field, the light emitted by the display screen 40 has enough light intensity, the light emitting unit for emitting infrared light is not started, the light emitted by the display screen irradiates the eyeball after passing through the two lens groups, and the light beam reflected by the eyeball is reflected to the light receiving unit through the visible light splitting surface, so that the eye movement tracking is realized. When the display screen 40 displays that the scene is in the dark field, the light intensity of the emergent light of the display screen 40 is insufficient, the light-emitting unit is started, the infrared detection light beam is emitted to the eyeball by the light-emitting unit, and the detection light beam reflected by the eyeball is reflected to the light-receiving unit through the wavelength selective film, so that the eyeball tracking is realized. The sensing device is used for identifying the brightness degree of the display screen 40, controlling the opening and closing of the light emitting unit, fully utilizing the light emitted by the display screen 40 and improving the light energy utilization rate.
In an alternative embodiment of the application, the wavelength selective reflective surface comprises at least one of:
As shown in fig. 5, a wavelength selective reflection film provided on the first optical surface 001 of the second lens group 03;
a first reflecting mirror (not shown) disposed between the optical receiving unit and the display screen, and a wavelength selective reflecting film laminated on the first reflecting mirror;
the visible light splitting surface comprises at least one of the following:
as shown in fig. 5, a visible light splitting film provided on the second optical surface 002 of the second lens group 03;
A second reflecting mirror (not shown in the figure) disposed between the optical receiving unit and the display screen, and a visible light splitting film laminated on the second reflecting mirror.
It is understood that each of the first lens group and the second lens group may include at least one optical element such as a lens, and the first optical surface and the second optical surface may be any surface of any lens in the second lens group.
In an alternative embodiment of the present application, the near-eye display optical module includes at least one of:
Case 1: the first mirror and the second mirror may be the same mirror or different mirrors; when the first reflecting mirror and the second reflecting mirror are the same reflecting mirror, the wavelength selective reflecting film and the visible light splitting film are stacked on the reflecting mirror; when the first reflecting mirror and the second reflecting mirror are different reflecting mirrors, the wavelength selective reflecting film and the visible light splitting film are respectively arranged on the surfaces of the corresponding reflecting mirrors.
Case 2: the first optical surface and the second optical surface may be the same optical surface or different optical surfaces; when the first optical surface and the second optical surface are the same optical surface, the wavelength selective reflection film and the visible light splitting film are stacked on the same surface of the same lens in the second lens group; when the first optical surface and the second optical surface are different optical surfaces, the wavelength selective reflection film and the visible light splitting film are arranged on different surfaces of the same lens in the second lens group, or the wavelength selective reflection film and the visible light splitting film are arranged on surfaces of different lenses in the second lens group.
It can be understood that the light-emitting angle of the display beam emitted by the display screen is generally different from that of the detection beam emitted by the light-emitting unit, so that the visible light splitting film and the wavelength selective reflecting film can be arranged on different optical surfaces, the light path design and the position design of the light-emitting unit are more convenient, and in addition, films are respectively coated on different optical surfaces, so that the difficulty of a film coating process can be greatly reduced.
In an alternative embodiment of the application, the second optical characteristic comprises at least one of: the polarization direction and the angle of the incident light; the visible light splitting surface comprises at least one of the following: a polarization-selective reflective film and an angle-selective reflective film.
In an alternative embodiment of the application, the visible light splitting surface is a polarization selective reflecting film which is arranged on the second optical surface of the second lens group and is used for reflecting the light beams with the first polarization direction, the polarization direction of the display light beams emitted by the display screen is perpendicular to the first polarization direction, and a first quarter wave plate is arranged between the visible light splitting surface and human eyes; the display light beam passes through the first quarter wave plate for the first time in the process of being injected into human eyes, and passes through the first quarter wave plate for the second time in the process of being reflected to the visible light splitting surface by human eyes.
In an alternative embodiment of the present application, the visible light splitting surface is an angle selective reflection film disposed on the second optical surface of the second lens group and used for reflecting the light beam in the first incident angle range, the display light beam emitted from the display screen does not satisfy the first incident angle range, and the display light beam reflected by the human eye satisfies the first incident angle range.
In an alternative embodiment of the present application, the first incident angle range is a range in which the incident angle is greater than the first angle, and when the second optical surface is a convex surface, the first angle is less than or equal to 40 °; when the second optical surface is concave, the first angle is less than or equal to 25 degrees; when the second optical surface is a plane, the first angle is less than or equal to 32 degrees.
In this embodiment, the light emitting unit may be disposed on any one side of the first lens group 02 and the second lens group 03, preferably, the light emitting unit is disposed on a side of the first lens group 02 away from the second lens group 03, i.e. on a side close to the human eye, so that the light emitted by the light emitting unit can be directly irradiated to the human eye, and light intensity loss caused by light passing through the lens is reduced.
In a third aspect, the present application provides a head mounted display device comprising: the near-eye display optical module of any one of the first aspect or the second aspect.
In the embodiment of the application, the type of the head-mounted display device is not limited, and any one of VR head-mounted display device, AR head-mounted display device and MR head-mounted display device can be included.
In a fourth aspect, the present application provides a virtual reality system comprising a head mounted display screen as in any of the third aspects, and an external operating unit establishing a connection with the head mounted display device. The foregoing embodiments mainly describe differences between the embodiments, and as long as there is no contradiction between different optimization features of the embodiments, the embodiments may be combined to form a better embodiment, and in consideration of brevity of line text, no further description is given here.
While certain specific embodiments of the application have been described in detail by way of example, it will be appreciated by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the application. It will be appreciated by those skilled in the art that modifications may be made to the above embodiments without departing from the scope and spirit of the application. The scope of the application is defined by the appended claims.
Claims (4)
1. A near-eye display optical module, comprising:
the display screen comprises a second lens group, an optical receiving unit and a first lens group which are sequentially arranged along the light emitting direction of the display screen;
the image light beam emitted by the display screen enters human eyes after passing through the second lens group and the first lens group;
an optical selective reflecting surface is arranged between the optical receiving unit and the display screen and is used for reflecting target light beams in the human eye reflected light beams to the optical receiving unit according to the target optical characteristics so as to realize an eye movement tracking function;
the target optical characteristic includes an incident light polarization direction; the optically selective reflective surface comprises a polarization-selective reflective film;
The optically selective reflective surface comprises at least one of: an optically selective reflective film disposed on a target optical surface in the second lens group; a reflecting mirror provided between the first lens group and the second lens group, and an optically selective reflecting film laminated on the reflecting mirror;
when the human eye reflected light beam is the image light beam emitted by the display screen, the method comprises the following steps:
The optical selective reflection film is a polarization selective reflection film for reflecting light beams in a first polarization direction, the polarization selective reflection film is arranged on the target optical surface, the polarization direction of the image light beams reaching the polarization selective reflection film from the display screen is orthogonal to the first polarization direction, and a first quarter wave plate is further arranged on one side, close to the first lens group, of the optical selective reflection film; the image light beam passes through the first quarter wave plate for the first time in the process of being injected into the human eye, and passes through the first quarter wave plate for the second time in the process of being reflected to the optical selective reflection film by the human eye;
The second lens group comprises a folding light path component, the folding light path component comprises a second quarter wave plate, a partial transmission partial reflector, a third quarter wave plate and a reflective polarizer, which are sequentially arranged along the light emitting direction of the display screen, and the optical selective reflecting surface is arranged between the first lens group and the reflective polarizer.
2. The near-eye display optical module of claim 1, wherein,
When the first lens group is a first lens with positive focal power, the second lens group comprises at least one of the following:
a second lens having positive optical power, the surface of the second lens facing away from the display screen being a plane;
a third lens and a second lens are sequentially arranged along the light emitting direction of the display screen, the second lens and the third lens both have positive focal power, and the surface of the second lens, which faces away from the display screen, is a convex surface;
A third lens and a second lens are sequentially arranged along the light emitting direction of the display screen, the third lens has positive focal power, the second lens has negative focal power, and the surface of the second lens, which faces away from the display screen, is a concave surface;
When the first lens group is a first lens with negative focal power, the second lens group comprises a third lens and a second lens which are sequentially arranged along the light emitting direction of the display screen, the second lens and the third lens both have positive focal power, and the surface of the second lens, deviating from the display screen, is a concave surface.
3. A head-mounted display device comprising the near-eye display optical module of any one of claims 1 or 2.
4. A virtual reality system comprising the head mounted display device of claim 3, and an external operating unit establishing a connection with the head mounted display device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311457445.8A CN117233972B (en) | 2023-11-03 | 2023-11-03 | Near-to-eye display optical module, head-mounted display device and virtual reality system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311457445.8A CN117233972B (en) | 2023-11-03 | 2023-11-03 | Near-to-eye display optical module, head-mounted display device and virtual reality system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117233972A CN117233972A (en) | 2023-12-15 |
| CN117233972B true CN117233972B (en) | 2024-05-31 |
Family
ID=89091496
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311457445.8A Active CN117233972B (en) | 2023-11-03 | 2023-11-03 | Near-to-eye display optical module, head-mounted display device and virtual reality system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117233972B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104965306A (en) * | 2015-07-10 | 2015-10-07 | 深圳纳德光学有限公司 | Large-field-angle eye lens optical system |
| CN105068253A (en) * | 2015-09-15 | 2015-11-18 | 厦门灵境信息科技有限公司 | Head-mounted display device and optical lens system thereof |
| CN107562179A (en) * | 2016-06-30 | 2018-01-09 | 上海青研科技有限公司 | It is a kind of to be used for eyeball tracking and the integrated mirror cup of iris recognition |
| CN108415152A (en) * | 2015-11-16 | 2018-08-17 | 董润 | One kind wearing display and sets alternative optical eyepiece camera lens |
| US10739586B1 (en) * | 2017-08-07 | 2020-08-11 | Facebook Technologies, Llc | Reflective polarizer for augmented reality and virtual reality display |
| CN115268009A (en) * | 2022-09-28 | 2022-11-01 | 南昌欧菲光电技术有限公司 | Optical system and head-mounted device |
| CN218273337U (en) * | 2022-10-18 | 2023-01-10 | 腾讯科技（深圳）有限公司 | Head-mounted display device |
| CN115755410A (en) * | 2022-11-28 | 2023-03-07 | 广州立景创新科技有限公司 | VR equipment |
| CN219039511U (en) * | 2022-12-02 | 2023-05-16 | 华为技术有限公司 | Intelligent glasses |
| CN219066130U (en) * | 2022-10-18 | 2023-05-23 | 腾讯科技（深圳）有限公司 | Head-mounted display device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11112613B2 (en) * | 2017-12-18 | 2021-09-07 | Facebook Technologies, Llc | Integrated augmented reality head-mounted display for pupil steering |
| US11132056B2 (en) * | 2019-12-04 | 2021-09-28 | Facebook Technologies, Llc | Predictive eye tracking systems and methods for foveated rendering for electronic displays |
-
2023
- 2023-11-03 CN CN202311457445.8A patent/CN117233972B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104965306A (en) * | 2015-07-10 | 2015-10-07 | 深圳纳德光学有限公司 | Large-field-angle eye lens optical system |
| CN105068253A (en) * | 2015-09-15 | 2015-11-18 | 厦门灵境信息科技有限公司 | Head-mounted display device and optical lens system thereof |
| CN108415152A (en) * | 2015-11-16 | 2018-08-17 | 董润 | One kind wearing display and sets alternative optical eyepiece camera lens |
| CN107562179A (en) * | 2016-06-30 | 2018-01-09 | 上海青研科技有限公司 | It is a kind of to be used for eyeball tracking and the integrated mirror cup of iris recognition |
| US10739586B1 (en) * | 2017-08-07 | 2020-08-11 | Facebook Technologies, Llc | Reflective polarizer for augmented reality and virtual reality display |
| CN115268009A (en) * | 2022-09-28 | 2022-11-01 | 南昌欧菲光电技术有限公司 | Optical system and head-mounted device |
| CN218273337U (en) * | 2022-10-18 | 2023-01-10 | 腾讯科技（深圳）有限公司 | Head-mounted display device |
| CN219066130U (en) * | 2022-10-18 | 2023-05-23 | 腾讯科技（深圳）有限公司 | Head-mounted display device |
| CN115755410A (en) * | 2022-11-28 | 2023-03-07 | 广州立景创新科技有限公司 | VR equipment |
| CN219039511U (en) * | 2022-12-02 | 2023-05-16 | 华为技术有限公司 | Intelligent glasses |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117233972A (en) | 2023-12-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11567328B2 (en) | See-through computer display systems with adjustable zoom cameras | |
| US11789269B2 (en) | See-through computer display systems | |
| US11668939B2 (en) | See-through computer display systems with stray light management | |
| US10474229B1 (en) | Folded viewing optics with high eye tracking contrast ratio | |
| US10989922B2 (en) | Augmented reality optics system with pin mirror | |
| KR100839574B1 (en) | Substrate-guided optical beam expander | |
| JP6336994B2 (en) | See-through near-eye display | |
| US20190219818A1 (en) | Eye tracking for augmented reality and virtual reality | |
| CN111766702A (en) | Near-to-eye display optical system for eyeball tracking | |
| US11451762B2 (en) | Head-mounted viewable device and eye-tracking system for use in head-mounted viewable device | |
| CN108398788B (en) | Eye tracking device and virtual reality imaging device | |
| US20210041692A1 (en) | Stray light suppression in eye-tracking imaging | |
| CN113376837A (en) | Near-eye display optical system, near-eye display apparatus and method | |
| CN117233972B (en) | Near-to-eye display optical module, head-mounted display device and virtual reality system | |
| CN117311004B (en) | Short-distance optical amplification module, head-mounted display and virtual reality system | |
| CN221225161U (en) | Short-distance optical amplification module, wearable display device and virtual reality system | |
| CN221225169U (en) | Near-eye imaging module, head-mounted virtual reality equipment and virtual reality system | |
| CN117311004A (en) | Short-distance optical amplification module, head-mounted display and virtual reality system | |
| US20150234168A1 (en) | Compact Folding Lens Display Module | |
| WO2023246814A1 (en) | Eyeball tracking optical system and head-mounted device | |
| CN211348860U (en) | AR optical glasses | |
| CN116149051A (en) | Lens assembly, infrared light supplementing method and eye movement tracking method and system | |
| CN116626887A (en) | Optical module and electronic equipment | |
| CN117331227A (en) | Near-to-eye display system and head-mounted display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |