CN107329267B

CN107329267B - Near-eye display and near-eye display system

Info

Publication number: CN107329267B
Application number: CN201710547136.8A
Authority: CN
Inventors: 欧健; 朱以胜; 何为
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2017-07-06
Filing date: 2017-07-06
Publication date: 2020-03-10
Anticipated expiration: 2037-07-06
Also published as: CN107329267A

Abstract

The present application provides a near-eye display and a near-eye display system, the near-eye display including: the camera shooting display panel comprises a plurality of camera shooting display units which are tiled, wherein each camera shooting display unit in the plurality of camera shooting display units comprises a camera shooting component and a display component which are superposed, and the camera shooting component is positioned on the back surface of the display component; and the first refraction structure is arranged on the surface of the display part of the camera display panel and is used for refracting light rays of images displayed by the display parts of the camera display units to a focus of the near-eye display, and the focus of the near-eye display is positioned in an eyeball of a user. The near-eye display of this application need not additionally to dispose camera device through integrating display element and camera component together into the display element that makes a video recording, is favorable to reducing the volume and the weight that have the near-eye display of the function of making a video recording, can improve user's use and experience, still is favorable to reducing the cost of near-eye display simultaneously.

Description

Near-eye display and near-eye display system

Technical Field

Embodiments of the present invention relate to the field of displays, and more particularly, to near-eye displays and near-eye display systems.

Background

Near-eye displays are typically worn on the eyes of a user, for example, near-eye displays are typically presented in the form of eyeglasses. The near-eye display may provide an Augmented Reality (AR) experience or a Virtual Reality (VR) experience for the user. The AR near-eye display technology is a technology in which a virtual image generated by a near-eye display and a real image of the real world are displayed in a superimposed manner, so that a user can see a final enhanced real image from a screen, as shown in fig. 1, a background 02 is a real image, and a time 01 displayed in the middle is a virtual image generated by the near-eye display. In the VR near-eye display technology, images of left and right eyes are displayed on near-eye displays corresponding to the left and right eyes, respectively, and the eyes can generate stereoscopic vision in the mind after acquiring the information with the difference.

Some near-eye displays are also provided with a camera so as to realize the camera shooting function. However, the camera module configured to the near-eye display in the prior art will increase the volume and weight of the near-eye display, resulting in poor user experience.

Disclosure of Invention

The embodiment of the invention provides a near-eye display and a near-eye display system, which are used for solving the problems of larger size and weight and poorer user experience of the near-eye display in the prior art.

In a first aspect, there is provided a near-eye display comprising:

the display panel makes a video recording, the display panel makes a video recording including a plurality of display element that make a video recording that the tiling set up. Each of the plurality of image pickup display units comprises an image pickup component and a display component which are superposed in the thickness direction of the image pickup display panel, and the image pickup component is positioned on the back of the display component.

And a first refractive structure provided on a surface of a display section of the image pickup display panel, a back surface of the display section being opposite to the surface of the display section.

The first refraction structure is used for refracting light rays carrying output of images displayed by the display parts of the plurality of camera shooting display units to a focus of the near-eye display, and the focus of the near-eye display is positioned in an eyeball of a user.

The image pickup device is used for picking up an image of a subject, and the display device is used for displaying the image. Specifically, the image pickup device is configured to receive light from a subject and photoelectrically convert the light from the subject to generate an electric signal. The display part is used for emitting light, and the surface of the display part of the camera display panel can display images by controlling the light emission of the display part of the camera display units in the camera display panel.

Specifically, the focal point of the near-eye display falls on the central axis of the center of the pupil of the user.

According to the near-eye display provided by the embodiment of the invention, the display part and the camera part are integrated into the camera display unit without additionally arranging the camera device, so that the size and the weight of the near-eye display with the camera function are reduced, the use experience of a user can be improved, and the cost of the near-eye display is reduced.

Moreover, the plurality of camera shooting display units are arranged on the whole camera shooting display panel, so that a larger field of view range can be provided, and the visual experience of a user can be improved.

In some embodiments, each camera display element is opaque and light cannot pass through the camera display element. Alternatively, each two adjacent image capture and display units in the plurality of image capture and display units are in direct contact, that is, no space is provided between the plurality of image capture and display units. Because the camera display unit is opaque, the near-eye display can be used as an opaque VR camera display.

Optionally, the plurality of camera display units are arranged at intervals, and a transparent substrate is filled between every two adjacent camera display units in the plurality of camera display units. The transparent substrate can allow light to pass through without distortion, so that external real scene light can enter eyes of a user through the transparent substrate between the adjacent camera shooting and displaying units.

According to the near-eye display provided by the embodiment of the invention, the refraction structure is arranged on the surface of the display part of the camera display panel, so that the light of the image displayed by the display part of the camera display panel is refracted to the eyes of the user, and meanwhile, the external real-scene light enters the eyes of the user through the transparent base material between the camera display units, so that the AR display of the virtual image and the real-scene image displayed by the panel of the camera display unit in a superposition mode can be realized.

In addition, by integrating the display component and the image pickup component together into an image pickup display unit, the AR display can be realized and the image pickup function can be realized.

Optionally, the first refraction structure is further used for transmitting the ambient light of the real scene. For example, the portion of the first refractive structure facing the transparent substrate spaced between every two image pickup display units allows external light to pass through without distortion. Alternatively, the portion of the first refractive structure facing the transparent substrate at the interval between every two image pickup display units may also be the transparent substrate.

Optionally, the image pickup display panel further comprises a transparent substrate, and the plurality of image pickup display units are arranged on the transparent substrate at intervals. Alternatively, the heights of the plurality of image pickup display units are the same.

Optionally, the height of the transparent substrate filled between every two adjacent image pickup display units does not exceed the height of the image pickup display units on two sides. This facilitates packaging.

It should be noted that the distance between each two adjacent image capture and display units may be the same or different.

Optionally, the near-eye display further comprises: and a second refraction structure provided on a surface of the image pickup element of the image pickup display panel, the second refraction structure being configured to refract light from a subject into the image pickup element of each image pickup display unit.

The second refraction structure is arranged on the surface of the camera shooting component of the camera shooting display panel, so that the light path of incident light entering the camera shooting component can be screened, the camera shooting component on the near-eye display is favorable to having the incident light path equivalent to human eyes, and the external object to be shot can be imaged.

Optionally, the optical path of the incident light of the first refractive structure is the same as the optical path of the emergent light of the second refractive structure.

Therefore, the image pickup component on the near-eye display has an incident light path equivalent to the eyes of the user, namely the visual angle of the image pickup component is the same as the visual angle of the user, namely the image pickup component can be used for realizing the image pickup of the near-eye display.

Optionally, the first refractive structure and the second refractive structure are the same in structure.

Optionally, the image pickup component of each image pickup display unit includes a collimating filter and a photosensitive element, the collimating filter is configured to filter light rays in a non-collimating direction from the received light rays from the object to be photographed, and input collimated light obtained after filtering into the photosensitive element, and the photosensitive element is configured to perform photoelectric conversion on the collimated light to generate an electrical signal.

Optionally, the second refraction structure includes a plurality of second sub-refraction structures, the second sub-refraction structures correspond to the image capturing components of the image capturing and displaying units one to one, and each of the second sub-refraction structures is configured to refract light from the object into the collimating filter of the corresponding image capturing component.

Optionally, every two adjacent second sub-refractive structures in the plurality of second sub-refractive structures are arranged at intervals, and a transparent substrate is filled between every two adjacent second sub-refractive structures.

Optionally, the interval between every two adjacent second sub-refractive structures is directly opposite to the interval between every two adjacent image pickup display units, that is, the transparent substrate between every two adjacent second sub-refractive structures is directly opposite to the transparent substrate between every two adjacent image pickup display units. In this way, the external real light can enter the eyes of the user through the transparent substrate filled in the space between the two without blocking.

And each second sub-refraction structure and the corresponding camera shooting component of the camera shooting display unit can be bonded by glue.

Optionally, the collimation filter of the image pickup component of each image pickup display unit includes at least one sub-collimation filter, the photosensitive element of the image pickup component of each image pickup display unit includes at least one sub-photosensitive element, the at least one sub-collimation filter located in the same image pickup component corresponds to the at least one sub-photosensitive element one to one, one side of each second sub-refraction structure close to the corresponding image pickup component is provided with at least one second chute, and the at least one second chute corresponds to the at least one sub-collimation filter one to one. An opening of each second chute of the at least one second chute faces the corresponding sub-collimating filter. Each second inclined groove in the at least one second inclined groove is used for refracting light rays to the collimation filter of the corresponding sub-camera shooting component.

Optionally, each sub-collimating filter includes two conical lenses symmetrically disposed, each of the two conical lenses includes a conical light-transmitting body and a convex lens, a focal point of the convex lens in each conical lens is located at a top end of the conical light-transmitting body, and the top ends of the conical light-transmitting bodies of the two conical lenses are connected.

Optionally, the photosensitive element of each image capturing component includes a red sub photosensitive element, a green sub photosensitive element, and a blue sub photosensitive element, the collimating filter of each image capturing component includes three sub collimating filters, and the red sub photosensitive element, the green sub photosensitive element, and the blue sub photosensitive element located in the same image capturing component correspond to the three sub collimating filters one to one;

the collimating lens in each camera shooting component is bonded with the photosensitive element through first glue;

the height T of the conical light-transmitting body in the sub-collimation filter corresponding to the red sub-photosensitive element, the green sub-photosensitive element and the blue sub-photosensitive element respectively₂The following relation is satisfied:

wherein R is_r、R_g、R_bThe curvature radius n of the convex lens in the sub-collimating lens corresponding to the red sub-photosensitive element, the green sub-photosensitive element and the blue sub-photosensitive element in the same image pickup device_r、n_g、n_bRefractive indices of the substrate of each sub-collimating filter for light of red wavelength, light of green wavelength and light of blue wavelength, n_fr、n_fg、n_fbThe refractive indexes of the first glue to light with red wavelength, light with green wavelength and light with blue wavelength are respectively.

Optionally, an included angle γ between two generatrices of the axial section of each conical light-transmitting body satisfies the following relation:

the diameter g of the light transmission hole at the joint of the two conical lenses in each sub-collimation filter meets the following relational expression:

g≥2×λ

wherein λ is the maximum wavelength of light transmitted through the light hole, T₂For said conical shape to transmit lightThe height of the body, W is the diameter of the bottom surface of the conical light-transmitting body.

In some possible implementation manners, a light shielding groove is arranged between two adjacent sub-collimation filters in the same collimation filter, and the light shielding groove is filled with a light absorbing material.

Optionally, the first refraction structure includes a plurality of first sub-refraction structures, the plurality of first sub-refraction structures correspond to the display components of the plurality of camera display units one to one, and each of the plurality of first sub-refraction structures is configured to refract the light output by the corresponding display component to the focus of the near-eye display.

Optionally, every two adjacent first sub-refractive structures in the plurality of first sub-refractive structures are arranged at intervals, and a transparent substrate is filled between every two adjacent first sub-refractive structures.

Optionally, the interval between every two adjacent first sub-refractive structures is directly opposite to the interval between every two adjacent image pickup display units, that is, the transparent substrate between every two adjacent first sub-refractive structures is directly opposite to the transparent substrate between every two adjacent image pickup display units. In this way, the external real light can enter the eyes of the user through the transparent substrate filled in the space between the two without blocking.

Therefore, the first refraction structure can refract the light emitted by the camera display unit to the focus of the near-eye display, and meanwhile, the external live-action light can penetrate through the transparent base material to enter the eyes of a user, so that the virtual image displayed by the camera display panel and the AR displayed by overlapping the live-action image can be displayed.

Optionally, the material of the transparent substrate between each two adjacent first refractive structures is the same as the material of the transparent substrate between each two adjacent image pickup display units.

Optionally, the display component of each camera shooting display unit includes at least one light emitting unit, one side of each first sub-refractive structure, which is close to the corresponding display component, is provided with at least one first inclined groove, and the at least one first inclined groove corresponds to the at least one light emitting unit one to one. The opening of each first inclined groove in the at least one first inclined groove faces the corresponding light-emitting unit. Each of the at least one first inclined groove is used for refracting light output by the corresponding light-emitting unit to a focal point of the near-eye display.

Optionally, each first refractive structure and the display part of the corresponding camera display unit are bonded by a second glue. Alternatively, the first refractive structure and the camera display unit are bonded together as one pixel element. That is, the near-eye display may include a plurality of pixel elements arranged at intervals, and a transparent substrate is filled between every two adjacent pixel elements.

Optionally, a plane where an inclined plane of each of the at least one first chute is located and a plane where a side surface of the first refraction structure, which is far away from the display panel, is located have an intersection line, and a first included angle Φ between the intersection line and a first central axis of the side surface of the first refraction structure, which is far away from the display panel, in the horizontal direction of the near-eye display satisfies the following formula:

a third included angle theta between a plane where the inclined plane of each first inclined groove is located and a plane where the surface of one side, far away from the camera shooting display panel, of the first refraction structure is located meets the following formula:

wherein

D is the distance from the central point of the inclined plane of each first inclined groove to the first central axis, and L is the distance from the central point of the inclined plane of each first inclined groove to the second central axis, which is far away from the camera shooting display panel on the first refraction structure, along the vertical direction of the near-eye displayN is the refractive index of the substrate of the first refractive structure, n_fIs the refractive index of the second glue, r is the curvature radius of the cambered surface of the near-eye display field of view,

the intersection line and a second included angle between the first central axes are larger than or equal to the first included angle, and the inclined plane and a fourth included angle between the side surfaces of the first refraction structures far away from the camera shooting display panel are larger than or equal to the third included angle.

The chute arranged on the first refraction structure meets the requirements, so that the display component on the camera display panel can form a clear full-view image on the retina of the eyes of a user, and the imaging cannot be blurred due to the zooming of the eyes of the user.

Optionally, the curvature radius r of the near-eye display field of view arc surface satisfies the following formula:

wherein S is a distance from the center of the image pickup display panel to the pupil center of the user, α is a maximum angle of view of the eye, and P is a pupil radius of the user.

Optionally, the near-eye display further comprises:

the collimating lens assembly is arranged between the camera display panel and the first refraction structure and used for converting light rays emitted by the display components of the camera display units into collimated light and inputting the collimated light into the first refraction structure;

the first refraction structure is used for refracting the collimated light input by the collimating lens component to the focal point of the near-eye display.

Optionally, the collimating lens assembly includes a plurality of collimating lenses, the plurality of collimating lenses are in one-to-one correspondence with the display components of the plurality of image pickup display units, and each of the plurality of collimating lenses is configured to convert light emitted by the corresponding display component into collimated light.

Optionally, every two adjacent collimating lenses of the plurality of collimating lenses are arranged at intervals, and a transparent substrate which is transparent to light is filled between every two adjacent collimating lenses.

Alternatively, the interval between every two adjacent collimating lenses is opposite to the interval between every two adjacent image pickup display units, that is, the transparent substrate between every two adjacent collimating lenses is opposite to the transparent substrate between every two adjacent image pickup display units. In this way, the external real light can enter the eyes of the user through the transparent substrate filled in the space between the two without blocking.

Optionally, the display component of each camera display unit includes at least one light emitting unit, each collimating lens includes at least one sub-collimating lens, the at least one sub-collimating lens corresponds to the at least one light emitting unit one to one, and each sub-collimating lens in the at least one sub-collimating lens is configured to convert light emitted by the corresponding light emitting unit into collimated light.

Optionally, first refraction structure includes a plurality of first sub-refraction structures, a plurality of first sub-refraction structures with a plurality of collimating lens one-to-one, every collimating lens are located between the luminescence unit that corresponds and the first sub-refraction structure that corresponds, bond through third glue between every collimating lens and the luminescence unit that corresponds, bond through fourth glue between every collimating lens and the first sub-refraction structure that corresponds.

Optionally, the display component in each camera display unit includes a red light emitting unit, a green light emitting unit, and a blue light emitting unit, each collimating lens includes three sub-collimating lenses, and the red light emitting unit, the green light emitting unit, and the blue light emitting unit located in the same display component correspond to the three sub-collimating lenses located in the corresponding collimating lenses one to one.

Optionally, the minimum distance T from the red light-emitting unit, the green light-emitting unit and the blue light-emitting unit to the corresponding sub-collimating lens is within the same display component₁Satisfy the following relational expressions respectively:

wherein R is_r、R_g、R_bThe curvature radius n of the sub-collimating lens corresponding to the red light-emitting unit, the green light-emitting unit and the light-emitting unit in the same display component unit_r、n_g、n_bRefractive index of the base material of each sub-collimating lens to light with red wavelength, light with green wavelength and light with blue wavelength, n_fr、n_fg、n_fbThe refractive indexes of the fourth glue to light with red wavelength, light with green wavelength and light with blue wavelength are respectively. Optionally, a light shielding groove is formed between two adjacent sub-collimating lenses in the same collimating lens, and the light shielding groove is filled with a light absorbing material.

Optionally, the light output by the display component of each camera display unit in the camera display panel is collimated light.

Optionally, a light shielding layer is disposed between the image pickup member and the display member in each image pickup display unit. Through setting up the light shield layer, can avoid the light that display element sent to shine on the light sensing element to the signal of telecommunication that leads to light sensing element output is inaccurate, and then has avoided the light that display element sent to influence the imaging quality of the part of making a video recording.

In a second aspect, there is provided a near-eye display system comprising:

a near-eye display, a transceiver, a control chip, and a battery as set forth in the first aspect or any one of the above possible implementations of the first aspect;

the near-eye display is used for converting light rays from a shot object into electric signals, displaying images under the control of the control chip and projecting the displayed images into eyes of a user;

the control chip is used for driving a display part of the near-eye display to display a corresponding image according to the first digital image signal received by the transceiver, and converting an electric signal of the image of the shot object obtained by the near-eye display into a second digital image signal;

the transceiver is used for receiving the first digital image signal, transmitting the first digital image signal to the control chip, acquiring a second digital image signal from the control chip and transmitting the second digital image signal to terminal equipment;

a battery to provide power to the near-eye display system.

The near-eye display system provided by the embodiment of the invention not only can realize near-eye display, but also can provide a larger field of view range, improve the visual experience of a user, and simultaneously realize camera shooting 'what you see is what you get'.

In some possible implementations, after the terminal device receives the second digital image signal, a photo or video taken by the near-eye display may be presented on the display screen according to the second digital image signal.

The first digital image signal may be transmitted by a terminal or server that establishes a connection (e.g., a wired connection or a wireless connection) with the near-eye display.

The control chip can convert the received first digital image signal into a driving current strength and a time sequence signal of a camera display unit in the near-eye display, and then drive a display part of the near-eye display to display an image according to the driving current strength and the time sequence signal.

In some embodiments, the first digital image signal and the second digital image signal are the same, and the image displayed by the display component in the near-eye display is the same as the image captured by the image capture component.

In some embodiments, the first digital image signal and the second digital image signal are different when the image displayed by the display component in the near-eye display is different from the image captured by the image capture component.

In one possible implementation, the near-eye display system includes one of the near-eye displays. When the user wears the near-eye display system, the near-eye display corresponds to the left eye or the right eye of the user.

In one possible implementation, the near-eye display system includes two of the near-eye displays. When a user wears the near-eye display system, one near-eye display corresponds to the left eye of the user, and one near-eye display corresponds to the right eye of the user.

In one possible implementation, the transceiver is a wireless transceiver.

In one possible implementation, the near-eye display system further includes an actuator configured to support the near-eye display and adjust a position of the near-eye display according to a movement trajectory of an eyeball of the user so that a focal point of the near-eye display falls within the eyeball of the user. Like this, when user's eyeball took place to rotate, the user need not the manual adjustment near-to-eye display and can see clear image, can promote user's use experience.

Drawings

FIG. 1 is a diagram of effects presented using AR technology;

FIG. 2 is a schematic diagram of a near-eye display system according to an embodiment of the present invention;

FIG. 3 is a side view of a near-eye display according to an embodiment of the invention;

FIG. 4 is a side view of a near-eye display according to another embodiment of the invention;

FIG. 5 is a side view of a near-eye display according to another embodiment of the invention;

FIG. 6 is a side view of a near-eye display according to another embodiment of the invention;

FIG. 7 is a side view of a display component in a near-eye display according to another embodiment of the invention;

FIG. 8 is a top view of a camera display unit in a near-eye display according to an embodiment of the invention;

FIG. 9 is a parametric illustration of a refractive structure according to another embodiment of the present invention;

FIG. 10 is a side view of a refractive structure according to another embodiment of the present invention;

FIG. 11 is a schematic view of a near-eye display field of view arc;

FIG. 12 is a side view of a near-eye display according to another embodiment of the invention;

FIG. 13 is a side view of a near-eye display according to another embodiment of the invention;

FIG. 14 is a side view of a collimating filter in a near-eye display according to another embodiment of the present invention;

FIG. 15 is a schematic diagram of a near-eye display according to another embodiment of the invention;

FIG. 16 is a schematic size diagram of a near-eye display according to another embodiment of the invention;

FIG. 17 is a schematic diagram of an arrangement of camera display units of a near-eye display according to an embodiment of the invention;

FIG. 18 is another arrangement of a camera display unit of the near-eye display according to an embodiment of the invention;

FIG. 19 is a flow chart of a process for fabricating a collimating filter according to an embodiment of the present invention.

Detailed Description

The technical solution in the embodiments of the present invention will be described below with reference to the accompanying drawings.

Fig. 2 is a schematic diagram of a near-eye display system according to an embodiment of the invention. As shown in fig. 2, the near-eye display system includes: a near-eye display, a control chip, a battery, a transceiver, and an antenna.

The near-eye display is used for projecting an image into the eyes of a user and realizing the function of acquiring an external image. The control chip is used for converting the digital image signal into a driving current strength and a time sequence signal of a display part of the near-eye display, and is connected to the near-eye display through a metal connecting wire hidden in the frame to drive the display part of the near-eye display to display an image; and simultaneously converting the electric signal of the image collected by the image pickup component of the near-eye display into a digital image signal. The battery provides power for the entire near-eye display system. The transceiver and the antenna are used for receiving digital image signals transmitted by a wireless link from the mobile terminal and transmitting the digital image signals to the control chip; and simultaneously, a digital image signal of the image acquired by the camera shooting component is acquired from the control chip and is sent to the terminal equipment. Wherein the transceiver may optionally be in particular a wireless transceiver.

As shown in fig. 2, the near-eye display system may include two near-eye displays, a left near-eye display and a right near-eye display, which correspond to the left and right eyes of the user, respectively, so that both eyes of the user can see the augmented reality image using the AR display technology. However, the embodiment of the present invention is not limited to this, and the near-eye display system may further include only one near-eye display corresponding to the left eye or the right eye of the user, so that the eye of the user corresponding to the near-eye display can see the augmented reality image using the AR display technology or the stereoscopic image using the VR display technology.

That is, the near-eye display in the embodiment of the present invention may be regarded as one lens in the near-eye display system.

It should be noted that the control chip in the embodiment of the present invention may also be referred to as a driving chip.

As shown in fig. 3, the near-eye display provided by the embodiment of the invention may include a camera display panel 310 and a first refractive structure 320. Wherein the image capture display panel 310 includes a plurality of image capture display units 311 arranged in a tiled arrangement. Each image pickup display unit 311 includes an image pickup section 3111 and a display section 3112 stacked in the thickness direction of the image pickup display panel 310, and the image pickup section 3111 is located on the back surface of the display section 3112.

It is to be understood that the back surface of the display part 3112 is opposed to the surface of the display part 3112. The surface of the display member 3112 can emit light, and an image can be displayed by controlling the light emission of the display member 3112 of the plurality of imaging display units 311 on the imaging display panel 310.

The plurality of image pickup display units 311 are tiled in the image pickup display panel 310, specifically: the plurality of image pickup display units 311 are not overlapped with each other in a direction perpendicular to the image pickup display panel 310, and each image pickup display unit 311 does not block light output from the other image pickup display units 311 in the direction perpendicular to the image pickup display panel 310.

Each image pickup part 3111 is for taking a picture or a video, and each display part 3112 is for displaying an image. Specifically, each image pickup section 3111 is configured to receive light from a subject and photoelectrically convert the light from the subject to generate an electric signal. Each display section 3112 is for emitting light, and by controlling the light emission of the display section 3112 of the plurality of image pickup display units 311 in the image pickup display panel 310, the surface of the display section 3112 of the image pickup display panel 310 can display an image.

The first refraction structure 320 is disposed on a light emitting side of the imaging display panel 310 (i.e., a surface of the display part 3112) and refracts light output from the imaging display panel 310 to a focal point of the near-eye display, which is located in an eyeball of a user.

Specifically, the light output by the display component of each camera display unit 311 constitutes a light beam, and the center of the light beam is directed to the focus of the near-eye display after being refracted by the first refraction structure 320.

It should be noted that the focal point of the near-eye display refers to a point at which collimated light is converged after passing through the near-eye display, and this point is the focal point of the near-eye display. So-called collimated light is relative to divergent light, and generally rays are divergent, i.e. two adjacent rays propagate further and further apart. When the divergence angle of the outgoing light cone is smaller than or equal to a specific angle (for example, in the embodiment of the present invention, the specific angle may be smaller than or equal to 5 °) after the light is emitted from the light source, it can be considered that the plurality of light rays emitted from the light source are parallel to each other and are collimated. Collimated light is generally said to be a plurality of rays that are substantially parallel to each other.

In the embodiment of the present invention, the near-eye display includes the image capture display panel and the first refraction structure, so in the embodiment of the present invention, the light output by the display component of the image capture display panel is refracted to the focal point of the near-eye display after passing through the first refraction structure. Further, as is known to those skilled in the art, in order to enable the user to more clearly see the image displayed by the near-eye display, optionally, the focus of the near-eye display may fall within the user's eyeball. Specifically, the focus of the near-eye display falls on the central axis of the center of the user's pupil. In this and other embodiments, and unless otherwise specified, the focal point of the near-eye display is also located on the central axis of the center of the pupil of the user. It should be noted that, after the user wears the near-eye display, if the user's eyeball rotates, the focal point of the near-eye display may not be located on the central axis of the center of the user's pupil, and at this time, a device (e.g., an actuator) for supporting the near-eye display may automatically track the rotation of the user's eyeball and automatically adjust the position of the near-eye display so that the focal point of the near-eye display is located on the central axis of the center of the user's pupil. Like this, when user's eyeball took place to rotate, the user need not the manual adjustment near-to-eye display and can see clear image, can promote user's use experience.

When the position of the near-eye display is adjusted by using a support member such as an actuator, the position of the near-eye display can be adjusted in accordance with the head shape or the face shape of the user, so that the position of the near-eye display can be adjusted more accurately.

Alternatively, the substrate of the first refractive structure 320 may be a transparent substrate.

Alternatively, as shown in fig. 4, each two adjacent image pickup display units 311 in the plurality of image pickup display units 311 are arranged at intervals, and a transparent substrate that transmits light is filled between each two adjacent image pickup display units 311. The design can enable external real scene light to enter eyes of a user through the transparent substrate between the adjacent camera shooting and displaying units. Moreover, the display components of the plurality of camera shooting display units are tiled and arranged on the whole near-eye display, a larger view field range can be provided, and the visual experience of a user can be improved.

It should be noted that the portion of the first refractive structure 320 opposite to the transparent substrate at the interval between every two image pickup display units 311 allows external light to pass through without distortion. Alternatively, the portion of the first refractive structure 320 facing the transparent substrate at the interval between every two image pickup display units 311 may also be the transparent substrate.

Alternatively, the image capture display panel 310 may further include a transparent substrate, and the plurality of image capture display units 311 may be disposed at intervals on the transparent substrate of the image capture display panel 310.

The plurality of camera display units are arranged on the camera display panel, and the transparent base material is adopted at the interval between any two adjacent camera display units, so that the external live-action light can pass through the interval between any two camera display units, and the superposition of the external live-action image and the image displayed by the camera display units is realized.

The transparent substrate in the embodiment of the present invention may be glass or transparent resin, but the embodiment of the present invention is not limited thereto, and the transparent substrate may also be other material capable of transmitting light. The light transmittance of the transparent substrate is not limited in the embodiments of the present invention, and for example, the light transmittance of the transparent substrate may be 80% to 95%. The higher the light transmittance of the transparent substrate, the higher the quality of the image that a person sees when wearing the near-eye display. Optionally, the transparent substrate covers the entire space between any two adjacent image pickup display units, thereby maximizing the light transmittance.

In some embodiments, the plurality of image capture display units 311 may be arranged in a matrix shape of M rows × N columns, each of M and N being an integer greater than or equal to 1. However, the present invention is not limited to this, and the plurality of imaging and display units 311 may be arranged in other regular shapes or irregular shapes.

The adjacent photographic display units may refer to photographic display units adjacent in one or more specified directions, which may be determined according to the arrangement shape of the photographic display units. For example, the plurality of image pickup display units 311 are arranged in a matrix shape, and adjacent image pickup display units refer to image pickup display units adjacent in the row direction and/or the column direction.

It should be understood that every two adjacent camera shooting display units are arranged at intervals, which means that a certain interval distance exists between the two adjacent camera shooting display units, and the interval distance can be adjusted according to actual products. The larger the separation distance, the higher the light transmittance, but the worse the image quality. The smaller the separation distance, the lower the light transmittance, and the higher the image quality.

In some embodiments, the distance between every two adjacent camera display units is the same, which is beneficial to simplifying the production process of the near-eye display. However, the embodiment of the present invention is not limited to this, and the spacing distance between every two adjacent image pickup display units may also be different, or the spacing distances between some adjacent image pickup display units may be the same. For example, the plurality of image pickup display units 311 are arranged in a matrix shape, and the spacing distances between two adjacent image pickup display units in the row direction and/or the column direction are the same; or, a first distance is arranged between two adjacent image pickup display units in the row direction, a second distance is arranged between two adjacent image pickup display units in the column direction, and the first distance is different from the second distance.

Since the resolution of the vision of the human eye to the macula portion is high and the resolution to the edge portion is low, in some embodiments, the separation distance between the camera display units may also be set according to the distance from the camera display unit to the center of the camera display panel (i.e., the center of the near-eye display lens). For example, the farther from the center of the camera display panel, the larger the spacing between the camera display units, which does not affect the visual experience of the user.

In the near-eye display provided by the embodiment of the invention, the refraction structure is arranged on the light-emitting side of the camera display panel, so that the image displayed by the display component of the camera display panel is refracted into the eyes of the user, and meanwhile, the external real-scene light rays pass through the transparent base material between the camera display units and enter the eyes of the user, so that the AR display of the virtual image displayed by the camera display panel and the external real-scene image in a superposition mode can be realized. Meanwhile, the camera shooting display units are arranged on the whole camera shooting display panel, so that a larger field of view range can be provided, and the visual experience of a user can be improved.

Further, by integrating the display component and the image pickup component into the image pickup display unit, the AR display is realized, and simultaneously, the image pickup function can be realized, and the image pickup visual angle is consistent with the visual angle of human eyes, namely, the AR image pickup is realized. Meanwhile, the near-eye display does not need to be additionally provided with a camera device, so that the cost, the weight and the size of the near-eye display with the camera function and the AR display function are reduced.

In addition, the near-eye display of the embodiment of the invention has no complicated optical lens group and electromechanical moving part, so that the weight of the near-eye display is reduced.

The refraction structure in the embodiment of the present invention may be any structure capable of refracting light output by the display component of the image capture display unit to the focus of the near-eye display, and the embodiment of the present invention does not limit the specific implementation form of the refraction structure.

Optionally, as shown in fig. 5, the near-eye display may further include: and a second refraction structure 330 provided on a surface of the image pickup section 3111 of the image pickup display panel 310, the second refraction structure 330 being configured to refract light rays input from a subject into the image pickup section 3111 of each image pickup display unit 311.

The light rays from the object comprise light rays reflected by the object and light rays emitted by the object.

The second refraction structure is arranged on the surface of the camera shooting component of the camera shooting display panel, so that incident light paths entering the camera shooting component can be screened, the camera shooting component on the near-eye display is favorable to having incident light paths equivalent to human eyes, and the external object to be shot can be imaged.

Alternatively, the optical path of the incident light of the first refractive structure 320 is the same as the optical path of the emergent light of the second refractive structure 330.

Therefore, the image pickup component on the near-eye display has the incident light path equivalent to the eyes of the user, namely the visual angle of the image pickup component is the same as that of the user, and the user can see the same image as that shot by the image pickup component.

It should be noted that, in the embodiment of the present invention, the optical path of the incident light of the first refraction structure 320 and the optical path of the emergent light of the second refraction structure 330 may be different, and in this case, the viewing angle of the image pickup device is different from the viewing angle of the user.

Alternatively, the first and

second refraction structures

320 and 330 may have the same structure. Because the light path has reversibility, two refraction structures with the same structure are adopted, so that the light path of incident light of one refraction structure is the same as the light path of emergent light of the other refraction structure. It should be noted that the embodiment of the present invention is not limited to this, and the structures of the first refraction structure 320 and the second refraction structure 330 may be different.

In some embodiments, as shown in fig. 6, the first refractive structure includes a plurality of first sub-refractive structures 321. The plurality of first sub-refractive structures 321 correspond to the display parts 3112 of the plurality of image capture display units 311 one-to-one, wherein each first sub-refractive structure 321 is configured to refract the light output by the corresponding display part 3112 to a focus of the near-eye display. A transparent substrate is filled between every two adjacent sub-refractive structures 321. The transparent substrate is capable of passing external real scene light. Alternatively, the transparent base material filled between the adjacent first sub-refractive structures 321 is the same as the transparent base material filled between the adjacent image pickup display units 311.

Optionally, each first sub-refractive structure 321 is bonded to the corresponding image capture and display unit 311 by glue.

Alternatively, a surface of a side of each first sub-refractive structure 321 close to the corresponding display part 3112 is greater than or equal to a light emitting surface of the corresponding display part 3112. This enables more light rays emitted from each display part 3112 to enter the corresponding first sub-refractive structure 321, and further enables more light rays to be refracted by each first sub-refractive structure 321 to the focus of the near-eye display.

Alternatively, the distance between each two adjacent first sub-refractive structures 321 is the same as the distance between its corresponding two adjacent image capture and display units 311. Alternatively, each first sub-refractive structure 321 coincides with the central axis of the corresponding image capture display unit 311.

In some embodiments, each camera display unit 311 and the corresponding first sub-refractive structure 321 bonded by glue may be taken as one pixel component. That is, the near-eye display may include a plurality of the pixel assemblies arranged at intervals, and a transparent substrate that transmits light is filled between every two adjacent pixel assemblies. External real scene light can pass through this transparent substrate and get into user's eye.

Alternatively, as shown in fig. 6, the second refractive structure includes a plurality of second sub-refractive structures 331, and the plurality of second sub-refractive structures 331 are in one-to-one correspondence with the image pickup parts 3111 of the plurality of image pickup display units 311. Each of the second sub-refractive structures 331 is configured to refract light from a subject into the corresponding image capturing part 3111, each two adjacent second sub-refractive structures 331 of the plurality of second sub-refractive structures 331 are disposed at intervals, and a transparent substrate is filled between each two adjacent second sub-refractive structures 331.

Optionally, each second sub-refractive structure 331 is bonded to the corresponding image capture and display unit 311 by glue.

Alternatively, the surface of each second sub-refractive structure 331 on the side close to the corresponding image pickup display unit 311 is larger than or equal to the surface of the corresponding image pickup part 3111, so that more light can be refracted into the image pickup part 3111 of the image pickup display unit 311.

Alternatively, the distance between each two adjacent second sub-refractive structures 331 is the same as the distance between its corresponding two adjacent image capture and display units 311. Alternatively, each second sub-refractive structure 331 coincides with the central axis of the corresponding imaging display unit 311.

In some embodiments, each of the camera display unit 311, the corresponding first sub-refractive structure 321, and the corresponding second sub-refractive structure 331, which are bonded by glue, may be regarded as one pixel component. That is, the near-eye display may include a plurality of the pixel assemblies arranged at intervals, and a transparent substrate that transmits light is filled between every two adjacent pixel assemblies. External real scene light can pass through this transparent substrate and get into user's eye.

In some embodiments, the display section 3112 of the camera display units 311 is a single color light emitting unit, e.g., the display section of each camera display unit 311 includes one color light emitting unit, such as a red light emitting unit, a green light emitting unit, or a blue light emitting unit.

In some embodiments, the display section 3112 of each camera display unit 311 includes light-emitting units of a plurality of colors, for example, the display section 3112 may include a red (R) light-emitting unit, a green (G) light-emitting unit, and a blue (B) light-emitting unit, as shown in fig. 7. A top view of each camera display unit is shown in fig. 8. It should be understood that the top view of each camera display unit shown in fig. 8 is a circle, but the embodiment of the present invention is not limited thereto.

In some embodiments, as shown in fig. 7, three first inclined grooves 321-1 to 321-3 are disposed on each first sub-refractive structure 321 on a side close to the display part 3112 of the corresponding camera display panel, the three first inclined grooves 321-1 to 321-3 in each first sub-refractive structure 321 correspond to three light emitting units in the display part 3112 of each camera display unit 311 one by one, and each first inclined groove is used for refracting light output by the corresponding light emitting unit to a focal point of the near-eye display. The glue for bonding the display part 3112 of each image pickup display unit and the corresponding sub-refractive structure 321 is diagonally shaded as shown in fig. 7.

In fig. 7, only the light emitted by each light-emitting unit is taken as the collimated light, and the light emitted by each light-emitting unit in the display part 3112 may also be the divergent light, which is not limited in the embodiment of the present invention. It should be noted that fig. 7 only illustrates the light paths of the near-eye display by taking three light rays output by the light emitting unit as an example. In fact, a light beam composed of a plurality of light rays output by each light emitting unit is refracted by the same first inclined groove and then is directed to the focal point of the near-eye display. Specifically, a light beam composed of a plurality of light rays output by each light emitting unit is refracted through the first inclined groove, and the center of the refracted light beam points to the focal point of the near-eye display. The size of the cross section of the light beam output by the light emitting unit is related to the size of the light emitting unit.

When the display part 3112 of each image capture display unit 311 includes a red light emitting unit, a green light emitting unit, and a blue light emitting unit, the display part 3112 of the image capture display unit 311 can output light of different colors, so that the LCD panel can realize color display, thereby enabling the near-eye display to display a color image.

The Light Emitting unit in the embodiment of the invention may be a Light-Emitting Diode (LED) or an Organic Light-Emitting Diode (OLED).

In order to enable each first refraction structure to more accurately refract the light output by the display part 3112 of each camera display unit to the focal point of the near-eye display, the design of each first inclined groove on each first sub-refraction structure 321 may satisfy the following requirements:

1. a plane where the inclined surface of each first inclined groove is located and a plane where a side surface of the first sub-refractive structure 321 away from the camera display panel is located have an intersection line, and a first included angle Φ (shown in fig. 9) between the intersection line and a first central axis along the horizontal direction of the near-eye display on the side surface of the first sub-refractive structure 321 away from the camera display panel satisfies the following relational expression (1):

wherein, the second included angle between the intersection line and the first central axis is greater than or equal to the first included angle, namely the first included angle is the smaller included angle of the two included angles formed by the intersection line and the first central axis;

2. a third included angle θ (shown in fig. 10) between a plane on which the inclined surface of each first inclined groove is located and a plane on a side surface of the first refraction structure 321 away from the image capture display panel satisfies the following relation (2):

wherein

A fourth included angle between the plane where the inclined surface of each first inclined groove is located and the plane where the side surface of the first sub-refractive structure 321 away from the display panel 310 is located is greater than or equal to a third included angle, that is, the third included angle is a smaller one of two included angles formed by the inclined surface of each inclined groove and the side surface of the sub-refractive structure 321 away from the display panel 310.

The meaning of each parameter in relation (1) and relation (2) is as follows:

d is a distance from a center point of the inclined surface of each first inclined groove to the first central axis, L is a distance from the center point of the inclined surface of each first inclined groove to a second central axis on a side surface of the first sub-refractive structure 321 away from the camera display panel 310 in a vertical direction (e.g., y direction) of the near-eye display, n is a refractive index of a base material of the sub-refractive structure 321, and n is a refractive index of a base material of the sub-refractive structure 321_fThe refractive index of the glue between the first sub-refractive structure 321 and the corresponding display part 3112, and r is the curvature radius of the near-eye display field of view arc surface.

In some embodiments, the near-eye display field of view arc radius of curvature r satisfies the following relation (3):

wherein S is the distance from the center of the image display panel to the center of the pupil of the user, α is the maximum angle of view of the eye, and P is the pupil radius of the user, as shown in fig. 11.

The sphere center of the near-eye display view field cambered surface is the focus of the first refraction structure of the near-eye display.

The refraction structure meeting the design can enable the image of the camera display panel on the retina of the user to be clearer, and the image cannot be blurred due to the zooming of the eyes of the user. It should be noted that the examples of the relation (1) and the relation (2) described above are for helping those skilled in the art to better understand the embodiments of the present invention, and are not intended to limit the scope of the embodiments of the present invention. It is obvious to those skilled in the art that various equivalent modifications or changes can be made based on the given examples of the relation (1) and the relation (2), and such modifications or changes also fall within the scope of the embodiments of the present invention.

In some embodiments, the structure of the second sub-refractive structure 331 is the same as that of the first sub-refractive structure 321, and is not described herein again.

In some embodiments, in order to make the light emitted by the light emitting unit incident on the first refractive structure as much as possible, and further make the first refractive structure refract the light to the focal point of the near-eye display as much as possible, the light emitted by the light emitting unit can be made to be collimated light (i.e., parallel light). For example, an LED capable of emitting collimated light may be used, and as shown in fig. 7, light emitted from each light emitting unit in the display part 3112 is collimated light.

Alternatively, a collimating lens may be used to collimate the divergent light rays emitted by the light emitting unit. In some embodiments, the near-eye display may further include a collimating lens assembly disposed between the camera display panel 310 and the first refractive structure 320 for converting light emitted from the plurality of display parts 3112 into collimated light and inputting into the first refractive structure 320. Accordingly, the first refraction structure 320 is used to refract the collimated light input by the collimating lens assembly to the focal point of the near-eye display.

In some embodiments, as shown in fig. 12, the collimating lens assembly includes a plurality of collimating lenses 341, the plurality of collimating lenses 341 are in one-to-one correspondence with the plurality of image capture display units 311, and each collimating lens 341 is configured to convert light emitted from the display part 3112 of the corresponding image capture display unit 311 into collimated light. Every two adjacent collimating lenses 341 are disposed at intervals, and a transparent substrate that transmits light is filled between every two adjacent collimating lenses 341. Alternatively, the transparent base material filled between the adjacent collimator lenses 341 is the same as the transparent base material filled between the adjacent image pickup display units 311.

In some embodiments, as shown in fig. 12, the plurality of first sub-refractive structures 321 correspond to the plurality of collimating lenses 341 in a one-to-one manner, and each collimating lens 341 is located between the corresponding image capture and display unit 311 and the corresponding first sub-refractive structure 321. Each camera display unit 311 and the corresponding collimating lens 341 may be bonded by glue 1, and each collimating lens 341 and the corresponding first sub-refractive structure 321 may be bonded by glue 2. In the embodiment of the present invention, the design of each first inclined groove on the first sub-refractive structure 321 also satisfies the above relation(1) And the design of relation (2), it should be noted that n in relation (2) is now present_fIs the refractive index of the glue 2 between the first sub-refractive structure 321 and the corresponding collimating lens 341.

Alternatively, the refractive index of the glue 1 is the same as the refractive index of the substrate of the collimator lens 341. This can avoid the glue 1 from affecting the focus of the collimating lens 341, and thus affecting the collimating effect. Alternatively, the refractive index of the glue 1, the refractive index of the substrate of the collimating lens 331, and the refractive index of the substrate of the first sub-refractive structure 321 are all the same.

Alternatively, the distance between each two adjacent collimator lenses 341 is the same as the distance between its corresponding adjacent two image capture and display units 311.

In some embodiments, each image capture and display unit 311, the collimating lens 341 corresponding to the image capture and display unit 311, and the first refractive structure 321 corresponding to the image capture and display unit 311 may be regarded as one pixel component. That is to say, the near-eye display may include a plurality of the pixel assemblies, each two adjacent pixel assemblies of the plurality of pixel assemblies are disposed at an interval, and a transparent substrate that transmits light is filled between each two adjacent pixel assemblies. External real scene light can pass through this transparent substrate and get into user's eye.

In some embodiments, each collimating lens 341 may further include at least one sub-collimating lens, and the display part 3112 of each camera display unit 311 includes at least one light emitting unit, and the at least one sub-collimating lens corresponds to the at least one light emitting unit one to one. Each sub-collimating lens is used for converting the light emitted by the corresponding light emitting unit into collimated light. The focus of each sub-collimating lens is located at the light source of the corresponding light-emitting unit, and the light emitted by the corresponding light-emitting unit is converted into collimated light.

In some embodiments, as shown in fig. 13, the display section 3112 of each camera display unit 311 includes a red (R) light-emitting unit, a green (G) light-emitting unit, and a blue (B) light-emitting unit, each collimator lens 341 includes three sub-collimator lenses, and R, G, B light-emitting units located in the same display section 3112 are in one-to-one correspondence with the three sub-collimator lenses located in the same collimator lens.

Alternatively, the minimum distances T of the red, green, and blue light emitting units located within the same display part 3112 to the respective sub-collimating lenses₁Satisfy the following relational expressions respectively:

wherein R is_r、R_g、R_bThe radius of curvature, n, of the sub-collimating lens corresponding to each of the red light emitting unit, the green light emitting unit, and the light emitting unit in the same display part 3112 unit_r、n_g、n_bRefractive index of the base material of each sub-collimating lens to light with red wavelength, light with green wavelength and light with blue wavelength, n_fr、n_fg、n_fbThe refractive indices of the glue 2 for light with red wavelength, light with green wavelength and light with blue wavelength are shown.

It should be noted that, only three light beams emitted by the R light-emitting units are taken as an example in fig. 13, a plurality of divergent light beams emitted by each light-emitting unit are converted into a plurality of collimated light beams through a sub-collimating lens, and the light beams formed by the plurality of collimated light beams are refracted by the same inclined groove and then directed to the focal point of the near-eye display. Specifically, a light beam composed of a plurality of light rays emitted by each light emitting unit is refracted through the inclined grooves, and the center of the refracted light beam points to the focal point of the near-eye display.

Optionally, as shown in fig. 13, a light shielding groove may be further disposed between two adjacent sub-collimating lenses and located in the same collimating lens 341, and the light shielding groove is filled with a light absorbing material (e.g., a black filled portion shown in fig. 13) to prevent light rays emitted by adjacent light emitting units from interfering with each other.

Alternatively, as shown in fig. 13, the image pickup section 3111 of each image pickup display unit includes a collimating filter and a photosensitive element, which are bonded by glue 4. The collimation filter is used for filtering light rays in a non-collimation direction in the received light rays from the shot object, and inputting collimated light obtained after filtering into the photosensitive element, and the photosensitive element is used for performing photoelectric conversion on the collimated light to generate an electric signal.

Because the collimating filter only allows the light rays in the collimation direction to pass through, and the incident light rays in other non-collimation directions are all reflected or absorbed, the image pickup component can enable the image to be clear.

It should be noted that the outer surface of the near-eye display according to the embodiment of the present invention is a plane. The collimated direction of light rays is the direction perpendicular to the outer surface of the near-eye display.

Alternatively, a light-shielding layer is provided between the image pickup member 3111 and the display member 3112 in each image pickup display unit. Through setting up the light shield layer, can avoid the light that display element sent to shine on the light sensing element of the part of making a video recording to the signal of telecommunication that leads to the light sensing element output is inaccurate, and then has avoided the light that display element sent to influence the imaging quality of the part of making a video recording.

Optionally, the collimating filter of each image capturing component 3111 includes at least one sub-collimating filter, the photosensitive element of the image capturing component of each image capturing display unit 311 includes at least one sub-photosensitive element, the at least one sub-collimating filter located in the same image capturing component corresponds to the at least one sub-photosensitive element one to one, one side of each second sub-refraction structure close to the corresponding image capturing component is provided with at least one second inclined groove, the at least one second inclined groove corresponds to the at least one sub-collimating filter one to one, and each second inclined groove in the at least one second inclined groove is used for refracting light to the collimating filter of the corresponding sub-image capturing component.

The different sub-photosensitive elements in each collimating filter may include filters of different colors for performing photoelectric conversion on light of different colors to generate electrical signals.

Fig. 14 is a schematic structural view of the collimating filter of fig. 13. As shown in fig. 14, each sub-collimating filter may include two conical lenses symmetrically disposed in a horizontal direction, each of the two conical lenses including a conical light-transmitting body and a convex lens. The focus of the convex lens in each conical lens is positioned at the top end of the conical light-transmitting body, the top ends of the conical light-transmitting bodies of the two conical lenses are connected, and the top end connecting part of the conical light-transmitting bodies of the two conical lenses is a light-transmitting hole.

Specifically, in the conical lens, the bottom surface of the convex lens is connected to the bottom surface of the conical light-transmitting body.

Alternatively, as shown in fig. 13, the photosensitive element of each image pickup unit includes a red (R) sub photosensitive element, a green (G) sub photosensitive element, and a blue (B) sub photosensitive element, the collimating filter of each image pickup unit includes three sub collimating filters, and the red, green, and blue sub photosensitive elements located in the same image pickup unit correspond to the three sub collimating filters one to one. The red sub-photosensitive element is used for performing photoelectric conversion on red light to generate an electric signal, the green sub-photosensitive element is used for performing photoelectric conversion on green light to generate an electric signal, and the blue sub-photosensitive element is used for performing photoelectric conversion on blue light to generate an electric signal.

Alternatively, as shown in fig. 13, the collimating filter in each image pickup section 3111 is bonded to the second sub-refractive structure 331 by glue 3, and the collimating filter in each image pickup section 3111 is bonded to the photosensitive element by glue 4.

Optionally, the height T of the conical light-transmitting body in the sub-collimating filter corresponding to each of the red sub-photosensitive element, the green sub-photosensitive element and the blue sub-photosensitive element₂Also satisfies the relation (4):

wherein R is_r、R_g、R_bThe radius of curvature, n, of the convex lens in the sub-collimating filter respectively corresponding to the red sub-photosensitive element, the green sub-photosensitive element and the blue sub-photosensitive element in the same image pickup device_r、n_g、n_bRefractive indices of the substrate of each sub-collimating filter for light of red wavelength, light of green wavelength and light of blue wavelength, n_fr、n_fg、n_fbThe refractive indexes of the glue 4 to the light with red wavelength, the light with green wavelength and the light with blue wavelength。

Height T of conical light-transmitting body in each conical lens₂When the above relation (4) is satisfied, the focal point of each conical lens in the sub-collimating lens can be made to fall on the top of the conical light transmitting body.

Note that the refractive index of the glue 2 is lower than that of the substrate of the collimating lens, and the refractive indices of the glue 3 and the glue 4 are lower than that of the substrate of the collimating filter. It should be noted that the refractive index of the substrate of the collimating filter and the refractive index of the substrate of the collimating lens may be the same.

In some embodiments, the refractive indices of glue 2, glue 3, and glue 4 are the same.

the diameter g of the light transmission hole at the joint of the two conical lenses in each sub-collimation filter satisfies the following relation:

g≥2×λ (6)

wherein λ is the maximum wavelength of light transmitted by the light hole, T₂Is the height of the conical light-transmitting body, and W is the diameter of the bottom surface of the conical light-transmitting body.

The included angle gamma and the diameter g of the light holes meet the relational expressions (5) and (6), so that light rays output by the sub-collimating lens can be prevented from being diffracted, and the influence on image definition is avoided.

As shown in fig. 13 or fig. 14, a light shielding groove is disposed between two adjacent sub-collimating filters in the same collimating filter, and the light shielding groove is filled with a light absorbing material. Therefore, the light absorbing material in the light shielding groove can absorb light rays incident to the part of the sub-collimating lens except the focus, and therefore light rays in the non-specified direction output by the camera shooting display unit are filtered.

Alternatively, as shown in fig. 14, the width of the convex lens of each sub-collimating filter is equal to the diameter of the bottom surface of the conical light transmissive body. It should be noted that fig. 13 only illustrates the optical paths of three light rays. The second sub-refraction structure 331 refracts incident light with a large external incident angle and inputs the reflected incident light into the sub-collimation filter of the camera display unit 311, and the collimation filter filters out light in a non-collimation direction and inputs collimated light into the photosensitive element. It should be noted that the light beam composed of multiple light rays is refracted by the same inclined groove and then directed into the sub-collimation filter.

In some embodiments, one second sub-refractive structure 331, the corresponding image capture and display unit 311, the corresponding collimating lens 341, and the first sub-refractive structure 321 as shown in fig. 13 may be taken as one pixel component. As shown in fig. 15, the near-eye display may include a plurality of the pixel assemblies, each two adjacent pixel assemblies of the plurality of pixel assemblies are disposed at intervals, and a transparent substrate that transmits light is filled between each two adjacent pixel assemblies.

It should be further noted that the structure of the collimating filter shown in fig. 13 or fig. 14 and the structure of the collimating lens 341 shown in fig. 12 are only illustrative, and are not intended to limit the scope of the embodiments of the present invention. It will be apparent to those skilled in the art from the foregoing examples that various equivalent modifications or changes may be made, and such modifications or changes are also within the scope of the embodiments of the present invention.

In some embodiments, as shown in fig. 13, each sub-collimating lens in the collimating lens 341 is a conical lens comprising a conical light-transmitting body and a convex lens, and the focal point of the convex lens in each conical lens is located at the top end of the conical light-transmitting body. Thus, the minimum distance T of a light-emitting unit within the display component to its corresponding sub-collimating lens₁Can be expressed as the sum of the height of the conical light-transmitting body in the sub-collimating lens and the thickness of the glue 1.

Some parameters of the near-eye display according to an embodiment of the present invention are described below as a specific example. As shown in fig. 16, the camera display panel of the near-eye display may have a size of: 50mm 30mm, the number of pixels (i.e., camera display units) is: 1445 × 1250. One light emitting unit has a diameter of 8 μm, the photosensitive element has a diameter of 8 μm, the distance between the centers of two adjacent light emitting units is 10 μm, and the distance between two adjacent light emitting unitsThe interval distance is 5 mu m, the diameter of a light hole in the sub-collimation filter is 2 mu m, the interval distance between two adjacent sub-collimation lenses is 2 mu m, the curvature radius Rr of the sub-collimation lens corresponding to the red light-emitting unit is 8 mu m, the curvature radius Rg of the sub-collimation lens corresponding to the green light-emitting unit is more than Rr, the curvature radius Rb of the sub-collimation lens corresponding to the blue light-emitting unit is more than Rg, and T is more than Rg₁The refractive index of glue 1, the refractive index of the base material of the collimating lens 341, and the refractive index of the base material of the first sub-refractive structure 321 are all 1.7, the refractive index of glue 2 and the refractive index of glue 3 are 1.45, and the thickness of the near-eye display may be 200 μm or 1 mm. The thicker the thickness of the near-eye display, the higher the stiffness. It should be understood that this example is intended to assist those skilled in the art in better understanding the embodiments of the present invention and is not intended to limit the scope of the embodiments of the present invention. It will be apparent to those skilled in the art from the foregoing examples that various equivalent modifications or changes may be made, and such modifications or changes are also within the scope of the embodiments of the present invention.

As described above, the plurality of image capture display units on the image capture display panel in the embodiment of the present invention may be arranged in various ways, for example, the plurality of image capture display units on the image capture display panel may be arranged as shown in fig. 17 or fig. 18, and one image capture display unit includes R, G, B sub image capture display units as an example in fig. 17 and fig. 18. Each sub-camera display unit comprises, from top to bottom, a second inclined groove as shown in fig. 13, a sub-collimating filter corresponding to the second inclined groove, a sub-photosensitive element corresponding to the sub-collimating filter, a light-emitting element corresponding to the sub-photosensitive element, a sub-collimating lens corresponding to the light-emitting element, and a first inclined groove corresponding to the sub-collimating lens. Similarly, the plurality of sub image pickup display units in each image pickup display unit may also be arranged in various arrangements, which is not limited in the embodiment of the present invention. For example, the plurality of sub image pickup display units in each image pickup display unit may be arranged in a line as shown in fig. 17, or may be arranged in a triangle as shown in fig. 18.

The arrangement shown in fig. 17 is taken as an example. Assuming that 1445 image display units are arranged in the x direction and 1250 image display units are arranged in the y direction, the distance between two adjacent image display units in the x direction is 34.59 μm, and the distance between two adjacent image display units in the y direction is 24 μm, the minimum width of the near-eye display in the x direction is 1444 × 34.59 μm, and the minimum height in the y direction is 1249 × 24 μm.

It should be noted that the glue in each of the above embodiments may be transparent glue, and the light transmittance of the transparent glue is higher, which is beneficial to improving the imaging quality of the near-eye display. The refractive structure, the condensing lens, and the collimating filter substrate in the above embodiments may be transparent substrates. The transparent substrate used for the refraction structure, the transparent substrate used for the condensing lens, the transparent substrate used for the collimating filter, and the transparent substrate filled between the adjacent pixel groups may be the same transparent substrate or different transparent substrates, which is not limited in the embodiment of the present invention.

FIG. 19 is a schematic flow chart of a process for implementing a collimating filter in a near-eye display according to an embodiment of the present invention. As shown in fig. 19, the process flow for this implementation is as follows.

Step 1, forming a lens array and a groove on an organic transparent material substrate by a nano imprinting technology.

And 2, printing light absorption coatings on the surfaces of the lens array and the groove to form a light absorption groove. For example, black light absorbing ink is printed such that the light absorbing grooves are filled with ink, providing light absorbing properties.

And 3, opening holes on the surface between the adjacent light absorption grooves by adopting a high-precision laser or etching process. For example, a laser is used to remove the light absorbing ink at the focal point of the corresponding microlens to form the light path.

And 4, oppositely aligning and pasting the light holes of the two lens groups obtained through the steps, and thus, the collimating lens can be manufactured.

It should be understood that fig. 19 is only an example of a process for implementing the collimating filter, and the embodiment of the present invention is not limited thereto.

It should also be understood that the collimator lens can be completed through steps 1 to 3.

The above description is only a specific implementation of the embodiments of the present invention, but the scope of the embodiments of the present invention is not limited thereto, and any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the embodiments of the present invention, and all such changes or substitutions should be covered by the scope of the embodiments of the present invention. Therefore, the protection scope of the embodiments of the present invention shall be subject to the protection scope of the claims.

Claims

1. A near-eye display, comprising:

the camera shooting display panel comprises a plurality of camera shooting display units which are tiled, wherein each camera shooting display unit in the plurality of camera shooting display units comprises a camera shooting component and a display component which are overlapped along the thickness direction of the camera shooting display panel, and the camera shooting component is positioned on the back of the display component;

a first refractive structure provided on a surface of a display section of the image pickup display panel, a back surface of the display section being opposite to the surface of the display section;

the first refraction structure is used for refracting light rays carrying images displayed by the display parts of the plurality of camera shooting display units to a focus point of the near-eye display, and the focus point of the near-eye display is positioned in an eyeball of a user.

2. The near-eye display of claim 1 further comprising:

the plurality of camera display units are arranged at intervals, and a transparent base material which is transparent is filled between every two adjacent camera display units in the plurality of camera display units.

3. The near-eye display of claim 2 further comprising:

and a second refraction structure provided on a surface of the image pickup element of the image pickup display panel, the second refraction structure being configured to refract light from a subject into the image pickup element of each image pickup display unit.

4. The near-eye display of claim 3 wherein the light path of the incident light rays of the first refractive structure is the same as the light path of the emergent light rays of the second refractive structure.

5. The near-eye display of claim 4 wherein the first and second refractive structures are identical in structure.

6. The near-eye display of any one of claims 3 to 5, wherein the image capturing component of each image capturing and displaying unit comprises a collimating filter and a photosensitive element, the collimating filter is configured to filter out light rays in a non-collimated direction from the received light rays from the subject, and to input collimated light obtained by filtering out into the photosensitive element, and the photosensitive element is configured to perform photoelectric conversion on the collimated light to generate an electrical signal.

7. The near-eye display of claim 6 wherein the second refractive structures comprise a plurality of second sub-refractive structures, the plurality of second sub-refractive structures corresponding to the image capture components of the plurality of image capture display units one-to-one, each of the plurality of second sub-refractive structures being configured to refract light from a subject into a corresponding image capture component.

8. The near-eye display of claim 7 wherein every two adjacent second sub-refractive structures of the plurality of second sub-refractive structures are spaced apart, and a transparent substrate is filled between every two adjacent second sub-refractive structures.

9. The near-eye display of claim 7,

the collimation filter of every display element that makes a video recording's the part of making a video recording includes at least one sub-collimation filter, every display element that makes a video recording's the part of making a video recording includes at least one sub-photosensitive element, is located same the part of making a video recording at least one sub-collimation filter with at least one sub-photosensitive element one-to-one, one side that every second sub-refraction structure is close to the part of making a video recording that corresponds is provided with at least one second chute, at least one second chute with at least one sub-collimation filter one-to-one, the opening orientation of each second chute corresponds in at least one second chute sub-collimation filter, every second chute in at least one second chute is arranged in refracting the collimation filter of the part of making a video recording to corresponding light.

10. The near-eye display of claim 9 wherein each sub-collimating filter comprises two conical lenses arranged symmetrically, each of the two conical lenses comprising a conical light transmissive body and a convex lens, the convex lens of each conical lens having a focal point at a top end of the conical light transmissive body, the top ends of the conical light transmissive bodies of the two conical lenses being connected.

11. The near-eye display of any one of claims 1 to 5 wherein the light-sensing elements of each camera assembly comprise a red sub-light-sensing element, a green sub-light-sensing element, and a blue sub-light-sensing element, the collimating filter of each camera assembly comprises three sub-collimating filters, and the red sub-light-sensing element, the green sub-light-sensing element, and the blue sub-light-sensing element in the same camera assembly are in one-to-one correspondence with the three sub-collimating filters;

the collimating filter in each camera shooting component is bonded with the photosensitive element through first glue;

wherein R is_r、R_g、R_bThe curvature radius n of the convex lens in the sub-collimating filter respectively corresponding to the red sub-photosensitive element, the green sub-photosensitive element and the blue sub-photosensitive element in the same image pickup device_r、n_g、n_bRefractive indices of the substrate of each sub-collimating filter for light of red wavelength, light of green wavelength and light of blue wavelength, n_fr、n_fg、n_fbThe refractive indexes of the first glue to light with red wavelength, light with green wavelength and light with blue wavelength are respectively.

12. The near-eye display of claim 10 wherein the angle γ between the two generatrices of the axial cross-section of each conical light-transmitting body satisfies the following relationship:

g≥2×λ

wherein λ is the maximum wavelength of light transmitted through the light hole, T₂W is the height of the conical light-transmitting body, and W is the diameter of the bottom surface of the conical light-transmitting body.

13. The near-eye display of any one of claims 1 to 5,

the first refraction structure comprises a plurality of first sub-refraction structures, the plurality of first sub-refraction structures correspond to the display parts of the plurality of camera shooting display units one to one, and each first sub-refraction structure in the plurality of first sub-refraction structures is used for refracting light output by the corresponding display part to the focus of the near-eye display.

14. The near-eye display of claim 13 wherein every two adjacent first sub-refractive structures of the plurality of first sub-refractive structures are spaced apart, and a transparent substrate is filled between every two adjacent first sub-refractive structures.

15. The near-eye display of claim 13,

the display component of each camera shooting display unit comprises at least one light emitting unit, one side, close to the corresponding display component, of each first sub-refraction structure is provided with at least one first inclined groove, the at least one first inclined groove corresponds to the at least one light emitting unit in a one-to-one mode, the opening direction of each first inclined groove in the at least one first inclined groove corresponds to the light emitting unit, and each first inclined groove in the at least one first inclined groove is used for refracting light output by the corresponding light emitting unit to the focus of the near-eye display.

16. A near-eye display according to claim 15 wherein each first sub-refractive structure is bonded to the corresponding display component by a second glue.

17. The near-eye display of claim 16 wherein a plane of the slope of each of the at least one first chute and a plane of a side surface of the first refractive structure away from the camera display panel have an intersection, and a first angle Φ between the intersection and a first central axis along the horizontal direction of the near-eye display on the side surface of the first refractive structure away from the camera display panel satisfies the following equation:

wherein

D does the central point on the inclined plane of every first chute arrives the distance of first axis, L does the central point on the inclined plane of every first chute arrives keep away from on the first refraction structure follow on the side surface of display panel near the distance of eye display's the second axis of the vertical direction, n is the refracting index of the substrate of first refraction structure, n is_fIs the refractive index of the second glue, r is the curvature radius of the cambered surface of the near-eye display field of view,

18. The near-eye display of claim 17 wherein the near-eye display field of view arc radius of curvature r satisfies the following equation:

19. The near-eye display of any one of claims 1 to 5 further comprising:

20. The near-eye display of claim 19 wherein the collimating lens assembly comprises a plurality of collimating lenses in a one-to-one correspondence with the plurality of camera display units, each collimating lens of the plurality of collimating lenses for converting light emitted by the display component of the corresponding camera display unit into collimated light.

21. The near-eye display of claim 20 wherein each two adjacent collimating lenses of the plurality of collimating lenses are spaced apart and a transparent substrate is filled between each two adjacent collimating lenses.

22. The near-eye display of claim 20 wherein the display component of each camera display unit comprises at least one light emitting unit, each collimating lens comprises at least one sub-collimating lens, the at least one sub-collimating lens corresponds to the at least one light emitting unit one to one, and each sub-collimating lens of the at least one sub-collimating lens is configured to convert light emitted by the corresponding light emitting unit into collimated light.

23. The near-eye display of claim 20 wherein the first refractive structure comprises a plurality of first sub-refractive structures, the plurality of first sub-refractive structures correspond to the plurality of collimating lenses one-to-one, each collimating lens is located between the corresponding camera display unit and the corresponding first sub-refractive structure, each collimating lens is bonded to the corresponding camera display unit by a third glue, and each collimating lens is bonded to the corresponding first sub-refractive structure by a fourth glue.

24. The near-eye display of claim 23,

the display component in each camera display unit comprises a red light-emitting unit, a green light-emitting unit and a blue light-emitting unit, each collimating lens comprises three sub-collimating lenses, and the red light-emitting unit, the green light-emitting unit and the blue light-emitting unit which are positioned in the same display component correspond to the three sub-collimating lenses positioned in the corresponding collimating lenses in a one-to-one mode.

25. The near-eye display of claim 24 wherein the red, green, and blue light-emitting units within the same display component are a minimum distance T to the respective sub-collimating lens₁Satisfy the following relational expressions respectively:

wherein R is_r、R_g、R_bThe curvature radius n of the sub-collimating lens corresponding to the red light emitting unit, the green light emitting unit and the blue light emitting unit in the same display part_r、n_g、n_bRefractive index of the base material of each sub-collimating lens to light with red wavelength, light with green wavelength and light with blue wavelength, n_fr、n_fg、n_fbThe refractive indexes of the fourth glue to light with red wavelength, light with green wavelength and light with blue wavelength are respectively.

26. A near-eye display according to any one of claims 1 to 5 wherein the light output by the display component of each camera display unit within the camera display panel is collimated light.

27. A near-eye display according to any one of claims 1 to 5 wherein a light-shielding layer is provided between the image pickup member and the display member in each image pickup display unit.

28. A near-eye display system, comprising:

the near-eye display, transceiver, control chip, and battery of any one of claims 1-27;

the transceiver is used for receiving the first digital image signal, transmitting the first digital image signal to the control chip, acquiring the second digital image signal from the control chip and transmitting the second digital image signal to terminal equipment;

a battery to provide power to the near-eye display system.