CN114578579A - Display device, VR device, display method, computer storage medium, and computer device - Google Patents
Display device, VR device, display method, computer storage medium, and computer device Download PDFInfo
- Publication number
- CN114578579A CN114578579A CN202210439887.9A CN202210439887A CN114578579A CN 114578579 A CN114578579 A CN 114578579A CN 202210439887 A CN202210439887 A CN 202210439887A CN 114578579 A CN114578579 A CN 114578579A
- Authority
- CN
- China
- Prior art keywords
- display
- electro
- display device
- optical modulator
- display screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 26
- 238000001514 detection method Methods 0.000 claims abstract description 49
- 239000000758 substrate Substances 0.000 claims description 44
- 230000003287 optical effect Effects 0.000 claims description 12
- 239000013078 crystal Substances 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 6
- 239000000463 material Substances 0.000 claims description 5
- JBRZTFJDHDCESZ-UHFFFAOYSA-N AsGa Chemical compound [As]#[Ga] JBRZTFJDHDCESZ-UHFFFAOYSA-N 0.000 claims description 4
- 229910001218 Gallium arsenide Inorganic materials 0.000 claims description 4
- WSMQKESQZFQMFW-UHFFFAOYSA-N 5-methyl-pyrazole-3-carboxylic acid Chemical compound CC1=CC(C(O)=O)=NN1 WSMQKESQZFQMFW-UHFFFAOYSA-N 0.000 claims description 3
- GQYHUHYESMUTHG-UHFFFAOYSA-N lithium niobate Chemical compound [Li+].[O-][Nb](=O)=O GQYHUHYESMUTHG-UHFFFAOYSA-N 0.000 claims description 3
- 230000006870 function Effects 0.000 description 16
- 238000010586 diagram Methods 0.000 description 10
- 238000003384 imaging method Methods 0.000 description 10
- 230000014509 gene expression Effects 0.000 description 9
- 230000000694 effects Effects 0.000 description 6
- 230000002035 prolonged effect Effects 0.000 description 5
- 239000004973 liquid crystal related substance Substances 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 210000001747 pupil Anatomy 0.000 description 2
- 235000002911 Salvia sclarea Nutrition 0.000 description 1
- 244000182022 Salvia sclarea Species 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 208000003464 asthenopia Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 230000005684 electric field Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000010287 polarization Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
- G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
- G02B30/30—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving parallax barriers
- G02B30/31—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving parallax barriers involving active parallax barriers
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0012—Optical design, e.g. procedures, algorithms, optimisation routines
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The invention discloses a display device, VR equipment, a display method, a computer storage medium and equipment, wherein the display device of one embodiment comprises: a display screen including a plurality of sub-pixels; a position detection unit for detecting position information of human eyes; the electro-optical modulator is arranged on the light incident side of the display screen; the electronic grating is arranged on one side of the electro-optical modulator, which is far away from the display screen; and a control unit controlling a voltage applied to the electro-optical modulator based on the position information detected by the position detection unit so that the left eye image and the right eye image are respectively incident to the left eye and the right eye of the human eye when the display device performs stereoscopic display. The display device provided by the embodiment of the invention realizes the interference-free stereoscopic image display of left and right eyes under the condition of not reducing the brightness of the display panel by providing the position information detection unit and the electro-optical modulator and controlling the voltage applied to the electro-optical modulator based on the position information.
Description
Technical Field
The present invention relates to the field of display technologies, and in particular, to a display device, a VR device, a display method, a computer-readable storage medium, and a computer device.
Background
With the increasing demand of people for display, 3D display has become an inevitable trend of future display technologies. Naked eye 3D technologies are mainly classified into two major categories: the binocular parallax and the original light field are reproduced. The principle of reproducing binocular parallax is as follows: the left eye and the right eye of a person receive two views with parallax respectively, and images of the two views are synthesized in the brain to generate a 3D effect. Thus, when 3D stereoscopic display is required, 3D video images can be generated by mapping images having parallax to the left and right eyes of a person, respectively.
At present, the design scheme of the naked eye 3D display device is to realize the far and near viewing naked eye 3D effect by changing the size of the opening of the grating. However, the disadvantage of this scheme is that when human eyes are far away from or close to the screen, the aperture ratio of the grating must be reduced to see the 3D effect, and at this time, the brightness of the display panel will decrease, which will affect the viewing experience, and increasing the backlight brightness can improve the brightness decrease problem to a certain extent, but the backlight brightness increase will bring the problem of power consumption increase, and the scheme also has the problem of brightness fluctuation.
Disclosure of Invention
In order to solve at least one of the above problems, a first embodiment of the present application provides a display device including:
a display screen including a plurality of sub-pixels;
a position detection unit for detecting position information of human eyes;
the electro-optical modulator is arranged on the light incident side of the display screen;
the electronic grating is arranged on one side of the electro-optical modulator, which is far away from the display screen; and
and a control unit controlling the voltage applied to the electro-optical modulator based on the position information detected by the position detection unit so that the left eye image and the right eye image are respectively incident to the left eye and the right eye of the human eye when the display device performs stereoscopic display.
In some optional embodiments, in the stereoscopic display, the control unit controls the voltage applied to the electro-optical modulator based on the position information detected by the position detection unit, so that the refractive index n of the refractive medium affecting the optical path direction from the electronic grating to the light-emitting side of the display screenxSatisfies the following conditions:
wherein S is the optimal viewing distance of the display device, SxIs the distance from the human eye to the display screen, and n is the refractive index of the refractive medium at the optimal viewing distance for the human eye.
In some alternative embodiments, the display panel includes a driving circuit substrate,
the display device further includes: the first polaroid is arranged on the surface of the drive circuit substrate, which is far away from the light-emitting side of the display screen, and the refraction medium is composed of the drive circuit substrate, the first polaroid, the electro-optic modulator and an electrode substrate of the electronic grating.
In some optional embodiments, the control unit is based on the position detection unit when the stereoscopic display is performedThe detected position information controls a voltage applied to the electro-optical modulator so that a refractive index n of the electro-optical modulator3xSatisfies the following conditions:
wherein d is1To drive the thickness of the circuit board, n1In order to drive the refractive index of the circuit substrate, d2Is the thickness of the first polarizer, n2Is the refractive index of the first polarizer, d3Thickness of the electro-optical modulator, d4Is the thickness of the electrode substrate, n4Is the refractive index of the electrode substrate.
In some alternative embodiments, the material of the electro-optic modulator is selected from: at least one of a lithium niobate crystal, a gallium arsenide crystal, and a lithium tantalate crystal.
In some alternative embodiments, the aperture ratio of the electron grating is 50%.
In some optional embodiments, the position detection unit captures a human eye position image, and the control unit acquires a distance between a human eye and the display screen based on the human eye position image.
A second aspect of the application provides a VR device comprising a display apparatus as described above.
A third aspect of the present application provides a display method using the display device described above, the method comprising:
the control unit controls the position detection unit to detect the position information of human eyes;
the control unit controls the voltage applied to the electro-optical modulator based on the position information detected by the position detection unit, so that when the display device performs stereoscopic display, after the light entering from the electronic grating exits from the display screen through the electronic modulator, the left eye image and the right eye image are respectively incident to the left eye and the right eye of human eyes.
In some optional embodiments, in the stereoscopic display, the control unit controls the voltage applied to the electro-optical modulator based on the position information detected by the position detection unit, so as to influence the light path direction from the electronic grating to the light emitting side of the display screenRefractive index n of the refractive mediumxSatisfies the following conditions:
wherein S is the optimal viewing distance of the display device, SxIs the distance from the human eye to the display screen, and n is the refractive index of the refractive medium at the optimal viewing distance for the human eye.
In some alternative embodiments, the control unit controls the voltage applied to the electro-optical modulator based on the position information detected by the position detection unit so that the refractive index n of the electro-optical modulator3xSatisfies the following conditions:
wherein the refraction medium is composed of a drive circuit substrate, a first polaroid, an electro-optic modulator and an electrode substrate of an electronic grating,
wherein d is1To drive the thickness of the circuit board, n1In order to drive the refractive index of the circuit substrate, d2Is the thickness of the first polarizer, n2Is the refractive index of the first polarizer, d3Thickness of the electro-optical modulator, d4Is the thickness of the electrode substrate, n4Is the refractive index of the electrode substrate.
A fourth aspect of the present application provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method as described above.
A fifth aspect of the application provides a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the method as described above when executing the program.
The invention has the following beneficial effects:
the invention aims at the existing problems at present, and provides a display device, VR equipment, a display method, a computer readable storage medium and computer equipment, wherein a position information detection unit and an electro-optic modulator are provided, and the voltage applied to the electro-optic modulator is controlled based on the position information detected by the position information detection unit, so that a stereoscopic image display function that left and right eye images are not interfered can be realized under the condition that the display brightness and the power consumption of the display device are not reduced, the watching experience of a user is improved, the use cost of a product is reduced, the service life of the product is prolonged, and the display device has a wide application prospect.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1a is a diagram illustrating a prior art binocular focusing with a constant grating aperture as the human eye viewing distance gets closer;
FIG. 1b is a schematic diagram showing the focusing of two eyes after the opening of the grating is changed when the viewing distance of the eyes gets closer in the prior art;
FIG. 2 shows a schematic diagram of a display device according to an embodiment of the present application;
FIG. 3 shows a schematic cross-sectional view of a display device according to an embodiment of the present application;
FIG. 4 illustrates a detailed imaging schematic when the human eye is at an optimal viewing distance without binocular image interference;
FIG. 5 illustrates an equivalent geometric relationship diagram when the human eye is at the optimal viewing distance without binocular image interference;
FIG. 6 shows a detailed imaging schematic when considering the effect of the refractive medium between the display screen and the grating;
fig. 7 illustrates a schematic flow chart of a display method using a display device according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a computer device according to another embodiment of the present invention.
Detailed Description
In order to more clearly illustrate the invention, the invention is further described below with reference to preferred embodiments and the accompanying drawings. Similar parts in the figures are denoted by the same reference numerals. It is to be understood by persons skilled in the art that the following detailed description is illustrative and not restrictive, and is not to be taken as limiting the scope of the invention.
In the naked eye 3D display device, a viewing distance at which a maximum aperture ratio of a raster, which is 50%, can be obtained when left and right eye images are not interfered is generally set as an optimum viewing distance. Taking the example of using a naked eye 3D display device to view a stereoscopic image at a distance closer than an optimal viewing distance, fig. 1a shows a schematic diagram of binocular imaging when imaging is still performed at a maximum aperture ratio of a raster in the prior art, and fig. 1b shows a schematic diagram of binocular imaging when no interference occurs between the left and right eyes at this time. As shown in fig. 1a, dot-dashed lines and solid line segments are used to distinguish sub-pixels of a display screen that provide a left-eye image and a right-eye image, and it can be seen that in the prior art, when the aperture ratio of the grating is still the maximum aperture ratio, the light entering the left eye simultaneously includes the left-eye image and the right-eye image, and the light entering the right eye also includes the left-eye image and the right-eye image; as shown in fig. 1b, in the prior art, by reducing the aperture ratio of the grating, the image entering the left eye is only the left eye image, while the image entering the right eye is only the right eye image, but it can also be seen from the figure that a part of light rays cannot enter the human eye through the opening when the aperture ratio of the grating is reduced, thereby reducing the light extraction ratio.
Therefore, in the prior art, when the viewing distance is changed, the left eye and the right eye can be ensured to normally view the stereoscopic image without interference by reducing the aperture ratio of the grating, but the problem of reduced display brightness is caused, and if the original display brightness is required to be ensured, the backlight brightness needs to be increased, so that the problem of increased power consumption is inevitably caused.
In order to solve the above problem, as shown in fig. 2, the present application provides a display device 1 including:
a display screen 10 including a plurality of sub-pixels;
a position detection unit 20 for detecting position information of human eyes;
an electro-optical modulator 30 disposed on the light incident side of the display screen 10;
an electronic grating 40 arranged on the side of the electro-optical modulator 30 far away from the display screen 10; and
and a control unit 50 for controlling the voltage applied to the electro-optical modulator 40 based on the position information detected by the position detection unit 20 so that the left-eye image and the right-eye image are respectively incident to the left eye and the right eye of the human eye when the display device 1 performs stereoscopic display.
In the embodiment, by providing the position information detection unit and the electro-optical modulator and controlling the voltage applied to the electro-optical modulator based on the position information detected by the position information detection unit, the stereoscopic image display function that the left and right eye images are not interfered can be realized under the condition that the display brightness and the power consumption of the display device are not reduced, the watching experience of a user is improved, the use cost of a product is reduced, the service life of the product is prolonged, and the stereoscopic image display device has a wide application prospect.
In order to facilitate understanding of the structure of the display device of the embodiments of the present application, a detailed description will be given below with reference to specific examples of the display device of the present invention and its imaging principle.
In a specific example, as shown with reference to fig. 2 and 3, the display device 1 of the embodiment of the present application includes a display screen 10, a position detection unit 20, an electro-optical modulator 30, an electronic grating 40, and a control unit 50.
The display screen 10 includes a driving circuit substrate 11 and a color film substrate 12, where the color film substrate 12 includes optical filters of various colors, and the optical filters define a plurality of sub-pixels in the display screen 10.
The position detecting unit 20 may be an image collector, such as an infrared camera device, for example, and collects images of positions of human eyes of a user watching the display device in real time or at regular time, and outputs the images of the positions of the human eyes to the control unit 50. The position detection unit 20 may be disposed near the back side of the display screen 10, for example, the light transmitted by the under-screen image capture region is used to capture the position image of the human eye, and the position detection unit 20 may also be disposed on the outer frame of the display screen 10 near the light-emitting side, and it should be understood by those skilled in the art that the present application is not intended to limit the specific form of the position detection unit 20, nor the specific position of the position detection unit 20, so as to detect the position information of the human eye of the user.
In addition, the above example indicates that the position detection unit 20 collects the position image of the human eye, and sends the position image of the human eye to the control unit 50 as the position information of the human eye, optionally, the position detection unit 20 may also obtain the distance between the human eye and the display screen 10 according to the position image of the human eye when collecting the position image of the human eye, and directly output the distance to the control unit 50 as the position information of the human eye, which is not described herein again.
In particular, the display device 1 comprises an electro-optical modulator 30, the electro-optical modulator 30 being arranged at the light entrance side of the display screen 10. Optionally, the material of the electro-optic modulator is selected from: lithium niobate crystal (LiNbO)3) Gallium arsenide crystal (GaAs) and lithium tantalate crystal (LiTaO)3) At least one of (1). Of course, this is merely exemplary, and the electro-optic modulator may be made of other materials as long as the material can change the refractive index based on voltage control.
With continued reference to fig. 2 and 3, the electronic grating 40 is disposed on the side of the electro-optic modulator 30 remote from the display screen 10. Alternatively, referring to fig. 3, the electronic grating 40 is a liquid crystal grating, and includes a lower electrode substrate 41, a lower electrode 42, a liquid crystal layer 43, an upper electrode 44, a common electrode, and a common electrode substrate 46. Wherein the orthographic projections of the lower electrodes 42 and the upper electrodes 44 on the lower substrate 41 are alternately distributed, and the electric field generated between the lower electrodes 42 and the upper electrodes 44 drives the liquid crystal in the liquid crystal layer 43 to deflect to control the light transmission and the light non-transmission of different areas so as to realize the grating effect. In the present application, the electron grating 40 may be fixed to be constant at a maximum grating aperture ratio of 50%.
In the embodiment of the present application, referring to fig. 2, the display device 1 further includes a control unit 50, the control unit 50 controls the position detection unit 20 to detect the position information of the human eyes, for example, controls the position detection unit 20 to collect the position image of the human eyes and receives the position image of the human eyes as the position information of the human eyes; the voltage applied to the electro-optical modulator 30 may be controlled based on the received human eye position image so that the left eye image and the right eye image are incident to the left eye and the right eye of the human eye, respectively, when the display device 1 performs stereoscopic display. Specifically, the control unit 50 may obtain a distance of the human eye from the display screen 10 based on the position image of the human eye and control the voltage applied to the electro-optical modulator 30 based on the distance.
Of course, as shown in fig. 2, the control unit 50 may also integrate the display driving control function of the display screen 10 and the control function of controlling the voltages of the lower electrode 42 and the upper electrode 44 of the electronic grating 40, but the application is not limited thereto, and the control unit 50 may be only a control unit for controlling the voltages applied to the electro-optical modulator 30, and the description thereof is omitted here.
Referring to fig. 3, the display device 1 further includes: a first polarizer 61 arranged between the display screen 10 and the electro-optical modulator 30, a second polarizer 62 arranged on the light incident side of the electron grating 40, and a third polarizer 63 arranged on the light emergent side of the display screen 10, each polarizer being used to adjust the polarization direction of the light and also constituting the propagation medium of the light in the display device. In particular, the first polarizer 61 is disposed on the surface of the driving circuit substrate 11 away from the light exit side of the display panel 10, and is bonded to the surface of the electro-optical modulator 30 away from the electronic grating 40.
The imaging, control principle and structural advantages of the display device of the embodiment of the present application are described further below with reference to fig. 4 to 6.
Referring to fig. 4, a schematic diagram of stereo imaging when the human eye is at the optimal viewing distance S is shown. Wherein, the distance from the human eye to the display screen 10 is S, and the height from the opening of the electronic grating 40 to the display screen 10 is H. As can be seen from fig. 4, when light enters the display screen from the opening of the electronic grating 40 and exits to the human eye, the light is actually refracted because the refractive index of the medium between the opening of the electronic grating 40 and the display screen is different from that of air, and the medium which refracts the light entering from the opening of the electronic grating 40 at the display screen 10 becomes a refractive medium in the present application. Specifically, a refractive medium 100 is shown, the refractive medium comprising: the drive circuit substrate 11, the first polarizing plate 61, the electro-optical modulator 30, and the common electrode substrate 42 of the electronic grating 40. Therefore, the height H represents the thickness of the refractive medium 100, and is also referred to as the placement height of the electron grating 40. The equivalent height h is given after taking into account the refractive effect of the refractive medium 100.
As can also be seen from fig. 4, the sub-pixel 1 and the sub-pixel 2 respectively emit a left-eye image and a right-eye image, and light of the two sub-pixels near the edges of the sub-pixels at the optimal viewing distance S can also be incident to the left eye and the right eye, respectively, so that the electronic raster at the optimal viewing distance S may have a maximum aperture ratio, which is 50%.
Fig. 5 shows a geometrical relationship diagram obtained after considering the equivalent height, wherein the dotted line represents the right-eye image ray of another sub-pixel adjacent to the sub-pixel 1. The sub-pixel width is P, the interpupillary distance is L, the opening distance of the electronic grating is a, and the distance of the opaque portion of the electronic grating 40 is B.
The left eye e1, the sub-pixel 1, and the opening of the electronic raster 40 may form a similar triangular relationship that satisfies:
the left-eye e1 and right-eye e2, the sub-pixel 1, and the left-eye image light at the focus of the equivalent height may form a similar triangle relationship, which satisfies:
the right eye e2, sub-pixel 1 and sub-pixel 2, and the distance between the opening of the electronic grating 40 and the opaque region may constitute a similar triangular relationship that satisfies:
the equivalent height can be obtained by solving the expressions (1), (2) and (3) simultaneously:
further consider simultaneously the geometric relationship between the equivalent height H and the thickness of the refractive medium 100, i.e., the placement height H. Wherein the refractive index n of the refractive medium and the refractive index of air are n 1. It should be noted that the refractive index n represents the refractive index of the refractive medium when the human eye is located at the optimal viewing distance of the display device, with the understanding that the refractive index is generally a known parameter in the design of display device products.
Referring to fig. 6, the formula for the refractive index can be used to derive: n1 sin theta 1 n sin theta,
simultaneously:
where θ represents an incident angle of a light ray incident to an interface of the refractive medium and air, and θ 1 represents a refraction angle.
From the above relationship it follows:
at the same time, the user can select the desired position,
assuming that the pupil distance of the human eye is 65mm and the optimal viewing distance is 450mm, the inverse trigonometric function can be used to obtain the angle theta 1 ≈ 4.08 deg. and angle theta ≈ 2.73 deg..
Thus, the number of the first and second electrodes,
so x ≈ a.
Thus, it is possible to provide
Obtaining:
when the air refractive index n is substituted to 1, the thickness of the refractive medium 100, that is, the standing height H is obtained, and the relationship between the height H obtained by converting the refractive index of the refractive medium is:
H＝h*n (6)
when the human eye views the stereoscopic image, when the human eye is at the optimal viewing distance S of the display device, the reduced height of the electronic raster 40 at this time satisfies expression (4), and the expression (4) is substituted into expression (6) to obtain:
when the human eye approaches or moves away from the display screen 10, the viewing distance of the human eye becomes SxAt this time:
obtained from expression (4):
thereby obtaining the refractive index n of the refraction medium 100 influencing the light path direction from the electronic grating 40 to the light-emitting side of the display screen 10x：
It will be appreciated that when the distance of the human eye from the display screen 10 is the optimum viewing distance S, nxN, still satisfied.
That is, according to expression (8) obtained in the present application, it is only necessary to obtain the distance S from the human eye to the display screen 10xTherefore, the stereoscopic image display function that the left and right eyes do not interfere with each other when the maximum aperture ratio of the electronic raster is satisfied at the viewing distance can be uniquely obtained.
In other words, through the above study and derivation, in the embodiment of the present application, at the time of stereoscopic display, the voltage applied to the electro-optical modulator 30 is controlled based on the position information detected by the position detection unit 20 by the setting control unit 50, so thatRefractive index n of the refraction medium from the electronic grating to the light path direction of the light-emitting side of the display screen 10xSatisfying expression (8), then can make the left eye image and the right eye image of display device 1 incident left eye and right eye of people's eye respectively, and needn't reduce the aperture opening ratio of electron grating this moment to when can making the distance of people's eye to display screen no longer be best viewing distance, still can be under the condition of the screen brightness that does not reduce the display screen and do not increase backlight unit's light-emitting luminance and power consumption, realize the clear eye 3D that left and right eyes are noiseless shows, improved user and watched experience, reduced the use cost of product, prolonged the life of product.
Preferably, in order to make the control process of the control unit 50 simpler, the inventors further derive an expression of the refractive index of the electro-optical modulator 30. Specifically, at the time of stereoscopic display, the control unit 50 controls the voltage applied to the electro-optical modulator 30 based on the position information detected by the position detection unit 20 so that the refractive index n of the electro-optical modulator 303xSatisfies the following conditions:
wherein d is1Thickness of the driver circuit substrate 11, n1Refractive index of the driving circuit substrate 11, d2Is the thickness of the first polarizer 61, n2Is a refractive index of the first polarizing plate 61, d3Thickness of the electro-optic modulator 30, d4Is the thickness of the common electrode substrate 46, n4Is the refractive index of the common electrode substrate 46. It will be appreciated that the refractive indices and thicknesses of the other dielectric layers in the refractive medium 100 may be known.
With this arrangement, the control unit is arranged so that the refractive index of the electro-optical modulator is directly obtained according to expression (9) based on the position information of the human eye detected by the position detection unit 20. The control of the refractive index of the refractive medium of the display device can be achieved by varying the voltage applied to the electro-optical modulator by the control unit, as long as the relationship of the refractive index of each electro-optical modulator and the voltage that needs to be applied to the electro-optical modulator is stored in advance.
It should be noted that, although not specifically mentioned, the display device may also have a non-stereoscopic display function, that is, the display device may be a display device having both a planar display function and a stereoscopic display function, and when the display device is in a non-stereoscopic display mode, it is only necessary to control all the electronic gratings to transmit light and to light up each sub-pixel of the display screen according to an image displayed in two dimensions (2D), which is not described herein again.
Based on the same inventive concept, embodiments of the present application also provide a VR device corresponding to the display apparatus of the present application, including the display apparatus as described in the above embodiments. The principle of the VR device for solving the problem is similar to that of the display device, so the specific implementation of the VR device can refer to the implementation of the display device, and the repetition points are not described herein again.
When implemented, the VR device may be any VR product or component with naked eye 3D display functionality. Other essential components of the device are understood by those of ordinary skill in the art, and are not described in detail herein, nor should they be construed as limiting the present application.
Based on the same inventive concept, as shown in fig. 8, an embodiment of the present application further provides a display method of the display device in the above embodiment, where the displaying includes:
s1, the control unit controls the position detection unit to detect the position information of the human eyes;
and S2, the control unit controls the voltage applied to the electro-optical modulator based on the position information detected by the position detection unit, so that when the display device performs stereoscopic display, after the light entering from the electronic grating exits from the display screen through the electronic modulator, the left eye image and the right eye image are respectively incident to the left eye and the right eye of the human eye.
In the embodiment, the control unit controls the position detection unit to detect the position information of the human eyes and controls the voltage applied to the electro-optical modulator based on the position information detected by the position information detection unit, so that the stereoscopic image display function that the left eye image and the right eye image are not interfered can be realized under the condition that the display brightness and the power consumption of the display device are not reduced, the watching experience of a user is improved, the use cost of a product is reduced, the service life of the product is prolonged, and the stereoscopic image display device has a wide application prospect.
In some optional embodiments, in the stereoscopic display, the control unit controls the voltage applied to the electro-optical modulator based on the position information detected by the position detection unit, so that the refractive index n of the refractive medium affecting the optical path direction from the electronic grating to the light-emitting side of the display screenxSatisfies the following conditions:
wherein S is the optimal viewing distance of the display device, SxIs the distance from the human eye to the display screen, and n is the refractive index of the refractive medium at the optimal viewing distance for the human eye.
In some alternative embodiments, the control unit controls the voltage applied to the electro-optical modulator based on the position information detected by the position detection unit so that the refractive index n of the electro-optical modulator is increased when stereoscopic display is performed3xSatisfies the following conditions:
wherein the refraction medium is composed of a drive circuit substrate, a first polaroid, an electro-optic modulator and an electrode substrate of an electronic grating,
wherein d is1To drive the thickness of the circuit board, n1In order to drive the refractive index of the circuit substrate, d2Is the thickness of the first polarizer, n2Is the refractive index of the first polarizer, d3Thickness of the electro-optical modulator, d4Is the thickness of the electrode substrate, n4Is the refractive index of the electrode substrate.
The above embodiments have focused on the display method in the stereoscopic display of the display device, and the method of the present embodiment is similarly applicable when the display device has a stereoscopic display (3D) function and a non-stereoscopic display (2D) function, but is different in that the display method is applied to the stereoscopic display function.
Another embodiment of the present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements:
controlling a position detection unit to detect position information of human eyes;
and controlling the voltage applied to the electro-optical modulator based on the position information detected by the position detection unit, so that when the display device performs stereoscopic display, after the light entering from the electronic grating exits from the display screen through the electronic modulator, the left eye image and the right eye image are respectively incident to the left eye and the right eye of human eyes.
In practice, the computer-readable storage medium may take any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present embodiment, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
As shown in fig. 8, another embodiment of the present invention provides a schematic structural diagram of a computer device. The computer device 102 shown in fig. 8 is only an example and should not bring any limitations to the functionality or scope of use of the embodiments of the present invention.
As shown in fig. 8, computer device 102 is in the form of a general purpose computing device. The components of computer device 102 may include, but are not limited to: one or more processors or processing units 106, a system memory 28, and a bus 108 that couples various system components including the system memory 28 and the processing unit 106.
The system memory 208 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)300 and/or cache memory 302. The computer device 102 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 304 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 8, and commonly referred to as a "hard drive"). Although not shown in FIG. 8, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 108 by one or more data media interfaces. Memory 208 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 400 having a set (at least one) of program modules 402 may be stored, for example, in memory 28, such program modules 402 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 402 generally perform the functions and/or methodologies of the described embodiments of the invention.
The computer device 102 may also communicate with one or more external devices 104 (e.g., keyboard, pointing device, display 204, etc.), with one or more devices that enable a user to interact with the computer device 102, and/or with any devices (e.g., network card, modem, etc.) that enable the computer device 102 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 202. Also, the computer device 102 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, such as the Internet) through the network adapter 200. As shown in FIG. 8, the network adapter 200 communicates with the other modules of the computer device 102 via the bus 108. It should be appreciated that although not shown in FIG. 8, other hardware and/or software modules may be used in conjunction with computer device 102, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processor unit 106 executes various functional applications and data processing by executing programs stored in the system memory 208, for example, implementing a display method using the display device described above according to the embodiment of the present invention.
Aiming at the existing problems, the invention provides the display device, the VR equipment and the display method, the position information detection unit and the electro-optic modulator are provided, and the voltage applied to the electro-optic modulator is controlled based on the position information detected by the position information detection unit, so that the stereoscopic image display function that the left eye image and the right eye image are not interfered can be realized under the condition of not reducing the display brightness and the power consumption of the display device, the watching experience of a user is improved, the use cost of a product is reduced, the service life of the product is prolonged, and the display device, the VR equipment and the display method have wide application prospects.
Aiming at the existing problems, the near-eye light field display device, the VR equipment and the near-eye light field display method are formulated, the preset display screen for displaying data is received and displayed, the aperture of two adjacent lenses and the micro-lens array smaller than the aperture of pupils of human eyes are used, so that the images entering the eyes are overlapped in space, the display data of the overlapped parts are the same, clear and fuzzy transformation between different imaging surfaces can be watched through lens focusing, the true 3D display of continuous depth imaging capable of being focused by a single eye is realized, 3D visual fatigue is avoided, the use experience of a user is improved, and the near-eye light field display device has wide application prospects.
It should be understood that the above-mentioned embodiments of the present invention are only examples for clearly illustrating the present invention, and are not intended to limit the embodiments of the present invention, and it will be obvious to those skilled in the art that other variations or modifications may be made on the basis of the above description, and all embodiments may not be exhaustive, and all obvious variations or modifications may be included within the scope of the present invention.
Claims (13)
1. A display device, comprising:
a display screen including a plurality of sub-pixels;
a position detection unit for detecting position information of human eyes;
the electro-optical modulator is arranged on the light incident side of the display screen;
the electronic grating is arranged on one side of the electro-optical modulator, which is far away from the display screen; and
and the control unit is used for controlling the voltage applied to the electro-optical modulator based on the position information detected by the position detection unit so that the left eye image and the right eye image are respectively incident to the left eye and the right eye of the human eyes when the display device performs stereoscopic display.
2. The display device according to claim 1, wherein the control unit controls the voltage applied to the electro-optical modulator based on the position information detected by the position detection unit so that a refractive index n of a refractive medium affecting an optical path direction of the electronic grating to a light exit side of the display screen at the time of stereoscopic displayxSatisfies the following conditions:
wherein S is the optimal viewing distance of the display device, SxIs the distance from the human eye to the display screen, and n is the refractive index of the refractive medium at the optimal viewing distance for the human eye.
3. The display device according to claim 2, wherein the display panel includes a driving circuit substrate,
the display device further includes: the first polaroid is arranged on the surface, far away from the light emitting side of the display screen, of the driving circuit substrate, and the refraction medium is composed of the driving circuit substrate, the first polaroid, the electro-optic modulator and a common electrode substrate of the electronic grating.
4. The display device according to claim 3, wherein the control unit controls the voltage applied to the electro-optical modulator so that the refractive index n of the electro-optical modulator at the time of stereoscopic display based on the position information detected by the position detection unit3xSatisfies the following conditions:
wherein d is1For the thickness of the drive circuit substrate, n1Is a refractive index of the driving circuit substrate, d2Is the thickness of the first polarizer, n2Is the refractive index of the first polarizer, d3Thickness of the electro-optic modulator, d4Is the thickness of the electrode substrate, n4Is the refractive index of the electrode substrate.
5. A display device as claimed in claim 1, wherein the material of the electro-optic modulator is selected from: at least one of a lithium niobate crystal, a gallium arsenide crystal, and a lithium tantalate crystal.
6. The display device according to claim 1, wherein the aperture ratio of the electron grating is 50%.
7. The display device according to claim 2, wherein the position detection unit captures a human eye position image, and the control unit acquires a distance of the human eye from the display screen based on the human eye position image.
8. A VR device comprising the display apparatus of any of claims 1-7.
9. A display method using the display device according to any one of claims 1 to 7, wherein the method comprises:
the control unit controls the position detection unit to detect the position information of the human eyes;
the control unit controls the voltage applied to the electro-optical modulator based on the position information detected by the position detection unit, so that when the display device performs three-dimensional display, after light entering from the electronic grating is emitted from the display screen through the electronic modulator, a left eye image and a right eye image are respectively incident to the left eye and the right eye of the human eye.
10. The display method according to claim 9, wherein the control unit controls the voltage applied to the electro-optical modulator based on the position information detected by the position detection unit so that a refractive index n of a refractive medium affecting an optical path direction of the electronic grating to the light exit side of the display screen at the time of stereoscopic displayxSatisfies the following conditions:
wherein S is the optimal viewing distance of the display device, SxIs the distance from the human eye to the display screen, n is the distance from the human eye to the display screen at the optimal viewing distanceRefractive index of the refractive medium.
11. The display method according to claim 10, wherein the control unit controls the voltage applied to the electro-optical modulator based on the position information detected by the position detection unit so that the refractive index n of the electro-optical modulator at the time of stereoscopic display3xSatisfies the following conditions:
wherein the refractive medium is composed of the drive circuit substrate, the first polarizing plate, the electro-optical modulator, and the electrode substrate of the electronic grating,
wherein d is1For the thickness of the drive circuit substrate, n1Is a refractive index of the driving circuit substrate, d2Is the thickness of the first polarizer, n2Is the refractive index of the first polarizer, d3Thickness of the electro-optic modulator, d4Is the thickness of the electrode substrate, n4Is the refractive index of the electrode substrate.
12. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 9-11.
13. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method according to any of claims 9-11 when executing the program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210439887.9A CN114578579B (en) | 2022-04-25 | 2022-04-25 | Display device, VR apparatus, display method, computer storage medium, and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210439887.9A CN114578579B (en) | 2022-04-25 | 2022-04-25 | Display device, VR apparatus, display method, computer storage medium, and apparatus |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114578579A true CN114578579A (en) | 2022-06-03 |
| CN114578579B CN114578579B (en) | 2024-01-12 |
Family
ID=81784574
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210439887.9A Active CN114578579B (en) | 2022-04-25 | 2022-04-25 | Display device, VR apparatus, display method, computer storage medium, and apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114578579B (en) |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070115230A1 (en) * | 2005-11-21 | 2007-05-24 | Sanyo Epson Imaging Devices Corporation | Image display device and electronic apparatus |
| US20100073465A1 (en) * | 2008-09-22 | 2010-03-25 | Samsung Electronics Co., Ltd. | Apparatus and method for displaying three dimensional image |
| US20100091095A1 (en) * | 2008-10-15 | 2010-04-15 | Samsung Electronics Co., Ltd. | Method for driving glasses-type stereoscopic display preventing visual fatigue and refractive index-variable shutter glasses |
| US20100232000A1 (en) * | 2007-10-19 | 2010-09-16 | Seereal Technologies S.A. | Spatial Light Modulator Using Electrowetting Cells |
| CN102736255A (en) * | 2012-06-05 | 2012-10-17 | 深圳市亿思达显示科技有限公司 | Stereo display device and optical grating system applied to same |
| CN202815375U (en) * | 2012-07-03 | 2013-03-20 | 信利半导体有限公司 | Open hole stereoscopic display and parallax barrier type raster thereof |
| CN103576408A (en) * | 2012-08-01 | 2014-02-12 | 株式会社日本显示器 | Stereoscopic display apparatus |
| CN103698930A (en) * | 2013-12-09 | 2014-04-02 | 深圳超多维光电子有限公司 | Three-dimensional display device |
| CN103955067A (en) * | 2014-04-15 | 2014-07-30 | 京东方科技集团股份有限公司 | Three-dimensional display system |
| CN104007585A (en) * | 2014-04-30 | 2014-08-27 | 深圳市亿思达显示科技有限公司 | Liquid crystal lens electronic grating and naked eye stereoscopic display device |
| CN203909440U (en) * | 2014-04-30 | 2014-10-29 | 深圳市亿思达显示科技有限公司 | Liquid-crystal lens electronic grating and naked-eye three-dimensional display device |
| CN105739280A (en) * | 2014-12-31 | 2016-07-06 | 乐金显示有限公司 | Hologram Display Apparatus And Method For Controlling The Same |
| CN106125322A (en) * | 2016-09-05 | 2016-11-16 | 万维云视（上海）数码科技有限公司 | Bore hole 3D display floater and bore hole 3D display device |
| CN106338905A (en) * | 2016-10-31 | 2017-01-18 | 京东方科技集团股份有限公司 | Display apparatus and display method |
| WO2017202059A1 (en) * | 2016-05-26 | 2017-11-30 | 京东方科技集团股份有限公司 | Liquid crystal lens, 3d display panel and control method thereof |
| CN111856773A (en) * | 2019-04-26 | 2020-10-30 | 天马日本株式会社 | Display device |
-
2022
- 2022-04-25 CN CN202210439887.9A patent/CN114578579B/en active Active
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070115230A1 (en) * | 2005-11-21 | 2007-05-24 | Sanyo Epson Imaging Devices Corporation | Image display device and electronic apparatus |
| US20100232000A1 (en) * | 2007-10-19 | 2010-09-16 | Seereal Technologies S.A. | Spatial Light Modulator Using Electrowetting Cells |
| US20100073465A1 (en) * | 2008-09-22 | 2010-03-25 | Samsung Electronics Co., Ltd. | Apparatus and method for displaying three dimensional image |
| US20100091095A1 (en) * | 2008-10-15 | 2010-04-15 | Samsung Electronics Co., Ltd. | Method for driving glasses-type stereoscopic display preventing visual fatigue and refractive index-variable shutter glasses |
| CN102736255A (en) * | 2012-06-05 | 2012-10-17 | 深圳市亿思达显示科技有限公司 | Stereo display device and optical grating system applied to same |
| CN202815375U (en) * | 2012-07-03 | 2013-03-20 | 信利半导体有限公司 | Open hole stereoscopic display and parallax barrier type raster thereof |
| CN103576408A (en) * | 2012-08-01 | 2014-02-12 | 株式会社日本显示器 | Stereoscopic display apparatus |
| CN103698930A (en) * | 2013-12-09 | 2014-04-02 | 深圳超多维光电子有限公司 | Three-dimensional display device |
| CN103955067A (en) * | 2014-04-15 | 2014-07-30 | 京东方科技集团股份有限公司 | Three-dimensional display system |
| CN104007585A (en) * | 2014-04-30 | 2014-08-27 | 深圳市亿思达显示科技有限公司 | Liquid crystal lens electronic grating and naked eye stereoscopic display device |
| CN203909440U (en) * | 2014-04-30 | 2014-10-29 | 深圳市亿思达显示科技有限公司 | Liquid-crystal lens electronic grating and naked-eye three-dimensional display device |
| CN105739280A (en) * | 2014-12-31 | 2016-07-06 | 乐金显示有限公司 | Hologram Display Apparatus And Method For Controlling The Same |
| WO2017202059A1 (en) * | 2016-05-26 | 2017-11-30 | 京东方科技集团股份有限公司 | Liquid crystal lens, 3d display panel and control method thereof |
| CN106125322A (en) * | 2016-09-05 | 2016-11-16 | 万维云视（上海）数码科技有限公司 | Bore hole 3D display floater and bore hole 3D display device |
| CN106338905A (en) * | 2016-10-31 | 2017-01-18 | 京东方科技集团股份有限公司 | Display apparatus and display method |
| CN111856773A (en) * | 2019-04-26 | 2020-10-30 | 天马日本株式会社 | Display device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114578579B (en) | 2024-01-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9052414B2 (en) | Virtual image device | |
| JP5459373B2 (en) | Image display device | |
| CN108490703B (en) | Display system and display control method thereof | |
| US20130027772A1 (en) | Variable-depth stereoscopic display | |
| US11740535B2 (en) | Display apparatus and controlling method thereof | |
| US9190019B2 (en) | Image display apparatus | |
| US20130050186A1 (en) | Virtual image display device | |
| US20180252932A1 (en) | Three-dimensional display panel, three-dimensional display apparatus having the same, and fabricating method thereof | |
| CN109031760B (en) | 3D liquid crystal display panel, display device and driving method | |
| US9500874B2 (en) | Liquid crystal optical element and image display apparatus including the same | |
| US9030643B2 (en) | Liquid crystal optical element and image display apparatus including the same | |
| US20180046059A1 (en) | Display spectacles and driving method thereof | |
| WO2013073147A1 (en) | Image display device | |
| JP2015102808A (en) | Display device | |
| KR102142594B1 (en) | Phase control backlight | |
| JP5942150B2 (en) | Image display device | |
| US10499032B2 (en) | Naked-eye stereoscopic display and method of displaying a stereoscopic image | |
| WO2024088004A1 (en) | Display device and image acquisition method therefor | |
| CN111308698B (en) | Directional display screen, induction type three-dimensional display device and display method thereof | |
| CN211603731U (en) | Virtual reality or augmented reality display system and wearable equipment | |
| CN114578579B (en) | Display device, VR apparatus, display method, computer storage medium, and apparatus | |
| CN209858911U (en) | Display device | |
| EP3629072B1 (en) | Optical switch and image system using same | |
| JP5591783B2 (en) | Image display device | |
| CN115695764A (en) | Display apparatus and method, computer-readable storage medium, and computer device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |