CN116009253A - Optical equipment - Google Patents
Optical equipment Download PDFInfo
- Publication number
- CN116009253A CN116009253A CN202111235619.7A CN202111235619A CN116009253A CN 116009253 A CN116009253 A CN 116009253A CN 202111235619 A CN202111235619 A CN 202111235619A CN 116009253 A CN116009253 A CN 116009253A
- Authority
- CN
- China
- Prior art keywords
- image source
- optical
- optical waveguide
- glasses
- waveguide structure
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003287 optical effect Effects 0.000 title claims abstract description 480
- 230000008859 change Effects 0.000 claims abstract description 37
- 239000011521 glass Substances 0.000 claims description 207
- 238000012545 processing Methods 0.000 claims description 21
- 210000001508 eye Anatomy 0.000 description 155
- 239000000758 substrate Substances 0.000 description 35
- 238000010586 diagram Methods 0.000 description 29
- 238000010168 coupling process Methods 0.000 description 22
- 238000005859 coupling reaction Methods 0.000 description 22
- 230000001276 controlling effect Effects 0.000 description 21
- 238000000034 method Methods 0.000 description 18
- 210000001747 pupil Anatomy 0.000 description 17
- 230000008878 coupling Effects 0.000 description 12
- 238000007726 management method Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 9
- 210000003128 head Anatomy 0.000 description 9
- 238000003384 imaging method Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 9
- 230000000694 effects Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000000644 propagated effect Effects 0.000 description 5
- 230000001105 regulatory effect Effects 0.000 description 5
- 238000004904 shortening Methods 0.000 description 5
- 230000000712 assembly Effects 0.000 description 4
- 238000000429 assembly Methods 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 230000003190 augmentative effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000007769 metal material Substances 0.000 description 2
- 238000005498 polishing Methods 0.000 description 2
- 235000002911 Salvia sclarea Nutrition 0.000 description 1
- 244000182022 Salvia sclarea Species 0.000 description 1
- VYPSYNLAJGMNEJ-UHFFFAOYSA-N Silicium dioxide Chemical compound O=[Si]=O VYPSYNLAJGMNEJ-UHFFFAOYSA-N 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 239000000853 adhesive Substances 0.000 description 1
- 230000001070 adhesive effect Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001902 propagating effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Abstract
The application relates to the technical field of optics and discloses optical equipment. The optical device comprises an optical display module, wherein the optical display module comprises a first image source assembly and a first optical waveguide structure; when the position of the first image source component changes, the included angle between the light ray corresponding to the first image source component and the first optical waveguide structure also changes, and then the virtual image position of the optical display module also changes. Therefore, the optical device provided by the application can realize the change of the virtual image position by adjusting the position of the first image source component relative to the first optical waveguide structure, so that the requirements of users on different virtual image positions can be met.
Description
Technical Field
The present application relates to the field of optical technologies, and in particular, to an optical device.
Background
Head mounted display devices have found wide application in various fields of military, commercial, industrial, fire and recreational applications. In some technical solutions, the head-mounted display device mainly uses an optical machine as an image source, and projects an image into human eyes to form images in the form of virtual images through a specific optical element. Among them, the optical element generally adopts an optical waveguide structure.
Currently, the virtual image positions of the head-mounted display device are the same when different users wear the head-mounted display device, and the distance between the head-mounted display device and the users is also a fixed distance, so that the requirements of the users for different virtual image positions and virtual image distances are difficult to meet.
Disclosure of Invention
In order to solve the above problems, an embodiment of the present application provides an optical device, including an optical display module, where the optical display module includes a first image source component and a first optical waveguide structure; and, in addition, the processing unit,
when the first image source component has a first position, the light which is incident to the first optical waveguide structure corresponding to the first image source component has a first included angle with the first optical waveguide structure, the optical display module has a first virtual image position,
when the first image source component has a second position, the light which is incident to the first optical waveguide structure corresponding to the first image source component has a second included angle with the first optical waveguide structure, and the optical display module has a second virtual image position.
In this embodiment of the present application, the first image source component may be an optical machine, for convenience of explanation, in some embodiments, an included angle between a light ray incident on the first optical waveguide structure by the first image source component and the first optical waveguide structure in this embodiment of the present application may be defined, and the included angle between the first image source component and the first optical waveguide structure is consistent, that is, an angle of a light ray emitted by the image source component is consistent with an angle of the first image source component, and when a position of the image source component is changed, a position of a light ray emitted by the image source component is also changed.
In this embodiment of the present application, the first image source component may be adjusted to be incident to the light of the first optical waveguide structure by adjusting the position of the first image source component, and the included angle between the first optical waveguide structure is changed, so that the position of the virtual image formed by the optical display module is changed, and the requirement of the user on different virtual image positions can be met.
In some embodiments, the position of the first optical waveguide structure may be adjusted to achieve that the angle between the light incident on the first optical waveguide structure by the first image source component and the first optical waveguide structure is changed, so that the position of the virtual image formed by the optical display module is changed.
It can be appreciated that the optical device provided in this embodiment of the present application may be a wearable display device such as AR glasses, or may be another device, for example, a vehicle-mounted head-up display, where the first image source assembly may be fixed on an automobile, and the first optical waveguide structure may be embedded in a position such as a windshield of the automobile.
It is understood that in the embodiments of the present application, the first position and the second position merely represent different two positions. The first virtual image position and the second virtual image position are also representative of different two virtual image positions.
In some embodiments, the optical display module has the first virtual image position when the first image source assembly has a first position relative to the first optical waveguide structure, and,
when the first image source component has a second position relative to the first optical waveguide structure, the optical display module has the second virtual image position.
In some embodiments, the optical device further comprises:
and the display angle adjusting assembly is used for adjusting the relative position of the first image source assembly relative to the first optical waveguide structure.
In the embodiment of the application, the display angle adjusting component may be used for adjusting the position of the first image source component.
In this embodiment, the display angle adjusting component may be any of the display angle adjusting components for adjusting the position of the optical machine described in the following embodiments.
In some embodiments, the display angle adjustment assembly is coupled to the first image source assembly, and the display angle adjustment assembly adjusts the relative position of the first image source assembly with respect to the first optical waveguide structure by moving the first image source assembly.
In some embodiments, the optical device further comprises:
And the waveguide angle adjusting assembly is used for adjusting the relative position of the first image source assembly relative to the first optical waveguide structure by moving the first optical waveguide structure.
In this embodiment of the present application, the waveguide angle adjustment assembly may be used to adjust the position of the first optical waveguide structure, and specifically, the waveguide angle adjustment assembly may be configured to be a bendable structure for an intermediate frame between the right lens frame and the left lens frame mentioned in the following embodiment, or, a connection portion between the left lens frame and/or the right lens frame and the intermediate frame is configured to be a rotatable structure.
The waveguide angle adjustment assembly may also be a nose pad and a second adjustment assembly as shown in fig. 18.
In some embodiments, the optical device further comprises a second image source assembly and a second optical waveguide structure; and, in addition, the processing unit,
when the first image source component has a first position relative to the first optical waveguide structure and the second image source component has a third position relative to the second optical waveguide structure, a virtual image formed by the light incident from the first image source component to the first optical waveguide structure and the light incident from the second image source component to the second optical waveguide structure has the first virtual image position,
When the first image source component has a second position relative to the first optical waveguide structure and the second image source component has a fourth position relative to the second optical waveguide structure, a virtual image formed by the light incident on the first optical waveguide structure by the first image source component and the light incident on the second optical waveguide structure by the second image source component has the second virtual image position.
In this embodiment of the present application, in an optical device, two image source assemblies and two optical waveguide structures may be further disposed, and adjustment of the relative positions of the two image source assemblies and the two optical waveguide structures is respectively adjusted, so as to implement adjustment of a virtual image position and a virtual image distance of the optical device.
In some embodiments, the optical device is AR glasses.
In some embodiments, the AR glasses further comprise a frame first lens and a second lens;
the glasses frame comprises a first glasses frame, a second glasses frame, a first glasses leg and a second glasses leg;
the first lens includes the first optical waveguide structure.
In this embodiment of the application, first lens and second lens can be right lens and left lens respectively, and first mirror leg and second mirror leg can be right mirror leg and left mirror leg respectively. The first optical waveguide structure may be an optical waveguide structure mentioned in the later embodiments. The first image source assembly may be a light engine that emits light to the right lens hereinafter, and the second image source assembly may be a light engine that emits light to the left lens hereinafter.
In some embodiments, the AR glasses further comprise a first angle adjustment assembly connecting the frame and the first image source assembly for adjusting the first image source assembly from the first position to the second position.
In some embodiments, the first angle adjustment assembly is disposed on the first temple or the first frame.
In some embodiments, the AR glasses further comprise a second image source assembly, a second optical waveguide structure, and a second angle adjustment assembly;
the second lens comprises the second optical waveguide structure, and the second angle adjusting component is connected with the frame and the second image source component and used for adjusting the second image source component from a third position to a fourth position.
In this embodiment of the present application, the first angle adjustment assembly and the second angle adjustment assembly may be display angle adjustment assemblies for adjusting positions of the left temple or the left frame glazing machine in the following embodiments, and the second angle adjustment assembly may be display angle adjustment assemblies for adjusting positions of the right temple or the right frame glazing machine in the following embodiments.
In some embodiments, where the first image source assembly has the first position and the second image source assembly has the third position, a virtual image of light incident on the first light guide structure by the first image source assembly and light incident on the second light guide structure by the second image source assembly has the first virtual image position, and,
When the first image source component has the second position and the second image source component has the fourth position, a virtual image formed by the light rays incident on the first optical waveguide structure by the first image source component and the light rays incident on the second optical waveguide structure by the second image source component has the second virtual image position.
In some embodiments, the second angle adjustment assembly is disposed on the second temple or the second frame.
In some embodiments, the first angle adjustment assembly includes a first fixed lever and a first rotating structure, wherein,
the first end of the first fixing rod is fixed on the first glasses leg or the first glasses frame, and the first image source component is arranged at the second end of the first fixing rod through the first rotating structure.
In this embodiment, the first fixing rod may refer to a third fixing arm for connecting the optical machine to the right temple or the right frame in the following embodiment, and the first rotating structure may refer to a rotating structure between the optical machine and the third fixing rod in the following embodiment.
In some embodiments, the second angular adjustment assembly includes a second fixed rod and a second rotational structure, wherein,
The first end of the second fixing rod is fixed on the second glasses leg or the second glasses frame, and the second image source assembly is arranged at the second end of the second fixing rod through the second rotating structure.
In this embodiment, the second fixing rod may refer to a fixing arm for connecting the optical machine to the left temple or the left frame in the following embodiments.
In this embodiment of the present application, the first fixing rod and the second fixing rod may be elastic and bendable structures, for example, made of metal materials, or may be rotating arms mentioned later, and when the user wants to adjust the angle of the optical machine, the position adjustment of the optical machine may be achieved by manually snapping the first fixing rod and the second fixing rod. The operation is more convenient.
In some embodiments, the first or second rotational structure comprises a universal joint.
In this embodiment of the present application, the first rotating structure or the second rotating structure may be universal joints, and may be other structures capable of realizing multi-angle rotation.
In some embodiments, the first angle adjustment assembly includes a first fixed rod, a first rotating structure, a first driving structure, and at least one first telescoping structure;
The first end of the first fixing rod is fixed on the first glasses leg or the first glasses frame, and the first image source component is arranged at the second end of the first fixing rod through the first rotating structure;
one end of each first telescopic structure of the at least one first telescopic structure is connected with different positions of the first image source assembly, and the other end of each first telescopic structure of the at least one first telescopic structure is connected with the first driving structure;
the first driving structure can drive the first telescopic structure to extend and shorten so as to drive the first image source assembly to rotate around the first fixing rod in the corresponding direction.
In some embodiments, the second angular adjustment assembly includes a second fixed rod, a second rotational structure, a second drive structure, and at least one second telescoping structure;
the second end of the second fixing rod is fixed on the second glasses leg or the second glasses frame, and the second image source assembly is arranged at the second end of the second fixing rod through the second rotating structure;
one end of each second telescopic structure of the at least one second telescopic structure is connected with different positions of the second image source assembly, and the other end of each second telescopic structure of the at least one second telescopic structure is connected with the second driving structure;
The second driving structure can drive the second telescopic structure to extend and shorten so as to drive the second image source assembly to rotate around the second fixing rod in the corresponding direction.
In this embodiment of the present application, the first telescopic mechanism and the second telescopic mechanism may be telescopic structures mentioned in the embodiments below. The first driving structure and the second driving structure may be electric motors mentioned in the later embodiments.
In some embodiments, the first telescopic structure comprises a first sleeve and a second sleeve, one end of the first sleeve is connected with the first image source component, the other end of the first sleeve is sleeved inside or outside the second sleeve, and the other end of the first sleeve is connected with the driving structure;
or, the second telescopic structure comprises a third sleeve and a fourth sleeve, one end of the third sleeve is connected with the first image source assembly, the other end of the fourth sleeve is sleeved inside or outside the third sleeve, and the other end of the third sleeve is connected with the second driving structure.
In this embodiment, the first sleeve and the second sleeve may be an inner sleeve and an outer sleeve of the telescopic structure mentioned in the later embodiments, respectively. The third sleeve and the fourth sleeve may also be an inner sleeve and an outer sleeve, respectively, as mentioned in the embodiments below.
In some embodiments, the first image source component is provided with a first connecting column corresponding to the first telescopic structures on the side surface, and one end of the first sleeve of each first telescopic structure is provided with a first connecting ring; the first connecting ring is sleeved outside the first connecting column;
or, the side surface of the second image source assembly is provided with second connecting columns with the number corresponding to the second telescopic junctions, and one end of the third sleeve of each second telescopic structure is provided with a second connecting ring; the second connecting ring is sleeved outside the second connecting column.
In this application embodiment, the stability in the rotatory in-process of ray apparatus can effectively be strengthened in the setting of go-between and spliced pole.
In some embodiments, the inner diameter of the first connection ring is equal to the outer diameter of the first connection post; alternatively, the inner diameter of the first connection ring is larger than the outer diameter of the first connection post;
or, the inner diameter of the second connecting ring is equal to the outer diameter of the second connecting column; alternatively, the inner diameter of the second connecting ring is larger than the outer diameter of the second connecting post.
In this embodiment, the inner diameter of the first connecting ring is larger than the outer diameter of the first connecting column, which can effectively avoid the situation that the angle of the optical machine is adjusted due to the fact that the user touches the first key or the second key in the later embodiment by mistake. That is, in some embodiments of the present application, the angle of the optical machine is changed only when the user triggers the first key or the second key for the second time. In the same way, the inner diameter of the second connecting ring is larger than the outer diameter of the second connecting column, and the beneficial effects are achieved.
In some embodiments, a first stop is provided at an end of the first connection post not connected to the first image source assembly;
or, one end of the second connecting column, which is not connected with the second image source assembly, is provided with a second stop part.
In this embodiment of the application, be equipped with first backstop portion at the one end of first spliced pole that is not connected with first image source subassembly can prevent effectively that first go-between from breaking away from on the first spliced pole. The second stopping part is arranged at one end of the second connecting column which is not connected with the second image source component, so that the second connecting ring can be effectively prevented from being separated from the second connecting column.
In some embodiments, one end of the first sleeve of each first telescopic structure is connected with the bottom surface of the first image source component, wherein the bottom surface of the first image source component is opposite to the light emergent surface of the first image source component;
one end of the third sleeve of each second telescopic structure is connected with the bottom surface of the second image source assembly, wherein the bottom surface of the second image source assembly is opposite to the light emitting surface of the second image source assembly.
In some embodiments, the optical device further comprises a processor and a sensing means;
The sensing device is used for sending the first position change information to the controller when detecting that the position of the first image source component relative to the first optical waveguide structure deviates from a first set position; when the position of the second image source component relative to the second optical waveguide structure is detected to deviate from a second set position, sending second position change information to a controller;
the processor is used for controlling the position of the first image source component relative to the first optical waveguide structure to return to the first set position according to the first position information; and controlling the position of the second image source component relative to the second optical waveguide structure to return to the second set position according to the second position information.
In this embodiment, the sensor device may be a sensor mentioned later, and the sensor and the processor may cooperate to control the position of the image source component relative to the first optical waveguide structure to return to the set position. Thereby the position of the virtual image can be controlled to return to the set position more intelligently.
In some implementations, the optical device further includes a processor;
the processor is configured to:
acquiring a voice instruction of a user;
Controlling the position of the first image source component relative to the first optical waveguide structure to be a set position corresponding to the voice command according to the voice command; and/or; and controlling the position of the second image source component relative to the second optical waveguide structure to be a set position corresponding to the voice command.
In some implementations, the optical device further includes a processor; the processor is configured to:
acquiring an eye image of a user;
determining the gaze point position of the user according to the eye image of the user;
and adjusting the relative position of the first image source component relative to the first optical waveguide structure and/or the relative position of the second image source component relative to the second optical waveguide structure according to the gaze point position and the gaze depth of the user, so that the virtual image position of the optical display module is positioned at the gaze point position of the user.
In this embodiment of the application, the optical device may automatically adjust the virtual image position according to the gaze point position and the gaze depth of the user, so as to more intelligently match the requirement of the user.
In some embodiments, the optical device further comprises a nose pad, a height adjustment assembly, and an intermediate frame;
the middle mirror frame is arranged between the first mirror frame and the second mirror frame;
The two ends of the nose pad are respectively connected with the first mirror frame and the second mirror frame;
the nose pad can move away from or close to the middle mirror frame through the height adjusting assembly, and when the nose pad has a first height relative to the middle mirror frame, the first image source assembly has the first position, and when the nose pad has a second height relative to the middle mirror frame, the first image source assembly has the second position.
In some embodiments, the height adjustment assembly comprises a stud secured to the nose pad;
the middle mirror frame is provided with threaded holes matched with the studs.
The embodiment of the application also provides an imaging control method of the optical device, which comprises the following steps:
acquiring an eye image of a user wearing the optical device, the eye image comprising at least one eye of the user;
acquiring gaze point information of the user based on the eye image, the gaze point information including at least one of a gaze point position and a gaze point depth;
and adjusting the virtual image position imaged by the optical device according to the gaze point information.
In some embodiments, the optical device is AR glasses.
In some embodiments, the optical device includes an optical display module including a first image source assembly and a first optical waveguide structure;
the adjusting the virtual image position imaged by the optical device according to the gaze point information includes:
and adjusting the position of the virtual image imaged by the optical device by adjusting the relative position of the first image source component and the first optical waveguide structure according to the fixation point information.
Or,
and according to the fixation point information, adjusting the imaging virtual image position of the optical device by adjusting the direction of the light rays emitted by the first image source assembly.
In some embodiments, the optical device includes an optical display module including a first image source assembly, a first optical waveguide structure, a second image source assembly, and a second optical waveguide structure;
the adjusting the virtual image position imaged by the optical device according to the gaze point information includes:
according to the fixation point information, adjusting the relative positions of the first image source component and the first optical waveguide structure of the optical device and the relative positions of the second image source component and the second optical waveguide structure to realize adjustment of the imaging virtual image position of the optical device;
Or,
according to the fixation point information, the direction of the light rays emitted by the first image source component of the optical device and the direction of the light rays emitted by the second image source component are adjusted, so that the position of the virtual image imaged by the optical device is adjusted.
The imaging control method of the optical device provided by the embodiment of the application can be used for the optical device, such as AR glasses, mentioned above. According to the imaging control method of the optical device, the position of the optical machine relative to the lens can be automatically adjusted, for example, the gazing point position and gazing depth of the human eye can be automatically identified by the AR glasses, and then the position of the optical machine relative to the lens is automatically adjusted, so that the virtual image position is adjusted to the gazing point position of the human eye, and the virtual image distance is matched with the gazing depth of the human eye. The gaze point location may include, among other things, the gaze point direction and the specific location of the gaze point.
In addition, in some embodiments, the AR glasses may also automatically identify the gaze point position and gaze depth of the human eye, and then adjust the virtual image position to the gaze point position of the human eye through an image processing related algorithm without adjusting the position of the optical machine relative to the lens to achieve the adjustment of the virtual image position.
In some embodiments, the AR glasses may also automatically identify the gaze point position and gaze depth of the human eye and by changing the exit direction of the light rays in the light engine without changing the position of the light engine such that the virtual image distance matches the gaze depth of the human eye by adjusting the virtual image position to the gaze point position of the human eye.
Therefore, the optical device can be directly and intelligently matched with the requirements of the user without manual operation, and the virtual image position is adjusted to the position required by the user.
Drawings
FIG. 1a illustrates a schematic structural view of an optical waveguide, according to some embodiments of the present application;
FIG. 1b illustrates a schematic representation of the propagation of light within an optical waveguide, according to some embodiments of the present application;
FIG. 2 illustrates a schematic structural diagram of AR eyewear, according to some embodiments of the present application;
fig. 3a to 3e are schematic diagrams showing changes in virtual image positions caused by different angles between outgoing light rays of an optical machine and lenses in a monocular AR glasses according to some embodiments of the present application;
FIG. 4a illustrates a schematic diagram of the structure of an AR pair of glasses, according to some embodiments of the present application;
FIG. 4b illustrates a schematic diagram of the connection structure of a first and second fixed arm of AR glasses, according to some embodiments of the present application;
FIG. 4c illustrates a schematic diagram of a display angle adjustment assembly for AR glasses, in accordance with some embodiments of the present application;
FIG. 4d illustrates a schematic diagram of a display angle adjustment assembly for AR glasses, in accordance with some embodiments of the present application;
FIG. 4e illustrates a schematic diagram of a display angle adjustment assembly for AR glasses, in accordance with some embodiments of the present application;
FIG. 4f illustrates a schematic diagram of the structure of an AR pair of glasses, in accordance with some embodiments of the present application;
FIG. 4g illustrates a schematic diagram of a configuration of a temple folded state of AR glasses, in accordance with some embodiments of the present application;
FIG. 4h illustrates a schematic diagram of the structure of an AR eyewear, in accordance with some embodiments of the present application;
FIG. 4i illustrates a schematic diagram of a configuration of a temple folded state of AR glasses, in accordance with some embodiments of the present application;
FIG. 5 illustrates a schematic diagram of a configuration of a temple folded state of AR glasses, according to some embodiments of the present application;
FIG. 6a illustrates a schematic diagram of a display angle adjustment assembly for AR glasses, according to some embodiments of the present application;
FIG. 6b is a schematic diagram of the contact location of the bottom of the optical bench with the telescoping structure of an AR glasses according to some embodiments of the present application;
FIG. 6c illustrates a schematic view of the contact location of the bottom of the ray apparatus and the telescoping structure of AR glasses according to some embodiments of the present application;
FIG. 6d is a schematic diagram of the contact location of the bottom of the optical bench and the telescopic structure of AR glasses according to some embodiments of the present application;
FIG. 7 illustrates a schematic diagram of a display angle adjustment assembly for AR glasses, in accordance with some embodiments of the present application;
FIG. 8 illustrates a schematic diagram of a display angle adjustment assembly for AR glasses, in accordance with some embodiments of the present application;
FIG. 9a illustrates a schematic diagram of a display angle adjustment assembly for AR glasses, in accordance with some embodiments of the present application;
FIG. 9b illustrates a schematic view of a connection ring and connection post of AR glasses, according to some embodiments of the present application;
FIG. 9c illustrates a schematic view of a connection ring and connection post of AR glasses, according to some embodiments of the present application;
FIG. 10a illustrates a schematic diagram of a display angle adjustment assembly for AR glasses, according to some embodiments of the present application;
FIG. 10b illustrates a partial structural schematic view of a display angle adjustment assembly of AR glasses in accordance with some embodiments of the present application;
FIG. 11 illustrates a schematic structural diagram of AR glasses, according to some embodiments of the present application;
FIG. 12 illustrates a schematic representation of virtual image positions of AR glasses in accordance with some embodiments of the present application;
FIG. 13 illustrates a schematic representation of virtual image positions of AR glasses in accordance with some embodiments of the present application;
FIG. 14 illustrates a schematic representation of virtual image positions of AR glasses in accordance with some embodiments of the present application;
fig. 15 illustrates a schematic representation of a change in virtual image position of AR glasses according to some embodiments of the application;
FIG. 16 illustrates a schematic representation of virtual image positions of AR glasses in accordance with some embodiments of the present application;
FIG. 17 illustrates a schematic representation of virtual image positions of AR glasses in accordance with some embodiments of the present application;
FIG. 18 illustrates a schematic diagram of the structure of a nose pad of AR glasses, according to some embodiments of the present application;
FIG. 19 is a schematic diagram showing the relative positions of the outgoing light rays of the optical machine and the incoupling grating of the AR glasses according to some embodiments of the present application;
fig. 20 illustrates a hardware architecture diagram of AR glasses, according to some embodiments of the present application.
Reference numerals:
100-optical waveguide; a 101-waveguide substrate; 102-coupling in a grating; 103-coupling out a grating; 400-ray machine;
21-left temple; 22-right temple; 221-a main board; 23-left mirror frame; 24-right frame; 25-left lens; 26-right lens; 27-left fold configuration; 28-right fold configuration; 281-a first fixed arm; 282-a second fixed arm; 283-spindle; 291-third fixed arm; 2911-a rotating arm; 292-a rotating structure; 2921-ball sleeve; 2922-ball head; 293-inner sleeve; 294-outer sleeve; 295-an electric motor; 296-first key; 297 a second key;
404-a printed circuit board; 401-a connecting ring; 402-connecting columns; 403-stop; 5-a nose pad; 51-stud.
Detailed Description
Further advantages and effects of the present application will be readily apparent to those skilled in the art from the present disclosure, by describing embodiments of the present application with specific examples.
While the description of the present application will be presented in conjunction with some embodiments, it is not intended that the features of this application be limited to only this embodiment. Rather, the purpose of the description presented in connection with the embodiments is to cover other alternatives or modifications, which may be extended by the claims based on the present application. The following description contains many specific details in order to provide a thorough understanding of the present application. The present application may be practiced without these specific details. Furthermore, some specific details are omitted from the description in order to avoid obscuring the focus of the application. It should be noted that, in the case of no conflict, the embodiments and features in the embodiments may be combined with each other.
It should be noted that, in the description of the embodiments of the present application, it should be noted that, unless explicitly specified and defined otherwise, the terms "mounted", "connected" and "connected" should be interpreted broadly, and for example, "connected" may be either detachably connected or non-detachably connected; may be directly connected or indirectly connected through an intermediate medium. In this specification, like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures. In the description of the present application, it should be noted that the directions or positional relationships indicated by the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. are based on the directions or positional relationships shown in the drawings, are merely for convenience of description of the present application and to simplify the description, and do not indicate or imply that the devices or elements referred to must have a specific orientation, be configured and operated in a specific orientation, and thus should not be construed as limiting the present application. Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
In the embodiment of the present application, "and/or" is merely an association relationship describing an association object, and indicates that three relationships may exist, for example, a and/or B may indicate: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" herein generally indicates that the front and rear associated objects are an "or" relationship.
It will be appreciated that a head mounted display device is a device that transmits optical signals to the eye through various head displays, and may achieve different effects such as Virtual Reality (VR), augmented Reality (Augmented Reality, AR), mixed Reality (MR), and the like.
In order to facilitate understanding of the technical solutions of the present application, taking AR glasses in a head-mounted display device as an example, some technical terms, optical elements and related principles involved in the present application are described. It can be understood that the technical scheme of the application is applicable to other near-to-eye Display devices based on optical waveguide technology, such as a Head Up Display (HUD) and the like, besides being applied to a Head-mounted Display device, by proper structural adjustment.
For ease of understanding, some of the basic elements referred to in this application are first described.
And (one) an optical waveguide:
wherein the optical waveguide (optical waveguide) is a dielectric device, also known as a dielectric optical waveguide, that guides the propagation of light waves therein. In some embodiments, an optical waveguide refers to an optical element that utilizes the principle of total reflection to guide the propagation of light waves in its own right for total reflection. A common waveguide substrate may be a guiding structure composed of an optically transparent medium (e.g. quartz glass) that transmits electromagnetic waves at optical frequencies.
(II) diffraction optical waveguide
The diffractive optical waveguide is an optical element provided with a diffraction grating on a waveguide substrate.
The diffraction grating comprises a grating structure having a fixed period or a graded period. Wherein, the grating structure with fixed period is an optical device which is generally composed of a plurality of parallel slits with equal width and equal spacing; grating structures with graded periods are typically optical devices consisting of parallel slits of unequal width or unequal spacing. The light irradiated onto the diffraction grating can change the propagation direction by diffraction of the diffraction grating.
In some embodiments, the diffractive optical waveguide includes an in-coupling grating and an out-coupling grating; in other embodiments, the diffractive optical waveguide may include a relay grating in addition to the in-coupling and out-coupling gratings. Wherein the coupling-in grating may be used to couple light incident on the coupling-in grating into the waveguide substrate; the out-coupling grating may be used to couple light in the waveguide substrate incident on the out-coupling grating out of the waveguide substrate; the relay grating can be positioned between the coupling-in grating and the coupling-out grating, can be used for changing the propagation direction of light rays incident on the relay grating, and can guide the light rays to propagate towards the direction of the coupling-out grating, so that the exit pupil expansion of the diffraction optical waveguide in different directions is realized.
In the embodiments of the present application, the diffractive optical waveguide including only the coupling-in grating and the coupling-out grating is described as an example.
In the embodiment of the present application, for convenience of explanation, a direction from the right eye to the left eye of the user is defined as a positive direction of the X axis; defining a vertical direction perpendicular to the X-axis direction and from the foot to the top of the head of the user as a positive direction of the Y-axis; the direction perpendicular to the X-axis direction and from the front of the user's body to the back of the body is defined as the positive direction of the Z-axis.
For example, as shown in fig. 1a, the optical waveguide 100 may be a diffractive optical waveguide, and the optical waveguide 100 may comprise a waveguide substrate 101, an in-coupling grating 102 for coupling light into the waveguide substrate 101, and an out-coupling grating 103 for coupling light out of the waveguide substrate 101.
As shown in fig. 1b, after the light i1 emitted from the optical engine 400 enters the coupling grating 102, the original propagation direction is changed by diffraction of the coupling grating 102, and the light is directed to the bottom of the waveguide substrate 101. Based on the characteristics of the waveguide substrate 101, the light ray i1 coupled into the waveguide substrate 101 via the coupling-in grating 102 can be propagated by total reflection between the upper and lower surfaces of the waveguide substrate 101 with the positive direction of the X-axis as the guiding direction. During the process of total reflection propagation in the waveguide substrate 101, when the light ray i1 is incident on the D1 position of the coupling-out grating 103 on the surface of the waveguide substrate 101, a part of the light ray i11 is released through diffraction of the coupling-out grating 103. While the rest of the light i12 continues to be totally reflected and propagated in the waveguide substrate 101, and the light i12 propagated by total reflection repeats the above-mentioned phenomenon when being incident on the coupling-out grating 103 on the surface of the waveguide substrate 101 during the subsequent propagation. Wherein the light coupled out by the coupling-out grating 103 is able to enter the human eye and form a virtual image.
It will be appreciated that the position of the virtual image is related to the direction of the light coupled out by the coupling-out grating 103 into the human eye. When the light coupled out of the coupling-out grating 103 vertically enters the human eye, the virtual image is located right in front of the human eye's line of sight. When the light coupled out of the coupling-out grating 103 is inclined to the left or right and enters the human eye, the virtual image is located at a corresponding right or left position right in front of the human eye's line of sight. The direction of the light out of the coupling-out grating 103 is related to the direction of the light emitted from the optical machine 400 incident on the coupling-in grating.
(III) AR glasses
The AR glasses include monocular AR glasses and binocular AR glasses. In the AR glasses for monocular display, at least part of the area of one of the two lenses adopts an optical waveguide structure; in the binocular display AR glasses, at least part of the areas of both lenses adopt an optical waveguide structure. In addition, AR glasses typically also include a light engine for projecting image light. The light emitted by the optical machine can be led in on the coupling-in grating of the lens of the AR glasses and led out into the human eye at the coupling-out grating position of the lens, so that a user can see a virtual image corresponding to the image.
A schematic diagram of the AR glasses 10 in some embodiments is shown in fig. 2, and as shown in fig. 2, the AR glasses 10 may include a frame portion, a lens portion, and a light engine 400.
It will be appreciated that in the drawings of the embodiments of the present application, a circle may be provided with a dot to indicate a direction perpendicular to the paper surface, for example, in fig. 2, a positive direction of a Y axis indicated by a circle provided with a dot is a direction perpendicular to the paper surface. And the direction perpendicular to the paper surface is shown as an inward direction by arranging an "x" in a circle, for example, in fig. 6b-6d, the positive direction of the Z-axis is shown as an outward direction perpendicular to the paper surface by arranging a dot in a circle.
Wherein the frame portion can include a left temple 21 and a right temple 22 and the lens portion can include a left lens 25 and a right lens 26. At least one of the left lens 25 and the right lens 26 may employ an optical waveguide structure, for example, in fig. 2, a schematic structural diagram of the AR glasses 10 is shown by taking the diffractive optical waveguide structure as an example of the right lens 26. Wherein the optical engine 400 is fixed in front of the right lens 26, for example, in the negative direction of the Z-axis. It is understood that the optical waveguide structures mentioned in the embodiments of the present application are the same concept as the diffractive optical waveguides mentioned in the foregoing.
The light path of the light emitted by the optical engine 400 of the AR glasses 10 shown in fig. 2 in the right lens 26 made of the diffractive optical waveguide is as shown in fig. 1 a. Since the relative positions of the optical engine and the lens cannot be adjusted, the optical path of the light emitted by the optical engine 400 in the right lens 26 cannot be changed, and therefore, the direction of the light coupled out from the coupling-out grating on the right lens 26 cannot be changed, and therefore, the position of the virtual image is also in a fixed state, and thus, it is difficult to meet the requirements of users for different virtual image positions.
For example, in some cases where the light engine is fixed to the frame, the virtual image position is generally directly in front of the user's line of sight when the monocular display device is in use, and some users consider the virtual image to block the line of sight directly in front of the line of sight, affecting the view of the real world environment, and hopefully the virtual image is offset from directly in front of the line of sight, for example, in a left or right position directly in front of the line of sight. In this case, since the optical machine is fixed to the frame, it is difficult to adjust the position of the virtual image to the position of the virtual image required by the user.
As another example, when using a binocular display device, the distance between the virtual image and the line connecting the pupils of the human eye (hereinafter referred to as the virtual image distance) is generally fixed, but different virtual image distances may be required under different use scenarios to make the human eye more comfortable to view. For example, the virtual image distance may be adjusted to 0.5 to 1m when working or learning indoors, 3 to 5m when walking outdoors, and 5m or more when riding. At this time, the optical machine is fixed to the frame, so that the virtual image distance cannot be adjusted according to the scene.
As described above, for AR glasses, the position of the virtual image is related to the direction of the light coupled out by the coupling-out grating entering the human eye, so in order to solve the above-mentioned problem, the embodiment of the present application provides an AR glasses with an adjustable relative position between the optical machine and the lens, and the position of the virtual image or the distance of the virtual image is changed by changing the incident angle of the optical machine light entering the coupling-in grating on the lens. For example, in some embodiments, the optical machine of the AR glasses is fixed on the glasses leg through the display angle adjusting component, and the incident angle of the light emitted by the optical machine to the coupling-in grating on the lens can be adjusted by controlling the display angle adjusting component, so as to adjust the angle of the emergent light coupled out by the coupling-out grating, and finally, the adjustment of the virtual image position and the virtual image distance is achieved.
The angle between the emergent light emitted by the optical machine and the lens can be adjusted and regulated through the display angle regulating component in an all-around multi-angle manner, for example, the angle between the emergent light of the optical machine and the lens can be regulated in the X-axis direction (the direction of the connecting line between the user pupils) and the Y-axis direction (the direction perpendicular to the direction of the connecting line between the user pupils or the human height direction), so that the angle of the emergent light coupled out by the coupling-out grating can be regulated, and finally the position and the virtual image distance of a virtual image which can be seen by the human eye can be regulated.
Specifically, for example, when the emission direction of the light emitted from the light machine is changed in the X-axis direction, the change in the virtual image position represents the change in the X-axis direction, and when the emission direction of the light emitted from the light machine is changed in the Y-axis direction, the change in the virtual image position represents the change in the Y-axis direction.
Further, it is understood that in embodiments of the present application, the display angle adjustment assembly may be implemented by various mechanical structures, and that the user may manually adjust the display angle adjustment assembly to change the position of the light engine relative to the lens.
In some embodiments, the user may also change the position of the light engine relative to the lens by sending control instructions, such as voice control instructions, to the display angle adjustment component, which are executed by the display angle adjustment component.
In some embodiments, the AR glasses may also automatically adjust the position of the camera relative to the lenses, e.g., the AR glasses may automatically identify the gaze point position of the human eye, and then automatically adjust the position of the camera relative to the lenses such that the virtual image position is adjusted to the gaze point position of the human eye. In addition, in some embodiments, the AR glasses may also automatically recognize the gaze point position of the human eye, and then adjust the virtual image position to the gaze point position of the human eye through an algorithm related to image processing, without adjusting the position of the optical machine relative to the lens to achieve the adjustment of the virtual image position. And will be described in detail hereinafter.
In addition, it can be understood that in other embodiments of the present application, besides adjusting the position of the optical engine to change the position of the optical engine relative to the lens, the position of the optical engine relative to the lens can be changed by adjusting the position of the lens, so as to further adjust the virtual image position and the virtual image distance, which will be described in detail below.
In the following, the relationship between the angle between the outgoing light of the optical machine and the lens and the virtual image position imaged last in the embodiment of the present application will be described by taking the example of adjusting the angle between the outgoing light of the optical machine and the lens in the X-axis direction in the AR glasses 10 for monocular display.
Monocular optics principle
Fig. 3a to 3e show the principle of light rays that change the position of the virtual image due to the different angles between the outgoing light rays of the light machine 400 and the lenses in the case of the single-view AR glasses. The following describes the central chief ray of the outgoing light, and the light rays of other angles synchronously change with the central chief ray.
Fig. 3a-3c respectively show the change of the virtual image position in the horizontal direction caused by different angles between the outgoing light of the optical machine 400 and the lens in the monocular display AR glasses (as shown in fig. 4 a) with the left and right lenses in the same plane at different viewing angles. It is understood that the left lens and the right lens of the AR glasses 10 are in the same plane, that is, the surface of the left lens of the AR glasses 10 on which the coupling-out grating and the coupling-in grating are disposed and the surface of the right lens 26 on which the coupling-out grating and the coupling-in grating are disposed are in the same plane.
Specifically, as shown in fig. 3a and 3c, when the light ray i1 emitted from the optical engine 400 is perpendicular to the right lens (i.e., the first positional relationship between the optical engine 400 and the lens, the angle between the light ray i1 emitted from the optical engine 400 and the lens is the first angle), as shown in fig. 3a, the virtual image 300 is located right in front of the eye line.
As shown in fig. 3a and 3c, after the light ray i1 emitted by the optical engine 400 perpendicularly enters the coupling-in grating 101 of the right lens 26, that is, the light ray i1 emitted by the optical engine has an outgoing direction parallel to the normal P1 of the right lens 26, the original propagation direction is changed by diffraction of the coupling-in grating 101, and the light ray i1 is directed to the bottom of the waveguide substrate 101 at a diffraction angle a1, and then propagates through total reflection between the upper and lower surfaces of the waveguide substrate 101. During the process of total reflection propagation in the waveguide substrate 101, the light ray i1 still enters the D1 position of the coupling-out grating 103 on the surface of the waveguide substrate 101 at the incident angle a 1. At the D1 position, a portion of the light i11 is released by diffraction of the coupling-out grating 103, since the coupling-out grating 103 and the coupling-in grating 102 have the same diffraction parameters, i.e. the diffraction angle is the same when the light is incident through the coupling-in grating 102 and the coupling-out grating 103. Therefore, the light ray i11 still exits perpendicularly to the right lens 26. While the remaining part of the light i12 continues to propagate through the waveguide substrate 101 by total reflection, the light i12 propagating through total reflection repeats the above-mentioned steps when incident on the position on the coupling-out grating 103 on the surface of the waveguide substrate 101 during the subsequent propagation. Finally, the position of the imaged virtual image 300 is located directly in front of the eye's line of sight.
Unlike the position of the optical engine 400 in fig. 3a, fig. 3b shows a schematic view of the light propagation after the optical engine 400 is rotated by an angle a around the positive direction of the Y-axis X-axis by the display angle adjusting assembly, and it can be seen that the finally imaged virtual image 303 is deflected by an angle a around the negative direction of the Y-axis X-axis compared to the scene shown in fig. 3 a. That is, the optical engine 400 and the lens have a second positional relationship, and the angle between the light ray i1 emitted from the optical engine 400 and the lens is a second angle.
As shown in fig. 3b and 3c, after rotating the optical bench 400 by an angle a around the positive direction of the Y-axis X-axis, the light ray i1 enters the coupling-in grating 101 at an incident angle a, changes the original propagation direction by diffraction of the coupling-in grating 101, and is directed to the bottom of the waveguide substrate 101 at a diffraction angle a 2. Based on the characteristics of the waveguide substrate 101, the light ray i1 coupled into the waveguide substrate 101 via the coupling-in grating can propagate through total reflection between the upper and lower surfaces of the waveguide substrate 101. During the process of total reflection propagation in the waveguide substrate 101, the light ray i1 still enters the D1 position of the coupling-out grating 103 on the surface of the waveguide substrate 101 at the incident angle a 2. At the D1 position, a part of the light i11 is released by the diffraction of the coupling-out grating 103, and the coupling-out grating 103 is consistent with the diffraction parameter of the coupling-in grating, so that the exit angle of the light i11 is still the angle a to exit the coupling-out grating 103. While the rest of the light i12 continues to be totally reflected and propagated in the waveguide substrate 101, and the light i12 propagated by total reflection repeats the above-mentioned phenomenon when being incident on the coupling-out grating 103 on the surface of the waveguide substrate 101 during the subsequent propagation. The position of the final virtual image 303 is at a position offset by an angle a around the negative direction of the Y-axis X-axis directly in front of the human eye's line of sight.
In fig. 3a-3c, the change of the virtual image position is illustrated by taking the case that the left lens 25 and the right lens 26 of the AR glasses 10 are located in the same plane, and for the AR glasses 10 in which the left lens 25 and the right lens 26 are located in different planes, the angle between the outgoing light of the optical machine and the lenses is changed, so that the position of the virtual image formed finally can be changed.
Fig. 3d shows a change in the horizontal direction of the virtual image position caused by different angles between the outgoing light of the optical machine 400 and the lenses in a monocular AR eyeglass 10 with the left and right lenses in different planes. For example, referring to fig. 11, taking the angle a between the left lens 25 and the plane h1 perpendicular to the line of sight of the right lens 26 and the human eye directly ahead as an example, the optical engine 400 is disposed on the right temple 22, and the light ray i1 emitted from the optical engine 400 is perpendicular to the plane h1, the virtual image 300 finally imaged is located at the position of the line of sight P2 directly ahead of the human eye around the negative direction deflection angle 2a of the Y-axis X-axis. It will be appreciated that, for the monocular AR glasses shown in fig. 3d, the position of the virtual image 300 in the X-axis direction changes with the position of the optical machine 400, and the resulting change in the position in the X-axis direction can be referred to in fig. 3c.
Specifically, as shown in fig. 3d, if the incident light i1 enters the coupling-in grating 101 with the angle a between the incident light i1 and the normal P1 of the right lens 26, according to the principle that the light propagates in the waveguide substrate 101, the angle a between the exit angle of the light exiting the coupling-out grating 103 and the normal P1 is also the angle a, and the plane of the right lens 26 is the plane having the angle a with the plane h1, so the angle a between the normal P1 of the right lens 26 and the normal of the plane h1 is also the angle a, and therefore the angle 2a between the exit angle of the light exiting the coupling-out grating 103 and the eye straight ahead line of sight is the angle 2a, i.e. the virtual image 300 is located at the position of the eye straight ahead line of sight P2 around the negative direction of the Y axis X axis and deflected by the angle 2 a.
At this time, if the user desires the virtual image 300 to deflect to a position in front of the eye's line of sight in the positive direction of the Y-axis X-axis, the optical engine 400 may be rotated by an angle of 2a in the negative direction of the Y-axis X-axis; if the position of the virtual image 300 of the optical bench 400 is to be deflected in a negative direction about the Y-axis X-axis, the optical bench 400 can be adjusted to rotate in a positive direction about the Y-axis X-axis. In summary, the AR glasses 10 provided in the embodiments of the present application can realize the adjustment of the optical machine position under the condition of different glasses forms, thereby realizing the adjustment of the virtual image position.
It will be appreciated that although the optical principle of adjusting the angle between the incident light of the optical engine and the lens in the X-axis direction and thus the position of the virtual image in the X-axis direction is only shown, in the embodiments of the present application, the position of the optical engine may be adjusted from all directions, and the optical principle of adjusting the position of the virtual image is not limited to the X-axis direction and is the same. For example, when the angle between the incident light of the light machine and the lens is adjusted in the Y direction, for example, the human height direction, the virtual image position can be adjusted in the Y direction. For example, fig. 3e shows a change in the position of the virtual image in the vertical direction caused by a different angle between the incident light of the optical engine 400 and the right lens 26 in the case of the monocular AR glasses (as shown in fig. 4 a) with the left and right lenses in the same plane.
Specifically, as shown in fig. 3e, when the light machine 400 is perpendicular to the right lens 26, i.e. the light ray i1 emitted from the light machine 400 is perpendicular to the coupling-in grating 102 on the right lens 26, as in the optical principle of adjusting the virtual image position in the horizontal direction, the light ray i11 emitted from the coupling-out grating 103 is vertically incident into the human eye, i.e. the virtual image 300 finally imaged is located right in front of the human eye line. When the optical engine is rotated by an angle a around the positive direction of the X-axis and the Y-axis, the angle a between the light ray i3 emitted from the optical engine 400 and the normal of the right lens 26 is the angle a, and the angle a between the light ray i31 emitted from the coupling-out grating 103 and the normal of the right lens 26 is the angle a according to the optical principle of adjusting the virtual image position in the X-axis direction, that is, the virtual image 303 finally imaged is located at a position in front of the human eye line of sight and deflected by an angle a around the negative direction of the X-axis and the Y-axis.
It can be seen from the above-mentioned propagation process of the light, in the case that the diffraction parameters of the coupling-in grating and the coupling-out grating are identical, the angle at which the light is incident into the waveguide substrate and the angle at which the light is coupled out from the waveguide substrate are in a symmetrical relationship with respect to the normal of the plane of the waveguide substrate. The relationship between the light exit angle and the incident angle will not be described in detail.
In some embodiments, if the user wants to have the virtual image at a position just in front of the line of sight, some users may have a larger head circumference, and therefore may prop the temple open, so that the optical machine deviates from a position perpendicular to the lens, and thus the virtual image position seen by the user may deviate by a certain angle. At this time, the user can adjust the angle of the optical machine through the display angle adjusting component, so that the virtual image can still be positioned right in front of the user. Therefore, the AR glasses provided by the embodiment of the application can be used for users with different head sizes, and different requirements of the users on virtual image positions can be met.
Monocular display AR glasses 10
Based on the optical principle, a monocular AR glasses 10 with left and right lenses in the same plane according to the embodiment of the present application is described below with reference to fig. 4 a.
As shown in fig. 4a, AR eyeglass 10 can include a frame portion, a lens portion, a left folding mechanism 27, a right folding mechanism 28, a light engine 400, and a display angle adjustment assembly.
In some embodiments, the frame portion can include a left temple 21, a right temple 22, a left frame 23, and a right frame 24, and the lens portion can include a left lens 25 and a right lens 26. One of the left lens 25 and the right lens 26 may have an optical waveguide structure, and specifically, one of the left lens 25 and the right lens 26 may have an optical waveguide structure in the whole area or a part of the area, for example, in fig. 4a, a schematic structural diagram of the AR glasses 10 is shown by taking the optical waveguide structure as an example of the right lens 26.
In some embodiments, the left folding structure 27 and the right folding structure 28 may be the same structure, and the right folding structure 28 will now be described as an example. As shown in fig. 4b, the right folding structure 28 may include a first fixing arm 281, a second fixing arm 282, and a rotation shaft 283. One end of the first fixing arm 281 is fixed on the right frame 24, the other end of the first fixing arm 281 is connected with one end of the second fixing arm 282 through a rotating shaft 283, and the other end of the second fixing arm 282 is connected with the right temple 22. Folding and unfolding of the right temple 22 is accomplished by rotation of the second securing arm 282 about the pivot 283.
In some embodiments, the second fixed arm 282 and the right temple 22 may be connected by a connector; the second fixed arm 282 may be part of the right temple 22 in some embodiments.
It can be appreciated that in the embodiments of the present application, the display angle adjustment assembly may be a manual display angle adjustment assembly or an automatic display angle adjustment assembly. The following first illustrates an arrangement of a manual display angle adjustment assembly in some embodiments of the present application.
Manual display angle adjusting assembly
In some embodiments, as shown in fig. 4a and 4c, the display angle adjustment assembly may include a third fixed arm 291 and a rotating structure 292. One end of the third fixing arm 291 is fixed to the second fixing arm 282 of the right folding structure 28, and the optical bench 400 is fixed to the other end of the third fixing arm 291 through the rotating structure 292. The optical bench 400 can realize omnibearing multi-angle position adjustment through the rotating structure 292.
Fig. 5 shows a schematic view of the AR glasses shown in fig. 4a in a folded state of two legs. As shown in fig. 5, when the optical bench 400 is fixed to the second fixing arm 282 by the third fixing arm 291, the optical bench 400 is decoupled from the right frame 24, i.e., not connected to the right frame 24, but is changed in position as the right temple 22 is folded and unfolded.
In some embodiments, one end of the third fixing arm 291 may be further fixed to the first fixing arm 281 of the right folding structure 28, and the optical bench 400 is fixed to the other end of the third fixing arm 291 through the rotation structure 292.
In some embodiments, the rotating structure 292 in fig. 4c may be a universal joint as shown in fig. 4d, which may include a ball head 2922 and a ball socket 2921, wherein the ball head 2922 may be provided on the optical machine 400, the ball socket 2921 is provided on the third fixed arm 291, and the ball head 2922 may be snapped into the ball socket 2921 and perform 360 degree rotation within the ball socket 2921. In some embodiments, the rotating structure 292 in fig. 4c may be other structures that can achieve multi-angle rotation.
When the display angle adjusting assembly adopts the embodiment including the third fixing arm 291 and the rotating structure 292, if the user needs to adjust the position of the optical bench 400, the optical bench 400 can be directly manually turned to adjust the position of the optical bench 400.
In addition to the display angle adjustment assembly shown in fig. 4c and 4d, in some embodiments, a display angle adjustment assembly as shown in fig. 4e may be employed. As shown in fig. 4e, the display angle adjustment assembly may include a rotating arm 2911. The rotating arm 2911 may be made of a material that can be bent at multiple angles, such as a metal material, or the third fixing arm is formed by connecting a plurality of links that can rotate at multiple angles end to realize multiple-angle rotation of the rotating arm 2911. One end of the rotating arm 2911 is fixed to the second fixed arm 282, and the optical machine 400 is fixedly connected to the other end of the rotating arm 2911.
When the display angle adjusting assembly adopts the embodiment including the rotating arm 2911, the user may manually bend the rotating arm 2911 to rotate to adjust the position of the optical bench 400 when the user wants to adjust the angle of the optical bench 400.
In some embodiments, the third fixing arm 291 in fig. 4c may be replaced by a rotating arm 2911, and in this case, the position adjustment of the optical bench 400 may be achieved by manually pulling the rotating arm 2911 to rotate, or by manually pulling the optical bench 400 to rotate.
In some embodiments, as shown in fig. 4f, the optical unit 400 of the AR glasses is fixed on the right frame 24, and a flexible printed circuit board 404 (or other type of communication cable) for controlling the circuit of the optical unit 400 is connected to the main board 221 of the AR glasses in the right temple 22 through the rotation shaft 28.
In fig. 4f, the optical device 400 is fixed on the right lens frame 24, and the flexible printed circuit board 404 is connected to the main board 221 through the rotation shaft 28, so as shown in fig. 4g, the flexible printed circuit board 404 of the optical device 400 is folded along with the folding of the right lens leg 22. As such, as the time for which the user uses the AR glasses is longer, the number of times the right temple 22 is folded and unfolded increases, which may easily cause damage to the flexible printed circuit board 404.
Thus, when the optical device 400 is fixed to the second fixing arm 282 by the third fixing arm 291 as mentioned in fig. 4a, as shown in fig. 4h, the flexible printed circuit board 404 of the optical device 400 is connected to the main board 221 of the AR glasses without passing through the rotating shaft 28, so that, as shown in fig. 4i, when the right temple 22 is folded, any bending of the flexible printed circuit board 404 of the optical device 400 does not occur, and even if the right temple 22 is folded and unfolded for many times, the flexible printed circuit board 404 is not damaged.
It will be appreciated that for the display angle adjustment assembly, other structures than the embodiments mentioned in the above fig. 4c to 4i may be implemented, without being limited thereto, as long as a change in the position of the optical machine can be implemented.
Automatic display angle adjusting assembly
The following describes an arrangement scheme of the automatic display angle adjustment assembly in the embodiment of the present application.
For example, taking the example of the monocular AR glasses 10 shown in FIG. 4a, FIG. 6a illustrates an automatic display angle adjustment assembly. As shown in fig. 6a, in some embodiments of the present application, the automatic display angle adjustment assembly may include a third fixed arm 291, a rotating structure 292, an electric motor 295, a retractable structure, a first button 296, and a second button 297.
One end of the third fixing arm 291 is fixed to the second fixing arm 282, one side of the optical bench 400 is fixed to the other end of the third fixing arm 291 by the rotation structure 292, and the optical bench 400 can rotate around the third fixing arm 291 by the rotation structure 292.
The electric motor 295 may be provided in connection with the main board 221 of the AR glasses 10, and the main board 221 of the AR glasses 10 may be provided in the right temple 22 of the AR glasses.
In some embodiments, the telescopic structure may include a telescopic tube, which may include an outer tube 294 and an inner tube 293, where one end of the inner tube 293 is fixed to a position of a bottom center point of the optical bench 400 that is offset by a set distance along the X-axis negative direction or offset by a set distance along the X-axis positive direction, so as to enable the optical bench 400 to rotate around the negative direction of the Y-axis X-axis or the positive direction of the X-axis when the inner tube 293 moves along the Z-axis positive direction or along the Z-axis negative direction. The other end of the inner sleeve 293 is slidably connected to the inner wall of the outer sleeve 294, and the outer sleeve 294 is fixed to the electric motor 295. Wherein the electric motor 295 can control the inner sleeve 293 to move in the positive direction or the negative direction along the Z-axis along the inner wall of the outer sleeve 294, so as to drive one side of the optical machine 400 to move in the positive direction or the negative direction along the Z-axis. If one side of the optical bench 400 moves along the positive direction of the Z axis or along the negative direction of the Z axis, the optical bench 400 rotates around the negative direction of the X axis or toward the positive direction of the X axis, so as to adjust the angle of the outgoing light.
In some embodiments, the connection between the inner sleeve 293 and the optical bench 400 may be a clamping connection, an adhesive connection, a bolting connection, or the like.
The first button 296 and the second button 297 may be disposed on the right temple 22, and the first button 296 and the second button 297 are connected with the processor of the AR glasses 10, and the first button 296 and the second button 297 may be used for controlling the expansion structure to be elongated and shortened, respectively. It is understood that the processor of the AR glasses 10 may be a central processing unit, which is a control device for controlling all circuits and electronic devices in the AR glasses to operate normally. In other embodiments of the present application, separate processing devices may also be employed to receive control instructions from the first key 296 and the second key 297 to control operation of the electric motor 295.
It should be noted that, in the embodiment of the present application, the manner of controlling the extension and shortening of the telescopic structure by using the key is only an example, and the present application is not limited to other structures, for example, may be in the form of a knob or a virtual button. The positions of the first key 296 and the second key 297 can also be adjusted according to actual requirements. In this embodiment, the manner of controlling the extension and shortening of the telescopic structure may be that an entity key is not set, but a virtual key on the touch screen is set. In some embodiments, voice instructions, gesture instructions, etc. may also be used.
In the above embodiments, the automatic display angle adjustment assembly is described to achieve adjustment of the X-axis direction (pupil distance direction) of the virtual image position, and in some embodiments, adjustment of the Y-axis direction (human height direction) of the virtual image position or all-directional adjustment of the opto-mechanical position may be achieved in the same manner.
For example, in some embodiments, if the display angle adjusting component is used to implement the adjustment in the human body height direction of the virtual image position, that is, in the Y-axis direction, the display angle adjusting component is different from the above-described scheme for implementing the adjustment in the X-axis direction of the optical machine position in that the position where the top end of the inner sleeve is fixed to the bottom of the optical machine is different.
For example, in the display angle adjusting assembly for adjusting the X-axis direction of the virtual image position, as shown in the schematic view of the bottom of the optical bench 400 in fig. 6b, the center point of the position where the top end of the inner sleeve is fixed to the bottom of the optical bench 400 is offset by the position 002 of the set distance along the X-axis direction or the position 001 of the set distance along the X-axis direction (near the connecting end of the third fixing arm 291 and the optical bench 400), so as to realize that the inner sleeve can rotate around the negative direction of the Y-axis direction and the positive direction of the X-axis direction when moving along the Z-axis direction or along the negative direction of the Z-axis direction.
As shown in the schematic diagram of the bottom of the optical engine in fig. 6c, when the optical engine needs to rotate around the negative direction of the Y axis of the X axis or to the positive direction of the Y axis, the position where the top end of the inner sleeve is fixed to the bottom of the optical engine 400 may be the position 003 of the center point position at the bottom of the optical engine 400, which is offset by a set distance to the positive direction of the Y axis, or the position 004 of the inner sleeve, which is offset by a set distance to the negative direction of the Y axis, so as to drive the optical engine 400 to rotate around the positive direction of the Y axis of the X axis or to the negative direction of the Y axis when the inner sleeve moves along the positive direction of the Z axis or along the negative direction of the Z axis.
It can be appreciated that, in the embodiment of the present application, the fixing positions of the top end of the inner sleeve and the bottom of the optical bench 400 are all exemplary illustrations, and it can be appreciated that, in the embodiment of the present application, the fixing positions of the top end of the inner sleeve and the bottom of the optical bench 400 may be any positions that can drive the optical bench 400 to rotate around the negative direction of the X-axis Y-axis or to the positive direction of the Y-axis or drive the optical bench 400 to rotate around the negative direction of the Y-axis X-axis and to the positive direction of the X-axis when the inner sleeve is along the positive direction of the Z-axis or along the negative direction of the Z-axis.
In some embodiments, if the display angle adjustment assembly is used to achieve omnidirectional position adjustment of the virtual image position, two electric motors and two telescopic structures may be provided. The display angle adjusting component is different from the scheme for realizing left and right adjustment of the virtual image position in that: an electric motor and a telescopic structure are added.
As shown in fig. 6d, the fixed positions of the inner sleeves of the two telescopic sleeves are respectively positions 002 of the center point of the position where the top end of the inner sleeve of one telescopic structure is fixed at the bottom of the optical bench 400, which is offset by a set distance along the negative direction of the X-axis, so as to drive the optical bench 400 to rotate around the negative direction of the Y-axis and the positive direction of the X-axis when the inner sleeve moves along the positive direction of the Z-axis or along the negative direction of the Z-axis. The position of the top end of the inner sleeve with another telescopic structure fixed at the bottom of the optical bench 400 may be a position 003 offset from the center point position at the bottom of the optical bench 400 by a set distance in the positive direction of the Y axis, so as to drive the optical bench 400 to rotate around the positive direction of the Y axis or to rotate around the negative direction of the Y axis when the inner sleeve moves in the positive direction of the Z axis or in the negative direction of the Z axis.
It will be appreciated that in the solution of the display angle adjustment assembly for implementing an omni-directional adjustment of the position of the optical machine, the number of keys on the temple for controlling the extension and shortening of the telescopic structure may be four, for example, including a first key, a second key, a third key and a fourth key. Wherein the first key and the second key may be used to control the extension and shortening of one of the telescoping structures. In other embodiments, the third key and the fourth key may be used to control the extension and retraction of another telescoping structure.
The following briefly describes the working principle of the automatic display angle adjustment assembly in fig. 6a for rotating the optical machine in the X-axis direction:
as shown in fig. 7, when the user presses the first button 296, the processor receives an instruction for controlling the extension of the telescopic structure, and controls the electric motor 295 to drive the inner sleeve 293 to move in the negative Z-axis direction, when the inner sleeve 293 moves in the negative Z-axis direction, the right side of the bottom of the top-powered optical engine 400 can gradually move in the negative Z-axis direction, so as to drive the optical engine 400 to rotate around the third fixing arm 291 in the positive X-axis direction, thereby changing the angle of the outgoing light emitted by the optical engine 400 relative to the optical waveguide structure, and further changing the position of the virtual image formed by the AR glasses 10.
As shown in fig. 8, when the user presses the second key 297. The processor receives the instruction for controlling the telescopic structure to shorten, and controls the electric motor 295 to drive the inner sleeve 293 to move towards the positive direction of the Z axis, when the inner sleeve 293 moves towards the positive direction of the Z axis, the right side of the bottom of the optical bench 400 is pulled to gradually move towards the positive direction of the Z axis, so as to drive the optical bench 400 to rotate around the third fixing arm 291 towards the negative direction of the X axis, thereby changing the angle of emergent light emitted by the optical bench 400 relative to the optical waveguide structure, and further changing the position of a virtual image formed by the AR glasses 10.
In other embodiments, to further enhance stability during rotation of the optical bench 400, attachment structures may be provided on the opposite side of the third fixed arm 291 that is attached. As shown in fig. 9a, when the angle adjustment assembly is used to implement the rotation of the optical bench in the X-axis direction, a connection post 402 may be provided on the opposite side of the optical bench 400, which is not connected to the third fixing arm 291, and a connection ring 401 may be provided on the top end of the inner sleeve 293.
In some embodiments, when the angle adjustment assembly is shown to be used to effect rotation of the carriage in the Y-axis direction, the connecting post 402 in fig. 9a may be any adjacent side of the carriage 400 not connected to the third fixed arm 291.
It can be appreciated that in the embodiment of the present application, the above-mentioned scheme of implementing the rotation of the optical machine along the X-axis direction and the Y-axis direction by using the display angle adjusting assembly is only illustrative, and in the embodiment of the present application, the rotation of different angles of the optical machine can be implemented by adjusting the connection position of the telescopic tube at the bottom of the optical machine. The rotating direction of the optical machine can be the direction of the connecting line of the connecting position point of the telescopic tube at the bottom of the optical machine and the center point of the bottom of the optical machine.
Wherein, as shown in fig. 9b, the connection ring 401 may be sleeved on the connection post 402, and the inner diameter of the connection ring 401 may be equal to the outer diameter of the connection post 402. I.e. the connection ring 401 can just be sleeved on the connection post 402. At this time, the working principle of the automatic display angle adjusting assembly is as follows:
When the user presses the first button 296, the processor receives an instruction for controlling the extension of the telescopic structure, and controls the electric motor 295 to drive the inner sleeve 293 to move along the negative direction of the Z axis, and when the inner sleeve 293 moves along the negative direction of the Z axis, the right side of the bottom of the optical machine 400 can be driven to gradually move along the negative direction of the Z axis through the connecting ring 401 and the connecting post 402, so that the optical machine 400 is driven to rotate around the third fixing arm 291 in the positive direction of the x axis, thereby changing the angle of the emergent light emitted by the optical machine 400 relative to the optical waveguide structure, and further changing the position of the virtual image formed by the AR glasses 10.
When the user presses the second key 297, the processor receives an instruction for controlling the telescopic structure to shorten, and controls the electric motor 295 to drive the inner sleeve 293 to move in the positive direction of the Z axis, and when the inner sleeve 293 moves in the positive direction of the Z axis, the right side of the bottom of the optical machine 400 can be driven to gradually move in the positive direction of the Z axis through the connecting ring 401 and the connecting column 402, so that the optical machine 400 is driven to rotate around the third fixing arm 291 in the negative direction of the x axis, the angle of emergent light emitted by the optical machine 400 relative to the optical waveguide structure is changed, and the position of a virtual image formed by the AR glasses 10 is further changed.
In some embodiments, in order to effectively avoid the situation that the angle of the optical machine 400 is adjusted due to the user's mistakenly touching the first button 296 or the second button 297, as shown in fig. 9c, the inner diameter of the connection ring 401 may also be larger than the outer diameter of the connection post 402, that is, there is a gap between the connection ring 401 and the connection post 402, and the dimension L1 of the gap may be a distance that the first button 296 is clicked for stretching the stretching structure or a distance that the second button 297 is clicked for shortening the stretching structure. It is understood that the connection ring 401 and the connection post 402 may be coaxially disposed in the embodiment of the present application.
At this time, when the user clicks the first button 296, the telescopic tube is extended, the inner tube 293 moves along the negative direction of the Z-axis, and at this time, the lower ends of the connection ring 401 and the connection post 402 may be closely adjacent to or just contact with each other, but the optical engine 400 is not driven to rotate. When the user clicks the second button 297, the telescopic tube shortens, the inner tube 293 moves along the positive direction of the Z axis, and at this time, the upper ends of the connection ring 401 and the connection post 402 may be closely adjacent or just contact, but do not drive the optical engine 400 to rotate. The embodiment can effectively avoid the situation that the angle of the optical machine 400 is adjusted due to the fact that the user mistakenly touches the first key 296 or the second key 297. That is, in some embodiments of the present application, the user may change the angle of the optical engine 400 only when the first button 296 or the second button 297 is triggered for the second time.
In some embodiments, as shown in fig. 10a and 10b, a stop 403 may also be provided at an end of the connection post 402 not connected to the optical machine 400, where the stop 403 may prevent the connection ring 401 from sliding off the connection post 402, and in some embodiments, the stop 403 includes, but is not limited to, a stop plate or a nut.
It will be appreciated that for the first key 296 and the second key 297, in some embodiments, it may be provided that the telescoping structure is extended a set distance each time the first key 296 is pressed. For example, the processor controls the electric motor 295 to drive the inner sleeve 293 of the telescoping structure to extend 0.5mm in the negative Z-axis direction when the first button 296 is pressed a first time, and to extend the telescoping structure again 0.5mm in the negative Z-axis direction when the first button 296 is pressed a second time. In addition, the telescopic structure can be extended when the first key 296 is pressed for a long time, and the telescopic structure can be shortened when the second key 297 is pressed for a long time. Wherein, before reaching the limit distance by which the telescopic structure can be extended or shortened, the first key 296 is pressed for a time proportional to the distance by which the telescopic structure is extended, and the second key 297 is pressed for a time proportional to the distance by which the telescopic structure is shortened.
In addition to the above-mentioned key control telescopic structure solution, in other embodiments, an audio acquisition device, such as a microphone, may be provided on the monocular AR glasses 10, so that the user can control the position change of the optical machine 400 by giving a voice command. For example, when the user sends a voice command of "30 ° rotating leftwards", the microphone collects the voice command and sends the voice command to the processor of the monocular AR glasses 10, the processor recognizes the voice command, and then controls the electric motor 295 to drive the inner sleeve 293 of the telescopic structure to extend for a set length along the negative direction of the Z-axis according to the voice command, so as to realize 30 ° rotation of the optical machine 400 around the positive direction of the X-axis of the Y-axis.
In addition, in some embodiments, in order to enable the position of the virtual image to be located at an initial virtual image position set in the AR glasses when different users wear the AR glasses, for example, the initial virtual image position may be right in front of the line of sight of the eyes of the users, an induction structure may be provided on the glasses legs, for example, a sensor may be connected to a processor, the sensor may detect a deflection angle of the glasses legs from an initial state to a current state, and the processor may perform automatic adjustment of an optical-mechanical rotation angle according to the deflection angle of the glasses legs. So as to ensure that the included angle between the light emitted by the light machine and the lens returns to the initial position, and the position of the virtual image returns to the initial virtual image position arranged in the AR glasses.
For example, the optical machine is fixed on the right glasses leg, and the initial state is that the light rays emitted by the optical machine are vertical to the right glasses. When the sensor detects that the mirror leg is changed from the initial state to the current state, namely, the mirror leg deflects 5 degrees around the negative direction of the Y-axis X-axis, the processor can control the optical machine to rotate 5 degrees around the negative direction of the Y-axis X-axis, so that the included angle between the light emitted by the optical machine and the lens returns to the initial position. The scheme of controlling the rotation of the optical machine by the processor is shown above and will not be described herein.
In some embodiments, the AR glasses may also automatically adjust the position of the camera relative to the lenses according to the gaze point position and gaze depth of the human eye such that the position of the virtual image is adjusted to the gaze point position of the human eye and the virtual image distance matches the gaze depth of the human eye.
The manner in which the monocular AR glasses automatically adjust the position of the optical machine relative to the lenses according to the gaze direction of the eyes of the person may be as follows:
1) An eye image of a user is acquired.
For the monocular display AR glasses, a camera may be disposed in front of a lens having an optical waveguide structure, so as to capture an eye image of a user in real time, for example, if a right lens is a lens having an optical waveguide structure, the camera may be fixed on a right lens frame, so that the right eye image of the user is captured in real time.
2) And acquiring the gazing direction of the user according to the eye image of the user.
For example, in the embodiment of the present application, according to the fact that the camera may capture the right eye image of the user in real time, the AR glasses may process the right eye image of the user acquired in real time through some image processing algorithms or image recognition algorithms, so as to determine the gazing direction of the right eye of the user.
3) And adjusting the virtual image position imaged by the AR glasses according to the gazing direction of the user.
For example, according to the AR glasses provided in the embodiments of the present application, according to the real-time change of the gazing direction of the right eye of the user, the angle of the optical machine on the right temple is adjusted in real time, so that the virtual image position is adjusted to the gazing direction of the human eye.
For example, when a user wears the AR glasses, the AR glasses determine that the gazing direction of the right eye of the user is the right front position, for example, the first position, according to the right eye image of the user photographed by the camera, and at this time, the AR glasses can automatically adjust the angle of the right temple polishing machine so as to adjust the virtual image position to the right front position of the right eye of the user; when a period of time passes, the AR glasses determine that the gazing direction of the right eye of the user is the right front position of the right eye, for example, the second position according to the right eye image of the user photographed by the camera, and at this time, the AR glasses can automatically adjust the angle of the optical machine, so that the virtual image position is adjusted to the right front position of the right eye of the user.
In some embodiments, the camera may send the photographed right eye image of the user to the processor of the AR glasses, and the processor of the AR glasses may process the right eye image of the user according to an image processing algorithm or an image recognition algorithm, determine a gaze direction of the right eye of the user, and perform an optical-mechanical angle adjustment so as to adjust the virtual image position to the gaze direction of the human eye.
In some embodiments, the processor may further be provided with an algorithm model related to the determination of the gaze direction of the human eye, where the algorithm model may determine the gaze direction of the right eye of the user through the right eye image of the user, and perform an optical-mechanical angle adjustment, so as to adjust the virtual image position to the gaze direction of the human eye.
The solution of controlling the angle adjustment of the optical bench by the processor may adjust the angle of the optical bench based on the angle adjustment component mentioned in the embodiments of the present application as described above. For example, the processor may effect adjustment of the position of the light engine relative to the lens by controlling movement of the telescoping structure.
In some embodiments, the processor may also control the adjustment of the angle of the optical machine by adjusting the position of the lens.
In some embodiments, the processor may also control the rotation of the light engine directly through some algorithm program or adjust the outgoing direction of the light in the light engine without adjusting the position of the light engine. But may be any other scheme in some embodiments.
The monocular display AR glasses 10 provided in the foregoing embodiments of the present application can realize the adjustment of the included angle between the light emitted by the optical machine and the lens through the display angle adjusting component, so as to adjust the angle of the outgoing light coupled out by the lens, and finally realize the adjustment of the position of the virtual image that can be seen by the eyes, thereby meeting the requirements of different users.
In addition, in the embodiment of the application, the optical machine is separated from the mirror frame and is connected with the mirror legs, so that the relative angle between the optical machine and the mirror can be adjusted, and the disassembly and the maintenance are convenient.
In the above embodiment, the display angle adjusting components are all disposed on the glasses legs, and it can be understood that in other embodiments of the present application, the optical machine may be disposed at other positions of the AR glasses through the applicable display angle adjusting components. For example, the optical machine is arranged on the left frame or the right frame, namely, the optical machine is positioned in front of the lenses; or on the nose pad, without limitation.
While the above description has been made of the monocular AR glasses 10 having the left and right lenses in the same plane provided in the embodiments of the present application, it is understood that the monocular AR glasses 10 having the left and right lenses in the non-same plane may have the same structure as the monocular AR glasses 10 having the left and right lenses in the same plane, except for the different angles of the lenses. Fig. 11 shows a schematic structural diagram of a monocular AR glasses with non-identical left and right lenses, and it can be seen that the left lens 25 and the right lens 26 of the AR glasses in fig. 11 are both at an angle a with respect to the plane h1, and the left lens 25 and the right lens 26 are symmetrically distributed, and other structures refer to the monocular AR glasses with non-identical left and right lenses in fig. 4-10, which are not described herein.
Principle of binocular optics
The monocular display AR glasses provided in the embodiments of the present application are described above, and the binocular AR glasses provided in the embodiments of the present application are briefly described below.
In the following, in the case of the binocular AR glasses, the relationship between the angle between the incident light of the optical machine and the lens and the distance between the connecting line between the virtual image formed last and the pupil of the human eye is described by taking the example of adjusting the angle between the emergent light of the optical machine and the lens in the horizontal direction.
For example, fig. 12 shows a binocular display AR eyeglass 20 in which the left lens 25 and the right lens 26 are on the same plane, and as shown in fig. 12, the left lens 25 and the right lens 26 are symmetrically arranged, and a plane h1 in which the planes of the left lens 25 and the right lens 26 are perpendicular to the line of sight of the human eye is in a parallel state. The optical engine 400 is located on the right temple 22, and the emitted light ray i1 is perpendicular to the right lens 26. The optical engine 500 is located on the left temple 21, and the emitted light ray i2 is perpendicular to the left lens 25.
Fig. 13-15 respectively show the change in virtual image position caused by the different angles between the outgoing light rays of the light engine 400 and the lenses.
As shown in fig. 13, when the optical engine 400 is located on the right temple 22 and the emitted light ray i1 is in a perpendicular relationship with the right lens 26, the optical engine 500 is located on the left temple 21 and the emitted light ray i2 is in a perpendicular relationship with the left lens 25, according to the description of the optical principle in the monocular AR glasses 10 in fig. 3a, it can be known that the virtual image position projected by the optical engine 500 on the left temple 21 seen by the human eye is directly in front of the left eye line, and the virtual image position projected by the optical engine 400 on the right temple 22 seen by the human eye is directly in front of the right eye line. I.e. the vertical distance of the dashed position from the plane in which the pupil of the human eye lies is infinity.
As shown in fig. 14 and 15, when the optical engine 400 rotates by an angle a around the negative direction of the y-axis and the x-axis, the angle a1 is formed between the emitted light ray i1 and the normal P1 of the right lens 26; when the optical engine 500 rotates by an angle a1 around the positive direction of the Y-axis and the x-axis, the angle a1 is formed between the emitted light ray i2 and the normal P3 of the left lens 25. As can be seen from the description of the optical principle in the monocular AR glasses 10 in fig. 3b, the virtual image position projected by the optical machine 400 on the left temple 21 seen by the human eye is located at the position of the positive front of the left eye line of sight deflected by an angle a1 around the negative direction of the Y axis x axis, and the virtual image position projected by the optical machine 400 on the right temple 22 seen by the human eye is located at the position of the positive front of the right eye line of sight deflected by an angle a1 around the Y axis x axis. The line of sight of the virtual image 301 projected by the optical machine 400 on the left temple 21 viewed by the left eye of the user and the line of sight of the virtual image 302 projected by the optical machine 400 on the right temple 22 viewed by the right eye have an intersection o1, the intersection o1 being the position of the virtual image that can be seen by the human eye,
at this time, the distance between the virtual image position and the pupil distance of the human eye is the vertical distance of the connecting line between the intersection o1 and the pupil of the human eye.
At this time, if the user needs to further decrease the distance between the virtual image and the pupil line of the human eye, the display angle adjusting component may continuously rotate the left temple 21 and the right temple 22 by a set angle, for example, an angle a2, around the positive direction of the y-axis and the x-axis, and continuously rotate the right temple 22 and the left temple 400 by a set angle, for example, an angle a2, around the negative direction of the y-axis and the x-axis. As indicated by the dashed line rays in fig. 15. At this time, as can be seen from the description in the above-mentioned monocular AR glasses 10, the position of the virtual image 301 projected by the optical machine 400 on the left temple 21 seen by the human eye continues to deflect around the negative direction of the y-axis x-axis, and the position of the virtual image 302 projected by the optical machine 400 on the right temple 22 seen by the human eye continues to deflect around the positive direction of the y-axis x-axis. At this time, the line of sight of the virtual image 301 projected by the optical machine 400 on the left temple 21 viewed by the left eye of the user and the line of sight of the virtual image 302 projected by the optical machine 400 on the right temple 22 viewed by the right eye have an intersection o2, where the intersection o2 is a virtual image position viewable by the human eye, and at this time, the distance between the virtual image viewable by the human eye and the human eye pupil distance is a perpendicular distance between the intersection o2 and the human eye pupil, and the perpendicular distance between the intersection o1 and the human eye pupil is reduced. Thereby realizing the adjustment of the distance between the virtual image and the human eye pupil connecting line.
When the left lens 25 and the right lens 26 are on the same plane as shown in fig. 12 and 13, if the light rays emitted by the light machine 500 on the left temple 21 and the light machine 400 on the left temple 22 are parallel to the normal lines of the left lens 25 and the right lens 26, respectively, the distance of the virtual image is infinity.
In contrast, as shown in fig. 14 and 15, if the light emitted by the optical engine 500 on the left temple 21 and the optical engine 400 on the left temple 22 is not parallel to the normal line of the left lens 25 and the right lens 26, the virtual image distance L is a finite distance, and the distance L can be calculated by the following formula:
L=IPD/2/tanβ
wherein IPD (interpupillary Distance) is the interpupillary distance of the human eye, and beta is the angle between the emergent ray of the mirror leg polishing machine and the normal of the corresponding mirror surface.
It should be noted that, in order to ensure the comfort of viewing by the eyes, the deflection angle of the left temple bar and the deflection angle of the right temple bar are generally in a consistent state.
In the above description, in the case of the binocular AR glasses, when the left lens 25 and the right lens 26 are on the same plane, the angles between the outgoing light rays of the optical unit 500 on the left leg 21 and the outgoing light rays of the optical unit 400 on the left leg 22 are different from those of the corresponding lenses, so that the virtual image position is changed.
In the following, a change in the virtual image position caused by different angles between the light emitted from the light machine 500 on the left temple 21 and the light emitted from the light machine 400 on the left temple 22 and the corresponding lens when the left lens 25 and the right lens 26 are not on the same plane will be briefly described.
Fig. 16 and 17 show the change in the position of the virtual image caused by the difference between the angle between the outgoing light ray from the optical engine 500 on the left temple 21 and the outgoing light ray from the optical engine 400 on the left temple 22 and the corresponding lens.
As shown in fig. 16, the angles between the left lens 25 and the right lens 26 and the plane h1 are all an angle a, the optical bench 400 is located on the right temple 22, and the angle β between the emitted light ray i1 and the normal of the plane h1 is an angle β. As can be seen from fig. 3d, if the light ray i1 is incident with the angle a between the light ray i1 and the normal line P1 of the right lens 26, that is, the light ray i1 is incident in parallel with the normal line of the plane h1, the angle of the virtual image formed is 2a, and if the optical machine 400 is gradually rotated by an angle a around the negative direction of the y-axis x-axis, the virtual image formed is gradually deflected around the positive direction of the y-axis x-axis, and when the optical machine 400 is rotated by 2a around the negative direction of the y-axis x-axis, the virtual image formed is deflected by 2a around the positive direction of the y-axis x-axis, that is, the light ray i.e., the light ray i is located right in front of the human eye.
Therefore, as shown in fig. 16, the angles between the left lens 25 and the right lens 26 and the plane h1 are all a, and when the angle between the light ray i1 emitted from the optical bench 400 on the right temple 26 and the normal line of the plane h1 is β is 2a, the virtual image position projected from the optical bench 400 on the right temple 22, which is seen by the human eye, is located right in front of the right eye line of sight. Similarly, when the angle β between the ray i1 emitted by the optical engine 500 on the left temple 25 and the normal line of the plane h1 is 2a, the virtual image projected by the optical engine 500 on the left temple 21 is seen by the human eye to be directly in front of the left eye sight line, that is, the vertical distance between the virtual line position and the plane in which the pupil distance of the human eye is located is infinity.
As shown in fig. 17, when the optical engine 400 on the right temple 26 continues to rotate around the negative direction of the y-axis x-axis, and the optical engine 500 on the left temple 25 continues to rotate around the positive direction of the y-axis x-axis, that is, β is greater than 2a, the virtual image position projected by the optical engine 400 on the right temple 22 seen by the human eye is located in the direction right ahead of the right eye's line of sight, the virtual image position projected by the optical engine 500 on the left temple 21 seen by the human eye is located in the direction right ahead of the left eye's line of sight, and as described in fig. 14, the intersection o1 is the intersection between the line of the virtual image 301 projected by the optical engine 400 on the left temple 21 seen by the user's left eye and the virtual image 302 projected by the optical engine 400 on the right temple 22 seen by the right eye, where the intersection o1 is the virtual image position that the human eye can see. At this time, the distance between the virtual image position and the pupil distance of the human eye is the vertical distance of the connecting line between the intersection o1 and the pupil of the human eye.
Wherein when beta > 2 alpha, the distance L of the virtual image is calculated by the following formula,
L=IPD/2/tan(β-2a)。
the following describes a pair of dual-view AR glasses 20 provided in the embodiment of the present application, as shown in fig. 17, the dual-view AR glasses 20 are different from the single-view AR glasses 10 in fig. 4-11 in that the left lens 25 and the right lens 26 each adopt an optical waveguide structure, and include two optical machines, namely, an optical machine 400 on the right leg 22 and an optical machine 500 on the left leg 21, and the optical machine 400 on the right leg 22 and the optical machine 500 on the left leg 21 are respectively used for projecting light from the coupling grating in the right lens 26 and the coupling grating in the left lens 25.
It is understood that the display angle adjustment assembly and the angle adjustment scheme of the optical machine in the monocular AR glasses 10 can be used in the binocular AR glasses 20. That is, the angle adjustment scheme of the right temple 22 and the glazing machine 400 can be used for the angle adjustment of the left temple 21 and the glazing machine 500. For example, the display angle adjusting means for adjusting the position of the optical bench 400 on the left temple 21 may have the same structure as the display angle adjusting means for adjusting the position of the optical bench 400 on the right temple 22 as shown in fig. 4 to 11, and for example, the third fixing arm 291 and the rotating structure 292 may be used as described above. In some embodiments, the display angle adjusting component used to adjust the position of the optical engine 400 on the left temple 21 and the display angle adjusting component used to adjust the position of the optical engine 400 on the right temple 22 may have different structures, and any one of the above mentioned display angle adjusting components may be used, for example, the solution of the third fixing arm 291 and the rotating structure 292 may be used on the left temple 21, the solution of the above mentioned key-type angle adjustment of the optical engine 400 may be used on the right temple 22, and so on. The specific structure of the binocular display AR glasses 20 is not described here.
The above embodiments all disclose AR glasses for adjusting the virtual image position by adjusting the position of the optical machine and changing the angle of the outgoing light of the optical machine relative to the optical waveguide structure. However, based on the optical principles of fig. 3a to 3e and fig. 13 to 14, the angle of the outgoing light ray of the light machine with respect to the lens can be changed as long as the position of the lens with respect to the light machine is changed, so that the position of the virtual image is changed. In other embodiments of the present application, the virtual image position may also be adjusted by adjusting the position of the lens. For example, the change in the virtual image position in the Y-axis direction may be achieved by adjusting the height of the lenses, the change in the X-axis direction of the virtual image position may be adjusted by adjusting the spacing of the left and right lenses in the horizontal direction, or the change in the virtual image position in each direction may be adjusted by adjusting the angle of the lenses with respect to the human eye line.
For example, for the scene shown in fig. 3a, the position of the optical engine 400 may be fixed, but the right lens may be rotated by an angle a degrees around the negative direction of the y-axis x-axis at the angle shown in the drawing, which may also cause the outgoing light rays of the optical engine 400 to deflect by an angle a, thereby changing the position of the virtual image 300 as shown in fig. 3 b. For example, the right frame 24 and the left frame 23 may be provided in a relatively bendable structure to adjust the angle of the lens with respect to the optical machine, thereby achieving position adjustment of the virtual image 300.
The embodiment in which the right lens frame 24 and the left lens frame 23 are relatively bendable may be that the middle frame between the right lens frame 24 and the left lens frame 23 is provided with a bendable structure, or that the connection between the left lens frame 24 and/or the right lens frame 25 and the middle frame is provided with a rotatable structure.
Furthermore, it is understood that in other embodiments of the present application, the adjustment of the virtual image position may also be achieved by adjusting the inclination of the lenses of the entire AR glasses in the y-direction relative to the human eye.
For example, for the AR glasses shown in fig. 4a or 11, the height of the lens in the AR glasses may be changed by providing the nose pad and the adjusting assembly shown in fig. 18, that is, the fitting position of the temple and the ear is unchanged, and the lens is rotated around the fitting position by a certain angle around the X-axis, so that the change of the virtual image position in the Y-axis direction is achieved. In particular, the frame portion may include left and right frames 23, 24 and an intermediate frame between the left and right frames 23, 24. The nose pad 5 is movably connected to the left and right frames 23 and 24 of the frame portion through a second adjusting assembly. With this structural design, the position of the nose pad 5 is adjusted by the second adjusting assembly, so that the nose pad 5 is moved in the Y-axis direction to realize a change in the virtual image position in the Y-axis direction.
Wherein, the second adjusting component can include the double-screw bolt 51 that sets up on the nose holds in the palm and the screw hole that sets up on the intermediate picture frame, and wherein, the nose holds in the palm 5 can be directly through threaded connection's mode connection in the screw hole on the intermediate picture frame. When the nose pad 5 is adjusted in height, the nose pad 5 is simply drawn out of the intermediate frame or inserted into the intermediate frame to a corresponding depth along the Y-axis.
It will be appreciated that because the nose pad 5 is generally fixed in position over the bridge of the nose of the user, when the studs 5 provided on the nose pad 5 are gradually inserted into the threaded holes provided on the intermediate frame, the left and right frames 23, 24 will slide down the bridge of the nose, causing the left and right lenses 25, 26 to slide down the bridge of the nose, thereby causing the final virtual image position to move in the negative Y-axis direction. When the stud 5 provided on the nose pad 5 is gradually pulled out from the screw hole provided on the intermediate lens frame, the left lens frame 23 and the right lens frame 24 move upward along the nose bridge, so that the left lens 25 and the right lens 26 move upward along the nose bridge, and the final virtual image position moves in the positive direction along the Y axis. Finally, the change of the virtual image position in the Y-axis direction is realized.
In addition, the positions of the optical machine and the lens can be changed simultaneously to realize the adjustment of the virtual image position.
In the following, in the binocular display AR glasses, a method for automatically adjusting the position of the camera with respect to the lenses according to the gaze point position and the gaze depth of the eyes of the person will be briefly described. The method can comprise the following steps:
1) A binocular image of a user wearing AR glasses is acquired.
For binocular display AR glasses, in some embodiments, cameras may be provided in front of both the left and right lenses for capturing images of the left and right eyes of the user, respectively, in real time; the position of the camera can be the position opposite to the eyeball of the user, which is favorable for shooting clear eye images of the user.
2) And acquiring the gaze point position and the gaze point depth of the user based on the binocular image of the user.
According to the embodiment of the application, the AR glasses can process the real-time collected images of the eyes of the user through some image processing algorithms or image recognition algorithms according to the images of the left eye and the right eye of the user shot by the camera, and the gazing point positions and gazing depths of the eyes of the user are judged.
3) And adjusting the virtual image position of the AR glasses imaging according to the gaze point position and/or the gaze point depth of the user.
The AR glasses in the embodiment of the application can adjust angles of the light machine on the left glasses leg and the light machine on the right glasses leg in real time through real-time change of the fixation point positions and fixation depths of the eyes of the user, so that the virtual image positions are adjusted to the fixation point positions of the eyes of the user, and the virtual image distances are matched with the fixation depths of the eyes of the user.
In some embodiments, the camera may send the captured images of the eyes of the user to the processor of the AR glasses, and the processor of the AR glasses may process the images of the left eye and the right eye of the user by using an image processing algorithm or an image recognition algorithm, determine the gaze point positions and the gaze depths of the eyes of the user, and perform two optical-mechanical angle adjustments, so that the virtual image position is adjusted to the gaze point position of the eyes, and the virtual image distance is matched with the gaze depth of the eyes.
In some embodiments, the processor may further be provided with an algorithm model related to the determination of the gaze point positions of the eyes, where the algorithm model may determine the gaze point positions of the eyes of the user through the images of the eyes of the user, and perform two optical-mechanical angle adjustments, so that the virtual image position is adjusted to the gaze point position of the eyes, and the virtual image distance matches the gaze depth of the eyes.
The solution of controlling the angle adjustment of the optical bench by the processor may adjust the angle of the optical bench based on the angle adjustment component mentioned in the embodiments of the present application as described above. For example, the processor may effect adjustment of the position of the two light engines relative to the lens by controlling the movement of the telescoping structure.
In some embodiments, the scheme of controlling the angle adjustment of the two optical machines by the processor can also be replaced by adjusting the position of the lens to realize the adjustment of the position of the optical machine relative to the lens.
In some embodiments, the processor may also control the rotation of the optical engine directly by some algorithm program or adjust the outgoing direction of the light in the optical engine without adjusting the position of the optical engine. But may be any other scheme in some embodiments.
In this embodiment, the scheme of determining the virtual image position by using the analysis method of the eye gaze point of human eye may be used in AR glasses with other structures, such as AR glasses with a mirror structure, or may be used in other head-mounted display devices, and is not limited to AR glasses.
It will be appreciated that the AR glasses in the above embodiments are merely exemplary, and the technical solutions of the present application are applicable to near-eye display devices of various forms using optical waveguides as lenses or imaging media, which are not limited herein.
Furthermore, it can be appreciated that in the embodiments of the present application, since the angle of the light engine may be changed, it is necessary to ensure that the light emitted by the light engine can be incident into the coupling-in grating. Fig. 19 shows a schematic diagram of a light ray incident on the coupling-in grating 102 when the light machine is perpendicular to the coupling-in grating 102, the light machine rotates a set angle around a positive direction of a Y-axis X-axis from an angle perpendicular to the coupling-in grating 102, and the light machine rotates a set angle around a negative direction of the Y-axis X-axis from an angle perpendicular to the coupling-in grating 102, respectively. In this embodiment, the size of the coupling grating needs to be capable of satisfying that light emitted by the optical machine at any rotatable angle can be incident on the coupling grating.
For example, the angle of rotation of the optical engine is in the range of 0-30 degrees in the circumferential direction, and when the coupling grating on the lens is disposed, the size of the coupling grating needs to be capable of meeting the requirement that the light emitted by the optical engine 400 when rotating 0-30 degrees can be incident on the coupling grating.
In addition, in the embodiment of the application, if the light rays entering the diffraction optical waveguide of the optical machine under different angles can be coupled out from the coupling-out grating, the field angle of the diffraction optical waveguide of the lens is greater than or equal to the sum of the field angle of the optical machine and the maximum rotatable angle of the optical machine; for example, if the angle of view of the optical bench is 20 °, and the maximum rotatable angle of the optical bench 400 is 10 °, the angle of view of the optical waveguide structure should be 30 ° or more.
In this embodiment of the present application, the optical machine and the display angle adjusting component may be wrapped inside the temple, or may be exposed outside the temple, or may be partially exposed, and the specific setting mode thereof may be adjusted correspondingly according to the actual design of the AR glasses.
In summary, the AR glasses with the adjustable relative positions of the optical machine and the lens provided in the embodiments of the present application change the virtual image position or the virtual image distance by changing the incident angle of the optical machine incident on the coupling grating on the lens, so as to satisfy the requirements of users for different virtual image positions and virtual image distances.
In an embodiment of the present application, there is further provided an imaging control method of AR glasses, where the method may be executed by a processor of the AR glasses, and the method includes:
1) An eye image of a user wearing AR glasses is acquired, wherein the eye image of the user may include an image of one eye of the user, or may include images of both eyes of the user.
It can be appreciated that in the embodiment of the present application, the eye image of the user may be photographed in real time by using the cameras, and for the monocular display AR glasses, the number of cameras may be one, for photographing the image of one of the eyes of the user in real time. For binocular display AR glasses, the number of cameras may be two, one for capturing images of the user's eyes in real time.
2) At least one of a gaze point position or a gaze point depth of the user is acquired based on the eye image of the user.
In the embodiment of the application, the AR glasses can process the eye images of the user acquired in real time through some image processing algorithms or image recognition algorithms according to the eye images of the user shot by the camera, so as to determine the gazing point position and/or gazing depth of eyes of the user.
3) And adjusting the virtual image position of the AR glasses imaging according to the gaze point position and/or the gaze point depth of the user.
In this embodiment of the present application, the AR glasses may implement adjustment of an angle of an optical machine on a temple of the AR glasses according to real-time changes of a gaze point position and a gaze depth of an eye of a user, so that a virtual image position is adjusted to the gaze point position of a human eye, and the virtual image distance is matched with the gaze depth of the human eye.
A hardware structure of AR glasses is further described below.
As shown in fig. 20, the AR glasses 10 may include a processor 110, a power module 140, a memory 180, a wireless communication module 120, a sensor module 190, an audio module 150, a camera 170, an interface module 160, keys 101, and an optical bench 400, etc.
It is to be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the AR glasses 10. In other embodiments of the present application, AR glasses 10 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
The processor 110 may include one or more processing units, for example, processing modules or processing circuits that may include a central processor CPU (Central Processing Unit), an image processor GPU (Graphics Processing Unit), a digital signal processor DSP, a microprocessor MCU (Micro-programmed Control Unit), an AI (Artificial Intelligence ) processor, a programmable logic device FPGA (Field Programmable Gate Array), and the like. Wherein the different processing units may be separate devices or may be integrated in one or more processors. A memory unit may be provided in the processor 110 for storing instructions and data. In some embodiments, the storage unit in the processor 110 is a cache 180.
In an embodiment of the present application, the processor 110 may be configured to control the display angle adjustment assembly to perform a corresponding movement. For example, the processor can recognize the voice command, and then control the electric motor to drive the inner sleeve of the telescopic structure to correspondingly move along the Z-axis direction according to the voice command so as to realize the adjustment of the position of the optical machine.
The power module 140 may include a power source, a power management component, and the like. The power source may be a battery. The power management component is used for managing the charging of the power supply and the power supply supplying of the power supply to other modules. In some embodiments, the power management component includes a charge management module and a power management module. The charging management module is used for receiving charging input from the charger; the power management module is used for connecting a power supply, and the charging management module is connected with the processor 110. The power management module receives input from the power and/or charge management module and provides power to the processor 110, the optical engine 400, the camera 170, the wireless communication module 120, and the like.
The wireless communication module 120 may include an antenna, and transmit and receive electromagnetic waves via the antenna. The wireless communication module 120 may provide solutions for wireless communication including wireless local area network (wireless localarea networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc. applied to the AR glasses 10. The AR glasses 10 may communicate with a network and other devices through wireless communication technology.
The optical machine 400 may be used to project a virtual image to the lenses of AR glasses.
The sensor module 190 may include a position sensor, a proximity sensor, a pressure sensor, a gyroscope sensor, a barometric sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.
In this embodiment of the present application, the position sensor may be used to obtain information about a change in position of a temple in AR glasses.
The audio module 150 is used to convert digital audio information into an analog audio signal output, or to convert an analog audio input into a digital audio signal. The audio module 150 may also be used to encode and decode audio signals. In some embodiments, the audio module 150 may be disposed in the processor 110, or some functional modules of the audio module 150 may be disposed in the processor 110. In some embodiments, the audio module 150 may include a speaker, an earpiece, a microphone, and an earphone interface.
Wherein the microphone may be used to receive voice instructions from a user.
In the present embodiment, the camera 170 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to an ISP (Image Signal Processing ) to be converted into a digital image signal. The AR glasses 10 may implement photographing functions through an ISP, a camera 170, a video codec, a GPU (Graphic Processing Unit, a graphic processor), a display screen 102, an application processor, and the like.
The interface module 160 includes a universal serial bus (universal serial bus, USB) interface. Wherein the external memory card communicates with the processor 110 through an external memory interface to implement a data storage function. The universal serial bus interface is used for the AR glasses 10 to communicate with other electronic devices.
In some embodiments, AR glasses 10 further include keys 1001. The key 1001 may be a first key, a second key, a third key, a fourth key, or the like.
Reference in the specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," and the like in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise.
The foregoing is merely illustrative embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the present application, and should be covered in the scope of the present application; embodiments of the present application and features of embodiments may be combined with each other without conflict. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (28)
1. An optical device, comprising an optical display module, wherein the optical display module comprises a first image source component and a first optical waveguide structure; and, in addition, the processing unit,
when the first image source component has a first position, the light which is incident to the first optical waveguide structure corresponding to the first image source component has a first included angle with the first optical waveguide structure, the optical display module has a first virtual image position,
when the first image source component has a second position, the light which is incident to the first optical waveguide structure corresponding to the first image source component has a second included angle with the first optical waveguide structure, and the optical display module has a second virtual image position.
2. An optical device as recited in claim 1, wherein the optical display module has the first virtual image position when the first image source assembly has a first position relative to the first optical waveguide structure, and,
when the first image source component has a second position relative to the first optical waveguide structure, the optical display module has the second virtual image position.
3. The optical device of claim 2, further comprising:
and the display angle adjusting assembly is used for adjusting the relative position of the first image source assembly relative to the first optical waveguide structure.
4. The optical device of claim 3, wherein the display angle adjustment assembly is coupled to the first image source assembly and the display angle adjustment assembly adjusts the relative position of the first image source assembly with respect to the first optical waveguide structure by moving the first image source assembly.
5. An optical device as recited in claim 3, further comprising:
and the waveguide angle adjusting assembly is used for adjusting the relative position of the first image source assembly relative to the first optical waveguide structure by moving the first optical waveguide structure.
6. The optical device of claim 2, further comprising a second image source assembly and a second optical waveguide structure; and, in addition, the processing unit,
when the first image source component has a first position relative to the first optical waveguide structure and the second image source component has a third position relative to the second optical waveguide structure, a virtual image formed by the light incident from the first image source component to the first optical waveguide structure and the light incident from the second image source component to the second optical waveguide structure has the first virtual image position,
when the first image source component has a second position relative to the first optical waveguide structure and the second image source component has a fourth position relative to the second optical waveguide structure, a virtual image formed by the light incident on the first optical waveguide structure by the first image source component and the light incident on the second optical waveguide structure by the second image source component has the second virtual image position.
7. The optical device of claim 1, wherein the optical device is AR glasses.
8. The optical device of claim 7, wherein the AR glasses further comprise a frame first lens and a second lens;
The glasses frame comprises a first glasses frame, a second glasses frame, a first glasses leg and a second glasses leg;
the first lens includes the first optical waveguide structure.
9. The optical device of claim 8, wherein the AR glasses further comprise a first angle adjustment assembly connecting the frame and the first image source assembly for adjusting the first image source assembly from the first position to the second position.
10. The optical device of claim 9, wherein the first angle adjustment assembly is disposed on the first temple or the first frame.
11. The optical device of claim 9, wherein the AR glasses further comprise a second image source assembly, a second optical waveguide structure, and a second angle adjustment assembly;
the second lens comprises the second optical waveguide structure, and the second angle adjusting component is connected with the frame and the second image source component and used for adjusting the second image source component from a third position to a fourth position.
12. The optical device of claim 11, wherein, with the first image source assembly having the first position and the second image source assembly having the third position, a virtual image of light incident on the first optical waveguide structure by the first image source assembly and light incident on the second optical waveguide structure by the second image source assembly has the first virtual image position, and,
When the first image source component has the second position and the second image source component has the fourth position, a virtual image formed by the light rays incident on the first optical waveguide structure by the first image source component and the light rays incident on the second optical waveguide structure by the second image source component has the second virtual image position.
13. The optical device of claim 11, wherein the second angle adjustment assembly is disposed on the second temple or the second frame.
14. The optical device of any one of claims 9 to 13, wherein the first angle adjustment assembly comprises a first fixed lever and a first rotating structure, wherein,
the first end of the first fixing rod is fixed on the first glasses leg or the first glasses frame, and the first image source component is arranged at the second end of the first fixing rod through the first rotating structure.
15. The optical device of claim 13, wherein the second angular adjustment assembly comprises a second fixed rod and a second rotating structure, wherein,
the first end of the second fixing rod is fixed on the second glasses leg or the second glasses frame, and the second image source assembly is arranged at the second end of the second fixing rod through the second rotating structure.
16. An optical device as claimed in claim 14 or 15, wherein the first or second rotational structure comprises a gimbal.
17. The optical device of any one of claims 9 to 13, wherein the first angle adjustment assembly comprises a first fixed rod, a first rotating structure, a first driving structure, and at least one first telescoping structure;
the first end of the first fixing rod is fixed on the first glasses leg or the first glasses frame, and the first image source component is arranged at the second end of the first fixing rod through the first rotating structure;
one end of each first telescopic structure of the at least one first telescopic structure is connected with different positions of the first image source assembly, and the other end of each first telescopic structure of the at least one first telescopic structure is connected with the first driving structure;
the first driving structure can drive the first telescopic structure to extend and shorten so as to drive the first image source assembly to rotate around the first fixing rod in the corresponding direction.
18. The optical device of claim 13, wherein the second angular adjustment assembly comprises a second fixed rod, a second rotational structure, a second drive structure, and at least one second telescoping structure;
The second end of the second fixing rod is fixed on the second glasses leg or the second glasses frame, and the second image source assembly is arranged at the second end of the second fixing rod through the second rotating structure;
one end of each second telescopic structure of the at least one second telescopic structure is connected with different positions of the second image source assembly, and the other end of each second telescopic structure of the at least one second telescopic structure is connected with the second driving structure;
the second driving structure can drive the second telescopic structure to extend and shorten so as to drive the second image source assembly to rotate around the second fixing rod in the corresponding direction.
19. The optical device of claim 17 or 18, wherein the first telescopic structure comprises a first sleeve and a second sleeve, one end of the first sleeve is connected with the first image source assembly, the other end of the first sleeve is sleeved inside or outside the second sleeve, and the other end of the first sleeve is connected with the driving structure;
or, the second telescopic structure comprises a third sleeve and a fourth sleeve, one end of the third sleeve is connected with the first image source assembly, the other end of the fourth sleeve is sleeved inside or outside the third sleeve, and the other end of the third sleeve is connected with the second driving structure.
20. The optical device according to claim 19, wherein a first connection post corresponding to the first telescopic structures is arranged on the side surface of the first image source assembly, and a first connection ring is arranged at one end of the first sleeve of each first telescopic structure; the first connecting ring is sleeved outside the first connecting column;
or, the side surface of the second image source assembly is provided with second connecting columns with the number corresponding to the second telescopic junctions, and one end of the third sleeve of each second telescopic structure is provided with a second connecting ring; the second connecting ring is sleeved outside the second connecting column.
21. The optical device of claim 20, wherein an inner diameter of the first connection ring is equal to an outer diameter of the first connection post; alternatively, the inner diameter of the first connection ring is larger than the outer diameter of the first connection post;
or, the inner diameter of the second connecting ring is equal to the outer diameter of the second connecting column; alternatively, the inner diameter of the second connecting ring is larger than the outer diameter of the second connecting post.
22. The optical device according to claim 18 or 19, wherein an end of the first connection post not connected to the first image source assembly is provided with a first stopper;
Or, one end of the second connecting column, which is not connected with the second image source assembly, is provided with a second stop part.
23. The optical device of claim 19, wherein one end of the first sleeve of each of the first telescoping structures is connected to a bottom surface of the first image source assembly, wherein the bottom surface of the first image source assembly is opposite the light exit surface of the first image source assembly;
one end of the third sleeve of each second telescopic structure is connected with the bottom surface of the second image source assembly, wherein the bottom surface of the second image source assembly is opposite to the light emitting surface of the second image source assembly.
24. The optical device of any one of claims 11-23, further comprising a processor and a sensing means;
the sensing device is used for sending the first position change information to the controller when detecting that the position of the first image source component relative to the first optical waveguide structure deviates from a first set position; when the position of the second image source component relative to the second optical waveguide structure is detected to deviate from a second set position, sending second position change information to a controller;
The processor is used for controlling the position of the first image source component relative to the first optical waveguide structure to return to the first set position according to the first position information; and controlling the position of the second image source component relative to the second optical waveguide structure to return to the second set position according to the second position information.
25. The optical device of any one of claims 11-23, further comprising a processor;
the processor is configured to:
acquiring a voice instruction of a user;
controlling the position of the first image source component relative to the first optical waveguide structure to be a set position corresponding to the voice command according to the voice command; and/or; and controlling the position of the second image source component relative to the second optical waveguide structure to be a set position corresponding to the voice command.
26. The optical device of any one of claims 11-23, further comprising:
a processor; the processor is configured to:
acquiring an eye image of a user;
determining the gaze point position of the user according to the eye image of the user;
and adjusting the relative position of the first image source component relative to the first optical waveguide structure and/or the relative position of the second image source component relative to the second optical waveguide structure according to the gaze point position and the gaze depth of the user, so that the virtual image position of the optical display module is positioned at the gaze point position of the user.
27. The optical device of any one of claims 8-26, further comprising a nose pad, a height adjustment assembly, and an intermediate frame;
the middle mirror frame is arranged between the first mirror frame and the second mirror frame;
the two ends of the nose pad are respectively connected with the first mirror frame and the second mirror frame;
the nose pad can move away from or close to the middle mirror frame through the height adjusting assembly, and when the nose pad has a first height relative to the middle mirror frame, the first image source assembly has the first position, and when the nose pad has a second height relative to the middle mirror frame, the first image source assembly has the second position.
28. The optical device of claim 27, wherein the height adjustment assembly comprises a stud secured to the nose pad;
the middle mirror frame is provided with a threaded hole matched with the stud.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111235619.7A CN116009253A (en) | 2021-10-22 | 2021-10-22 | Optical equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111235619.7A CN116009253A (en) | 2021-10-22 | 2021-10-22 | Optical equipment |
Publications (1)
Publication Number | Publication Date |
---|---|
CN116009253A true CN116009253A (en) | 2023-04-25 |
Family
ID=86035943
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202111235619.7A Pending CN116009253A (en) | 2021-10-22 | 2021-10-22 | Optical equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN116009253A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117215073A (en) * | 2023-11-08 | 2023-12-12 | 深圳市光舟半导体技术有限公司 | Binocular fusion AR (augmented reality) glasses |
-
2021
- 2021-10-22 CN CN202111235619.7A patent/CN116009253A/en active Pending
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117215073A (en) * | 2023-11-08 | 2023-12-12 | 深圳市光舟半导体技术有限公司 | Binocular fusion AR (augmented reality) glasses |
CN117215073B (en) * | 2023-11-08 | 2024-02-27 | 深圳市光舟半导体技术有限公司 | Binocular fusion AR (augmented reality) glasses |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6641361B2 (en) | Waveguide eye tracking using switched diffraction gratings | |
JP6693060B2 (en) | Display system, display device, display device control method, and program | |
TWI615631B (en) | Head-mounted display device and control method of head-mounted display device | |
US11378802B2 (en) | Smart eyeglasses | |
JP6033866B2 (en) | Wearable device having input / output structure | |
EP3228072B1 (en) | Virtual focus feedback | |
CN206497255U (en) | Augmented reality shows system | |
KR20170042332A (en) | Waveguide eye tracking employing volume bragg grating | |
CN113709410A (en) | Method, system and equipment for enhancing human eye visual ability based on MR glasses | |
US20160097929A1 (en) | See-through display optic structure | |
CN103698904A (en) | Smart glasses and control method thereof | |
RU138628U1 (en) | Augmented Reality Glasses | |
US20160109703A1 (en) | Head mounted display, method for controlling head mounted display, and computer program | |
CN112654913B (en) | Electronic device with adjustable support structure | |
WO2018149267A1 (en) | Display method and device based on augmented reality | |
KR20180037909A (en) | Smart glasses | |
CN113168211A (en) | Modular accessory system for wearable devices | |
WO2018045985A1 (en) | Augmented reality display system | |
CN116009253A (en) | Optical equipment | |
WO2016169339A1 (en) | Image enhancing eyeglasses structure | |
WO2016101861A1 (en) | Head-worn display device | |
CN107111143B (en) | Vision system and film viewer | |
WO2018035842A1 (en) | Additional near-eye display apparatus | |
TW201805689A (en) | Add-on near eye display device characterized in that sharpened images are outputted onto the transparent display so that they are superposed on scenes viewed with naked eyes of the user | |
CN115032788B (en) | Head-wearing device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |