CN118295536A - Intelligent glasses, control method and control device thereof - Google Patents
Intelligent glasses, control method and control device thereof Download PDFInfo
- Publication number
- CN118295536A CN118295536A CN202410501413.1A CN202410501413A CN118295536A CN 118295536 A CN118295536 A CN 118295536A CN 202410501413 A CN202410501413 A CN 202410501413A CN 118295536 A CN118295536 A CN 118295536A
- Authority
- CN
- China
- Prior art keywords
- strabismus
- user
- glasses
- area
- pupil
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000011521 glass Substances 0.000 title claims abstract description 61
- 238000000034 method Methods 0.000 title claims abstract description 54
- 208000004350 Strabismus Diseases 0.000 claims abstract description 166
- 210000001747 pupil Anatomy 0.000 claims abstract description 46
- 210000005252 bulbus oculi Anatomy 0.000 claims abstract description 35
- 210000001508 eye Anatomy 0.000 claims description 33
- 239000004984 smart glass Substances 0.000 claims description 30
- 238000012937 correction Methods 0.000 abstract description 27
- 238000004891 communication Methods 0.000 description 16
- 230000006870 function Effects 0.000 description 9
- 238000012549 training Methods 0.000 description 9
- 230000000694 effects Effects 0.000 description 8
- 230000008569 process Effects 0.000 description 5
- 238000012546 transfer Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 210000003205 muscle Anatomy 0.000 description 4
- 230000009466 transformation Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 210000004087 cornea Anatomy 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000001028 reflection method Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Landscapes
- Eye Examination Apparatus (AREA)
Abstract
The invention provides intelligent glasses, a control method and a control device thereof. The method comprises the following steps: acquiring a strabismus direction of a pupil of a user, wherein the strabismus direction is a direction in which the pupil deviates from the center of an eyeball; according to the strabismus direction, determining a strabismus area and an offset direction of the strabismus area relative to a central point on the display interface by taking the central point of the display interface as a reference position; and determining a strabismus correcting area in the opposite direction of the offset direction of the strabismus area relative to the central point, and displaying a preset picture on the strabismus correcting area. The invention aims to realize auxiliary vision correction through intelligent glasses.
Description
Technical Field
The invention relates to the technical field of intelligent glasses, in particular to an intelligent glasses, a control method and a control device thereof.
Background
At present, when strabismus patients are subjected to exercise correction, a pen point training method is mainly adopted for exercise, the exercise process is boring, the patients are difficult to adhere, and a good auxiliary correction effect is difficult to achieve.
Disclosure of Invention
The invention mainly aims to provide intelligent glasses, a control method and a control device thereof, and aims to realize auxiliary vision correction through the intelligent glasses.
Therefore, the invention provides an intelligent glasses control method, which comprises the following steps:
Acquiring a strabismus direction of a pupil of a user, wherein the strabismus direction is a direction in which the pupil deviates from the center of an eyeball;
According to the strabismus direction, determining a strabismus area and an offset direction of the strabismus area relative to a central point on the display interface by taking the central point of the display interface as a reference position;
And determining a strabismus correcting area in the opposite direction of the offset direction of the strabismus area relative to the central point, and displaying a preset picture on the strabismus correcting area.
Optionally, the smart glasses include an eye tracking module, and the acquiring the strabismus direction of the pupil of the user includes:
Acquiring an eyeball image of a user through the eyeball tracking module;
And determining the strabismus direction of the pupil of the user according to the eyeball image.
Optionally, the eye tracking module includes an infrared lamp array and a camera module, and the step of acquiring the eye image of the user through the eye tracking module specifically includes:
controlling the infrared lamp array to project an infrared light spot array on the eyeball of the user;
acquiring an infrared image and a visible light image of the eyeball of the user through the camera module; wherein the eyeball image includes the infrared image and the visible light image;
the step of determining the strabismus direction of the pupil of the user according to the eyeball image specifically comprises the following steps:
Based on the infrared image and the visible light image, generating a relative position of the pupil of the user relative to the infrared light spot array, and determining the strabismus direction of the pupil of the user according to the relative position.
Optionally, the infrared light spot array includes nine infrared light spots arranged in three rows and three columns.
Optionally, the step of displaying the preset picture on the strabismus correcting area specifically includes:
Acquiring a reference point in a preset picture and a preset fixation point in the strabismus area;
And displaying a preset picture on the strabismus correcting area according to the reference point, so that the direction of the reference point relative to the center point is opposite to the direction of the preset gaze point relative to the center point.
Optionally, the reference point includes a center point of a preset screen or a gaze point of a user on the preset screen.
Optionally, before the step of displaying the preset screen on the strabismus correcting area, the method further includes:
Acquiring a strabismus angle of a pupil of a user;
the step of displaying the preset picture on the strabismus correcting area further comprises the following steps:
Generating a corresponding moving distance according to the strabismus angle;
and displaying the preset picture at the position of the moving distance from the central point on the strabismus correcting area.
The invention also proposes a control device comprising:
a memory;
A processor, a smart glasses control program stored on the memory and executed by the processor, the smart glasses control program, when executed by the processor, implementing the smart glasses control method as claimed in any one of the preceding claims.
The invention also provides intelligent glasses, which comprise the control device.
Optionally, the smart glasses are any one of AR glasses, XR glasses, VR glasses, or MR glasses.
The intelligent glasses control method comprises the following steps: acquiring a strabismus direction of a pupil of a user, wherein the strabismus direction is a direction in which the pupil deviates from the center of an eyeball; according to the strabismus direction, determining a strabismus area and an offset direction of the strabismus area relative to a central point on the display interface by taking the central point of the display interface as a reference position; and determining a strabismus correcting area in the opposite direction of the offset direction of the strabismus area relative to the central point, and displaying a preset picture on the strabismus correcting area. Therefore, in practical application, when a user wears the intelligent glasses, the intelligent glasses can adaptively adjust the position of the preset picture on the display interface according to the direction of the user's pupil strabismus, so that when the user watches the preset picture, the user can exercise weaker eye muscles which cause strabismus, and the auxiliary correction of strabismus is realized. Meanwhile, compared with the nib training method in the prior art, when the intelligent glasses are adopted for auxiliary strabismus correction, pictures interested by a user can be displayed, so that the boring condition of the nib training method is overcome, the daily life of the user is less influenced, for example, the user can wear the intelligent glasses in the process of taking a high-speed rail, watch TV drama and wear the time, correct strabismus conditions of the user, and do not need to find time specially for nib training. Therefore, the intelligent glasses are adopted to assist strabismus correction, the interest and convenience of the user in assisting strabismus correction are effectively improved, and the effect of assisting strabismus correction of the user is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical methods in the prior art, the drawings required for the description of the embodiments or the prior art will be briefly described, and it is apparent that the drawings in the following description are only some embodiments of the present invention and that other drawings may be obtained from the structures shown in these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of an embodiment of a method for controlling smart glasses according to the present invention;
FIG. 2 is a flowchart of another embodiment of a method for controlling smart glasses according to the present invention;
FIG. 3 is a flowchart of a smart glasses control method according to another embodiment of the present invention;
FIG. 4 is a flowchart illustrating a smart glasses control method according to another embodiment of the present invention;
FIG. 5 is a flowchart of a smart glasses control method according to another embodiment of the present invention;
FIG. 6 is a schematic circuit diagram of an embodiment of the smart glasses of the present invention;
FIG. 7 is a diagram illustrating pupil direction detection according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of a display interface according to an embodiment of the invention;
FIG. 9 is a schematic diagram of a display interface according to another embodiment of the invention.
Description of the reference numerals
| 11 | Memory device | 12 | Processor and method for controlling the same |
| 110 | Infrared lamp array | 120 | Image pickup module |
| 130 | Communication module |
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
The technical method according to the embodiments of the present invention will be clearly and completely described in the following description with reference to the drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be noted that all directional indicators (such as up, down, left, right, front, and rear … …) in the embodiments of the present invention are merely used to explain the relative positional relationship, movement, etc. between the components in a particular posture (as shown in the drawings), and if the particular posture is changed, the directional indicator is changed accordingly.
In the present invention, unless specifically stated and limited otherwise, the terms "connected," "affixed," and the like are to be construed broadly, and for example, "affixed" may be a fixed connection, a removable connection, or an integral body; can be mechanically or electrically connected; either directly or indirectly, through intermediaries, or both, may be in communication with each other or in interaction with each other, unless expressly defined otherwise. The specific meaning of the above terms in the present invention can be understood by those of ordinary skill in the art according to the specific circumstances.
Furthermore, descriptions such as those referred to as "first," "second," and the like, are provided for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implying an order of magnitude of the indicated technical features in the present disclosure. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In addition, the technical methods of the embodiments may be combined with each other, but it is necessary to be based on the fact that those skilled in the art can realize the technical methods, and when the combination of the technical methods contradicts or cannot be realized, the combination of the technical methods should be regarded as not exist and not within the scope of protection claimed in the present invention.
At present, when strabismus patients are subjected to exercise correction, a pen point training method is mainly adopted for exercise, the exercise process is boring, the patients are difficult to adhere, and a good auxiliary correction effect is difficult to achieve.
For this reason, the present invention proposes a control method for intelligent glasses, it can be understood that a control device for storing and executing the following method may be disposed in the vehicle-mounted AR glasses, and the control device may be implemented by using a main controller, for example, an MCU, a DSP (DIGITAL SIGNAL Process, digital signal processing Chip), an FPGA (Field Programmable GATE ARRAY, programmable gate array Chip), a PLC, an SOC (System On Chip), or the like.
Referring to fig. 1, in an embodiment of the present invention, the method includes:
step S100, obtaining a strabismus direction of a pupil of a user, wherein the strabismus direction is a direction in which the pupil deviates from the center of an eyeball;
in this embodiment, optionally, the user may enter the strabismus direction of the left eye and/or the right eye of the current user into the smart glasses through an intelligent terminal, such as a mobile phone, a computer, etc., which is in communication connection with the smart glasses, or operate a triggerable component on the smart glasses to set the corresponding strabismus direction.
Optionally, in another embodiment, referring to fig. 2, the smart glasses includes an eye tracking module, and the acquiring the strabismus direction of the pupil of the user includes: step S110, acquiring an eyeball image of a user through the eyeball tracking module; and step S120, determining the strabismus direction of the pupil of the user according to the eyeball image.
In this embodiment, the intelligent glasses may be provided with an eye tracking device electrically connected to the control device, for example, an eye tracking module using a pupil cornea reflection method, an eye tracking module using a retina imaging method, an eye tracking module using an eye modeling method, an eye tracking module using a cornea reflection light intensity method, and the like. The eyeball tracking module can determine eyeball information of a user, such as strabismus direction of pupils of the user, through an eyeball tracking algorithm corresponding to the type of the eyeball through a shot image of the eyeball.
Step 200, determining a strabismus area and an offset direction of the strabismus area relative to a central point on a display interface by taking the central point of the display interface as a reference position according to the strabismus direction;
In this embodiment, the display interface is an area of the smart glasses for displaying images, such as AR glasses, optical elements for imaging on lenses of MR glasses, etc., and the control device may determine, according to a pre-stored transfer function, an area that is mainly observed under strabismus conditions, i.e., a strabismus area, when the user wears the smart glasses in combination with the strabismus direction of the pupils. The pre-stored transfer function can be obtained by carrying out multiple experiments on the intelligent glasses in a wearing state by a researcher during research and development, namely, tracking and detecting eyeballs of a user so as to determine the observed area on a display interface when pupils of the user are in different positions, and generating a corresponding preset transfer function. Then, the control device determines the offset direction of the squint area according to the position of the squint area relative to the center point. For example, referring to fig. 8, the squint region shown in fig. 8 is a region that the control device mainly observes when the user wears the smart glasses after determining the squint direction of the user's pupil, and further determines that the squint region is shifted rightward with respect to the position of the center point on the display interface, that is, the shift direction is rightward. In addition, it can be understood that the intelligent glasses can also detect the worn posture of the intelligent glasses, and through a known transformation relation (preset by a researcher) between the intelligent glasses and the preset worn posture, the area which is currently seen by a user in the preset worn state is adaptively determined and is taken as a strabismus area, so that the accuracy of strabismus area position determination and strabismus correction area position determination is effectively improved.
And step S300, determining a strabismus correcting area in the opposite direction of the offset direction of the strabismus area relative to the central point, and displaying a preset picture on the strabismus correcting area.
In this embodiment, after the control device confirms the strabismus region on the display interface, a strabismus correction region is determined in a direction opposite to the offset direction. Alternatively, a plurality of regions may be equally divided on the display interface with the center point as the origin, and then the region occupied by the strabismus region is marked, and the marked region rotated by one hundred eighty degrees with respect to the center point is set as the strabismus correction region. For example, the center point of the display interface is taken as the origin of the XY coordinates, four quadrant areas are distinguished, the quadrant where the current strabismus area is located is the first quadrant, and then the second quadrant area can be set as the strabismus correction area. Alternatively, the control device may perform coordinate transformation on the coordinates in the oblique region according to a preset coordinate transformation transfer function to confirm the coordinates of the oblique correction region in the opposite direction to the offset direction of the center point. The coordinate transformation transfer function may be preset in advance by a developer during development, so that when a strabismus user looks at a picture in the strabismus correction area, weak eye muscles causing strabismus thereof can be exercised. For example, referring to fig. 8, if a strabismus area with a right offset direction is confirmed in fig. 8, a strabismus correcting area is generated in a left direction relative to a center point, and a picture a originally displayed at the center point of the display interface is moved to the left to be displayed in the strabismus correcting area, namely a picture B, when a user looks at a picture in the strabismus correcting area with the left offset, left muscles of eyes can be exercised, so as to assist in correcting strabismus. The preset picture may be a pre-designed treatment picture, or a picture that is displayed on the display interface according to the function of the current smart glasses, for example, a picture content of a certain television play/movie played through the smart glasses, or an information content such as a chart and characters. It can be understood that the above method may be adapted to only one eye of the user, that is, the projection of the picture on the display interface corresponding to the one eye is performed with the supplementary correction of strabismus, for example, the picture is displayed on the optical element of the left eye on the AR glasses, for example, the strabismus correction area on the left lens is used to assist in correcting the left eye of the strabismus of the user, or may be adapted to both eyes of the user simultaneously.
The intelligent glasses control method comprises the following steps: acquiring a strabismus direction of a pupil of a user, wherein the strabismus direction is a direction in which the pupil deviates from the center of an eyeball; according to the strabismus direction, determining a strabismus area and an offset direction of the strabismus area relative to a central point on the display interface by taking the central point of the display interface as a reference position; and determining a strabismus correcting area in the opposite direction of the offset direction of the strabismus area relative to the central point, and displaying a preset picture on the strabismus correcting area. Therefore, in practical application, when a user wears the intelligent glasses, the intelligent glasses can adaptively adjust the position of the preset picture on the display interface according to the direction of the user's pupil strabismus, so that when the user watches the preset picture, the user can exercise weaker eye muscles which cause strabismus, and the auxiliary correction of strabismus is realized. Meanwhile, compared with the nib training method in the prior art, when the intelligent glasses are adopted for auxiliary strabismus correction, pictures interested by a user can be displayed, so that the boring condition of the nib training method is overcome, the daily life of the user is less influenced, for example, the user can wear the intelligent glasses in the process of taking a high-speed rail, watch TV drama and wear the time, correct strabismus conditions of the user, and do not need to find time specially for nib training. Therefore, the intelligent glasses are adopted to assist strabismus correction, the interest and convenience of the user in assisting strabismus correction are effectively improved, and the effect of assisting strabismus correction of the user is improved.
Referring to fig. 3 and 6, in an embodiment of the present invention, the eye tracking module includes an infrared lamp array 110 and a camera module 120, and the step of acquiring an eye image of the user through the eye tracking module specifically includes:
s111, controlling the infrared lamp array 110 to project an infrared light spot array on the eyeballs of the user;
In this embodiment, optionally, the infrared light spot array includes nine infrared light spots arranged according to three rows and three columns, so that accuracy of calculating the position of the pupil relative to the infrared light spots described below can be effectively improved.
S112, acquiring an infrared image and a visible light image of the eyeball of the user through the camera module 120; wherein the eyeball image includes the infrared image and the visible light image;
the step S120, determining the strabismus direction of the pupil of the user according to the eyeball image specifically includes:
S121, based on the infrared image and the visible light image, generating the relative position of the pupil of the user relative to the infrared light spot array, and determining the strabismus direction of the pupil of the user according to the relative position.
In the present embodiment, the camera module 120 includes an infrared camera module 120 and a visible light camera module 120. When the control device needs to determine the current strabismus direction, the infrared lamp array 110 is controlled to project an infrared light spot array on the eyeball of the user. Then, the control device determines the information of the user's pupil, such as strabismus direction, according to the infrared image and the visible light image captured by the infrared camera module 120 and the visible light camera module 120, and then according to a preset eye tracking algorithm (pre-stored by a developer).
Specifically, referring to fig. 7, an example is described in which nine infrared spots are arranged in three rows and three columns of an infrared spot array, and a left eye ball is obliquely inward, that is, the line of sight of the left eye of the user is deviated to the right. The control device can determine the relative position of the pupil position to the infrared spot array according to the plurality of infrared images and the visible light images, and then calculate and obtain the pupil information, such as strabismus direction, strabismus angle and the like, according to a tracking algorithm preset by a researcher. Thus, through the arrangement, the strabismus direction of the user can be accurately confirmed, and the strabismus correcting effect on the user is improved.
It should be understood that, since the smart glasses display pictures to be played by themselves, such as pictures of a television show, movie pictures, certain text information, etc., in the strabismus correcting area on the display interface, compared with the pen point training method, the user often does not use the whole preset picture as a focusing point of the sight line, which affects the correcting effect to a certain extent.
For this purpose, referring to fig. 4, in an embodiment of the present invention, the step of displaying the preset screen on the strabismus correcting area specifically includes:
Step S310, a reference point in a preset picture and a preset gaze point in the strabismus area are obtained;
Step S320, displaying a preset image on the strabismus correcting area according to the reference point, so that the direction of the reference point relative to the center point is opposite to the direction of the preset gaze point relative to the center point.
In this embodiment, after the strabismus direction and the strabismus area are obtained in the foregoing embodiment, the gaze focus point in the strabismus area, that is, the preset gaze point, of the user may be further determined according to the strabismus direction of the pupil of the user.
After confirming the preset gaze point, the position of the preset screen within the strabismus correction area may be adaptively adjusted within the strabismus correction area according to the preset gaze point, the reference point, and the center point. Specifically, the control device adjusts the position of the preset image in the strabism correcting area so that the preset gaze point, the central point and the reference point are on the same straight line, and the direction of the reference point relative to the central point is necessarily opposite to the direction of the preset gaze point relative to the central point because the strabism correcting area is in the direction opposite to the offset direction. The reference point comprises a center point of a preset picture or a gaze point of a user on the preset picture. It can be understood that, when the reference point includes the gaze point of the user on the preset screen, the gaze point of the user on the preset screen may be obtained by the above-mentioned eye tracking device. Specifically, referring to fig. 9, taking the reference point as the gaze point on the preset picture as an example, the preset picture is a television play selected by the user, and the front face of the person on the television play is the reference point, then the control device adaptively adjusts the position of the picture B in the strabismus correcting area at this time, so that the direction of the front face of the person in the picture B relative to the center point is completely opposite to the direction of the preset gaze point relative to the center point, and the three are on the same straight line.
Through the arrangement, when the user adopts the intelligent glasses to correct strabismus, the position of the preset picture can be correspondingly arranged in the strabismus correcting area according to the datum point, the center point and the preset fixation point, so that the pupil focusing fixation point of the user when watching the preset picture can be just opposite to the focusing fixation point of the user when watching strabismus, and the correcting effect is further improved.
In addition, it can be understood that the user can also control the intelligent glasses according to the current requirement by directly operating the intelligent glasses or operating an external terminal in communication with the intelligent glasses, so that the intelligent glasses can be opened or closed with the function of adjusting the preset picture position according to the reference point. When the function is turned off, the control device displays a preset picture at a certain position in the strabismus correcting area, such as a center position and an edge position, or a certain distance from the center point of the picture to the center point. Therefore, if the strabismus condition of the user is serious, when the user cannot look at the strabismus correcting area completely at the beginning of correcting, the functions can be closed, abnormal display of the picture is prevented, and the adaptability of the intelligent glasses to strabismus correcting assistance is effectively improved.
Based on any of the above embodiments, referring to fig. 5, in an embodiment of the present invention, before the step of displaying the preset screen on the strabismus correcting area, the method further includes:
Step S400, obtaining a strabismus angle of a pupil of a user;
In this embodiment, the control device may obtain the strabismus angle of the pupil of the user in the same manner as in the above embodiment, for example, the strabismus angle set by the user by himself or the strabismus angle of the pupil detected by the eye tracking device.
The step of displaying the preset picture on the strabismus correcting area further comprises the following steps:
Step S330, generating a corresponding moving distance according to the strabismus angle;
and step 340, displaying the preset picture at the position of the moving distance from the central point on the strabismus correcting area.
In this embodiment, the control device determines the required movement angle according to the squint angle and the preset squint angle-movement distance (obtained by multiple tests by the developer). In the preset strabismus angle-moving distance mapping table, the greater the strabismus angle of the user, namely the more serious the strabismus condition, the greater the corresponding moving distance. Specifically, in combination with the foregoing embodiment, optionally, the control device may reference the moving picture with a reference point in the preset picture, so that a distance between the reference point and the center point is the moving distance. Optionally, the control device may further adjust the position of the preset screen with reference to the coordinate closest to the center point on the preset screen, so that the distance between the pixel closest to the center point on the preset screen and the center point is the moving distance.
Through the arrangement, the intelligent glasses not only can assist in correcting the strabismus condition of the user, but also can adaptively adjust the exercise intensity according to the strabismus condition severity of the user, namely the greater the strabismus angle of the user is, the greater the moving distance is, so that the effect of strabismus correction is further improved.
The invention also proposes a control device, referring to fig. 6, comprising:
A memory 11;
A processor 12, a smart wearable device control program stored on the memory 11 and executed by the processor 12, which when executed by the processor 12, implements the smart eyeglass control method of any one of the above.
It should be noted that, since the control device of the present invention includes all the technical solutions of all the embodiments of the above-mentioned intelligent glasses control method, at least all the beneficial effects brought by the technical solutions of the embodiments of the above-mentioned intelligent glasses control method are not described herein in detail.
The invention also provides an intelligent glasses, which comprises the control device, wherein the intelligent glasses are any one of AR glasses, XR glasses, VR glasses or MR glasses.
In this embodiment, the smart glasses may further be provided with a communication module 130, where the communication module 130 may be a wireless communication module, such as a WIFI communication module, a lan communication module, a 4G/5G communication module, or a wired communication module, such as a LIN communication module, a CAN communication module, an RS485 communication module, and so on. The intelligent glasses can be connected with the external intelligent terminal through the communication module in a communication mode, so that in the embodiment, a user can control the intelligent glasses through controlling the intelligent terminal.
It is noted that, since the smart glasses of the present invention include all the technical solutions of all the embodiments of the control device, at least all the beneficial effects brought by the technical solutions of the embodiments of the control device are not described in detail herein.
It is noted that, since the smart glasses of the present invention include all the technical solutions of all the embodiments of the control device, at least all the beneficial effects brought by the technical solutions of the embodiments of the control device are not described in detail herein.
The foregoing description of the embodiments of the present invention is merely an optional embodiment of the present invention, and is not intended to limit the scope of the invention, and all equivalent structural modifications made by the present invention in the light of the present invention, the description of which and the accompanying drawings, or direct/indirect application in other related technical fields are included in the scope of the invention.
Claims (10)
1. An intelligent glasses control method, which is characterized by comprising the following steps:
Acquiring a strabismus direction of a pupil of a user, wherein the strabismus direction is a direction in which the pupil deviates from the center of an eyeball;
According to the strabismus direction, determining a strabismus area and an offset direction of the strabismus area relative to a central point on the display interface by taking the central point of the display interface as a reference position;
And determining a strabismus correcting area in the opposite direction of the offset direction of the strabismus area relative to the central point, and displaying a preset picture on the strabismus correcting area.
2. The smart glasses control method according to claim 1, wherein the smart glasses include an eye tracking module, and the acquiring the strabismus direction of the pupil of the user includes:
Acquiring an eyeball image of a user through the eyeball tracking module;
And determining the strabismus direction of the pupil of the user according to the eyeball image.
3. The method for controlling intelligent glasses according to claim 2, wherein the eye tracking module comprises an infrared lamp array and a camera module, and the step of acquiring the eye image of the user through the eye tracking module specifically comprises:
controlling the infrared lamp array to project an infrared light spot array on the eyeball of the user;
acquiring an infrared image and a visible light image of the eyeball of the user through the camera module; wherein the eyeball image includes the infrared image and the visible light image;
the step of determining the strabismus direction of the pupil of the user according to the eyeball image specifically comprises the following steps:
Based on the infrared image and the visible light image, generating a relative position of the pupil of the user relative to the infrared light spot array, and determining the strabismus direction of the pupil of the user according to the relative position.
4. The intelligent eyeglass control method according to claim 3, wherein the infrared light spot array includes nine infrared light spots arranged in three rows and three columns.
5. The method for controlling intelligent glasses according to claim 1, wherein the step of displaying the preset screen on the strabismus correcting area specifically comprises:
Acquiring a reference point in a preset picture and a preset fixation point in the strabismus area;
And displaying a preset picture on the strabismus correcting area according to the reference point, so that the direction of the reference point relative to the center point is opposite to the direction of the preset gaze point relative to the center point.
6. The smart glasses control method as claimed in claim 5, wherein the reference point includes a center point of a preset screen or a gaze point of a user on the preset screen.
7. The smart glasses control method according to any one of claims 1 to 6, wherein before the step of displaying the preset screen on the strabismus correcting region, the method further comprises:
Acquiring a strabismus angle of a pupil of a user;
the step of displaying the preset picture on the strabismus correcting area further comprises the following steps:
Generating a corresponding moving distance according to the strabismus angle;
and displaying the preset picture at the position of the moving distance from the central point on the strabismus correcting area.
8. A control device, characterized in that the control device comprises:
a memory;
A processor, a smart-lens control program stored on the memory and executed by the processor, which when executed by the processor, implements the smart-lens control method of any one of claims 1-7.
9. An intelligent glasses, comprising the control device according to claim 8.
10. The smart glasses of claim 9 wherein the smart glasses are any one of AR glasses, XR glasses, VR glasses or MR glasses.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410501413.1A CN118295536A (en) | 2024-04-23 | 2024-04-23 | Intelligent glasses, control method and control device thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410501413.1A CN118295536A (en) | 2024-04-23 | 2024-04-23 | Intelligent glasses, control method and control device thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN118295536A true CN118295536A (en) | 2024-07-05 |
Family
ID=91674464
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410501413.1A Pending CN118295536A (en) | 2024-04-23 | 2024-04-23 | Intelligent glasses, control method and control device thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN118295536A (en) |
-
2024
- 2024-04-23 CN CN202410501413.1A patent/CN118295536A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109558012B (en) | Eyeball tracking method and device | |
| US10488925B2 (en) | Display control device, control method thereof, and display control system | |
| US20190235624A1 (en) | Systems and methods for predictive visual rendering | |
| KR102469507B1 (en) | Information processing apparatus, information processing method and program | |
| US20180295350A1 (en) | Binocular See-Through AR Head-Mounted Display Device and Information Display Method Therefor | |
| WO2009107371A1 (en) | Sight line detector and method for detecting sight line | |
| WO2023011339A1 (en) | Line-of-sight direction tracking method and apparatus | |
| US20210271318A1 (en) | Multi-Modal Vision Enhancement System | |
| WO2016115874A1 (en) | Binocular ar head-mounted device capable of automatically adjusting depth of field and depth of field adjusting method | |
| US11561392B2 (en) | Method for generating and displaying a virtual object by an optical system | |
| US20230023903A1 (en) | Image processing method, vr device, terminal, display system, and non-transitory computer-readable storage medium | |
| US11448903B2 (en) | Method for correcting centering parameters and/or an axial position and corresponding computer program and methods | |
| CN109766007A (en) | A kind of the blinkpunkt compensation method and compensation device, display equipment of display equipment | |
| CN109976514A (en) | Eye movement data bearing calibration based on eyeball error model | |
| WO2022062436A1 (en) | Amblyopia training method, apparatus and device, storage medium, and program product | |
| US11715176B2 (en) | Foveated rendering method and system of virtual reality system based on monocular eyeball tracking | |
| EP3402387B1 (en) | Method, system and computer readable medium to determine a strabismus angle between the eyes of an individual | |
| WO2019073689A1 (en) | Information processing device, information processing method, and program | |
| JP2005261728A (en) | Line-of-sight direction recognition apparatus and line-of-sight direction recognition program | |
| CN109917908B (en) | Image acquisition method and system of AR glasses | |
| CN113138664A (en) | Eyeball tracking system and method based on light field perception | |
| KR101817436B1 (en) | Apparatus and method for displaying contents using electrooculogram sensors | |
| CN118295536A (en) | Intelligent glasses, control method and control device thereof | |
| TWI683134B (en) | Image display method of head-mounted display apparatus and head-mounted display apparatus | |
| CN114911445B (en) | Display control method for virtual reality device, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |