CN117357381A

CN117357381A - Visual disturbance rehabilitation training device, system and method based on augmented reality

Info

Publication number: CN117357381A
Application number: CN202310320410.3A
Authority: CN
Inventors: 王倩; 王兴昌; 孙锡全; 袁静; 焦辉广; 孟帅; 张冬华
Original assignee: Shenzhen Vision Stick Medical Technology Co ltd
Current assignee: Shenzhen Vision Stick Medical Technology Co ltd
Priority date: 2023-03-29
Filing date: 2023-03-29
Publication date: 2024-01-09

Abstract

The invention discloses visual disorder rehabilitation training equipment, system and method based on augmented reality, and relates to the technical field of visual rehabilitation training. Visual disturbance rehabilitation training device is based on augmented reality's visual disturbance rehabilitation training device, including XR glasses, XR glasses include picture frame and baffle lens, for wearing monitoring sensor and microphone hole between two baffle lenses on the picture frame, integrated display module assembly and optical module assembly on corresponding two baffle lenses to integrated diopter adjust knob or set up the dioptric lens on corresponding picture frame, integrated power key, function key and speaker play sound hole on the mirror leg of picture frame, and set up signal interface in the end. And the vision disorder rehabilitation training is realized through a matched rehabilitation training system. According to the invention, the visual disorder rehabilitation is effectively realized by performing targeted training on the screened optimal retina sites through the visual disorder rehabilitation training device based on the augmented reality.

Description

Visual disturbance rehabilitation training device, system and method based on augmented reality

Technical Field

The invention relates to the technical field of vision rehabilitation training, in particular to vision disorder rehabilitation training equipment, system and method based on augmented reality.

Background

Vision disorder (Vision Impariment, VI) refers to a condition of low binocular vision or reduced vision due to various causes and cannot be corrected, so that the daily life and social participation of the patient are affected, which is also called vision disability. Vision disorder is a global public health problem, which not only has serious influence on personal life and families, but also can disturb social order and obstruct the development of social economy. Visual disorders include low vision and blind. Low Vision (LV) refers to a visual dysfunction that cannot be improved by surgery, medication or conventional refractive correction, with the best corrected Vision of the superior of the eyes being less than 0.3 and equal to or greater than 0.05, but which is capable or potential to be able to learn, work, etc. with its residual Vision. At present, main causes of blindness and low vision in China comprise cataract, uncorrected ametropia, ocular fundus diseases, glaucoma, keratopathy and the like, and some diseases can reduce the occurrence of low vision through preventive intervention and early intervention treatment or acquire the capability of independent life through timely rehabilitation, so that the national and social aspects are promoted to start to strengthen the key of research on the low vision and the blind and importance of rehabilitation.

Low vision rehabilitation (Low Vision Rehabilitation, LVR) helps patients to make maximum use of their residual vision, promoting their independent life learning to return to society. Among them, the vision aid is an important means and effective way for low vision rehabilitation, which is a device or means that can help low vision patients to increase or improve vision ability.

The head-wearing visual equipment (Head Mounted Display, HMD) is a head-wearing image display and observation equipment, mainly composed of an image source, an optical system, a display device and a circuit control, and the working principle is that an image generated by the image source and an external scenery image are synthesized through the optical system and imaged on a focal plane of a goggles system, converted into parallel light after passing through the eyepiece system, and projected into eyes through a combined lens in front of eyes of a user. HMDs can be categorized as Virtual Reality (VR), also known as immersive Reality devices and augmented Reality (Augmented Realtiy, AR) devices, according to availability. VR devices typically employ a binocular display to simulate a three-dimensional image environment, eliminating a direct path between the user's eyes and the real environment, with the user immersed in the simulated world. AR technology is a technology that superimposes computer-generated perception information with the physical real world to augment element information of the real environment, including sound, video, image, GPS data, and the like. Mixed Reality (MR) includes VR and AR, which can be understood as "real world+virtual world+digitized information", and is a new visual environment generated by combining real world and virtual world, and a user can coexist with physical and digital objects in the new visual environment and interact in real time. Augmented Reality (XR) refers to all real and virtual environments that are human-machine interactive, including Augmented Reality (AR), virtual Reality (VR), mixed Reality (MR), and the like in various forms and everything in between, through a real and virtual combination created by computer technology and wearable devices. The enhancement and expansion of the real world in XR technology is typically real-time information related to the environment. Based on advanced XR technologies (such as computer imaging and object recognition), environmental information around users becomes interactive and digitally operable. Virtualization information related to environments and objects can be overlaid on top of the real world.

Traditional medical treatment (including surgery, medicine, laser, intravitreal injection of anti-vascular endothelial growth factor, etc.) can only delay the active progress of the disease, but has limited value for improving central dark spots and visual functions caused by stationary retinal or choroidal atrophy scarring. In addition, the electronic vision auxiliary equipment such as the vision aid can utilize residual vision to improve visual experience, but has the problems of visual fatigue, difficult operation, limited visual field and the like, and becomes an important factor for limiting the wide application of the electronic vision auxiliary equipment. Micro-vision biofeedback training (Microperimetric Biofeedback Training, MBFT) is to adjust a vision system to a new functional state by means of a novel micro-vision meter through purposeful repetitive training of the acquired, so as to promote the information transmission of retina-brain, realize the plasticity of visual cortex and further improve the vision functions of vision, fixation stability, reading speed, contrast sensitivity and the like.

The field of vision refers to the spatial extent that eyes can see when both eyes are looking forward and remain stationary. In patients with central vision loss, the field of vision is limited to the non-foveal region of the macula, and the patient spontaneously mobilizes the eye movement system to adaptively select the non-foveal region for saccades and fixation to compensate for the lack of foveal input information. This non-foveal region acts as a pseudo-fovea, allowing the patient to obtain relevant visual information. This region is called the preferred retinal gaze center (Preferred Retina Locus, PRL), which is defined as: specific areas of one or more functional retinas formed after repeated specific visual objective or task training may also have accommodation for attention and eye movement.

Selection criteria for PRL: 1. has good retina sensitivity; 2. on the basis of not distinguishing retinal meridians, the position of the anatomical fovea is as close as possible; 3. most PRL locations select the field of view above the center dark point. PRL requires careful selection by ophthalmologists and optometrists based on clinical experience, with reference to factors such as fundus, field of view, eye position, stereoscopy, and fusion.

For PRL-based vision disorder rehabilitation training, current training equipment has a micro-vision perimeter to train low vision patients who lose foveal gaze, repositioning their preferred retinal gaze center (PRL) to a different area, known as a trained retinal gaze center (Trained Retina Locus, TRL); TRL is predetermined by doctors of professional staff such as doctors, and the like, because the fixation stability and visual effect are improved, the fixation rehabilitation training enables the user to have better functional vision, and the stimulation of the active flicker mode and pleasant music create effective and pleasant training experience for the user; however, the micro-vision perimeter has a large size, is easily influenced by the actions of limbs (such as head deflection) and the like during training, is high in price, has strong professional requirements for operation, and can be used by trained persons only in places such as hospitals and the like under the guidance of professionals such as doctors and the like.

Disclosure of Invention

The invention aims to provide visual disorder rehabilitation training equipment, system and method based on augmented reality, which are used for carrying out targeted training on the screened optimized retina gazing center point based on the visual disorder rehabilitation training equipment based on augmented reality, so that visual disorder rehabilitation is effectively realized.

In order to achieve the technical purpose and the technical effect, the invention is realized by the following technical scheme:

visual disturbance rehabilitation training device based on augmented reality, including XR glasses, XR glasses include picture frame and baffle lens, for wearing monitor sensor and microphone hole between two baffle lenses on the picture frame, integrated display module assembly and optical module assembly on corresponding two baffle lenses, simultaneously on baffle lens downside integrated installation infrared illuminator and eye move tracking camera, integrated diopter adjust knob or set up the dioptric lens on corresponding picture frame, integrated power key, function key and speaker play sound hole on the mirror leg of picture frame to set up signal interface in the end.

Furthermore, the XR glasses are connected with the mobile terminal through a signal interface, the micro-vision meter function is realized by application software of the mobile terminal, and the display screen is displayed through the display module and the optical module, so that threshold vision inspection and fixation training are provided;

the XR glasses are internally provided with a Bluetooth module and a power module, the signal interface is a Type-C connecting component, the Type-C connecting component is also a charging interface of the power module, and the power module supplies power for all elements on the XR glasses.

Further, the diopter adjusting knob supports diopter adjustment of-5D to 0D and is provided with a diopter mark; vision disorder rehabilitation training is carried out under the state of correcting vision, if diopter adjustment of-5D-0D can not cover the vision of a user, a proper refractive lens is needed to be added on a front refractive mirror frame, so that the vision correction is achieved.

Another object of the present invention is to provide a rehabilitation training system of an augmented reality-based vision disorder rehabilitation training device, the rehabilitation training system comprising:

vision disorder rehabilitation training device: XR glasses are used as carriers to realize the function of a micro-vision field perimeter;

mobile terminal software: the XR glasses are connected to provide calculation force support and display output, and user interaction, account management and data presentation are realized;

the background server: realizing user data storage and data analysis processing; and provides a user-specific professional interface.

Furthermore, the mobile terminal software of the rehabilitation training system is divided into a user terminal and a background terminal, the user terminal carries out rehabilitation training selection after logging in through registration, the mobile terminal software is connected with vision impairment rehabilitation training equipment through wires or Bluetooth, the mobile terminal software realizes user interaction and data presentation, and meanwhile, functional training can be started after the vision impairment rehabilitation training equipment is worn;

the training content received by the vision disorder rehabilitation training device is allocated and arranged by a background server and mobile terminal software, and the background server analyzes and processes data and cooperates with professionals to realize remote rehabilitation training.

Another object of the present invention is to provide a rehabilitation training method of a rehabilitation training system of vision impairment rehabilitation training device based on augmented reality;

the rehabilitation training method comprises the following steps:

s1: center field and side center field test

The mobile terminal software gives out a visual target with set brightness at a set position in a 10-degree visual field range, projects the visual target to the XR glasses, and carries out interaction according to whether the visual target can be seen to respond or not, and the background gives out a test result according to the interaction result;

s2: determination and training of preferred retinal gaze center sites

The background server and the mobile terminal software find and select the optimal retina fixation center according to the diagnosis and test results, determine the trained retina fixation center site coordinates, send the site coordinates to the mobile software terminal of the user, and the user terminal automatically receives and executes the optimal retina fixation center site and trains.

Further, in the determination and training of the preferred retinal locus, the user is required to rotate the eye under the guidance of a professional physician such as an ophthalmologist or autonomously; finding out a dynamic visual target, keeping fixation, manually selecting the direction of the embedded small visual target, and strengthening fixation and a hand, eye and brain feedback mechanism;

according to the setting of various parameters, corresponding training parameters are formed in training, and according to the training parameters, the optimal retina sites are optimized and adjusted again to evaluate the training effect.

Further, the determination and training of the optimized retina loci confirm whether a user sees a dynamic checkerboard by using a paracentric trained retina locus according to an eye movement tracking camera set by XR glasses, and accuracy parameters of the seeing are calculated by using fixation stability;

and the eye movement tracking camera records the change of the fixation point and calculates fixation stability.

Further, the determination and training of the preferred retinal locus, various parameters of the training are recorded, and the visual field is monitored periodically during the process;

life vision, real world vision, data display, vision sensitivity change, improvement.

Further, the determination and training of the preferred retina sites, wherein the training optotype is black and white flickering checkerboard;

the training optotype is a black-and-white blinking checkerboard of 4×4=16 or 8×8=64;

the side length of the checkerboard is calculated and set in a visual angle.

Further, the spatial frequency, the time frequency, the flicker frequency, the fixation stay time, the stay position and the stay time of the red checkerboard are set by a training program;

the visual field monitoring program adopts a central visual field monitoring mode, adopts a strategy program corresponding to a micro-field meter, and preferably adopts a 10-2 program.

The invention has the beneficial effects that:

the vision disorder rehabilitation training device based on the extended reality is based on the XR glasses, has relatively proper economic cost, is beneficial to fixation, meets the requirement that the head is kept motionless in the test and training process, enables the eye movement eye muscles to see the preset fixation point and keep fixation, ensures the integration of eyes and the head, and avoids irregular test and training caused by limb actions such as turning;

compared with the micro-vision meter which can only be used under the guidance of professionals such as doctors in places such as hospitals, the vision disorder rehabilitation training equipment and the rehabilitation training system based on the extended reality can be independently used under the guidance of testees in non-hospital scenes such as home scenes or under the prompt of voice characters and patterns provided by the equipment after training.

According to the visual disturbance rehabilitation training device, system and method based on the extended reality, a testee can independently use the visual disturbance rehabilitation training device, the visual disturbance rehabilitation training system and method based on the extended reality can achieve periodic visual field examination on an application scene, and the visual disturbance rehabilitation training device, the visual disturbance rehabilitation training system and the visual disturbance rehabilitation training method cannot achieve the visual disturbance rehabilitation training device, the system and the method based on the extended reality can not achieve the visual disturbance rehabilitation training device.

According to the visual disorder rehabilitation training device, system and method based on the extended reality, a periodic visual field checking result can be used for evaluating visual states of a testee and evaluating the disease progress of fundus retinas of a user. Meanwhile, by combining the biofeedback training provided by the invention, the vision improvement condition, the fixation training effect and the like of a user are evaluated.

The invention can be purchased and used independently by a testee, can be used periodically on an application scene, solves the problems of going to and from hospitals and shortage of hospital resources, can be used for a long time under the guidance of software or service personnel such as exclusive ophthalmologists or optometrists, improves the training maintenance time, and avoids the problems of double vision and the like.

Of course, it is not necessary for any one product to practice the invention to achieve all of the advantages set forth above at the same time.

Drawings

FIG. 1 is a schematic view of XR glasses according to an embodiment of the invention;

FIG. 2 is a schematic view of another structure of XR glasses according to an embodiment of the invention

FIG. 3 is a schematic diagram of a training target according to an embodiment of the present invention;

FIG. 4 is a schematic diagram showing an actual training process of XR glasses according to an embodiment of the invention;

FIG. 5 is a schematic diagram II of an XR glasses training process according to an embodiment of the invention;

FIG. 6 is a schematic diagram III of an XR glasses training procedure according to an embodiment of the invention;

FIG. 7 is a diagram of a training report according to an embodiment of the present invention;

in the drawings, the reference numerals are as follows:

the device comprises a 1-mirror frame, a 2-baffle lens, a 3-infrared illuminator, a 4-eye movement tracking camera, a 5-display module and an optical module, a 6-signal interface, a 7-wearing monitoring sensor and an 8-diopter adjusting knob.

Detailed Description

In order to more clearly describe the technical scheme of the embodiment of the present invention, the embodiment of the present invention will be described in detail below with reference to the accompanying drawings.

Example 1

As shown in fig. 1-2:

visual disturbance rehabilitation training equipment based on augmented reality comprises XR glasses, wherein the XR glasses comprise a glasses frame and baffle lenses, a wear monitoring sensor and a microphone hole are arranged between the two baffle lenses on the glasses frame, a display module and an optical module are integrated on the corresponding two baffle lenses, an infrared illuminator and an eye movement tracking camera are integrated on the lower side of the baffle lenses, a diopter adjusting knob is integrated on the corresponding glasses frame or a refractive lens is arranged on the corresponding glasses frame, a power key, a function key and a loudspeaker sound outlet hole are integrated on the glasses legs of the glasses frame, and a signal interface is arranged at the tail end;

the XR glasses are connected with the mobile terminal through a signal interface, the micro-vision meter function is realized by application software of the mobile terminal, and the display screen is put on through the display module and the optical module, so that threshold vision inspection and fixation training are provided;

The diopter adjusting knob supports diopter adjustment of-5D to 0D, and diopter marks are set.

In this embodiment, this product is plug and play Type product, inserts in the right side mirror leg slot through Type-C connecting wire, and the other end is connected and is taken video output's equipment, can reach the effect of showing and throw the screen.

The glasses support wireless Bluetooth technology, and the glasses contain lithium ion batteries, and can also be used as independent Bluetooth (Bluetooth) audio when a cable is not connected, and are in wireless connection with Bluetooth main equipment such as a mobile phone/Pad/PC. The Type-C interface is also a charging interface of the internal battery, and when the power supply is connected, the internal battery can be automatically charged until the internal battery is full.

Wearing method

It is recommended that the temples be worn from the head down after being fully opened and that the connection cord be placed behind the ear. Wires can be used

The clip clamps the phone data line in place on the collar or other suitable location to provide a better wearing experience.

In this embodiment, diopter adjustment:

the diopter adjusting knob is arranged above the product, supports diopter adjustment of-5D to 0D, and does not need to additionally wear myopia glasses for use.

Vision disorder rehabilitation training is carried out under the state of correcting vision, if diopter adjustment of-5D-0D can not cover the vision of a user, a proper refractive lens is needed to be added on a front refractive mirror frame, so that the vision correction is achieved.

In this embodiment, the conversion relationship between diopter and near vision power: -1d=100 degrees, -2d=200 degrees, and so on.

Example 2

Rehabilitation training system of vision disorder rehabilitation training device based on augmented reality, rehabilitation training system includes:

The mobile terminal software of the rehabilitation training system is divided into a user terminal and a background terminal, the user terminal carries out rehabilitation training selection after registration and login, the mobile terminal software is connected with vision impairment rehabilitation training equipment through wired or wireless communication, the mobile terminal software realizes user interaction and data presentation, and meanwhile, functional training can be started after the vision impairment rehabilitation training equipment is worn;

Example 3

A rehabilitation training method of a rehabilitation training system of vision disorder rehabilitation training equipment based on augmented reality;

the rehabilitation training method comprises the following steps:

s1: center field and side center field test

The mobile terminal software gives out a sighting target with a set position, a set brightness and a set threshold value in a 10-degree visual field range, projects the sighting target to the XR glasses, and carries out interaction according to whether the sighting target can be seen to respond or not, and the background gives out a test result according to the interaction result;

s2: determination and training of preferred retinal sites

The background server and the mobile terminal software find and select the optimal retina sites according to the diagnosis and test results, determine trained retina sites, send the point coordinates to the mobile software terminal of the user, and the user terminal automatically receives and executes the optimal retina sites and trains.

The determination and training of the preferred retinal locus requires the user to rotate the eye under the direction of a professional physician such as an ophthalmologist or autonomously; finding out a dynamic visual target, keeping fixation, manually selecting the direction of the embedded small visual target, and strengthening fixation and a hand, eye and brain feedback mechanism;

Determining and training the optimized retina loci, and determining whether a user sees a dynamic checkerboard by using a paracentric trained retina locus according to an eye movement tracking camera set by XR glasses, wherein accuracy parameters of the seeing are calculated by using fixation stability;

The determination and training of the preferred retinal locus, various parameters of the training are recorded, and the visual field is monitored periodically during the process;

The optimal retina sites are determined and trained, and the training vision marks are black and white flickering checkerboards;

the training optotype is a black-and-white flicker checkerboard with 4×4=16 grid low spatial frequencies or 8×8=64 grid high spatial frequencies;

the side length of the checkerboard is calculated and set according to the visual angle, and 1 unit side length corresponds to 1-degree visual angle.

In this embodiment, the specific display optotype size is related to the optical parameters of the XR glasses, for example, the screen image distance of the XR glasses is set to l=3m, and the display optotype size S is:

S＝L*sin1°≈L*π*1°/180°＝3m*π*1°/180°＝0.05m

the space frequency, time frequency, flicker frequency, fixation stay time and red checkerboard stay time of the checkerboard are set by a training program;

in this embodiment, the visual field monitoring program adopts a central visual field detection mode, adopts a strategy program corresponding to a visual field meter, and preferably adopts a 10-2 program.

The flicker frequency of the checkerboard is 1-30Hz;

the relative position coordinates and time of the fixation point stay can be monitored, collected and recorded through an eye movement camera, when a testee rotates eye muscles to enable the testee to achieve a preset trained retina locus through the eye muscles, a training program sends out an instruction, and a checkerboard visual target is displayed at the locus; if the subject's gaze point does not reach the trained retinal locus, the locus does not display a checkerboard optotype; when the subject's gaze point reaches the trained retinal locus, the training program records the data of the precise coordinate position where the subject's gaze point stays on the locus, the frequency of stay time, duration, etc., and calculates the time for effective training. The method comprises the steps of carrying out a first treatment on the surface of the

Further, when the testee starts training, the display is not provided with the checkerboard visual target, the checkerboard visual target can appear at a preset coordinate position only when the testee moves the eye muscle to enable the trained retina locus to reach the corresponding coordinate point, in the process that the testee moves the eye muscle, the XR glasses can generate music sounds, when the gaze point of the testee approaches the preset trained retina locus, the music sounds can be increased, or the frequency of sound of a single ticker is increased along with the approach of the preset trained retina locus coordinate position, the testee is prompted and stimulated to find the locus, and when the gaze point of the testee reaches the locus and keeps fixation, the program can generate pleasant music sounds to guide the testee to keep fixation continuously.

Or red-white areas are arranged in a black-white checkerboard, and a preferable 4×4=16 black-white checkerboard adopts a 2×2=4 red-white area, and a 8×8=64 black-white checkerboard adopts a 4×4=16 red-white area; the red-white area is positioned at the edge part of the black-white checkerboard in four directions, and the flicker frequency is the same as that of the black-white area; the dwell time is set by the gaze monitoring program.

The user selects the azimuth of the red area in the black-white area through the wireless remote control handle, and the application program judges whether the user sees the optotype through whether the direction selection of the user is correct or not;

in the fixation training process, continuously changing the positions of the red and white areas, wherein the retention time of each position is preferably 1-10 seconds, and calculating fixation stability by evaluating fixation effect through the accuracy of the direction selected by a user;

the specific implementation manner of the embodiment is as follows: downloading LOOKBON vision stick APP through a mobile terminal, and registering and logging in by a user; the user selects monitoring and follow-up to perform dynamic visual field test;

selecting either the left or right eye;

selecting a visual field test cursor level;

in this embodiment, the dark environment (like brightness in moon light when full month) of visual field test can be realized by the sunglasses lens of the XR glasses of the vision disorder rehabilitation training device, after the XR glasses are connected by the user side, the user is adapted for 5 minutes in the dark environment, and then the test is started (in this process, the XR glasses are controlled by software to close the opposite side optical module screen, meanwhile, the environment brightness is monitored by the built-in light sensor, if the environment brightness does not reach the dark environment standard, the program is not allowed to enter the next test or training program, so as to ensure the rationality of the test and training environment and the accuracy and effectiveness of the test and training); the user end through the mobile end software registers and connects XR glasses, selects TRL training to select left eye or right eye as required, need to be noted whether test or training, need shelter from the opposite side eye, stir adjust knob about (can correct 0-500 degree myopia), adjust to the most clear state, or the front suitable dioptric lens. The method comprises the steps of carrying out a first treatment on the surface of the

The XR glasses of the embodiment are stably worn by a user, so that the head of the user and the glasses are naturally ensured to be integrated, and the problem that the user keeps the fixed head position is fundamentally solved;

after the user registers, selecting account binding of doctors or other professionals, and binding a management end of mobile end software, wherein the management end is an ophthalmologist, an optometrist, a rehabilitation assistance technology consultant and a health manager; the management end sets a TRL training target point and issues synchronization to a user end of mobile end software;

as shown in fig. 3:

the training target point optotype adopts a checkerboard optotype, a rehabilitation training scheme is determined by professional ophthalmologists/optometrists and other professionals, and the grade of the target optotype is adjusted according to the requirement of the rehabilitation training scheme; training targets with adjustable flicker frequency, the protocol being determined by a professional ophthalmologist/optometrist; frequency grade and other parameters are adjusted according to the requirements of a rehabilitation training scheme;

wherein the checkerboard side length, i.e. the viewing angle of the eye, has a low spatial frequency and a high spatial frequency, and sets a training mode, such as a 4/16 training mode, a 16/64 training mode, wherein:

4/16 training mode: the black and white checkerboard has 4 x 4 side length flicker, the red checkerboard has 2 x 2 side length flicker, and the up-down, left-right positions of the red checkerboard can be changed;

16/64 training mode: the black and white checkerboard has 8 x 8 side length flicker, the red checkerboard has 4 x 4 side length flicker, and the up-down, left-right positions of the red checkerboard can be changed;

in this embodiment, the checkerboard angle (side length) is recommended as: 1-8 degrees; the time for the red checkerboard to stay at the up-down, left-right positions is as follows: 1 '-10'; the black and white checkerboard and the red checkerboard flash at the same frequency; the checkerboard flicker frequency is: 1 Hz-30 Hz;

in this embodiment, TRL training:

firstly, determining a preferred retina locus PRL of a user, wherein the PRL may be one or more, and selecting an optimal TRL training locus according to the fixation habit of the user;

setting parameters such as checkerboard target size, frequency, fixation level and the like at TRL sites; parameters are adjusted according to the visual condition of a user, namely, the parameters are big, small, slow, fast, easy and difficult;

guiding a user to find TRL sites and see the up-down, left-right position change of checkerboard red flickering;

in this embodiment, if the left side view of the TRL target of the user is blocked by the dark area, the user is informed to rotate the eyeball slowly to the right side, the checkerboard will see gradually, and when the whole checkerboard is seen, the fixation is maintained, and the user is required to maintain the fixation point in the area for as long as possible;

in the embodiment, the contralateral eyes are shielded, training is carried out in a dark environment, TRL fixation stability is kept as much as possible, each time is 10-15 minutes, rest is carried out at intervals, and accumulation is carried out for about 1 hour every day;

specific implementation of this embodiment:

as shown in fig. 4, the visual rehabilitation training target is judged and set according to visual field examination, a user visual field meter 10-2 program chart is 54 years old, after macular rupture Kong Shu, the central shadow of the complaint is shielded, and the visual object is deformed;

the ophthalmologist combines the medical history and physical examination results of the patient, including comprehensive consideration of treatment history, fundus photography, FFA, visual field, macular OCT and the like, and selects proper PRL (preferred retinal locus) and TRL (trained retinal locus) according to the daily life vision habit of the patient:

the vision rehabilitation training is carried out in a dark environment,

the training process can be divided into two major parts:

(1) Micro-vision inspection is carried out on the user, and a new TRL is selected for the user according to the inspection result:

(1) the macula lutea is required to be close to the central fovea of the retina as much as possible, and the corresponding macula lutea is required to be close to the central visual field as much as possible in the visual field;

(2) should be as close to the current PRL as possible, or take the center position of 2 adjacent PRLs;

(3) PRL used in combination with consideration of daily life vision habit;

(4) selecting a region with higher light sensitivity;

(5) the position is selected as far as possible from the upper part, and the reading habit and the gazing habit of the user are required to be met.

(2) In determining the training target position (X, Y), reference perimeter 10-2 program test chart setpoint:

firstly, simulating and selecting proper positions (X, Y) of the PRL to correspond to proper visual angle positions on a visual field diagram;

then selecting the numerical values of X and Y according to the auxiliary line of the visual angle in the 10-2 visual field diagram, wherein X represents the visual angle locus corresponding to the transverse axis of the auxiliary line, and Y represents the visual angle locus corresponding to the longitudinal axis of the auxiliary line;

finally, the selected target positions (X, Y) are issued through the management platform; the PRL locus of the rehabilitation training mirror is set by referring to the 10-degree visual field detection result, and the cross auxiliary line and the grid auxiliary line are set, so that the consistency correspondence of the position of a preset target point (X, Y) and the position of a transmitting user end can be realized.

The vision disorder rehabilitation training glasses are in an XR glasses type, so that a user can wear the vision disorder rehabilitation training glasses stably, the head of the user and the glasses are naturally ensured to be integrated, and the problem that the user keeps the fixed head position is fundamentally solved; the user rotates the trained eyeball according to the specified direction requirement, so that the user can easily watch the specified TRL training target, can keep fixation as long as possible, and is more beneficial to keeping the fixation time of the PRL longer than that of the micro-vision meter;

and (5) carrying out storage and portability. Training can be performed at any time in home, traveling and the like, and a specified training period and training time can be ensured;

recommending a training scheme: training for 1 hr for 10-15 min each time, 4-6 times daily, and continuously for 3 months; after 3 months, according to the visual rehabilitation effect evaluation of the user, the user can choose to continue training or carry out a new set of 3-6 months of consolidation training after a rest period of 1 month so as to help the visual plasticity consolidation.

Most of training is carried out without family members accompanying except for individual patients with serious vision disorder, so that the time of the family members is not occupied;

under the guidance of ophthalmologist doctors, the 'three-teacher rehabilitation coaches' jointly serve users, guide the users to better use equipment and train according to the standard requirements; under the guidance of doctors and the remote guidance of three-operator common management team, the user can achieve the same and even better strengthening training effect at home;

three operators: optometrist/rehabilitation assistance technique consultant/health manager

As shown in fig. 5, visual rehabilitation training (user side): setting and adjusting the position of a training target point, and remotely issuing;

the training process forms data visualization, a doctor can view the data at any time, and training parameters are remotely adjusted according to the data;

the doctor assistant 'three-teacher rehabilitation coach' team assists in follow-up, and the time can reach daily and weekly.

The compliance of users is high, and perfect closed loop from in-hospital treatment to home rehabilitation is practically and effectively realized.

Setting training parameters:

the ophthalmologist/optometrist sets a PRL site on the management platform and issues the PRL site;

the team of three engineers guides the user to use the rehabilitation training glasses on site, or can remotely guide the user to use the rehabilitation training glasses, the user wears the rehabilitation training glasses, the head position of the user is naturally kept fixed, the head position of the user is not required to be corrected in the training process, the user is only required to be guided to lightly rotate eyeballs to a specific direction to find PRL checkerboard visual targets, and the fixation is kept as much as possible; simultaneously, a Bluetooth handle is used for selecting the sighting target direction;

training parameters are adjusted, wherein the key point is to select TRL according to PRL, further convert the selected sites into training target coordinates (x, y) for positioning, and adjust parameters such as checkerboard side length, angle, density, flicker frequency, fixation level and the like according to the user condition.

As shown in fig. 6, visual rehabilitation training: the training completion user terminal/management terminal automatically generates a report;

fixation of a fixation target is needed during training, and a professional ophthalmologist/optometrist determines a rehabilitation training scheme; fixation grade is adjusted according to the requirement of rehabilitation training scheme;

training needs to adapt to different optic disc densities according to human eye vision, and a professional ophthalmologist/optometrist determines a rehabilitation training scheme; the density level of the video disc is adjusted according to the requirement of a rehabilitation training scheme;

in summary, the vision disorder rehabilitation training device based on the augmented reality is based on the XR glasses, has relatively proper economic cost, is beneficial to fixation, meets the requirements that the head is kept motionless, the eyes look forward to fix the point of fixation in the test and training process, ensures that the eyes are integrated with the head, and avoids irregular test and training caused by limb actions such as turning;

The invention can be independently used by testers, can be used periodically on application scenes to solve the problems of round trip hospitals and shortage of hospital resources, can be used for a long time under the guidance of software or service personnel such as exclusive ophthalmologists or optometrists,

the training maintenance time is prolonged, and the problems of double vision and the like are avoided.

The preferred embodiments of the invention disclosed above are intended only to assist in the explanation of the invention. The preferred embodiments are not exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best understand and utilize the invention. The invention is limited only by the claims and the full scope and equivalents thereof.

Claims

1. Visual disturbance rehabilitation training device based on augmented reality, including XR glasses, XR glasses include picture frame and baffle lens, its characterized in that: the infrared illuminator and the eye tracking camera are integrated and installed on the lower side of the baffle lenses, the diopter adjusting knob is integrated or the diopter lenses are arranged on the corresponding lens frame, the power key, the function key and the loudspeaker sound outlet are integrated on the lens legs of the lens frame, and the signal interface is arranged at the tail end.

2. The augmented reality-based vision impairment rehabilitation training device of claim 1, wherein: the XR glasses are connected with the mobile terminal through a signal interface, the micro-vision meter function is realized by application software of the mobile terminal, and the display screen is put on through the display module and the optical module, so that threshold vision inspection and fixation training are provided;

3. The augmented reality-based vision impairment rehabilitation training device of claim 1, wherein: the diopter adjusting knob supports diopter adjustment of-5D to 0D, and diopter marks are set.

4. Rehabilitation training system of vision disorder rehabilitation training device based on augmented reality, its characterized in that: the rehabilitation training system comprises:

5. The rehabilitation training system of an augmented reality-based vision disorder rehabilitation training device according to claim 4, wherein: the mobile terminal software of the rehabilitation training system is divided into a user terminal and a background terminal, the user terminal carries out rehabilitation training selection after registering and logging in, the mobile terminal software is connected with vision impairment rehabilitation training equipment through wires or Bluetooth, the mobile terminal software realizes user interaction and data presentation, and meanwhile, functional training can be started after the vision impairment rehabilitation training equipment is worn;

6. A rehabilitation training method of a rehabilitation training system of vision disorder rehabilitation training equipment based on augmented reality is characterized by comprising the following steps:

the rehabilitation training method comprises the following steps:

s1: center field and side center field test

s2: determination and training of preferred retinal sites

The background server and the mobile terminal software find and select the optimal retina sites according to the diagnosis and test results, determine the trained retina sites, send the point coordinates to the mobile software terminal of the patient, and the user terminal automatically receives and executes the optimal retina sites and trains.

7. The rehabilitation training method of the rehabilitation training system of the rehabilitation training device for visual disturbance based on the augmented reality according to claim 6, wherein:

determination and training of the preferred retinal locus, wherein the user is required to rotate the eye under the direction of a practitioner or autonomously; finding out a dynamic visual target, keeping fixation, and further manually selecting the azimuth of the embedded small visual target to strengthen the fixation and a hand, eye and brain feedback mechanism;

according to the settings of the various parameters, corresponding training parameters are formed in the training, and according to the training parameters, the retina sites are optimized and adjusted again, preferably.

8. The rehabilitation training method of the rehabilitation training system of the rehabilitation training device for visual disturbance based on the augmented reality according to claim 6, wherein:

determining and training the optimized retina loci, determining whether a user uses a paracentric trained retina locus to watch a dynamic checkerboard according to an eye tracking camera system set by XR glasses, and calculating fixation stability according to the fixation point position and fixation time length of the user;

9. The rehabilitation training method of the rehabilitation training system of the rehabilitation training device for visual disturbance based on the augmented reality according to claim 6, wherein:

the optimal retina sites are determined and trained, and the training visual marks are black and white flickering checkerboards;

the side length of the checkerboard is calculated and set according to the visual angle of human eyes, 1 side length unit corresponds to 1 degree visual angle, and the specific display sighting mark size is related to the optical parameters of the XR glasses.

The flicker frequency of the checkerboard, the fixation stay time and the stay time of the embedded red checkerboard are set by a visual field monitoring program;

the visual field monitoring program adopts a central visual field monitoring mode, adopts a strategy corresponding to a visual field meter and preferably adopts a 10-2, 24-2 or 30-2 strategy, and uses the 10-2 strategy to check the macula area within 10 degrees of the visual field center;

the visual field rehabilitation training is monocular, opposite eyes are required to be shielded, and the corresponding optical display modules on the XR glasses are controlled through software.

10. Application of visual disturbance rehabilitation training device based on augmented reality in visual disturbance rehabilitation training.