CN115770013A - Eye movement test method, device, equipment and medium for assisting vulnerable group - Google Patents
Eye movement test method, device, equipment and medium for assisting vulnerable group Download PDFInfo
- Publication number
- CN115770013A CN115770013A CN202211518447.9A CN202211518447A CN115770013A CN 115770013 A CN115770013 A CN 115770013A CN 202211518447 A CN202211518447 A CN 202211518447A CN 115770013 A CN115770013 A CN 115770013A
- Authority
- CN
- China
- Prior art keywords
- data
- subject
- early warning
- test
- eye movement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000004424 eye movement Effects 0.000 title claims abstract description 78
- 238000010998 test method Methods 0.000 title description 5
- 238000012360 testing method Methods 0.000 claims abstract description 145
- 238000000034 method Methods 0.000 claims abstract description 49
- 230000003340 mental effect Effects 0.000 claims abstract description 18
- 230000008569 process Effects 0.000 claims abstract description 15
- 201000010099 disease Diseases 0.000 claims abstract description 12
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 claims abstract description 12
- 210000001747 pupil Anatomy 0.000 claims description 53
- 230000008859 change Effects 0.000 claims description 25
- 238000004590 computer program Methods 0.000 claims description 7
- 238000013480 data collection Methods 0.000 claims description 7
- 238000005070 sampling Methods 0.000 claims description 6
- 230000000007 visual effect Effects 0.000 claims description 4
- 230000036760 body temperature Effects 0.000 claims description 3
- 238000004422 calculation algorithm Methods 0.000 claims description 3
- 230000002159 abnormal effect Effects 0.000 abstract description 6
- 230000036541 health Effects 0.000 abstract description 6
- 238000012544 monitoring process Methods 0.000 abstract description 3
- 230000001537 neural effect Effects 0.000 abstract description 2
- 230000015654 memory Effects 0.000 description 15
- 210000001508 eye Anatomy 0.000 description 12
- 230000006870 function Effects 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 230000001149 cognitive effect Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 7
- 230000019771 cognition Effects 0.000 description 6
- 206010016256 fatigue Diseases 0.000 description 6
- 210000004087 cornea Anatomy 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 208000024891 symptom Diseases 0.000 description 3
- 208000024827 Alzheimer disease Diseases 0.000 description 2
- 208000018737 Parkinson disease Diseases 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 206010020772 Hypertension Diseases 0.000 description 1
- 208000019914 Mental Fatigue Diseases 0.000 description 1
- 208000003464 asthenopia Diseases 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 210000004204 blood vessel Anatomy 0.000 description 1
- 238000009529 body temperature measurement Methods 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 208000029078 coronary artery disease Diseases 0.000 description 1
- 206010012601 diabetes mellitus Diseases 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 210000001061 forehead Anatomy 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001575 pathological effect Effects 0.000 description 1
- 230000033764 rhythmic process Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 238000001429 visible spectrum Methods 0.000 description 1
- 230000003245 working effect Effects 0.000 description 1
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Landscapes
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The application discloses an eye movement testing method and device for assisting vulnerable groups, and relates to the field of intelligent medical treatment. The specific implementation mode comprises the following steps: determining basic information of a subject belonging to the vulnerable group, wherein the basic information at least comprises age information and disease information; calibrating VR test equipment corresponding to a subject, and acquiring body sign data of the subject through the VR test equipment, wherein the body sign data at least comprises eye movement data and heart rate data; determining an early warning threshold corresponding to the subject according to the basic information; and if the physical sign data reach the early warning threshold value, early warning the mental stress state of the subject. The physical health of the testee is effectively guaranteed by monitoring the eye movement data, the heart rate data and the like of the testee. Once the data is abnormal, the neural pressure state of the testee in the eye movement testing process is abnormal, early warning can be carried out, corresponding measures are carried out, the health of the testee is guaranteed, and the probability of retesting is reduced.
Description
Technical Field
The application relates to the technical field of computers, in particular to the field of intelligent medical treatment, and particularly relates to a method, a device, equipment and a medium for assisting eye movement testing of vulnerable groups.
Background
VR technology, that is, virtual reality technology, is a computer simulation system that creates and experiences a virtual world, and generates a simulated environment using a computer, which immerses a user in the environment. The virtual reality technology is to combine electronic signals generated by computer technology with data in real life to convert the electronic signals into phenomena which can be felt by people, wherein the phenomena can be true and true objects in reality or substances which can not be seen by the naked eyes, and the phenomena are expressed by a three-dimensional model.
Eye tracking techniques, near-infrared light is directed toward the center of the eye (pupil) by infrared emitters deployed around the eye, causing detectable reflections in the pupil and cornea (the outermost optical element of the eye). These reflections (appearing as a vector between the cornea and the pupil) are tracked by the infrared camera. This is an optical tracking of corneal reflections, known as Pupil Center Corneal Reflections (PCCR). Light from the visible spectrum may produce uncontrolled specular reflections, while infrared light directly enters the pupil, it simply "bounces" the iris, thus allowing for precise discrimination between the pupil and the iris. Furthermore, since infrared light is not visible to humans, it does not cause distraction to participants when tracking the eyes. The eye tracker uses a near infrared light source to generate a reflected image on the cornea and pupil of the user's eye, and then uses two image sensors to capture the eye and the reflected image. The position of the eye in space and the sight line position are accurately calculated through an image processing algorithm and a three-dimensional eyeball model, and meanwhile, real-time data of the pupil size can also be obtained.
The new technology combining VR and eye movement can be used for measuring the cognitive level of the old, and has the technical advantages of immersive measurement experience and capability of accurately measuring quantized data. The method has the advantages that the cognitive test is integrated into a VR scene, and relevant physiological and pathological characteristics are corresponded by capturing and measuring eye movement data, so that the method is used as a high-efficiency and convenient means, great convenience is provided for clinical tests in relevant medical fields, and subjective cognitive errors of tests brought by traditional subjective eye movement observation tests and the influence of test external environments on test results are reduced.
However, in the prior art, the current testing time is relatively long, and most of the tested objects are weak people such as the elderly, which are easy to cause mental and eye fatigue, especially in the process of performing the eye movement cognition test, the test needs to be recalibrated or even terminated due to the fact that the test is separated from instrument equipment for rest or eyes are kneaded. The trouble is caused to the whole testing process, and meanwhile, the potential safety hazard influencing the health is increased in the testing process of the vulnerable group.
Disclosure of Invention
Aiming at the problem of difficulty in testing of the vulnerable group, the eye movement testing method and device for assisting the vulnerable group, the electronic equipment and the storage medium are provided.
According to a first aspect, there is provided an eye movement test method for assisting a vulnerable group of people, comprising:
determining basic information of a subject belonging to the vulnerable group, wherein the basic information at least comprises age information and disease information;
calibrating VR testing equipment corresponding to the subject, and acquiring physical sign data of the subject through the VR testing equipment, wherein the physical sign data at least comprises eye movement data and heart rate data;
determining an early warning threshold corresponding to the subject according to the basic information;
and if the physical sign data reach the early warning threshold value, early warning the mental stress state of the subject.
According to a second aspect, there is provided an eye movement testing device for assisting a vulnerable group of people, comprising:
a basic information determination unit which determines basic information of a subject belonging to a vulnerable group, the basic information including at least age information and disease information;
the data acquisition unit is used for calibrating VR testing equipment corresponding to the subject and acquiring physical sign data of the subject through the VR testing equipment, wherein the physical sign data at least comprises eye movement data and heart rate data;
the early warning threshold value determining unit is used for determining an early warning threshold value corresponding to the subject according to the basic information;
and the early warning unit is used for early warning the mental stress state of the subject if the physical sign data reaches the early warning threshold value.
According to a third aspect, there is provided an electronic device comprising: one or more processors; a storage device for storing one or more programs which, when executed by one or more processors, cause the one or more processors to implement a method as in any one of the embodiments of a method for eye movement testing of a person suffering from a disability.
According to a fourth aspect, a computer-readable storage medium is provided, having stored thereon a computer program which, when executed by a processor, performs the method as any one of the embodiments of the eye movement testing method for assisting a vulnerable group of people.
According to the scheme of the application, the eye movement data, the heart rate data and the like of the testee are monitored in the test process, and the physical health of the testee can be effectively guaranteed. Once the data is abnormal, the neural pressure state of the testee in the eye movement testing process is abnormal, early warning can be carried out at the moment, corresponding measures are carried out, the health of the testee is guaranteed, and the retesting probability is reduced.
Drawings
Other features, objects and advantages of the present application will become more apparent upon reading of the detailed description of non-limiting embodiments made with reference to the following drawings:
FIG. 1 is an exemplary system architecture diagram to which some embodiments of the present application may be applied;
FIG. 2 is a flow chart of one embodiment of a method of assisting eye movement testing of a vulnerable group of people according to the present application;
FIG. 3 is a schematic flow chart of a method for assisting eye movement testing of a vulnerable group of people according to one scenario of the present application;
FIG. 4 is a schematic diagram of one embodiment of an eye movement testing device for assisting a person with disability according to the subject application;
fig. 5 is a block diagram of an electronic device for implementing the eye movement testing method for assisting the vulnerable group according to the embodiment of the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
Fig. 1 shows an exemplary system architecture 100 to which embodiments of the eye movement testing method of the assisted vulnerable group or the eye movement testing device of the assisted vulnerable group of the present application may be applied.
As shown in fig. 1, the system architecture 100 may include terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 serves as a medium for providing communication links between the terminal devices 101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
A user may use terminal devices 101, 102, 103 to interact with a server 105 over a network 104 to receive or send messages or the like. Various communication client applications, such as a video application, a live application, an instant messaging tool, a mailbox client, social platform software, and the like, may be installed on the terminal devices 101, 102, and 103.
Here, the terminal apparatuses 101, 102, and 103 may be hardware or software. When the terminal devices 101, 102, 103 are hardware, they may be various electronic devices having a display screen, including but not limited to smart phones, tablet computers, e-book readers, laptop portable computers, desktop computers, and the like. When the terminal apparatuses 101, 102, 103 are software, they can be installed in the electronic apparatuses listed above. It may be implemented as multiple pieces of software or software modules (e.g., multiple pieces of software or software modules to provide distributed services) or as a single piece of software or software module. And is not particularly limited herein.
The server 105 may be a server providing various services, such as a background server providing support for the terminal devices 101, 102, 103. The background server can analyze and process the received data such as the physical sign data and feed back a processing result (such as an early warning threshold) to the terminal device.
It should be noted that the eye movement testing method for the assisted vulnerable group provided in the embodiment of the present application may be executed by the server 105 or the terminal devices 101, 102, and 103, and accordingly, the eye movement testing device for the assisted vulnerable group may be disposed in the server 105 or the terminal devices 101, 102, and 103.
It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for an implementation.
With continuing reference to fig. 2 and 3, a flow 200 of an embodiment of a method for assisting eye movement testing of a vulnerable group of people (in some scenarios, eye movement testing may also be referred to as eye movement cognition testing as shown in fig. 3) and a method flow in one scenario are shown according to the present application. In the present embodiment, an execution subject (e.g., a server or a terminal device shown in fig. 1) on which the eye movement test method of the assisted vulnerable group can be executed. The eye movement testing method for the auxiliary vulnerable group comprises the following steps:
The basic information may also include other information such as gender information, and the collection mode may be obtained based on questionnaire filling, other system importing modes, and the like.
The vulnerable population is mainly the elderly (for example, the elderly are considered as being 60 years old), and some people with partial diseases can be considered as the vulnerable population even if the ages of the people do not meet the requirements. The disease information mainly aims at the diseases easily obtained by the old, such as AD (Alzheimer disease), PD (Parkinson disease), hypertension, diabetes, coronary heart disease and the like.
The existing fatigue degree judging method mainly adopts the form of inquiry or questionnaire, and the inquiry type test mode has larger subjective influence, long time consumption and low inquirer compliance, and can not achieve the required real-time, automatic and user-friendly fatigue reminding and test interruption effects. Based on this, real-time automatic judgment is performed through physical sign data of the user.
The examinee carries out the calibration before the eye movement test after gathering up VR test equipment, and eye movement data acquisition equipment has been equipped with infrared eye movement sensor, infrared pupil sensor, infrared body temperature sensor, bluetooth receiver etc. and supporting also wearable infrared body temperature measurement bracelet, and it is connected with VR test equipment through the bluetooth agreement. The sensor signals are concentrated in a computing unit of the VR testing device. At this time, the computing unit of the VR testing device can record the sensor data of multiple channels in real time and keep continuous detection.
To the vulnerable crowd such as the old crowd that has multiple complication, combine equipment such as wearable bracelet wrist-watch when heart rate detects, realize the multi-device linkage through calling the interface, the detection of the vulnerable crowd such as the old person of being more convenient for.
Different subjects have different body states, so different early warning thresholds are set, the corresponding test result is more accurate, and the early warning is more reasonable.
And 204, if the physical sign data reach the early warning threshold, early warning the mental stress state of the subject.
And judging the mental stress state (also called as cognitive load condition) of the subject according to the heart rate data and the eye movement data transmitted by the VR testing equipment, and pausing or terminating the test after early warning to ensure the health of the subject.
The infrared heart rate sensing technology with relatively convenient and fast realizable degree is selected for use, the heart rate data of the testee are collected in real time to assist the fatigue monitoring work in the eye movement testing process, and the eye movement testing is not invasive and is not influenced. Therefore, the double-channel sensing data is used, the technical principle is considered, the fatigue monitoring work can achieve the real-time, efficient and safe working effect, and the safety and humanization of the eye movement test are improved.
The sensors are integrated into eye movement cognition VR testing equipment, the core function of the equipment is to provide eye movement cognition testing, the auxiliary function is to detect the mental load state of a subject in real time through the sensors, and the intervention behavior of test suspension or termination is actively carried out under the condition that the cognitive load of the subject is large or physiological and mental discomfort occurs in the testing, and the main purpose is to ensure the safety and reliability of the testing.
In the test process, the physiological indexes of the testee are measured to be abnormal through the infrared cornea reflection sensor and the infrared heart rate sensor, the test state of the testee is abnormal through data comparison, the test is suspended or stopped, sound warning is sent out, and the test is stopped in time. The progress of the eye movement cognition test process is recorded, and the progress of the test is saved in a patient file in the system, so that the test can be continued when the test is carried out next time conveniently.
In some optional implementation manners of this embodiment, the VR testing device at least includes an eye movement data collecting device, and the eye movement data collecting device includes an infrared eye movement sensor, an infrared pupil sensor, an infrared body temperature sensor, and the like.
The eye movement data is acquired by the eye movement data acquisition device based on a pupil-cornea tracking technology (pupil-cornea reflections) and a double-channel mode of bright pupil and dark pupil.
The eye movement data comprises pupil position data and pupil size data, wherein the sensor receives infrared bright spots with the same size as the pupil through infrared light irradiation of the bright pupil channel, and therefore the pupil size data is obtained through a visual algorithm.
In most of the eye movement techniques in the prior art, a two-channel acquisition mode is not used, and the acquisition mode of a bright pupil channel can acquire the size of a pupil, but is not used for fatigue assessment of a user. Meanwhile, the fatigue degree cannot be completely proved by only pupil diameter data, and an additional parameter index is also needed to assist judgment.
The eye movement collection technology uses a non-invasive infrared cornea reflection accurate positioning method without any physical contact with eyes. The pupil position is accurately positioned, the calculation parameters are adjusted according to different individuals, the color brightness is adjusted, and the device is suitable for testing comfortable environments of different crowds. Meanwhile, the eye movement acquisition mechanism after function expansion can measure the pupil size, and time stamps are applied to pupil diameter data to form a pupil diameter data set.
In some optional implementations of this embodiment, the VR testing device includes at least a heart rate data collection device, and the heart rate data collection device includes a plurality of heart rate data collection devices, each of which is disposed at a different location of the subject.
By adopting the heart rate sensing technology, the device can be placed at a plurality of positions such as hands, trunks, faces and the like in principle. A reflection type optical sensor with transistor output generally uses a range from 700nm (red) to 1000nm (infrared) for biological measurement, light beams can penetrate through a narrow part of a body, reach a blood vessel to reflect and then return to a light ray from the sensor, signals are sent to an operational amplifier for enhancing and shaping, and finally a heart rate graph of a typical waveform can be obtained, so that the wave peak can be analyzed to obtain the heart rate condition, and heart rate data can be obtained.
In some optional implementations of the present embodiment, the VR testing device includes at least a temperature sensor, the temperature sensor corresponding to a face of the subject. The temperature sensor is additionally arranged on the surface of the light shield at the forehead, the face is attached to achieve the best measuring effect, the temperature data is stamped with a time stamp to form a temperature data set, and therefore the temperature data is used as partial data in human body sign data to assist in judging the state of a subject.
In some optional implementations of this embodiment, multiple VR testing devices that have been described above are integrated to obtain corresponding data and perform corresponding acquisition.
Specifically, the heart rate data includes a plurality of heartbeat data respectively corresponding to a plurality of heart rate data acquisition devices, for example, bluetooth wearing heart rate sensor data — heartbeat B 1 (sub/sec), and head contact heart rate sensor data-heartbeat B 2 (times/second). The pupil size data includes pupil diameter, e.g., pupil size sensor data-pupil diameter R (millimeters).
And setting sampling interval time respectively aiming at the heartbeat data and the pupil size data. For example, the heart rate sensor has a sample rate f 1 The fixed value is 25Hz; pupil sampling rate of f 2 The fixed value is 5Hz. And setting interval sampling time, the heart rate part is delta t 1 ＝1/f 1 Through Δ t 1 The latter heart rate data is B 1 ' and B 2 '; the pupil portion is Δ t 2 ＝1/f 2 Through Δ t 2 The latter heart rate data is R'.
And determining corresponding change rate data according to the sampling interval time, wherein the change rate data comprises a heart rate change rate and a pupil change rate. At this time, the heart rate change rate k can be known from the data flow of each sensor 1 ＝(B 1 ′-B 1 )/Δt 1 ；k 2 ＝|B 2 ′-B 2 |/Δt 1 (ii) a Pupil rate of change k 3 ＝|R′-R|/Δt 2 。
Further, according to the age information, determining threshold values corresponding to the heartbeat data and the pupil size data; when the subject has various symptoms, weighting is carried out according to the symptom information to obtain the threshold values corresponding to the heart rate change rate and the pupil change rate.
When the experimenter was worn and is had wearable equipment such as intelligent bracelet or intelligent wrist-watch, can transfer this intelligence wearing equipment and detect the patient in the rhythm of the heart change data of a period of time in the past, supplementary judgement.
If the heartbeat data is higher than the first threshold value, the pupil size data is lower than the second threshold value, the heart rate change rate is higher than the third threshold value, and the pupil change rate is higher than the fourth threshold value, a judgment is triggered, and the duration time is higher than the preset time, the test is suspended, and the mental stress state of the testee is early warned. For example, a pause warning threshold is set, and if any 1 threshold is triggered by three data, the system is judged to give a warning. B 1 ，B 2 Not less than 80; r is less than or equal to 4, change rate k 1 ，k 2 Not less than 10 times/second 2 )，k 3 Not less than 0.2 (mm/s); if the state continues for more than 10s, the system is determined to suspend the test, as shown in the following table.
And if the heartbeat data is higher than a fifth threshold value, the pupil size data is lower than a sixth threshold value, the heart rate change rate is higher than a seventh threshold value, and the pupil change rate is higher than an eighth threshold value, triggering at least two judgments, stopping the test, and early warning the mental stress state of the subject. The fifth threshold, the seventh threshold and the eighth threshold are respectively higher than the first threshold, the third threshold and the fourth threshold, and the sixth threshold is lower than the second threshold. For example, a termination threshold is set, and if three data trigger any 2 thresholds, the system is determined to terminate the test. B is 1 ,B 2 Not less than 100; r is less than or equal to 3.5, and the change rate k 1 ,k 2 Not less than 20 (times/second) 2 )，k 3 Not less than 0.5 (mm/s), as shown in the following table.
In some alternative implementations of the present embodiment, after pausing or terminating the test, feedback is provided to the subject and the test taker, and the test breakpoint is recorded while pausing. When the data of the heart rate and the pupil size exceed the pause or termination threshold values corresponding to the age and the disease symptoms, the system simultaneously reminds the testers and the testees in a visual and auditory feedback mode, pauses or terminates the ongoing eye movement cognitive test and records a test breakpoint.
Before the next test, the system judges whether the test is in the interrupted state, if the test is in the interrupted state, the test subject needs to perform a pretest (also called a state judgment test) in advance before the test, in the process of the pretest, a relaxation video is played for the test subject to enable the test subject to relax fully, and meanwhile, the mental load state of the test subject is monitored through a multi-channel sensor. If the time is lower than the warning threshold corresponding to the pause test within a certain time, the system judges that the eye movement cognition test can be continued. If the subject still accords with the early warning threshold corresponding to the pause test, the relaxation time is prompted for two minutes, if the early warning threshold corresponding to the termination test exceeds 5s, or the pause test reaches 3 times, the test is directly ended
And judging whether the user can continue the test according to the data of the various sensing devices before the interrupted test is restarted so as to ensure that the physiological indexes and the psychological states of the testee can continue the eye movement cognitive test.
With further reference to fig. 4, as an implementation of the method shown in the above figures, the present application provides an embodiment of an eye movement testing device for assisting the vulnerable group, which corresponds to the embodiment of the method shown in fig. 2, and which may include the same or corresponding features or effects as the embodiment of the method shown in fig. 2, in addition to the features described below. The device can be applied to various electronic equipment in particular.
As shown in fig. 4, the eye movement test apparatus 400 for assisting the vulnerable group of the present embodiment includes: a basic information determining unit 401, a data collecting unit 402, an early warning threshold determining unit 403 and an early warning unit 404. Wherein the basic information determining unit 401 is configured to determine basic information of a subject belonging to the vulnerable group, the basic information including at least age information, condition information; a data acquisition unit 402 configured to calibrate a VR testing device corresponding to the subject and acquire physical sign data of the subject through the VR testing device, where the physical sign data includes at least eye movement data and heart rate data; an early warning threshold determination unit 403 configured to determine an early warning threshold corresponding to the subject according to the basic information; an early warning unit 404 configured to perform an early warning on the mental stress state of the subject if the physical sign data reaches the early warning threshold.
In this embodiment, specific processes of the basic information determining unit 401, the data acquiring unit 402, the early warning threshold determining unit 403, and the early warning unit 404 of the eye movement testing apparatus 400 for assisting the vulnerable group and technical effects brought by the specific processes may respectively refer to relevant descriptions of step 201, step 202, step 203, and step 204 in the corresponding embodiment of fig. 2, and are not described herein again.
According to an embodiment of the present application, an electronic device and a readable storage medium are also provided.
Fig. 5 is a block diagram of an electronic device of an eye movement testing method for assisting a vulnerable group according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the applications described and/or claimed herein.
As shown in fig. 5, the electronic apparatus includes: one or more processors 501, memory 502, and interfaces for connecting the various components, including high-speed interfaces and low-speed interfaces. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing some of the necessary operations (e.g., as an array of servers, a group of blade servers, or a multi-processor system). Fig. 5 illustrates an example of a processor 501.
The memory 502, which is a non-transitory computer-readable storage medium, may be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as program instructions/modules corresponding to the eye movement testing method for the assisted vulnerable group in the embodiment of the present application (for example, the basic information determination unit 401, the data acquisition unit 402, the early warning threshold determination unit 403, and the early warning unit 404 shown in fig. 4). The processor 501 executes various functional applications and data processing of the server by running non-transitory software programs, instructions and modules stored in the memory 502, so as to implement the eye movement testing method for assisting the vulnerable group in the above method embodiment.
The memory 502 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created from use of the eye movement test electronics of the assisted visually impaired person, and the like. Further, the memory 502 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, memory 502 optionally includes memory remotely located from processor 501, which may be connected to eye-test electronics assisting the vulnerable group of people via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device for assisting the eye movement test method of the vulnerable group may further include: an input device 503 and an output device 504. The processor 501, the memory 502, the input device 503 and the output device 504 may be connected by a bus or other means, and fig. 5 illustrates the connection by a bus as an example.
The input device 503 may receive input numeric or character information and generate key signal inputs related to user settings and function controls of the eye-movement test apparatus for assisting the vulnerable group of people, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointer stick, one or more mouse buttons, a track ball, a joystick or other input devices. The output devices 504 may include a display device, auxiliary lighting devices (e.g., LEDs), and tactile feedback devices (e.g., vibrating motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present application may be implemented by software or hardware. The described units may also be provided in a processor, and may be described as: a processor comprises a basic information determining unit, a data collecting unit, an early warning threshold determining unit and an early warning unit. Where the names of these units do not in some cases constitute a limitation on the unit itself, for example, the basic information determining unit may also be described as a "unit that determines the basic information of the subject".
As another aspect, the present application also provides a computer-readable medium, which may be contained in the apparatus described in the above embodiments; or may be present separately and not assembled into the device. The computer readable medium carrying one or more programs which, when executed by the apparatus, cause the apparatus to: determining basic information of a subject belonging to the vulnerable group, wherein the basic information at least comprises age information and disease information; calibrating VR testing equipment corresponding to the subject, and acquiring physical sign data of the subject through the VR testing equipment, wherein the physical sign data at least comprises eye movement data and heart rate data; determining an early warning threshold corresponding to the subject according to the basic information; and if the physical sign data reach the early warning threshold value, early warning the mental stress state of the subject.
The above description is only a preferred embodiment of the application and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention herein disclosed is not limited to the particular combination of features described above, but also encompasses other arrangements formed by any combination of the above features or their equivalents without departing from the spirit of the invention. For example, the above features may be replaced with (but not limited to) features having similar functions disclosed in the present application.
Claims (10)
1. A method of assisting eye movement testing of a vulnerable population, the method comprising:
determining basic information of a subject belonging to the vulnerable group, wherein the basic information at least comprises age information and disease information;
calibrating VR testing equipment corresponding to the subject, and acquiring physical sign data of the subject through the VR testing equipment, wherein the physical sign data at least comprises eye movement data and heart rate data;
determining an early warning threshold corresponding to the subject according to the basic information;
and if the physical sign data reach the early warning threshold value, early warning the mental stress state of the subject.
2. The method of claim 1, the VR testing device comprising at least an eye movement data collection device comprising an infrared eye movement sensor, an infrared pupil sensor, an infrared body temperature sensor;
acquiring, by the VR testing device, physical sign data of the subject, specifically including:
the eye movement data are collected through the eye movement data collection equipment based on a pupil-cornea tracking technical method and a bright pupil-dark pupil double-channel mode, the eye movement data comprise pupil position data and pupil size data, infrared light of a bright pupil channel irradiates, a sensor receives infrared bright spots with the same size as the pupil, and therefore the pupil size data are obtained through a visual algorithm.
3. The method of claim 1, the VR testing device comprising at least a heart rate data collection device, the heart rate data collection device comprising a plurality of devices, each device disposed at a different location on the subject;
collecting body sign data of the subject through the VR testing device, specifically including:
and transmitting a corresponding infrared light beam to the subject through the heart rate data acquisition equipment, and obtaining heart rate data corresponding to the subject through an operational amplifier according to a returned signal.
4. The method of claim 1, the VR testing device including at least a temperature sensor, the temperature sensor corresponding to a face of the subject;
acquiring, by the VR testing device, physical sign data of the subject, specifically including:
the face of the subject is attached through the temperature sensor so as to collect temperature data of the subject, and the temperature data is used as partial data in the human body sign data.
5. The method according to claim 2 or 3, wherein the heart rate data comprises a plurality of heartbeat data respectively corresponding to a plurality of heart rate data acquisition devices;
collecting body sign data of the subject through the VR testing device, specifically including:
setting sampling interval time respectively aiming at the heartbeat data and the pupil size data;
and determining corresponding change rate data according to the sampling interval time, wherein the change rate data comprises a heart rate change rate and a pupil change rate.
6. The method according to claim 5, wherein determining the pre-alarm threshold corresponding to the subject according to the basic information specifically comprises:
determining a threshold corresponding to the heartbeat data and the pupil size data according to the age information; weighting according to the disease information to obtain threshold values corresponding to the heart rate change rate and the pupil change rate;
if the physical sign data reaches the early warning threshold, early warning the mental stress state of the subject, specifically comprising:
if the heartbeat data is higher than a first threshold value, the pupil size data is lower than a second threshold value, the heart rate change rate is higher than a third threshold value, and the pupil change rate is higher than a fourth threshold value, triggering a judgment, and if the duration time is higher than a preset time, suspending the test and early warning the mental stress state of the subject;
if the heartbeat data is higher than a fifth threshold value, the pupil size data is lower than a sixth threshold value, the heart rate change rate is higher than a seventh threshold value, and the pupil change rate is higher than an eighth threshold value, triggering at least two judgments, stopping testing, and early warning the mental stress state of the subject; the fifth threshold, the seventh threshold, and the eighth threshold are respectively higher than the first threshold, the third threshold, and the fourth threshold, and the sixth threshold is lower than the second threshold.
7. The method of claim 6, further comprising:
after pausing or terminating the test, feeding back the test subject and the test taker, and recording a test breakpoint when pausing;
before the next test, if the corresponding test breakpoint exists in the test subject, performing a pretest on the test subject, playing a relaxation video for the test subject in the pretest process, if the test subject still accords with the early warning threshold corresponding to the pause test, pausing the test again, and stopping the test after the pause test reaches the preset times or accords with the early warning threshold corresponding to the termination test.
8. An eye movement testing device to assist in the vulnerable population, the device comprising:
a basic information determination unit which determines basic information of a subject belonging to a vulnerable group, the basic information including at least age information and disease information;
the data acquisition unit is used for calibrating VR testing equipment corresponding to the subject and acquiring physical sign data of the subject through the VR testing equipment, wherein the physical sign data at least comprises eye movement data and heart rate data;
the early warning threshold value determining unit is used for determining an early warning threshold value corresponding to the subject according to the basic information;
and the early warning unit is used for early warning the mental stress state of the subject if the physical sign data reaches the early warning threshold value.
9. An electronic device, comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-7.
10. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, carries out the method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211518447.9A CN115770013B (en) | 2022-11-30 | 2022-11-30 | Eye movement test method, device, equipment and medium for auxiliary weak population |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211518447.9A CN115770013B (en) | 2022-11-30 | 2022-11-30 | Eye movement test method, device, equipment and medium for auxiliary weak population |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115770013A true CN115770013A (en) | 2023-03-10 |
| CN115770013B CN115770013B (en) | 2023-07-14 |
Family
ID=85390699
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211518447.9A Active CN115770013B (en) | 2022-11-30 | 2022-11-30 | Eye movement test method, device, equipment and medium for auxiliary weak population |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115770013B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103886307A (en) * | 2014-04-15 | 2014-06-25 | 王东强 | Sight tracking and fatigue early warning method |
| US9357966B1 (en) * | 2014-12-18 | 2016-06-07 | Karen Elise Cohen | Drug screening device for monitoring pupil reactivity and voluntary and involuntary eye muscle function |
| CN113749619A (en) * | 2021-09-13 | 2021-12-07 | 上海大学 | Mental fatigue assessment method based on K-TRCA |
| CN114038162A (en) * | 2021-12-29 | 2022-02-11 | 神思电子技术股份有限公司 | Vulnerable user nursing and alarming method, equipment and medium |
| CN115100704A (en) * | 2022-05-20 | 2022-09-23 | 河北科技大学 | Face recognition device and method for resisting spoofing attack by combining thermal infrared and visible light |
-
2022
- 2022-11-30 CN CN202211518447.9A patent/CN115770013B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103886307A (en) * | 2014-04-15 | 2014-06-25 | 王东强 | Sight tracking and fatigue early warning method |
| US9357966B1 (en) * | 2014-12-18 | 2016-06-07 | Karen Elise Cohen | Drug screening device for monitoring pupil reactivity and voluntary and involuntary eye muscle function |
| CN113749619A (en) * | 2021-09-13 | 2021-12-07 | 上海大学 | Mental fatigue assessment method based on K-TRCA |
| CN114038162A (en) * | 2021-12-29 | 2022-02-11 | 神思电子技术股份有限公司 | Vulnerable user nursing and alarming method, equipment and medium |
| CN115100704A (en) * | 2022-05-20 | 2022-09-23 | 河北科技大学 | Face recognition device and method for resisting spoofing attack by combining thermal infrared and visible light |
Non-Patent Citations (1)
| Title |
|---|
| 胥川;裴赛君;王雪松;: "基于无侵入测量指标的个体差异化驾驶疲劳检测", 中国公路学报, no. 10 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115770013B (en) | 2023-07-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Rovini et al. | How wearable sensors can support Parkinson's disease diagnosis and treatment: a systematic review | |
| US8323216B2 (en) | System and method for applied kinesiology feedback | |
| Lamonaca et al. | Health parameters monitoring by smartphone for quality of life improvement | |
| AU2014225626B2 (en) | Form factors for the multi-modal physiological assessment of brain health | |
| US8025404B2 (en) | Method and apparatus for monitoring eye tremor | |
| AU2016201728B2 (en) | A system and method for determining psychological stress of a person | |
| US20220148728A1 (en) | System and method for analyzing stress of user and managing individual mental health, using hmd device having biosignal sensors mounted therein | |
| KR20200071647A (en) | Biofeedback method based on virtual/augmented reality contents and bio-signal for diagnosis and healing of mental illness | |
| US20230233152A1 (en) | Methods, apparatus and systems for adaptable presentation of sensor data | |
| CN115770013B (en) | Eye movement test method, device, equipment and medium for auxiliary weak population | |
| EP3417771A1 (en) | A method for monitoring blood pressure, and a device thereof | |
| US20220125323A1 (en) | Systems, devices, and methods for detecting brain conditions from cranial movement due to blood flow in the brain | |
| WO2016040647A2 (en) | Method and apparatus for monitoring eye tremor | |
| Saraguro et al. | Analysis of hand movements in patients with Parkinson’s Disease using Kinect | |
| Daniol et al. | Eye-tracking in Mixed Reality for Diagnosis of Neurodegenerative Diseases | |
| CN108451526A (en) | The method and system of frequency domain heart information are detected using pupillary reaction | |
| KR20220047187A (en) | Server and method for cognitive function testing using feature combination | |
| CN113855024A (en) | Wearable equipment for all-weather evaluation of depression symptoms of depression patients | |
| CN114554958A (en) | Stroke detection and prevention systems and methods | |
| WO2023061591A1 (en) | Determining the quality of setting up a headset for cranial accelerometry | |
| KR20010103223A (en) | The objective visual acuity test system by computer device | |
| Karaca | The metabolic efficiency of walking is reduced in patients with intermittent claudication |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |