CN114451874A

CN114451874A - Intelligent eye patch, terminal equipment, health management method and system

Info

Publication number: CN114451874A
Application number: CN202011244217.9A
Authority: CN
Inventors: 张慧; 李靖
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2020-11-10
Filing date: 2020-11-10
Publication date: 2022-05-10
Also published as: WO2022100407A1

Abstract

The application provides an intelligent eye patch, terminal equipment, a health management method and a health management system, and relates to the technical field of health management, wherein a signal acquisition unit, a processing unit and an EEG electrode are arranged on the intelligent eye patch, and the signal acquisition unit can detect an EEG signal corresponding to the EEG electrode, a heart rate signal of a wearer and a head movement signal; the processing unit can carry out epileptic detection according to the EEG signal, the heart rate signal and the head movement signal, and can send epileptic seizure data to the terminal equipment connected with the intelligent eye patch under the condition that epileptic seizure is detected; the terminal device may display a seizure record generated based on the acquired seizure data in response to an operation by a user. The technical scheme provided by the application can realize the monitoring and management of the epileptic disease and can improve the accuracy of the epileptic detection result.

Description

Intelligent eye patch, terminal equipment, health management method and system

Technical Field

The application relates to the technical field of health management, in particular to an intelligent eyeshade, a terminal device, a health management method and a health management system.

Background

Epilepsy is a chronic disease in which there is a sudden abnormal firing of neurons in the brain, resulting in transient cerebral dysfunction, which is typically characterized by recurrent seizures or by long or short tic symptoms. For epileptic patients, it is desirable to help physicians understand the condition of the patient by recording the seizure status of the epilepsy.

Seizures are unpredictable and repetitive and may occur at daytime and night. For seizures during the day, they can be found and recorded by the patient's relatives and friends; during the night sleep period, the patients are generally independent and the epileptic seizure is difficult to find, which is not beneficial to the management of epileptic diseases, so that the epileptic seizure during the sleep period (i.e. sleep epilepsy) needs to be monitored.

Disclosure of Invention

In view of this, the present application provides an intelligent eye patch, a terminal device, a health management method and a system, which are used for monitoring and managing an epileptic disease.

In order to achieve the above object, in a first aspect, embodiments of the present application provide an intelligent eye shield provided with a signal acquisition unit, a processing unit, and an electroencephalogram (EEG) electrode, wherein,

the signal acquisition unit is used for:

detecting an EEG signal corresponding to the EEG electrode;

detecting a heart rate signal of the wearer;

detecting a head movement signal of the wearer;

the processing unit is configured to:

performing epilepsy detection based on the EEG signal, the heart rate signal and the head movement signal;

and in the case of detecting the epileptic seizure, transmitting epileptic seizure data to a terminal device connected with the intelligent eye shield.

According to the intelligent eye patch provided by the embodiment of the application, the epilepsy detection can be performed through the EEG signal, the heart rate signal and the head movement signal collected by the intelligent eye patch, so that the monitoring of the sleep epilepsy is realized; and the intelligent eyeshade can transmit epileptic seizure data to the terminal equipment, and helps a user to manage epilepsy. In addition, the brain wave of the patient is very obvious when the epilepsy occurs, the situations of abnormal heartbeat, body convulsion and the like can also occur, the EEG signal can well reflect the brain wave change situation when the epilepsy occurs, the heart rate signal can reflect the heart rate change situation when the epilepsy occurs, the head movement signal can reflect the head movement situation when the epilepsy occurs, and the signal is little interfered by body movement (such as hand movement), so that the epilepsy detection is performed by combining the EEG signal, the heart rate signal and the head movement signal, and the accuracy of the epilepsy detection result can be effectively improved.

In a possible implementation manner of the first aspect, the intelligent eyeshade comprises an eyeshade body and fixing belts connected with two ends of the eyeshade body, and the EEG electrodes are located on the eyeshade body in an area corresponding to the forehead of a human body. This allows more accurate EEG signals to be collected.

In one possible implementation of the first aspect, the signal acquisition unit comprises: simulation front end chip, photoplethysmography sensor and acceleration sensor, the intelligence eye-shade still includes: the analog front-end chip is used for outputting EEG signals corresponding to the EEG electrodes according to the signals collected by the reference electrode and the signals collected by the EEG electrodes; the photoplethysmography sensor is for detecting a heart rate signal of the wearer; the acceleration sensor is used for detecting a head movement signal of the wearer.

In the above embodiment, by providing the reference electrode, the EEG signals corresponding to each EEG electrode are obtained according to the signals collected by the reference electrode and the signals collected by each EEG electrode, so that the accuracy of the obtained EEG signals can be improved; moreover, the analog front-end chip has the functions of signal filtering, amplification, analog-to-digital conversion and the like, and the accuracy of the obtained EEG signal can be further improved by adopting the analog front-end chip, so that the accuracy of the epilepsy detection result can be improved by the reference electrode and the analog front-end chip. In addition, the heart rate is measured by adopting the photoelectric plethysmography sensor, the structure is simple, and the portability of the intelligent eyeshade and the comfort of a user can be improved; the signals acquired by the acceleration sensor can well reflect the head movement condition, and the accuracy of the detection result is ensured.

In one possible embodiment of the first aspect, the reference electrode is connected to the fixed strip by a connecting wire. The reference electrode is simple in arrangement mode, and complexity of the intelligent eyeshade can be reduced.

In one possible embodiment of the first aspect, a nose mask is provided on a lower side of a middle portion of the eyecup body, and the reference electrode is provided on the nose mask at a position corresponding to a tip of a nose of a human body. The arrangement mode of the reference electrode is convenient for users to use, and better EEG reference potential can be obtained.

In a possible embodiment of the first aspect, a nose bridge strip matched with the nose bridge is arranged on the eyeshade body at a position corresponding to the nose bridge. Therefore, the user can make the nose cover better fit the nose by adjusting the nose bridge strip, and the accuracy of the reference potential measured by the reference electrode is improved.

In one possible implementation of the first aspect, the EEG electrodes comprise a plurality, the smart eye patch further comprising: the elasticity adjusting module, the processing unit is specifically used for: detecting the signal quality of an EEG signal corresponding to each EEG electrode, and carrying out epilepsy detection according to the EEG signal, the heart rate signal and the head movement signal under the condition that the signal quality of each EEG signal meets the requirement; and under the condition that the signal quality of any EEG signal does not meet the requirement, controlling the tightness adjusting module to adjust the tightness of the intelligent eye patch.

In the above embodiment, under the condition that the signal quality of each EEG signal meets the requirement, the epilepsy detection is performed according to the signal data acquired by the signal acquisition unit, so that the accuracy of the epilepsy detection result can be ensured; under the condition that the signal quality of the EEG signal does not meet the requirements, the tightness adjusting module is controlled to adjust the tightness of the intelligent eye patch, so that the EEG electrode can be fully contacted with the skin to obtain better EEG signal quality, and the accuracy of the epilepsy detection result is improved.

In a possible implementation manner of the first aspect, the processing unit is further configured to: determining a target EEG signal from the EEG signals, detecting the signal quality of the target EEG signal, and detecting the sleep state of the user according to the target EEG signal under the condition that the signal quality of the target EEG signal meets the requirement; controlling the tightness adjustment module to adjust the tightness of the intelligent eyeshade if the signal quality of the target EEG signal does not meet requirements; and sending corresponding sleep state data to the terminal equipment.

In the above embodiment, the target EEG signal is determined from the EEG signals of the signal data, and the sleep state of the user is detected according to the signal data when the signal quality of the target EEG signal meets the requirement, so that the accuracy of the sleep detection result can be ensured, and the processing efficiency can be improved; under the condition that the signal quality of the target EEG signal does not meet the requirement, the tightness adjusting module is controlled to adjust the tightness of the intelligent eye patch, so that an EEG electrode can be fully contacted with the skin to obtain better EEG signal quality, and the accuracy of a sleep detection result is improved; in addition, the intelligent eyeshade can send corresponding sleep state data to the terminal equipment to help the user to carry out sleep management.

In a possible implementation of the first aspect, the at least two EEG electrodes are symmetrically arranged on both sides of the intelligent eye patch, and the processing unit is specifically configured to: detecting the sleeping posture of the user according to the head movement signal; if the sleeping posture of the user is lying on the side, determining an EEG signal corresponding to an EEG electrode on the same side as the sleeping posture of the user as a target EEG signal; and if the sleeping posture of the user is lying, determining the EEG signal with the best signal quality in the EEG signals as a target EEG signal.

In the above embodiment, at least two EEG electrodes are symmetrically arranged on two sides of the intelligent eyeshade, so that the intelligent eyeshade can adapt to different sleeping postures of a user, and the accuracy of a sleep detection result is improved. In addition, the intelligent eyeshade detects the sleeping posture of the user according to the head movement signal; when the sleeping posture of the user lies on the side, determining an EEG signal collected by an EEG electrode on the same side as the sleeping posture of the user as a target EEG signal; when the sleeping posture of the user lies flat, the EEG signal with the best signal quality in all the EEG signals is determined as the target EEG signal, so that when the user lies on the side, the signal quality of each path of EEG signal does not need to be judged, the detection efficiency can be improved to a certain degree, and the power consumption can be reduced.

In a possible implementation manner of the first aspect, the processing unit is specifically configured to: and determining the EEG signal with the best signal quality in each EEG signal as a target EEG signal. When the method is used for determining the target EEG signal, other sensor signals are not needed, and the detection method is simple.

In one possible implementation of the first aspect, the intelligent eyewear further comprises: and the processing unit is also used for controlling the sleep stimulation module to output a stimulation signal for improving the sleep state of the user according to the EEG signal and the detected sleep state. This may improve the sleep quality of the user by the stimulus signal.

In one possible embodiment of the first aspect, the seizure data comprises a plurality of the following data: the time of the epileptic seizure, the duration of the epileptic seizure, the severity of the epileptic seizure, the EEG signal detected by the signal acquisition unit between a first moment before the epileptic seizure and a second moment after the epileptic seizure is over, the heart rate signal and the head movement signal.

In a second aspect, an embodiment of the present application provides a health management method, applied to a terminal device, including:

acquiring epileptic seizure data detected by the intelligent eye mask in the first aspect;

in response to a first operation by a user, displaying seizure records generated based on the acquired seizure data, each seizure record including a severity of a seizure, a seizure time, and a seizure duration.

The first operation may be a voice instruction input operation of the user, or may be a click operation of the user on a target option (such as an epilepsy recording card provided by the terminal device in the health management application). The terminal device may display the seizure record in an seizure record detail page.

According to the health management method provided by the embodiment of the application, the terminal equipment can acquire the epileptic seizure data from the intelligent eye shield, can respond to user operation, and displays the epileptic seizure record generated based on the acquired epileptic seizure data, so that a user can conveniently check and manage epileptic seizure conditions.

In one possible implementation of the second aspect, the method further comprises: responding to a second operation of the user, and acquiring epileptic seizure data input by the user; and updating seizure records.

The second operation may include operations in which the user manually adds the epileptic seizure data, for example, the terminal device may provide an addition control in the epileptic recording details page, and the user may click the addition control to confirm the added epileptic seizure record through a confirmation operation after inputting the epileptic seizure data in the open epileptic seizure record addition interface.

The terminal equipment can record the epileptic seizure data conveniently by providing the epileptic seizure data manual adding function, and then convenience of epileptic management of a user can be improved.

In one possible implementation of the second aspect, the method further comprises: and reminding the target contact person when the user is determined to be in the epileptic seizure state according to the epileptic seizure data and the severity of the epileptic seizure reaches the target severity. Therefore, the guardian can be reminded in time when the epileptic seizure of the patient is serious, and the adverse effect of the epileptic seizure on the patient is reduced.

In one possible implementation manner of the second aspect, the reminding target contact includes:

sending help seeking information to the target contact person;

and/or calling the target contact person and playing a help recording to the target contact person, wherein the severity of the epileptic seizure is indicated in both the help information and the help recording.

The guardian can be informed in time by adopting help seeking information or a help seeking telephone; in addition, the severity of the epileptic seizure is indicated in the help information and the help recording, so that a guardian can conveniently know the epileptic seizure condition of the patient, and better take countermeasures.

In one possible implementation manner of the second aspect, before the reminding the target contact, the method further includes:

responding to a third operation of the user, and displaying an intelligent eyeshade setting interface;

and responding to a fourth operation performed by the user in the intelligent eye shield setting interface, starting an emergency call function, and storing a target contact set by the user.

The terminal device may provide device editing options corresponding to various paired intelligent health devices (such as an intelligent eyeshade), and the third operation may be a click operation of the user on the device editing options corresponding to the intelligent eyeshade; in addition, an emergency call option can be provided in the intelligent eyeshade equipment interface, and the fourth operation can comprise an operation of clicking the emergency call option by a user, and an operation of starting an automatic help-sending information function, an automatic help-calling telephone function and/or setting an emergency contact person in the opened emergency call interface.

The terminal equipment can facilitate the user to set the individualized emergency call for help of the epileptic seizure by providing the emergency call setting function, so that the user experience is improved.

In one possible implementation of the second aspect, the method further comprises: and responding to a fifth operation performed by the user in the intelligent eyeshade setting interface, and controlling the intelligent eyeshade to turn on or off target functions, wherein the target functions comprise an epilepsy monitoring function for continuously performing epilepsy detection and/or a sleep monitoring function for continuously performing sleep state detection.

The terminal device can provide an epilepsy monitoring option and/or a sleep monitoring option in the intelligent eyeshade setting interface, and the fifth operation can be a switch operation of the epilepsy monitoring option and/or the sleep monitoring option performed by the user.

Through the switch options that provide epilepsy monitoring function and sleep monitor function on terminal equipment, can improve the convenience that the user set up intelligent eye-shade.

In one possible implementation of the second aspect, the method further comprises: and responding to a sixth operation of the user, displaying statistical data generated based on the epileptic seizure data, wherein the statistical data comprises the epileptic seizure times and the epileptic seizure duration counted by different statistical cycles corresponding to any severity.

The terminal device may provide a statistics control in the epilepsy record details page, and the sixth operation may be an operation of the user clicking the statistics control.

By providing the epileptic seizure statistic function on the terminal equipment, a user can conveniently know the epileptic seizure condition of a patient in each period.

In a third aspect, an embodiment of the present application provides a health management apparatus, which is applied to a terminal device, and includes:

a communication module, configured to acquire seizure data detected by the intelligent eye mask according to the first aspect;

and the display module is used for responding to a first operation of a user and displaying the epileptic seizure records generated based on the acquired epileptic seizure data, wherein each epileptic seizure record comprises the severity, seizure time and seizure duration of the epileptic seizure.

In one possible implementation of the third aspect, the apparatus further comprises: the input module is used for responding to a second operation of the user and acquiring epileptic seizure data input by the user;

the display module is also used for updating the epileptic seizure record.

In one possible implementation of the third aspect, the apparatus further comprises: and the processing module is used for indicating the communication module to remind the target contact person when the fact that the user is in the epileptic seizure state and the severity of the epileptic seizure reaches the target severity is determined according to the epileptic seizure data.

In a possible implementation manner of the third aspect, the communication module is specifically configured to:

sending help seeking information to the target contact person;

In a possible implementation manner of the third aspect, the display module is further configured to: displaying a smart eye shield setting interface in response to a third operation of the user before the processing module instructs the communication module to remind the target contact;

the processing module is further configured to: and responding to a fourth operation performed by the user in the intelligent eye shield setting interface, starting an emergency call function, and storing a target contact set by the user.

In a possible implementation manner of the third aspect, the processing module is further configured to: and responding to a fifth operation performed by the user in the intelligent eye shield setting interface, and controlling the intelligent eye shield to open or close a target function, wherein the target function is an epilepsy monitoring function for continuously performing epilepsy detection or a sleep monitoring function for continuously performing sleep state detection.

In a possible implementation manner of the third aspect, the display module is further configured to: and responding to a sixth operation of the user, displaying statistical data generated based on the epileptic seizure data, wherein the statistical data comprises the epileptic seizure times and the epileptic seizure duration counted by different statistical cycles corresponding to any severity.

In a fourth aspect, an embodiment of the present application provides a terminal device, including: a memory for storing a computer program and a processor; the processor is configured to execute the method of the second aspect when the computer program is invoked.

The beneficial effects of the third aspect and the fourth aspect can be referred to the related description in the second aspect, and are not described herein again.

In a fifth aspect, an embodiment of the present application provides a health management system, including: the intelligent eyewear of the first aspect and the terminal device of the fourth aspect.

The beneficial effects of the fifth aspect can be seen from the description of the first aspect and the second aspect, and are not described herein again.

In a sixth aspect, embodiments of the present application provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method of the second aspect or any of the implementation manners of the second aspect.

In a seventh aspect, this application provides a computer program product, which when run on a terminal device, causes the terminal device to execute the method of any one of the second aspect or the implementation manner of the second aspect.

In an eighth aspect, an embodiment of the present application provides a chip system, which includes a processor, the processor is coupled with a memory, and the processor executes a computer program stored in the memory to implement the method according to the second aspect or any implementation manner of the second aspect. The chip system can be a single chip or a chip module consisting of a plurality of chips.

It is understood that the beneficial effects of the sixth aspect to the eighth aspect can be referred to the related description of the second aspect, and are not described herein again.

Drawings

Fig. 1 is a schematic structural diagram of a health management system according to an embodiment of the present application;

fig. 2 is a schematic functional block diagram of an intelligent eyeshade provided in the embodiments of the present application;

FIG. 3 is a schematic structural view of an intelligent eyeshade according to an embodiment of the present application;

FIG. 4 is a schematic view of another embodiment of the intelligent eyewear of the present application;

fig. 5 is a schematic structural diagram of a terminal device according to an embodiment of the present application;

fig. 6 is a schematic flow chart of epilepsy detection provided in an embodiment of the present application;

fig. 7 is a schematic flowchart of sleep detection provided in an embodiment of the present application;

8-12 are some application interface diagrams provided by embodiments of the present application;

fig. 13 is a schematic structural diagram of a health management device according to an embodiment of the present application.

Detailed Description

The embodiments of the present application will be described below with reference to the drawings. The terminology used in the description of the embodiments herein is for the purpose of describing particular embodiments herein only and is not intended to be limiting of the application.

In order to monitor sleep epilepsy, a feasible technical scheme is to detect epileptic seizures through a smart bracelet, a smart watch and the like which can be worn on the wrist or the arm. Taking a smart watch as an example, a photoplethysmography (PPG) sensor, a gyroscope, an Acceleration (ACC) sensor and the like can be arranged on the smart watch, the heart rate variation of the user is monitored by the PPG sensor, the movement variation of the user is monitored by the gyroscope and the ACC sensor, and the seizure of the user is detected by combining the heart rate variation and the movement variation of the user.

The scheme has low detection accuracy for mild epileptic seizure due to small heart rate variation and insignificant hand twitch in mild epileptic seizure, and the method is highly susceptible to motion disturbance, such as hand motion during sleep, and thus the accuracy of the detection result is also affected.

Therefore, the embodiment of the application provides a health management system to realize monitoring and management of sleep epilepsy and improve accuracy of epilepsy detection.

Fig. 1 is a schematic structural diagram of a health management system according to an embodiment of the present application, and as shown in fig. 1, the epilepsy monitoring system according to the embodiment may include: the intelligent eyewear 100 and the terminal device 200.

The terminal device 200 may be an electronic device such as a mobile phone, a tablet, or a computer, and is exemplarily illustrated in fig. 1 by taking the mobile phone as an example. Wireless communication connection can be established between the intelligent eyeshade 100 and the terminal device 200 through short-distance communication technology such as bluetooth or wireless fidelity (Wi-Fi) or other wireless communication technologies, so that the use by a user is facilitated; a wired communication connection may also be established through a Universal Serial Bus (USB) interface (not shown) or the like to provide a more flexible data transmission manner, and in this embodiment, a wireless communication connection is taken as an example for illustration.

In this embodiment, the intelligent eyeshade 100 can monitor the electroencephalogram information, the heart rate information, the motion information, and the like of the user (i.e., the wearer), and can perform the epilepsy detection based on these information; the terminal device 200 can acquire the epileptic seizure data from the intelligent eyeshade 100, and can provide the user with recording the epileptic seizure data in the daytime and acquiring the epileptic seizure data recorded by other intelligent health devices to help the user better monitor and manage epilepsy.

Fig. 2 is a functional module schematic view of the intelligent eyewear provided in the embodiment of the present application, fig. 3 is a structural schematic view of the intelligent eyewear provided in the embodiment of the present application, and fig. 4 is another structural schematic view of the intelligent eyewear provided in the embodiment of the present application.

As shown in fig. 2, the intelligent eyewear 100 may include: the system comprises a signal acquisition unit 110, a processing unit 120, a data buffer module 130, an elasticity adjusting module 140, a sleep stimulation module 150, a wireless communication module 160, a notification module 170, a power supply module 180, an EEG electrode 191 and the like. The signal acquisition unit 110 may include sensor detection modules such as an electroencephalogram detection module 111, a heart rate detection module 112, and a motion detection module 113, and the electroencephalogram detection module 111 may include an Analog Front End (AFE) chip 1111; the heart rate detection module 112 may include a PPG sensor 1121; the motion detection module 113 may include an ACC sensor 1131.

It is to be understood that the illustrated structure of the embodiment of the present invention does not constitute a specific limitation to the intelligent eyewear 100. In other embodiments of the present application, the intelligent eyewear 100 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The EEG electrodes 191 are used for monitoring the brain wave change of the user, wherein, the EEG electrodes 191 may comprise one; a plurality of EEG electrodes may be included to improve the accuracy of the detection result, which is exemplified by 3 EEG electrodes 191 in fig. 3 and 4. The EEG electrodes 191 may be located on the intelligent eyeshade 100 at positions corresponding to the forehead of the human body, as shown in fig. 3 and 4, the three EEG electrodes 191 are respectively located on the intelligent eyeshade 100 at positions corresponding to the left frontal pole (Fp 1) region, the right frontal pole (Fp 2) region and the central frontal pole (FpZ) region of the human body, that is, after the intelligent eyeshade 100 is worn by the user, the three EEG electrodes 191 are respectively located in the Fp1, Fp2 and FpZ regions of the user.

It is understood that the EEG electrodes 191 may be located at positions on the smart mask 100 corresponding to the left forehead (F3) region or the right forehead (F4) region of the human body, and the specific positions of the EEG electrodes 191 are not particularly limited as long as the electroencephalogram signals with better quality can be detected.

In order to improve the accuracy of the detection result, the intelligent eyeshade 100 may further include a Reference Electrode (REF) 192 for providing a reference potential for the EEG electrode 191, and the EEG signal recorded by the EEG detection module 111 is a difference between the signal collected by the EEG electrode 191 and the signal collected by the reference electrode 192. The reference electrode 192 can be placed at a position close to zero potential on the human body, that is, after the user wears the intelligent eyeshade 100, the reference electrode 192 is located at a position close to zero potential on the body of the user; in this embodiment, the position may be specifically an earlobe, behind an ear, a tip of a nose, or other position with less influence by physiology and the outside.

As shown in fig. 3, the intelligent eyeshade 100 may include an eyeshade body 11 and a fixing band 12, the reference electrode 192 may be connected to the fixing band 12 of the intelligent eyeshade 100 by a connecting wire, and when in use, a user may stick the reference electrode 192 at a position of an earlobe, behind an ear, or at a tip of a nose, etc.

As shown in fig. 4, a nose mask 13 may be provided on the lower side of the middle portion of the eyecup body 11, and a reference electrode 192 may be provided on the nose mask 13 for the convenience of the user. In a specific arrangement, the reference electrode 192 may be located on the nose mask 13 at a position opposite to the tip of the nose of the human body, so as to improve the accuracy of the detection result of the electroencephalogram signal.

The AFE chip 1111 is electrically connected to each EEG electrode 191 and the reference electrode 192, respectively, and is configured to determine an EEG signal according to a signal collected by the EEG electrode 191 and a signal collected by the reference electrode 192, and perform processing such as filtering, amplification and analog-to-digital conversion on the EEG signal, and then transmit the EEG signal to the processing unit 120.

The PPG sensor 1121 is mainly used to monitor the heart rate variation of the user, and it can acquire the PPG signal of the forehead of the user. The PPG sensor 1121 may be disposed at a position where the upper edge or the side surface of the eye mask body 11 can be closely attached to the skin and comfort is better. One PPG sensor 1121 may be provided to improve the portability of the eye patch; a plurality of PPG sensors 1121 are also provided to improve the accuracy of the detection result, and may be selected according to needs in specific implementation, which is exemplified by one PPG sensor 1121 in this embodiment. The heart rate detection module 112 detects a heart rate signal (i.e., a PPG signal) by using the PPG sensor 1121, so that the comfort of the user can be improved; it is understood that the heart rate detection module 112 may also employ a piezoelectric sensor to collect the heart rate signal to improve the accuracy of the detection result.

The ACC sensor 1131 is mainly used to monitor the head movement of the user, and can acquire ACC signals of the head of the user. Similar to the PPG sensor 1121, the ACC sensor 1131 may also be disposed at an upper edge or a side surface of the eyecup body 11, and the like, and one ACC sensor may be disposed to improve the portability of the eyecup; a plurality of ACC sensors 1131 may be provided to improve the accuracy of the detection result, and may be selected according to needs in specific implementation.

It is understood that the motion detection module 113 may also include a gyro constant angular velocity sensor to improve the accuracy of head motion detection, and the motion detection module 113 may also be implemented by an Inertial Measurement Unit (IMU) integrated with an ACC sensor and a gyro, which may be selected according to needs, and the motion detection module 113 is exemplarily illustrated as including only the ACC sensor 1131.

The processing unit 120 is an overall control unit of the intelligent eyeshade 100, and may adopt a Micro Controller Unit (MCU) or a Digital Signal Processor (DSP), etc. The processing unit 120 may acquire the signal data acquired by the signal acquisition unit 110, perform filtering, denoising, and other processing on the acquired signal data, and further detect the epileptic seizure condition of the user in real time according to the signal data, so as to implement epileptic monitoring, and the specific epileptic detection process may refer to the subsequent contents.

The processing unit 120 may also detect a sleep state of the user according to the signal data acquired by the signal acquisition unit 110, so as to implement sleep monitoring, thereby facilitating sleep management of the user. Wherein the sleep state may include: the method comprises the following steps of falling asleep, light sleep, sound sleep, deep sleep, rapid eye movement sleep and the like, wherein heart rate, electroencephalogram and motion states of a user are different in different sleep states, and when the sleep state of the user is detected, detection can be carried out according to one of an EEG signal, a PPG signal and an ACC signal so as to improve detection efficiency; detection may also be made from a plurality of EEG, PPG and ACC signals to improve the accuracy of sleep detection. Specifically, a pre-trained sleep state recognition model or other detection methods may be used to detect the sleep state, which is not particularly limited in this embodiment. For convenience of description, in the following, sleep detection is performed according to an EEG signal, a PPG signal, and an ACC signal by using a sleep state identification model, which is taken as an example in the embodiments of the present application.

To facilitate the user's use, a function switch key (not shown) may be provided on the smart visor 100, and the user may set the smart visor to activate the epilepsy monitoring function and/or the sleep monitoring function.

It is understood that the processing unit 120 may also transmit the signal data acquired by the signal acquisition unit 110 to the terminal device 200 through the wireless communication module 160, so that the terminal device 200 performs the epilepsy detection and the sleep detection; the user can also set the detection function of the intelligent eyeshade activation through the terminal device 200.

Considering that the user wears loose, turns over, sleeps on one side, and the like, which may cause poor contact of one or all EEG electrodes, and affect the detection result, in order to improve the accuracy of the detection result, in this embodiment, the processing unit 120 may perform signal quality detection on the EEG signal after acquiring the EEG signal, and may control the tightness adjusting module 140 to adjust the tightness of the intelligent eye patch under the condition that the signal quality does not meet the requirement, so that the EEG electrodes are in full contact with the skin, and a better EEG signal quality is acquired.

Wherein, the tightness adjusting module 140 may include a fixing band adjusting device for adjusting the length of the fixing band 12, the device may include a motor and a transmission mechanism, etc., the transmission mechanism is respectively connected with the motor and the fixing band 12, and the motor may drive the transmission mechanism to move under the control of the processing unit 120, so as to increase or shorten the length of the fixing band 12.

The tightness adjustment module 140 may also be implemented using an inflator to improve comfort. In particular, the inflation means may be provided adjacent the EEG electrodes for applying a skin-facing pressure to the EEG electrodes to bring the EEG electrodes into close proximity with the skin. The inflation device may include an air pump, an air bag, an air tube, and the like, the air bag is communicated with the air pump through the air tube, and the air pump may inflate the air bag through the air tube under the control of the processing unit 120, so that the air bag pressurizes the EEG electrodes. An air bag can be correspondingly arranged near each EEG electrode, each air bag is provided with a corresponding air pipe, and each air bag can adopt different air pumps or the same air pump; alternatively, a large air bag may be used to control the pressurization of the EEG electrodes simultaneously, for example, an array air bag may be used, the array air bag covers the EEG electrodes, and when the array air bag is inflated, part or all of the air bag units of the array air bag may be controlled to inflate so as to pressurize part or all of the EEG electrodes.

In order to improve the sleep quality of the user, in the present embodiment, the processing unit 120 may control the sleep stimulation module 150 to output the stimulation signal to stimulate the brain according to the acquired EEG signal and the detected sleep state, so as to improve the sleep state of the user. The sleep stimulation module 150 may include an audio stimulation module and/or a micro-electrical stimulation module.

The audio stimulation module is used to implement an audio function, and may include a speaker and an audio module for performing audio digital-to-analog conversion, and the processing unit 120 may control the audio stimulation module to play music or other audio signals by using a related audio control method to improve the sleep state of the user. For example: before the user falls asleep, the type of the played audio can be determined according to the energy ratio of each frequency band of the EEG signal, and then whether the drowsiness of the user is increased or not can be judged according to the EEG signal; if so, the audio of the type can be continuously played, otherwise, the type of the played audio can be adjusted; after the user falls asleep, the music playing can be stopped, or an audio signal with a certain frequency can be played, and the user is guided to enter a slow wave sleep period by adjusting the frequency and the volume of the audio signal.

The micro-electrical stimulation module is used for realizing micro-current stimulation and can comprise a pulse generator, a stimulation electrode and the like. The processing unit 120 can adopt a related micro-electrical control method to control the micro-electrical stimulation module to output the stimulation current, so as to improve the sleep state of the user. For example: after the user falls asleep, parameters such as waveform, intensity, frequency, cycle period and the like of the stimulation current can be controlled according to the EEG signal of the user, and the user is guided to enter a slow wave sleep period. The control method corresponding to the audio stimulation module and the micro-electrical stimulation module may adopt various related algorithms, the audio control method and the micro-electrical control method are only an example, and may be selected according to needs when being specifically implemented, and this embodiment is not particularly limited thereto.

The data buffering module 130 is used for buffering the signal data collected by the signal collecting unit 110, and may be a separate storage device or may be integrated in the processing unit 120. When detecting the epileptic seizure, the processing unit 120 may generate epileptic seizure data and then transmit the epileptic seizure data to the terminal device 200; in order to improve flexibility, the processing unit 120 may also store the epileptic seizure data in the data buffer module 130, and synchronize the signal data in the data buffer module 130 to the terminal device 200 when a subsequent user triggers data synchronization, so that retransmission may also be performed in case of a transmission failure, and thus reliability of data management may also be improved. The epileptic seizure data may include epileptic detection results (which may include epileptic seizure time, duration and severity of epileptic seizure, etc.), and may include signal data from several minutes before the epileptic seizure, during the epileptic seizure, and several minutes after the epileptic seizure is over, i.e., signal data from a first time before the epileptic seizure to a second time after the epileptic seizure is over. Similarly, the processing unit 120 may generate sleep state data according to the sleep state detection result and then send the sleep state data to the terminal device 200 in real time, or buffer the sleep state data in the data buffer module 130, where the sleep state data may include the detected sleep state and the sleep time corresponding to the sleep state.

The wireless communication module 160 may provide a solution for wireless communication including Wireless Local Area Networks (WLANs), such as Wi-Fi networks, bluetooth, etc., applied to the smart eyewear 100. The processing unit 120 may communicate with the terminal device 200 through the wireless communication module 160, and transmit the detected seizure data and sleep state data to the terminal device 200.

The notification module 170 is used to indicate user operation, and may include a speaker, a motor, and/or an indicator light, etc., for audible, vibratory, and/or light prompts. The notification module 170 may also be used to indicate a charging status, a charge change, an operating status, and the like.

The power module 180 is used for supplying power to the intelligent eyeshade 100, and may include a battery and a power management unit, and the power management unit may receive a charging input of a wired charger through a USB interface, and may also receive a wireless charging input through a wireless charging coil, thereby charging the battery; and parameters such as battery capacity and battery health can be monitored. The power management unit may be a separate device or may be integrated in the processing unit 120.

The EEG electrodes 191 and the PPG sensor 1121 may be disposed on the inner side of the intelligent eye patch 100 for contacting the skin; the ACC sensor 1131, the processing unit 120, the data caching module 130, the tightness adjusting module 140, the sleep stimulation module 150, the wireless communication module 160, the notification module 170, and the power module 180 need not be exposed outside, and may be disposed in an interlayer of the eye mask body 11, and the portion that needs to be exposed outside may be disposed on the outer surface of the intelligent eye mask 100, and the specific disposition position of each module may be selected according to actual needs, which is not particularly limited in this embodiment.

The above-mentioned fig. 3 and 4 exemplarily show two structures of the intelligent eyeshade 100, which are different mainly in the difference between the fixing band 12 and the nose mask 13.

As shown in fig. 3, the fixing bands 12 may be two ear-hanging fixing bands 12, and the two fixing bands 12 are correspondingly connected to two sides of the eyeshade body 11. As shown in fig. 4, the fixing band 12 may also be a head-mounted fixing band 12, which may include one as shown in fig. 4, one end of the fixing band 12 being connected to one side of the eyecup body 11, and the other end being connected to the other side of the eyecup body 11.

It can be understood that, the head-wearing fixing band 12 may also include two, one of the fixing bands 12 is connected with one side of the eyeshade body 11, the other fixing band 12 is connected with the other side of the eyeshade body 11, and the two fixing bands 12 may be connected together by knotting, hook and loop fasteners or the like. In addition, fig. 3 and 4 are only used to illustrate different implementations of the fixing band 12, and are not intended to limit the present application, the intelligent eyeshade 100 shown in fig. 3 may also employ a head-mounted fixing band 12, and the intelligent eyeshade 100 shown in fig. 4 may also employ a supra-aural fixing band 12.

In order to improve the comfort of the user and the wearing convenience, the fixing band 12 may be an elastic fixing band 12, which may also make the eyeshade body 11 better fit the skin.

In order to improve the accuracy of the signal detection result of the reference electrode 192, a nose bridge strip 14 matched with the nose bridge can be arranged at the position, corresponding to the nose bridge, on the eyeshade body 11, and a user can make the nose cover 13 better fit the nose by adjusting the nose bridge strip 14.

The eyeshade body 11 may be made of fabric, elastic foam, plastic, metal and/or silica gel, and the specific material is not limited in this embodiment.

In this embodiment, the terminal device 200 may be a portable electronic device such as a mobile phone or a tablet, or may also be a non-portable electronic device such as a computer, and in this embodiment, the terminal device 200 is taken as a mobile phone as an example for illustration.

Fig. 5 is a schematic structural diagram of a terminal device according to an embodiment of the present disclosure, and as shown in fig. 5, the terminal device 200 may include a processor 210, an external memory interface 220, an internal memory 221, a USB interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, a button 290, a motor 291, an indicator 292, a camera 293, a display 294, a Subscriber Identity Module (SIM) card interface 295, and the like. The sensor module 280 may include a pressure sensor 280A, a gyroscope sensor 280B, an air pressure sensor 280C, a magnetic sensor 280D, an acceleration sensor 280E, a distance sensor 280F, a proximity light sensor 280G, a fingerprint sensor 280H, a temperature sensor 280J, a touch sensor 280K, an ambient light sensor 280L, a bone conduction sensor 280M, and the like.

It is to be understood that the illustrated structure of the embodiment of the present invention does not specifically limit the terminal device 200. In other embodiments of the present application, terminal device 200 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The terminal device 200 may receive the seizure data and the sleep state data detected by the smart mask 100 through the wireless communication module 260 or the USB interface 230, and may provide a seizure management service to the user according to the seizure data and a sleep management service to the user according to the sleep state data. In addition, the terminal device 200 may also upload the seizure data and the sleep state data of the user to the cloud for storage, so as to be further analyzed by a subsequent doctor.

Processor 210 may include one or more processing units, such as: the processor 210 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The different processing units may be separate devices or may be integrated into one or more processors.

The controller may be a neural center and a command center of the terminal device 200, among others. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 210 for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may hold instructions or data that have just been used or recycled by processor 210. If the processor 210 needs to use the instruction or data again, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 210, thereby increasing the efficiency of the system.

In some embodiments, processor 210 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

The I2C interface is a bi-directional synchronous serial bus that includes a serial data line (SDA) and a Serial Clock Line (SCL). In some embodiments, processor 210 may include multiple sets of I2C buses. The processor 210 may be coupled to the touch sensor 280K, the charger, the flash, the camera 293, etc. through different I2C bus interfaces. For example: the processor 210 may be coupled to the touch sensor 280K through an I2C interface, such that the processor 210 and the touch sensor 280K communicate through an I2C bus interface to implement the touch function of the terminal device 200.

The I2S interface may be used for audio communication. In some embodiments, processor 210 may include multiple sets of I2S buses. Processor 210 may be coupled to audio module 270 via an I2S bus to enable communication between processor 210 and audio module 270. In some embodiments, the audio module 270 may communicate audio signals to the wireless communication module 260 via the I2S interface, enabling answering of calls via a bluetooth headset.

The PCM interface may also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, audio module 270 and wireless communication module 260 may be coupled by a PCM bus interface. In some embodiments, the audio module 270 may also transmit audio signals to the wireless communication module 260 through the PCM interface, so as to implement a function of answering a call through a bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communications. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 210 with the wireless communication module 260. For example: the processor 210 communicates with the bluetooth module in the wireless communication module 260 through the UART interface to implement the bluetooth function. In some embodiments, the audio module 270 may transmit the audio signal to the wireless communication module 260 through a UART interface, so as to realize the function of playing music through a bluetooth headset.

The MIPI interface may be used to connect the processor 210 with peripheral devices such as the display screen 294, the camera 293, and the like. The MIPI interface includes a Camera Serial Interface (CSI), a Display Serial Interface (DSI), and the like. In some embodiments, processor 210 and camera 293 communicate via a CSI interface to implement the capture functionality of terminal device 200. The processor 210 and the display screen 294 communicate through the DSI interface, and implement a display function of the terminal device 200.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal and may also be configured as a data signal. In some embodiments, a GPIO interface may be used to connect processor 210 with camera 293, display 294, wireless communication module 260, audio module 270, sensor module 280, and the like. The GPIO interface may also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, and the like.

The USB interface 230 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 230 may be used to connect a charger to charge the terminal device 200, and may also be used to transmit data between the terminal device 200 and a peripheral device. And the earphone can also be used for connecting an earphone and playing audio through the earphone. The interface may also be used to connect other terminal devices, such as AR devices and the like.

It should be understood that the connection relationship between the modules according to the embodiment of the present invention is only an exemplary illustration, and does not limit the structure of the terminal device 200. In other embodiments of the present application, the terminal device 200 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

The charge management module 240 is configured to receive a charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 240 may receive charging input from a wired charger via the USB interface 230. In some wireless charging embodiments, the charging management module 240 may receive a wireless charging input through a wireless charging coil of the terminal device 200. The charging management module 240 may also supply power to the terminal device through the power management module 241 while charging the battery 242.

The power management module 241 is used to connect the battery 242, the charging management module 240 and the processor 210. The power management module 241 receives input from the battery 242 and/or the charging management module 240, and provides power to the processor 210, the internal memory 221, the external memory, the display 294, the camera 293, and the wireless communication module 260. The power management module 241 may also be used to monitor parameters such as battery capacity, battery cycle number, battery state of health (leakage, impedance), etc. In some other embodiments, the power management module 241 may also be disposed in the processor 210. In other embodiments, the power management module 241 and the charging management module 240 may be disposed in the same device.

The wireless communication function of the terminal device 200 may be implemented by the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, a modem processor, a baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in terminal device 200 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 250 may provide a solution including 2G/3G/4G/5G wireless communication and the like applied to the terminal device 200. The mobile communication module 250 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 250 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 250 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 250 may be disposed in the processor 210. In some embodiments, at least some of the functional modules of the mobile communication module 250 may be disposed in the same device as at least some of the modules of the processor 210.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then passed to the application processor. The application processor outputs sound signals through an audio device (not limited to the speaker 270A, the receiver 270B, etc.) or displays images or video through the display screen 294. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be separate from the processor 210, and may be disposed in the same device as the mobile communication module 250 or other functional modules.

The wireless communication module 260 may provide solutions for wireless communication applied on the terminal device 200, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 260 may be one or more devices integrating at least one communication processing module. The wireless communication module 260 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 210. The wireless communication module 260 may also receive a signal to be transmitted from the processor 210, frequency-modulate and amplify the signal, and convert the signal into electromagnetic waves via the antenna 2 to radiate the electromagnetic waves.

In some embodiments, antenna 1 of terminal device 200 is coupled to mobile communication module 250 and antenna 2 is coupled to wireless communication module 260, such that terminal device 200 may communicate with networks and other devices via wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), time division-synchronous code division multiple access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a Global Navigation Satellite System (GNSS), a beidou satellite navigation system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

The terminal device 200 implements a display function through the GPU, the display screen 294, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 294 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 210 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 294 is used to display images, video, and the like. The display screen 294 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a Mini LED, a Micro LED, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, terminal device 200 may include 1 or N display screens 294, N being a positive integer greater than 1.

The terminal device 200 may implement a shooting function through the ISP, the camera 293, the video codec, the GPU, the display screen 294, the application processor, and the like.

The ISP is used to process the data fed back by the camera 293. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in camera 293.

The camera 293 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, the terminal device 200 may include 1 or N cameras 293, where N is a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the terminal device 200 selects a frequency point, the digital signal processor is used to perform fourier transform or the like on the frequency point energy.

Video codecs are used to compress or decompress digital video. The terminal device 200 may support one or more video codecs. In this way, the terminal device 200 can play or record video in a plurality of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.

The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. The NPU can implement applications such as intelligent recognition of the terminal device 200, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 220 may be used to connect an external memory card, such as a Micro SD card, to extend the storage capability of the terminal device 200. The external memory card communicates with the processor 210 through the external memory interface 220 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.

Internal memory 221 may be used to store computer-executable program code, including instructions. The processor 210 executes various functional applications of the terminal device 200 and data processing by executing instructions stored in the internal memory 221. The internal memory 221 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (such as audio data, a phonebook, etc.) created during use of the terminal apparatus 200, and the like. In addition, the internal memory 221 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.

The terminal device 200 may implement an audio function through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C, the headphone interface 270D, the application processor, and the like. Such as music playing, recording, etc.

Audio module 270 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. Audio module 270 may also be used to encode and decode audio signals. In some embodiments, the audio module 270 may be disposed in the processor 210, or some functional modules of the audio module 270 may be disposed in the processor 210.

The speaker 270A, also called a "horn", is used to convert an audio electrical signal into an acoustic signal. The terminal device 200 can listen to music through the speaker 270A or listen to a handsfree call.

The receiver 270B, also called "earpiece", is used to convert the electrical audio signal into a sound signal. When the terminal apparatus 200 receives a call or voice information, it is possible to receive voice by bringing the receiver 270B close to the human ear.

The microphone 270C, also referred to as a "microphone," is used to convert acoustic signals into electrical signals. When making a call or transmitting voice information, the user can input a voice signal to the microphone 270C by speaking the user's mouth near the microphone 270C. The terminal device 200 may be provided with at least one microphone 270C. In other embodiments, the terminal device 200 may be provided with two microphones 270C, which may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the terminal device 200 may further include three, four, or more microphones 270C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.

The earphone interface 270D is used to connect wired earphones. The headset interface 270D may be the USB interface 230, or may be an Open Mobile Terminal Platform (OMTP) standard interface of 3.5mm, or a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 280A is used to sense a pressure signal, which can be converted into an electrical signal. In some embodiments, the pressure sensor 280A may be disposed on the display screen 294. The pressure sensor 280A can be of a wide variety of types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a sensor comprising at least two parallel plates having an electrically conductive material. When a force acts on the pressure sensor 280A, the capacitance between the electrodes changes. The terminal device 200 determines the intensity of the pressure from the change in the capacitance. When a touch operation is applied to the display screen 294, the terminal device 200 detects the intensity of the touch operation based on the pressure sensor 280A. The terminal device 200 can also calculate the touched position from the detection signal of the pressure sensor 280A. In some embodiments, the touch operations that are applied to the same touch position but different touch operation intensities may correspond to different operation instructions. For example: and when the touch operation with the touch operation intensity smaller than the first pressure threshold value acts on the short message application icon, executing an instruction for viewing the short message. And when the touch operation with the touch operation intensity larger than or equal to the first pressure threshold value acts on the short message application icon, executing an instruction of newly building the short message.

The gyro sensor 280B may be used to determine the motion attitude of the terminal device 200. In some embodiments, the angular velocity of the terminal device 200 about three axes (i.e., x, y, and z axes) may be determined by the gyro sensor 280B. The gyro sensor 280B may be used for photographing anti-shake. Illustratively, when the shutter is pressed, the gyro sensor 280B detects the shake angle of the terminal device 200, calculates the distance to be compensated for by the lens module according to the shake angle, and allows the lens to counteract the shake of the terminal device 200 through a reverse movement, thereby achieving anti-shake. The gyroscope sensor 280B may also be used for navigation, somatosensory gaming scenes.

The air pressure sensor 280C is used to measure air pressure. In some embodiments, the terminal device 200 calculates altitude, aiding positioning and navigation, from the barometric pressure value measured by the barometric pressure sensor 280C.

The magnetic sensor 280D includes a hall sensor. The terminal device 200 may detect the opening and closing of the flip holster using the magnetic sensor 280D. In some embodiments, when the terminal device 200 is a folder, the terminal device 200 may detect the opening and closing of the folder according to the magnetic sensor 280D. And then according to the opening and closing state of the leather sheath or the opening and closing state of the flip cover, the automatic unlocking of the flip cover is set.

The acceleration sensor 280E can detect the magnitude of acceleration of the terminal device 200 in various directions (generally, three axes). The magnitude and direction of gravity can be detected when the terminal device 200 is stationary. The method can also be used for recognizing the posture of the terminal equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

A distance sensor 280F for measuring distance. The terminal device 200 may measure the distance by infrared or laser. In some embodiments, shooting a scene, the terminal device 200 may range using the distance sensor 280F to achieve fast focus.

The proximity light sensor 280G may include, for example, a Light Emitting Diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The terminal device 200 emits infrared light to the outside through the light emitting diode. The terminal device 200 detects infrared reflected light from a nearby object using a photodiode. When sufficient reflected light is detected, it can be determined that there is an object near the terminal device 200. When insufficient reflected light is detected, the terminal device 200 can determine that there is no object near the terminal device 200. The terminal device 200 can utilize the proximity light sensor 280G to detect that the user holds the terminal device 200 close to the ear for talking, so as to automatically turn off the screen to achieve the purpose of saving power. The proximity light sensor 280G may also be used in a holster mode, a pocket mode automatically unlocks and locks the screen.

The ambient light sensor 280L is used to sense the ambient light level. The terminal device 200 may adaptively adjust the brightness of the display screen 294 according to the perceived ambient light level. The ambient light sensor 280L may also be used to automatically adjust the white balance when taking a picture. The ambient light sensor 280L may also cooperate with the proximity light sensor 280G to detect whether the terminal device 200 is in a pocket for protection against accidental touches.

The fingerprint sensor 280H is used to collect a fingerprint. The terminal device 200 can utilize the collected fingerprint characteristics to realize fingerprint unlocking, access to an application lock, fingerprint photographing, fingerprint incoming call answering and the like.

The temperature sensor 280J is used to detect temperature. In some embodiments, the terminal device 200 executes a temperature processing strategy using the temperature detected by the temperature sensor 280J. For example, when the temperature reported by the temperature sensor 280J exceeds the threshold, the terminal device 200 performs a reduction in performance of a processor located near the temperature sensor 280J, so as to reduce power consumption and implement thermal protection. In other embodiments, terminal device 200 heats battery 242 when the temperature is below another threshold to avoid a low temperature causing abnormal shutdown of terminal device 200. In other embodiments, when the temperature is below a further threshold, the terminal device 200 performs boosting of the output voltage of the battery 242 to avoid abnormal shutdown due to low temperature.

The touch sensor 280K is also referred to as a "touch panel". The touch sensor 280K may be disposed on the display screen 294, and the touch sensor 280K and the display screen 294 form a touch screen, which is also called a "touch screen". The touch sensor 280K is used to detect a touch operation applied thereto or nearby. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display screen 294. In other embodiments, the touch sensor 280K may be disposed on the surface of the terminal device 200, different from the position of the display screen 294.

The bone conduction sensor 280M may acquire a vibration signal. In some embodiments, the bone conduction sensor 280M may acquire a vibration signal of the human vocal part vibrating the bone mass. The bone conduction sensor 280M may also contact the pulse of the human body to receive the blood pressure pulsation signal. In some embodiments, bone conduction sensor 280M may also be disposed in a headset, integrated into a bone conduction headset. The audio module 270 may analyze a voice signal based on the vibration signal of the bone mass vibrated by the sound part acquired by the bone conduction sensor 280M, so as to implement a voice function. The application processor can analyze heart rate information based on the blood pressure pulsation signal acquired by the bone conduction sensor 280M, so as to realize a heart rate detection function.

The keys 290 include a power-on key, a volume key, etc. The keys 290 may be mechanical keys. Or may be touch keys. The terminal device 200 may receive a key input, and generate a key signal input related to user setting and function control of the terminal device 200.

The motor 291 may generate a vibration cue. The motor 291 can be used for both incoming call vibration prompting and touch vibration feedback. For example, touch operations applied to different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 291 may also respond to different vibration feedback effects for touch operations on different areas of the display 294. Different application scenes (such as time reminding, receiving information, alarm clock, game and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

Indicator 292 may be an indicator light that may be used to indicate a state of charge, a change in charge, or may be used to indicate a message, missed call, notification, etc.

The SIM card interface 295 is used to connect a SIM card. The SIM card can be attached to and detached from the terminal device 200 by being inserted into the SIM card interface 295 or being pulled out of the SIM card interface 295. The terminal device 200 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 295 may support a Nano SIM card, a Micro SIM card, a SIM card, etc. Multiple cards can be inserted into the same SIM card interface 295 at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 295 may also be compatible with different types of SIM cards. The SIM card interface 295 may also be compatible with external memory cards. The terminal device 200 interacts with the network through the SIM card to implement functions such as communication and data communication. In some embodiments, the terminal device 200 employs eSIM, namely: an embedded SIM card. The eSIM card may be embedded in the terminal apparatus 200 and cannot be separated from the terminal apparatus 200.

According to the health management system, epilepsy detection can be performed through EEG signals, PPG signals and ACC signals collected by the intelligent eyeshade, and monitoring of sleep epilepsy is achieved; and the intelligent eyeshade can transmit epileptic seizure data to the terminal equipment, and helps a user to manage epilepsy. In addition, the brain wave of the patient is very obvious when the epilepsy occurs, the situations of abnormal heartbeat, body convulsion and the like can also occur, the EEG signal can well reflect the brain wave change situation when the epilepsy occurs, the PPG signal can reflect the heart rate change situation when the user has the epilepsy, the head ACC signal can reflect the head movement information when the user has the epilepsy, and the signal is little interfered by body movement (such as hand movement), so that the epilepsy detection is performed by combining the EEG signal, the PPG signal and the head ACC signal, and the accuracy of the epilepsy detection result can be effectively improved.

The process of detecting epilepsy is explained below. Referring to fig. 6, fig. 6 is a schematic flowchart of epilepsy detection provided in the embodiment of the present application.

In order to save processing resources and reduce system power consumption, the intelligent eye mask can start epilepsy detection after detecting that the user falls asleep. The intelligent eyeshade can detect whether the user falls asleep or not according to the signal data acquired by the signal acquisition unit, or can determine whether the user falls asleep or not based on a sleep monitoring result under the condition that the sleep monitoring function is started so as to further save processing resources. For a specific sleep onset detection mode, reference may be made to the following description of the sleep detection process, which is not described herein again.

Specifically, when detecting epilepsy, the detection may be performed at preset epilepsy detection periods, and in each period, the epilepsy detection may be performed according to a signal segment (referred to as a first signal segment) corresponding to the period. The period may be several seconds, the first signal segment corresponding to the period may include signal data of a preset duration before the detection time corresponding to the period, and the preset duration (i.e., the duration of the first signal segment) may be greater than or equal to the duration of the period. For example: the duration of the period is 2 seconds, the duration of the first signal segment can be 4 seconds, namely, the epilepsy detection is carried out every 2 seconds, and 4 seconds of signal data which are collected recently are adopted every time, namely, two adjacent periods can multiplex 2 seconds of signal data; or, the time length of the period and the time length of the first signal segment are both 4 seconds, the data acquired by the signal acquisition unit is not multiplexed, and the signal data acquired in the period is adopted for each epileptic detection. For each cycle, epilepsy detection can be performed using the method shown in fig. 6.

As shown in fig. 6, for each period, after the first signal segment corresponding to the period is acquired, signal processing, feature extraction, and seizure detection may be sequentially performed according to signal data in the first signal segment, and duration calculation, severity evaluation, and the like of a seizure may be performed after the seizure is ended.

In signal processing, a bandpass filter such as butterworth (butterworth) may be generally used to filter the signal data in the first signal segment to remove noise and unwanted signals such as baseline, low frequency, and high frequency, and obtain a useful signal.

Compared with the condition of non-epileptic seizure, the amplitude of brain waves of an epileptic patient is greatly increased during epileptic seizure, various abnormal waves can appear in the brain waves, and the frequency of the abnormal waves is changed; but also symptoms such as accelerated heartbeat and body convulsion can occur. Correspondingly, the signal characteristics of the EEG signal, the PPG signal and the ACC signal may also vary; by analyzing the signal characteristics of the signal data, whether the user has epilepsy can be judged. Therefore, after the signal processing is performed on the first signal segment, features related to the epilepsy detection in the first signal segment may be extracted, and then the determination of the epilepsy attack may be performed based on these extracted features.

Features in the EEG signal that are relevant for epilepsy detection may include: EEG amplitude and its statistical characteristics, the statistical characteristics of EEG signal can include mean value, variance, covariance matrix, etc. domain characteristics and each frequency band signal (alpha, beta, theta, delta, etc. wave) energy account for some or all of the features in the equal frequency domain characteristics; features in the PPG signal that are relevant for epilepsy detection may include: heart rate and heart rate variability; features in the ACC signal that are relevant for epilepsy detection may include: ACC amplitude and its statistical characteristics, the statistical characteristics of the ACC signal may include: mean, variance, standard deviation, etc. domain features and signal energy, etc. frequency features.

After the signal features of the first signal segment are extracted, the epileptic seizure detection can be performed by adopting a pre-trained first classification model, that is, the extracted signal features can be input into the first classification model to obtain the epileptic seizure detection result. If a seizure condition is detected, further calculating information such as duration and severity of the seizure if the end of the seizure is detected; if no seizure condition is detected, no treatment may be done.

As mentioned above, in order to improve the accuracy of the detection result, the EEG electrode includes a plurality of EEG signals, that is, the EEG signals include multiple paths, and the signal feature of the EEG signal input to the first classification model may include a signal feature of each EEG signal, or may be a mean value of each signal feature of the EEG signal determined according to the signal features of each EEG signal.

When determining whether the epileptic seizure has ended, the determination may be made according to the epileptic seizure detection result of the subsequent first signal segments, and specifically, during the subsequent detection of each first signal segment, if the absence of epilepsia is detected for the first time or for a plurality of consecutive times, the epileptic seizure ending may be determined.

The duration of the seizure may be determined based on the start time and the end time of the seizure. The severity of the seizure can be determined using a second classification model trained in advance.

In a specific implementation, the signal characteristics of each first signal segment during the epileptic seizure, the duration of the epileptic seizure, and the aggregate characteristics of each first signal segment can be input into the second classification model to obtain the severity of the epileptic seizure. Wherein the aggregate characteristic of each first signal segment may be determined according to various signal characteristics of each first signal segment, which may include, for example: the mean and variance of each signal feature determined from the values of the various signal features in the first signal segments, and the like. The severity of the epileptic seizure may also be divided into several levels, which may include, for example, three levels of mild, moderate and severe, and the specific number of levels is not particularly limited in this embodiment.

The first classification model and the second classification model may be specifically classifiers or regressors. The Machine learning algorithm adopted by the two methods can be a Bayesian algorithm, a Support Vector Machine (SVM) algorithm or a classification algorithm based on a neural network.

Similar to a conventional model training method, for a first classification model, a first training sample set may be obtained in advance, where the first training sample set includes training samples corresponding to epileptic seizures and training samples corresponding to epileptic non-seizures, and each training sample includes signal data (EEG signal, PPG signal, and ACC signal) and a classification label (including epileptic occurrence and non-epileptic occurrence); and then, extracting the characteristics of the signal data in each training sample, and inputting the extracted signal characteristics and the corresponding classification labels into an initial first classification model to be trained for training to obtain a first classification model. For the second classification model, a second training sample set may be obtained in advance, where the second training sample set includes training samples corresponding to epileptic seizures of various degrees of severity, and each training sample may include: signal data (EEG signal, PPG signal and ACC signal) and classification labels (i.e. severity of the seizure) for each first signal segment during the seizure; then, carrying out feature extraction on the signal data of each first signal segment in each training sample, and determining the duration of the epileptic seizure and the aggregation feature of each first signal segment; and inputting the extracted signal characteristics, the determined duration of the epileptic seizure and the classification labels corresponding to the aggregation characteristics of the first signal segments into an initial second classification model to be trained for training to obtain a second classification model.

In order to improve the accuracy of the detection result, as shown in fig. 6, before the signal processing is performed on the first signal segment, the signal quality detection may be performed on the EEG signal in the first signal segment, and then the subsequent epilepsy detection is performed when the signal quality of the EEG signal meets the requirement; under the condition that the signal quality of the EEG signal does not meet the requirement, the tightness adjusting module can be controlled to adjust the tightness of the intelligent eye patch, so that the EEG electrode is fully contacted with the skin, and better EEG signal quality is obtained.

In particular, it may be determined from the signal-to-noise ratio of the EEG signal whether the signal quality of the EEG signal meets the requirements; in order to improve the accuracy, feature extraction can be carried out on the EEG signal, and whether the signal quality of the EEG signal meets the requirement or not can be determined according to the relation between the extracted features and the corresponding feature value range. For example: the signal quality of the EEG signal may be considered to meet the requirements when each extracted feature is within the corresponding feature value range (i.e., each feature meets the requirements), or when the number of features meeting the requirements reaches a preset number, otherwise, the signal quality of the EEG signal is considered to not meet the requirements.

The method can be used for detecting the signal quality of the EEG signal corresponding to each EEG electrode in the first signal segment, and the subsequent epileptic detection can be carried out under the condition that the signal quality of each EEG signal meets the requirement. Under the condition that the signal quality of any EEG signal does not meet the requirement, the tightness adjusting module can be controlled to adjust the tightness of the intelligent eyeshade.

When the tightness is adjusted, the tightness adjusting module can be controlled to adjust the preset tightness adjusting amount; in order to quickly determine a proper tightness adjustment amount, the tightness adjustment module can be controlled to continuously adjust the tightness of the intelligent eyeshade at a preset adjustment speed, during the adjustment process, signal quality detection of an EEG signal is carried out, and under the condition that the signal quality of the EEG signal is detected to meet the requirement, the tightness adjustment module is controlled to stop adjustment; or, the tightness adjustment amount may be determined according to the detected signal quality, and then the tightness adjustment module is controlled to adjust according to the tightness adjustment amount, for example: the signal quality can be measured by the ratio of the number of the features meeting the requirements to the total number of the features, and the tightness adjustment amount is determined according to the corresponding relation between the preset signal quality and the tightness adjustment amount.

In addition, a maximum tightness can be predetermined according to the relationship between the tightness of the intelligent eyeshade and the wearing comfort of the user; when adjusting, if the elasticity of intelligence eye-shade reaches this predetermined maximum elasticity, then also can control elasticity adjusting module and stop adjusting to improve the comfort level that the user wore intelligent eye-shade.

It should be noted that, the signal quality detection method and the tightness adjustment method are only exemplary descriptions, and are not intended to limit the present application, and the specific implementation method may be set as needed, which is not particularly limited in this embodiment.

According to the epilepsy detection method, the EEG signal, the PPG signal and the ACC signal are combined to carry out epilepsy detection, wherein the change of the brain wave of a patient is obvious during epileptic seizure, the conditions of abnormal heartbeat, body convulsion and the like can also occur, the EEG signal can well reflect the change of the brain wave during epileptic seizure, the PPG signal can reflect the change of the heart rate of the user during epileptic seizure, the head ACC signal can reflect the head movement information of the user during epileptic seizure, and the signal is slightly interfered by body movement (such as hand movement), so that the EEG signal, the PPG signal and the head ACC signal are combined to carry out epilepsy detection, and the accuracy of an epilepsy detection result can be effectively improved. In addition, the subsequent epilepsia detection process is carried out under the condition that the signal quality of the EEG signal meets the requirement, and when the signal quality of the EEG signal does not meet the requirement, the tightness of the intelligent eye patch is adjusted through the tightness adjusting module to ensure that the signal quality of the EEG signal meets the requirement, so that the accuracy of the epilepsia detection result can be further improved.

The sleep detection process is explained below. Referring to fig. 7, fig. 7 is a schematic flowchart of sleep detection according to an embodiment of the present application.

Similar to the above process of detecting epilepsy, during sleep detection, detection may be performed in a preset sleep detection period, and for each period, after a signal segment (referred to as a second signal segment) corresponding to the period is obtained, processing processes such as signal processing, feature extraction, and sleep state determination may be sequentially performed according to signal data in the second signal segment, so as to obtain sleep parameters such as a sleep state and a sleep duration of a user. The sleep detection period and the epilepsy detection period may be the same or different, and the durations of the second signal segment corresponding to the sleep detection period and the first signal segment corresponding to the epilepsy detection period may be different, which may be set to be longer, for example, 30 seconds; the second signal segment is determined in a manner similar to the first signal segment in the epilepsy detection, and is not described herein again.

Similar to the processing procedure of the relevant step in the epilepsy detection, when performing signal processing, a band-pass filter may be used to filter the signal data in the second signal segment; then, the amplitude and the statistical characteristic of an EEG signal, the heart rate characteristic of a PPG signal, the amplitude and the statistical characteristic of an ACC signal and the like in the second signal segment can be extracted; after the signal features of the second signal segment are extracted, a pre-trained third classification model (i.e., a sleep state recognition model) may be used to determine the sleep state detection result. The characteristics of the sleep detection and the epilepsy detection can be the same or different, and the characteristics can be selected according to the needs in specific implementation; the third classification model is similar to the first classification model, except that the training sample set in the training process is different, and the training sample set of the third classification model contains training samples corresponding to various sleep states; as previously described, the sleep state may include: falling asleep, light sleep, deep sleep, rapid eye movement sleep, and the like. For further details of these steps, reference may be made to the description of epilepsy detection, which is not repeated here.

Similarly, in order to improve the accuracy of the detection result, as shown in fig. 7, before the second signal segment is processed, the signal quality of the EEG signal in the second signal segment may be detected, and when the signal quality of the EEG signal meets the requirement, the subsequent sleep detection may be performed; under the condition that the signal quality of the EEG signal does not meet the requirement, the tightness adjusting module can be controlled to adjust the tightness of the intelligent eyeshade. The specific signal quality detection method and the tightness adjustment method are similar to the related methods in epilepsy detection, and are not described herein again.

For the case where the EEG electrodes include a plurality of EEG electrodes, the EEG signals of all EEG electrodes may be used when performing sleep detection; the EEG signal collected by one of the EEG electrodes may also be used to improve the processing efficiency, and correspondingly, during signal quality detection, the EEG signal with the best signal quality (referred to herein as the target EEG signal) may be selected, and subsequent sleep detection may be performed when the signal quality of the signal meets the requirement; and under the condition that the signal quality of the signal does not meet the requirement, controlling the tightness adjusting module to adjust the tightness of the intelligent eyeshade.

In order to improve the accuracy of the detection result, at least two EEG electrodes can be symmetrically arranged on two sides of the intelligent eyeshade so as to adapt to different sleeping postures of the user. For example, the two EEG electrodes may be symmetrically placed on the smart mask at locations corresponding to the FP1 and FP2 regions of the human body as shown in fig. 3, or may be placed at other locations on the smart mask that are left-right symmetric with respect to the midline of the frontal pole, such as locations corresponding to the F3 and F4 regions. Correspondingly, as shown in fig. 7, when performing signal quality detection, a sleeping posture can be determined according to the ACC signal in the second signal segment, and if the sleeping posture of the user is lying down, an EEG signal with the best signal quality, that is, a target EEG signal, can be determined according to the signal quality of each EEG signal; if the user's sleeping posture is lying on his side, the EEG signal corresponding to the EEG electrode on the same side as the user's sleeping posture can be determined as the target EEG signal, and then it is determined whether the signal quality of the determined target EEG signal meets the requirements. When the scheme determines that the user lies on the side, the signal quality of each path of EEG signal does not need to be judged, so that the detection efficiency can be improved to a certain extent, and the power consumption can be reduced. Of course, the EEG signal with the best signal quality can be directly determined from the EEG signals without judging the sleeping posture, and the detection method is simple without other sensor signals.

Considering that the duration of the second signal segment of the sleep detection is longer, the signal quality monitoring may also be performed in a preset signal quality detection period while performing the sleep detection, and the duration of the third signal segment corresponding to each period may be the same as the duration of the first signal segment corresponding to the epilepsy detection period, or may be slightly greater than or less than the duration of the first signal segment. Under the condition that the signal quality of the EEG signal meets the requirement, no processing is needed; under the condition that the signal quality of the EEG signal does not meet the requirement, the tightness adjusting module can be controlled to adjust the tightness of the intelligent eyeshade.

It can be understood that if the intelligent eyeshade simultaneously starts the epilepsy detection function and the sleep detection function, the signal quality detection requirements of the epilepsy detection and the sleep detection can be simultaneously met through the signal quality detection in the epilepsy detection process, and the signal quality monitoring is not additionally needed during the sleep detection; and in the epileptic detection, signal quality detection is carried out on each path of EEG signals, after the tightness is adjusted, the signal quality of each path of EEG signals meets the requirements, and one path or multiple paths of EEG signals meeting the signal quality requirements can be selected at will to carry out subsequent sleep state judgment during sleep detection.

According to the sleep detection method, the accuracy of the sleep state detection result can be improved by combining the EEG signal to carry out sleep monitoring. In addition, the subsequent sleep detection process is carried out under the condition that the signal quality of the EEG signal meets the requirement, and when the signal quality of the EEG signal does not meet the requirement, the tightness of the intelligent eye patch is adjusted through the tightness adjusting module to ensure that the signal quality of the EEG signal meets the requirement, so that the accuracy of the sleep state detection result can be further improved.

As described above, the smart eyewear may transmit seizure data and sleep state data to the terminal device to facilitate management of epileptic diseases and sleep by the user. The following describes an epilepsy management process in a terminal device by taking epilepsy management as an example.

The terminal device may provide an epilepsy management function, which may be a function in a certain application or may be a single application, and in this embodiment, the epilepsy detection function is exemplified as a function in the health management application.

Fig. 8 is a schematic view of an application interface provided in an embodiment of the present application, as shown in fig. 8 (a), an application icon (for example, the exercise health icon 11 shown in fig. 8) and other application icons corresponding to a health management application are displayed in a screen interface of the terminal device 200, and a user may click the exercise health icon 11 to open the health management application; as shown in (b) of fig. 8, the terminal device 200 displays the main interface 10 of the health management application in response to the user's operation of clicking the sports health icon, where the main interface 10 may include a function name 101, a card list 102, and a navigation bar 103, where:

the function name 101 may be used to indicate a currently open function, such as the "healthy" function shown in the figure.

Cards corresponding to various health management functions provided by the health management application, such as a main card 1021 (which can be used for viewing basic activity data such as step number and calorie), an epilepsy recording card 1022, a sleep card 1023, a weight card 1024 and a movement recording card 1025, which are shown in the card list 102, a heart rate card and a blood sugar card, which are not shown, may be included in the card list 102, and all or part of the cards may be displayed in the card list 102; the user may view the hidden portion of the card list 102 through a swipe operation, such as: weight card 1024 and hidden portions of exercise record card 1025, as well as other cards in card list 102 (e.g., heart rate cards). Additionally, an edit card control (not shown) may be provided below the card list 102 for a user to edit cards contained in the card list 102; other content may also be contained below the card list 102, such as: healthy life recommendation content, and the like.

Various function menus may be included in the navigation bar 103, such as shown in fig. 8 (b): a "health" function for viewing various health management functions, an "exercise" function for viewing various exercise data, a "device" function for managing connected intelligent health devices, and a "my" function for personal account management.

As described above, the smart eyewear 100 may transmit the detected seizure data and sleep state data to the terminal device 200, and accordingly, the terminal device 200 may manage the data for the user to view. Specifically, the user may open the card detail page by clicking the card to view data corresponding to the card, which is exemplified by the epilepsy recording card.

As shown in fig. 8 (b), after clicking the epilepsy recording card 1022, the user may enter into the epilepsy recording details page 20, as shown in fig. 8 (c), the epilepsy recording details page 20 may show the epilepsy seizure recording 203 of the user, and may include a return control 201 and a epilepsy seizure severity degree selection control 202, and the user may return to the upper level interface of the epilepsy recording details page 20 through the return control 201; a seizure record of seizure severity to be displayed is selected by the seizure severity selection control 202, wherein the seizure severity corresponds to the severity identified by the intelligent eyewear 100, which may include, for example, mild, moderate and severe, as shown in fig. 8 (c), and seizure records 203 of all severity may be displayed by default in the seizure record details page 20, wherein each seizure record may show the severity of seizure, seizure date, seizure duration and start-stop time, etc. It is understood that the terminal device 200 may also obtain the epileptic seizure data through other intelligent health devices having epileptic monitoring functions, and correspondingly, the epileptic seizure records 203 may include records generated by the terminal device 200 according to the epileptic seizure data obtained from other intelligent health devices.

In addition, the epilepsy record details page 20 may include controls such as an add control 204 and a statistics control 205, and a user may open an epilepsy record adding interface through the add control 204 to manually add the epilepsy data and view the epilepsy statistics data through the statistics control 205, which is illustrated below.

As shown in (a) and (b) of fig. 9, the user may click the adding control 204 to open the epileptic seizure record adding interface 30, and the epileptic seizure record adding interface 30 may include a parameter editing item 301, a cancellation control 302 and a confirmation control 303, where the parameter editing item 301 may include editing options related to epileptic seizure data, such as severity, seizure date, start time and end time, and the parameter editing item 301 may guide the user to complete the adding of epileptic seizure records; the user can cancel the addition of the seizure record by clicking the cancel control 302 and return to the upper level interface of the seizure record adding interface 30; as shown in fig. 9 (b) and (c), after the user edits each parameter edit item 301, the user can confirm the added seizure record by clicking on the confirmation control 303, and the seizure record added by the user can be updated in the seizure record details page 20.

As shown in fig. 10 (a) and (b), the user may click on the statistics control 205 to open the seizure statistics interface 40, which may display the user's seizure statistics data 403 and may include a return control 401 and a seizure severity degree selection control 402, and the user may return to the upper interface of the seizure statistics interface 40 through the return control 201; the seizure statistics of seizure severity to be displayed are selected by the seizure severity selecting control 402, and as shown in (b) of fig. 10, the statistics of mild seizures may be displayed by default in the seizure statistics interface 40. The statistical data of the epileptic seizures can include weekly statistical data counted by taking days as a unit, monthly statistical data counted by taking weeks as a unit, yearly statistical data counted by taking months as a unit, total statistical data and the like, and the statistical data can display the epileptic seizure duration in a mode of column diagrams and the like and can display data such as epileptic seizure times and the like in a corresponding statistical mode.

Similarly, the user may check the corresponding health management data through the card detail pages corresponding to other cards, and may also manually add the health management data and check the corresponding statistical data, and the like, and the card detail pages of different cards may adopt different display modes according to the characteristics of the health management data to be displayed, and may be set as needed in specific implementation, which is not particularly limited in this embodiment.

As described above, the intelligent eyewear 100 may automatically transmit the seizure data and the sleep state data to the terminal device 200 when the connection is established with the terminal device 200, or may store the seizure data and the sleep state data, and synchronize the stored seizure data with the terminal device 200 when the user triggers data synchronization. Accordingly, the terminal device 200 may provide an automatic synchronization function and a manual synchronization function by which health data of the user is acquired from the intelligent health device including the intelligent eyecup.

As shown in fig. 11, the terminal device 200 may provide a synchronization control 501 corresponding to the manual synchronization data and a switch control 502 for automatically synchronizing the data in the application setting interface 50, and the user may manually synchronize the data by clicking the synchronization control 501 and select to turn on or off the automatic synchronization function by clicking the switch control 502. The application setting interface 50 may be opened by clicking a setting option in the "my" function, and the interface may further include other setting options, such as options of data sharing, message management, privacy, cache clearing, and the like, which are shown in the figure, and this embodiment is not particularly limited in this respect. The user may also synchronize data by touching down a swipe in the main interface 10 for ease of use by the user.

For convenience of use by the user, the health management application may also provide device control functionality for controlling the connected intelligent health devices, and in particular, may implement the device control functionality under the "device" functionality in the navigation bar 103. As shown in fig. 12 (a) and (b), the user may click on the "device" function, opening the device management interface 60; the device management interface 60 may include an add device control 601 and my device bar, where the add device control 601 may be displayed by a card or in other manners, and a user may add a new intelligent health device through the add device control; the my equipment column lists equipment editing options corresponding to various intelligent health equipment paired with the terminal equipment 200, such as eye cover editing option 602 corresponding to an intelligent eye cover and bracelet editing option 603 corresponding to an intelligent bracelet shown in the figure, and a user can set corresponding intelligent health equipment through the equipment editing options.

For example, as shown in (b) and (c) of fig. 12, the user may click the eye shade editing option 602 to open the eye shade setting interface 70, and the eye shade setting interface 70 may include a device card 701 for displaying device status information and various function editing options, where the device status information may include a device name (e.g., "Aaa 111"), a connection status, a remaining power amount, and the like of the smart eye shade.

The function editing options may include a guide of use option 702, an epilepsy monitoring option 703, a sleep monitoring option 704, an emergency call for help option 705, a bluetooth disconnect alert option 706, and a unpaired option 707, among others. The user can check related use guide through the use guide option 702, turn on or turn off the epilepsy monitoring function of the intelligent eyeshade 100 through the epilepsy monitoring option 703, turn on or turn off the sleep monitoring function of the intelligent eyeshade 100 through the sleep monitoring option 704, start the emergency call function through the emergency call option 705, turn on or turn off the bluetooth disconnection reminding service through the bluetooth disconnection reminding option 706, and release the pairing connection between the intelligent eyeshade 100 and the terminal device 200 through the release pairing option 707. Through above-mentioned these functions, the user can be convenient set up intelligent eye-shade, and can reduce the adverse effect that seizure brought the patient through the timely guardian of reminding of emergency call for help function.

Fig. 12 (d) is a schematic diagram of an emergency call interface, and as shown in fig. 12 (c) and (d), the user may click the emergency call option 705 to open the emergency call interface 80, which may include: the system comprises a return control 801, an automatic help-seeking information sending option 802, an automatic help-seeking telephone dialing option 803, an emergency contact option 804, an emergency call time period option 805 and the like, wherein a user can return to a previous level interface of the emergency call interface 80 through the return control 801, turn on or turn off a function of automatically sending help-seeking information through the automatic help-seeking information sending option 802, and turn on or turn off a function of automatically dialing a help-seeking telephone through the automatic help-seeking telephone dialing option 803, wherein after the function of automatically sending help-seeking information is turned on, the terminal device 200 can automatically send help-seeking information containing a health state (such as severe epilepsy) to an emergency contact when the severity of epileptic seizure reaches a target degree (such as severe epilepsy); after the function of automatically dialing the help-seeking telephone is started, the terminal device 200 can automatically call the emergency contact and play the help-seeking recording when the severity of the epileptic seizure reaches the target degree, and can automatically hang up the telephone after the completion of the playing, wherein the help-seeking recording can contain information such as the severity of the epileptic seizure of the user. For ease of use by the user, the corresponding functional prompts may be displayed under the automatic send help information option 802 and the automatic dial help call option 803, as shown in the figure.

In addition, the user may set an emergency contact through the emergency contact option 804, specifically, may manually input a phone number of the emergency contact, or may select the emergency contact from the address list. In order to improve flexibility, the health management application may provide the emergency call time period option 805, so that the user may set an emergency call time period, for example, in the daytime, a guardian may be around the patient, and the guardian may find the epileptic seizure condition of the patient in time, and may not activate the emergency call function in the daytime, and correspondingly, the emergency call time period may be set to a time period corresponding to night, for example, 22:00 to 07:00 on the second day; if the patient does not have guardians around the day, the emergency call-for-help period may be set to be all day as shown.

The terminal equipment that this embodiment provided can make the convenient seizure data of management epileptic disease of user through above-mentioned epileptic management function to can make the convenient relevant function that sets up intelligent eye-shade of user, in addition, through the emergency call for help function, the guardian of reminding that can be timely, thereby can reduce the adverse effect that epileptic seizure brought to the patient.

It can be understood that the terminal device may also perform sleep management according to the sleep state data acquired from the intelligent eye patch, similar to epilepsy management, the terminal device may display the sleep state history record after the user clicks the sleep card 1023, and may also provide sleep statistical data, and the user may also manually input sleep data such as the sleep record, and the specific interface may refer to various current sleep management interfaces, which are not described herein again.

Based on the same inventive concept, as an implementation of the foregoing method, an embodiment of the present application provides a health management device, where an embodiment of the device corresponds to the foregoing method embodiment, and for convenience of reading, details in the foregoing method embodiment are not repeated in this device embodiment one by one, but it should be clear that the device in this embodiment can correspondingly implement all the contents in the foregoing method embodiment.

Fig. 13 is a schematic structural diagram of a health management device according to an embodiment of the present application, and as shown in fig. 13, the device according to the embodiment includes:

a display module 310, an input module 320, a processing module 330, and a communication module 340.

The display module 310 is used to support the terminal device to perform the interface display operation in the above embodiments and/or other processes for the technology described herein. The display unit may be a touch screen or other hardware or a combination of hardware and software.

The input module 320 is used for receiving input of a user on a display interface of the terminal device, such as touch input, voice input, gesture input, and the like, and is used for enabling the terminal to perform the steps related to receiving the user operation in the above embodiments and/or other processes for the technology described herein. The input module may be a touch screen or other hardware or a combination of hardware and software.

Processing module 330 is used to enable the terminal device to perform the processing operations in the above-described embodiments and/or other processes for the techniques described herein.

The communication module 340 is used to enable the terminal device to perform operations related to the communication process between the cloud and the smart eyewear in the above embodiments and/or other processes for the techniques described herein.

The apparatus provided in this embodiment may perform the above method embodiments, and the implementation principle and the technical effect are similar, which are not described herein again.

It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

Embodiments of the present application further provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the method described in the above method embodiments.

The embodiment of the present application further provides a computer program product, which when running on a terminal device, enables the terminal device to implement the method described in the above method embodiment when executed.

An embodiment of the present application further provides a chip system, which includes a processor, where the processor is coupled to the memory, and the processor executes a computer program stored in the memory to implement the method in the foregoing method embodiment. The chip system can be a single chip or a chip module consisting of a plurality of chips.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in or transmitted over a computer-readable storage medium. The computer instructions may be transmitted from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optics, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., a floppy Disk, a hard Disk, or a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a Solid State Disk (SSD)), among others.

One of ordinary skill in the art will appreciate that all or part of the processes in the methods of the above embodiments may be implemented by hardware related to instructions of a computer program, which may be stored in a computer-readable storage medium, and when executed, may include the processes of the above method embodiments. And the aforementioned storage medium may include: various media capable of storing program codes, such as ROM or RAM, magnetic or optical disks, etc.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus/device and method may be implemented in other ways. For example, the above-described apparatus/device embodiments are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.

It should also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

As used in this specification and the appended claims, the term "if" may be interpreted contextually as "when", "upon" or "in response to" determining "or" in response to detecting ". Similarly, the phrase "if it is determined" or "if a [ described condition or event ] is detected" may be interpreted contextually to mean "upon determining" or "in response to determining" or "upon detecting [ described condition or event ]" or "in response to detecting [ described condition or event ]".

Furthermore, in the description of the present application and the appended claims, the terms "first," "second," "third," and the like are used for distinguishing between descriptions and not necessarily for describing or implying relative importance.

Reference throughout this specification to "one embodiment" or "some embodiments," or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," or the like, in various places throughout this specification are not necessarily all referring to the same embodiment, but rather "one or more but not all embodiments" unless specifically stated otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless expressly specified otherwise.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims

1. An intelligent eye patch is characterized in that the intelligent eye patch is provided with a signal acquisition unit, a processing unit and an EEG electrode, wherein,

the signal acquisition unit is used for:

detecting an EEG signal corresponding to the EEG electrode;

detecting a heart rate signal of the wearer;

detecting a head movement signal of the wearer;

the processing unit is configured to:

2. The intelligent eyeshade of claim 1, wherein the intelligent eyeshade comprises an eyeshade body and fixing bands connected with two ends of the eyeshade body, and the EEG electrodes are located on the eyeshade body in the region corresponding to the forehead of the human body.

3. The intelligent eyewear of claim 2, wherein the signal acquisition unit comprises: the simulation front end chip, the intelligence eye-shade still includes: the analog front end chip is used for outputting EEG signals corresponding to the EEG electrodes according to the signals collected by the reference electrodes and the signals collected by the EEG electrodes.

4. The intelligent eyewear of claim 3, wherein the reference electrode is connected to the fixation strap by a connecting wire.

5. The intelligent eyeshade of claim 3, wherein a nose mask is provided on the underside of the middle portion of the eyeshade body, and the reference electrode is provided on the nose mask at a position corresponding to the tip of the human nose.

6. The intelligent eyeshade of claim 5, wherein a nose bridge strip matching the nose bridge is provided on the eyeshade body at a position corresponding to the nose bridge.

7. The intelligent eye shield as recited in any one of claims 1-6, wherein the EEG electrodes comprise a plurality of electrodes, the intelligent eye shield further comprising: the elasticity adjusting module, the processing unit is specifically used for: detecting the signal quality of an EEG signal corresponding to each EEG electrode, and carrying out epilepsy detection according to the EEG signal, the heart rate signal and the head movement signal under the condition that the signal quality of each EEG signal meets the requirement; and under the condition that the signal quality of any EEG signal does not meet the requirement, controlling the tightness adjusting module to adjust the tightness of the intelligent eye patch.

8. The intelligent eyewear of claim 7, wherein the processing unit is further configured to: determining a target EEG signal from each of said EEG signals, detecting the signal quality of said target EEG signal, detecting the sleep state of the user from said target EEG signal if said target EEG signal meets requirements; controlling the tightness adjustment module to adjust the tightness of the intelligent eyeshade if the signal quality of the target EEG signal does not meet requirements; and sending corresponding sleep state data to the terminal equipment.

9. The intelligent eye shield of claim 8, wherein at least two EEG electrodes are symmetrically disposed on both sides of said intelligent eye shield, said processing unit being specifically configured to: detecting the sleeping posture of the user according to the head movement signal; if the sleeping posture of the user is lying on the side, determining an EEG signal corresponding to an EEG electrode on the same side as the sleeping posture of the user as a target EEG signal; and if the sleeping posture of the user is lying, determining the EEG signal with the best signal quality in the EEG signals as a target EEG signal.

10. The intelligent eye shield of claim 8, wherein said processing unit is specifically configured to: and determining the EEG signal with the best signal quality in each EEG signal as a target EEG signal.

11. The intelligent eyewear of any of claims 1-10, further comprising: and the processing unit is also used for controlling the sleep stimulation module to output a stimulation signal for improving the sleep state of the user according to the EEG signal and the detected sleep state.

12. The intelligent eyewear of any of claims 1-11, wherein the seizure data comprises a plurality of the following data: the time of the epileptic seizure, the duration of the epileptic seizure, the severity of the epileptic seizure, the EEG signal detected by the signal acquisition unit between a first moment before the epileptic seizure and a second moment after the epileptic seizure is over, the heart rate signal and the head movement signal.

13. A health management method is applied to terminal equipment and is characterized by comprising the following steps:

acquiring seizure data detected by the intelligent eyewear of any one of claims 1-12;

in response to a first operation by the user, displaying seizure records generated based on the acquired seizure data, each seizure record including a severity of a seizure, a seizure time, and a seizure duration.

14. The method of claim 13, further comprising:

responding to a second operation of the user, and acquiring epileptic seizure data input by the user;

and updating the record of the epileptic seizure.

15. The method according to claim 13 or 14, characterized in that the method further comprises:

and reminding the target contact person when the user is determined to be in the epileptic seizure state according to the epileptic seizure data and the severity of the epileptic seizure reaches the target severity.

16. The method of claim 15, wherein the alerting the target contact comprises:

sending help seeking information to the target contact person;

17. The method of claim 15 or 16, wherein prior to the alerting the target contact, the method further comprises:

18. The method of claim 17, further comprising:

and responding to a fifth operation performed by a user in the intelligent eye shield setting interface, and controlling the intelligent eye shield to open or close target functions, wherein the target functions comprise an epilepsy monitoring function for continuously performing epilepsy detection and/or a sleep monitoring function for continuously performing sleep state detection.

19. The method according to any one of claims 13-18, further comprising:

and responding to a sixth operation of the user, displaying statistical data generated based on the epileptic seizure data, wherein the statistical data comprises the epileptic seizure times and the epileptic seizure duration counted by different statistical cycles corresponding to any severity.

20. A terminal device, comprising: a memory for storing a computer program and a processor; the processor is adapted to perform the method of any of claims 13-19 when the computer program is invoked.

21. A health management system, comprising: the intelligent eyewear of any of claims 1-12 and the terminal device of claim 20.

22. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method according to any one of claims 13-19.

23. A chip system, comprising a processor coupled to a memory, the processor executing a computer program stored in the memory to implement the method of any one of claims 13-19.