WO2022151887A1 - Sleep monitoring method and related apparatus - Google Patents

Sleep monitoring method and related apparatus Download PDF

Info

Publication number
WO2022151887A1
WO2022151887A1 PCT/CN2021/137461 CN2021137461W WO2022151887A1 WO 2022151887 A1 WO2022151887 A1 WO 2022151887A1 CN 2021137461 W CN2021137461 W CN 2021137461W WO 2022151887 A1 WO2022151887 A1 WO 2022151887A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
user
sleep state
data
mobile phone
Prior art date
Application number
PCT/CN2021/137461
Other languages
French (fr)
Chinese (zh)
Inventor
韩佳
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2022151887A1 publication Critical patent/WO2022151887A1/en

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4806—Sleep evaluation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024—Detecting, measuring or recording pulse rate or heart rate
    • A61B5/02438—Detecting, measuring or recording pulse rate or heart rate with portable devices, e.g. worn by the patient
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1118—Determining activity level
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4806—Sleep evaluation
    • A61B5/4809—Sleep detection, i.e. determining whether a subject is asleep or not
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4806—Sleep evaluation
    • A61B5/4812—Detecting sleep stages or cycles
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4806—Sleep evaluation
    • A61B5/4815—Sleep quality
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6802—Sensor mounted on worn items
    • A61B5/681—Wristwatch-type devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72412—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/12—Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion

Definitions

  • the present application relates to the technical field of artificial intelligence, and in particular, to a sleep monitoring method and related devices.
  • the quality of sleep is closely related to people's physical health. More and more electronic devices (such as wristbands, watches, etc.) have a sleep monitoring function to monitor the quality of a person's sleep.
  • Sleep monitoring needs to determine whether the user has entered a sleep state and whether the user has woken up.
  • Current electronic devices such as wristbands, usually determine whether a user is in a sleep state by monitoring their own exercise state and the change in the user's heart rate.
  • the above method is likely to cause misjudgment of the sleep state. For example, in the scenario where the user uses the mobile phone in a fixed posture before going to bed, the user does not enter the sleep state. The bracelet often judges that the user has entered a sleep state, resulting in inaccurate sleep quality monitoring.
  • the present application provides a sleep monitoring method and a related device, which can determine whether a user enters a sleep state through the cooperation of multiple electronic devices, so as to improve the accuracy of monitoring the time when the user enters the sleep state.
  • the present application provides a sleep monitoring method.
  • the first electronic device may receive the first request of the second electronic device.
  • the first electronic device has a binding relationship with the second electronic device.
  • the first request may be sent when the second electronic device is in a wearing state and the first data is monitored.
  • the first data is consistent with the data that the user enters the sleep state.
  • the first electronic device may determine whether the first user wearing the second electronic device is using the first electronic device, and send the first determination result or the second determination result to the second electronic device.
  • the first determination result is that the first user is using the first electronic device
  • the second determination result is that the first user is not using the first electronic device.
  • the above-mentioned first electronic device can be a mobile phone, a tablet computer, a laptop computer, a handheld computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (personal digital assistant, PDA) and smart glasses, etc.
  • Electronic equipment The above-mentioned second electronic device may be an electronic device for monitoring the sleep quality of the user. For example, bracelets, watches, etc. When the second electronic device is in the wearing state, the sleep quality of the user can be monitored.
  • the above-mentioned first data is the data monitored when the second electronic device is worn by the first user.
  • the above-mentioned first data may include physiological characteristic data of the first user and motion data of the second electronic device.
  • the above-mentioned physiological characteristic data may be, for example, heart rate data.
  • the motion data of the second electronic device may be, for example, acceleration data and angular velocity data.
  • the above-mentioned first data is consistent with the data that the user enters the sleep state, which may indicate that the second electronic device prejudges that the first user enters the sleep state.
  • the above-mentioned first data may be collected through big data, and may reflect physiological characteristic data of a general user wearing the second electronic device and enter a sleep state and motion data of the second electronic device.
  • the above-mentioned second data may include physiological characteristic data of the first user wearing the second electronic device and actually entering a sleep state and motion data of the second electronic device. The second electronic device can more accurately predict whether the first user enters the sleep state by using the physiological characteristic data and the motion data of the second electronic device that the first user wears the second electronic device actually enters the sleep state.
  • the first electronic device may determine under the first condition that the first electronic device is being used by the user and the user is the first user, and the first electronic device obtains the first determination result.
  • the first condition may include one or more of the following: the first electronic device determines that it is in a non-stationary state, the first electronic device detects a user operation within a first time period, the first electronic device detects that a human eye is watching the first The screen of the electronic device and the first electronic device detect that it is running a screen-casting application.
  • the first electronic device can determine under the first condition that the first electronic device is being used by the user and the user is not the first user, or the first electronic device determines that the first electronic device is not being used by the user, then the first electronic device A second judgment result is obtained.
  • the first electronic device can determine that a user is using the first electronic device. If the first electronic device monitors the user operation within the first time, the first electronic device may determine that a user is using the first electronic device. If the first electronic device detects that a human eye is looking at the screen of the first electronic device, the first electronic device may determine that a user is using the first electronic device. If the first electronic device runs a screen-casting application, the first electronic device can determine that a user is using the first electronic device.
  • the first electronic device may first determine whether it is in a stationary state. If the first electronic device is in a non-stationary state and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is in a stationary state, the first electronic device may further determine whether a user operation is monitored within the first time period. If the user operation is monitored within the first time period, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If no user operation is monitored within the first time period, the first electronic device may further monitor whether human eyes are watching the screen of the first electronic device.
  • the first electronic device can obtain the first determination result. If it is detected that no human eyes are watching the screen of the first electronic device, the first electronic device can obtain the second judgment result. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is not the first user, the first electronic device can obtain the second determination result.
  • the first electronic device may further monitor whether it runs an application program for screen projection. If a screen-casting application is running, and it is determined that the user is the first user, the first electronic device can obtain the first judgment result. If it is detected that no human eye is watching the screen of the first electronic device, and no application program for screen projection is running, the first electronic device can obtain the second judgment result.
  • the first electronic device may first determine whether it is in a stationary state. If the first electronic device is in a non-stationary state and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is in a stationary state, the first electronic device can further monitor whether human eyes are watching the screen of the first electronic device. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is detected that no human eyes are watching the screen of the first electronic device, the first electronic device can obtain the second judgment result. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is not the first user, the first electronic device can obtain the second determination result.
  • the first electronic device may first determine whether a user operation is monitored within the first time period. If the user operation is monitored within the first time period, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If no user operation is monitored within the first time period, the first electronic device may further monitor whether human eyes are watching the screen of the first electronic device. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is detected that no human eyes are watching the screen of the first electronic device, the first electronic device can obtain the second judgment result. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is not the first user, the first electronic device can obtain the second determination result.
  • the first electronic device may monitor whether human eyes are watching the screen of the first electronic device. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is detected that no human eyes are watching the screen of the first electronic device, the first electronic device can obtain the second judgment result. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is not the first user, the first electronic device can obtain the second determination result.
  • the first electronic device may use sensors such as an acceleration sensor, a gyroscope sensor and the like to determine whether it is in a stationary state.
  • sensors such as an acceleration sensor, a gyroscope sensor and the like to determine whether it is in a stationary state.
  • the above-mentioned user operation may be a touch operation acting on the screen of the first electronic device, a user operation acting on a button of the first electronic device, an input operation of a voice command, an input operation of an air gesture, and the like.
  • the first electronic device may determine whether a human eye is looking at the screen of the first electronic device through a human eye gaze recognition model.
  • the human eye gaze recognition model may be a neural network model.
  • the training data for training the human eye gaze recognition model may include image data of the human eye looking at the screen and image data of the human eye not looking at the screen.
  • the trained human eye gaze recognition model can identify the characteristics of the image in which the human eye gazes at the screen, so as to determine whether the human eye gazes at the screen of the mobile phone 100 .
  • the method for the first electronic device to determine that the user is the first user may include: the first electronic device may determine, through the first image captured by the camera, that the first image contains the face of the first user The image is used to determine the user of the first electronic device as the first user.
  • the above-mentioned camera for collecting the first image may be a camera of the first electronic device, or a camera of a screen projection device.
  • the first electronic device can also determine whether the user of the first electronic device is the first user by collecting other biometric information (such as voiceprint information, fingerprint information, etc.).
  • the first electronic device may establish a binding relationship with the second electronic device by pairing with Bluetooth.
  • the first electronic device may establish a binding relationship with the second electronic device in response to the first user operation.
  • the first user operation may be used to indicate that the owner of the first electronic device is the first user.
  • the first electronic device may establish a binding relationship with the second electronic device by logging into the same account.
  • the first electronic device can determine that the owner of the first electronic device and the user wearing the second electronic device are the same person. In this way, the user of the first electronic device and the user wearing the second electronic device are not the same person, and misjudgment on whether the user enters the sleep state can be reduced.
  • the second electronic device may request the first electronic device to further confirm whether the first user enters the sleep state.
  • the first electronic device may confirm whether the first user enters the sleep state by judging whether the first user is using the first electronic device. This can reduce the misjudgment of whether the user enters the sleep state because the user maintains a fixed posture for a long time but is not in the sleep state when the second electronic device is used alone to monitor whether the user enters the sleep state, and improves the monitoring of the time when the user enters the sleep state 's accuracy.
  • the first electronic device monitors a user operation to unlock the first electronic device within the second time period, and the first electronic device may send the first message to the second electronic device.
  • the first message may be used to indicate that the first user is using the first electronic device.
  • the first electronic device detects a user operation to turn off the alarm clock within the second time period, and the user who turns off the alarm clock is the first user, and the first electronic device may send the above-mentioned first message to the second electronic device.
  • the above unlocking method may be a method of unlocking by using biometric information.
  • the biometric information may be, for example, face information, voiceprint information, fingerprint information, and the like.
  • the first electronic device may determine that the unlocked user is the first user.
  • the above-mentioned second time period may be a time period of a first duration from when the first electronic device sends the second judgment result to the second electronic device.
  • the second time period may be a preset time period.
  • the second electronic device can use the first electronic device to determine whether the first user exits the sleep state. This can reduce the misjudgment of whether the first user has exited the sleep state when the first user has woken up but has not woken up, and improve the accuracy of sleep quality monitoring.
  • the present application also provides a sleep monitoring method.
  • the second electronic device monitors the first data while in the wearing state.
  • the first data is consistent with the data that the user enters the sleep state.
  • the second electronic device sends the first request to the first electronic device.
  • the first electronic device has a binding relationship with the second electronic device.
  • the second electronic device determines that the first user wearing the second electronic device has not entered a sleep state.
  • the first determination result is a determination result of determining that the first user is using the first electronic device after the first electronic device receives the first request.
  • the above-mentioned first data is the data monitored when the second electronic device is worn by the first user.
  • the above-mentioned first data may include physiological characteristic data of the first user and motion data of the second electronic device.
  • the above-mentioned physiological characteristic data may be, for example, heart rate data.
  • the motion data of the second electronic device may be, for example, acceleration data and angular velocity data.
  • the above-mentioned first data is consistent with the data that the user enters the sleep state, which may indicate that the second electronic device prejudges that the first user enters the sleep state.
  • the above-mentioned first data may be collected through big data, and may reflect physiological characteristic data of a general user wearing the second electronic device and enter a sleep state and motion data of the second electronic device.
  • the above-mentioned second data may include physiological characteristic data of the first user wearing the second electronic device and actually entering a sleep state and motion data of the second electronic device. The second electronic device can more accurately predict whether the first user enters the sleep state by using the physiological characteristic data and the motion data of the second electronic device that the first user wears the second electronic device actually enters the sleep state.
  • the second electronic device may monitor the second data while in the wearing state, and determine whether the second data and the data of the user entering the sleep state are not match. That is, the second electronic device can predict again whether the first user enters the sleep state.
  • the second electronic device may perform a pre-judgment every preset time period (such as 5 minutes, etc.), and when the pre-judgment result is that the first user enters a sleep state requesting the first electronic device to determine whether the first user enters a sleep state.
  • the above-mentioned second data is data of the first user, and the second data may include physiological characteristic data of the first user and motion data of the second electronic device.
  • the second electronic device may record the monitored physiological characteristic data of the user as data not in a sleep state.
  • the second electronic device determines that the first user enters a sleep state.
  • the second determination result is the determination result that the first electronic device determines that the first user does not use the first electronic device after receiving the first request.
  • the second electronic device may record the monitored physiological characteristic data of the user as data in the sleep state.
  • the second electronic device may request the first electronic device to further confirm whether the first user enters the sleep state.
  • the first electronic device may confirm whether the first user enters the sleep state by judging whether the first user is using the first electronic device. This can reduce the misjudgment of whether the user enters the sleep state because the user maintains a fixed posture for a long time but is not in the sleep state when the second electronic device is used alone to monitor whether the user enters the sleep state, and improves the monitoring of the time when the user enters the sleep state 's accuracy.
  • the second electronic device receives the first message from the first electronic device when detecting that the state of the first user is the sleep state, and can determine the first message detected by the second electronic device
  • the user's state is a non-sleep state.
  • the first message may be used to indicate that the first user is using the first electronic device.
  • the second electronic device can use the first electronic device to determine whether the first user exits the sleep state. This can reduce the misjudgment of whether the first user has exited the sleep state when the first user has woken up but has not woken up, and improve the accuracy of sleep quality monitoring.
  • the present application also provides a sleep monitoring method.
  • the second electronic device monitors the first data while in the wearing state.
  • the first data is consistent with the data that the user enters the sleep state.
  • the second electronic device may send the first request to the first electronic device.
  • the first electronic device has a binding relationship with the second electronic device.
  • the first electronic device receives the first request from the second electronic device.
  • the first electronic device may determine whether the first user wearing the second electronic device is using the first electronic device, and send the first determination result or the second determination result to the second electronic device.
  • the first determination result is that the first user is using the first electronic device.
  • the second judgment result is that the first user does not use the first electronic device. In the case of receiving the first judgment result, the second electronic device may determine that the first user does not enter the sleep state.
  • the second electronic device may request the first electronic device to further confirm whether the first user enters the sleep state.
  • the first electronic device may confirm whether the first user enters the sleep state by judging whether the first user is using the first electronic device. This can reduce the misjudgment of whether the user enters the sleep state because the user maintains a fixed posture for a long time but is not in the sleep state when the second electronic device is used alone to monitor whether the user enters the sleep state, and improves the monitoring of the time when the user enters the sleep state 's accuracy.
  • the first electronic device determines under the first condition that the first electronic device is being used by the user and the user is the first user, and the first electronic device obtains the first determination result.
  • the first condition includes one or more of the following: the first electronic device determines that it is in a non-stationary state, the first electronic device detects a user operation within the first time period, and the first electronic device detects that a human eye is watching the first electronic device. The screen of the device and the first electronic device detect that it is running a screen-casting application.
  • the first electronic device determines that the first electronic device is being used by the user and the user is not the first user, or the first electronic device determines that the first electronic device is not being used by the user, and the first electronic device obtains the first electronic device. 2. Judgment results.
  • the method for the first electronic device to determine that the user is the first user may be: the first electronic device captures the first image through a camera, and determines that the first image contains the first user face image.
  • the above-mentioned camera for collecting the first image may be a camera of the first electronic device, or a camera of a screen projection device.
  • the first electronic device can also determine whether the user of the first electronic device is the first user by collecting other biometric information (such as voiceprint information, fingerprint information, etc.).
  • the second electronic device may determine that the first user enters a sleep state.
  • the first electronic device may establish a binding relationship with the second electronic device by pairing with Bluetooth.
  • the first electronic device may establish a binding relationship with the second electronic device in response to the first user operation.
  • the first user operation may be used to indicate that the owner of the first electronic device is the first user.
  • the first electronic device may establish a binding relationship with the second electronic device by logging into the same account.
  • the first electronic device can determine that the owner of the first electronic device and the user wearing the second electronic device are the same person. In this way, the user of the first electronic device and the user wearing the second electronic device are not the same person, and misjudgment on whether the user enters the sleep state can be reduced.
  • the first electronic device monitors a user operation of unlocking the first electronic device within the second time period, and the first electronic device may send the first message to the second electronic device.
  • the first message may be used to indicate that the first user is using the first electronic device.
  • the first electronic device detects a user operation to turn off the alarm clock within the second time period, and the user who turns off the alarm clock is the first user, and the first electronic device may send the first message to the second electronic device.
  • the above unlocking method may be a method of unlocking by using biometric information.
  • the biometric information can be, for example, face information, voiceprint information, fingerprint information, and the like.
  • the first electronic device may determine that the unlocked user is the first user.
  • the above-mentioned second time period may be a time period of a first duration from when the first electronic device sends the second judgment result to the second electronic device.
  • the second time period may be a preset time period.
  • the second electronic device can use the first electronic device to determine whether the first user exits the sleep state. This can reduce the misjudgment of whether the first user has exited the sleep state when the first user has woken up but has not woken up, and improve the accuracy of sleep quality monitoring.
  • the present application also provides a sleep monitoring method.
  • the second electronic device receives the first message of the first electronic device when detecting that the state of the first user wearing the second electronic device is a sleep state, and can determine the first message detected by the second electronic device The user's state is a non-sleep state.
  • the first electronic device has a binding relationship with the second electronic device.
  • the first message may be sent by the first electronic device after monitoring the user operation of unlocking the first electronic device within the first monitoring time period.
  • determining that the detected state of the first user is a non-sleep state may specifically be marking the detected state of the first user from a sleep state to a non-sleep state. That is to say, when receiving the above-mentioned first message, the second electronic device may determine that the first user wakes up. Furthermore, the second electronic device may determine the moment when the first message is received or the moment when the first electronic device detects the unlocking user operation as the moment when the first user wakes up.
  • the second electronic device can use the first electronic device to determine whether the first user exits the sleep state. This can reduce the misjudgment of whether the first user has exited the sleep state when the first user has woken up but has not woken up, and improve the accuracy of sleep quality monitoring.
  • the above unlocking method may be a method for unlocking by using biometric information.
  • the biometric information may be, for example, face information, voiceprint information, fingerprint information, and the like.
  • the first electronic device may determine that the unlocked user is the first user.
  • the second electronic device monitors the first data while in the wearing state.
  • the first data is consistent with the data that the user enters the sleep state.
  • the second electronic device may send the first request to the first electronic device.
  • the second electronic device receives the judgment result that the first electronic device indicates that the first user does not use the first electronic device, and can determine that the state of the first user detected by the second electronic device is the sleep state.
  • the above-mentioned first monitoring time period may be a time period for which the second electronic device estimates the first user to exit the sleep state.
  • the above-mentioned first monitoring time period may be a fixed time period, such as a time period from 5:00 am to the above-mentioned 10:00 am.
  • the above-mentioned first monitoring period may be the first period of time from the first electronic device sending a judgment result indicating that the first user does not use the first electronic device to the second electronic device part.
  • the above-mentioned first monitoring time period and the second time period in the foregoing embodiment may be the same time period.
  • the first electronic device may establish a binding relationship with the second electronic device by pairing with Bluetooth.
  • the first electronic device may establish a binding relationship with the second electronic device in response to the first user operation.
  • the first user operation may be used to indicate that the owner of the first electronic device is the first user.
  • the first electronic device may establish a binding relationship with the second electronic device by logging into the same account.
  • the first electronic device can determine that the owner of the first electronic device and the user wearing the second electronic device are the same person. In this way, the user of the first electronic device and the user wearing the second electronic device are not the same person, and misjudgment on whether the user enters the sleep state can be reduced.
  • the second electronic device may further record the monitored physiological characteristic data of the user as not in a sleep state data.
  • the present application also provides a sleep monitoring method.
  • the first electronic device may monitor the user operation of unlocking the first electronic device within the first monitoring time period, and send the first message to the second electronic device.
  • the first message is used to indicate that the first user wearing the second electronic device is using the first electronic device.
  • the first electronic device has a binding relationship with the second electronic device.
  • the second electronic device receives the first message when detecting that the state of the first user is a sleep state, and may determine that the detected state of the first user is a non-sleep state.
  • determining that the detected state of the first user is a non-sleep state may specifically be marking the detected state of the first user from a sleep state to a non-sleep state. That is to say, when receiving the above-mentioned first message, the second electronic device may determine that the first user wakes up. Furthermore, the second electronic device may determine the moment when the first message is received or the moment when the first electronic device detects the unlocking user operation as the moment when the first user wakes up.
  • the second electronic device can use the first electronic device to determine whether the first user exits the sleep state. This can reduce the misjudgment of whether the first user has exited the sleep state when the first user has woken up but has not woken up, and improve the accuracy of sleep quality monitoring.
  • the second electronic device monitors the first data when it is in the wearing state, and the first data is consistent with the data that the user enters the sleep state.
  • the second electronic device sends the first request to the first electronic device.
  • the first electronic device receives the first request, determines whether the first user is using the first electronic device, and obtains a determination result indicating that the first user is not using the first electronic device.
  • the first electronic device may send a judgment result indicating that the first user does not use the first electronic device to the second electronic device.
  • the second electronic device may determine that the first user enters a sleep state.
  • the above-mentioned first monitoring time period may be a time period during which the second electronic device estimates the first user to exit the sleep state.
  • the above-mentioned first monitoring time period may be the first time period from the time when the first electronic device sends a judgment result indicating that the first user does not use the first electronic device to the second electronic device part.
  • the first electronic device before sending the above-mentioned first message to the second electronic device, may further determine under the first condition that the first electronic device is being used by the user and the user is the first electronic device a user.
  • the first condition includes one or more of the following: the first electronic device determines that it is in a non-stationary state, the first electronic device detects a user operation within the first time period, and the first electronic device detects that a human eye is watching the first electronic device.
  • the screen of the device and the first electronic device detect that it is running a screen-casting application.
  • the second electronic device may record the monitored physiological characteristic data of the user as data not in the sleep state.
  • the first electronic device may establish a binding relationship with the second electronic device by pairing with Bluetooth.
  • the first electronic device may establish a binding relationship with the second electronic device in response to the first user operation.
  • the first user operation may be used to indicate that the owner of the first electronic device is the first user.
  • the first electronic device may establish a binding relationship with the second electronic device by logging into the same account.
  • the first electronic device can determine that the owner of the first electronic device and the user wearing the second electronic device are the same person. In this way, the user of the first electronic device and the user wearing the second electronic device are not the same person, and misjudgment on whether the user enters the sleep state can be reduced.
  • the present application provides an electronic device.
  • the electronic device is a first electronic device.
  • the first electronic device may include a camera, a communication module, a memory and a processor.
  • a camera can be used to capture images.
  • the communication module can be used to establish a communication connection with the second electronic device.
  • Memory can be used to store computer programs.
  • the processor may be configured to invoke a computer program, so that the first electronic device executes any of the possible implementation methods of the above-mentioned first aspect.
  • the present application further provides an electronic device.
  • the electronic device is the second electronic device.
  • the second electronic device may include a communication module, a memory and a processor.
  • the communication module can be used to establish a communication connection with the first electronic device.
  • Memory can be used to store computer programs.
  • the processor may be configured to invoke a computer program, so that the second electronic device executes any possible implementation method of the second aspect above or any possible implementation method of the fourth aspect above.
  • the present application provides a sleep monitoring system, which may include the electronic device provided in the sixth aspect and the electronic device provided in the seventh aspect.
  • an embodiment of the present application provides a chip, which is applied to the electronic device provided in the sixth aspect or the electronic device provided in the seventh aspect, the chip includes one or more processors, and the processors are used to invoke computer instructions In order to make the electronic device provided in the sixth aspect above perform any possible implementation method as in the first aspect, or cause the electronic device provided in the seventh aspect above to perform any possible implementation method as in the second aspect or perform as in the fourth aspect Any possible implementation of the aspect.
  • an embodiment of the present application provides a computer program product containing instructions, when the computer program product is executed on an electronic device, the electronic device provided in the sixth aspect can perform any possible implementation as in the first aspect. method, or cause the electronic device provided in the seventh aspect to perform any possible implementation method as in the second aspect or perform any possible implementation method as in the fourth aspect.
  • an embodiment of the present application provides a computer storage medium, including computer instructions, when the computer instructions are executed on an electronic device, the electronic device provided in the sixth aspect can execute any of the possible operations in the first aspect.
  • the implementation method is implemented, or the electronic device provided in the seventh aspect is caused to perform any possible implementation method in the second aspect or any possible implementation method in the fourth aspect.
  • the electronic device provided in the sixth aspect the electronic device provided in the seventh aspect, the sleep monitoring system provided in the eighth aspect, the chip provided in the ninth aspect, the computer program product provided in the tenth aspect, and the eleventh aspect
  • the provided computer-readable storage media are all used to execute the methods provided by the embodiments of the present application. Therefore, for the beneficial effects that can be achieved, reference may be made to the beneficial effects in the corresponding method, which will not be repeated here.
  • FIG. 1 is a schematic structural diagram of a first electronic device 100 provided by an embodiment of the present application.
  • FIG. 2 is a schematic diagram of a sleep monitoring scenario provided by an embodiment of the present application.
  • FIG. 3 is a flowchart of a sleep monitoring method provided by an embodiment of the present application.
  • FIG. 5 is a flowchart of another sleep monitoring method provided by an embodiment of the present application.
  • FIG. 6 is a flowchart of another sleep monitoring method provided by an embodiment of the present application.
  • first and second are only used for descriptive purposes, and should not be understood as implying or implying relative importance or implying the number of indicated technical features. Therefore, the features defined with “first” and “second” may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise specified, the “multiple” The meaning is two or more.
  • the present application provides a sleep monitoring method, which can monitor whether a user enters a sleep state through the cooperation of a first electronic device and a second electronic device.
  • Sleep state can refer to the form that a person exhibits when sleeping.
  • the sleep state may include a sleep onset stage, a light sleep stage, and a deep sleep stage.
  • a user in a sleeping state maintains a fixed posture for a long time or has a small change in the posture of the limbs.
  • the heart rate of the user in the sleeping state fluctuates around the resting heart rate.
  • the first electronic device may be a mobile phone, a tablet computer, a laptop computer, a handheld computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), and smart glasses. equipment.
  • UMPC ultra-mobile personal computer
  • PDA personal digital assistant
  • the second electronic device is an electronic device for monitoring the user's sleep quality.
  • the sleep quality monitoring may include determining the total duration of the user in a sleep state, and data such as the duration of sleep onset, light sleep, and deep sleep in the sleep state.
  • the second electronic device may be, for example, an electronic device such as a wristband, a watch, or the like. That is, the user can monitor his own sleep quality by wearing the second electronic device.
  • the embodiments of the present application do not limit the specific types of the first electronic device and the second electronic device.
  • the second electronic device is worn on the first user.
  • a sleep model is stored in the second electronic device.
  • the second electronic device may use a sleep model to predict whether the first user enters a sleep state according to data collected by sensors such as an acceleration sensor and a heart rate sensor.
  • the second electronic device may send a request for confirming whether the first user enters the sleep state to the first electronic device.
  • the first electronic device can detect whether the first user is using the first electronic device. If it is determined that the first user is using the first electronic device, the first electronic device may notify the second electronic device that the first user is using the first electronic device.
  • the second electronic device may determine that the first user has not entered a sleep state according to the notification. Otherwise, the first electronic device may notify the second electronic device that the first electronic device is not used by the first user. The second electronic device may determine that the second user enters the sleep state according to the notification.
  • the second electronic device can request the first electronic device to further confirm whether the first user enters the sleep state. This can reduce the misjudgment of whether the user enters the sleep state because the user maintains a fixed posture for a long time but is not in the sleep state when the second electronic device is used alone to monitor whether the user enters the sleep state, and improves the monitoring of the time when the user enters the sleep state 's accuracy.
  • FIG. 1 exemplarily shows a schematic structural diagram of a first electronic device 100 provided by an embodiment of the present application.
  • the first electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, Battery 142, Antenna 1, Antenna 2, Mobile Communication Module 150, Wireless Communication Module 160, Audio Module 170, Speaker 170A, Receiver 170B, Microphone 170C, Headphone Jack 170D, Sensor Module 180, Key 190, Motor 191, Indicator 192, A camera 193, a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195 and the like.
  • SIM subscriber identification module
  • the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.
  • the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the first electronic device 100 .
  • the first electronic device 100 may include more or less components than shown, or some components are combined, or some components are separated, or different components are arranged.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processor
  • graphics processor graphics processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the controller may be the nerve center and command center of the first electronic device 100 .
  • the controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.
  • the USB interface 130 is an interface that conforms to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.
  • the USB interface 130 can be used to connect a charger to charge the first electronic device 100, and can also be used to transmit data between the first electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones.
  • the interface can also be used to connect other electronic devices, such as AR devices.
  • the charging management module 140 is used to receive charging input from the charger.
  • the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
  • the power management module 141 receives input from the battery 142 and/or the charging management module 140 and supplies power to the processor 110 , the internal memory 121 , the external memory, the display screen 194 , the camera 193 , and the wireless communication module 160 .
  • the wireless communication function of the first electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the first electronic device 100 may be used to cover a single or multiple communication frequency bands.
  • the mobile communication module 150 may provide a wireless communication solution including 2G/3G/4G/5G etc. applied on the first electronic device 100 .
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like.
  • the mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110 .
  • at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .
  • the wireless communication module 160 can provide applications on the first electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global Navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • WLAN wireless local area networks
  • BT wireless fidelity
  • GNSS global Navigation satellite system
  • frequency modulation frequency modulation, FM
  • NFC near field communication technology
  • IR infrared technology
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the
  • the antenna 1 of the first electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the first electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the first electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
  • Display screen 194 is used to display images, videos, and the like.
  • the first electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
  • the first electronic device 100 may implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.
  • the ISP is used to process the data fed back by the camera 193 .
  • the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin tone.
  • ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be provided in the camera 193 .
  • Camera 193 is used to capture still images or video.
  • the object is projected through the lens to generate an optical image onto the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other formats of image signals.
  • the first electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.
  • a digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the first electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point, and the like.
  • Video codecs are used to compress or decompress digital video.
  • the first electronic device 100 may support one or more video codecs.
  • the first electronic device 100 can play or record videos in various encoding formats, such as: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.
  • the NPU is a neural-network (NN) computing processor.
  • NN neural-network
  • Applications such as intelligent cognition of the first electronic device 100 can be implemented through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, and the like.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the first electronic device 100.
  • an external memory card such as a Micro SD card
  • Internal memory 121 may be used to store computer executable program code, which includes instructions.
  • the processor 110 executes various functional applications and data processing of the first electronic device 100 by executing the instructions stored in the internal memory 121 .
  • the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area may store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like.
  • the storage data area may store data (such as audio data, phone book, etc.) created during the use of the first electronic device 100 and the like.
  • the first electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playback, recording, etc.
  • the audio module 170 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 170 may also be used to encode and decode audio signals.
  • Speaker 170A also referred to as a “speaker” is used to convert audio electrical signals into sound signals.
  • the receiver 170B also referred to as “earpiece”, is used to convert audio electrical signals into sound signals.
  • the microphone 170C also called “microphone” or “microphone”, is used to convert sound signals into electrical signals.
  • the earphone jack 170D is used to connect wired earphones.
  • the pressure sensor 180A is used to sense pressure signals, and can convert the pressure signals into electrical signals.
  • the pressure sensor 180A may be provided on the display screen 194 .
  • the capacitive pressure sensor may be comprised of at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes.
  • the first electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the first electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A.
  • the first electronic device 100 may also calculate the touched position according to the detection signal of the pressure sensor 180A.
  • touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example, when a touch operation whose intensity is less than the first pressure threshold acts on the short message application icon, the instruction for viewing the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.
  • the gyro sensor 180B may be used to determine the motion attitude of the first electronic device 100 .
  • the angular velocity of the first electronic device 100 about three axes ie, the x, y and z axes
  • the gyro sensor 180B can be used for image stabilization. Exemplarily, when the shutter is pressed, the gyro sensor 180B detects the shaking angle of the first electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and allows the lens to offset the shaking of the first electronic device 100 through reverse motion, Achieve anti-shake.
  • the gyro sensor 180B can also be used for navigation and somatosensory game scenarios.
  • the air pressure sensor 180C is used to measure air pressure.
  • the magnetic sensor 180D includes a Hall sensor.
  • the acceleration sensor 180E can detect the magnitude of the acceleration of the first electronic device 100 in various directions (generally three axes).
  • the magnitude and direction of gravity can be detected when the first electronic device 100 is stationary. It can also be used for recognizing the posture of the first electronic device 100, and can be used in applications such as switching between horizontal and vertical screens, and pedometers.
  • Distance sensor 180F for measuring distance.
  • Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes.
  • the first electronic device 100 detects infrared reflected light from nearby objects using a photodiode. When sufficient reflected light is detected, it may be determined that there is an object near the first electronic device 100 . When insufficient reflected light is detected, the first electronic device 100 may determine that there is no object near the first electronic device 100 .
  • the ambient light sensor 180L is used to sense ambient light brightness.
  • the first electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness.
  • the ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures.
  • the ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the first electronic device 100 is in the pocket, so as to prevent accidental touch.
  • the fingerprint sensor 180H is used to collect fingerprints.
  • the first electronic device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering incoming calls with fingerprints, and the like.
  • the temperature sensor 180J is used to detect the temperature.
  • Touch sensor 180K also called “touch panel”.
  • the touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”.
  • the touch sensor 180K is used to detect a touch operation on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • Visual output related to touch operations may be provided through display screen 194 .
  • the touch sensor 180K may also be disposed on the surface of the first electronic device 100 , which is different from the position where the display screen 194 is located.
  • the bone conduction sensor 180M can acquire vibration signals.
  • the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice.
  • the bone conduction sensor 180M can also contact the pulse of the human body and receive the blood pressure beating signal.
  • the bone conduction sensor 180M can also be disposed in the earphone, combined with the bone conduction earphone.
  • the audio module 170 can analyze the voice signal based on the vibration signal of the vocal vibration bone block obtained by the bone conduction sensor 180M, and realize the voice function.
  • the application processor can analyze the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M, and realize the function of heart rate detection.
  • the keys 190 include a power-on key, a volume key, and the like.
  • the first electronic device 100 may receive key input, and generate key signal input related to user settings and function control of the first electronic device 100 .
  • Motor 191 can generate vibrating cues.
  • the indicator 192 can be an indicator light, which can be used to indicate the charging state, the change of the power, and can also be used to indicate a message, a missed call, a notification, and the like.
  • the SIM card interface 195 is used to connect a SIM card.
  • the SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact with and separation from the first electronic device 100 .
  • the first electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
  • the first electronic device 100 employs an eSIM, ie an embedded SIM card.
  • the eSIM card can be embedded in the first electronic device 100 and cannot be separated from the first electronic device 100 .
  • the sleep monitoring method provided by the present application is specifically introduced by taking the first electronic device 100 as a mobile phone and the second electronic device 200 as a wristband.
  • FIG. 2 exemplarily shows a sleep monitoring scenario involved in the present application.
  • the first user wears the bracelet 200 .
  • the first user uses the mobile phone 100 while lying on the bed and maintaining a fixed posture.
  • the bracelet 200 can use a sleep model to predict that the first user has entered a sleep state according to data collected by sensors such as an acceleration sensor and a heart rate sensor.
  • the bracelet 200 may request the mobile phone 100 to further confirm whether the first user enters the sleep state.
  • the mobile phone 100 can confirm whether the first user enters the sleep state by judging whether the first user is using the mobile phone 100 . If it is determined that the first user is using the mobile phone 100 , the mobile phone 100 may send a message to the bracelet 200 to indicate that the first user is using the mobile phone 100 .
  • the bracelet 200 may determine that the first user has not entered a sleep state. If it is determined that the first user does not use the mobile phone 100 , the mobile phone 100 may send a message to the bracelet, indicating that the first user does not use the mobile phone 100 . When receiving the message, the bracelet 200 can determine that the first user has entered a sleep state.
  • the mobile phone 100 can determine whether the first user uses the mobile phone by monitoring whether the mobile phone 100 is in a stationary state, whether it detects user operations acting on the mobile phone 100 within a preset time, and whether the first user's eyes are looking at the screen of the mobile phone 100 100.
  • the mobile phone 100 can determine whether it is in a stationary state by using the data collected by the acceleration sensor and the gyroscope sensor. If it is determined that it is in a non-stationary state (that is, the posture of the mobile phone 100 changes), the mobile phone 100 can determine that a user is using the mobile phone 100 . Further, the mobile phone 100 can determine whether the user using the mobile phone 100 is the first user.
  • the mobile phone 100 can monitor whether there is a user operation acting on the mobile phone 100 within a preset time. This can reduce the misjudgment of whether the user is in a sleep state when the mobile phone 100 is in a stationary state but is still being used by the user. If the user operation is monitored within the preset time, the mobile phone 100 may determine that a user is using the mobile phone 100 . Further, the mobile phone 100 can determine whether the user using the mobile phone 100 is the first user. This embodiment of the present application does not limit the length of the foregoing preset time.
  • the mobile phone 100 can monitor whether human eyes are watching the screen of the mobile phone 100 . This can reduce the misjudgment of whether the user is in a sleep state when the mobile phone is in a stationary state and there is no user operation for a preset period of time, but is still used by the user (for example, a scene where the mobile phone is in a stationary state to play a video). If a human eye looks at the screen of the mobile phone 100, the mobile phone 100 can determine whether the user looking at the screen is the first user. If no human eyes look at the screen of the mobile phone 100 or the user looking at the screen of the mobile phone 100 is not the first user, the mobile phone 100 can determine that the first user does not use the mobile phone 100 .
  • the mobile phone 100 and the bracelet 200 have a binding relationship.
  • the mobile phone 100 and the bracelet 200 may establish a binding relationship through Bluetooth pairing.
  • the mobile phone 100 may mark the bracelet 200 as a receiving bracelet worn by the owner of the mobile phone 100 .
  • the mobile phone 100 may add an owner tag to the bracelet 200 when storing the Bluetooth address of the bracelet 200 .
  • the mobile phone 100 can detect whether the first user is using the mobile phone 100 .
  • the mobile phone 100 may not process the request.
  • the mobile phone 100 in response to the first user operation, may establish a binding relationship with the bracelet 200 .
  • the first user operation may be used to indicate that the owner of the mobile phone 100 and the user wearing the bracelet 200 are the same user.
  • the mobile phone 100 can manage the bracelets that have established a communication connection with itself.
  • the setting options for managing the bracelet in the mobile phone 100 may include a sleep assist function.
  • the mobile phone 100 can enable the sleep assist function in the setting options for managing the bracelet 200 .
  • the bracelet 200 may request the mobile phone 100 to further confirm whether the owner of the mobile phone 100 is in the sleep state after prejudging that the user wearing the bracelet 200 has entered the sleep state.
  • the mobile phone 100 and the bracelet 200 may establish a binding relationship by associating with the same account (for example, a Huawei account). That is, the accounts logged in the mobile phone 100 and the bracelet 200 are the same account. Since the mobile phone 100 and the bracelet 200 have a binding relationship, the mobile phone 100 can assist the bracelet 200 to monitor whether the user wearing the bracelet 200 (ie the first user) has entered by judging whether the owner (ie, the first user) is using the mobile phone. sleep state. This can reduce the misjudgment that the user of the mobile phone 100 and the user wearing the bracelet 200 are not the same person as to whether the user enters the sleep state.
  • the same account for example, a Huawei account
  • the embodiments of the present application do not limit the manner in which the mobile phone 100 and the bracelet 200 establish a binding relationship.
  • a neural network can be composed of neural units, and a neural unit can refer to an operation unit that takes x s and an intercept 1 as inputs, and the output of the operation unit can refer to the following formula (1):
  • W s is the weight of x s
  • b is the bias of the neural unit.
  • f is an activation function of the neural unit, which is used to introduce nonlinear characteristics into the neural network to convert the input signal in the neural unit into an output signal. The output signal of this activation function can be used as the input of the next convolutional layer.
  • the activation function can be a sigmoid function.
  • a neural network is a network formed by connecting many of the above single neural units together, that is, the output of one neural unit can be the input of another neural unit.
  • the input of each neural unit can be connected with the local receptive field of the previous layer to extract the features of the local receptive field, and the local receptive field can be an area composed of several neural units.
  • the convolutional neural network can use the error back propagation (BP) algorithm to correct the size of the parameters in the initial super-resolution model during the training process, so that the reconstruction error loss of the super-resolution model becomes smaller and smaller. Specifically, forwarding the input signal until the output will generate an error loss, and updating the parameters in the initial super-resolution model by back-propagating the error loss information, so that the error loss converges.
  • the back-propagation algorithm is a back-propagation motion dominated by the error loss, aiming to obtain the parameters of the optimal super-resolution model, such as the weight matrix.
  • FIG. 3 exemplarily shows a flowchart of a sleep monitoring method provided by an embodiment of the present application. As shown in FIG. 3, the method may include steps S101-S108. in:
  • the bracelet 200 uses a sleep model to predict that the first user enters a sleep state.
  • the sleep model may be a trained neural network model.
  • the bracelet 200 can collect acceleration data in real time through an acceleration sensor, and collect heart rate data of the first user through a heart rate sensor in real time. Based on the above acceleration data and heart rate data, the bracelet 200 can use the sleep model to predict whether the first user enters a sleep state.
  • the wristband 200 when the user is in a sleep state, the wristband 200 usually has a small change in posture within a certain period of time, or even the posture remains unchanged. The posture of the wristband 200 is different when the wristband 200 is worn on the user and remains in a stationary state and when the wristband 200 is placed on a desktop and remains in a stationary state.
  • the heart rate usually drops gradually after the user goes to sleep. Therefore, in combination with the acceleration data and the heart rate data detected by the bracelet 200, the bracelet 200 can predict whether the user enters a sleep state.
  • the training data for training the sleep model may include acceleration data and heart rate data of the bracelet 200 when the user is actually in a sleeping state, and acceleration data and heart rate data of the bracelet 200 when the user is actually in a non-sleep state. These data can be collected through big data. That is, these data may be acceleration data and heart rate data in a sleep state and acceleration data and heart rate data in a non-sleep state when a general user wears the bracelet 200 . Alternatively, these data may be acceleration data and heart rate data in a sleep state and acceleration data and heart rate data in a non-sleep state when the first user is wearing the bracelet 200 .
  • the sleep model trained by using the data of the first user can better predict whether the first user enters a sleep state.
  • the trained sleep model can identify the characteristics of the acceleration data and heart rate data of the bracelet 200 when the first user is actually in a sleeping state, so as to predict whether the first user is in a sleeping state. That is to say, when the acceleration data monitored by the wristband 200 is consistent with the acceleration data when the user is actually sleeping, and the monitored heart rate data is consistent with the heart rate data when the user is actually sleeping, the wristband 200 It can be predicted that the first user enters a sleep state.
  • the bracelet 200 can also use a sleep model to predict whether the first user is sleeping based on data such as angular velocity data collected by a gyro sensor, ambient light data collected by an ambient light sensor, and ambient sound data collected by a microphone. state. That is, the training data of the sleep model may also include angular velocity data, ambient light data, ambient sound data, and the like.
  • the embodiments of the present application do not limit the training data used for training the sleep model and the method for training the sleep model.
  • the method for the wristband 200 to predict whether the first user enters the sleep state reference may also be made to the method for judging whether the first user enters the sleep state by electronic devices such as wristbands in the prior art.
  • the bracelet 200 sends a request to the mobile phone 100 to confirm whether the first user is in a sleep state.
  • the mobile phone 100 determines whether it is in a stationary state.
  • the fact that the mobile phone 100 is in a non-stationary state can indicate that a user is using the mobile phone 100 .
  • the fact that the mobile phone 100 is in a stationary state cannot directly indicate that no user is using the mobile phone 100 .
  • the mobile phone 100 is in a stationary state, but is still used by the user.
  • the mobile phone 100 can determine whether it is in a stationary state through acceleration data collected by the acceleration sensor.
  • the mobile phone 100 may perform the following step S104.
  • the mobile phone 100 may perform the following step S106.
  • the method for determining whether the mobile phone 100 is in a stationary state in this embodiment of the present application is not limited.
  • the mobile phone 100 can also determine whether it is in a stationary state through the angular velocity data collected by the gyro sensor.
  • the mobile phone 100 monitors whether the first user is in a sleep state by judging whether it is in a stationary state, which can reduce the misjudgment of whether the first user is in a sleep state when the mobile phone 100 is in a stationary state but is still used by the first user.
  • the mobile phone 100 determines whether a user operation is monitored within a preset time.
  • the fact that the mobile phone 100 monitors the user operation within the preset time can indicate that a user is using the mobile phone 100 .
  • the fact that the mobile phone 100 does not monitor the user operation within the preset time cannot directly indicate that no user is using the mobile phone 100 .
  • the length of the above-mentioned preset time is 10 minutes.
  • the mobile phone 100 may not receive user operation during the video playback process, but is still blocked by the user. use.
  • the above-mentioned user operation may be, for example, a touch operation acting on the screen of the mobile phone 100, a user operation acting on a button of the mobile phone 100, an input operation of a voice command, an input operation of an air gesture, and the like.
  • This embodiment of the present application does not limit the specific types of the above-mentioned user operations.
  • the mobile phone 100 may perform the following step S105.
  • the mobile phone 100 may perform the following step S106.
  • This embodiment of the present application does not limit the length of the foregoing preset time.
  • the mobile phone 100 monitors whether the first user enters a sleep state by judging whether a user operation is monitored within a preset time, which can reduce the number of times that the mobile phone 100 is in a stationary state and there is no user operation within the preset time.
  • a scene still being used by the first user eg, a scene where the mobile phone is in a still state to play a video
  • misjudged whether the first user has entered a sleep state eg, a scene where the mobile phone is in a still state to play a video
  • the mobile phone 100 determines whether human eyes are watching the screen.
  • the mobile phone 100 can capture images through the front camera. Based on the above image, the mobile phone 100 can use the human eye gaze recognition model to determine whether the human eye gazes at the screen.
  • the human eye gaze recognition model may be a neural network model.
  • the training data for training the human eye gaze recognition model may include image data of the human eye looking at the screen and image data of the human eye not looking at the screen.
  • the trained human eye gaze recognition model can identify the characteristics of the image in which the human eye gazes at the screen, so as to determine whether the human eye gazes at the screen of the mobile phone 100 .
  • the aforementioned front-facing camera for capturing images may be a low-power camera.
  • a low-power camera For example, infrared cameras.
  • the above-mentioned low-power camera can be in a working state in real time. This embodiment of the present application does not limit the type of the above-mentioned front camera.
  • the mobile phone 100 when it is determined that there is no user operation acting on the mobile phone 100 within a preset time period, the mobile phone 100 can turn on the above-mentioned front camera to capture images.
  • the mobile phone 100 may turn on the aforementioned front-facing camera. The embodiment of the present application does not limit the time when the mobile phone 100 turns on the front camera.
  • the mobile phone 100 may perform the following step S106.
  • the mobile phone 100 may perform the following step S108.
  • the mobile phone 100 monitors whether the first user is in a sleep state by judging whether human eyes are watching the screen, which can reduce the situation where the mobile phone 100 is in a stationary state, and there is no user operation within a preset time, but is not used by the first user (for example, the mobile phone is in a stationary state.
  • the video is played in the state, but the first user falls asleep during the video playback) misjudgment of whether the first user has entered the sleep state.
  • the mobile phone 100 determines whether the user of the mobile phone 100 is the first user.
  • the mobile phone 100 determines that the mobile phone 100 is in a non-stationary state, the mobile phone 100 determines that the mobile phone 100 is in a stationary state but monitors user operations within a preset time, and the mobile phone 100 determines that the mobile phone 100 is in a stationary state and is in a stationary state. If no user operation is detected within the preset time, but it is recognized that someone is watching the screen of the mobile phone 100 , the mobile phone 100 can determine that a user is using the mobile phone 100 . Further, the mobile phone 100 can determine whether the user is the first user.
  • the mobile phone 100 may determine whether the user is the first user through face recognition.
  • the bracelet 200 there is a binding relationship between the bracelet 200 and the mobile phone 100 .
  • the first user wearing the bracelet 200 is the owner of the mobile phone 100 .
  • the mobile phone 100 can compare the face image collected by the front camera with the face image of the owner stored in the mobile phone 100 to determine whether the user of the mobile phone 100 is the first user.
  • the above-mentioned face image of the owner stored in the mobile phone 100 may be a face image used for face recognition to unlock the mobile phone 100 .
  • the embodiment of the present application does not limit the method for the mobile phone 100 to compare whether the face image collected by the front camera and the face image of the owner stored in the mobile phone 100 are the face image of the same user.
  • the mobile phone 100 may also determine whether the user of the mobile phone 100 is the first user by means of biometric identification methods such as voiceprint recognition and fingerprint recognition.
  • biometric identification methods such as voiceprint recognition and fingerprint recognition. This embodiment of the present application does not limit the specific method for determining whether the user of the mobile phone 100 is the first user.
  • the mobile phone 100 may execute the following step S107.
  • the mobile phone 100 may execute the following step S108.
  • the mobile phone 100 detects whether the first user enters the sleep state by identifying whether the user is the first user, which can reduce the number of users of the mobile phone 100 and the first user wearing the bracelet 200 It is not the same person's misjudgment of whether the first user has entered a sleep state.
  • the mobile phone 100 sends the first judgment result to the bracelet 200 , indicating that the first user is using the mobile phone 100 .
  • the mobile phone 100 can determine that the first user is using the mobile phone 100 . Then, the mobile phone 100 may send the first judgment result to the bracelet 200 to indicate that the first user is using the mobile phone 100 .
  • the bracelet 200 can use the sleep model again to predict whether the first user enters the sleep state, and request the mobile phone 100 to confirm whether the first user enters the sleep state .
  • the bracelet 200 can use a sleep model to predict whether the first user is in a sleep state every preset time period (eg, 5 minutes, etc.).
  • the bracelet 200 may record the monitored data (such as heart rate data) as the data that the first user is in a non-sleep state.
  • the mobile phone 100 sends the second judgment result to the bracelet 200 , indicating that the first user does not use the mobile phone 100 .
  • the mobile phone 100 may determine that the first user does not use the mobile phone 100 . Then, the mobile phone 100 can send the second judgment result to the bracelet 200, indicating that the first user does not use the mobile phone 100.
  • the bracelet 200 may determine the moment when the second judgment result is received as the moment when the first user enters the sleep state. Alternatively, the bracelet 200 may predetermine the moment when the first user enters the sleep state as the moment when the first user enters the sleep state. In this embodiment of the present application, the time when the wristband 200 determines that the first user enters the sleep state is not particularly limited. The bracelet 200 may record the monitored data (such as heart rate data) after the first user enters the sleep state as the data when the first user is in the sleep state.
  • the monitored data such as heart rate data
  • the bracelet 200 can use the mobile phone 100 to confirm whether the first user enters the sleep state. This can reduce the misjudgment of whether the first user has entered the sleep state because the first user maintains a fixed posture for a long time but is not in the sleep state when the bracelet 200 is used alone to monitor whether the first user has entered the sleep state, and the first user can be improved. The accuracy of monitoring when the user goes to sleep. Thus, the bracelet 200 can improve the accuracy of sleep quality monitoring.
  • the mobile phone 100 after determining that the mobile phone 100 is in a non-stationary state, it can directly determine whether the user of the mobile phone 100 is the first user. In this way, the mobile phone 100 does not need to perform steps S104 and S105 , thereby saving the power consumption of the mobile phone 100 .
  • the mobile phone 100 determines that the user's operation has not been monitored within the preset time, it can directly determine whether the user of the mobile phone 100 is the first user. In this way, the mobile phone 100 does not need to perform step S105 , thereby saving the power consumption of the mobile phone 100 .
  • the execution order of the above steps S103 and S104 may be reversed. That is, after receiving the request from the bracelet 200 for confirming whether the first user enters the sleep state, the mobile phone 100 may first determine whether there is a user operation within the preset time. If it is determined that there is a user operation within the preset time, the mobile phone 100 may perform step S106. If it is determined that there is no user operation within the preset time, the mobile phone 100 can further determine whether it is in a stationary state. If it is determined that it is in a stationary state, the mobile phone 100 may execute step S105. If it is determined that it is in a non-stationary state, the mobile phone 100 may execute step S106.
  • the mobile phone 100 can simultaneously execute the above steps S103, S104, and S105 to determine whether the mobile phone 100 is in the sleep state. used by users. If it is determined that the mobile phone 100 is used by the user, the mobile phone 100 may further perform step S106 to determine whether the user is the first user. Otherwise, the mobile phone 100 may execute step S108 to instruct the first user of the bracelet 200 to enter the sleep state.
  • FIG. 4 exemplarily shows a flowchart of another sleep monitoring method provided by an embodiment of the present application.
  • the method may include steps S201-S207. in:
  • the bracelet 200 uses the sleep model to predict that the first user enters the sleep state.
  • the bracelet 200 sends a request to the mobile phone 100 to confirm whether the first user enters the sleep state.
  • steps S201 and S202 may refer to steps S101 and S102 in the method shown in FIG. 3 , respectively.
  • the mobile phone 100 determines whether it is in a stationary state.
  • step S203 For the method for determining whether the mobile phone 100 is in a stationary state, reference may be made to step S203 in the method shown in FIG. 3 .
  • the mobile phone 100 may execute step S204. That is, the mobile phone 100 can determine whether human eyes are watching the screen.
  • the mobile phone 100 may execute step S205.
  • the mobile phone 100 determines whether human eyes are watching the screen.
  • the mobile phone 100 determines whether the user of the mobile phone 100 is the first user.
  • the mobile phone 100 sends the first judgment result to the bracelet 200 , indicating that the first user is using the mobile phone 100 .
  • the mobile phone 100 sends the second judgment result to the bracelet 200 , indicating that the first user does not use the mobile phone 100 .
  • steps S204 to S207 reference may be made to steps S105 to S108 in the method shown in FIG. 3 , which will not be repeated here.
  • FIG. 5 exemplarily shows a flowchart of another sleep monitoring method provided by an embodiment of the present application.
  • the method may include steps S301-S307. in:
  • the bracelet 200 uses the sleep model to predict that the first user enters the sleep state.
  • the bracelet 200 sends a request to the mobile phone 100 to confirm whether the first user enters the sleep state.
  • steps S301 and S302 may refer to steps S101 and S102 in the method shown in FIG. 3 , respectively.
  • the mobile phone 100 determines whether a user operation is monitored within a preset time.
  • step S204 For the method for the mobile phone 100 to determine whether the user operation is monitored within the preset time, reference may be made to step S204 in the method shown in FIG. 3 .
  • the mobile phone 100 may perform step S304. That is, the mobile phone 100 can determine whether human eyes are watching the screen.
  • the mobile phone 100 may perform step S305.
  • the mobile phone 100 determines whether human eyes are watching the screen.
  • the mobile phone 100 determines whether the user of the mobile phone 100 is the first user.
  • the mobile phone 100 sends the first judgment result to the bracelet 200 , indicating that the first user is using the mobile phone 100 .
  • the mobile phone 100 sends the second judgment result to the bracelet 200 , indicating that the first user does not use the mobile phone 100 .
  • steps S304 to S307 reference may be made to steps S105 to S108 in the method shown in FIG. 3 , which will not be repeated here.
  • FIG. 6 exemplarily shows a flowchart of another sleep monitoring method provided by an embodiment of the present application.
  • the method may include steps S401-S406. in:
  • the bracelet 200 uses the sleep model to predict that the first user enters the sleep state.
  • the bracelet 200 sends a request to the mobile phone 100 to confirm whether the first user is in a sleep state.
  • steps S401 and S402 may refer to steps S101 and S102 in the method shown in FIG. 3 , respectively.
  • the mobile phone 100 determines whether human eyes are watching the screen.
  • the mobile phone 100 determines whether the user of the mobile phone 100 is the first user.
  • the mobile phone 100 sends the first judgment result to the bracelet 200 , indicating that the first user is using the mobile phone 100 .
  • the mobile phone 100 sends the second judgment result to the bracelet 200 , indicating that the first user does not use the mobile phone 100 .
  • steps S403 to S406 reference may be made to steps S105 to S108 in the method shown in FIG. 3 , and details are not repeated here.
  • the mobile phone 100 when receiving a request from the bracelet 200 for determining whether the first user enters a sleep state, can monitor whether it is running a screen-casting application.
  • the fact that the mobile phone 100 runs a screen-casting application can indicate that a user is using the mobile phone 100 .
  • the mobile phone 100 can detect whether the user of the mobile phone 100 is the first user.
  • the mobile phone 100 may send a message for capturing images to a screen projection device, such as a TV.
  • the screen projection device may capture and view an image of the area of the screen projection device, and send the image to the mobile phone 100 .
  • the mobile phone 100 can determine whether the image from the screen projection device includes the face image of the first user.
  • the fact that the image collected by the screen-casting device includes the face image of the first user may indicate that the first user casts the screen through the mobile phone 100 and watches the content played on the screen-casting device. That is, the first user is not in a sleep state.
  • the mobile phone 100 may send the first judgment result in the foregoing embodiment to the bracelet 200 , indicating that the first user is using the mobile phone 100 .
  • the fact that the image collected by the screen projection device does not include the face image of the first user may indicate that the users who use the mobile phone 100 to project the screen and watch the content played on the screen projection device do not include the first user.
  • the mobile phone 100 may send the second judgment result in the foregoing embodiment to the bracelet 200, indicating that the first user does not use the mobile phone 100.
  • the mobile phone 100 may detect that it is in a stationary state, there is no user operation within a preset time, and no human eyes are watching. However, the first user did not go to sleep, but was watching the screen-casting device.
  • the above method can monitor whether the mobile phone 100 is running a screen-casting application, and monitor whether the first user enters a sleep state by using images collected by the screen-casting device when the screen-casting application is running. This can reduce the misjudgment by the first user that the mobile phone 100 is in a stationary state, has no user operation within a preset time, and has no human eyes, but is still used by the first user to determine whether the first user is in a sleep state.
  • the mobile phone 100 may request other electronic devices having an image capturing device (eg, a camera), such as a TV, to perform image capturing.
  • an image captured by an electronic device having an image capturing device is obtained, the mobile phone 100 can determine whether the image contains the first user and determine the state of the first user. In this way, the mobile phone 100 can monitor whether the first user enters the sleep state, and send the monitoring result to the bracelet 200 .
  • the mobile phone 100 may send a message for capturing images to the TV.
  • the TV can send the images captured by the camera to the mobile phone 100 .
  • the fact that the image collected by the television through the camera includes the face image of the first user may indicate that the first user is watching the television. That is, the first user enters the sleep state. If the mobile phone 100 determines that the image from the TV contains the face image of the first user, the mobile phone 100 can send the first judgment result in the foregoing embodiment to the bracelet 200 to indicate that the first user is using the mobile phone 100 .
  • the embodiments of the present application do not limit the manner in which the mobile phone 100 establishes a communication connection with an electronic device having an image acquisition device, such as a television.
  • the above-mentioned communication connection manner may be, for example, a Bluetooth connection, a Wi-Fi network connection, or the like.
  • the bracelet 200 can establish a communication connection with other electronic devices having image capturing devices.
  • the bracelet 200 may send a message for capturing an image to the electronic device having the image capturing device.
  • the electronic device with the image acquisition device can send the acquired image to the bracelet 200 .
  • the bracelet 200 can determine the state of the first user according to these images to determine whether the first user has entered a sleep state.
  • the bracelet 200 can send these images to an electronic device with strong processing capability, such as the mobile phone 100 , among the electronic devices that have established a communication connection with itself.
  • the mobile phone 100 can determine the state of the first user according to the received image, so as to determine whether the first user has entered a sleep state.
  • the manner in which the bracelet 200 establishes a communication connection with an electronic device having an image acquisition device in this embodiment of the present application is not limited.
  • the bracelet 200 can use the mobile phone 100 to determine whether the first user exits the sleep state (ie, the first user wakes up).
  • the mobile phone 100 may send a message to the bracelet 200 for instructing the first user to exit the sleep state when monitoring the user operation of unlocking the mobile phone 100 for the first time within the second time period.
  • the bracelet 200 may determine the time when the user operation of unlocking the mobile phone 100 is detected as the time when the first user exits the sleep state. Combined with the moment when the first user enters the sleep state determined by the sleep monitoring method in the foregoing embodiment, the bracelet 200 can determine the total duration of the first user being in the sleep state, and evaluate the duration of the first user from entering the sleep state to exiting the sleep state. Sleep quality over time.
  • the above unlocking method may be a method for unlocking by using biometric information.
  • the biometric information may be, for example, face information, voiceprint information, fingerprint information, and the like.
  • the mobile phone 100 may determine that the unlocked user is the first user.
  • the above-mentioned second time period may be a period of time (eg, 12 hours) during which the mobile phone 100 sends the second judgment result to the bracelet 200 to indicate that the first user does not use the mobile phone 100 .
  • the above-mentioned second time period may be a preset time period, for example, a time period from 5:00 am to 10:00 am.
  • the above-mentioned second time period may also be a time period estimated by the bracelet 200 when the first user exits the sleep state. The bracelet 200 can estimate the time period for the first user to exit the sleep state according to the data of the first user detected multiple times.
  • the mobile phone 100 may determine whether the user who turns off the alarm clock of the mobile phone 100 is the first user when monitoring the user's operation to turn off the alarm clock of the mobile phone 100 within the above-mentioned second time period. If it is determined that the user who turns off the alarm clock of the mobile phone 100 is the first user, the mobile phone 100 may send a message to the bracelet 200 for instructing the first user to exit the sleep state. When receiving the above-mentioned message for instructing the first user to exit the sleep state, the bracelet 200 may determine the time when the user operation to turn off the alarm clock of the mobile phone 100 is monitored as the time when the first user exits the sleep state.
  • This embodiment of the present application does not limit the method for the mobile phone 100 to determine whether the user who turns off the alarm clock of the mobile phone 100 is the first user.
  • the mobile phone 100 can determine whether the user who turns off the alarm clock is the first user by identifying the biometric information such as face recognition, voiceprint recognition, and fingerprint recognition.
  • the mobile phone 100 may also use the methods shown in FIG. 3 to FIG. 6 to determine whether the first user uses the mobile phone 100 during the second time period. If it is determined that the first user is using the mobile phone 100 , the mobile phone 100 may send a message to the bracelet 200 for instructing the first user to exit the sleep state.
  • This embodiment of the present application does not limit the implementation method for the mobile phone 100 to determine whether the first user exits the sleep state.
  • the bracelet 200 may use the sleep model in the foregoing embodiment to determine whether the first user exits the sleep state based on the acceleration data and the heart rate data.
  • the first user has exited the sleep state, but the change in the posture of the bracelet 200 is small or even the posture remains unchanged. Then, the result determined by the bracelet 200 using the sleep model is often that the first user is still in a sleep state. This reduces the accuracy of sleep quality monitoring.
  • the above method of judging whether the first user exits the sleep state by the mobile phone 100 of the bracelet 200 can reduce the misjudgment of whether the first user exits the sleep state when the first user has woken up but does not get up, and improve the accuracy of sleep quality monitoring.

Abstract

A sleep monitoring method and a related apparatus, relating to the field of artificial intelligence. In the method, a second electronic device (200) worn on a first user and used for monitoring sleep quality can determine, by means of a first electronic device (100), whether the first user has entered a sleeping state. After the first user is pre-determined to have entered the sleeping state, the second electronic device (200) sends, to the first electronic device (100), a request for determining whether the first user has entered the sleeping state. When it is determined that the first user is using the first electronic device (100), the first electronic device (100) sends, to the second electronic device (200), a message for indicating that the first user has not entered the sleeping state. The method can reduce the misjudgment, caused by using the second electronic device (200) alone for monitoring, of whether the user has entered the sleeping state, and improve the accuracy of monitoring of the time when the user enters the sleeping state.

Description

睡眠监测方法及相关装置Sleep monitoring method and related device
本申请要求于2021年01月15日提交中国专利局、申请号为202110057952.7、申请名称为“睡眠监测方法及相关装置”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application with the application number 202110057952.7 and the application title "Sleep Monitoring Method and Related Device" filed with the China Patent Office on January 15, 2021, the entire contents of which are incorporated into this application by reference.
技术领域technical field
本申请涉及人工智能技术领域，尤其涉及睡眠监测方法及相关装置。The present application relates to the technical field of artificial intelligence, and in particular, to a sleep monitoring method and related devices.
背景技术Background technique
睡眠质量的好坏与人的身体健康状况息息相关。越来越多的电子设备(如手环、手表等)具有睡眠监测功能，来监测人的睡眠质量。The quality of sleep is closely related to people's physical health. More and more electronic devices (such as wristbands, watches, etc.) have a sleep monitoring function to monitor the quality of a person's sleep.
睡眠监测需要判断用户是否进入睡眠状态以及用户是否醒来。目前的电子设备，例如手环通常是通过监测自己的运动状态以及用户的心率变化来判断用户是否处于睡眠状态。但在用户长时间保持固定姿势且未处于睡眠状态的场景中，上述方法容易造成睡眠状态的误判。例如，在用户睡前保持固定姿势使用手机的场景中，用户并未进入睡眠状态。而手环往往会判断用户已进入睡眠状态，从而导致睡眠质量监测不准确。Sleep monitoring needs to determine whether the user has entered a sleep state and whether the user has woken up. Current electronic devices, such as wristbands, usually determine whether a user is in a sleep state by monitoring their own exercise state and the change in the user's heart rate. However, in a scenario where the user maintains a fixed posture for a long time and is not in a sleep state, the above method is likely to cause misjudgment of the sleep state. For example, in the scenario where the user uses the mobile phone in a fixed posture before going to bed, the user does not enter the sleep state. The bracelet often judges that the user has entered a sleep state, resulting in inaccurate sleep quality monitoring.
发明内容SUMMARY OF THE INVENTION
本申请提供了一种睡眠监测方法及相关装置，可以通过多个电子设备协作来判断用户是否进入睡眠状态，提高用户进入睡眠状态的时间监测的准确率。The present application provides a sleep monitoring method and a related device, which can determine whether a user enters a sleep state through the cooperation of multiple electronic devices, so as to improve the accuracy of monitoring the time when the user enters the sleep state.
第一方面，本申请提供了一种睡眠监测方法。在该方法中，第一电子设备可以接收到第二电子设备的第一请求。第一电子设备与第二电子设备具有绑定关系。第一请求可以是第二电子设备处于佩带状态且监测到第一数据时发送的。第一数据与用户进入睡眠状态的数据相符。第一电子设备可以判断佩带第二电子设备的第一用户是否在使用第一电子设备，并将第一判断结果或第二判断结果发送给第二电子设备。第一判断结果为第一用户在使用第一电子设备，第二判断结果为第一用户未使用第一电子设备。In a first aspect, the present application provides a sleep monitoring method. In the method, the first electronic device may receive the first request of the second electronic device. The first electronic device has a binding relationship with the second electronic device. The first request may be sent when the second electronic device is in a wearing state and the first data is monitored. The first data is consistent with the data that the user enters the sleep state. The first electronic device may determine whether the first user wearing the second electronic device is using the first electronic device, and send the first determination result or the second determination result to the second electronic device. The first determination result is that the first user is using the first electronic device, and the second determination result is that the first user is not using the first electronic device.
上述第一电子设备可以是手机、平板电脑、膝上型计算机、手持计算机、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本、个人数字助理(personal digital assistant，PDA)以及智能眼镜等电子设备。上述第二电子设备可以是用于监测用户睡眠质量的电子设备。例如，手环、手表等等。第二电子设备处于佩带状态时可以监测用户的睡眠质量。The above-mentioned first electronic device can be a mobile phone, a tablet computer, a laptop computer, a handheld computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (personal digital assistant, PDA) and smart glasses, etc. Electronic equipment. The above-mentioned second electronic device may be an electronic device for monitoring the sleep quality of the user. For example, bracelets, watches, etc. When the second electronic device is in the wearing state, the sleep quality of the user can be monitored.
上述第一数据是第二电子设备佩带于第一用户时监测到的数据。上述第一数据可以包括第一用户的生理特征数据、第二电子设备的运动数据。上述生理特征数据可以例如是心率数据。上述第二电子设备的运动数据可以例如是加速度数据、角速度数据。The above-mentioned first data is the data monitored when the second electronic device is worn by the first user. The above-mentioned first data may include physiological characteristic data of the first user and motion data of the second electronic device. The above-mentioned physiological characteristic data may be, for example, heart rate data. The motion data of the second electronic device may be, for example, acceleration data and angular velocity data.
上述第一数据与用户进入睡眠状态的数据相符，可以表示第二电子设备预判出第一用户进入睡眠状态。上述第一数据可以是通过大数据收集得到的，可以反映一般用户在佩带第二电子设备进入睡眠状态的生理特征数据以及第二电子设备的运动数据。或者，上述第二数据可以包含第一用户佩带第二电子设备实际进入睡眠状态的生理特征数据以及第二电子设备的 运动数据。利用包含有第一用户佩带第二电子设备实际进入睡眠状态的生理特征数据以及第二电子设备的运动数据，第二电子设备可以更准确地预判第一用户是否进入睡眠状态。The above-mentioned first data is consistent with the data that the user enters the sleep state, which may indicate that the second electronic device prejudges that the first user enters the sleep state. The above-mentioned first data may be collected through big data, and may reflect physiological characteristic data of a general user wearing the second electronic device and enter a sleep state and motion data of the second electronic device. Alternatively, the above-mentioned second data may include physiological characteristic data of the first user wearing the second electronic device and actually entering a sleep state and motion data of the second electronic device. The second electronic device can more accurately predict whether the first user enters the sleep state by using the physiological characteristic data and the motion data of the second electronic device that the first user wears the second electronic device actually enters the sleep state.
结合第一方面，在一些实施例中，第一电子设备可以在第一条件下判断出第一电子设备在被用户使用且使用者为第一用户，则第一电子设备得到第一判断结果。第一条件可以包括以下一项或多项：第一电子设备判断出自己处于非静止状态、第一电子设备在第一时间段内监测到用户操作、第一电子设备监测到有人眼注视第一电子设备的屏幕、第一电子设备监测到自己运行有投屏的应用程序。第一电子设备可以在第一条件下判断出第一电子设备在被用户使用且使用者不为第一用户，或者第一电子设备判断出第一电子设备未被用户使用，则第一电子设备得到第二判断结果。With reference to the first aspect, in some embodiments, the first electronic device may determine under the first condition that the first electronic device is being used by the user and the user is the first user, and the first electronic device obtains the first determination result. The first condition may include one or more of the following: the first electronic device determines that it is in a non-stationary state, the first electronic device detects a user operation within a first time period, the first electronic device detects that a human eye is watching the first The screen of the electronic device and the first electronic device detect that it is running a screen-casting application. The first electronic device can determine under the first condition that the first electronic device is being used by the user and the user is not the first user, or the first electronic device determines that the first electronic device is not being used by the user, then the first electronic device A second judgment result is obtained.
其中，若第一电子设备处于非静止状态，第一电子设备可以判断出有用户在使用第一电子设备。若第一电子设备在第一时间内监测到用户操作，第一电子设备可以判断出有用户在使用第一电子设备。若第一电子设备检测到有人眼注视第一电子设备的屏幕，第一电子设备可以判断出有用户在使用第一电子设备。若第一电子设备运行有投屏的应用程序，第一电子设备可以判断出有用户在使用第一电子设备。Wherein, if the first electronic device is in a non-stationary state, the first electronic device can determine that a user is using the first electronic device. If the first electronic device monitors the user operation within the first time, the first electronic device may determine that a user is using the first electronic device. If the first electronic device detects that a human eye is looking at the screen of the first electronic device, the first electronic device may determine that a user is using the first electronic device. If the first electronic device runs a screen-casting application, the first electronic device can determine that a user is using the first electronic device.
在一种可能的实现方式中，当接收到上述第一请求，第一电子设备可以先判断自己是否处于静止状态。若第一电子设备处于非静止状态，且判断出使用者是第一用户，第一电子设备可以得到第一判断结果。若处于静止状态，第一电子设备可以进一步判断在第一时间段内是否监测到用户操作。若在第一时间段内监测到用户操作，且判断出使用者是第一用户，第一电子设备可以得到第一判断结果。若在第一时间段内未监测到用户操作，第一电子设备可以进一步监测是否有人眼注视第一电子设备的屏幕。若监测到有人眼注视第一电子设备的屏幕，且判断出使用者是第一用户，第一电子设备可以得到第一判断结果。若监测到没有人眼注视第一电子设备的屏幕，第一电子设备可以得到第二判断结果。若监测到有人眼注视第一电子设备的屏幕，且判断出使用者不是第一用户，第一电子设备可以得到第二判断结果。In a possible implementation manner, when receiving the above-mentioned first request, the first electronic device may first determine whether it is in a stationary state. If the first electronic device is in a non-stationary state and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is in a stationary state, the first electronic device may further determine whether a user operation is monitored within the first time period. If the user operation is monitored within the first time period, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If no user operation is monitored within the first time period, the first electronic device may further monitor whether human eyes are watching the screen of the first electronic device. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is detected that no human eyes are watching the screen of the first electronic device, the first electronic device can obtain the second judgment result. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is not the first user, the first electronic device can obtain the second determination result.
可选的，若监测到没有人眼注视第一电子设备的屏幕，第一电子设备可以进一步监测自己是否运行有投屏的应用程序。若运行有投屏的应用程序，且确定使用者是第一用户，第一电子设备可以得到第一判断结果。若监测到没有人眼注视第一电子设备的屏幕，且未运行有投屏的应用程序，第一电子设备可以得到第二判断结果。Optionally, if it is detected that no human eyes are watching the screen of the first electronic device, the first electronic device may further monitor whether it runs an application program for screen projection. If a screen-casting application is running, and it is determined that the user is the first user, the first electronic device can obtain the first judgment result. If it is detected that no human eye is watching the screen of the first electronic device, and no application program for screen projection is running, the first electronic device can obtain the second judgment result.
在另一种可能的实现方式中，当接收到上述第一请求，第一电子设备可以先判断自己是否处于静止状态。若第一电子设备处于非静止状态，且判断出使用者是第一用户，第一电子设备可以得到第一判断结果。若处于静止状态，第一电子设备可以进一步监测是否有人眼注视第一电子设备的屏幕。若监测到有人眼注视第一电子设备的屏幕，且判断出使用者是第一用户，第一电子设备可以得到第一判断结果。若监测到没有人眼注视第一电子设备的屏幕，第一电子设备可以得到第二判断结果。若监测到有人眼注视第一电子设备的屏幕，且判断出使用者不是第一用户，第一电子设备可以得到第二判断结果。In another possible implementation manner, when receiving the above-mentioned first request, the first electronic device may first determine whether it is in a stationary state. If the first electronic device is in a non-stationary state and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is in a stationary state, the first electronic device can further monitor whether human eyes are watching the screen of the first electronic device. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is detected that no human eyes are watching the screen of the first electronic device, the first electronic device can obtain the second judgment result. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is not the first user, the first electronic device can obtain the second determination result.
在另一种可能的实现方式中，当接收到上述第一请求，第一电子设备可以先判断在第一时间段内是否监测到用户操作。若在第一时间段内监测到用户操作，且判断出使用者是第一用户，第一电子设备可以得到第一判断结果。若在第一时间段内未监测到用户操作，第一电子设备可以进一步监测是否有人眼注视第一电子设备的屏幕。若监测到有人眼注视第一电子设备的屏幕，且判断出使用者是第一用户，第一电子设备可以得到第一判断结果。若监测到没有人眼注视第一电子设备的屏幕，第一电子设备可以得到第二判断结果。若监测到有人眼注视第一电子设备的屏幕，且判断出使用者不是第一用户，第一电子设备可以得到第二判断 结果。In another possible implementation manner, when receiving the above-mentioned first request, the first electronic device may first determine whether a user operation is monitored within the first time period. If the user operation is monitored within the first time period, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If no user operation is monitored within the first time period, the first electronic device may further monitor whether human eyes are watching the screen of the first electronic device. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is detected that no human eyes are watching the screen of the first electronic device, the first electronic device can obtain the second judgment result. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is not the first user, the first electronic device can obtain the second determination result.
在另一种可能的实现方式中，当接收到上述第一请求，第一电子设备可以监测是否有人眼注视第一电子设备的屏幕。若监测到有人眼注视第一电子设备的屏幕，且判断出使用者是第一用户，第一电子设备可以得到第一判断结果。若监测到没有人眼注视第一电子设备的屏幕，第一电子设备可以得到第二判断结果。若监测到有人眼注视第一电子设备的屏幕，且判断出使用者不是第一用户，第一电子设备可以得到第二判断结果。In another possible implementation manner, when receiving the above-mentioned first request, the first electronic device may monitor whether human eyes are watching the screen of the first electronic device. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is the first user, the first electronic device can obtain the first determination result. If it is detected that no human eyes are watching the screen of the first electronic device, the first electronic device can obtain the second judgment result. If it is detected that human eyes are watching the screen of the first electronic device, and it is determined that the user is not the first user, the first electronic device can obtain the second determination result.
在一些实施例中，第一电子设备可以利用加速度传感器、陀螺仪传感器等传感器来判断自己是否处于静止状态。In some embodiments, the first electronic device may use sensors such as an acceleration sensor, a gyroscope sensor and the like to determine whether it is in a stationary state.
在一些实施例中，上述用户操作可以是作用在第一电子设备屏幕上的触摸操作，作用在第一电子设备按键上的用户操作、语音指令的输入操作、隔空手势的输入操作等等。In some embodiments, the above-mentioned user operation may be a touch operation acting on the screen of the first electronic device, a user operation acting on a button of the first electronic device, an input operation of a voice command, an input operation of an air gesture, and the like.
在一些实施例中，第一电子设备可以通过人眼注视识别模型来判断是否有人眼注视第一电子设备的屏幕。该人眼注视识别模型可以是神经网络模型。用于训练该人眼注视识别模型的训练数据可包括人眼注视屏幕的图像数据和人眼未注视屏幕的图像数据。经过训练的人眼注视识别模型可以识别出人眼注视屏幕的图像的特征，从而判断是否有人眼注视手机100的屏幕。In some embodiments, the first electronic device may determine whether a human eye is looking at the screen of the first electronic device through a human eye gaze recognition model. The human eye gaze recognition model may be a neural network model. The training data for training the human eye gaze recognition model may include image data of the human eye looking at the screen and image data of the human eye not looking at the screen. The trained human eye gaze recognition model can identify the characteristics of the image in which the human eye gazes at the screen, so as to determine whether the human eye gazes at the screen of the mobile phone 100 .
在一些实施例中，第一电子设备判断出使用者为第一用户的方法可以包括：第一电子设备可以通过摄像头采集的第一图像，判断出该第一图像中包含第一用户的人脸图像来确定第一电子设备的使用者为第一用户。上述采集第一图像的摄像头可以是第一电子设备的摄像头，或者是投屏设备的摄像头。第一电子设备还可以通过采集其它生物特征信息(如声纹信息、指纹信息等)来判断第一电子设备的使用者是否为第一用户。In some embodiments, the method for the first electronic device to determine that the user is the first user may include: the first electronic device may determine, through the first image captured by the camera, that the first image contains the face of the first user The image is used to determine the user of the first electronic device as the first user. The above-mentioned camera for collecting the first image may be a camera of the first electronic device, or a camera of a screen projection device. The first electronic device can also determine whether the user of the first electronic device is the first user by collecting other biometric information (such as voiceprint information, fingerprint information, etc.).
结合第一方面，在一些实施例中，第一电子设备可以与第二电子设备通过蓝牙配对的方式建立绑定关系。或者，第一电子设备可以响应于第一用户操作与第二电子设备建立绑定关系。该第一用户操作可用于指示第一电子设备的机主为第一用户。或者，第一电子设备可以与第二电子设备通过登录同一个账号建立绑定关系。With reference to the first aspect, in some embodiments, the first electronic device may establish a binding relationship with the second electronic device by pairing with Bluetooth. Alternatively, the first electronic device may establish a binding relationship with the second electronic device in response to the first user operation. The first user operation may be used to indicate that the owner of the first electronic device is the first user. Alternatively, the first electronic device may establish a binding relationship with the second electronic device by logging into the same account.
由于第一电子设备与第二电子设备具有上述绑定关系，第一电子设备可以确定第一电子设备的机主与佩带有第二电子设备的用户是同一个人。这样可以减少第一电子设备的使用者与佩带有第二电子设备的用户不是同一个人对用户是否进入睡眠状态的误判。Since the first electronic device and the second electronic device have the above-mentioned binding relationship, the first electronic device can determine that the owner of the first electronic device and the user wearing the second electronic device are the same person. In this way, the user of the first electronic device and the user wearing the second electronic device are not the same person, and misjudgment on whether the user enters the sleep state can be reduced.
由上述睡眠监测方法可知，第二电子设备在预判出第一用户进入睡眠状态时，可以请求第一电子设备进一步确认第一用户是否进入睡眠状态。第一电子设备可以通过判断第一用户是否在使用第一电子设备来确认第一用户是否进入睡眠状态。这可以减少在单独利用第二电子设备监测用户是否进入睡眠状态的情况下，由于用户长时间保持固定姿势但未处于睡眠状态对用户是否进入睡眠状态的误判，提高用户进入睡眠状态的时间监测的准确率。It can be known from the above sleep monitoring method that when the second electronic device predicts that the first user enters the sleep state, the second electronic device may request the first electronic device to further confirm whether the first user enters the sleep state. The first electronic device may confirm whether the first user enters the sleep state by judging whether the first user is using the first electronic device. This can reduce the misjudgment of whether the user enters the sleep state because the user maintains a fixed posture for a long time but is not in the sleep state when the second electronic device is used alone to monitor whether the user enters the sleep state, and improves the monitoring of the time when the user enters the sleep state 's accuracy.
结合第一方面，在一些实施例中，第一电子设备在第二时间段内，监测到解锁第一电子设备的用户操作，第一电子设备可以向第二电子设备发送第一消息。该第一消息可用于指示第一用户在使用第一电子设备。或者，第一电子设备在第二时间段内，监测到关闭闹钟的用户操作，且关闭闹钟的用户为第一用户，第一电子设备可以向第二电子设备发送上述第一消息。With reference to the first aspect, in some embodiments, the first electronic device monitors a user operation to unlock the first electronic device within the second time period, and the first electronic device may send the first message to the second electronic device. The first message may be used to indicate that the first user is using the first electronic device. Alternatively, the first electronic device detects a user operation to turn off the alarm clock within the second time period, and the user who turns off the alarm clock is the first user, and the first electronic device may send the above-mentioned first message to the second electronic device.
上述解锁的方法可以是利用生物特征信息进行解锁的方法。该生物特征信息可以例如是人脸信息、声纹信息、指纹信息等等。当监测到上述生物特征信息属于第一用户的生物特征信息，第一电子设备可以确定解锁的用户为第一用户。The above unlocking method may be a method of unlocking by using biometric information. The biometric information may be, for example, face information, voiceprint information, fingerprint information, and the like. When monitoring that the above-mentioned biometric information belongs to the biometric information of the first user, the first electronic device may determine that the unlocked user is the first user.
上述第二时间段可以为从第一电子设备向二电子设备发送第二判断结果开始的第一时长 的时间段。或者，第二时间段可以为预设时间段。The above-mentioned second time period may be a time period of a first duration from when the first electronic device sends the second judgment result to the second electronic device. Alternatively, the second time period may be a preset time period.
由上述方法可知，第二电子设备可以借助第一电子设备来判断第一用户是否退出睡眠状态。这可以减少第一用户已经醒来但未起床对判断第一用户是否退出睡眠状态的误判，提高睡眠质量监测的准确率。It can be known from the above method that the second electronic device can use the first electronic device to determine whether the first user exits the sleep state. This can reduce the misjudgment of whether the first user has exited the sleep state when the first user has woken up but has not woken up, and improve the accuracy of sleep quality monitoring.
第二方面，本申请还提供了一种睡眠监测方法。在该方法中，第二电子设备在处于佩带状态时监测到第一数据。第一数据与用户进入睡眠状态的数据相符。第二电子设备向第一电子设备发送第一请求。第一电子设备与第二电子设备具有绑定关系。在接收到来自第一电子设备的第一判断结果的情况下，第二电子设备确定佩带第二电子设备的第一用户未进入睡眠状态。第一判断结果为第一电子设备接收到第一请求后判断出第一用户在使用第一电子设备的判断结果。In a second aspect, the present application also provides a sleep monitoring method. In the method, the second electronic device monitors the first data while in the wearing state. The first data is consistent with the data that the user enters the sleep state. The second electronic device sends the first request to the first electronic device. The first electronic device has a binding relationship with the second electronic device. In the case of receiving the first judgment result from the first electronic device, the second electronic device determines that the first user wearing the second electronic device has not entered a sleep state. The first determination result is a determination result of determining that the first user is using the first electronic device after the first electronic device receives the first request.
上述第一数据是第二电子设备佩带于第一用户时监测到的数据。上述第一数据可以包括第一用户的生理特征数据、第二电子设备的运动数据。上述生理特征数据可以例如是心率数据。上述第二电子设备的运动数据可以例如是加速度数据、角速度数据。The above-mentioned first data is the data monitored when the second electronic device is worn by the first user. The above-mentioned first data may include physiological characteristic data of the first user and motion data of the second electronic device. The above-mentioned physiological characteristic data may be, for example, heart rate data. The motion data of the second electronic device may be, for example, acceleration data and angular velocity data.
上述第一数据与用户进入睡眠状态的数据相符，可以表示第二电子设备预判出第一用户进入睡眠状态。上述第一数据可以是通过大数据收集得到的，可以反映一般用户在佩带第二电子设备进入睡眠状态的生理特征数据以及第二电子设备的运动数据。或者，上述第二数据可以包含第一用户佩带第二电子设备实际进入睡眠状态的生理特征数据以及第二电子设备的运动数据。利用包含有第一用户佩带第二电子设备实际进入睡眠状态的生理特征数据以及第二电子设备的运动数据，第二电子设备可以更准确地预判第一用户是否进入睡眠状态。The above-mentioned first data is consistent with the data that the user enters the sleep state, which may indicate that the second electronic device prejudges that the first user enters the sleep state. The above-mentioned first data may be collected through big data, and may reflect physiological characteristic data of a general user wearing the second electronic device and enter a sleep state and motion data of the second electronic device. Alternatively, the above-mentioned second data may include physiological characteristic data of the first user wearing the second electronic device and actually entering a sleep state and motion data of the second electronic device. The second electronic device can more accurately predict whether the first user enters the sleep state by using the physiological characteristic data and the motion data of the second electronic device that the first user wears the second electronic device actually enters the sleep state.
结合第二方面，在一些实施例中，在确定第一用户未进入睡眠状态之后，第二电子设备可以在处于佩带状态时监测第二数据，并判断第二数据与用户进入睡眠状态的数据是否相符。即第二电子设备可以再次预判第一用户是否进入睡眠状态。其中，在接收到来自第一电子设备的第一判断结果，第二电子设备可以每隔预设时间段(如5分钟等)进行一次预判，并在预判结果为第一用户进入睡眠状态时请求第一电子设备确定第一用户是否进入睡眠状态。With reference to the second aspect, in some embodiments, after it is determined that the first user has not entered a sleep state, the second electronic device may monitor the second data while in the wearing state, and determine whether the second data and the data of the user entering the sleep state are not match. That is, the second electronic device can predict again whether the first user enters the sleep state. Wherein, after receiving the first judgment result from the first electronic device, the second electronic device may perform a pre-judgment every preset time period (such as 5 minutes, etc.), and when the pre-judgment result is that the first user enters a sleep state requesting the first electronic device to determine whether the first user enters a sleep state.
上述第二数据为第一用户的数据，第二数据可以包括第一用户的生理特征数据、第二电子设备的运动数据。The above-mentioned second data is data of the first user, and the second data may include physiological characteristic data of the first user and motion data of the second electronic device.
结合第二方面，在一些实施例中，在确定第一用户未进入睡眠状态之后，第二电子设备可以将监测到的用户的生理特征数据记录为未处于睡眠状态下的数据。With reference to the second aspect, in some embodiments, after determining that the first user is not in a sleep state, the second electronic device may record the monitored physiological characteristic data of the user as data not in a sleep state.
结合第二方面，在一些实施例中，在接收到来自第一电子设备的第二判断结果的情况下，第二电子设备确定第一用户进入睡眠状态。第二判断结果为第一电子设备接收到第一请求后判断出第一用户未使用第一电子设备的判断结果。With reference to the second aspect, in some embodiments, in the case of receiving the second determination result from the first electronic device, the second electronic device determines that the first user enters a sleep state. The second determination result is the determination result that the first electronic device determines that the first user does not use the first electronic device after receiving the first request.
进一步的，在确定第一用户进入睡眠状态之后，第二电子设备可以将监测到的用户的生理特征数据记录为睡眠状态下的数据。Further, after it is determined that the first user enters the sleep state, the second electronic device may record the monitored physiological characteristic data of the user as data in the sleep state.
由上述睡眠监测方法可知，第二电子设备在预判出第一用户进入睡眠状态时，可以请求第一电子设备进一步确认第一用户是否进入睡眠状态。第一电子设备可以通过判断第一用户是否在使用第一电子设备来确认第一用户是否进入睡眠状态。这可以减少在单独利用第二电子设备监测用户是否进入睡眠状态的情况下，由于用户长时间保持固定姿势但未处于睡眠状态对用户是否进入睡眠状态的误判，提高用户进入睡眠状态的时间监测的准确率。It can be known from the above sleep monitoring method that when the second electronic device predicts that the first user enters the sleep state, the second electronic device may request the first electronic device to further confirm whether the first user enters the sleep state. The first electronic device may confirm whether the first user enters the sleep state by judging whether the first user is using the first electronic device. This can reduce the misjudgment of whether the user enters the sleep state because the user maintains a fixed posture for a long time but is not in the sleep state when the second electronic device is used alone to monitor whether the user enters the sleep state, and improves the monitoring of the time when the user enters the sleep state 's accuracy.
结合第二方面，在一些实施例中，第二电子设备在检测到第一用户的状态为睡眠状态时接收到来自第一电子设备的第一消息，可以确定第二电子设备检测到的第一用户的状态为非睡眠状态。第一消息可以可用于指示第一用户在使用第一电子设备。With reference to the second aspect, in some embodiments, the second electronic device receives the first message from the first electronic device when detecting that the state of the first user is the sleep state, and can determine the first message detected by the second electronic device The user's state is a non-sleep state. The first message may be used to indicate that the first user is using the first electronic device.
由上述方法可知，第二电子设备可以借助第一电子设备来判断第一用户是否退出睡眠状态。这可以减少第一用户已经醒来但未起床对判断第一用户是否退出睡眠状态的误判，提高睡眠质量监测的准确率。It can be known from the above method that the second electronic device can use the first electronic device to determine whether the first user exits the sleep state. This can reduce the misjudgment of whether the first user has exited the sleep state when the first user has woken up but has not woken up, and improve the accuracy of sleep quality monitoring.
第三方面，本申请还提供了一种睡眠监测方法。在该方法中，第二电子设备在处于佩带状态时监测到第一数据。该第一数据与用户进入睡眠状态的数据相符。第二电子设备可以向第一电子设备发送第一请求。第一电子设备与第二电子设备具有绑定关系。第一电子设备接收到第二电子设备的第一请求。第一电子设备可以判断佩带第二电子设备的第一用户是否在使用第一电子设备，并将第一判断结果或第二判断结果发送给第二电子设备。第一判断结果为第一用户在使用第一电子设备。第二判断结果为第一用户未使用第一电子设备。在接收到第一判断结果的情况下，第二电子设备可以确定第一用户未进入睡眠状态。In a third aspect, the present application also provides a sleep monitoring method. In the method, the second electronic device monitors the first data while in the wearing state. The first data is consistent with the data that the user enters the sleep state. The second electronic device may send the first request to the first electronic device. The first electronic device has a binding relationship with the second electronic device. The first electronic device receives the first request from the second electronic device. The first electronic device may determine whether the first user wearing the second electronic device is using the first electronic device, and send the first determination result or the second determination result to the second electronic device. The first determination result is that the first user is using the first electronic device. The second judgment result is that the first user does not use the first electronic device. In the case of receiving the first judgment result, the second electronic device may determine that the first user does not enter the sleep state.
由上述睡眠监测方法可知，第二电子设备在预判出第一用户进入睡眠状态时，可以请求第一电子设备进一步确认第一用户是否进入睡眠状态。第一电子设备可以通过判断第一用户是否在使用第一电子设备来确认第一用户是否进入睡眠状态。这可以减少在单独利用第二电子设备监测用户是否进入睡眠状态的情况下，由于用户长时间保持固定姿势但未处于睡眠状态对用户是否进入睡眠状态的误判，提高用户进入睡眠状态的时间监测的准确率。It can be known from the above sleep monitoring method that when the second electronic device predicts that the first user enters the sleep state, the second electronic device may request the first electronic device to further confirm whether the first user enters the sleep state. The first electronic device may confirm whether the first user enters the sleep state by judging whether the first user is using the first electronic device. This can reduce the misjudgment of whether the user enters the sleep state because the user maintains a fixed posture for a long time but is not in the sleep state when the second electronic device is used alone to monitor whether the user enters the sleep state, and improves the monitoring of the time when the user enters the sleep state 's accuracy.
结合第三方面，在一些实施例中，第一电子设备在第一条件下判断出第一电子设备在被用户使用且使用者为第一用户，第一电子设备得到第一判断结果。第一条件包括以下一项或多项：第一电子设备判断出自己处于非静止状态、第一电子设备在第一时间段内监测到用户操作、第一电子设备监测到有人眼注视第一电子设备的屏幕、第一电子设备监测到自己运行有投屏的应用程序。第一电子设备在第一条件下判断出第一电子设备在被用户使用且使用者不为第一用户，或者第一电子设备判断出第一电子设备未被用户使用，第一电子设备得到第二判断结果。With reference to the third aspect, in some embodiments, the first electronic device determines under the first condition that the first electronic device is being used by the user and the user is the first user, and the first electronic device obtains the first determination result. The first condition includes one or more of the following: the first electronic device determines that it is in a non-stationary state, the first electronic device detects a user operation within the first time period, and the first electronic device detects that a human eye is watching the first electronic device. The screen of the device and the first electronic device detect that it is running a screen-casting application. Under the first condition, the first electronic device determines that the first electronic device is being used by the user and the user is not the first user, or the first electronic device determines that the first electronic device is not being used by the user, and the first electronic device obtains the first electronic device. 2. Judgment results.
结合第三方面，在一些实施例中，第一电子设备判断出使用者为第一用户的方法可以为：第一电子设备通过摄像头采集第一图像，并判断出第一图像中包含第一用户的人脸图像。上述采集第一图像的摄像头可以是第一电子设备的摄像头，或者是投屏设备的摄像头。第一电子设备还可以通过采集其它生物特征信息(如声纹信息、指纹信息等)来判断第一电子设备的使用者是否为第一用户。With reference to the third aspect, in some embodiments, the method for the first electronic device to determine that the user is the first user may be: the first electronic device captures the first image through a camera, and determines that the first image contains the first user face image. The above-mentioned camera for collecting the first image may be a camera of the first electronic device, or a camera of a screen projection device. The first electronic device can also determine whether the user of the first electronic device is the first user by collecting other biometric information (such as voiceprint information, fingerprint information, etc.).
结合第三方面，在一些实施例中，在接收到第二判断结果的情况下，第二电子设备可以确定第一用户进入睡眠状态。With reference to the third aspect, in some embodiments, in the case of receiving the second judgment result, the second electronic device may determine that the first user enters a sleep state.
结合第三方面，在一些实施例中，第一电子设备可以与第二电子设备通过蓝牙配对的方式建立绑定关系。或者，第一电子设备可以响应于第一用户操作与第二电子设备建立绑定关系。该第一用户操作可用于指示第一电子设备的机主为第一用户。或者，第一电子设备可以与第二电子设备通过登录同一个账号建立绑定关系。With reference to the third aspect, in some embodiments, the first electronic device may establish a binding relationship with the second electronic device by pairing with Bluetooth. Alternatively, the first electronic device may establish a binding relationship with the second electronic device in response to the first user operation. The first user operation may be used to indicate that the owner of the first electronic device is the first user. Alternatively, the first electronic device may establish a binding relationship with the second electronic device by logging into the same account.
由于第一电子设备与第二电子设备具有上述绑定关系，第一电子设备可以确定第一电子设备的机主与佩带有第二电子设备的用户是同一个人。这样可以减少第一电子设备的使用者与佩带有第二电子设备的用户不是同一个人对用户是否进入睡眠状态的误判。Since the first electronic device and the second electronic device have the above-mentioned binding relationship, the first electronic device can determine that the owner of the first electronic device and the user wearing the second electronic device are the same person. In this way, the user of the first electronic device and the user wearing the second electronic device are not the same person, and misjudgment on whether the user enters the sleep state can be reduced.
结合第三方面，在一些实施例中，第一电子设备在第二时间段内，监测到解锁第一电子设备的用户操作，第一电子设备可以向第二电子设备发送第一消息。第一消息可用于指示第一用户在使用第一电子设备。或者，第一电子设备在第二时间段内，监测到关闭闹钟的用户操作，且关闭闹钟的用户为第一用户，第一电子设备可以向第二电子设备发送第一消息。With reference to the third aspect, in some embodiments, the first electronic device monitors a user operation of unlocking the first electronic device within the second time period, and the first electronic device may send the first message to the second electronic device. The first message may be used to indicate that the first user is using the first electronic device. Alternatively, the first electronic device detects a user operation to turn off the alarm clock within the second time period, and the user who turns off the alarm clock is the first user, and the first electronic device may send the first message to the second electronic device.
上述解锁的方法可以是利用生物特征信息进行解锁的方法。该生物特征信息可以例如是 人脸信息、声纹信息、指纹信息等等。当监测到上述生物特征信息属于第一用户的生物特征信息，第一电子设备可以确定解锁的用户为第一用户。The above unlocking method may be a method of unlocking by using biometric information. The biometric information can be, for example, face information, voiceprint information, fingerprint information, and the like. When monitoring that the above-mentioned biometric information belongs to the biometric information of the first user, the first electronic device may determine that the unlocked user is the first user.
上述第二时间段可以为从第一电子设备向二电子设备发送第二判断结果开始的第一时长的时间段。或者，第二时间段可以为预设时间段。The above-mentioned second time period may be a time period of a first duration from when the first electronic device sends the second judgment result to the second electronic device. Alternatively, the second time period may be a preset time period.
由上述方法可知，第二电子设备可以借助第一电子设备来判断第一用户是否退出睡眠状态。这可以减少第一用户已经醒来但未起床对判断第一用户是否退出睡眠状态的误判，提高睡眠质量监测的准确率。It can be known from the above method that the second electronic device can use the first electronic device to determine whether the first user exits the sleep state. This can reduce the misjudgment of whether the first user has exited the sleep state when the first user has woken up but has not woken up, and improve the accuracy of sleep quality monitoring.
第四方面，本申请还提供了一种睡眠监测方法。在该方法中，第二电子设备在检测到佩戴有第二电子设备的第一用户的状态为睡眠状态时接收到第一电子设备的第一消息，可以确定第二电子设备检测到的第一用户的状态为非睡眠状态。第一电子设备与第二电子设备具有绑定关系。第一消息可以是第一电子设备在第一监测时间段内监测到解锁第一电子设备的用户操作之后发送的。In a fourth aspect, the present application also provides a sleep monitoring method. In this method, the second electronic device receives the first message of the first electronic device when detecting that the state of the first user wearing the second electronic device is a sleep state, and can determine the first message detected by the second electronic device The user's state is a non-sleep state. The first electronic device has a binding relationship with the second electronic device. The first message may be sent by the first electronic device after monitoring the user operation of unlocking the first electronic device within the first monitoring time period.
上述第二电子设备在接收到第一消息时确定检测到的第一用户的状态为非睡眠状态具体可以是将检测到的第一用户的状态从睡眠状态标记为非睡眠状态。也即是说，当接收到上述第一消息，第二电子设备可以确定第一用户醒来了。并且，第二电子设备可以将接收到第一消息的时刻或者是第一电子设备检测到解锁的用户操作的时刻确定为第一用户醒来的时刻。When the second electronic device receives the first message, determining that the detected state of the first user is a non-sleep state may specifically be marking the detected state of the first user from a sleep state to a non-sleep state. That is to say, when receiving the above-mentioned first message, the second electronic device may determine that the first user wakes up. Furthermore, the second electronic device may determine the moment when the first message is received or the moment when the first electronic device detects the unlocking user operation as the moment when the first user wakes up.
由上述方法可知，第二电子设备可以借助第一电子设备来判断第一用户是否退出睡眠状态。这可以减少第一用户已经醒来但未起床对判断第一用户是否退出睡眠状态的误判，提高睡眠质量监测的准确率。It can be known from the above method that the second electronic device can use the first electronic device to determine whether the first user exits the sleep state. This can reduce the misjudgment of whether the first user has exited the sleep state when the first user has woken up but has not woken up, and improve the accuracy of sleep quality monitoring.
结合第四方面，在一些实施例中，上述解锁的方法可以是利用生物特征信息进行解锁的方法。该生物特征信息可以例如是人脸信息、声纹信息、指纹信息等等。当监测到上述生物特征信息属于第一用户的生物特征信息，第一电子设备可以确定解锁的用户为第一用户。With reference to the fourth aspect, in some embodiments, the above unlocking method may be a method for unlocking by using biometric information. The biometric information may be, for example, face information, voiceprint information, fingerprint information, and the like. When monitoring that the above-mentioned biometric information belongs to the biometric information of the first user, the first electronic device may determine that the unlocked user is the first user.
结合第四方面，在一些实施例中，第二电子设备在处于佩带状态时监测到第一数据。第一数据与用户进入睡眠状态的数据相符。第二电子设备可以向第一电子设备发送第一请求。第二电子设备接收到第一电子设备指示第一用户未使用第一电子设备的判断结果，可以确定第二电子设备检测到的第一用户的状态为进入睡眠状态。In conjunction with the fourth aspect, in some embodiments, the second electronic device monitors the first data while in the wearing state. The first data is consistent with the data that the user enters the sleep state. The second electronic device may send the first request to the first electronic device. The second electronic device receives the judgment result that the first electronic device indicates that the first user does not use the first electronic device, and can determine that the state of the first user detected by the second electronic device is the sleep state.
结合第四方面，在一些实施例中，上述第一监测时间段可以为第二电子设备预估第一用户退出睡眠状态的时间段。可选的，上述第一监测时间段可以是固定的时间段，例如上午5点到上述10点这一时间段。With reference to the fourth aspect, in some embodiments, the above-mentioned first monitoring time period may be a time period for which the second electronic device estimates the first user to exit the sleep state. Optionally, the above-mentioned first monitoring time period may be a fixed time period, such as a time period from 5:00 am to the above-mentioned 10:00 am.
结合第四方面，在一些实施例中，上述第一监测时间段可以为从第一电子设备向第二电子设备发送指示第一用户未使用第一电子设备的判断结果开始的第一时长的时间段。With reference to the fourth aspect, in some embodiments, the above-mentioned first monitoring period may be the first period of time from the first electronic device sending a judgment result indicating that the first user does not use the first electronic device to the second electronic device part.
上述第一监测时间段与前述实施例中的第二时间段可以为相同的时间段。The above-mentioned first monitoring time period and the second time period in the foregoing embodiment may be the same time period.
结合第四方面，在一些实施例中，第一电子设备可以与第二电子设备通过蓝牙配对的方式建立绑定关系。或者，第一电子设备可以响应于第一用户操作与第二电子设备建立绑定关系。该第一用户操作可用于指示第一电子设备的机主为第一用户。或者，第一电子设备可以与第二电子设备通过登录同一个账号建立绑定关系。With reference to the fourth aspect, in some embodiments, the first electronic device may establish a binding relationship with the second electronic device by pairing with Bluetooth. Alternatively, the first electronic device may establish a binding relationship with the second electronic device in response to the first user operation. The first user operation may be used to indicate that the owner of the first electronic device is the first user. Alternatively, the first electronic device may establish a binding relationship with the second electronic device by logging into the same account.
由于第一电子设备与第二电子设备具有上述绑定关系，第一电子设备可以确定第一电子设备的机主与佩带有第二电子设备的用户是同一个人。这样可以减少第一电子设备的使用者与佩带有第二电子设备的用户不是同一个人对用户是否进入睡眠状态的误判。Since the first electronic device and the second electronic device have the above-mentioned binding relationship, the first electronic device can determine that the owner of the first electronic device and the user wearing the second electronic device are the same person. In this way, the user of the first electronic device and the user wearing the second electronic device are not the same person, and misjudgment on whether the user enters the sleep state can be reduced.
结合第四方面，在一些实施例中，在确定检测到的第一用户的状态为非睡眠状态之后，第二电子设备还可以将监测到的用户的生理特征数据记录为未处于睡眠状态下的数据。With reference to the fourth aspect, in some embodiments, after determining that the detected state of the first user is a non-sleep state, the second electronic device may further record the monitored physiological characteristic data of the user as not in a sleep state data.
第五方面，本申请还提供了一种睡眠监测方法。在该方法中，第一电子设备可以在第一监测时间段内监测到解锁第一电子设备的用户操作，向第二电子设备发送第一消息。该第一消息用于指示佩带有第二电子设备的第一用户在使用第一电子设备。第一电子设备与第二电子设备具有绑定关系。第二电子设备在检测到第一用户的状态为睡眠状态时接收到第一消息，可以确定检测到的第一用户的状态为非睡眠状态。In a fifth aspect, the present application also provides a sleep monitoring method. In this method, the first electronic device may monitor the user operation of unlocking the first electronic device within the first monitoring time period, and send the first message to the second electronic device. The first message is used to indicate that the first user wearing the second electronic device is using the first electronic device. The first electronic device has a binding relationship with the second electronic device. The second electronic device receives the first message when detecting that the state of the first user is a sleep state, and may determine that the detected state of the first user is a non-sleep state.
上述第二电子设备在接收到第一消息时确定检测到的第一用户的状态为非睡眠状态具体可以是将检测到的第一用户的状态从睡眠状态标记为非睡眠状态。也即是说，当接收到上述第一消息，第二电子设备可以确定第一用户醒来了。并且，第二电子设备可以将接收到第一消息的时刻或者是第一电子设备检测到解锁的用户操作的时刻确定为第一用户醒来的时刻。When the second electronic device receives the first message, determining that the detected state of the first user is a non-sleep state may specifically be marking the detected state of the first user from a sleep state to a non-sleep state. That is to say, when receiving the above-mentioned first message, the second electronic device may determine that the first user wakes up. Furthermore, the second electronic device may determine the moment when the first message is received or the moment when the first electronic device detects the unlocking user operation as the moment when the first user wakes up.
由上述方法可知，第二电子设备可以借助第一电子设备来判断第一用户是否退出睡眠状态。这可以减少第一用户已经醒来但未起床对判断第一用户是否退出睡眠状态的误判，提高睡眠质量监测的准确率。It can be known from the above method that the second electronic device can use the first electronic device to determine whether the first user exits the sleep state. This can reduce the misjudgment of whether the first user has exited the sleep state when the first user has woken up but has not woken up, and improve the accuracy of sleep quality monitoring.
结合第五方面，在一些实施例中，第二电子设备在处于佩带状态时监测到第一数据，第一数据与用户进入睡眠状态的数据相符。第二电子设备向第一电子设备发送第一请求。第一电子设备接收到第一请求，并判断第一用户是否在使用第一电子设备，得到指示第一用户未使用第一电子设备的判断结果。第一电子设备可以将指示第一用户未使用第一电子设备的判断结果发送给第二电子设备。当接收到上述指示第一用户未使用第一电子设备的判断结果，第二电子设备可以确定第一用户进入睡眠状态。With reference to the fifth aspect, in some embodiments, the second electronic device monitors the first data when it is in the wearing state, and the first data is consistent with the data that the user enters the sleep state. The second electronic device sends the first request to the first electronic device. The first electronic device receives the first request, determines whether the first user is using the first electronic device, and obtains a determination result indicating that the first user is not using the first electronic device. The first electronic device may send a judgment result indicating that the first user does not use the first electronic device to the second electronic device. When receiving the above determination result indicating that the first user does not use the first electronic device, the second electronic device may determine that the first user enters a sleep state.
结合第五方面，在一些实施例中，上述第一监测时间段可以为第二电子设备预估第一用户退出睡眠状态的时间段。With reference to the fifth aspect, in some embodiments, the above-mentioned first monitoring time period may be a time period during which the second electronic device estimates the first user to exit the sleep state.
结合第五方面，在一些实施例中，上述第一监测时间段可以为从第一电子设备向第二电子设备发送指示第一用户未使用第一电子设备的判断结果开始的第一时长的时间段。With reference to the fifth aspect, in some embodiments, the above-mentioned first monitoring time period may be the first time period from the time when the first electronic device sends a judgment result indicating that the first user does not use the first electronic device to the second electronic device part.
结合第五方面，在一些实施例中，第一电子设备在向第二电子设备发送上述第一消息之前，还可以在第一条件下判断出第一电子设备在被用户使用且使用者为第一用户。第一条件包括以下一项或多项：第一电子设备判断出自己处于非静止状态、第一电子设备在第一时间段内监测到用户操作、第一电子设备监测到有人眼注视第一电子设备的屏幕、第一电子设备监测到自己运行有投屏的应用程序。With reference to the fifth aspect, in some embodiments, before sending the above-mentioned first message to the second electronic device, the first electronic device may further determine under the first condition that the first electronic device is being used by the user and the user is the first electronic device a user. The first condition includes one or more of the following: the first electronic device determines that it is in a non-stationary state, the first electronic device detects a user operation within the first time period, and the first electronic device detects that a human eye is watching the first electronic device. The screen of the device and the first electronic device detect that it is running a screen-casting application.
结合第五方面，在一些实施例中，当确定第一用户退出睡眠状态，第二电子设备可以将监测到的用户的生理特征数据记录为未处于睡眠状态下的数据。With reference to the fifth aspect, in some embodiments, when it is determined that the first user exits the sleep state, the second electronic device may record the monitored physiological characteristic data of the user as data not in the sleep state.
结合第五方面，在一些实施例中，第一电子设备可以与第二电子设备通过蓝牙配对的方式建立绑定关系。或者，第一电子设备可以响应于第一用户操作与第二电子设备建立绑定关系。该第一用户操作可用于指示第一电子设备的机主为第一用户。或者，第一电子设备可以与第二电子设备通过登录同一个账号建立绑定关系。With reference to the fifth aspect, in some embodiments, the first electronic device may establish a binding relationship with the second electronic device by pairing with Bluetooth. Alternatively, the first electronic device may establish a binding relationship with the second electronic device in response to the first user operation. The first user operation may be used to indicate that the owner of the first electronic device is the first user. Alternatively, the first electronic device may establish a binding relationship with the second electronic device by logging into the same account.
由于第一电子设备与第二电子设备具有上述绑定关系，第一电子设备可以确定第一电子设备的机主与佩带有第二电子设备的用户是同一个人。这样可以减少第一电子设备的使用者与佩带有第二电子设备的用户不是同一个人对用户是否进入睡眠状态的误判。Since the first electronic device and the second electronic device have the above-mentioned binding relationship, the first electronic device can determine that the owner of the first electronic device and the user wearing the second electronic device are the same person. In this way, the user of the first electronic device and the user wearing the second electronic device are not the same person, and misjudgment on whether the user enters the sleep state can be reduced.
第六方面，本申请提供的一种电子设备。该电子设备为第一电子设备。第一电子设备可包括摄像头、通信模块、存储器和处理器。摄像头可用于采集图像。通信模块可用于与第二电子设备建立通信连接。存储器可用于存储计算机程序。处理器可用于调用计算机程序，使得第一电子设备执行上述第一方面中任一可能的实现方法。In a sixth aspect, the present application provides an electronic device. The electronic device is a first electronic device. The first electronic device may include a camera, a communication module, a memory and a processor. A camera can be used to capture images. The communication module can be used to establish a communication connection with the second electronic device. Memory can be used to store computer programs. The processor may be configured to invoke a computer program, so that the first electronic device executes any of the possible implementation methods of the above-mentioned first aspect.
第七方面，本申请还提供了一种电子设备。该电子设备为第二电子设备。第二电子设备 可包括通信模块、存储器和处理器。通信模块可用于与第一电子设备建立通信连接。存储器可用于存储计算机程序。处理器可用于调用计算机程序，使得第二电子设备执行上述第二方面中任一可能的实现方法或者执行上述第四方面中任一可能的实现方法。In a seventh aspect, the present application further provides an electronic device. The electronic device is the second electronic device. The second electronic device may include a communication module, a memory and a processor. The communication module can be used to establish a communication connection with the first electronic device. Memory can be used to store computer programs. The processor may be configured to invoke a computer program, so that the second electronic device executes any possible implementation method of the second aspect above or any possible implementation method of the fourth aspect above.
第八方面，本申请提供了一种睡眠监测***，该***可包括上述第六方面提供的电子设备和上述第七方面提供的电子设备。In an eighth aspect, the present application provides a sleep monitoring system, which may include the electronic device provided in the sixth aspect and the electronic device provided in the seventh aspect.
第九方面，本申请实施例提供一种芯片，该芯片应用于第六方面提供的电子设备或第七方面提供的电子设备，该芯片包括一个或多个处理器，该处理器用于调用计算机指令以使得上述第六方面提供的电子设备执行如第一方面中任一可能的实现方法，或使得上述第七方面提供的电子设备执行如第二方面中任一可能的实现方法或执行如第四方面中任一可能的实现方法。In a ninth aspect, an embodiment of the present application provides a chip, which is applied to the electronic device provided in the sixth aspect or the electronic device provided in the seventh aspect, the chip includes one or more processors, and the processors are used to invoke computer instructions In order to make the electronic device provided in the sixth aspect above perform any possible implementation method as in the first aspect, or cause the electronic device provided in the seventh aspect above to perform any possible implementation method as in the second aspect or perform as in the fourth aspect Any possible implementation of the aspect.
第十方面，本申请实施例提供一种包含指令的计算机程序产品，当上述计算机程序产品在电子设备上运行时，使得上述第六方面提供的电子设备执行如第一方面中任一可能的实现方法，或使得上述第七方面提供的电子设备执行如第二方面中任一可能的实现方法或执行如第四方面中任一可能的实现方法。In a tenth aspect, an embodiment of the present application provides a computer program product containing instructions, when the computer program product is executed on an electronic device, the electronic device provided in the sixth aspect can perform any possible implementation as in the first aspect. method, or cause the electronic device provided in the seventh aspect to perform any possible implementation method as in the second aspect or perform any possible implementation method as in the fourth aspect.
第十一方面，本申请实施例提供一种计算机存储介质，包括计算机指令，当上述计算机指令在电子设备上运行时，使得上述第六方面提供的电子设备执行如第一方面中任一可能的实现方法，或使得上述第七方面提供的电子设备执行如第二方面中任一可能的实现方法或执行如第四方面中任一可能的实现方法。In an eleventh aspect, an embodiment of the present application provides a computer storage medium, including computer instructions, when the computer instructions are executed on an electronic device, the electronic device provided in the sixth aspect can execute any of the possible operations in the first aspect. The implementation method is implemented, or the electronic device provided in the seventh aspect is caused to perform any possible implementation method in the second aspect or any possible implementation method in the fourth aspect.
可以理解地，上述第六方面提供的电子设备、第七方面提供的电子设备、第八方面提供的睡眠监测***、第九方面提供的芯片、第十方面提供的计算机程序产品和第十一方面提供的计算机可读存储介质均用于执行本申请实施例所提供的方法。因此，其所能达到的有益效果可参考对应方法中的有益效果，此处不再赘述。It can be understood that the electronic device provided in the sixth aspect, the electronic device provided in the seventh aspect, the sleep monitoring system provided in the eighth aspect, the chip provided in the ninth aspect, the computer program product provided in the tenth aspect, and the eleventh aspect The provided computer-readable storage media are all used to execute the methods provided by the embodiments of the present application. Therefore, for the beneficial effects that can be achieved, reference may be made to the beneficial effects in the corresponding method, which will not be repeated here.
附图说明Description of drawings
图1是本申请实施例提供的一种第一电子设备100的结构示意图；FIG. 1 is a schematic structural diagram of a first electronic device 100 provided by an embodiment of the present application;
图2是本申请实施例提供的一种睡眠监测的场景示意图；FIG. 2 is a schematic diagram of a sleep monitoring scenario provided by an embodiment of the present application;
图3是本申请实施例提供的一种睡眠监测方法的流程图；3 is a flowchart of a sleep monitoring method provided by an embodiment of the present application;
图4是本申请实施例提供的另一种睡眠监测方法的流程图；4 is a flowchart of another sleep monitoring method provided by an embodiment of the present application;
图5是本申请实施例提供的另一种睡眠监测方法的流程图；5 is a flowchart of another sleep monitoring method provided by an embodiment of the present application;
图6是本申请实施例提供的另一种睡眠监测方法的流程图。FIG. 6 is a flowchart of another sleep monitoring method provided by an embodiment of the present application.
具体实施方式Detailed ways
下面将结合附图对本申请实施例中的技术方案进行清楚、详尽地描述。其中，在本申请实施例的描述中，除非另有说明，“/”表示或的意思，例如，A/B可以表示A或B；文本中的“和/或”仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况，另外，在本申请实施例的描述中，“多个”是指两个或多于两个。The technical solutions in the embodiments of the present application will be described clearly and in detail below with reference to the accompanying drawings. Wherein, in the description of the embodiments of the present application, unless otherwise specified, “/” means or, for example, A/B can mean A or B; “and/or” in the text is only a description of an associated object The association relationship indicates that there can be three kinds of relationships, for example, A and/or B can indicate that A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of this application , "plurality" means two or more than two.
以下，术语“第一”、“第二”仅用于描述目的，而不能理解为暗示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征，在本申请实施例的描述中，除非另有说明，“多个”的含 义是两个或两个以上。Hereinafter, the terms "first" and "second" are only used for descriptive purposes, and should not be understood as implying or implying relative importance or implying the number of indicated technical features. Therefore, the features defined with "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise specified, the "multiple" The meaning is two or more.
本申请提供一种睡眠监测方法，可通过第一电子设备和第二电子设备协作来监测用户是否进入睡眠状态。睡眠状态可以指人在睡觉时所表现出的形态。睡眠状态可以包括入睡阶段、浅睡阶段和深睡阶段。处于睡眠状态的用户长时间保持固定的姿态或者肢体有小幅度的姿态变化。并且，处于睡眠状态的用户的心率在静息心率附近波动。第一电子设备可以是手机、平板电脑、膝上型计算机、手持计算机、超级移动个人计算机(ultra-mobile personal computer，UMPC)、上网本、个人数字助理(personal digital assistant，PDA)以及智能眼镜等电子设备。第二电子设备是用于监测用户睡眠质量的电子设备。睡眠质量监测可以包括确定用户处于睡眠状态的总时长以及睡眠状态中入睡阶段、浅睡阶段、深睡阶段的时间长度等数据。第二电子设备可以例如是手环、手表等电子设备。即用户可以通过佩带第二电子设备来监测自己的睡眠质量。本申请实施例对第一电子设备和第二电子设备的具体类型不作限定。The present application provides a sleep monitoring method, which can monitor whether a user enters a sleep state through the cooperation of a first electronic device and a second electronic device. Sleep state can refer to the form that a person exhibits when sleeping. The sleep state may include a sleep onset stage, a light sleep stage, and a deep sleep stage. A user in a sleeping state maintains a fixed posture for a long time or has a small change in the posture of the limbs. Also, the heart rate of the user in the sleeping state fluctuates around the resting heart rate. The first electronic device may be a mobile phone, a tablet computer, a laptop computer, a handheld computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), and smart glasses. equipment. The second electronic device is an electronic device for monitoring the user's sleep quality. The sleep quality monitoring may include determining the total duration of the user in a sleep state, and data such as the duration of sleep onset, light sleep, and deep sleep in the sleep state. The second electronic device may be, for example, an electronic device such as a wristband, a watch, or the like. That is, the user can monitor his own sleep quality by wearing the second electronic device. The embodiments of the present application do not limit the specific types of the first electronic device and the second electronic device.
在该睡眠监测方法中，第二电子设备佩带于第一用户上。第二电子设备中存储有睡眠模型。第二电子设备可以根据加速度传感器、心率传感器等传感器采集的数据，利用睡眠模型预判第一用户是否进入睡眠状态。当第二电子设备的预判结果为第一用户进入睡眠状态，第二电子设备可以向第一电子设备发送确认第一用户是否进入睡眠状态的请求。进一步的，第一电子设备可以检测第一用户是否在使用第一电子设备。若判断出第一用户在使用第一电子设备，第一电子设备可以通知第二电子设备第一用户在使用第一电子设备。第二电子设备可以根据该通知确定第一用户未进入睡眠状态。否则，第一电子设备可以通知第二电子设备第一用户未使用第一电子设备。第二电子设备可以根据该通知确定第二用户进入睡眠状态。In the sleep monitoring method, the second electronic device is worn on the first user. A sleep model is stored in the second electronic device. The second electronic device may use a sleep model to predict whether the first user enters a sleep state according to data collected by sensors such as an acceleration sensor and a heart rate sensor. When the pre-judgment result of the second electronic device is that the first user enters the sleep state, the second electronic device may send a request for confirming whether the first user enters the sleep state to the first electronic device. Further, the first electronic device can detect whether the first user is using the first electronic device. If it is determined that the first user is using the first electronic device, the first electronic device may notify the second electronic device that the first user is using the first electronic device. The second electronic device may determine that the first user has not entered a sleep state according to the notification. Otherwise, the first electronic device may notify the second electronic device that the first electronic device is not used by the first user. The second electronic device may determine that the second user enters the sleep state according to the notification.
由上述方法可知，第二电子设备在预判出第一用户进入睡眠状态时，可以请求第一电子设备进一步确认第一用户是否进入睡眠状态。这可以减少在单独利用第二电子设备监测用户是否进入睡眠状态的情况下，由于用户长时间保持固定姿势但未处于睡眠状态对用户是否进入睡眠状态的误判，提高用户进入睡眠状态的时间监测的准确率。It can be known from the above method that when the second electronic device predicts that the first user enters the sleep state, the second electronic device can request the first electronic device to further confirm whether the first user enters the sleep state. This can reduce the misjudgment of whether the user enters the sleep state because the user maintains a fixed posture for a long time but is not in the sleep state when the second electronic device is used alone to monitor whether the user enters the sleep state, and improves the monitoring of the time when the user enters the sleep state 's accuracy.
图1示例性示出了本申请实施例提供的一种第一电子设备100的结构示意图。FIG. 1 exemplarily shows a schematic structural diagram of a first electronic device 100 provided by an embodiment of the present application.
如图1所示，第一电子设备100可以包括处理器110，外部存储器接口120，内部存储器121，通用串行总线(universal serial bus，USB)接口130，充电管理模块140，电源管理模块141，电池142，天线1，天线2，移动通信模块150，无线通信模块160，音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，传感器模块180，按键190，马达191，指示器192，摄像头193，显示屏194，以及用户标识模块(subscriber identification module，SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A，陀螺仪传感器180B，气压传感器180C，磁传感器180D，加速度传感器180E，距离传感器180F，接近光传感器180G，指纹传感器180H，温度传感器180J，触摸传感器180K，环境光传感器180L，骨传导传感器180M等。As shown in FIG. 1 , the first electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, Battery 142, Antenna 1, Antenna 2, Mobile Communication Module 150, Wireless Communication Module 160, Audio Module 170, Speaker 170A, Receiver 170B, Microphone 170C, Headphone Jack 170D, Sensor Module 180, Key 190, Motor 191, Indicator 192, A camera 193, a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195 and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.
可以理解的是，本发明实施例示意的结构并不构成对第一电子设备100的具体限定。在本申请另一些实施例中，第一电子设备100可以包括比图示更多或更少的部件，或者组合某些部件，或者拆分某些部件，或者不同的部件布置。图示的部件可以以硬件，软件或软件和硬件的组合实现。It can be understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the first electronic device 100 . In other embodiments of the present application, the first electronic device 100 may include more or less components than shown, or some components are combined, or some components are separated, or different components are arranged. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)， 图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
其中，控制器可以是第一电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。The controller may be the nerve center and command center of the first electronic device 100 . The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.
处理器110中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器110的等待时间，因而提高了***的效率。A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.
USB接口130是符合USB标准规范的接口，具体可以是Mini USB接口，Micro USB接口，USB Type C接口等。USB接口130可以用于连接充电器为第一电子设备100充电，也可以用于第一电子设备100与***设备之间传输数据。也可以用于连接耳机，通过耳机播放音频。该接口还可以用于连接其他电子设备，例如AR设备等。The USB interface 130 is an interface that conforms to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface 130 can be used to connect a charger to charge the first electronic device 100, and can also be used to transmit data between the first electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices.
充电管理模块140用于从充电器接收充电输入。The charging management module 140 is used to receive charging input from the charger.
电源管理模块141用于连接电池142，充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入，为处理器110，内部存储器121，外部存储器，显示屏194，摄像头193，和无线通信模块160等供电。The power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives input from the battery 142 and/or the charging management module 140 and supplies power to the processor 110 , the internal memory 121 , the external memory, the display screen 194 , the camera 193 , and the wireless communication module 160 .
第一电子设备100的无线通信功能可以通过天线1，天线2，移动通信模块150，无线通信模块160，调制解调处理器以及基带处理器等实现。The wireless communication function of the first electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.
天线1和天线2用于发射和接收电磁波信号。第一电子设备100中的每个天线可用于覆盖单个或多个通信频带。Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the first electronic device 100 may be used to cover a single or multiple communication frequency bands.
移动通信模块150可以提供应用在第一电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器，开关，功率放大器，低噪声放大器(low noise amplifier，LNA)等。移动通信模块150可以由天线1接收电磁波，并对接收的电磁波进行滤波，放大等处理，传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大，经天线1转为电磁波辐射出去。在一些实施例中，移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中，移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。The mobile communication module 150 may provide a wireless communication solution including 2G/3G/4G/5G etc. applied on the first electronic device 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 . In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .
无线通信模块160可以提供应用在第一电子设备100上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)，全球导航卫星***(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号，对其进行调频，放大，经天线2转为电磁波辐射出去。The wireless communication module 160 can provide applications on the first electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global Navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .
在一些实施例中，第一电子设备100的天线1和移动通信模块150耦合，天线2和无线通信模块160耦合，使得第一电子设备100可以通过无线通信技术与网络以及其他设备通信。In some embodiments, the antenna 1 of the first electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the first electronic device 100 can communicate with the network and other devices through wireless communication technology.
第一电子设备100通过GPU，显示屏194，以及应用处理器等实现显示功能。GPU为图像处理的微处理器，连接显示屏194和应用处理器。GPU用于执行数学和几何计算，用于图 形渲染。处理器110可包括一个或多个GPU，其执行程序指令以生成或改变显示信息。The first electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
显示屏194用于显示图像，视频等。在一些实施例中，第一电子设备100可以包括1个或N个显示屏194，N为大于1的正整数。Display screen 194 is used to display images, videos, and the like. In some embodiments, the first electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
第一电子设备100可以通过ISP，摄像头193，视频编解码器，GPU，显示屏194以及应用处理器等实现拍摄功能。The first electronic device 100 may implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.
ISP用于处理摄像头193反馈的数据。例如，拍照时，打开快门，光线通过镜头被传递到摄像头感光元件上，光信号转换为电信号，摄像头感光元件将所述电信号传递给ISP处理，转化为肉眼可见的图像。ISP还可以对图像的噪点，亮度，肤色进行算法优化。ISP还可以对拍摄场景的曝光，色温等参数优化。在一些实施例中，ISP可以设置在摄像头193中。The ISP is used to process the data fed back by the camera 193 . For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin tone. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be provided in the camera 193 .
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device，CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor，CMOS)光电晶体管。感光元件把光信号转换成电信号，之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB，YUV等格式的图像信号。在一些实施例中，第一电子设备100可以包括1个或N个摄像头193，N为大于1的正整数。Camera 193 is used to capture still images or video. The object is projected through the lens to generate an optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other formats of image signals. In some embodiments, the first electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.
数字信号处理器用于处理数字信号，除了可以处理数字图像信号，还可以处理其他数字信号。例如，当第一电子设备100在频点选择时，数字信号处理器用于对频点能量进行傅里叶变换等。A digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the first electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point, and the like.
视频编解码器用于对数字视频压缩或解压缩。第一电子设备100可以支持一种或多种视频编解码器。这样，第一电子设备100可以播放或录制多种编码格式的视频，例如：动态图像专家组(moving picture experts group，MPEG)1，MPEG2，MPEG3，MPEG4等。Video codecs are used to compress or decompress digital video. The first electronic device 100 may support one or more video codecs. In this way, the first electronic device 100 can play or record videos in various encoding formats, such as: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.
NPU为神经网络(neural-network，NN)计算处理器，通过借鉴生物神经网络结构，例如借鉴人脑神经元之间传递模式，对输入信息快速处理，还可以不断的自学习。通过NPU可以实现第一电子设备100的智能认知等应用，例如：图像识别，人脸识别，语音识别，文本理解等。The NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transfer mode between neurons in the human brain, it can quickly process the input information, and can continuously learn by itself. Applications such as intelligent cognition of the first electronic device 100 can be implemented through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, and the like.
外部存储器接口120可以用于连接外部存储卡，例如Micro SD卡，实现扩展第一电子设备100的存储能力。The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the first electronic device 100.
内部存储器121可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令，从而执行第一电子设备100的各种功能应用以及数据处理。内部存储器121可以包括存储程序区和存储数据区。其中，存储程序区可存储操作***，至少一个功能所需的应用程序(比如声音播放功能，图像播放功能等)等。存储数据区可存储第一电子设备100使用过程中所创建的数据(比如音频数据，电话本等)等。Internal memory 121 may be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the first electronic device 100 by executing the instructions stored in the internal memory 121 . The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like. The storage data area may store data (such as audio data, phone book, etc.) created during the use of the first electronic device 100 and the like.
第一电子设备100可以通过音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，以及应用处理器等实现音频功能。例如音乐播放，录音等。The first electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playback, recording, etc.
音频模块170用于将数字音频信息转换成模拟音频信号输出，也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。The audio module 170 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 170 may also be used to encode and decode audio signals.
扬声器170A，也称“喇叭”，用于将音频电信号转换为声音信号。Speaker 170A, also referred to as a "speaker", is used to convert audio electrical signals into sound signals.
受话器170B，也称“听筒”，用于将音频电信号转换成声音信号。The receiver 170B, also referred to as "earpiece", is used to convert audio electrical signals into sound signals.
麦克风170C，也称“话筒”，“传声器”，用于将声音信号转换为电信号。The microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.
耳机接口170D用于连接有线耳机。The earphone jack 170D is used to connect wired earphones.
压力传感器180A用于感受压力信号，可以将压力信号转换成电信号。在一些实施例中，压力传感器180A可以设置于显示屏194。压力传感器180A的种类很多，如电阻式压力传感器，电感式压力传感器，电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的平行板。当有力作用于压力传感器180A，电极之间的电容改变。第一电子设备100根据电容的变化确定压力的强度。当有触摸操作作用于显示屏194，第一电子设备100根据压力传感器180A检测所述触摸操作强度。第一电子设备100也可以根据压力传感器180A的检测信号计算触摸的位置。在一些实施例中，作用于相同触摸位置，但不同触摸操作强度的触摸操作，可以对应不同的操作指令。例如：当有触摸操作强度小于第一压力阈值的触摸操作作用于短消息应用图标时，执行查看短消息的指令。当有触摸操作强度大于或等于第一压力阈值的触摸操作作用于短消息应用图标时，执行新建短消息的指令。The pressure sensor 180A is used to sense pressure signals, and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be provided on the display screen 194 . There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, and the like. The capacitive pressure sensor may be comprised of at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The first electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the first electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The first electronic device 100 may also calculate the touched position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example, when a touch operation whose intensity is less than the first pressure threshold acts on the short message application icon, the instruction for viewing the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.
陀螺仪传感器180B可以用于确定第一电子设备100的运动姿态。在一些实施例中，可以通过陀螺仪传感器180B确定第一电子设备100围绕三个轴(即，x，y和z轴)的角速度。陀螺仪传感器180B可以用于拍摄防抖。示例性的，当按下快门，陀螺仪传感器180B检测第一电子设备100抖动的角度，根据角度计算出镜头模组需要补偿的距离，让镜头通过反向运动抵消第一电子设备100的抖动，实现防抖。陀螺仪传感器180B还可以用于导航，体感游戏场景。The gyro sensor 180B may be used to determine the motion attitude of the first electronic device 100 . In some embodiments, the angular velocity of the first electronic device 100 about three axes (ie, the x, y and z axes) may be determined by the gyro sensor 180B. The gyro sensor 180B can be used for image stabilization. Exemplarily, when the shutter is pressed, the gyro sensor 180B detects the shaking angle of the first electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and allows the lens to offset the shaking of the first electronic device 100 through reverse motion, Achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenarios.
气压传感器180C用于测量气压。The air pressure sensor 180C is used to measure air pressure.
磁传感器180D包括霍尔传感器。The magnetic sensor 180D includes a Hall sensor.
加速度传感器180E可检测第一电子设备100在各个方向上(一般为三轴)加速度的大小。当第一电子设备100静止时可检测出重力的大小及方向。还可以用于识别第一电子设备100姿态，应用于横竖屏切换，计步器等应用。The acceleration sensor 180E can detect the magnitude of the acceleration of the first electronic device 100 in various directions (generally three axes). The magnitude and direction of gravity can be detected when the first electronic device 100 is stationary. It can also be used for recognizing the posture of the first electronic device 100, and can be used in applications such as switching between horizontal and vertical screens, and pedometers.
距离传感器180F，用于测量距离。Distance sensor 180F for measuring distance.
接近光传感器180G可以包括例如发光二极管(LED)和光检测器，例如光电二极管。第一电子设备100使用光电二极管检测来自附近物体的红外反射光。当检测到充分的反射光时，可以确定第一电子设备100附近有物体。当检测到不充分的反射光时，第一电子设备100可以确定第一电子设备100附近没有物体。Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes. The first electronic device 100 detects infrared reflected light from nearby objects using a photodiode. When sufficient reflected light is detected, it may be determined that there is an object near the first electronic device 100 . When insufficient reflected light is detected, the first electronic device 100 may determine that there is no object near the first electronic device 100 .
环境光传感器180L用于感知环境光亮度。第一电子设备100可以根据感知的环境光亮度自适应调节显示屏194亮度。环境光传感器180L也可用于拍照时自动调节白平衡。环境光传感器180L还可以与接近光传感器180G配合，检测第一电子设备100是否在口袋里，以防误触。The ambient light sensor 180L is used to sense ambient light brightness. The first electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the first electronic device 100 is in the pocket, so as to prevent accidental touch.
指纹传感器180H用于采集指纹。第一电子设备100可以利用采集的指纹特性实现指纹解锁，访问应用锁，指纹拍照，指纹接听来电等。The fingerprint sensor 180H is used to collect fingerprints. The first electronic device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering incoming calls with fingerprints, and the like.
温度传感器180J用于检测温度。The temperature sensor 180J is used to detect the temperature.
触摸传感器180K，也称“触控面板”。触摸传感器180K可以设置于显示屏194，由触摸传感器180K与显示屏194组成触摸屏，也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器，以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中，触摸传感器180K也可以设置于第一电子设备100的表面，与显示屏194所处的位置不同。Touch sensor 180K, also called "touch panel". The touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to touch operations may be provided through display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the first electronic device 100 , which is different from the position where the display screen 194 is located.
骨传导传感器180M可以获取振动信号。在一些实施例中，骨传导传感器180M可以获取人体声部振动骨块的振动信号。骨传导传感器180M也可以接触人体脉搏，接收血压跳动信号。在一些实施例中，骨传导传感器180M也可以设置于耳机中，结合成骨传导耳机。音 频模块170可以基于所述骨传导传感器180M获取的声部振动骨块的振动信号，解析出语音信号，实现语音功能。应用处理器可以基于所述骨传导传感器180M获取的血压跳动信号解析心率信息，实现心率检测功能。The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 180M can also contact the pulse of the human body and receive the blood pressure beating signal. In some embodiments, the bone conduction sensor 180M can also be disposed in the earphone, combined with the bone conduction earphone. The audio module 170 can analyze the voice signal based on the vibration signal of the vocal vibration bone block obtained by the bone conduction sensor 180M, and realize the voice function. The application processor can analyze the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M, and realize the function of heart rate detection.
按键190包括开机键，音量键等。第一电子设备100可以接收按键输入，产生与第一电子设备100的用户设置以及功能控制有关的键信号输入。The keys 190 include a power-on key, a volume key, and the like. The first electronic device 100 may receive key input, and generate key signal input related to user settings and function control of the first electronic device 100 .
马达191可以产生振动提示。Motor 191 can generate vibrating cues.
指示器192可以是指示灯，可以用于指示充电状态，电量变化，也可以用于指示消息，未接来电，通知等。The indicator 192 can be an indicator light, which can be used to indicate the charging state, the change of the power, and can also be used to indicate a message, a missed call, a notification, and the like.
SIM卡接口195用于连接SIM卡。SIM卡可以通过***SIM卡接口195，或从SIM卡接口195拔出，实现和第一电子设备100的接触和分离。第一电子设备100可以支持1个或N个SIM卡接口，N为大于1的正整数。在一些实施例中，第一电子设备100采用eSIM，即：嵌入式SIM卡。eSIM卡可以嵌在第一电子设备100中，不能和第一电子设备100分离。The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact with and separation from the first electronic device 100 . The first electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. In some embodiments, the first electronic device 100 employs an eSIM, ie an embedded SIM card. The eSIM card can be embedded in the first electronic device 100 and cannot be separated from the first electronic device 100 .
第二电子设备200的结构可以参考图1所示的第一电子设备100的结构示意图，本申请实施例对此不作赘述。For the structure of the second electronic device 200 , reference may be made to the schematic structural diagram of the first electronic device 100 shown in FIG. 1 , which is not repeated in this embodiment of the present application.
在本申请的后续实施例中，以第一电子设备100为手机、第二电子设备200为手环来具体介绍本申请提供的睡眠监测方法。In the subsequent embodiments of the present application, the sleep monitoring method provided by the present application is specifically introduced by taking the first electronic device 100 as a mobile phone and the second electronic device 200 as a wristband.
图2示例性示出了本申请涉及的一种睡眠监测的场景。FIG. 2 exemplarily shows a sleep monitoring scenario involved in the present application.
如图2所示，第一用户佩带有手环200。第一用户躺在床上保持固定姿势使用手机100。手环200可以根据加速度传感器、心率传感器等传感器采集到的数据，利用睡眠模型预判出第一用户已进入睡眠状态。手环200可以请求手机100进一步确认第一用户是否进入睡眠状态。手机100可以通过判断第一用户是否在使用手机100来确认第一用户是否进入睡眠状态。若确定第一用户在使用手机100，手机100可以向手环200发送消息，指示第一用户在使用手机100。当接收到该消息，手环200可以确定第一用户未进入睡眠状态。若确定第一用户未使用手机100，手机100可以向手环发送消息，指示第一用户未使用手机100。当接收到该消息，手环200可以确定第一用户已进入睡眠状态。As shown in FIG. 2 , the first user wears the bracelet 200 . The first user uses the mobile phone 100 while lying on the bed and maintaining a fixed posture. The bracelet 200 can use a sleep model to predict that the first user has entered a sleep state according to data collected by sensors such as an acceleration sensor and a heart rate sensor. The bracelet 200 may request the mobile phone 100 to further confirm whether the first user enters the sleep state. The mobile phone 100 can confirm whether the first user enters the sleep state by judging whether the first user is using the mobile phone 100 . If it is determined that the first user is using the mobile phone 100 , the mobile phone 100 may send a message to the bracelet 200 to indicate that the first user is using the mobile phone 100 . When receiving the message, the bracelet 200 may determine that the first user has not entered a sleep state. If it is determined that the first user does not use the mobile phone 100 , the mobile phone 100 may send a message to the bracelet, indicating that the first user does not use the mobile phone 100 . When receiving the message, the bracelet 200 can determine that the first user has entered a sleep state.
其中，手机100可以监测自己是否处于静止状态、在预设时间内是否监测到作用于手机100的用户操作、监测第一用户的人眼是否注视手机100的屏幕，来判断第一用户是否使用手机100。The mobile phone 100 can determine whether the first user uses the mobile phone by monitoring whether the mobile phone 100 is in a stationary state, whether it detects user operations acting on the mobile phone 100 within a preset time, and whether the first user's eyes are looking at the screen of the mobile phone 100 100.
示例性的，手机100可以通过加速度传感器、陀螺仪传感器采集到的数据来判断自己是否处于静止状态。若确定自己处于非静止状态(即手机100的姿态发生改变)，手机100可以确定有用户在使用手机100。进一步的，手机100可以判断使用手机100的用户是否是第一用户。Exemplarily, the mobile phone 100 can determine whether it is in a stationary state by using the data collected by the acceleration sensor and the gyroscope sensor. If it is determined that it is in a non-stationary state (that is, the posture of the mobile phone 100 changes), the mobile phone 100 can determine that a user is using the mobile phone 100 . Further, the mobile phone 100 can determine whether the user using the mobile phone 100 is the first user.
若确定自己处于静止状态，手机100可以监测预设时间内是否有作用于手机100的用户操作。这可以减少手机100处于静止状态，但仍被用户使用的场景对用户是否进入睡眠状态的误判。若在预设时间内监测到用户操作，手机100可以确定有用户在使用手机100。进一步的，手机100可以判断使用手机100的用户是否是第一用户。本申请实施例对上述预设时间的长度不作限定。If it is determined that the mobile phone 100 is in a stationary state, the mobile phone 100 can monitor whether there is a user operation acting on the mobile phone 100 within a preset time. This can reduce the misjudgment of whether the user is in a sleep state when the mobile phone 100 is in a stationary state but is still being used by the user. If the user operation is monitored within the preset time, the mobile phone 100 may determine that a user is using the mobile phone 100 . Further, the mobile phone 100 can determine whether the user using the mobile phone 100 is the first user. This embodiment of the present application does not limit the length of the foregoing preset time.
若在预设时间内未监测到用户操作，手机100可以监测是否有人眼注视手机100的屏幕。这可以减少手机处于静止状态且预设时间内无用户操作，但仍被用户使用的场景(例如手机处于静止状态播放视频的场景)对用户是否进入睡眠状态的误判。若有人眼注视手机100的 屏幕，手机100可以判断注视屏幕的用户是否是第一用户。若没有人眼注视手机100的屏幕或者注视手机100的屏幕的用户不是第一用户，手机100可以判断出第一用户未使用手机100。If no user operation is detected within the preset time, the mobile phone 100 can monitor whether human eyes are watching the screen of the mobile phone 100 . This can reduce the misjudgment of whether the user is in a sleep state when the mobile phone is in a stationary state and there is no user operation for a preset period of time, but is still used by the user (for example, a scene where the mobile phone is in a stationary state to play a video). If a human eye looks at the screen of the mobile phone 100, the mobile phone 100 can determine whether the user looking at the screen is the first user. If no human eyes look at the screen of the mobile phone 100 or the user looking at the screen of the mobile phone 100 is not the first user, the mobile phone 100 can determine that the first user does not use the mobile phone 100 .
上述手环200利用睡眠模型预判第一用户是否进入睡眠状态的实现方法、手机100判断使用手机100的用户是否是第一用户的实现方法将在后续实施例中具体介绍，这里先不展开说明。The above-mentioned implementation method of the bracelet 200 using the sleep model to predict whether the first user enters the sleep state, and the implementation method of the mobile phone 100 to determine whether the user using the mobile phone 100 is the first user will be described in detail in the subsequent embodiments, and will not be described here first. .
在本申请实施例中，手机100和手环200具有绑定关系。In this embodiment of the present application, the mobile phone 100 and the bracelet 200 have a binding relationship.
在一种可能的实现方式中，手机100和手环200可以通过蓝牙配对的方式建立绑定关系。其中，手机100可以将手环200标记为手机100的机主所佩戴的收手环。例如，手机100可以在存储手环200的蓝牙地址时，为手环200增加机主标签。当接收到来自手环200用于确定第一用户是否进入睡眠状态的请求时，手机100可以检测第一用户是否在使用手机100。当接收到不具有机主标签的手环发送的用于确定用户是否进入睡眠状态的请求时，手机100可以不处理该请求。In a possible implementation manner, the mobile phone 100 and the bracelet 200 may establish a binding relationship through Bluetooth pairing. The mobile phone 100 may mark the bracelet 200 as a receiving bracelet worn by the owner of the mobile phone 100 . For example, the mobile phone 100 may add an owner tag to the bracelet 200 when storing the Bluetooth address of the bracelet 200 . When receiving a request from the bracelet 200 for determining whether the first user enters a sleep state, the mobile phone 100 can detect whether the first user is using the mobile phone 100 . When receiving a request sent by a bracelet without an owner tag for determining whether the user enters a sleep state, the mobile phone 100 may not process the request.
在另一种可能的实现方式中，响应于第一用户操作，手机100可以与手环200建立绑定关系。该第一用户操作可用于指示手机100的机主与佩带手环200的用户是同一个用户。具体的，手机100可以管理与自己建立有通信连接的手环。手机100中用于管理手环的设置选项中可包括睡眠辅助功能。响应于上述第一用户操作，手机100可以开启用于管理手环200的设置选项中的睡眠辅助功能。当上述睡眠辅助功能开启，手环200在预判出佩带有手环200的用户进入睡眠状态后，可以请求手机100进一步确认手机100的机主是否进入睡眠状态。In another possible implementation manner, in response to the first user operation, the mobile phone 100 may establish a binding relationship with the bracelet 200 . The first user operation may be used to indicate that the owner of the mobile phone 100 and the user wearing the bracelet 200 are the same user. Specifically, the mobile phone 100 can manage the bracelets that have established a communication connection with itself. The setting options for managing the bracelet in the mobile phone 100 may include a sleep assist function. In response to the above-mentioned first user operation, the mobile phone 100 can enable the sleep assist function in the setting options for managing the bracelet 200 . When the above sleep assist function is enabled, the bracelet 200 may request the mobile phone 100 to further confirm whether the owner of the mobile phone 100 is in the sleep state after prejudging that the user wearing the bracelet 200 has entered the sleep state.
在另一种可能的实现方式中，手机100和手环200可以通过关联同一个账号(例如，华为账号)建立绑定关系。即手机100和手环200上登录的账号为同一个账号。由于手机100和手环200具有绑定关系，手机100可以通过判断机主(即第一用户)是否在使用手机来辅助手环200监测佩带有手环200的用户(即第一用户)是否进入睡眠状态。这样可以减少手机100的使用者与佩带有手环200的用户不是同一个人对用户是否进入睡眠状态的误判。In another possible implementation manner, the mobile phone 100 and the bracelet 200 may establish a binding relationship by associating with the same account (for example, a Huawei account). That is, the accounts logged in the mobile phone 100 and the bracelet 200 are the same account. Since the mobile phone 100 and the bracelet 200 have a binding relationship, the mobile phone 100 can assist the bracelet 200 to monitor whether the user wearing the bracelet 200 (ie the first user) has entered by judging whether the owner (ie, the first user) is using the mobile phone. sleep state. This can reduce the misjudgment that the user of the mobile phone 100 and the user wearing the bracelet 200 are not the same person as to whether the user enters the sleep state.
本申请实施例对手机100和手环200建立绑定关系的方式不作限定。The embodiments of the present application do not limit the manner in which the mobile phone 100 and the bracelet 200 establish a binding relationship.
由于本申请涉及神经网络的应用，为了便于理解，下面对本申请实施例可能涉及的神经网络的相关术语进行介绍。Since the present application relates to the application of neural networks, for ease of understanding, the following describes terms related to neural networks that may be involved in the embodiments of the present application.
1、神经网络1. Neural network
神经网络可以是由神经单元组成的，神经单元可以是指以x s和截距1为输入的运算单元，该运算单元的输出可以参考下述公式(1)： A neural network can be composed of neural units, and a neural unit can refer to an operation unit that takes x s and an intercept 1 as inputs, and the output of the operation unit can refer to the following formula (1):
Figure PCTCN2021137461-appb-000001
Figure PCTCN2021137461-appb-000001
其中，s＝1、2、……、n，n为大于1的自然数，W s为x s的权重，b为神经单元的偏置。f为神经单元的激活函数(activation functions)，用于将非线性特性引入神经网络中，来将神经单元中的输入信号转换为输出信号。该激活函数的输出信号可以作为下一层卷积层的输入。激活函数可以是sigmoid函数。神经网络是将许多个上述单一的神经单元联结在一起形成的网络，即一个神经单元的输出可以是另一个神经单元的输入。每个神经单元的输入可以与前一层的局部接受域相连，来提取局部接受域的特征，局部接受域可以是由若干个神经单元组成的区域。 Among them, s=1, 2, ..., n, n is a natural number greater than 1, W s is the weight of x s , and b is the bias of the neural unit. f is an activation function of the neural unit, which is used to introduce nonlinear characteristics into the neural network to convert the input signal in the neural unit into an output signal. The output signal of this activation function can be used as the input of the next convolutional layer. The activation function can be a sigmoid function. A neural network is a network formed by connecting many of the above single neural units together, that is, the output of one neural unit can be the input of another neural unit. The input of each neural unit can be connected with the local receptive field of the previous layer to extract the features of the local receptive field, and the local receptive field can be an area composed of several neural units.
2、损失函数2. Loss function
在训练神经网络的过程中，因为希望神经网络的输出尽可能的接近真正想要预测的值，所以可以通过比较当前网络的预测值和真正想要的目标值，再根据两者之间的差异情况来更新每一层神经网络的权重向量(当然，在第一次更新之前通常会有初始化的过程，即为神经网络中的各层预先配置参数)，比如，如果网络的预测值高了，就调整权重向量让它预测低一些，不断的调整，直到神经网络能够预测出真正想要的目标值或与真正想要的目标值非常接近的值。因此，就需要预先定义“如何比较预测值和目标值之间的差异”，这便是损失函数(loss function)或目标函数(objective function)，它们是用于衡量预测值和目标值的差异的重要方程。其中，以损失函数举例，损失函数的输出值(loss)越高表示差异越大，那么神经网络的训练就变成了尽可能缩小这个loss的过程。In the process of training the neural network, because it is hoped that the output of the neural network is as close as possible to the value that you really want to predict, you can compare the predicted value of the current network with the target value you really want, and then based on the difference between the two to update the weight vector of each layer of the neural network (of course, there is usually an initialization process before the first update, that is, to pre-configure parameters for each layer in the neural network), for example, if the predicted value of the network is high, Just adjust the weight vector to make its prediction lower, and keep adjusting until the neural network can predict the real desired target value or a value that is very close to the real desired target value. Therefore, it is necessary to pre-define "how to compare the difference between the predicted value and the target value", which is the loss function (loss function) or objective function (objective function), which are used to measure the difference between the predicted value and the target value. important equation. Among them, taking the loss function as an example, the higher the output value of the loss function (loss), the greater the difference, then the training of the neural network becomes the process of reducing the loss as much as possible.
3、反向传播算法3. Back propagation algorithm
卷积神经网络可以采用误差反向传播(back propagation，BP)算法在训练过程中修正初始的超分辨率模型中参数的大小，使得超分辨率模型的重建误差损失越来越小。具体地，前向传递输入信号直至输出会产生误差损失，通过反向传播误差损失信息来更新初始的超分辨率模型中参数，从而使误差损失收敛。反向传播算法是以误差损失为主导的反向传播运动，旨在得到最优的超分辨率模型的参数，例如权重矩阵。The convolutional neural network can use the error back propagation (BP) algorithm to correct the size of the parameters in the initial super-resolution model during the training process, so that the reconstruction error loss of the super-resolution model becomes smaller and smaller. Specifically, forwarding the input signal until the output will generate an error loss, and updating the parameters in the initial super-resolution model by back-propagating the error loss information, so that the error loss converges. The back-propagation algorithm is a back-propagation motion dominated by the error loss, aiming to obtain the parameters of the optimal super-resolution model, such as the weight matrix.
下面具体介绍本申请实施例提供的一种睡眠监测方法。The following specifically describes a sleep monitoring method provided by an embodiment of the present application.
图3示例性示出了本申请实施例提供的一种睡眠监测方法的流程图。如图3所示，该方法可包括步骤S101～S108。其中：FIG. 3 exemplarily shows a flowchart of a sleep monitoring method provided by an embodiment of the present application. As shown in FIG. 3, the method may include steps S101-S108. in:
S101、手环200利用睡眠模型预判出第一用户进入睡眠状态。S101. The bracelet 200 uses a sleep model to predict that the first user enters a sleep state.
该睡眠模型可以是训练好的神经网络模型。The sleep model may be a trained neural network model.
在一些实施例中，手环200可以通过加速度传感器实时采集加速度数据，并通过心率传感器实时采集第一用户的心率数据。基于上述加速度数据和心率数据，手环200可以利用该睡眠模型来预判第一用户是否进入睡眠状态。其中，在用户处于睡眠状态时，手环200在一定时间段内通常姿态变化量较小或者甚至姿态保持不变。手环200佩带于用户上保持静止状态和放置于桌面上保持静止状态时手环200的姿态是不同的。并且，用户进入睡眠状态后心率通常会逐渐下降。因此，结合手环200检测到的加速度数据和心率数据，手环200可以对用户是否进入睡眠状态进行预判。In some embodiments, the bracelet 200 can collect acceleration data in real time through an acceleration sensor, and collect heart rate data of the first user through a heart rate sensor in real time. Based on the above acceleration data and heart rate data, the bracelet 200 can use the sleep model to predict whether the first user enters a sleep state. Wherein, when the user is in a sleep state, the wristband 200 usually has a small change in posture within a certain period of time, or even the posture remains unchanged. The posture of the wristband 200 is different when the wristband 200 is worn on the user and remains in a stationary state and when the wristband 200 is placed on a desktop and remains in a stationary state. Also, the heart rate usually drops gradually after the user goes to sleep. Therefore, in combination with the acceleration data and the heart rate data detected by the bracelet 200, the bracelet 200 can predict whether the user enters a sleep state.
用于训练该睡眠模型的训练数据可包括用户实际处于睡眠状态下手环200的加速度数据和心率数据以及用户实际处于非睡眠状态下手环200的加速度数据和心率数据。这些数据可以是通过大数据收集得到的。即这些数据可以是一般用户在佩带手环200时处于睡眠状态下的加速度数据和心率数据以及处于非睡眠状态下的加速度数据和心率数据。或者，这些数据可以是第一用户在佩带手环200时处于睡眠状态下的加速度数据和心率数据以及处于非睡眠状态下的加速度数据和心率数据。利用第一用户的数据训练得到的睡眠模型可以更好的预判第一用户是否进入睡眠状态。The training data for training the sleep model may include acceleration data and heart rate data of the bracelet 200 when the user is actually in a sleeping state, and acceleration data and heart rate data of the bracelet 200 when the user is actually in a non-sleep state. These data can be collected through big data. That is, these data may be acceleration data and heart rate data in a sleep state and acceleration data and heart rate data in a non-sleep state when a general user wears the bracelet 200 . Alternatively, these data may be acceleration data and heart rate data in a sleep state and acceleration data and heart rate data in a non-sleep state when the first user is wearing the bracelet 200 . The sleep model trained by using the data of the first user can better predict whether the first user enters a sleep state.
经过训练的睡眠模型可以识别出第一用户实际处于睡眠状态下手环200的加速度数据和心率数据的特征，从而预判出第一用户是否进入睡眠状态。也即是说，在手环200监测到的加速度数据与用户实际处于睡眠状态下的加速度数据相符，且监测到的心率数据与用户实际处于睡眠状态下的心率数据相符的情况下，手环200可以预判出第一用户进入睡眠状态。The trained sleep model can identify the characteristics of the acceleration data and heart rate data of the bracelet 200 when the first user is actually in a sleeping state, so as to predict whether the first user is in a sleeping state. That is to say, when the acceleration data monitored by the wristband 200 is consistent with the acceleration data when the user is actually sleeping, and the monitored heart rate data is consistent with the heart rate data when the user is actually sleeping, the wristband 200 It can be predicted that the first user enters a sleep state.
在一些实施例中，手环200还可以基于陀螺仪传感器采集的角速度数据、环境光传感器采集的环境光数据、麦克风采集的环境声音数据等数据，利用睡眠模型来预判第一用户是否 进入睡眠状态。即上述睡眠模型的训练数据还可以包括角速度数据、环境光数据、环境声音数据等。In some embodiments, the bracelet 200 can also use a sleep model to predict whether the first user is sleeping based on data such as angular velocity data collected by a gyro sensor, ambient light data collected by an ambient light sensor, and ambient sound data collected by a microphone. state. That is, the training data of the sleep model may also include angular velocity data, ambient light data, ambient sound data, and the like.
本申请实施例对用于训练睡眠模型的训练数据以及训练睡眠模型的方法均不作限定。手环200预判第一用户是否进入睡眠状态的方法还可以参考现有技术中手环等电子设备判断第一用户是否进入睡眠状态的方法。The embodiments of the present application do not limit the training data used for training the sleep model and the method for training the sleep model. For the method for the wristband 200 to predict whether the first user enters the sleep state, reference may also be made to the method for judging whether the first user enters the sleep state by electronic devices such as wristbands in the prior art.
S102、手环200向手机100发送确认第一用户是否进入睡眠状态的请求。S102 , the bracelet 200 sends a request to the mobile phone 100 to confirm whether the first user is in a sleep state.
S103、手机100判断自己是否处于静止状态。S103, the mobile phone 100 determines whether it is in a stationary state.
手机100处于非静止状态可以说明有用户在使用手机100。手机100处于静止状态不能直接说明没有用户在使用手机100。例如，在用户将手机100放置于手机支架上使用手机100的场景中，手机100处于静止状态，但仍被用户使用。The fact that the mobile phone 100 is in a non-stationary state can indicate that a user is using the mobile phone 100 . The fact that the mobile phone 100 is in a stationary state cannot directly indicate that no user is using the mobile phone 100 . For example, in a scenario where the user places the mobile phone 100 on the mobile phone stand to use the mobile phone 100, the mobile phone 100 is in a stationary state, but is still used by the user.
当接收到来自手环200用于确认第一用户是否进入睡眠状态的请求，手机100可以通过加速度传感器采集的加速度数据来判断自己是否处于静止状态。When receiving a request from the bracelet 200 for confirming whether the first user is in a sleep state, the mobile phone 100 can determine whether it is in a stationary state through acceleration data collected by the acceleration sensor.
若确定自己处于静止状态，手机100可以执行下述步骤S104。If it is determined that it is in a stationary state, the mobile phone 100 may perform the following step S104.
若确定自己处于非静止状态，手机100可以执行下述步骤S106。If it is determined that it is in a non-stationary state, the mobile phone 100 may perform the following step S106.
本申请实施例手机100判断自己是否处于静止状态的方法不作限定。例如手机100还可以通过陀螺仪传感器采集的角速度数据来判断自己是否处于静止状态。The method for determining whether the mobile phone 100 is in a stationary state in this embodiment of the present application is not limited. For example, the mobile phone 100 can also determine whether it is in a stationary state through the angular velocity data collected by the gyro sensor.
手机100通过判断自己是否处于静止状态来监测第一用户是否进入睡眠状态，可以减少手机100处于静止，但仍被第一用户使用的场景对第一用户是否进入睡眠状态的误判。The mobile phone 100 monitors whether the first user is in a sleep state by judging whether it is in a stationary state, which can reduce the misjudgment of whether the first user is in a sleep state when the mobile phone 100 is in a stationary state but is still used by the first user.
S104、手机100判断在预设时间内是否监测到用户操作。S104, the mobile phone 100 determines whether a user operation is monitored within a preset time.
手机100在预设时间内监测到用户操作可以说明有用户在使用手机100。手机100在预设时间内未监测到用户操作不能直接说明没有用户在使用手机100。例如，上述预设时间的长度为10分钟，在用户将手机100放置于手机支架上观看了30分钟的视频的场景中，手机100在视频播放的过程中可能没有接收到用户操作，但仍被使用。The fact that the mobile phone 100 monitors the user operation within the preset time can indicate that a user is using the mobile phone 100 . The fact that the mobile phone 100 does not monitor the user operation within the preset time cannot directly indicate that no user is using the mobile phone 100 . For example, the length of the above-mentioned preset time is 10 minutes. In a scenario where the user places the mobile phone 100 on the mobile phone stand to watch a video for 30 minutes, the mobile phone 100 may not receive user operation during the video playback process, but is still blocked by the user. use.
上述用户操作可以例如是作用在手机100屏幕上的触摸操作，作用在手机100按键上的用户操作、语音指令的输入操作、隔空手势的输入操作等等。本申请实施例对上述用户操作的具体类型不作限定。The above-mentioned user operation may be, for example, a touch operation acting on the screen of the mobile phone 100, a user operation acting on a button of the mobile phone 100, an input operation of a voice command, an input operation of an air gesture, and the like. This embodiment of the present application does not limit the specific types of the above-mentioned user operations.
若在预设时间内未监测到用户操作，手机100可以执行下述步骤S105。If no user operation is detected within the preset time, the mobile phone 100 may perform the following step S105.
若在预设时间内监测到用户操作，手机100可以执行下述步骤S106。If the user operation is monitored within the preset time, the mobile phone 100 may perform the following step S106.
本申请实施例对上述预设时间的长度不作限定。This embodiment of the present application does not limit the length of the foregoing preset time.
在手机100处于静止状态的情况下，手机100通过判断在预设时间内是否监测到用户操作来监测第一用户是否进入睡眠状态，可以减少手机100处于静止状态且预设时间内无用户操作，但仍被第一用户使用的场景(例如手机处于静止状态播放视频的场景)对第一用户是否进入睡眠状态的误判。When the mobile phone 100 is in a stationary state, the mobile phone 100 monitors whether the first user enters a sleep state by judging whether a user operation is monitored within a preset time, which can reduce the number of times that the mobile phone 100 is in a stationary state and there is no user operation within the preset time. However, a scene still being used by the first user (eg, a scene where the mobile phone is in a still state to play a video) misjudged whether the first user has entered a sleep state.
S105、手机100判断是否有人眼注视屏幕。S105. The mobile phone 100 determines whether human eyes are watching the screen.
手机100可以通过前置摄像头采集图像。基于上述图像，手机100可以利用人眼注视识别模型来判断是否有人眼注视屏幕。The mobile phone 100 can capture images through the front camera. Based on the above image, the mobile phone 100 can use the human eye gaze recognition model to determine whether the human eye gazes at the screen.
该人眼注视识别模型可以是神经网络模型。The human eye gaze recognition model may be a neural network model.
用于训练该人眼注视识别模型的训练数据可包括人眼注视屏幕的图像数据和人眼未注视屏幕的图像数据。经过训练的人眼注视识别模型可以识别出人眼注视屏幕的图像的特征，从而判断是否有人眼注视手机100的屏幕。训练人眼注视识别模型的方法可以参考现有技术中神经网络模型的训练方法，本申请对此不作赘述。The training data for training the human eye gaze recognition model may include image data of the human eye looking at the screen and image data of the human eye not looking at the screen. The trained human eye gaze recognition model can identify the characteristics of the image in which the human eye gazes at the screen, so as to determine whether the human eye gazes at the screen of the mobile phone 100 . For the method of training the human eye gaze recognition model, reference may be made to the training method of the neural network model in the prior art, which will not be repeated in this application.
在一些实施例中，上述用于采集图像的前置摄像头可以是低功耗摄像头。例如，红外摄像头。上述低功耗摄像头可以实时处于工作状态。本申请实施例对上述前置摄像头的类型不作限定。In some embodiments, the aforementioned front-facing camera for capturing images may be a low-power camera. For example, infrared cameras. The above-mentioned low-power camera can be in a working state in real time. This embodiment of the present application does not limit the type of the above-mentioned front camera.
在一些实施例中，在确定预设时间段内没有作用于手机100的用户操作时，手机100可以开启上述前置摄像头来采集图像。或者，当接收到来自手环200用于确认第一用户是否进入睡眠状态的请求时，手机100可以开启上述前置摄像头。本申请实施例对手机100开启前置摄像头的时间不作限定。In some embodiments, when it is determined that there is no user operation acting on the mobile phone 100 within a preset time period, the mobile phone 100 can turn on the above-mentioned front camera to capture images. Alternatively, when receiving a request from the bracelet 200 for confirming whether the first user has entered a sleep state, the mobile phone 100 may turn on the aforementioned front-facing camera. The embodiment of the present application does not limit the time when the mobile phone 100 turns on the front camera.
若识别出有人眼注视屏幕，手机100可以执行下述步骤S106。If it is recognized that human eyes are watching the screen, the mobile phone 100 may perform the following step S106.
若识别出没有人眼注视屏幕，手机100可以执行下述步骤S108。If it is recognized that no human eye is watching the screen, the mobile phone 100 may perform the following step S108.
手机100通过判断是否有人眼注视屏幕来监测第一用户是否进入睡眠状态，可以减少手机100处于静止状态、在预设时间内无用户操作，但未被第一用户使用的场景(例如手机处于静止状态播放视频，但第一用户在视频播放过程中睡着的场景)对第一用户是否进入睡眠状态的误判。The mobile phone 100 monitors whether the first user is in a sleep state by judging whether human eyes are watching the screen, which can reduce the situation where the mobile phone 100 is in a stationary state, and there is no user operation within a preset time, but is not used by the first user (for example, the mobile phone is in a stationary state. The video is played in the state, but the first user falls asleep during the video playback) misjudgment of whether the first user has entered the sleep state.
S106、手机100判断手机100的使用者是否是第一用户。S106, the mobile phone 100 determines whether the user of the mobile phone 100 is the first user.
在下述任意一种情况下：手机100判断出手机100处于非静止状态、手机100判断出手机100处于静止状态但在预设时间内监测到用户操作、手机100判断出手机100处于静止状态且在预设时间内未监测到用户操作但识别出有人眼注视手机100的屏幕，手机100可以确定有用户在使用手机100。进一步的，手机100可以判断使用者是否是第一用户。In any of the following situations: the mobile phone 100 determines that the mobile phone 100 is in a non-stationary state, the mobile phone 100 determines that the mobile phone 100 is in a stationary state but monitors user operations within a preset time, and the mobile phone 100 determines that the mobile phone 100 is in a stationary state and is in a stationary state. If no user operation is detected within the preset time, but it is recognized that someone is watching the screen of the mobile phone 100 , the mobile phone 100 can determine that a user is using the mobile phone 100 . Further, the mobile phone 100 can determine whether the user is the first user.
在一种可能的实现方式中，手机100可以通过人脸识别来判断使用者是否是第一用户。In a possible implementation manner, the mobile phone 100 may determine whether the user is the first user through face recognition.
其中，手环200和手机100之间具有绑定关系。佩带手环200的第一用户即为手机100的机主。手机100可以比较通过前置摄像头采集的人脸图像与手机100已存储的机主的人脸图像，来判断手机100的使用者是否是第一用户。上述手机100已存储的机主的人脸图像可以是用于人脸识别解锁手机100的人脸图像。本申请实施例对手机100比较通过前置摄像头采集的人脸图像与手机100已存储的机主的人脸图像是否是同一用户的人脸图像的方法不作限定。Wherein, there is a binding relationship between the bracelet 200 and the mobile phone 100 . The first user wearing the bracelet 200 is the owner of the mobile phone 100 . The mobile phone 100 can compare the face image collected by the front camera with the face image of the owner stored in the mobile phone 100 to determine whether the user of the mobile phone 100 is the first user. The above-mentioned face image of the owner stored in the mobile phone 100 may be a face image used for face recognition to unlock the mobile phone 100 . The embodiment of the present application does not limit the method for the mobile phone 100 to compare whether the face image collected by the front camera and the face image of the owner stored in the mobile phone 100 are the face image of the same user.
可选的，手机100还可以通过声纹识别、指纹识别等生物特征识别的方法来判断手机100的使用者是否是第一用户。本申请实施例对判断手机100的使用者是否是第一用户的具体方法不作限定。Optionally, the mobile phone 100 may also determine whether the user of the mobile phone 100 is the first user by means of biometric identification methods such as voiceprint recognition and fingerprint recognition. This embodiment of the present application does not limit the specific method for determining whether the user of the mobile phone 100 is the first user.
若判断出手机100的使用者是第一用户，手机100可以执行下述步骤S107。If it is determined that the user of the mobile phone 100 is the first user, the mobile phone 100 may execute the following step S107.
若判断出手机100的使用者不是第一用户，手机100可以执行下述步骤S108。If it is determined that the user of the mobile phone 100 is not the first user, the mobile phone 100 may execute the following step S108.
在判断出手机100被用户使用的情况下，手机100通过识别使用者是否是第一用户来检测第一用户是否进入睡眠状态，可以减少手机100的使用者与佩带有手环200的第一用户不是同一个人对第一用户是否进入睡眠状态的误判。When it is determined that the mobile phone 100 is used by the user, the mobile phone 100 detects whether the first user enters the sleep state by identifying whether the user is the first user, which can reduce the number of users of the mobile phone 100 and the first user wearing the bracelet 200 It is not the same person's misjudgment of whether the first user has entered a sleep state.
S107、手机100向手环200发送第一判断结果，指示第一用户在使用手机100。S107 , the mobile phone 100 sends the first judgment result to the bracelet 200 , indicating that the first user is using the mobile phone 100 .
若判断出手机100被用户使用，且使用者是第一用户，手机100可以确定第一用户在使用手机100。那么，手机100可以向手环200发送第一判断结果，指示第一用户在使用手机100。If it is determined that the mobile phone 100 is used by the user and the user is the first user, the mobile phone 100 can determine that the first user is using the mobile phone 100 . Then, the mobile phone 100 may send the first judgment result to the bracelet 200 to indicate that the first user is using the mobile phone 100 .
在一些实施例中，在接收到来自手机100的第一判断结果之后，手环200可以再次利用睡眠模型预判第一用户是否进入睡眠状态，并请求手机100来确认第一用户是否进入睡眠状态。其中，在确定第一用户处于睡眠状态时，手环200可以每隔预设时间段(如5分钟等)利用睡眠模型预判第一用户是否进入睡眠状态。In some embodiments, after receiving the first judgment result from the mobile phone 100, the bracelet 200 can use the sleep model again to predict whether the first user enters the sleep state, and request the mobile phone 100 to confirm whether the first user enters the sleep state . Wherein, when it is determined that the first user is in a sleep state, the bracelet 200 can use a sleep model to predict whether the first user is in a sleep state every preset time period (eg, 5 minutes, etc.).
在一些实施例中，在接收到来自手机100的第一判断结果之后，手环200可以将监测的数据(如心率数据)记录为第一用户处于非睡眠状态下的数据。In some embodiments, after receiving the first judgment result from the mobile phone 100, the bracelet 200 may record the monitored data (such as heart rate data) as the data that the first user is in a non-sleep state.
S108、手机100向手环200发送第二判断结果，指示第一用户未使用手机100。S108 , the mobile phone 100 sends the second judgment result to the bracelet 200 , indicating that the first user does not use the mobile phone 100 .
若判断出没有人眼注视手机100的屏幕，或者判断出手机100被用户使用，但使用者不是第一用户，手机100可以确定第一用户未使用手机100。那么，手机100可以向手环200发送第二判断结果，指示第一用户未使用手机100。If it is determined that no human eye is watching the screen of the mobile phone 100 , or it is determined that the mobile phone 100 is used by the user but the user is not the first user, the mobile phone 100 may determine that the first user does not use the mobile phone 100 . Then, the mobile phone 100 can send the second judgment result to the bracelet 200, indicating that the first user does not use the mobile phone 100.
当接收到来自手机100的第二判断结果，手环200可以将接收到第二判断结果的时刻确定为第一用户进入睡眠状态的时刻。或者，手环200可以将自己预判出第一用户进入睡眠状态的时刻作为第一用户进入睡眠状态的时刻。本申请实施例对手环200确定第一用户进入睡眠状态的时刻不作特殊限定。手环200可以将第一用户进入睡眠状态时刻之后监测的数据(如心率数据)记录为第一用户处于睡眠状态下的数据。When receiving the second judgment result from the mobile phone 100, the bracelet 200 may determine the moment when the second judgment result is received as the moment when the first user enters the sleep state. Alternatively, the bracelet 200 may predetermine the moment when the first user enters the sleep state as the moment when the first user enters the sleep state. In this embodiment of the present application, the time when the wristband 200 determines that the first user enters the sleep state is not particularly limited. The bracelet 200 may record the monitored data (such as heart rate data) after the first user enters the sleep state as the data when the first user is in the sleep state.
由图3所示的睡眠监测方法可知，手环200可以利用手机100来确认第一用户是否进入睡眠状态。这可以减少在单独利用手环200监测第一用户是否进入睡眠状态的情况下，由于第一用户长时间保持固定姿势但未处于睡眠状态对第一用户是否进入睡眠状态的误判，提高第一用户进入睡眠状态的时间监测的准确率。从而，手环200可以提高睡眠质量监测的准确率。It can be known from the sleep monitoring method shown in FIG. 3 that the bracelet 200 can use the mobile phone 100 to confirm whether the first user enters the sleep state. This can reduce the misjudgment of whether the first user has entered the sleep state because the first user maintains a fixed posture for a long time but is not in the sleep state when the bracelet 200 is used alone to monitor whether the first user has entered the sleep state, and the first user can be improved. The accuracy of monitoring when the user goes to sleep. Thus, the bracelet 200 can improve the accuracy of sleep quality monitoring.
另外，手机100在确定出自己处于非静止状态后，可以直接判断手机100的使用者是否是第一用户。这样，手机100可不用执行步骤S104和步骤S105，从而节省手机100的功耗。手机100在判断出预设时间内未监测到用户操作后，可以直接判断手机100的使用者是否是第一用户。这样，手机100可不用执行步骤S105，从而节省手机100的功耗。In addition, after determining that the mobile phone 100 is in a non-stationary state, it can directly determine whether the user of the mobile phone 100 is the first user. In this way, the mobile phone 100 does not need to perform steps S104 and S105 , thereby saving the power consumption of the mobile phone 100 . After the mobile phone 100 determines that the user's operation has not been monitored within the preset time, it can directly determine whether the user of the mobile phone 100 is the first user. In this way, the mobile phone 100 does not need to perform step S105 , thereby saving the power consumption of the mobile phone 100 .
在一些实施例中，上述步骤S103和步骤S104的执行顺序可以调换。即在接收到来自手环200用于确认第一用户是否进入睡眠状态的请求后，手机100可以先判断在预设时间内是否有用户操作。若判断出在预设时间内有用户操作，手机100可以执行步骤S106。若判断出在预设时间内没有用户操作，手机100可以进一步判断自己是否处于静止状态。若判断出自己处于静止状态，手机100可以执行步骤S105。若判断出自己处于非静止状态，手机100可以执行步骤S106。In some embodiments, the execution order of the above steps S103 and S104 may be reversed. That is, after receiving the request from the bracelet 200 for confirming whether the first user enters the sleep state, the mobile phone 100 may first determine whether there is a user operation within the preset time. If it is determined that there is a user operation within the preset time, the mobile phone 100 may perform step S106. If it is determined that there is no user operation within the preset time, the mobile phone 100 can further determine whether it is in a stationary state. If it is determined that it is in a stationary state, the mobile phone 100 may execute step S105. If it is determined that it is in a non-stationary state, the mobile phone 100 may execute step S106.
在另一些实施例中，在接收到来自手环200用于确认第一用户是否进入睡眠状态的请求后，手机100可以同时执行上述步骤S103、上述步骤S104、上述步骤S105，来判断手机100是否被用户使用。若判断出手机100被用户使用，手机100可以进一步执行步骤S106来判断使用者是否是第一用户。否则，手机100可以执行步骤S108来指示手环200第一用户进入睡眠状态。In some other embodiments, after receiving a request from the bracelet 200 for confirming whether the first user is in a sleep state, the mobile phone 100 can simultaneously execute the above steps S103, S104, and S105 to determine whether the mobile phone 100 is in the sleep state. used by users. If it is determined that the mobile phone 100 is used by the user, the mobile phone 100 may further perform step S106 to determine whether the user is the first user. Otherwise, the mobile phone 100 may execute step S108 to instruct the first user of the bracelet 200 to enter the sleep state.
图4示例性示出了本申请实施例提供的另一种睡眠监测方法的流程图。FIG. 4 exemplarily shows a flowchart of another sleep monitoring method provided by an embodiment of the present application.
如图4所示，该方法可包括步骤S201～S207。其中：As shown in FIG. 4, the method may include steps S201-S207. in:
S201、手环200利用睡眠模型预判出第一用户进入睡眠状态。S201. The bracelet 200 uses the sleep model to predict that the first user enters the sleep state.
S202、手环200向手机100发送确认第一用户是否进入睡眠状态的请求。S202 , the bracelet 200 sends a request to the mobile phone 100 to confirm whether the first user enters the sleep state.
上述步骤S201和步骤S202可以分别参考图3所示方法中的步骤S101和步骤S102。The above steps S201 and S202 may refer to steps S101 and S102 in the method shown in FIG. 3 , respectively.
S203、手机100判断自己是否处于静止状态。S203, the mobile phone 100 determines whether it is in a stationary state.
手机100判断自己是否处于静止状态的方法可以参考图3所示方法中的步骤S203。For the method for determining whether the mobile phone 100 is in a stationary state, reference may be made to step S203 in the method shown in FIG. 3 .
其中，当判断出自己处于静止状态，手机100可以执行步骤S204。即手机100可以判断是否有人眼注视屏幕。Wherein, when it is determined that it is in a stationary state, the mobile phone 100 may execute step S204. That is, the mobile phone 100 can determine whether human eyes are watching the screen.
当判断出自己处于非静止状态，手机100可以执行步骤S205。When it is determined that it is in a non-stationary state, the mobile phone 100 may execute step S205.
S204、手机100判断是否有人眼注视屏幕。S204, the mobile phone 100 determines whether human eyes are watching the screen.
S205、手机100判断手机100的使用者是否是第一用户。S205, the mobile phone 100 determines whether the user of the mobile phone 100 is the first user.
S206、手机100向手环200发送第一判断结果，指示第一用户在使用手机100。S206 , the mobile phone 100 sends the first judgment result to the bracelet 200 , indicating that the first user is using the mobile phone 100 .
S207、手机100向手环200发送第二判断结果，指示第一用户未使用手机100。S207 , the mobile phone 100 sends the second judgment result to the bracelet 200 , indicating that the first user does not use the mobile phone 100 .
上述步骤S204～步骤S207可以参考图3所示方法中的步骤S105～步骤S108，这里不再赘述。For the above steps S204 to S207, reference may be made to steps S105 to S108 in the method shown in FIG. 3 , which will not be repeated here.
图5示例性示出了本申请实施例提供的另一种睡眠监测方法的流程图。FIG. 5 exemplarily shows a flowchart of another sleep monitoring method provided by an embodiment of the present application.
如图5所示，该方法可包括步骤S301～S307。其中：As shown in FIG. 5, the method may include steps S301-S307. in:
S301、手环200利用睡眠模型预判出第一用户进入睡眠状态。S301. The bracelet 200 uses the sleep model to predict that the first user enters the sleep state.
S302、手环200向手机100发送确认第一用户是否进入睡眠状态的请求。S302 , the bracelet 200 sends a request to the mobile phone 100 to confirm whether the first user enters the sleep state.
上述步骤S301和步骤S302可以分别参考图3所示方法中的步骤S101和步骤S102。The above steps S301 and S302 may refer to steps S101 and S102 in the method shown in FIG. 3 , respectively.
S303、手机100判断在预设时间内是否监测到用户操作。S303. The mobile phone 100 determines whether a user operation is monitored within a preset time.
手机100判断在预设时间内是否监测到用户操作的方法可以参考图3所示方法中的步骤S204。For the method for the mobile phone 100 to determine whether the user operation is monitored within the preset time, reference may be made to step S204 in the method shown in FIG. 3 .
其中，当判断出在预设时间内未监测到用户操作，手机100可以执行步骤S304。即手机100可以判断是否有人眼注视屏幕。Wherein, when it is determined that the user operation is not monitored within the preset time, the mobile phone 100 may perform step S304. That is, the mobile phone 100 can determine whether human eyes are watching the screen.
当判断出在预设时间内监测到用户操作，手机100可以执行步骤S305。When it is determined that the user operation is monitored within the preset time, the mobile phone 100 may perform step S305.
S304、手机100判断是否有人眼注视屏幕。S304, the mobile phone 100 determines whether human eyes are watching the screen.
S305、手机100判断手机100的使用者是否是第一用户。S305, the mobile phone 100 determines whether the user of the mobile phone 100 is the first user.
S306、手机100向手环200发送第一判断结果，指示第一用户在使用手机100。S306 , the mobile phone 100 sends the first judgment result to the bracelet 200 , indicating that the first user is using the mobile phone 100 .
S307、手机100向手环200发送第二判断结果，指示第一用户未使用手机100。S307 , the mobile phone 100 sends the second judgment result to the bracelet 200 , indicating that the first user does not use the mobile phone 100 .
上述步骤S304～步骤S307可以参考图3所示方法中的步骤S105～步骤S108，这里不再赘述。For the above steps S304 to S307, reference may be made to steps S105 to S108 in the method shown in FIG. 3 , which will not be repeated here.
图6示例性示出了本申请实施例提供的另一种睡眠监测方法的流程图。FIG. 6 exemplarily shows a flowchart of another sleep monitoring method provided by an embodiment of the present application.
如图6所示，该方法可包括步骤S401～S406。其中：As shown in FIG. 6, the method may include steps S401-S406. in:
S401、手环200利用睡眠模型预判出第一用户进入睡眠状态。S401. The bracelet 200 uses the sleep model to predict that the first user enters the sleep state.
S402、手环200向手机100发送确认第一用户是否进入睡眠状态的请求。S402 , the bracelet 200 sends a request to the mobile phone 100 to confirm whether the first user is in a sleep state.
上述步骤S401和步骤S402可以分别参考图3所示方法中的步骤S101和步骤S102。The above steps S401 and S402 may refer to steps S101 and S102 in the method shown in FIG. 3 , respectively.
S403、手机100判断是否有人眼注视屏幕。S403, the mobile phone 100 determines whether human eyes are watching the screen.
S404、手机100判断手机100的使用者是否是第一用户。S404, the mobile phone 100 determines whether the user of the mobile phone 100 is the first user.
S405、手机100向手环200发送第一判断结果，指示第一用户在使用手机100。S405 , the mobile phone 100 sends the first judgment result to the bracelet 200 , indicating that the first user is using the mobile phone 100 .
S406、手机100向手环200发送第二判断结果，指示第一用户未使用手机100。S406 , the mobile phone 100 sends the second judgment result to the bracelet 200 , indicating that the first user does not use the mobile phone 100 .
上述步骤S403～步骤S406可以参考图3所示方法中的步骤S105～步骤S108，这里不再赘述。For the above steps S403 to S406, reference may be made to steps S105 to S108 in the method shown in FIG. 3 , and details are not repeated here.
在一些实施例中，当接收到来自手环200用于确定第一用户是否进入睡眠状态的请求，手机100可以监测自己是否运行有投屏的应用程序。手机100运行有投屏的应用程序可以说明有用户在使用手机100。当监测到自己运行有投屏的应用程序，手机100可以检测手机100 的使用者是否是第一用户。在一种可能的实现方式中，手机100可以向投屏设备，例如电视，发送采集图像的消息。当接收到上述用户采集图像的消息，投屏设备可以采集观看投屏设备区域的图像，并将该图像发送给手机100。手机100可以判断来自投屏设备的图像中是否包含第一用户的人脸图像。In some embodiments, when receiving a request from the bracelet 200 for determining whether the first user enters a sleep state, the mobile phone 100 can monitor whether it is running a screen-casting application. The fact that the mobile phone 100 runs a screen-casting application can indicate that a user is using the mobile phone 100 . When monitoring that it is running an application with screen projection, the mobile phone 100 can detect whether the user of the mobile phone 100 is the first user. In a possible implementation manner, the mobile phone 100 may send a message for capturing images to a screen projection device, such as a TV. When receiving the above-mentioned message from the user for capturing an image, the screen projection device may capture and view an image of the area of the screen projection device, and send the image to the mobile phone 100 . The mobile phone 100 can determine whether the image from the screen projection device includes the face image of the first user.
投屏设备采集的图像中包含第一用户的人脸图像可以说明第一用户通过手机100投屏，并观看投屏设备上播放的内容。也即是说，第一用户未进入睡眠状态。当判断出投屏设备采集的图像中包含第一用户的人脸图像，手机100可以向手环200发送前述实施例中的第一判断结果，指示第一用户在使用手机100。The fact that the image collected by the screen-casting device includes the face image of the first user may indicate that the first user casts the screen through the mobile phone 100 and watches the content played on the screen-casting device. That is, the first user is not in a sleep state. When it is determined that the image collected by the screen projection device includes the face image of the first user, the mobile phone 100 may send the first judgment result in the foregoing embodiment to the bracelet 200 , indicating that the first user is using the mobile phone 100 .
投屏设备采集的图像中不包含第一用户的人脸图像可以说明使用手机100投屏并观看投屏设备上播放的内容的用户中不包含第一用户。当判断出投屏设备采集的图像中不包含第一用户的人脸图像，手机100可以向手环200发送前述实施例中的第二判断结果，指示第一用户未使用手机100。The fact that the image collected by the screen projection device does not include the face image of the first user may indicate that the users who use the mobile phone 100 to project the screen and watch the content played on the screen projection device do not include the first user. When it is determined that the image collected by the screen projection device does not contain the face image of the first user, the mobile phone 100 may send the second judgment result in the foregoing embodiment to the bracelet 200, indicating that the first user does not use the mobile phone 100.
在手机100投屏的应用场景中，手机100可能监测到自己处于静止状态、在预设时间内没有用户操作且没有人眼注视。但第一用户并未进入睡眠状态，而是在观看投屏设备。上述方法可以监测手机100是否运行有投屏的应用程序，并在运行有投屏的应用程序的情况下借助投屏设备采集的图像来监测第一用户是否进入睡眠状态。这可以减少手机100处于静止状态、在预设时间内没有用户操作且没有人眼注视，但仍被第一用户使用对第一用户是否进入睡眠状态的误判。In an application scenario in which the mobile phone 100 projects a screen, the mobile phone 100 may detect that it is in a stationary state, there is no user operation within a preset time, and no human eyes are watching. However, the first user did not go to sleep, but was watching the screen-casting device. The above method can monitor whether the mobile phone 100 is running a screen-casting application, and monitor whether the first user enters a sleep state by using images collected by the screen-casting device when the screen-casting application is running. This can reduce the misjudgment by the first user that the mobile phone 100 is in a stationary state, has no user operation within a preset time, and has no human eyes, but is still used by the first user to determine whether the first user is in a sleep state.
在一些实施例中，当接收到来自手环200用于确定第一用户是否进入睡眠状态的请求，手机100可以请求其它具有图像采集装置(如摄像头)的电子设备，例如电视，进行图像采集。当得到具有图像采集装置的电子设备采集的图像，手机100可以判断图像中是否包含第一用户并确定第一用户的状态。这样，手机100可以监测出第一用户是否进入睡眠状态，并将监测结果发送给手环200。In some embodiments, when receiving a request from the bracelet 200 for determining whether the first user is in a sleep state, the mobile phone 100 may request other electronic devices having an image capturing device (eg, a camera), such as a TV, to perform image capturing. When an image captured by an electronic device having an image capturing device is obtained, the mobile phone 100 can determine whether the image contains the first user and determine the state of the first user. In this way, the mobile phone 100 can monitor whether the first user enters the sleep state, and send the monitoring result to the bracelet 200 .
示例性的，手机100可以向电视发送采集图像的消息。电视可以将通过摄像头采集的图像发送给手机100。电视通过摄像头采集的图像中包含第一用户的人脸图像可以说明第一用户在观看电视。即第一用户为进入睡眠状态。若手机100确定出来自电视的图像中包含第一用户的人脸图像，手机100可以向手环200发送前述实施例中的第一判断结果，指示第一用户在使用手机100。Exemplarily, the mobile phone 100 may send a message for capturing images to the TV. The TV can send the images captured by the camera to the mobile phone 100 . The fact that the image collected by the television through the camera includes the face image of the first user may indicate that the first user is watching the television. That is, the first user enters the sleep state. If the mobile phone 100 determines that the image from the TV contains the face image of the first user, the mobile phone 100 can send the first judgment result in the foregoing embodiment to the bracelet 200 to indicate that the first user is using the mobile phone 100 .
本申请实施例对手机100与电视等具有图像采集装置的电子设备建立通信连接的方式不作限定。上述通信连接方式可以例如是蓝牙连接、Wi-Fi网络连接等等。The embodiments of the present application do not limit the manner in which the mobile phone 100 establishes a communication connection with an electronic device having an image acquisition device, such as a television. The above-mentioned communication connection manner may be, for example, a Bluetooth connection, a Wi-Fi network connection, or the like.
在一些实施例中，手环200可以其他具有图像采集装置的电子设备建立通信连接。当预判出第一用户进入睡眠状态，手环200可以向具有图像采集装置的电子设备发送采集图像的消息。具有图像采集装置的电子设备可以将采集得到的图像发送给手环200。手环200可以根据这些图像来确定第一用户的状态，以判断第一用户是否进入睡眠状态。或者，手环200可以将这些图像发送给与自己建立有通信连接的电子设备中处理能力较强的电子设备，例如手机100。手机100可以根据接收到的图像确定第一用户的状态，从而判断第一用户是否进入睡眠状态。In some embodiments, the bracelet 200 can establish a communication connection with other electronic devices having image capturing devices. When it is pre-determined that the first user enters the sleep state, the bracelet 200 may send a message for capturing an image to the electronic device having the image capturing device. The electronic device with the image acquisition device can send the acquired image to the bracelet 200 . The bracelet 200 can determine the state of the first user according to these images to determine whether the first user has entered a sleep state. Alternatively, the bracelet 200 can send these images to an electronic device with strong processing capability, such as the mobile phone 100 , among the electronic devices that have established a communication connection with itself. The mobile phone 100 can determine the state of the first user according to the received image, so as to determine whether the first user has entered a sleep state.
本申请实施例对手环200与具有图像采集装置的电子设备建立通信连接的方式不作限定。The manner in which the bracelet 200 establishes a communication connection with an electronic device having an image acquisition device in this embodiment of the present application is not limited.
在一些实施例中，手环200可以借助手机100来判断第一用户是否退出睡眠状态(即第一用户醒来)。In some embodiments, the bracelet 200 can use the mobile phone 100 to determine whether the first user exits the sleep state (ie, the first user wakes up).
具体的，手机100可以在第二时间段内首次监测到解锁手机100的用户操作时，向手环200发送用于指示第一用户退出睡眠状态的消息。当接收到上述用于指示第一用户退出睡眠状态的消息，手环200可以将上述监测到解锁手机100的用户操作的时刻确定为第一用户退出睡眠状态的时刻。结合前述实施例中睡眠监测方法所确定的第一用户进入睡眠状态的时刻，手环200可以确定出第一用户处于睡眠状态的总时长，并评估第一用户从进入睡眠状态到退出睡眠状态这一时间段内的睡眠质量。Specifically, the mobile phone 100 may send a message to the bracelet 200 for instructing the first user to exit the sleep state when monitoring the user operation of unlocking the mobile phone 100 for the first time within the second time period. When receiving the above-mentioned message for instructing the first user to exit the sleep state, the bracelet 200 may determine the time when the user operation of unlocking the mobile phone 100 is detected as the time when the first user exits the sleep state. Combined with the moment when the first user enters the sleep state determined by the sleep monitoring method in the foregoing embodiment, the bracelet 200 can determine the total duration of the first user being in the sleep state, and evaluate the duration of the first user from entering the sleep state to exiting the sleep state. Sleep quality over time.
特别的，上述解锁的方法可以是利用生物特征信息进行解锁的方法。该生物特征信息可以例如是人脸信息、声纹信息、指纹信息等等。当监测到上述生物特征信息属于第一用户的生物特征信息，手机100可以确定解锁的用户为第一用户。In particular, the above unlocking method may be a method for unlocking by using biometric information. The biometric information may be, for example, face information, voiceprint information, fingerprint information, and the like. When monitoring that the above-mentioned biometric information belongs to the biometric information of the first user, the mobile phone 100 may determine that the unlocked user is the first user.
上述第二时间段可以是手机100向手环200发送用于指示第一用户未使用手机100的第二判断结果的一段时间(如12小时)。或者，上述第二时间段可以是预设的时间段，例如上午5点到上午10点的时间段。上述第二时间段也可以是手环200预估到的第一用户退出睡眠状态的时间段。其中，手环200可以根据多次检测到的第一用户的数据，预估第一用户退出睡眠状态的时间段。The above-mentioned second time period may be a period of time (eg, 12 hours) during which the mobile phone 100 sends the second judgment result to the bracelet 200 to indicate that the first user does not use the mobile phone 100 . Alternatively, the above-mentioned second time period may be a preset time period, for example, a time period from 5:00 am to 10:00 am. The above-mentioned second time period may also be a time period estimated by the bracelet 200 when the first user exits the sleep state. The bracelet 200 can estimate the time period for the first user to exit the sleep state according to the data of the first user detected multiple times.
可选的，手机100可以在上述第二时间段内监测到关闭手机100的闹钟的用户操作时，判断关闭手机100的闹钟的用户是否第一用户。若判断出关闭手机100的闹钟的用户是第一用户，手机100可以向手环200发送用于指示第一用户退出睡眠状态的消息。当接收到上述用于指示第一用户退出睡眠状态的消息，手环200可以将上述监测到关闭手机100的闹钟的用户操作的时刻确定为第一用户退出睡眠状态的时刻。本申请实施例对手机100判断关闭手机100的闹钟的用户是否是第一用户的方法不作限定。例如，手机100可以通过人脸识别、声纹识别、指纹识别等生物特征信息识别的方法来判断关闭闹钟的用户是否是第一用户。Optionally, the mobile phone 100 may determine whether the user who turns off the alarm clock of the mobile phone 100 is the first user when monitoring the user's operation to turn off the alarm clock of the mobile phone 100 within the above-mentioned second time period. If it is determined that the user who turns off the alarm clock of the mobile phone 100 is the first user, the mobile phone 100 may send a message to the bracelet 200 for instructing the first user to exit the sleep state. When receiving the above-mentioned message for instructing the first user to exit the sleep state, the bracelet 200 may determine the time when the user operation to turn off the alarm clock of the mobile phone 100 is monitored as the time when the first user exits the sleep state. This embodiment of the present application does not limit the method for the mobile phone 100 to determine whether the user who turns off the alarm clock of the mobile phone 100 is the first user. For example, the mobile phone 100 can determine whether the user who turns off the alarm clock is the first user by identifying the biometric information such as face recognition, voiceprint recognition, and fingerprint recognition.
可选的，手机100还可以在上述第二时间段内，利用前述图3～图6所示的方法来判断第一用户是否使用手机100。若判断出第一用户在使用手机100，手机100可以向手环200发送用于指示第一用户退出睡眠状态的消息。本申请实施例对手机100判断第一用户是否退出睡眠状态的实现方法不作限定。Optionally, the mobile phone 100 may also use the methods shown in FIG. 3 to FIG. 6 to determine whether the first user uses the mobile phone 100 during the second time period. If it is determined that the first user is using the mobile phone 100 , the mobile phone 100 may send a message to the bracelet 200 for instructing the first user to exit the sleep state. This embodiment of the present application does not limit the implementation method for the mobile phone 100 to determine whether the first user exits the sleep state.
不限于通过上述监测解锁的用户操作、监测关闭闹钟的用户操作以及前述图3～图6所示的方法来判断第一用户是否使用手机100，手机100还可以通过其他方法来判断自己是否被第一用户使用，进而辅助手环200来判断第一用户是否退出睡眠状态。It is not limited to determining whether the first user uses the mobile phone 100 by monitoring the user operation of unlocking, monitoring the user operation of turning off the alarm clock, and the aforementioned methods shown in FIGS. A user uses it, and then assists the bracelet 200 to determine whether the first user exits the sleep state.
手环200可以基于加速度数据和心率数据，利用前述实施例中的睡眠模型来判断第一用户是否退出睡眠状态。但在一些应用场景(例如第一用户在醒来后躺在床上使用手机的应用场景)中，第一用户已经退出睡眠状态，但手环200姿态的变化量较小或者甚至姿态保持不变。那么手环200利用睡眠模型判断出的结果往往是第一用户仍处于睡眠状态中。这就降低了睡眠质量监测的准确率。上述手环200借助手机100判断第一用户是否退出睡眠状态的方法，可以减少第一用户已经醒来但未起床对判断第一用户是否退出睡眠状态的误判，提高睡眠质量监测的准确率。The bracelet 200 may use the sleep model in the foregoing embodiment to determine whether the first user exits the sleep state based on the acceleration data and the heart rate data. However, in some application scenarios (for example, an application scenario in which the first user lies in bed and uses a mobile phone after waking up), the first user has exited the sleep state, but the change in the posture of the bracelet 200 is small or even the posture remains unchanged. Then, the result determined by the bracelet 200 using the sleep model is often that the first user is still in a sleep state. This reduces the accuracy of sleep quality monitoring. The above method of judging whether the first user exits the sleep state by the mobile phone 100 of the bracelet 200 can reduce the misjudgment of whether the first user exits the sleep state when the first user has woken up but does not get up, and improve the accuracy of sleep quality monitoring.
以上所述，以上实施例仅用以说明本申请的技术方案，而非对其限制；尽管参照前述实施例对本申请进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: The technical solutions described in the embodiments are modified, or some technical features thereof are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

Claims (33)

  1. 一种睡眠监测方法，其特征在于，所述方法包括：A sleep monitoring method, characterized in that the method comprises:
    第一电子设备接收到第二电子设备的第一请求；所述第一电子设备与所述第二电子设备具有绑定关系；所述第一请求是所述第二电子设备处于佩带状态且监测到第一数据时发送的，所述第一数据与用户进入睡眠状态的数据相符；The first electronic device receives a first request from the second electronic device; the first electronic device has a binding relationship with the second electronic device; the first request is that the second electronic device is in a wearing state and monitors When the first data is sent, the first data is consistent with the data that the user enters the sleep state;
    所述第一电子设备判断佩带所述第二电子设备的第一用户是否在使用所述第一电子设备，并将第一判断结果或第二判断结果发送给所述第二电子设备；所述第一判断结果为所述第一用户在使用所述第一电子设备，所述第二判断结果为所述第一用户未使用所述第一电子设备。The first electronic device determines whether the first user wearing the second electronic device is using the first electronic device, and sends the first determination result or the second determination result to the second electronic device; the The first determination result is that the first user is using the first electronic device, and the second determination result is that the first user is not using the first electronic device.
  2. 根据权利要求1所述的方法，其特征在于，所述第一电子设备判断佩带所述第二电子设备的第一用户是否在使用所述第一电子设备，具体包括：The method according to claim 1, wherein determining by the first electronic device whether the first user wearing the second electronic device is using the first electronic device specifically includes:
    所述第一电子设备在第一条件下判断出所述第一电子设备在被用户使用且使用者为所述第一用户，所述第一电子设备得到所述第一判断结果；所述第一条件包括以下一项或多项：所述第一电子设备判断出自己处于非静止状态、所述第一电子设备在第一时间段内监测到用户操作、所述第一电子设备监测到有人眼注视所述第一电子设备的屏幕、所述第一电子设备监测到自己运行有投屏的应用程序；The first electronic device determines under a first condition that the first electronic device is being used by a user and the user is the first user, and the first electronic device obtains the first determination result; the first A condition includes one or more of the following: the first electronic device determines that it is in a non-stationary state, the first electronic device detects a user operation within a first time period, and the first electronic device detects that there is a person Staring at the screen of the first electronic device, and the first electronic device detects that it is running a screen-casting application;
    所述第一电子设备在所述第一条件下判断出所述第一电子设备在被用户使用且使用者不为所述第一用户，或者所述第一电子设备判断出所述第一电子设备未被用户使用，所述第一电子设备得到所述第二判断结果。The first electronic device determines under the first condition that the first electronic device is being used by a user and the user is not the first user, or the first electronic device determines that the first electronic device is The device is not used by the user, and the first electronic device obtains the second judgment result.
  3. 根据权利要求2所述的方法，其特征在于，所述第一电子设备判断出使用者为所述第一用户，具体包括：The method according to claim 2, wherein determining that the user is the first user by the first electronic device specifically includes:
    所述第一电子设备通过摄像头采集第一图像，并判断出所述第一图像中包含所述第一用户的人脸图像。The first electronic device collects a first image through a camera, and determines that the first image includes a face image of the first user.
  4. 根据权利要求1-3中任一项所述的方法，其特征在于，所述第一数据包括以下一项或多项：用户的生理特征数据、所述第二电子设备的运动数据。The method according to any one of claims 1-3, wherein the first data includes one or more of the following: physiological characteristic data of the user, and motion data of the second electronic device.
  5. 根据权利要求1-4任一项所述的方法，其特征在于，所述方法还包括：The method according to any one of claims 1-4, wherein the method further comprises:
    所述第一电子设备在第二时间段内，监测到解锁所述第一电子设备的用户操作，所述第一电子设备向所述第二电子设备发送第一消息，所述第一消息用于指示所述第一用户在使用所述第一电子设备；或者，During the second time period, the first electronic device monitors a user operation to unlock the first electronic device, the first electronic device sends a first message to the second electronic device, and the first message uses to indicate that the first user is using the first electronic device; or,
    所述第一电子设备在所述第二时间段内，监测到关闭闹钟的用户操作，且关闭闹钟的用户为所述第一用户，所述第一电子设备向所述第二电子设备发送所述第一消息。During the second time period, the first electronic device detects a user operation to turn off the alarm clock, and the user who turns off the alarm clock is the first user, and the first electronic device sends the second electronic device the information. the first news.
  6. 根据权利要求5所述的方法，其特征在于，所述第二时间段为从所述第一电子设备向所述二电子设备发送所述第二判断结果开始的第一时长的时间段；或者，所述第二时间段为预设时间段。The method according to claim 5, wherein the second time period is a time period of a first duration from when the first electronic device sends the second judgment result to the second electronic device; or , the second time period is a preset time period.
  7. 根据权利要求1-6中任一项所述的方法，其特征在于，所述方法还包括：The method according to any one of claims 1-6, wherein the method further comprises:
    所述第一电子设备与所述第二电子设备通过蓝牙配对的方式建立绑定关系；或者，establishing a binding relationship between the first electronic device and the second electronic device through Bluetooth pairing; or,
    所述第一电子设备响应于第一用户操作与所述第二电子设备建立绑定关系，所述第一用户操作用于指示所述第一电子设备的机主为所述第一用户；或者，The first electronic device establishes a binding relationship with the second electronic device in response to a first user operation, and the first user operation is used to indicate that the owner of the first electronic device is the first user; or ,
    所述第一电子设备与所述第二电子设备通过登录同一个账号建立绑定关系。The first electronic device and the second electronic device establish a binding relationship by logging into the same account.
  8. 一种睡眠监测方法，其特征在于，所述方法包括：A sleep monitoring method, characterized in that the method comprises:
    第二电子设备在处于佩带状态时监测到第一数据，所述第一数据与用户进入睡眠状态的数据相符；When the second electronic device is in the wearing state, the first data is monitored, and the first data is consistent with the data that the user enters the sleep state;
    所述第二电子设备向第一电子设备发送第一请求；所述第一电子设备与所述第二电子设备具有绑定关系；The second electronic device sends a first request to the first electronic device; the first electronic device has a binding relationship with the second electronic device;
    在接收到来自所述第一电子设备的第一判断结果的情况下，所述第二电子设备确定佩带所述第二电子设备的第一用户未进入睡眠状态；所述第一判断结果为所述第一电子设备接收到所述第一请求后判断出所述第一用户在使用所述第一电子设备的判断结果。In the case of receiving the first determination result from the first electronic device, the second electronic device determines that the first user wearing the second electronic device has not entered a sleep state; the first determination result is that After receiving the first request, the first electronic device determines a determination result that the first user is using the first electronic device.
  9. 根据权利要求8所述的方法，其特征在于，所述第二电子设备确定佩带所述第二电子设备的第一用户未进入睡眠状态之后，所述方法还包括：The method according to claim 8, wherein after the second electronic device determines that the first user wearing the second electronic device has not entered a sleep state, the method further comprises:
    所述第二电子设备在处于佩带状态时监测到第二数据，并判断所述第二数据与用户进入睡眠状态的数据是否相符。The second electronic device monitors the second data when it is in the wearing state, and determines whether the second data is consistent with the data that the user enters the sleep state.
  10. 根据权利要求8或9所述的方法，其特征在于，所述第二电子设备确定佩带所述第二电子设备的第一用户未进入睡眠状态之后，所述方法还包括：The method according to claim 8 or 9, wherein after the second electronic device determines that the first user wearing the second electronic device has not entered a sleep state, the method further comprises:
    所述第二电子设备将监测到的用户的生理特征数据记录为未处于睡眠状态下的数据。The second electronic device records the monitored physiological characteristic data of the user as data not in a sleep state.
  11. 根据权利要求8-10中任一项所述的方法，其特征在于，所述方法还包括：The method according to any one of claims 8-10, wherein the method further comprises:
    在接收到来自所述第一电子设备的第二判断结果的情况下，所述第二电子设备确定所述第一用户进入睡眠状态；所述第二判断结果为所述第一电子设备接收到所述第一请求后判断出所述第一用户未使用所述第一电子设备的判断结果。In the case of receiving the second judgment result from the first electronic device, the second electronic device determines that the first user has entered a sleep state; the second judgment result is that the first electronic device receives After the first request, it is determined that the first user does not use the first electronic device.
  12. 根据权利要求11所述的方法，其特征在于，所述第二电子设备确定所述第一用户进入睡眠状态之后，所述方法还包括：The method according to claim 11, wherein after the second electronic device determines that the first user enters a sleep state, the method further comprises:
    所述第二电子设备将监测到的用户的生理特征数据记录为睡眠状态下的数据。The second electronic device records the monitored physiological characteristic data of the user as data in a sleep state.
  13. 根据权利要求9-12中任一项所述的方法，其特征在于，所述第一数据和所述第二数据包括以下一项或多项：用户的生理特征数据、所述第二电子设备的运动数据。The method according to any one of claims 9-12, wherein the first data and the second data include one or more of the following: physiological characteristic data of the user, the second electronic device movement data.
  14. 根据权利要求11-13中任一项所述的方法，其特征在于，所述方法还包括：The method according to any one of claims 11-13, wherein the method further comprises:
    所述第二电子设备在检测到所述第一用户的状态为睡眠状态时接收到来自所述第一电子设备的第一消息，确定所述第二电子设备检测到的所述第一用户的状态为非睡眠状态；所述第一消息用于指示所述第一用户在使用所述第一电子设备。The second electronic device receives a first message from the first electronic device when detecting that the state of the first user is a sleep state, and determines that the state of the first user detected by the second electronic device is a sleep state. The state is a non-sleep state; the first message is used to indicate that the first user is using the first electronic device.
  15. 一种睡眠监测方法，其特征在于，所述方法包括：A sleep monitoring method, characterized in that the method comprises:
    第二电子设备在处于佩带状态时监测到第一数据，所述第一数据与用户进入睡眠状态的数据相符；When the second electronic device is in the wearing state, the first data is monitored, and the first data is consistent with the data that the user enters the sleep state;
    所述第二电子设备向第一电子设备发送第一请求；所述第一电子设备与所述第二电子设备具有绑定关系；The second electronic device sends a first request to the first electronic device; the first electronic device has a binding relationship with the second electronic device;
    所述第一电子设备接收到所述第二电子设备的第一请求；the first electronic device receives the first request from the second electronic device;
    所述第一电子设备判断佩带所述第二电子设备的第一用户是否在使用所述第一电子设备，并将第一判断结果或第二判断结果发送给所述第二电子设备；所述第一判断结果为所述第一用户在使用所述第一电子设备，所述第二判断结果为所述第一用户未使用所述第一电子设备；The first electronic device determines whether the first user wearing the second electronic device is using the first electronic device, and sends the first determination result or the second determination result to the second electronic device; the The first determination result is that the first user is using the first electronic device, and the second determination result is that the first user is not using the first electronic device;
    在接收到所述第一判断结果的情况下，所述第二电子设备确定所述第一用户未进入睡眠状态。In the case of receiving the first determination result, the second electronic device determines that the first user is not in a sleep state.
  16. 根据权利要求15所述的方法，其特征在于，所述第一电子设备判断佩带所述第二电子设备的第一用户是否在使用所述第一电子设备，具体包括：The method according to claim 15, wherein the determining, by the first electronic device, whether the first user wearing the second electronic device is using the first electronic device, specifically comprises:
    所述第一电子设备在第一条件下判断出所述第一电子设备在被用户使用且使用者为所述第一用户，所述第一电子设备得到所述第一判断结果；所述第一条件包括以下一项或多项：所述第一电子设备判断出自己处于非静止状态、所述第一电子设备在第一时间段内监测到用户操作、所述第一电子设备监测到有人眼注视所述第一电子设备的屏幕、所述第一电子设备监测到自己运行有投屏的应用程序；The first electronic device determines under the first condition that the first electronic device is being used by a user and the user is the first user, and the first electronic device obtains the first determination result; the first A condition includes one or more of the following: the first electronic device determines that it is in a non-stationary state, the first electronic device detects a user operation within a first time period, and the first electronic device detects that there is a person Staring at the screen of the first electronic device, and the first electronic device detects that it is running a screen-casting application;
    所述第一电子设备在所述第一条件下判断出所述第一电子设备在被用户使用且使用者不为所述第一用户，或者所述第一电子设备判断出所述第一电子设备未被用户使用，所述第一电子设备得到所述第二判断结果。The first electronic device determines under the first condition that the first electronic device is being used by a user and the user is not the first user, or the first electronic device determines that the first electronic device is The device is not used by the user, and the first electronic device obtains the second judgment result.
  17. 根据权利要求16所述的方法，其特征在于，所述第一电子设备判断出使用者为所述第一用户，具体包括：The method according to claim 16, wherein determining that the user is the first user by the first electronic device specifically includes:
    所述第一电子设备通过摄像头采集第一图像，并判断出所述第一图像中包含所述第一用户的人脸图像。The first electronic device collects a first image through a camera, and determines that the first image includes a face image of the first user.
  18. 根据权利要求15-17中任一项所述的方法，其特征在于，所述方法还包括：The method according to any one of claims 15-17, wherein the method further comprises:
    在接收到所述第二判断结果的情况下，所述第二电子设备确定所述第一用户进入睡眠状态。In the case of receiving the second judgment result, the second electronic device determines that the first user enters a sleep state.
  19. 根据权利要求15-18中任一项所述的方法，其特征在于，所述方法还包括：The method according to any one of claims 15-18, wherein the method further comprises:
    所述第一电子设备在第二时间段内，监测到解锁所述第一电子设备的用户操作，所述第一电子设备向所述第二电子设备发送第一消息，所述第一消息用于指示所述第一用户在使用所述第一电子设备；或者，During the second time period, the first electronic device monitors a user operation to unlock the first electronic device, the first electronic device sends a first message to the second electronic device, and the first message uses to indicate that the first user is using the first electronic device; or,
    所述第一电子设备在所述第二时间段内，监测到关闭闹钟的用户操作，且关闭闹钟的用户为所述第一用户，所述第一电子设备向所述第二电子设备发送所述第一消息。During the second time period, the first electronic device detects a user operation to turn off the alarm clock, and the user who turns off the alarm clock is the first user, and the first electronic device sends the second electronic device the information. the first news.
  20. 根据权利要求15-19中任一项所述的方法，其特征在于，所述方法还包括：The method according to any one of claims 15-19, wherein the method further comprises:
    所述第一电子设备与所述第二电子设备通过蓝牙配对的方式建立绑定关系；或者，establishing a binding relationship between the first electronic device and the second electronic device through Bluetooth pairing; or,
    所述第一电子设备响应于第一用户操作与所述第二电子设备建立绑定关系，所述第一用户操作用于指示所述第一电子设备的机主为所述第一用户；或者，The first electronic device establishes a binding relationship with the second electronic device in response to a first user operation, and the first user operation is used to indicate that the owner of the first electronic device is the first user; or ,
    所述第一电子设备与所述第二电子设备通过登录同一个账号建立绑定关系。The first electronic device and the second electronic device establish a binding relationship by logging into the same account.
  21. 一种睡眠监测方法，其特征在于，所述方法包括：A sleep monitoring method, characterized in that the method comprises:
    第二电子设备在检测到佩戴有所述第二电子设备的第一用户的状态为睡眠状态时接收到第一电子设备的第一消息，确定所述第二电子设备检测到的所述第一用户的状态为非睡眠状态；所述第一电子设备与所述第二电子设备具有绑定关系；所述第一消息是所述第一电子设备在第一监测时间段内监测到解锁所述第一电子设备的用户操作之后发送的。The second electronic device receives the first message from the first electronic device when detecting that the state of the first user wearing the second electronic device is a sleep state, and determines that the first message detected by the second electronic device is in the sleep state. The state of the user is a non-sleep state; the first electronic device has a binding relationship with the second electronic device; the first message is that the first electronic device detects that the first electronic device has unlocked the Sent after a user operation of the first electronic device.
  22. 根据权利要求21所述的方法，其特征在于，所述第二电子设备在检测到佩戴有所述第二电子设备的第一用户的状态为睡眠状态之前，所述方法还包括：The method according to claim 21, wherein before the second electronic device detects that the state of the first user wearing the second electronic device is a sleep state, the method further comprises:
    所述第二电子设备在处于佩带状态时监测到第一数据，所述第一数据与用户进入睡眠状态的数据相符；The second electronic device detects the first data when it is in the wearing state, and the first data is consistent with the data that the user enters the sleep state;
    所述第二电子设备向所述第一电子设备发送第一请求；the second electronic device sends a first request to the first electronic device;
    所述第二电子设备接收到所述第一电子设备指示所述第一用户未使用所述第一电子设备的判断结果。The second electronic device receives a determination result that the first electronic device indicates that the first user does not use the first electronic device.
  23. 根据权利要求21或22所述的方法，其特征在于，所述第一监测时间段为所述第二电子设备预估所述第一用户退出睡眠状态的时间段。The method according to claim 21 or 22, wherein the first monitoring time period is a time period during which the second electronic device estimates that the first user exits a sleep state.
  24. 根据权利要求22所述的方法，其特征在于，所述第一监测时间段为从所述第一电子设备向所述第二电子设备发送所述指示所述第一用户未使用所述第一电子设备的判断结果开始的第一时长的时间段。The method according to claim 22, wherein the first monitoring time period is the transmission of the indication that the first user is not using the first electronic device from the first electronic device to the second electronic device The first time period when the judgment result of the electronic device starts.
  25. 一种睡眠监测方法，其特征在于，所述方法包括：A sleep monitoring method, characterized in that the method comprises:
    第一电子设备在第一监测时间段内监测到解锁所述第一电子设备的用户操作，向第二电子设备发送第一消息；所述第一电子设备与所述第二电子设备具有绑定关系；The first electronic device monitors the user operation of unlocking the first electronic device within the first monitoring time period, and sends a first message to the second electronic device; the first electronic device and the second electronic device are bound relation;
    所述第二电子设备在检测到所述第一用户的状态为睡眠状态时接收到所述第一消息，确定所述第二电子设备检测到的所述第一用户的状态为非睡眠状态。The second electronic device receives the first message when detecting that the state of the first user is a sleep state, and determines that the state of the first user detected by the second electronic device is a non-sleep state.
  26. 根据权利要求25所述的方法，其特征在于，所述第二电子设备在确定所述第一用户处于睡眠状态之前，所述方法还包括：The method according to claim 25, wherein before the second electronic device determines that the first user is in a sleep state, the method further comprises:
    所述第二电子设备在处于佩带状态时监测到第一数据，所述第一数据与用户进入睡眠状态的数据相符；The second electronic device detects the first data when it is in the wearing state, and the first data is consistent with the data that the user enters the sleep state;
    所述第二电子设备向所述第一电子设备发送第一请求；the second electronic device sends a first request to the first electronic device;
    所述第一电子设备接收到所述第一请求，并判断所述第一用户是否在使用所述第一电子设备，得到指示所述第一用户未使用所述第一电子设备的判断结果；所述第一电子设备将所述指示所述第一用户未使用所述第一电子设备的判断结果发送给所述第二电子设备。The first electronic device receives the first request, determines whether the first user is using the first electronic device, and obtains a determination result indicating that the first user is not using the first electronic device; The first electronic device sends the judgment result indicating that the first user does not use the first electronic device to the second electronic device.
  27. 根据权利要求25或26所述的方法，其特征在于，所述第一监测时间段为所述第二电子设备预估所述第一用户退出睡眠状态的时间段。The method according to claim 25 or 26, wherein the first monitoring time period is a time period during which the second electronic device estimates that the first user exits a sleep state.
  28. 根据权利要求26所述的方法，其特征在于，所述第一监测时间段为从所述第一电子设备向所述第二电子设备发送所述指示所述第一用户未使用所述第一电子设备的判断结果开始的第一时长的时间段。The method according to claim 26, wherein the first monitoring time period is the transmission of the indication that the first user is not using the first electronic device from the first electronic device to the second electronic device The first time period when the judgment result of the electronic device starts.
  29. 一种电子设备，所述电子设备为第一电子设备，其特征在于，包括：摄像头、通信模块、存储器和处理器；所述摄像头用于采集图像；所述通信模块用于与第二电子设备建立通信连接；所述存储器用于存储计算机程序；所述处理器用于调用所述计算机程序，使得所述第一电子设备执行权利要求1-7中任一项所述的方法。An electronic device, the electronic device is a first electronic device, characterized in that it comprises: a camera, a communication module, a memory and a processor; the camera is used for capturing images; the communication module is used for communicating with a second electronic device establishing a communication connection; the memory is used for storing a computer program; the processor is used for invoking the computer program, so that the first electronic device executes the method of any one of claims 1-7.
  30. 一种电子设备，所述电子设备为第二电子设备，其特征在于，包括：通信模块、存储器和处理器；所述通信模块用于与第一电子设备建立通信连接；所述存储器用于存储计算机程序；所述处理器用于调用所述计算机程序，使得所述第二电子设备执行权利要求8-14或权利要求21-24中任一项所述的方法。An electronic device, the electronic device is a second electronic device, characterized in that it comprises: a communication module, a memory and a processor; the communication module is used for establishing a communication connection with the first electronic device; the memory is used for storing A computer program; the processor is configured to invoke the computer program, so that the second electronic device executes the method of any one of claims 8-14 or claims 21-24.
  31. 一种睡眠监测***，其特征在于，所述***包括权利要求29所述的第一电子设备和权利要求30所述的第二电子设备。A sleep monitoring system, characterized in that, the system comprises the first electronic device of claim 29 and the second electronic device of claim 30 .
  32. 一种计算机存储介质，其特征在于，包括：计算机指令；当所述计算机指令在电子设备上运行时，使得所述电子设备执行如权利要求1-7或权利要求8-14或权利要求21-24中任一项所述的方法。A computer storage medium, characterized in that it includes: computer instructions; when the computer instructions are executed on an electronic device, the electronic device is made to execute the steps of claims 1-7 or 8-14 or claims 21- The method of any one of 24.
  33. 一种计算机程序产品，其特征在于，当所述计算机程序产品在电子设备上运行时，使得所述电子设备执行如权利要求1-7或权利要求8-14或权利要求21-24中任一项所述的方法。A computer program product, characterized in that, when the computer program product is run on an electronic device, the electronic device is made to execute any one of claims 1-7 or 8-14 or 21-24 method described in item.
PCT/CN2021/137461 2021-01-15 2021-12-13 Sleep monitoring method and related apparatus WO2022151887A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110057952.7A CN114762588A (en) 2021-01-15 2021-01-15 Sleep monitoring method and related device
CN202110057952.7 2021-01-15

Publications (1)

Publication Number Publication Date
WO2022151887A1 true WO2022151887A1 (en) 2022-07-21

Family

ID=82364577

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/137461 WO2022151887A1 (en) 2021-01-15 2021-12-13 Sleep monitoring method and related apparatus

Country Status (2)

Country Link
CN (1) CN114762588A (en)
WO (1) WO2022151887A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024051790A1 (en) * 2022-09-09 2024-03-14 荣耀终端有限公司 Sleep state detection method, electronic devices, and system

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117481614A (en) * 2023-12-26 2024-02-02 荣耀终端有限公司 Sleep state detection method and related equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150181368A1 (en) * 2013-12-20 2015-06-25 Kabushiki Kaisha Toshiba Electronic apparatus, method and storage medium
CN105042769A (en) * 2015-06-30 2015-11-11 广东美的制冷设备有限公司 Sleeping state monitoring method and device and air conditioner system
CN105380596A (en) * 2014-08-26 2016-03-09 三星电子株式会社 electronic device and sleep monitoring method in electronic device
CN105433904A (en) * 2015-11-24 2016-03-30 小米科技有限责任公司 Sleep state detection method, device and system
CN106308752A (en) * 2016-08-23 2017-01-11 广东小天才科技有限公司 Sleep monitoring method based on wearable equipment and sleep monitoring system based on wearable equipment
CN111839465A (en) * 2020-07-30 2020-10-30 歌尔科技有限公司 Sleep detection method and device, intelligent wearable device and readable storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150181368A1 (en) * 2013-12-20 2015-06-25 Kabushiki Kaisha Toshiba Electronic apparatus, method and storage medium
CN105380596A (en) * 2014-08-26 2016-03-09 三星电子株式会社 electronic device and sleep monitoring method in electronic device
CN105042769A (en) * 2015-06-30 2015-11-11 广东美的制冷设备有限公司 Sleeping state monitoring method and device and air conditioner system
CN105433904A (en) * 2015-11-24 2016-03-30 小米科技有限责任公司 Sleep state detection method, device and system
CN106308752A (en) * 2016-08-23 2017-01-11 广东小天才科技有限公司 Sleep monitoring method based on wearable equipment and sleep monitoring system based on wearable equipment
CN111839465A (en) * 2020-07-30 2020-10-30 歌尔科技有限公司 Sleep detection method and device, intelligent wearable device and readable storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024051790A1 (en) * 2022-09-09 2024-03-14 荣耀终端有限公司 Sleep state detection method, electronic devices, and system

Also Published As

Publication number Publication date
CN114762588A (en) 2022-07-19

Similar Documents

Publication Publication Date Title
CN112289313A (en) Voice control method, electronic equipment and system
WO2020207328A1 (en) Image recognition method and electronic device
WO2021213151A1 (en) Display control method and wearable device
WO2020019176A1 (en) Method for updating wake-up voice of voice assistant by terminal, and terminal
WO2021213165A1 (en) Multi-source data processing method, electronic device and computer-readable storage medium
WO2022151887A1 (en) Sleep monitoring method and related apparatus
WO2020019355A1 (en) Touch control method for wearable device, and wearable device and system
WO2021169515A1 (en) Method for data exchange between devices, and related device
WO2021104104A1 (en) Energy-efficient display processing method, and apparatus
WO2022007720A1 (en) Wearing detection method for wearable device, apparatus, and electronic device
WO2021068926A1 (en) Model updating method, working node, and model updating system
CN111835907A (en) Method, equipment and system for switching service across electronic equipment
CN113676339B (en) Multicast method, device, terminal equipment and computer readable storage medium
WO2022105830A1 (en) Sleep evaluation method, electronic device, and storage medium
WO2022100407A1 (en) Intelligent eye mask, terminal device, and health management method and system
CN113467735A (en) Image adjusting method, electronic device and storage medium
WO2022135144A1 (en) Self-adaptive display method, electronic device, and storage medium
WO2022206825A1 (en) Method and system for adjusting volume, and electronic device
WO2021204036A1 (en) Sleep risk monitoring method, electronic device and storage medium
CN113467747B (en) Volume adjusting method, electronic device and storage medium
CN114116610A (en) Method, device, electronic equipment and medium for acquiring storage information
CN111026285B (en) Method for adjusting pressure threshold and electronic equipment
WO2022252786A1 (en) Window split-screen display method and electronic device
WO2021239079A1 (en) Data measurement method and related apparatus
WO2022237598A1 (en) Sleep state testing method and electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21919077

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21919077

Country of ref document: EP

Kind code of ref document: A1