WO2022237598A1

WO2022237598A1 - Sleep state testing method and electronic device

Info

Publication number: WO2022237598A1
Application number: PCT/CN2022/090568
Authority: WO
Inventors: 夏凯伦; 徐腾; 赵帅; 叶际隆; 杨斌
Original assignee: 华为技术有限公司
Priority date: 2021-05-12
Filing date: 2022-04-29
Publication date: 2022-11-17
Also published as: CN115336968A

Abstract

A sleep state testing method applied to a wearable device. The method comprises: a wearable device collecting behavior data generated when a target user sleeps, the behavior data comprising a motion signal and/or a sound signal, wherein the motion signal is used for determining a first testing result representing a sleep state of the target user, and the sound signal is used for determining a second testing result representing the sleep state of the target user; and determining a final testing result of the sleep state of the target user according to the first testing result and/or the second testing result.

Description

一种睡眠状态检测方法与电子设备A sleep state detection method and electronic equipment

相关申请的交叉引用Cross References to Related Applications

本申请要求在2021年05月12日提交中国专利局、申请号为202110515668.X、申请名称为“一种睡眠状态检测方法与电子设备”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application with the application number 202110515668.X and the application name "A sleep state detection method and electronic equipment" submitted to the China Patent Office on May 12, 2021, the entire contents of which are incorporated by reference in this application.

技术领域technical field

本申请涉及终端技术领域，尤其涉及一种睡眠状态检测方法与电子设备。The present application relates to the technical field of terminals, and in particular to a sleep state detection method and electronic equipment.

背景技术Background technique

睡眠是人体重要的生理活动，能帮助人体恢复体力、脑力和精神，并能舒缓压力、增强学习能力，从而保持身体健康。人们若是欠缺睡眠或者患有睡眠障碍(比如失眠症、嗜睡症、梦游等)，将有可能导致一些后遗症，如情绪不稳定、忧郁、焦虑等。因此，睡眠状态检测是非常有必要的，能够帮助人们了解自己的睡眠质量，改善睡眠。Sleep is an important physiological activity of the human body, which can help the body recover physical, mental and spiritual strength, relieve stress, enhance learning ability, and maintain good health. If people lack sleep or suffer from sleep disorders (such as insomnia, narcolepsy, sleepwalking, etc.), it may lead to some sequelae, such as emotional instability, depression, anxiety, etc. Therefore, sleep state detection is very necessary and can help people understand their sleep quality and improve sleep.

目前，如何准确的检测睡眠状态是一直在探讨的问题。At present, how to accurately detect the sleep state is a problem that has been discussed.

发明内容Contents of the invention

本申请的目的在于提供了一种睡眠状态检测方法与电子设备，能够提升检测睡眠状态的准确性。The purpose of the present application is to provide a sleep state detection method and an electronic device, which can improve the accuracy of sleep state detection.

第一方面，提供一种睡眠状态检测方法，应用于可穿戴式设备，所述可穿戴设备当前处于非佩戴模式，所述方法包括：采集目标用户睡眠时产生的行为数据，所述行为数据包括运动信号和/或声音信号；其中，所述运动信号用于确定用于表征所述目标用户睡眠状态的第一检测结果，所述声音信号用于确定用于表征所述目标用户睡眠状态的第二检测结果；根据所述第一检测结果和/或所述第二检测结果，确定所述目标用户睡眠状态的最终检测结果。In the first aspect, a sleep state detection method is provided, which is applied to a wearable device, and the wearable device is currently in a non-wearing mode. The method includes: collecting behavior data generated when the target user sleeps, and the behavior data includes A motion signal and/or a sound signal; wherein, the motion signal is used to determine the first detection result characterizing the sleep state of the target user, and the sound signal is used to determine the first detection result characterizing the sleep state of the target user. Two detection results: according to the first detection result and/or the second detection result, determine the final detection result of the sleep state of the target user.

在本申请实施例中，通过运动信号和声音信号两个不同角度进行睡眠状态检测，并根据两个检测结果确定最终检测结果，有助于提升检测用户睡眠状态的准确性。In the embodiment of the present application, the sleep state is detected from two different angles of the motion signal and the sound signal, and the final detection result is determined according to the two detection results, which helps to improve the accuracy of detecting the user's sleep state.

在一些实施例中，可穿戴设备采集到目标用户睡眠时产生的行为数据之后，可以将所述行为数据发送给与可穿戴设备连接的电子设备。由该电子设备基于所述行为数据中的运行信号确定第一检测结果，基于所述行为数据中的声音信号确定第二检测结果，然后根据第一检测结果和/或第二检测结果得到最终检测结果。也就是说，可穿戴设备的执行步骤中的全部或部分可以由与可穿戴设备连接的电子设备执行。该电子设备得到最终检测结果之后可以发送给可穿戴设备进行显示或者该电子设备本地显示。其中，与可穿设备连接的电子设备比如可以是手机、平板电脑等便捷式电子设备。In some embodiments, after the wearable device collects the behavior data generated when the target user sleeps, the behavior data may be sent to an electronic device connected to the wearable device. The electronic device determines the first detection result based on the operating signal in the behavior data, determines the second detection result based on the sound signal in the behavior data, and then obtains the final detection result according to the first detection result and/or the second detection result result. That is to say, all or part of the execution steps of the wearable device may be executed by an electronic device connected to the wearable device. After the electronic device obtains the final detection result, it can be sent to the wearable device for display or displayed locally by the electronic device. Wherein, the electronic device connected with the wearable device may be, for example, a portable electronic device such as a mobile phone or a tablet computer.

在一种可能的设计中，所述最终检测结果是所述第一检测结果和所述第二检测结果的平均值或加权平均值。示例性的，比如第一检测结果是70分，第二检测结果是80分，那么最终检测结果是75分。In a possible design, the final detection result is an average or weighted average of the first detection result and the second detection result. Exemplarily, for example, if the first detection result is 70 points and the second detection result is 80 points, then the final detection result is 75 points.

应理解，除了分数值以外，第一检测结果和第二检测结果还可以有其它表示形式，比如，等级，如，第一检测结果是第一等级，第二检测结果是第三等级，那么最终检测结果是第一等级和第三等级的中间等级。It should be understood that, in addition to score values, the first detection result and the second detection result can also have other representations, such as grades, such as, the first detection result is the first grade, and the second detection result is the third grade, then the final The detection result is an intermediate grade between the first grade and the third grade.

在一种可能的设计中，所述采集目标用户睡眠时产生的行为数据之前，还包括：确定环境中包括多人时，输出第一提示信息，所述第一提示信息用于提示录入所述目标用户的特定声音信号；根据录入的所述目标用户的特定声音信号从所述声音信号中提取与所述目标用户的特定声音信号匹配的声音信号；其中，提取出的所述声音信号用于确定用于表征所述目标用户睡眠状态的所述第二检测结果。In a possible design, before collecting the behavior data generated when the target user sleeps, it also includes: outputting first prompt information when it is determined that there are many people in the environment, and the first prompt information is used to prompt to enter the A specific sound signal of the target user; extracting a sound signal matching the specific sound signal of the target user from the sound signals according to the entered specific sound signal of the target user; wherein, the extracted sound signal is used for Determining the second detection result characterizing the sleep state of the target user.

在本申请实施例中，在多人环境中，如果要检测目标用户的睡眠状态，那么录入目标用户的声音信号，这样的话，从采集的声音信号中提取出目标用户的声音信号可以用于确定该目标用户的第二检测结果。也就是说，即便是多人环境，本申请实施例也可以检测出某个特定用户的睡眠状态，使用方便。In the embodiment of the present application, in a multi-person environment, if the sleep state of the target user is to be detected, then the sound signal of the target user is input, so that the sound signal of the target user can be extracted from the collected sound signal to be used to determine The second detection result of the target user. That is to say, even in a multi-person environment, the embodiment of the present application can detect the sleep state of a specific user, which is convenient to use.

可选的，所述确定环境中包括多人时，输出第一提示信息，包括：与所述可穿戴设备连接的电子设备确定环境中包括多人时，输出所述第一提示信息；所述电子设备检测到录入所述目标用户的特定声音信号后，向所述可穿戴设备发送指令，该指令用于指示可穿戴设备开始采集行为数据。当然，所述电子设备也可以无需发送指令，比如可穿戴设备默认一直进行行为数据的采集。所述可穿戴设备采集行为数据之后，将所述行为数据发送给所述电子设备，所述电子设备根据录入的所述目标用户的特定声音信号从所述行为数据中的声音信号中提取与所述目标用户的特定声音信号匹配的声音信号，根据提取出的所述声音信号确定第二检测结果。Optionally, when it is determined that there are multiple people in the environment, outputting first prompt information includes: when the electronic device connected to the wearable device determines that there are multiple people in the environment, outputting the first prompt information; After the electronic device detects the specific sound signal recorded by the target user, it sends an instruction to the wearable device, and the instruction is used to instruct the wearable device to start collecting behavior data. Of course, the electronic device may not need to send instructions, for example, the wearable device always collects behavior data by default. After the wearable device collects the behavior data, it sends the behavior data to the electronic device, and the electronic device extracts from the sound signal in the behavior data according to the input specific sound signal of the target user. A sound signal matching the specific sound signal of the target user is selected, and a second detection result is determined according to the extracted sound signal.

在一种可能的设计中，所述采集目标用户睡眠时产生的行为数据之前，还可以确定环境中包括多人时，输出第二提示信息，所述第二提示信息用于提示录入所述目标用户相对于所述可穿戴设备的方位；根据录入的所述目标用户相对于所述可穿戴设备的方位，从所述运动信号中提取与所述目标用户相对于所述可穿戴设备的方位匹配的运动信号；其中，提取出的所述运动信号用于确定用于表征所述目标用户睡眠状态的所述第一检测结果。In a possible design, before collecting the behavior data generated when the target user sleeps, it may also be determined that there are many people in the environment, and then output second prompt information, and the second prompt information is used to prompt to enter the target user. The orientation of the user relative to the wearable device; according to the entered orientation of the target user relative to the wearable device, extract from the motion signal that matches the orientation of the target user relative to the wearable device motion signal; wherein, the extracted motion signal is used to determine the first detection result characterizing the sleep state of the target user.

在本申请实施例中，多人环境中，如果要检测目标用户的睡眠状态，那么录入目标用户相对于可穿戴设备的方位，这样的话，从采集的运动信号中提取出与该方位匹配的运动信号，该运动信号可以用于确定该目标用户的第一检测结果。也就是说，即便是多人环境，也可以检测出某个特定用户的睡眠状态，而且可以从运动信号和声音信号两个方面检测，准确性较高。In the embodiment of the present application, in a multi-person environment, if the sleep state of the target user is to be detected, the orientation of the target user relative to the wearable device is entered, and in this case, the motion matching the orientation is extracted from the collected motion signal signal, and the motion signal can be used to determine the first detection result of the target user. In other words, even in a multi-person environment, the sleep state of a specific user can be detected, and it can be detected from two aspects of motion signals and sound signals, with high accuracy.

可选的，所述确定环境中包括多人时，输出第二提示信息，包括：与所述可穿戴设备连接的电子设备确定环境中包括多人时，输出所述第二提示信息；所述电子设备检测到录入所述目标用户相对于所述可穿戴设备的方位后，向所述可穿戴设备发送指令，该指令用于指示可穿戴设备采集行为数据。当然，所述电子设备也可以无需发送指令，比如可穿戴设备默认一直进行行为数据的采集。所述可穿戴设备采集行为数据之后，将所述行为数据发送给所述电子设备，所述电子设备根据录入的所述目标用户相对于所述可穿戴设备的方位从所述行为数据中的运动信号中提取出对应的运动信号，根据提取出的运动信号确定第一检测结果。Optionally, when it is determined that there are multiple people in the environment, outputting second prompt information includes: when the electronic device connected to the wearable device determines that there are multiple people in the environment, outputting the second prompt information; After detecting that the orientation of the target user is entered relative to the wearable device, the electronic device sends an instruction to the wearable device, where the instruction is used to instruct the wearable device to collect behavior data. Of course, the electronic device may not need to send instructions, for example, the wearable device always collects behavior data by default. After the wearable device collects the behavior data, it sends the behavior data to the electronic device, and the electronic device extracts the movement data from the behavior data according to the entered orientation of the target user relative to the wearable device. The corresponding motion signal is extracted from the signal, and the first detection result is determined according to the extracted motion signal.

在一种可能的设计中，确定环境中包括多人，包括：输出第三提示信息，所述第三提示信息用于提示环境中是否有多人；根据用户输入的确认指令，确定环境中包括多人。也就是说，可穿戴设备可以通过输出提示信息的方式确定环境是否为多人环境。本申请实施例在多人环境，可以检测出某个特定用户的睡眠状态，而且可以从运动信号和声音信号两个方面检测，准确性较高。In a possible design, determining that there are multiple people in the environment includes: outputting third prompt information, the third prompt information is used to prompt whether there are multiple people in the environment; many people. That is to say, the wearable device can determine whether the environment is a multi-person environment by outputting prompt information. The embodiment of the present application can detect the sleeping state of a specific user in a multi-person environment, and can detect from two aspects of motion signals and sound signals, with high accuracy.

可选的，确定环境中包括多人，包括：通过与所述可穿戴设备连接的电子设备输出第三提示信息，所述电子设备根据用户输入的确认指令，确定环境中包括多人。所述电子设备确定包括多人时，可以输出第一提示信息或第二提示信息，参见前文描述。Optionally, determining that there are multiple people in the environment includes: outputting third prompt information through an electronic device connected to the wearable device, and the electronic device determines that there are multiple people in the environment according to a confirmation instruction input by the user. When the electronic device determines that there are multiple people involved, it may output the first prompt information or the second prompt information, refer to the foregoing description.

在一种可能的设计中，在所述采集目标用户睡眠时产生的行为数据之前，还包括：响应于用户操作，设置当前模式为非佩戴模式；输出第四提示信息，所述第四提示信息用于提示用户固定所述可穿戴设备。In a possible design, before collecting the behavior data generated when the target user sleeps, it also includes: responding to user operations, setting the current mode as the non-wearing mode; outputting fourth prompt information, the fourth prompt information Used to prompt the user to fix the wearable device.

在本申请实施例中，可穿戴设备具有佩戴模式和非佩戴模式，在佩戴模式下可以使用佩戴模式下的睡眠检测流程，在非佩戴模式下可以使用非佩戴模式的睡眠检测流程，在非佩戴模式下，可以提示用户固定设备，比如固定在床褥、枕头等位置，用户体验较高。In the embodiment of the present application, the wearable device has a wearing mode and a non-wearing mode. The sleep detection process in the wearing mode can be used in the wearing mode, and the sleep detection process in the non-wearing mode can be used in the non-wearing mode. In this mode, the user can be prompted to fix the device, such as fixing it on a mattress, pillow, etc., and the user experience is higher.

可选的，响应于用户操作，设置当前模式为非佩戴模式，包括：与所述可穿戴设备连接的电子设备响应于用户操作设置所述可穿戴设备当前模式为非佩戴模式，输出第四提示信息，提示用户固定可穿戴设备。Optionally, in response to a user operation, setting the current mode to the non-wearing mode includes: an electronic device connected to the wearable device responds to a user operation setting the current mode of the wearable device to the non-wearing mode, and outputs a fourth prompt message, prompting the user to secure the wearable.

也就是说，在本申请实施例中，可穿戴设备可以与电子设备(比如手机)连接，以上的可穿戴设备的各个步骤可以全部或部分由电子设备执行。比如，上述第一提示信息、第二提示信息、第三提示信息和第四提示信息中的至少一个提示信息可以通过与所述可穿戴设备连接的电子设备显示。That is to say, in the embodiment of the present application, the wearable device may be connected with an electronic device (such as a mobile phone), and all or part of the above steps of the wearable device may be performed by the electronic device. For example, at least one of the first prompt information, the second prompt information, the third prompt information and the fourth prompt information may be displayed by an electronic device connected to the wearable device.

在一种可能的设计中，所述目标用户包括多人时，所述最终检测结果可以用于表征所述多人的总体睡眠质量。也就是说，本申请实施例可以检测多人总体睡眠状态，这样，一次可以检测多人睡眠状态，效率更高。In a possible design, when the target user includes multiple people, the final detection result may be used to characterize the overall sleep quality of the multiple people. That is to say, the embodiment of the present application can detect the overall sleep status of multiple people, so that the sleep status of multiple people can be detected at one time, which is more efficient.

在一种可能的设计中，所述采集目标用户睡眠时产生的运动信号，可以通过运动传感器采集所述目标用户睡眠时由于翻身、起身或抖动的行为所带来的运动信号，所述运动信号包括位移、加速度、速度、角速度和角加速度等中的至少一种；所述方法还包括：根据所述运动信号识别体动特征，所述体动特征包括翻身、起身和抖动等；根据设定时长内所述体动特征发生的次数、频率和强度中的至少一项，确定所述第一检测结果。也就是说，本申请实施例中，可穿戴设备根据目标用户的体动特征的次数、频率、强度等，确定第一检测结果，体动特征(比如翻身、起身等)能够比较准确的反映用户睡眠状态，所以这种检测方式比较准确。In a possible design, the collection of motion signals generated by the target user during sleep may use a motion sensor to collect motion signals caused by the target user's behavior of turning over, getting up or shaking during sleep, and the motion signal Including at least one of displacement, acceleration, velocity, angular velocity and angular acceleration; the method also includes: identifying body motion characteristics according to the motion signal, and the body motion characteristics include turning over, getting up and shaking; according to the set The first detection result is determined by at least one of the occurrence times, frequency and intensity of the body movement feature within a time period. That is to say, in the embodiment of the present application, the wearable device determines the first detection result according to the number, frequency, intensity, etc. of the body movement characteristics of the target user, and the body movement characteristics (such as turning over, getting up, etc.) sleep state, so this detection method is more accurate.

在一种可能的设计中，所述采集的目标用户睡眠时产生的声音信号中包括的所述目标用户的鼾声、呼吸音等中的至少一项声音特征；所述方法还包括：根据设定时长内所述目标用户的鼾声或呼吸声中的至少一项声音特征的强度、频率和次数中的至少一项，确定所述第二检测结果。也就是说，本申请实施例中，可穿戴设备根据目标用户的鼾声或呼吸声的强度和频率等，确定第二检测结果，呼吸声或鼾声能够比较准确的反映用户的睡眠状态，所以这种检测方式比较准确。In a possible design, at least one sound feature of the target user's snoring sound, breathing sound, etc. is included in the collected sound signal generated by the target user during sleep; the method further includes: according to the set The second detection result is determined by at least one of intensity, frequency, and frequency of at least one sound feature of the target user's snoring sound or breathing sound within a time period. That is to say, in this embodiment of the application, the wearable device determines the second detection result according to the intensity and frequency of the target user's snoring or breathing sound, and the breathing or snoring sound can more accurately reflect the user's sleep state, so this The detection method is more accurate.

第二方面，提供一种电子设备，包括处理器，存储器，以及，一个或多个程序；其中，所述一个或多个程序被存储在所述存储器中，所述一个或多个程序包括指令，当所述指令被所述处理器执行时，使得所述终端设备执行如上述第一方面提供的方法步骤。In a second aspect, an electronic device is provided, including a processor, a memory, and one or more programs; wherein the one or more programs are stored in the memory, and the one or more programs include instructions , when the instruction is executed by the processor, the terminal device is made to execute the method steps provided in the first aspect above.

第三方面，提供一种计算机可读存储介质，所述计算机可读存储介质用于存储计算机程序，当所述计算机程序在计算机上运行时，使得所述计算机执行如上述第一方面提供的方法。In the third aspect, a computer-readable storage medium is provided, the computer-readable storage medium is used to store a computer program, and when the computer program is run on a computer, the computer executes the method as provided in the above-mentioned first aspect .

第四方面，提供一种计算机程序产品，包括计算机程序，当所述计算机程序在计算机上运行时，使得所述计算机执行如上述第一方面提供的方法。In a fourth aspect, a computer program product is provided, including a computer program, and when the computer program is run on a computer, the computer is made to execute the method provided in the first aspect above.

第五方面，还提供一种电子设备上的图形用户界面，所述电子设备具有显示屏、存储器、以及处理器，所述处理器用于执行存储在所述存储器中的一个或多个计算机程序，所述图形用户界面包括所述电子设备执行上述第一方面所述的方法时显示的图形用户界面。In a fifth aspect, there is also provided a graphical user interface on an electronic device, the electronic device has a display screen, a memory, and a processor, and the processor is configured to execute one or more computer programs stored in the memory, The graphical user interface includes a graphical user interface displayed when the electronic device executes the method described in the first aspect above.

第六方面，本申请实施例还提供一种芯片，所述芯片与电子设备中的存储器耦合，用于调用存储器中存储的计算机程序并执行本申请实施例第一方面的技术方案，本申请实施例中“耦合”是指两个部件彼此直接或间接地结合。In the sixth aspect, the embodiment of the present application further provides a chip, the chip is coupled with the memory in the electronic device, and is used to call the computer program stored in the memory and execute the technical solution of the first aspect of the embodiment of the present application. The implementation of the present application "Coupled" in the examples means that two elements are joined to each other directly or indirectly.

上述第二方面至第六方面的有益效果，参见第一方面的有益效果，不重复赘述。For the above beneficial effects of the second aspect to the sixth aspect, refer to the beneficial effects of the first aspect, which will not be repeated.

附图说明Description of drawings

图1为本申请一实施例提供的可穿戴设备的硬件结构的示意图；FIG. 1 is a schematic diagram of a hardware structure of a wearable device provided by an embodiment of the present application;

图2为本申请一实施例提供的睡眠状态检测方法的流程示意图；FIG. 2 is a schematic flowchart of a sleep state detection method provided by an embodiment of the present application;

图3为本申请一实施例提供的可穿戴设备的显示屏上的显示信息的示意图；FIG. 3 is a schematic diagram of information displayed on a display screen of a wearable device provided by an embodiment of the present application;

图4为本申请一实施例提供的可穿戴设备的显示屏上的显示信息的示意图；FIG. 4 is a schematic diagram of information displayed on a display screen of a wearable device provided by an embodiment of the present application;

图5A为本申请一实施例提供的手机上显示提示用户固定设备的示意图；FIG. 5A is a schematic diagram of a mobile phone displaying a prompt to a user to fix a device provided by an embodiment of the present application;

图5B和图5C为本申请一实施例提供的手机上显示睡眠状态检测结果的示意图；FIG. 5B and FIG. 5C are schematic diagrams of displaying sleep state detection results on a mobile phone provided by an embodiment of the present application;

图6为本申请一实施例提供的非佩戴模式下用户睡眠状态检测流程的示意图；FIG. 6 is a schematic diagram of a user sleep state detection process in non-wearing mode provided by an embodiment of the present application;

图7为本申请一实施例提供的睡眠状态检测方法的又一种流程示意图；FIG. 7 is another schematic flowchart of a sleep state detection method provided by an embodiment of the present application;

图8A至图8B为本申请一实施例提供的手机上提示录入目标用户的声音信息的示意图；8A to 8B are schematic diagrams of a mobile phone prompting to input voice information of a target user provided by an embodiment of the present application;

图9为本申请一实施例提供的手机上提示录入目标用户的声音信息的又一种示意图；FIG. 9 is another schematic diagram of a mobile phone prompting to input voice information of a target user provided by an embodiment of the present application;

图10至图12为本申请一实施例提供的手机上提示多种检测模式的示意图；Figures 10 to 12 are schematic diagrams of prompting multiple detection modes on the mobile phone provided by an embodiment of the present application;

图13为本申请一实施例提供的可穿戴设备的结构示意图。Fig. 13 is a schematic structural diagram of a wearable device provided by an embodiment of the present application.

具体实施方式Detailed ways

常见的睡眠状态检测方法主要包括以下几种：Common sleep state detection methods mainly include the following:

最传统的睡眠状态检测方法是利用医学上专业的医学仪器(如，多导睡眠检测仪)，在用户睡眠时，扫描用户脑电、呼吸等，可以为用户提供科学准确的临床诊断，但是医学仪器复杂且体型较大，无法实现日常化的睡眠检测。The most traditional sleep state detection method is to use medical professional medical instruments (such as polysomnography) to scan the user's EEG and breathing when the user is sleeping, which can provide users with scientific and accurate clinical diagnosis. The instrument is complex and large in size, and it is impossible to realize daily sleep detection.

为了满足日常化的睡眠状态检测，运动手环、手表等集成了睡眠检测功能，使得运动手环、手表的功能更丰富，不仅可以在用户日常运动(比如跑步)时检测运动状态，还可以在用户睡眠时检测睡眠状态。一般，运动手环或手表上设置电极片，当电极片接触用户身体时，可以感应到身体信号(比如心率)，通过身体信号判断睡眠状态。也就是说，用户睡觉时，需要佩戴运动手环或手表，才能检测睡眠状态，但是大部分用户睡觉时手腕上不喜欢佩戴东西，会影响睡觉，所以这种方式用户体验较低。In order to meet the daily sleep state detection, sports bracelets, watches, etc. integrate the sleep detection function, which makes the functions of sports bracelets and watches more abundant. Detect sleep state when user sleeps. Generally, an electrode sheet is provided on a sports bracelet or a watch. When the electrode sheet touches the user's body, a body signal (such as heart rate) can be sensed, and the sleep state can be judged through the body signal. That is to say, when the user sleeps, he needs to wear a sports bracelet or watch to detect the sleep state, but most users don't like to wear something on their wrist when they sleep, which will affect their sleep, so this method has a low user experience.

目前，市场上存在一些非佩戴式睡眠检测设备，例如睡眠追踪器，用户可以将其固定在床上，睡眠追踪器可以采集用户睡眠过程中的呼吸和心率的变化；再例如，具有能够固定运动手环或手表的凹槽的枕头，当运动手环或手表被固定在凹槽之后，可以检测用户睡眠过程中头部动作信号，来判断用户睡眠质量。但是，这种方式，需要用户额外购买非佩戴式睡眠检测设备(比如带凹槽的枕头)，而且非佩戴式睡眠检测设备功能单一，仅能检测睡眠状态，无法满足用户日常运动(比如跑步)时运动状态的检测。At present, there are some non-wearable sleep detection devices on the market, such as sleep trackers, which can be fixed on the bed by the user, and the sleep tracker can collect changes in the breathing and heart rate of the user during sleep; The pillow in the groove of the ring or watch, when the sports bracelet or watch is fixed in the groove, can detect the head movement signal during the user's sleep to judge the user's sleep quality. However, this method requires the user to purchase an additional non-wearable sleep detection device (such as a pillow with grooves), and the non-wearable sleep detection device has a single function, which can only detect the sleep state and cannot satisfy the user's daily exercise (such as running). The detection of motion state.

鉴于此，本申请实施例提供一种睡眠状态检测方法，该方法适用于可穿戴设备，可穿戴设备具有两种状态，佩戴状态和非佩戴状态。在佩戴状态时，用户可以佩戴该可穿戴设备实现日常的运动检测。在非佩戴状态时，用户可以将其设置在用户睡觉位置附近，无需用户佩戴在手腕上也可以检测睡眠状态，而且，可穿戴设备可以采集用户睡眠过程中的运动信号(比如翻身)，和/或声音信号(比如呼吸声)，其中，运动信号可以用于确定用户睡眠状态的第一检测结果，声音信号用于确定用户睡眠状态的第二检测结果；根据所述第一检测结果和/或所述第二检测结果，确定所述目标用户睡眠状态的最终检测结果，使得睡眠状态检测结果较为准确。In view of this, an embodiment of the present application provides a sleep state detection method, which is applicable to a wearable device, and the wearable device has two states, a wearing state and a non-wearing state. In the wearing state, the user can wear the wearable device for daily motion detection. In the non-wearing state, the user can set it near the user's sleeping position, and can detect the sleeping state without the user wearing it on the wrist. Moreover, the wearable device can collect motion signals (such as turning over) during the user's sleep, and/or Or a sound signal (such as the sound of breathing), wherein the motion signal can be used to determine the first detection result of the user's sleep state, and the sound signal is used to determine the second detection result of the user's sleep state; according to the first detection result and/or The second detection result determines the final detection result of the sleep state of the target user, so that the sleep state detection result is more accurate.

本申请实施例提供的睡眠状态检测方法可以应用于可穿戴设备。所述可穿戴设备可以是智能手表、智能手环、智能项链、智能服饰、智能鞋子、智能耳环等，本申请实施例对可穿戴设备的形态不作限定。The sleep state detection method provided in the embodiment of the present application can be applied to wearable devices. The wearable device may be a smart watch, smart bracelet, smart necklace, smart clothing, smart shoes, smart earrings, etc. The embodiment of the present application does not limit the form of the wearable device.

图1示出了可穿戴设备的结构示意图。如图1所示，可穿戴设备可以包括处理器110，外部存储器接口120，内部存储器121，通用串行总线(universal serial bus，USB)接口130，充电管理模块140，电源管理模块141，电池142，天线1，天线2，移动通信模块150，无线通信模块160，音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，传感器模块180，按键190，马达191，指示器192，摄像头193，显示屏194，以及用户标识模块(subscriber identification module，SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A，陀螺仪传感器180B，气压传感器180C，磁传感器180D，加速度传感器180E，距离传感器180F，接近光传感器180G，指纹传感器180H，温度传感器180J，触摸传感器180K，环境光传感器180L，骨传导传感器180M等。Figure 1 shows a schematic structural diagram of a wearable device. As shown in Figure 1, the wearable device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, and a battery 142 , antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193 , a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.

处理器110可以包括一个或多个处理单元，例如：处理器110可以包括应用处理器(application processor，AP)，调制解调处理器，图形处理器(graphics processing unit，GPU)，图像信号处理器(image signal processor，ISP)，控制器，存储器，视频编解码器，数字信号处理器(digital signal processor，DSP)，基带处理器，和/或神经网络处理器(neural-network processing unit，NPU)等。其中，不同的处理单元可以是独立的器件，也可以集成在一个或多个处理器中。其中，控制器可以是可穿戴设备的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号，产生操作控制信号，完成取指令和执行指令的控制。处理器110中还可以设置存储器，用于存储指令和数据。在一些实施例中，处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据，可从所述存储器中直接调用。避免了重复存取，减少了处理器110的等待时间，因而提高了***的效率。The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) Wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors. Among them, the controller can be the nerve center and command center of the wearable device. The controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction. A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the system.

USB接口130是符合USB标准规范的接口，具体可以是Mini USB接口，Micro USB接口，USB Type C接口等。USB接口130可以用于连接充电器为可穿戴设备充电，也可以用于可穿戴设备与***设备之间传输数据。充电管理模块140用于从充电器接收充电输入。电源管理模块141用于连接电池142，充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入，为处理器110，内部存储器121，外部存储器，显示屏194，摄像头193，和无线通信模块160等供电。The USB interface 130 is an interface conforming to the USB standard specification, specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface 130 can be used to connect a charger to charge the wearable device, and can also be used to transmit data between the wearable device and peripheral devices. The charging management module 140 is configured to receive a charging input from a charger. The power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives the input of the battery 142 and/or the charging management module 140, and supplies power for the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160, etc.

可穿戴设备的无线通信功能可以通过天线1，天线2，移动通信模块150，无线通信模块160，调制解调处理器以及基带处理器等实现。天线1和天线2用于发射和接收电磁波信号。可穿戴设备中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用，以提高天线的利用率。例如：可以将天线1复用为无线局域网的分集天线。在另外一些实施例中，天线可以和调谐开关结合使用。The wireless communication function of the wearable device can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor. Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in a wearable device can be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

移动通信模块150可以提供应用在可穿戴设备上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器，开关，功率放大器，低噪声放大器(low noise amplifier，LNA)等。移动通信模块150可以由天线1接收电磁波，并对接收的电磁波进行滤波，放大等处理，传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大，经天线1转为电磁波辐射出去。在一些实施例中，移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中，移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。The mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied to wearable devices. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be set in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be set in the same device.

无线通信模块160可以提供应用在可穿戴设备上的包括无线局域网(wireless local area networks，WLAN)(如无线保真(wireless fidelity，Wi-Fi)网络)，蓝牙(bluetooth，BT)，全球导航卫星***(global navigation satellite system，GNSS)，调频(frequency modulation，FM)，近距离无线通信技术(near field communication，NFC)，红外技术(infrared，IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波，将电磁波信号调频以及滤波处理，将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号，对其进行调频，放大，经天线2转为电磁波辐射出去。The wireless communication module 160 can provide wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (Wireless Fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.

在一些实施例中，可穿戴设备的天线1和移动通信模块150耦合，天线2和无线通信模块160耦合，使得可穿戴设备可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯***(global system for mobile communications，GSM)，通用分组无线服务(general packet radio service，GPRS)，码分多址接入(code division multiple access，CDMA)，宽带码分多址(wideband code division multiple access，WCDMA)，时分码分多址(time-division code division multiple access，TD-SCDMA)，长期演进(long term evolution，LTE)，BT，GNSS，WLAN，NFC，FM，和/或IR技术等。所述GNSS可以包括全球卫星定位***(global positioning system，GPS)，全球导航卫星***(global navigation satellite system，GLONASS)，北斗卫星导航***(beidou navigation satellite system，BDS)，准天顶卫星***(quasi-zenith satellite system，QZSS)和/或星基增强***(satellite based augmentation systems，SBAS)。In some embodiments, the antenna 1 of the wearable device is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the wearable device can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR techniques, etc. The GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).

显示屏194用于显示应用的显示界面等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display，LCD)，有机发光二极管(organic light-emitting diode，OLED)，有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的，AMOLED)，柔性发光二极管(flex light-emitting diode，FLED)，Miniled，MicroLed，Micro-oLed，量子点发光二极管(quantum dot light emitting diodes，QLED)等。在一些实施例中，可穿戴设备可以包括1个或N个显示屏194，N为大于1的正整数。The display screen 194 is used to display the display interface of the application and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc. In some embodiments, the wearable device may include 1 or N display screens 194, where N is a positive integer greater than 1.

可穿戴设备100可以通过ISP，摄像头193，视频编解码器，GPU，显示屏194以及应用处理器等实现拍摄功能。The wearable device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

ISP用于处理摄像头193反馈的数据。例如，拍照时，打开快门，光线通过镜头被传递到摄像头感光元件上，光信号转换为电信号，摄像头感光元件将所述电信号传递给ISP处理，转化为肉眼可见的图像。ISP还可以对图像的噪点，亮度，肤色进行算法优化。ISP还可以对拍摄场景的曝光，色温等参数优化。在一些实施例中，ISP可以设置在摄像头193中。The ISP is used for processing the data fed back by the camera 193 . For example, when taking a picture, open the shutter, the light is transmitted to the photosensitive element of the camera through the lens, and the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be located in the camera 193 .

摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device，CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor，CMOS)光电晶体管。感光元件把光信号转换成电信号，之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB，YUV等格式的图像信号。在一些实施例中，可穿戴设备可以包括1个或N个摄像头193，N为大于1的正整数。 Camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects it to the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other image signals. In some embodiments, the wearable device may include 1 or N cameras 193, where N is a positive integer greater than 1.

内部存储器121可以用于存储计算机可执行程序代码，所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令，从而执行可穿戴设备的各种功能应用以及数据处理。内部存储器121可以包括存储程序区和存储数据区。其中，存储程序区可存储操作***，以及至少一个应用程序(例如爱奇艺应用，微信应用等)的软件代码等。存储数据区可存储可穿戴设备使用过程中所产生的数据(例如图像、视频等)等。此外，内部存储器121可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件，闪存器件，通用闪存存储器(universal flash storage，UFS)等。The internal memory 121 may be used to store computer-executable program codes including instructions. The processor 110 executes various functional applications and data processing of the wearable device by executing instructions stored in the internal memory 121 . The internal memory 121 may include an area for storing programs and an area for storing data. Wherein, the storage program area can store the operating system and software codes of at least one application program (such as iQiyi application, WeChat application, etc.). The data storage area can store data (such as images, videos, etc.) generated during use of the wearable device. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.

外部存储器接口120可以用于连接外部存储卡，例如Micro SD卡，实现扩展可穿戴设备的存储能力。外部存储卡通过外部存储器接口120与处理器110通信，实现数据存储功能。例如将图片，视频等文件保存在外部存储卡中。The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the wearable device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, save pictures, videos and other files in the external memory card.

可穿戴设备可以通过音频模块170，扬声器170A，受话器170B，麦克风170C，耳机接口170D，以及应用处理器等实现音频功能。例如音乐播放，录音等。The wearable device can realize the audio function through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playback, recording, etc.

压力传感器180A用于感受压力信号，可以将压力信号转换成电信号。在一些实施例中，压力传感器180A可以设置于显示屏194。陀螺仪传感器180B可以用于确定可穿戴设备的运动姿态。在一些实施例中，可以通过陀螺仪传感器180B确定可穿戴设备围绕三个轴(即，x，y和z轴)的角速度。The pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal. In some embodiments, pressure sensor 180A may be disposed on display screen 194 . The gyroscope sensor 180B can be used to determine the motion gesture of the wearable device. In some embodiments, the angular velocity of the wearable device about three axes (ie, x, y and z axes) can be determined by the gyroscope sensor 180B.

陀螺仪传感器180B可以用于拍摄防抖。气压传感器180C用于测量气压。在一些实施例中，可穿戴设备通过气压传感器180C测得的气压值计算海拔高度，辅助定位和导航。磁传感器180D包括霍尔传感器。可穿戴设备可以利用磁传感器180D检测翻盖皮套的开合。在一些实施例中，当可穿戴设备是翻盖机时，可穿戴设备可以根据磁传感器180D检测翻盖的开合。进而根据检测到的皮套的开合状态或翻盖的开合状态，设置翻盖自动解锁等特性。加速度传感器180E可检测可穿戴设备在各个方向上(一般为三轴)加速度的大小。当可穿戴设备静止时可检测出重力的大小及方向。还可以用于识别可穿戴设备姿态，应用于横竖屏切换，计步器等应用。The gyro sensor 180B can be used for image stabilization. The air pressure sensor 180C is used to measure air pressure. In some embodiments, the wearable device calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation. The magnetic sensor 180D includes a Hall sensor. The wearable device may utilize the magnetic sensor 180D to detect opening and closing of the flip holster. In some embodiments, when the wearable device is a flip phone, the wearable device can detect the opening and closing of the flip according to the magnetic sensor 180D. Furthermore, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, features such as automatic unlocking of the flip cover are set. The acceleration sensor 180E can detect the acceleration of the wearable device in various directions (generally three axes). The magnitude and direction of gravity can be detected when the wearable device is stationary. It can also be used to recognize the posture of wearable devices, and can be used in applications such as horizontal and vertical screen switching, pedometers, etc.

距离传感器180F，用于测量距离。可穿戴设备可以通过红外或激光测量距离。在一些实施例中，拍摄场景，可穿戴设备可以利用距离传感器180F测距以实现快速对焦。接近光传感器180G可以包括例如发光二极管(LED)和光检测器，例如光电二极管。发光二极管可以是红外发光二极管。可穿戴设备通过发光二极管向外发射红外光。可穿戴设备使用光电二极管检测来自附近物体的红外反射光。当检测到充分的反射光时，可以确定可穿戴设备附近有物体。当检测到不充分的反射光时，可穿戴设备可以确定可穿戴设备附近没有物体。可穿戴设备可以利用接近光传感器180G检测用户手持可穿戴设备贴近耳朵通话，以便自动熄灭屏幕达到省电的目的。接近光传感器180G也可用于皮套模式，口袋模式自动解锁与锁屏。The distance sensor 180F is used to measure the distance. Wearables can measure distance via infrared or laser light. In some embodiments, when shooting a scene, the wearable device can use the distance sensor 180F for distance measurement to achieve fast focusing. Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes. The light emitting diodes may be infrared light emitting diodes. Wearable devices emit infrared light outwards through light-emitting diodes. Wearable devices use photodiodes to detect reflected infrared light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object in the vicinity of the wearable device. When insufficient reflected light is detected, the wearable device may determine that there are no objects near the wearable device. The wearable device can use the proximity light sensor 180G to detect that the user holds the wearable device close to the ear to make a call, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode, automatic unlock and lock screen in pocket mode.

环境光传感器180L用于感知环境光亮度。可穿戴设备可以根据感知的环境光亮度自适应调节显示屏194亮度。环境光传感器180L也可用于拍照时自动调节白平衡。环境光传感器180L还可以与接近光传感器180G配合，检测可穿戴设备是否在口袋里，以防误触。指纹传感器180H用于采集指纹。可穿戴设备可以利用采集的指纹特性实现指纹解锁，访问应用锁，指纹拍照，指纹接听来电等。The ambient light sensor 180L is used for sensing ambient light brightness. The wearable device can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the wearable device is in the pocket to prevent accidental touch. The fingerprint sensor 180H is used to collect fingerprints. Wearable devices can use the collected fingerprint features to unlock fingerprints, access application locks, take pictures with fingerprints, answer incoming calls with fingerprints, etc.

温度传感器180J用于检测温度。在一些实施例中，可穿戴设备利用温度传感器180J检测的温度，执行温度处理策略。例如，当温度传感器180J上报的温度超过阈值，可穿戴设备执行降低位于温度传感器180J附近的处理器的性能，以便降低功耗实施热保护。在另一些实施例中，当温度低于另一阈值时，可穿戴设备对电池142加热，以避免低温导致可穿戴设备异常关机。在其他一些实施例中，当温度低于又一阈值时，可穿戴设备对电池142的输出电压执行升压，以避免低温导致的异常关机。The temperature sensor 180J is used to detect temperature. In some embodiments, the wearable device utilizes the temperature detected by the temperature sensor 180J to implement a temperature handling strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the wearable device may reduce the performance of a processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection. In some other embodiments, when the temperature is lower than another threshold, the wearable device heats the battery 142 to avoid abnormal shutdown of the wearable device due to low temperature. In some other embodiments, when the temperature is lower than another threshold, the wearable device boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

触摸传感器180K，也称“触控面板”。触摸传感器180K可以设置于显示屏194，由触摸传感器180K与显示屏194组成触摸屏，也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器，以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中，触摸传感器180K也可以设置于可穿戴设备的表面，与显示屏194所处的位置不同。 Touch sensor 180K, also known as "touch panel". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the wearable device, which is different from the position of the display screen 194 .

骨传导传感器180M可以获取振动信号。在一些实施例中，骨传导传感器180M可以获取人体声部振动骨块的振动信号。骨传导传感器180M也可以接触人体脉搏，接收血压跳动信号。The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 180M can also contact the human pulse and receive the blood pressure beating signal.

按键190包括开机键，音量键等。按键190可以是机械按键。也可以是触摸式按键。可穿戴设备可以接收按键输入，产生与可穿戴设备的用户设置以及功能控制有关的键信号输入。马达191可以产生振动提示。马达191可以用于来电振动提示，也可以用于触摸振动反馈。例如，作用于不同应用(例如拍照，音频播放等)的触摸操作，可以对应不同的振动反馈效果。指示器192可以是指示灯，可以用于指示充电状态，电量变化，也可以用于指示消息，未接来电，通知等。SIM卡接口195用于连接SIM卡。SIM卡可以通过***SIM卡接口195，或从SIM卡接口195拔出，实现和可穿戴设备的接触和分离。The keys 190 include a power key, a volume key and the like. The key 190 may be a mechanical key. It can also be a touch button. The wearable device can receive key input and generate key signal input related to user settings and function control of the wearable device. The motor 191 can generate a vibrating reminder. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations applied to different applications (such as taking pictures, playing audio, etc.) may correspond to different vibration feedback effects. The indicator 192 can be an indicator light, and can be used to indicate charging status, power change, and can also be used to indicate messages, missed calls, notifications, and the like. The SIM card interface 195 is used for connecting a SIM card. The SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation with the wearable device.

可以理解的是，图1所示的部件并不构成对可穿戴设备的具体限定。本发明实施例中的可穿戴设备可以包括比图1中更多或更少的部件。此外，图1中的部件之间的组合/连接关系也是可以调整修改的。It can be understood that the components shown in FIG. 1 do not specifically limit the wearable device. The wearable device in the embodiment of the present invention may include more or less components than those shown in FIG. 1 . In addition, the combination/connection relationship between the components in FIG. 1 can also be adjusted and modified.

为了方便描述，下文实施例以可穿戴设备是智能手环(简称手环)为例进行介绍。For the convenience of description, the following embodiments take the wearable device as a smart bracelet (bracelet for short) as an example for introduction.

实施例一Embodiment one

请参见图2，为本申请实施例提供的睡眠状态检测方法的流程示意图。该方法可以由可穿戴设备执行，或者由与可穿戴设备连接的电子设备(比如手机)执行。下文主要以可穿戴设备执行为例进行介绍。如图2所示，所述方法的流程包括：Please refer to FIG. 2 , which is a schematic flowchart of a method for detecting a sleep state provided in an embodiment of the present application. The method can be executed by a wearable device, or by an electronic device (such as a mobile phone) connected to the wearable device. The following mainly takes the implementation of wearable devices as an example for introduction. As shown in Figure 2, the flow process of the method includes:

S201，可穿戴设备判断所述可穿戴设备当前是睡眠模式还是非睡眠模式。S201. The wearable device judges whether the wearable device is currently in a sleep mode or a non-sleep mode.

示例性的，睡眠模式是指用于检测睡眠状态的模式，非睡眠模式是指用于检测日常运动状态(比如跑步)的模式。其中，睡眠模式和非睡眠模式下可穿戴设备后台的计算过程不同，具体过程将在后文介绍。Exemplarily, the sleep mode refers to a mode for detecting a sleep state, and the non-sleep mode refers to a mode for detecting a daily exercise state (such as running). Among them, the calculation process in the background of the wearable device in sleep mode and non-sleep mode is different, and the specific process will be introduced later.

应理解，在S201之前，还可以包括步骤：设置可穿戴设备处于睡眠模式或非睡眠模式。具体的实现方式包括但不限定于如下至少一种：It should be understood that before S201, a step may also be included: setting the wearable device in a sleep mode or a non-sleep mode. Specific implementation methods include but are not limited to at least one of the following:

一种可实现方式为，可穿戴设备可以自动的进入睡眠模式或非睡眠模式。比如，当可穿戴设备检测到当前时间为睡觉时间(比如凌晨12点-1点)时，自动进入睡眠模式；当可穿戴设备检测到当前时间为起床时间(比如，早上8点至9点)时，自动进入非睡眠模式。其中，睡觉时间和/或起床时间的具体值可以是可穿戴设备的***默认设置的值，或者，也可以由用户手工输入可穿戴设备设置，本申请实施例不作限定。One possible implementation manner is that the wearable device can automatically enter a sleep mode or a non-sleep mode. For example, when the wearable device detects that the current time is sleep time (such as 12:00-1:00 am), it will automatically enter the sleep mode; when the wearable device detects that the current time is the wake-up time (for example, 8:00-9:00 am) , automatically enters non-sleep mode. Wherein, the specific value of the sleep time and/or wake-up time may be a default value set by the system of the wearable device, or may also be manually input by the user into the setting of the wearable device, which is not limited in this embodiment of the present application.

另一种可实现方式为，用户可以手动的设置可穿戴设备进入睡眠模式或非睡眠模式。示例性的，请参见图3中的(a)，手环显示屏上显示模式设置图标，当检测到针对该图标的操作指令时，显示如图3中的(b)的睡眠模式的标识和非睡眠模式的标识，用户可以选择其中一个标识实现设置某种模式。或者，可穿戴设备与手机连接，手机可以控制可穿戴设备(比如，手机上设置app，该app用于控制可穿戴设备)，那么用户可以在手机上设置可穿戴设备进入睡眠模式或非睡眠模式。下文的实施例以用户在手机上控制可穿戴设备设置睡眠模式或非睡眠模式为例进行介绍。Another possible way is that the user can manually set the wearable device to enter the sleep mode or the non-sleep mode. For example, please refer to (a) in FIG. 3 , the mode setting icon is displayed on the display screen of the wristband, and when an operation instruction for the icon is detected, the logo and the sleep mode of (b) in FIG. 3 are displayed. The logo of the non-sleep mode, the user can select one of the logos to set a certain mode. Or, the wearable device is connected to the mobile phone, and the mobile phone can control the wearable device (for example, an app is set on the mobile phone, and the app is used to control the wearable device), then the user can set the wearable device on the mobile phone to enter sleep mode or non-sleep mode . The following embodiments are introduced by taking the user controlling the wearable device on the mobile phone to set the sleep mode or the non-sleep mode as an example.

当可穿戴设备处于睡眠模式时，可穿戴设备中睡眠标记(flag)被置为第一标记(比如1)，当可穿戴设备处于非睡眠模式时，可穿戴设备中睡眠标记被设置为第二标记(比如0)。因此，S201中可穿戴设备可以读取睡眠标记，如果睡眠标记是第一标记，确定当前处于睡眠模式，如果睡眠标识是第二标记，确定当前处于非睡眠模式。其中，睡眠标记(flag)可以存储在存储器中，不在可穿戴设备的显示屏上显示；或者，也可以在可穿戴设备的显示屏上显示，显示位置可以任意，比如显示在状态栏(用于显示电量、运营商信息、无线信号标记等)中。When the wearable device is in sleep mode, the sleep flag (flag) in the wearable device is set to the first flag (such as 1), and when the wearable device is in non-sleep mode, the sleep flag in the wearable device is set to the second flag (such as 0). Therefore, in S201, the wearable device can read the sleep flag, if the sleep flag is the first flag, it is determined that it is currently in the sleep mode, and if the sleep flag is the second flag, it is determined that it is currently in the non-sleep mode. Wherein, the sleep flag (flag) can be stored in the memory and not displayed on the display screen of the wearable device; or, it can also be displayed on the display screen of the wearable device, and the display position can be arbitrary, such as displayed in the status bar (for Display power, operator information, wireless signal mark, etc.).

需要说明的是，S201是可选步骤，可以执行或不执行，本申请实施例不作限定。It should be noted that S201 is an optional step, which may or may not be performed, and is not limited in this embodiment of the present application.

S202，如果是睡眠模式，可穿戴设备判断是否为睡眠模式中的非佩戴模式。S202, if it is a sleep mode, the wearable device judges whether it is a non-wearing mode in the sleep mode.

在本申请实施例中，睡眠模式包括佩戴模式和非佩戴模式，如果用户选择佩戴模式，可以使用佩戴模式下的睡眠检测流程，如果用户选择非佩戴模式，可穿戴设备可以使用非佩戴模式下的睡眠检测流程。In the embodiment of this application, the sleep mode includes wearing mode and non-wearing mode. If the user chooses the wearing mode, the sleep detection process in the wearing mode can be used. If the user chooses the non-wearing mode, the wearable device can use the non-wearing mode. Sleep detection process.

应理解，如果S201不执行，S202替换为可穿戴设备判断是否为非佩戴模式。It should be understood that if S201 is not executed, S202 is replaced by the wearable device judging whether it is in the non-wearing mode.

一种可实现方式为，可穿戴设备确定当前是睡眠模式时，可以自动进入非佩戴模式，比如，用户或***提前设置了当前是睡眠模式时，自动进入非佩戴模式。One possible implementation method is that when the wearable device determines that it is currently in the sleep mode, it can automatically enter the non-wearing mode. For example, when the user or the system has set the current sleep mode in advance, it automatically enters the non-wearing mode.

另一种可实现方式为，用户可以设置佩戴模式或非佩戴模式。示例性的，请参见图4中的(a)，当手环检测到针对睡眠模式标识的点击操作时，确定进入睡眠模式，显示如图4中的(b)的佩戴模式的标识和非佩戴模式的标识，用户可以通过选择某个标识来设置某种模式。Another possible way is that the user can set the wearing mode or the non-wearing mode. For example, please refer to (a) in Figure 4, when the bracelet detects a click operation on the sleep mode logo, it is determined to enter the sleep mode, and the logo of the wearing mode and the non-wearing mode are displayed as shown in (b) in Figure 4 The logo of the mode, the user can set a certain mode by selecting a logo.

又一种可实现方式为，可穿戴设备确定当前是睡眠模式时，检测当前是否佩戴于用户手腕上，如果是，进入佩戴模式，否则，进入非佩戴模式。比如，可穿戴设备可以通过设置在可穿戴设备上的电极片判断可穿戴设备是否佩戴到用户手腕上，比如当电极片可以感应到用户身体信号，确定可穿戴设备佩戴在用户手腕上，否则，确定可穿戴设备未佩戴在用户手腕上。或者，可穿戴设备上运动传感器检测可穿戴设备是否处于运动状态，如果处于运动状态，确定可穿戴设备佩戴在用户手腕上，否则确定可穿戴设备未佩戴在用户手腕上。Yet another possible implementation is that when the wearable device determines that it is currently in the sleep mode, it detects whether it is currently worn on the user's wrist, and if so, enters the wearing mode; otherwise, enters the non-wearing mode. For example, the wearable device can determine whether the wearable device is worn on the user's wrist through the electrode pads set on the wearable device. For example, when the electrode pad can sense the user's body signal, it is determined that the wearable device is worn on the user's wrist; otherwise, Make sure the wearable is not on the user's wrist. Alternatively, the motion sensor on the wearable device detects whether the wearable device is in a motion state, and if it is in a motion state, it is determined that the wearable device is worn on the user's wrist, otherwise it is determined that the wearable device is not worn on the user's wrist.

如果是佩戴模式下，可穿戴设备执行佩戴模式下睡眠状态检测流程。比如，可穿戴设备上的电极片感应用户身体信号(比如心率、脉搏等)，通过身体信号判断睡眠状态，比如，心率越高，睡眠状态越差。如果是非佩戴模式，可以接着执行如下步骤。If it is in wearing mode, the wearable device executes the sleep state detection process in wearing mode. For example, the electrodes on the wearable device sense the user's body signal (such as heart rate, pulse, etc.), and judge the sleep state through the body signal. For example, the higher the heart rate, the worse the sleep state. If it is not wearing mode, you can follow the steps below.

S203，如果是非佩戴模式，可穿戴设备提示用户是否固定好设备。S203, if it is in the non-wearing mode, the wearable device prompts the user whether to fix the device.

示例性的，请参见图5A中的(a)，当手机检测到针对非佩戴模式标识的点击操作时，确定进入非佩戴模式，显示如图5A中的(b)的提示信息：设备是否已固定，还显示两个按键。当手机检测到用户选择“是”按键时，确定可穿戴设备固定好。当然，手机还可以提示用户将设备固定在枕头、床垫、床褥、用户睡衣等位置上。For example, please refer to (a) in FIG. 5A. When the mobile phone detects a click operation on the non-wearing mode logo, it is determined to enter the non-wearing mode, and a prompt message as shown in (b) in FIG. 5A is displayed: Is the device Fixed, also showing two keys. When the mobile phone detects that the user selects the "Yes" button, it determines that the wearable device is fixed. Of course, the mobile phone can also prompt the user to fix the device on pillows, mattresses, mattress pads, user pajamas, etc.

示例性的，当可穿戴设备为手环时，手环上具有可拆卸的模块，该模块上具有加持装置，可以用于加持在枕头、睡衣、床垫或床褥上。或者，用户购买手环时可以一并购买或商家赠送用于绑定手环的装置，使用该绑定装置将手环固定在枕头、睡衣、床垫或床褥上。Exemplarily, when the wearable device is a bracelet, the bracelet has a detachable module, and the module has a holding device, which can be used to hold on a pillow, pajamas, mattress or bedding. Or, when the user buys the wristband, he can purchase it together or the merchant presents a device for binding the wristband, and use the binding device to fix the wristband on the pillow, pajamas, mattress or bedding.

S204，可穿戴设备执行非佩戴模式检测流程检测用户睡眠状态。S204的具体实现过程将在后文详细介绍。S204, the wearable device executes a non-wearing mode detection process to detect the sleep state of the user. The specific implementation process of S204 will be described in detail later.

S205，可穿戴设备输出检测结果。S205, the wearable device outputs a detection result.

可选的，可穿戴设备可以直接输出检测结果，或者，将检测结果发送至手机，通过手机展示检测结果。Optionally, the wearable device can directly output the detection result, or send the detection result to the mobile phone, and display the detection result through the mobile phone.

可选的，在S205之前，还可以包括步骤：停止睡眠状态检测。一种可实现方式为，可穿戴设备可以自动停止睡眠状态检测，比如，在特定时间(比如早上8点)自动停止检测(如退出睡眠模式)，然后执行S205输出检测结果。其中，特定时间可以是用户设置的或手环***默认设置的。另一种可实现方式为，用户在可穿戴设备或与可穿戴设备连接的手机上手动停止睡眠状态检测。例如，请参见图5B中的(a)，手机上显示提示信息：您好，是否停止睡眠检测，还显示两个按键。当手机检测到选择“是”按键的操作时，执行S205后显示如图5B中的(b)所示的界面，该界面中包括检测结果。Optionally, before S205, a step may also be included: stop sleep state detection. One possible way is that the wearable device can automatically stop the sleep state detection, for example, automatically stop the detection (such as exiting the sleep mode) at a specific time (such as 8:00 in the morning), and then execute S205 to output the detection result. Wherein, the specific time may be set by the user or set by default by the bracelet system. Another possible way is that the user manually stops the sleep state detection on the wearable device or the mobile phone connected to the wearable device. For example, please refer to (a) in FIG. 5B , a prompt message is displayed on the mobile phone: Hello, whether to stop sleep detection, and two buttons are also displayed. When the mobile phone detects the operation of selecting the "Yes" button, an interface as shown in (b) in FIG. 5B is displayed after executing S205, and the interface includes the detection result.

图5B中以检测结果是用于表征睡眠状态的分数值为例，分数值越高代表睡眠质量越好。应理解的是，检测结果还可以是其他表现形式，比如，“优”、“良”、“差”等质量等级、睡眠曲线等等，本申请实施例不作限定。比如，参见图5C为检测结果的一种示例，检测结果为睡眠质量报告，其中包括睡眠质量曲线，用于表征在不同时间用户的睡眠质量，还包括历史记录，比如，入睡时间、睡眠时长、深睡时长、浅睡时长等。In FIG. 5B , it is taken as an example that the detection result is a score value used to represent a sleep state, and a higher score value represents a better sleep quality. It should be understood that the test results may also be in other forms, such as quality levels such as "excellent", "good", and "poor", sleep curves, etc., which are not limited in this embodiment of the present application. For example, see FIG. 5C for an example of the detection result. The detection result is a sleep quality report, which includes a sleep quality curve, which is used to characterize the user's sleep quality at different times, and also includes historical records, such as time to fall asleep, sleep duration, Duration of deep sleep, duration of light sleep, etc.

请参见图6，为上述图2中S204的细化过程，具体来说，可穿戴设备执行非佩戴模式的检测流程来检测用户睡眠状态包括两个检测分支中的至少一个，其中，第一分支是通过运动信号确定用户睡眠状态的第一检测结果，第二分支是根据声音信号确定用户睡眠状态的第二检测结果，然后根据第一检测结果和/或第二检测结果得到最终检测结果。如图6所示，具体包括如下步骤：Please refer to FIG. 6, which is the refinement process of S204 in FIG. 2 above. Specifically, the wearable device performs the non-wearing mode detection process to detect the user's sleep state, including at least one of the two detection branches, wherein the first branch It is the first detection result of determining the sleep state of the user through the motion signal, the second branch is the second detection result of determining the sleep state of the user according to the sound signal, and then the final detection result is obtained according to the first detection result and/or the second detection result. As shown in Figure 6, it specifically includes the following steps:

步骤1，可穿戴设备采集运动信号。Step 1, the wearable device collects motion signals.

假设可穿戴设备被固定在床褥上，如果用户睡觉时有翻身、起身等行为会带动床褥运动，进而带动可穿戴设备运动，这样的话，可穿戴设备可以采集到运动信号。Assuming that the wearable device is fixed on the mattress, if the user turns over or gets up while sleeping, the mattress will move, which in turn will drive the wearable device to move. In this way, the wearable device can collect motion signals.

示例性的，所述运动信号包括但不限定于位移、加速度、速度、角速度、角加速度等参数。比如，可穿戴设备中的运动传感器(加速度计、陀螺仪等)可以采集运动信号。Exemplarily, the motion signal includes, but is not limited to, parameters such as displacement, acceleration, velocity, angular velocity, and angular acceleration. For example, motion sensors (accelerometers, gyroscopes, etc.) in wearable devices can collect motion signals.

步骤2，可穿戴设备根据运动信号识别体动特征。In step 2, the wearable device recognizes body movement characteristics according to the movement signal.

示例性的，所述体动特征比如包括翻身、起身、抖动等。假设可穿戴设备采集的运动速度大于第一阈值，确定用户起身，或者，确定运动速度小于第二阈值，确定用户翻身。Exemplarily, the body motion features include, for example, turning over, getting up, shaking, and the like. Assuming that the motion speed collected by the wearable device is greater than the first threshold, it is determined that the user stands up; or, if it is determined that the motion speed is smaller than the second threshold, it is determined that the user turns over.

步骤3，可穿戴设备根据体动特征确定第一检测结果。Step 3, the wearable device determines the first detection result according to the body motion feature.

一种可实现方式为，可穿戴设备实时的检测体动特征，确定一段时间内发生体动特征(比如翻身)的次数和/或频率，根据次数和/或频率确定第一检测结果。比如，次数越高和/或频率越高，第一检测结果越低。One possible way is that the wearable device detects the body movement characteristics in real time, determines the number and/or frequency of body movement characteristics (such as turning over) within a period of time, and determines the first detection result according to the number and/or frequency. For example, the higher the number and/or the higher the frequency, the lower the first detection result.

另一种可实现方式为，可穿戴设备实时的检测体动特征，确定体动特征的强度，根据所述强度确定第一检测结果。以体动特征是翻身为例，通过运动信号可以确定出翻身的强度，所述强度比如包括翻身角度(运动传感器检测到的角度变化)、翻身速度(运动传感器检测到的角速度)等等，如果强度越大，第一检测结果越低，说明睡眠质量越差。Another possible implementation manner is that the wearable device detects the body motion feature in real time, determines the intensity of the body motion feature, and determines the first detection result according to the intensity. Taking the body motion feature of turning over as an example, the strength of turning over can be determined through the motion signal, such as including turning angle (angle change detected by the motion sensor), turning speed (angular velocity detected by the motion sensor), etc., if The greater the intensity, the lower the first detection result, indicating that the sleep quality is worse.

上面的两种方式可以单独使用，也可以结合使用，本申请实施例不作限定。The above two methods can be used alone or in combination, which is not limited in this embodiment of the present application.

示例性的，第一检测结果可以是分数值，那么次数越高和/或频率越高，分数越低。比如，可穿戴设备中存储有体动特征次数和/或频率为分数值之间的对应关系，可穿戴设备可以根据该对应关系确定分数值。Exemplarily, the first detection result may be a score value, and the higher the number of times and/or the higher the frequency, the lower the score. For example, the wearable device stores a corresponding relationship between the times and/or frequencies of body movement features as fractional values, and the wearable device may determine the fractional value according to the corresponding relationship.

步骤4，可穿戴设备采集声音信号。Step 4, the wearable device collects the sound signal.

步骤5，可穿戴设备从采集的声音信号中提取用户的鼾声、呼吸声等声音特征。In step 5, the wearable device extracts sound features such as the user's snoring sound and breathing sound from the collected sound signal.

可以理解的是，采集的声音信号中包括用户睡眠时产生的呼吸声、鼾声等。一般，睡觉时房间内是安静环境，所以呼吸声或鼾声较易识别。It can be understood that the collected sound signals include breathing sounds, snoring sounds and the like generated by the user during sleep. Generally, the room is a quiet environment when sleeping, so the sound of breathing or snoring is easier to recognize.

步骤6，可穿戴设备根据提取出的声音信号确定第二检测结果。Step 6, the wearable device determines a second detection result according to the extracted sound signal.

一种可实现方式为，可穿戴设备实时的采集声音信号，可以提取出持续的呼吸声或鼾声，可以根据呼吸声或鼾声的次数或频率，确定第二检测结果。比如，次数越高和/或频率越高，第二检测结果越低。示例性的，第二检测结果可以是分数值，那么次数越高和/或频率越高，分数越低。比如，可穿戴设备中存储有呼吸声或鼾声次数和/或频率为分数值之间的对应关系，可穿戴设备可以根据该对应关系确定分数值。One possible way is that the wearable device collects sound signals in real time, can extract continuous breathing sound or snoring sound, and can determine the second detection result according to the number or frequency of breathing sound or snoring sound. For example, the higher the number and/or the higher the frequency, the lower the second detection result. Exemplarily, the second detection result may be a score value, and the higher the number of times and/or the higher the frequency, the lower the score. For example, the number and/or frequency of breathing sounds or snoring sounds is stored in the wearable device as a fractional relationship, and the wearable device can determine the fractional value according to the corresponding relationship.

另一种可实现方式为，可穿戴设备可以根据呼吸声或鼾声的声音强度确定第二检测结果。比如，声音强度越大，分数值越低。Another possible implementation manner is that the wearable device may determine the second detection result according to the sound intensity of the breathing sound or the snoring sound. For example, the louder the sound intensity, the lower the score value.

需要说明的是，上面的步骤1至步骤3，与步骤4至步骤6之间的执行顺序不作限定，可以先通过运动信号确定第一检测结果，再根据声音信号确定第二检测结果；或者，先根据声音信号确定第二检测结果，再通过运动信号确定第一检测结果；或者，二者同时进行，本申请实施例不作限定。It should be noted that the above steps 1 to 3, and the order of execution between steps 4 to 6 are not limited, the first detection result can be determined through the motion signal first, and then the second detection result can be determined according to the sound signal; or, The second detection result is first determined according to the sound signal, and then the first detection result is determined through the motion signal; or, both are performed simultaneously, which is not limited in this embodiment of the present application.

步骤7，可穿戴设备根据第一检测结果和/或第二检测结果得到最终检测结果。Step 7, the wearable device obtains the final detection result according to the first detection result and/or the second detection result.

上述第一分支和第二分支可以只有其中一个，或者两个都有。如果只有第一分支，那么步骤7中最终检测结果等于第一检测结果，如果只有第二分支，那么步骤7中最终检测结果等于第二检测结果，如果第一分支和第二分支都有，那么步骤7是融合第一检测结果和第二检测结果得到最终检测结果。下面介绍第一检测结果和第二检测结果融合得到最终检测结果的过程。There may be only one of the above-mentioned first branch and the second branch, or both. If there is only the first branch, then the final detection result in step 7 is equal to the first detection result, if there is only the second branch, then the final detection result in step 7 is equal to the second detection result, if both the first branch and the second branch have, then Step 7 is to fuse the first detection result and the second detection result to obtain the final detection result. The following describes the process of fusing the first detection result and the second detection result to obtain the final detection result.

第一种可实现方式为，第一检测结果是第一分数，第二检测结果是第二分数，最终检测结果可以是第一分数和第二分数的平均值或者加权平均值。以加权平均为例，如果第一分支的权重高于第二分支，那么第一分数对应的第一权重可以高于第二分数对应的第二权重。比如，最终检测结果＝P1*X1+P2*X2，其中，X1是第一分数，X2是第二分数，P1是第一权重，P2是第二权重，P1高于P2。其中，第一分支和第二分支之间的权重关系可以是***默认设置的，或者，用户设置的。A first implementation manner is that the first detection result is a first score, the second detection result is a second score, and the final detection result may be an average or a weighted average of the first score and the second score. Taking the weighted average as an example, if the weight of the first branch is higher than that of the second branch, the first weight corresponding to the first score may be higher than the second weight corresponding to the second score. For example, the final detection result=P1*X1+P2*X2, where X1 is the first score, X2 is the second score, P1 is the first weight, P2 is the second weight, and P1 is higher than P2. Wherein, the weight relationship between the first branch and the second branch may be set by default by the system, or set by the user.

上面的方式中，第一检测结果和第二检测结果可以是一晚上的总分数。在另一些实施例中，一晚上可以划分为多个时间段，还可以将每个时间段内的第一检测结果和第二检测结果统计一次，然后根据多个时间段的统计结果得到最终检测结果，具体参见下面的第二种实现方式。In the above manner, the first detection result and the second detection result may be the total score for one night. In other embodiments, one night can be divided into multiple time periods, and the first detection result and the second detection result in each time period can be counted once, and then the final detection can be obtained according to the statistical results of multiple time periods As a result, refer to the second implementation manner below for details.

第二种实现方式为，第一分支(如步骤3)周期性的检测得到第一检测结果，第二分支(如步骤6)周期性的检测得到第二检测结果，可以根据每个周期内的第一检测结果和第二检测结果得到该周期内的第三检测结果，这样可以得到多个周期内的第三检测结果，根据多个周期内的第三检测结果得到最终检测结果。比如，最终检测结果是多个第三检测结果的平均值或加权平均值。示例性的，请参见下表1：The second kind of implementation is that the periodic detection of the first branch (such as step 3) obtains the first detection result, and the periodic detection of the second branch (such as step 6) obtains the second detection result. The first detection result and the second detection result obtain the third detection result in the cycle, so that the third detection results in multiple cycles can be obtained, and the final detection result is obtained according to the third detection results in multiple cycles. For example, the final detection result is the average or weighted average of multiple third detection results. For example, please refer to Table 1 below:

表1Table 1

以上表1为例，在周期1内，第一分支得到第一检测结果是80分，第二分支得到第二检测结果是90分，那么第三检测结果是85分(以第三检测结果是第一检测结果和第二检测结果的平均值为例)。在周期2内，第一分支得到第一检测结果是70分，第二分支得到第二检测结果是80分，那么第三检测结果是75分(以第三检测结果是第一检测结果和第二检测结果的平均值为例)。周期1内的第三检测结果(即85分)与周期2内的第三检测结果(即75分)的平均值为最终检测结果。可理解的是，上表1以两个周期为例，实际上可以包括更多周期，周期越多，计算越精准。The above table 1 is an example, in cycle 1, the first branch obtains the first test result is 80 points, the second branch obtains the second test result is 90 points, so the third test result is 85 points (with the third test result being The average value of the first test result and the second test result is taken as an example). In cycle 2, the first branch obtains the first detection result and is 70 points, the second branch obtains the second detection result and is 80 points, so the third detection result is 75 points (the first detection result and the second detection result are obtained by the third detection result. The average of the two test results is taken as an example). The average of the third test result (ie 85 points) in cycle 1 and the third test result (ie 75 points) in cycle 2 is the final test result. It is understandable that the above Table 1 takes two cycles as an example, but actually may include more cycles, and the more cycles, the more accurate the calculation.

实施例二Embodiment two

本实施例二与上面实施例一的区别在于，本实施例二考虑到有其它人与用户同睡的情况，这种情况下，可穿戴设备可以仅检测该用户的睡眠状态。简单来说，本实施例二的应用场景为多人同睡环境下，检测特定用户(或目标用户)的睡眠状态。The difference between the second embodiment and the first embodiment above is that the second embodiment takes into account the fact that other people sleep with the user. In this case, the wearable device can only detect the sleep state of the user. To put it simply, the application scenario of the second embodiment is to detect the sleep status of a specific user (or target user) in an environment where multiple people are sleeping together.

请参见图7，为本实施例提供的一种睡眠状态检测方法的流程示意图。图7与前面实施例一的图2的区别在于：在S202与S203之间增加步骤S202-1和S202-3。为了节省篇幅，下面只介绍图7中的S202-1至S202-3，对于图7中的其它步骤可以参见图2的介绍。Please refer to FIG. 7 , which is a schematic flowchart of a sleep state detection method provided in this embodiment. The difference between FIG. 7 and FIG. 2 of the first embodiment is that steps S202-1 and S202-3 are added between S202 and S203. In order to save space, only S202-1 to S202-3 in FIG. 7 will be introduced below, and other steps in FIG. 7 can be referred to the introduction in FIG. 2 .

S202-1，如果是非佩戴模式，可穿戴设备提示用户周围是否有其它人。S202-1, if it is in the non-wearing mode, the wearable device prompts the user whether there are other people around.

S202-2，如果确定周围有其他人，则提示录制目标用户的一段声音。S202-2. If it is determined that there are other people around, prompt to record a sound of the target user.

需要说明的是，本实施例二考虑到如果是多人环境，那么可穿戴设备采集的声音信号中包括多人的声音信号，为了检测特定用户的睡眠状态，需要从采集的包括多人的声音信号中确定出目标用户的声音信号。其中，目标用户是指多人情况下要检测睡眠状态的用户。如果有多人，那么要检测哪一个人的睡眠状态，则录入哪个人的声音。It should be noted that the second embodiment considers that if it is a multi-person environment, the sound signals collected by the wearable device include the sound signals of multiple people. In order to detect the sleep state of a specific user, it is necessary to collect the The sound signal of the target user is determined from the signal. Wherein, the target user refers to a user who needs to detect a sleep state when there are multiple people. If there are many people, which person's sleep state is to be detected, and whose voice is recorded.

一种实现方式为，请参见图8A中的(a)，当手机检测到针对非佩戴模式标识的操作时，显示如图8A中的(b)所示的提示信息：周围是否有其它人，还显示两个按键。当检测到针对“是”按键的操作时，确定用户周围存在其它人，显示如图8A中的(c)所示的提示信息：您好，记录10s呼吸声，还可以显示提示信息“长按按键录制”。当录制完成之后，显示如图8A中的(d)所示的界面。或者，上面图8A中的界面显示顺序可以调整，比如，请参见图8A中的(a)，当手环检测到针对非佩戴模式标识的操作时，先显示图8A中的(d)所示的界面，当选择“是”时，再显示图8A中的(b)所示的界面。One implementation is, please refer to (a) in FIG. 8A , when the mobile phone detects an operation for the non-wearing mode logo, it displays a prompt message as shown in (b) in FIG. 8A : whether there are other people around, Two keys are also shown. When the operation on the "Yes" button is detected, it is determined that there are other people around the user, and a prompt message as shown in (c) in Figure 8A is displayed: Hello, record 10s of breathing sound, and a prompt message "long press keystroke recording". After the recording is completed, an interface as shown in (d) in FIG. 8A is displayed. Alternatively, the display order of the interface in Figure 8A above can be adjusted, for example, please refer to (a) in Figure 8A, when the bracelet detects an operation for the non-wearing mode logo, it will first display (d) in Figure 8A interface, when “Yes” is selected, the interface shown in (b) in FIG. 8A is displayed again.

另一种可实现方式为，请参见图8B中的(a)，当手机检测到针对非佩戴模式标识的操作时，显示如图8B中的(b)所示的提示信息：您好，记录10s呼吸声，还可以显示提示信息“长按按键录制”，以及提示信息“跳过”，指用户确认如果周围没有其他人可以选择跳过这个设置过程。当录制完成或点击跳过按键之后，可以显示如图8B中的(c)所示的界面。Another possible way is, please refer to (a) in FIG. 8B. When the mobile phone detects an operation for the non-wearing mode logo, it displays a prompt message as shown in (b) in FIG. 8B: Hello, record 10s breathing sound, and the prompt message "long press the button to record" and the prompt message "skip" can also be displayed, which means that the user confirms that if there is no one else around, he can choose to skip this setting process. When the recording is completed or the skip button is clicked, an interface as shown in (c) in FIG. 8B may be displayed.

本实施例二增加了S202-1和S202-2之后，S204的实现原理与图2中S204的实现原理(即图6的流程)有不同。具体来说，在图6所示的步骤5可以细化为：根据事先录制的呼吸声从采集的声音信号中提取与所述事先录制的呼吸声匹配的呼吸声。这是因为，周围存在其它人的情况下，可穿戴设备采集的声音信号中包括所有人的呼吸声，一般来说，每个人的呼吸声具有特定的特色(比如强度、频率、持续时长等)，所以根据事先录制的呼吸声可以从采集的声音信号中识别出与目标用户的呼吸声，目标用户是指多人情况下要检测睡眠状态的用户，比如，录入的是哪个用户的呼吸声，那么提取出的就是哪个用户的呼吸声。After S202-1 and S202-2 are added in the second embodiment, the implementation principle of S204 is different from the implementation principle of S204 in FIG. 2 (that is, the flow chart in FIG. 6 ). Specifically, step 5 shown in FIG. 6 may be refined as: extracting the breathing sound matching the pre-recorded breathing sound from the collected sound signal according to the pre-recorded breathing sound. This is because, when there are other people around, the sound signal collected by the wearable device includes the breathing sound of all people. Generally speaking, the breathing sound of each person has specific characteristics (such as intensity, frequency, duration, etc.) , so according to the pre-recorded breathing sound, the breathing sound of the target user can be identified from the collected sound signals. The target user refers to the user who needs to detect the sleep state in the case of multiple people. Then the breathing sound of which user is extracted.

S202-3，提示用户将设备放置在目标用户的附近。S202-3. Prompt the user to place the device near the target user.

需要说明的是，本实施例二考虑到如果是多人环境，每个人睡觉时都可能会有翻身、起身等动作，都可能带动床褥运动(假设可穿戴设备固定在床褥上)，进而带动可穿戴设备运动，所以可穿戴设备采集的运动信号包括多人对应的运动信号，为了更为准确地检测特定用户的睡眠状态，可以提示用户将可穿戴设备放置在特定用户的附近。It should be noted that the second embodiment considers that if it is a multi-person environment, everyone may have actions such as turning over and getting up when sleeping, which may drive the movement of the mattress (assuming that the wearable device is fixed on the mattress), and then Drive the wearable device to move, so the motion signal collected by the wearable device includes motion signals corresponding to multiple people. In order to more accurately detect the sleep state of a specific user, the user can be prompted to place the wearable device near the specific user.

一种可实现方式为，请参见图9中的(a)，当手机检测到用户选择非佩戴模式时，显示如图9中的(b)所示的界面，该界面用于提示周围是否有其它人。如果是，则显示如图9中的(c)所示的界面，该界面提示用户录入呼吸声。录入完成之后，显示如图9中的(d)所示的界面，该界面中显示提示信息：是否固定好设备，以及将设备固定您在与其他人的中间并且靠近自己的一侧。One possible implementation is, please refer to (a) in Figure 9, when the mobile phone detects that the user selects the non-wearing mode, it displays an interface as shown in (b) in Figure 9, which is used to prompt whether there are others. If yes, an interface as shown in (c) in FIG. 9 is displayed, which prompts the user to record breathing sounds. After the entry is completed, the interface shown in (d) in Figure 9 is displayed, and the prompt information is displayed on the interface: whether the device is fixed, and the device is fixed between you and other people and on the side close to yourself.

示例性的，在图9中的(d)中手机检测到用户选择“是”之后，还可以显示如图9中的(e)所示的界面，该界面提示信息：设备在您的左侧还是右侧，假设手环检测到用户选择左侧，说明需要检测睡眠状态的特定用户在设备的右侧，那么当手环检测到运动信号时，将来自左侧的运动信号过滤，保留来自右侧的运动信号(即目标用户对应的运动信号)，然后根据所述保留的运动信号确定目标用户的第一检测结果。Exemplarily, after the mobile phone detects that the user selects "Yes" in (d) in Figure 9, the interface shown in (e) in Figure 9 can also be displayed, and the interface prompts information: the device is on your left Still on the right side, assuming that the wristband detects that the user selects the left side, it means that the specific user who needs to detect the sleep state is on the right side of the device, then when the wristband detects a motion signal, it will filter the motion signal from the left side and keep the motion signal from the right side. side motion signal (that is, the motion signal corresponding to the target user), and then determine the first detection result of the target user according to the retained motion signal.

假设将实施例一的方式称为单人单独检测模式，将实施例二的方式称为非单人单独检测模式(或多人单独检测模式)，即非单人环境下检测特定用户(即事先录入呼吸声的目标用户)的睡眠状态，用户可以选择使用单人单独检测模式或者非单人单独检测模式。Assume that the method of Embodiment 1 is called single-person detection mode, and the method of Embodiment 2 is called non-single-person detection mode (or multi-person detection mode), that is, to detect a specific user in a non-single-person environment (i.e. Record the sleep state of the target user) of the breathing sound, the user can choose to use the single person detection mode or the non-single person detection mode.

示例性的，请参见图10中的(a)，当手机检测到用户点击非佩戴模式的图标时，显示如图10中的(b)所示的提示信息：您好，请选择以下模式，还显示单人单独检测模式的图标和非单人单独检测的图标。当手机检测到用户选择单人单独检测模式时，确定是单人环境(即环境中没有其他人)，可以使用实施例一的方式(比如图2所示的流程)进行处理，比如，显示如图10中的(c)所示的界面。For example, please refer to (a) in Figure 10. When the mobile phone detects that the user clicks the icon of the non-wearing mode, a prompt message as shown in (b) in Figure 10 is displayed: Hello, please select the following mode, An icon for Solo detection mode and an icon for non-Solo detection are also displayed. When the mobile phone detects that the user selects the single-person detection mode, it is determined that it is a single-person environment (that is, there are no other people in the environment), and the method of Embodiment 1 (such as the process shown in Figure 2) can be used for processing. For example, the display is as follows The interface shown in (c) in FIG. 10 .

示例性的，请参见图11中的(a)，当手机检测到用户点击非佩戴模式的图标时，显示如图11中的(b)所示的提示信息：您好，请选择以下模式，还显示单人单独检测模式的图标和非单人单独检测的图标。当手机检测到用户选择非单人单独模式时，确定是非单人环境(即环境中有其他人)，则使用实施例二的方式(比如图7所示的流程)进行处理。比如，显示如图11中的(c)所示的界面，该界面内显示提示信息用于提示用户录入呼吸声。当录制完成或点击跳过按键时，显示如图11中的(d)所示的界面。For example, please refer to (a) in Figure 11. When the mobile phone detects that the user clicks the icon of the non-wearing mode, a prompt message as shown in (b) in Figure 11 is displayed: Hello, please select the following mode, An icon for Solo detection mode and an icon for non-Solo detection are also displayed. When the mobile phone detects that the user selects the non-single-person mode, it is determined that it is a non-single-person environment (that is, there are other people in the environment), and the method of Embodiment 2 (such as the process shown in FIG. 7 ) is used for processing. For example, an interface as shown in (c) in FIG. 11 is displayed, and prompt information is displayed in the interface for prompting the user to record breathing sounds. When the recording is completed or the skip button is clicked, an interface as shown in (d) in FIG. 11 is displayed.

实施例三Embodiment Three

前面的实施例一是单人单独检测模式，实施例二是非单人单独检测模式，本实施例三介绍非单人总体检测模式，与上面实施例二的区别在于，实施例二检测多人环境下某个特定用户的睡眠状态，本实施例三检测多人环境下所有人的总体睡眠状态。The previous embodiment 1 is a single-person detection mode, and embodiment 2 is a non-single-person detection mode. This embodiment 3 introduces a non-single-person overall detection mode. The difference from the above embodiment 2 is that embodiment 2 detects a multi-person environment For the sleep state of a specific user, the third embodiment detects the overall sleep state of all people in a multi-person environment.

本实施例三的实现原理与前面实施例一的实现原理相同。具体来说，多人环境下，每个人都可能会产生运动信号和声音信号，所以可穿戴设备采集的运动信号中包括多人的运动信号，可以理解为总运动信号，可穿戴设备采集的声音信号中包括多人的声音信号(比如多人的呼吸声)，可以理解为总声音信号。那么根据所述总运动信号确定用于表征多人总体睡眠状态的第一检测结果；那么，根据所述总声音信号确定用于表征多人总体睡眠状态的第二检测结果，根据第一检测结果和/或第二检测结果确定用于表征多人睡眠状态的最终检测结果。The realization principle of the third embodiment is the same as the realization principle of the foregoing first embodiment. Specifically, in a multi-person environment, everyone may generate motion signals and sound signals, so the motion signals collected by the wearable device include the motion signals of multiple people, which can be understood as the total motion signal, and the sound collected by the wearable device The signal includes sound signals of multiple people (such as breathing sounds of multiple people), which can be understood as a total sound signal. Then, determine the first detection result for characterizing the overall sleep state of multiple people according to the total motion signal; then, determine the second detection result for characterizing the overall sleep state of multiple people according to the total sound signal, according to the first detection result And/or the second detection result determines the final detection result used to characterize the sleep state of multiple people.

示例性的，请参见图12中的(a)所示，当手机检测到用户选择非佩戴模式时，显示如图12中的(b)所示的界面，该界面中包括单人单独检测模式、非单人单独检测模式、非单人总体检测模式、当手机检测到用户选择非单人总体检测模式之后，显示如图12中的(c)所示的界面，该界面用于提示设备是否固定好。For example, please refer to (a) in Figure 12, when the mobile phone detects that the user selects the non-wearing mode, the interface shown in (b) in Figure 12 is displayed, and the interface includes a single person detection mode , non-single-person individual detection mode, non-single-person overall detection mode, when the mobile phone detects that the user has selected a non-single-person overall detection mode, an interface as shown in (c) in Figure 12 is displayed, which is used to prompt whether the device fixed.

本实施例三的实现原理与实施例一的实现原理相同，即图2所示的流程图，具体来说，图2中的S204中的细化过程(即图6)第一分支中采集的运动信号反映多人睡眠时每人发生翻身、起身等动作带动床褥产生的运动的总和，第二分支采集的声音信号包括多人睡眠中每人产生的声音信号。The implementation principle of the third embodiment is the same as that of the first embodiment, that is, the flow chart shown in Figure 2, specifically, the details collected in the first branch of the refinement process in S204 in Figure 2 (that is, Figure 6). The motion signal reflects the sum of the movements generated by each person's turning over, getting up and other actions when multiple people are sleeping. The sound signals collected by the second branch include the sound signals generated by each person during multiple people's sleep.

基于相同的构思，图13所示为本申请提供的一种电子设备1300。该电子设备1300可以是前文中的手机或可穿戴设备。如图13所示，电子设备1300可以包括：一个或多个处理器1301；一个或多个存储器1302；通信接口1303，以及一个或多个计算机程序1304，上述各器件可以通过一个或多个通信总线1305连接。其中该一个或多个计算机程序1304被存储在上述存储器1302中并被配置为被该一个或多个处理器1301执行，该一个或多个计算机程序1304包括指令，上述指令可以用于执行如上面相应实施例中手机的相关步骤。通信接口1303用于实现与其他设备的通信，比如通信接口可以是收发器。Based on the same idea, FIG. 13 shows an electronic device 1300 provided by this application. The electronic device 1300 may be the aforementioned mobile phone or wearable device. As shown in Figure 13, the electronic device 1300 may include: one or more processors 1301; one or more memories 1302; a communication interface 1303, and one or more computer programs 1304, and each of the above devices may communicate through one or more Bus 1305 connection. Wherein the one or more computer programs 1304 are stored in the memory 1302 and are configured to be executed by the one or more processors 1301, the one or more computer programs 1304 include instructions, and the instructions can be used to perform the above Relevant steps of the mobile phone in the corresponding embodiment. The communication interface 1303 is used to implement communication with other devices, for example, the communication interface may be a transceiver.

上述本申请提供的实施例中，从电子设备(例如手机)作为执行主体的角度对本申请实施例提供的方法进行了介绍。为了实现上述本申请实施例提供的方法中的各功能，电子设备可以包括硬件结构和/或软件模块，以硬件结构、软件模块、或硬件结构加软件模块的形式来实现上述各功能。上述各功能中的某个功能以硬件结构、软件模块、还是硬件结构加软件模块的方式来执行，取决于技术方案的特定应用和设计约束条件。In the above-mentioned embodiments provided in the present application, the methods provided in the embodiments of the present application are introduced from the perspective of an electronic device (such as a mobile phone) as an execution subject. In order to realize the various functions in the method provided by the above embodiments of the present application, the electronic device may include a hardware structure and/or a software module, and realize the above-mentioned functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether one of the above-mentioned functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

以上实施例中所用，根据上下文，术语“当…时”或“当…后”可以被解释为意思是“如果…”或“在…后”或“响应于确定…”或“响应于检测到…”。类似地，根据上下文，短语“在确定…时”或“如果检测到(所陈述的条件或事件)”可以被解释为意思是“如果确定…”或“响应于确定…”或“在检测到(所陈述的条件或事件)时”或“响应于检测到(所陈述的条件或事件)”。另外，在上述实施例中，使用诸如第一、第二之类的关系术语来区份一个实体和另一个实体，而并不限制这些实体之间的任何实际的关系和顺序。As used in the above embodiments, depending on the context, the terms "when" or "after" may be interpreted to mean "if" or "after" or "in response to determining..." or "in response to detecting ...". Similarly, depending on the context, the phrases "in determining" or "if detected (a stated condition or event)" may be interpreted to mean "if determining..." or "in response to determining..." or "on detecting (a stated condition or event)" or "in response to detecting (a stated condition or event)". In addition, in the above embodiments, relational terms such as first and second are used to distinguish one entity from another, without limiting any actual relationship and order between these entities.

在本说明书中描述的参考“一个实施例”或“一些实施例”等意味着在本申请的一个或多个实施例中包括结合该实施例描述的特定特征、结构或特点。由此，在本说明书中的不同之处出现的语句“在一个实施例中”、“在一些实施例中”、“在其他一些实施例中”、“在另外一些实施例中”等不是必然都参考相同的实施例，而是意味着“一个或多个但不是所有的实施例”，除非是以其他方式另外特别强调。术语“包括”、“包含”、“具有”及它们的变形都意味着“包括但不限于”，除非是以其他方式另外特别强调。Reference to "one embodiment" or "some embodiments" or the like in this specification means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in other embodiments," etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless specifically stated otherwise. The terms "including", "comprising", "having" and variations thereof mean "including but not limited to", unless specifically stated otherwise.

在上述实施例中，可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时，可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时，全部或部分地产生按照本发明实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一个计算机可读存储介质传输，例如，所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质，(例如，软盘、硬盘、磁带)、光介质(例如，DVD)、或者半导体介质(例如固态硬盘Solid State Disk(SSD))等。在不冲突的情况下，以上各实施例的方案都可以组合使用。In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present invention will be generated in whole or in part. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website, computer, server or data center Transmission to another website site, computer, server, or data center by wired (eg, coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (eg, infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server or a data center integrated with one or more available media. The available medium may be a magnetic medium (for example, a floppy disk, a hard disk, or a magnetic tape), an optical medium (for example, DVD), or a semiconductor medium (for example, a Solid State Disk (SSD)). In the case of no conflict, the solutions of the above embodiments can be used in combination.

需要指出的是，本专利申请文件的一部分包含受著作权保护的内容。除了对专利局的专利文件或记录的专利文档内容制作副本以外，著作权人保留著作权。It should be pointed out that a part of the patent application documents contains content protected by copyright. Copyright is reserved by the copyright owner other than to make copies of the contents of the patent file or records of the Patent Office.

Claims

一种睡眠状态检测方法，其特征在于，应用于可穿戴式设备，所述可穿戴设备当前处于非佩戴模式，所述方法包括：A sleep state detection method, characterized in that it is applied to a wearable device, the wearable device is currently in a non-wearing mode, and the method includes:

采集目标用户睡眠时产生的行为数据，所述行为数据包括运动信号和/或声音信号；其中，所述运动信号用于确定用于表征所述目标用户睡眠状态的第一检测结果，所述声音信号用于确定用于表征所述目标用户睡眠状态的第二检测结果；collecting behavioral data generated when the target user sleeps, the behavioral data including motion signals and/or sound signals; The signal is used to determine a second detection result characterizing the sleep state of the target user;

根据所述第一检测结果和/或所述第二检测结果，确定所述目标用户睡眠状态的最终检测结果。According to the first detection result and/or the second detection result, determine the final detection result of the sleep state of the target user.
根据权利要求1所述的方法，其特征在于，所述最终检测结果是所述第一检测结果和所述第二检测结果的平均值或加权平均值。The method according to claim 1, wherein the final detection result is an average or a weighted average of the first detection result and the second detection result.
根据权利要求1或2所述的方法，其特征在于，所述采集目标用户睡眠时产生的行为数据之前，还包括：The method according to claim 1 or 2, wherein, before collecting the behavioral data generated when the target user sleeps, further comprising:

确定环境中包括多人时，输出第一提示信息，所述第一提示信息用于提示录入所述目标用户的特定声音信号；When it is determined that there are multiple people in the environment, output first prompt information, the first prompt information is used to prompt to enter the specific sound signal of the target user;

根据录入的所述目标用户的特定声音信号从所述声音信号中提取与所述目标用户的特定声音信号匹配的声音信号；extracting a sound signal matching the specific sound signal of the target user from the sound signals according to the entered specific sound signal of the target user;

其中，提取出的所述声音信号用于确定用于表征所述目标用户睡眠状态的所述第二检测结果。Wherein, the extracted sound signal is used to determine the second detection result characterizing the sleep state of the target user.
根据权利要求1-3任一所述的方法，其特征在于，所述采集目标用户睡眠时产生的行为数据之前，还包括：The method according to any one of claims 1-3, characterized in that, before collecting the behavior data generated when the target user sleeps, further comprising:

确定环境中包括多人时，输出第二提示信息，所述第二提示信息用于提示录入所述目标用户相对于所述可穿戴设备的方位；When it is determined that there are multiple people in the environment, output second prompt information, where the second prompt information is used to prompt entry of the orientation of the target user relative to the wearable device;

根据录入的所述目标用户相对于所述可穿戴设备的方位，从所述运动信号中提取与所述目标用户相对于所述可穿戴设备的方位匹配的运动信号；Extracting from the motion signal a motion signal matching the target user's orientation relative to the wearable device according to the entered orientation of the target user relative to the wearable device;

其中，提取出的所述运动信号用于确定用于表征所述目标用户睡眠状态的所述第一检测结果。Wherein, the extracted motion signal is used to determine the first detection result characterizing the sleep state of the target user.
根据权利要求3或4所述的方法，其特征在于，确定环境中包括多人，包括：The method according to claim 3 or 4, wherein determining that there are multiple people in the environment includes:

输出第三提示信息，所述第三提示信息用于提示环境中是否有多人；Outputting third prompt information, the third prompt information is used to prompt whether there are many people in the environment;

根据用户输入的确认指令，确定环境中包括多人。According to the confirmation instruction input by the user, it is determined that there are multiple people in the environment.
根据权利要求1-5任一所述的方法，其特征在于，在所述采集目标用户睡眠时产生的行为数据之前，还包括：The method according to any one of claims 1-5, further comprising:

响应于用户操作，设置当前模式为非佩戴模式；In response to a user operation, setting the current mode to a non-wearing mode;

输出第四提示信息，所述第四提示信息用于提示用户固定所述可穿戴设备。Outputting fourth prompt information, where the fourth prompt information is used to prompt the user to fix the wearable device.
根据权利要求1-6任一所述的方法，其特征在于，所述采集目标用户睡眠时产生的运动信号，包括：The method according to any one of claims 1-6, wherein the collecting motion signals generated when the target user sleeps includes:

通过运动传感器采集所述目标用户睡眠时由于翻身、起身或抖动的行为所带来的运动信号，所述运动信号包括位移、加速度、速度、角速度和角加速度中的至少一种；Using a motion sensor to collect motion signals caused by the target user's behavior of turning over, getting up or shaking during sleep, the motion signals include at least one of displacement, acceleration, velocity, angular velocity, and angular acceleration;

所述方法还包括：The method also includes:

根据所述采集到的运动信号识别体动特征，所述体动特征包括起身、翻身和抖动；Identifying body motion features according to the collected motion signals, the body motion features including getting up, turning over and shaking;

根据设定时长内所述体动特征发生的次数、频率和强度中的至少一项，确定所述第一检测结果。The first detection result is determined according to at least one of the occurrence times, frequency and intensity of the body motion feature within a set time period.
根据权利要求1-7任一所述的方法，其特征在于，所述采集的目标用户睡眠时产生的声音信号中包括的所述目标用户的鼾声、呼吸音中的至少一项声音特征；The method according to any one of claims 1-7, characterized in that at least one sound feature of the target user's snoring and breathing sounds is included in the collected sound signal generated when the target user is sleeping;

所述方法还包括：The method also includes:

根据设定时长内所述目标用户的鼾声或呼吸声中的至少一项声音特征的强度、频率和次数中的至少一项，确定所述第二检测结果。The second detection result is determined according to at least one of intensity, frequency, and frequency of at least one sound feature of the target user's snoring sound or breathing sound within a set time period.
一种电子设备，其特征在于，包括：An electronic device, characterized in that it comprises:

处理器，存储器，以及，一个或多个程序；processor, memory, and, one or more programs;

其中，所述一个或多个程序被存储在所述存储器中，所述一个或多个程序包括指令，当所述指令被所述处理器执行时，使得所述终端设备执行如权利要求1至8中任意一项所述的方法步骤。Wherein, the one or more programs are stored in the memory, the one or more programs include instructions, and when the instructions are executed by the processor, the terminal device performs the following steps: The method steps described in any one of 8.
一种计算机可读存储介质，其特征在于，所述计算机可读存储介质用于存储计算机程序，当所述计算机程序在计算机上运行时，使得所述计算机执行如权利要求1至8中任意一项所述的方法。A computer-readable storage medium, characterized in that the computer-readable storage medium is used to store a computer program, and when the computer program is run on a computer, the computer executes any one of claims 1 to 8. method described in the item.
一种计算机程序产品，其特征在于，包括计算机程序，当所述计算机程序在计算机上运行时，使得所述计算机执行如上述权利要求1-8中任意一项所述的方法。A computer program product, characterized in that it includes a computer program, and when the computer program is run on a computer, the computer is made to execute the method according to any one of claims 1-8.