CN114007141A - Intelligent terminal, server and sleep detection display method - Google Patents

Intelligent terminal, server and sleep detection display method Download PDF

Info

Publication number
CN114007141A
CN114007141A CN202111275391.4A CN202111275391A CN114007141A CN 114007141 A CN114007141 A CN 114007141A CN 202111275391 A CN202111275391 A CN 202111275391A CN 114007141 A CN114007141 A CN 114007141A
Authority
CN
China
Prior art keywords
data
sleep
user
state
intelligent terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111275391.4A
Other languages
Chinese (zh)
Inventor
穆聪聪
鲁好锦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Visual Technology Co Ltd
Original Assignee
Hisense Visual Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Visual Technology Co Ltd filed Critical Hisense Visual Technology Co Ltd
Priority to CN202111275391.4A priority Critical patent/CN114007141A/en
Publication of CN114007141A publication Critical patent/CN114007141A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44218Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/251Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866Management of end-user data
    • H04N21/25891Management of end-user data being end-user preferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508Management of client data or end-user data
    • H04N21/4532Management of client data or end-user data involving end-user characteristics, e.g. viewer profile, preferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H04N21/4668Learning process for intelligent management, e.g. learning user preferences for recommending movies for recommending content, e.g. movies

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Graphics (AREA)
  • Computing Systems (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The application provides an intelligent terminal, a server and a sleep detection display method, wherein the method can collect sleep data of a user in use and calculate sleep state information based on the sleep data collected in a preset detection period when the user controls and displays a user interface. And then the sleep state information is sent to the server, so that the server can match the adaptive recommended media asset data according to the sleep state and feed back the data to the intelligent terminal. And the intelligent terminal displays a user interface according to the recommended media asset data so that the user interface can include media asset content related to sleep detection. The method can enrich the display function of the intelligent terminal, and the sleep detection function can be operated cooperatively by multiple devices, thereby improving the user experience.

Description

Intelligent terminal, server and sleep detection display method
Technical Field
The application relates to the technical field of smart homes, in particular to an intelligent terminal, a server and a sleep detection display method.
Background
The intelligent terminal can be internally provided with a vital sign detection sensor, so that the intelligent terminal can detect partial vital sign parameters of a user, such as respiration, heartbeat and the like. The intelligent terminal can also analyze and calculate the vital sign parameters obtained by detection, so that the health state of the user is reflected through different vital characteristic parameters, and the aim of health detection is fulfilled. For example, the intelligent terminal can monitor the sleep state of the user by detecting parameters such as respiratory rate and heart rate change, so as to prompt the user to keep a reasonable and healthy sleep habit according to a monitoring result.
Generally, in the process of detecting vital signs, the intelligent terminal may extract a phase change of a target signal after a sensor detects the target signal for a specific part of a user's body, so as to estimate a vibration frequency of a target according to the phase change, and determine detection result data of a breathing or heartbeat frequency according to a type of the target. And the intelligent terminal performs calculation analysis on the detection result data to judge whether the user has a health problem. And feeding back prompt signals such as a prompt interface, voice broadcasting, vibration feedback and the like to the user according to the judgment result.
Therefore, the detection of the vital signs of the user by the intelligent terminal only stays in the basic functions of detection, analysis and prompt. The intelligent terminal can not take adaptive measures according to the detection result, and the detection function is only limited to the operation on single equipment, so that the vital sign detection function can not be widely popularized, and the user experience is reduced.
Disclosure of Invention
The application provides an intelligent terminal, a server and a sleep detection display method, and aims to solve the problems that the traditional sleep detection function is single and the user experience is reduced.
In a first aspect, the present application provides an intelligent terminal, including: a display, a vital signs detector, a communicator, and a processor. Wherein the display is configured to display a user interface; the vital signs detector is configured to detect sleep data of a user; the communicator is configured to establish a communication connection with a server; the processor is configured to perform the following program steps:
acquiring a control instruction which is input by a user and used for displaying a user interface;
responding to the control instruction, and acquiring sleep data in a preset detection period;
calculating sleep state information according to the sleep data, and sending the sleep state information to the server so that the server feeds back recommended media asset data according to the sleep state information;
and controlling the display to display the recommended media asset data in the user interface.
In a second aspect, the present application further provides a server, including: the device comprises a storage module, a communication module and a processing module. Wherein the storage module is configured to store media asset data; the communication module is configured to establish a communication connection relation with the intelligent terminal; the processing module is configured to perform the following procedural steps:
receiving sleep state information sent by the intelligent terminal, wherein the sleep state information is obtained by the intelligent terminal through calculation according to sleep data detected in a preset detection period;
matching the media asset data adaptive to the sleep state information in the storage module to obtain recommended media asset data;
and feeding back the recommended media asset data to the intelligent terminal.
In a third aspect, the present application further provides a sleep detection display method applied to an intelligent home system, where the intelligent home system includes an intelligent terminal and a server, and the sleep detection display method includes the following steps:
the intelligent terminal acquires a control instruction which is input by a user and used for displaying a user interface, and responds to the control instruction to acquire the sleep data in a preset detection period;
the intelligent terminal calculates sleep state information according to the sleep data and sends the sleep state information to the server;
the server matches the media asset data adaptive to the sleep state information to obtain recommended media asset data and feeds back the recommended media asset data;
and the intelligent terminal displays the recommended media asset data in the user interface.
According to the technical scheme, the intelligent terminal, the server and the sleep detection display method can collect the sleep data of the user in use, and calculate the sleep state information based on the sleep data collected in the preset detection period when the user controls and displays the user interface. And then the sleep state information is sent to the server, so that the server can match the adaptive recommended media asset data according to the sleep state and feed back the data to the intelligent terminal. And the intelligent terminal displays a user interface according to the recommended media asset data so that the user interface can include media asset content related to sleep detection. The method can enrich the display function of the intelligent terminal, and the sleep detection function can be operated cooperatively by multiple devices, thereby improving the user experience.
Drawings
In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of an intelligent terminal in an embodiment of the present application;
fig. 2 is a schematic diagram of a software architecture of an intelligent terminal in an embodiment of the present application;
FIG. 3 is a schematic diagram of a user interface of an intelligent terminal according to an embodiment of the present application;
fig. 4 is a schematic view of a sleep detection scene of an intelligent terminal in an embodiment of the present application;
FIG. 5 is a schematic diagram of a sleep detection user interface in an embodiment of the present application;
FIG. 6 is a diagram illustrating push messages in an embodiment of the present application;
fig. 7 is a schematic diagram of an intelligent terminal association device group in the embodiment of the present application;
fig. 8 is a schematic flowchart of a sleep detection display method at an intelligent terminal side in an embodiment of the present application;
fig. 9 is a schematic view of a touch interaction operation of an intelligent terminal in an embodiment of the present application;
fig. 10 is a schematic flowchart of a server-side sleep detection display method in an embodiment of the present application;
FIG. 11 is a diagram illustrating the interaction effect of push messages in the embodiment of the present application;
FIG. 12 is a diagram illustrating a display effect of recommended assets in an embodiment of the present application;
FIG. 13 is a flowchart illustrating a first state detection process according to an embodiment of the present application;
FIG. 14 is a flowchart illustrating a second state detection process according to an embodiment of the present application;
FIG. 15 is a schematic flow chart illustrating the process of adjusting environmental parameters according to an embodiment of the present application;
fig. 16 is a schematic flowchart of a control instruction forwarding process of the intelligent terminal in the embodiment of the present application.
Detailed Description
The technical solution in the embodiments of the present application will be described in detail and removed with reference to the accompanying drawings. In the description of the embodiments herein, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; "and/or" in the text is only an association relationship describing an associated object, and means that three relationships may exist, for example, a and/or B may mean: three cases of a alone, a and B both, and B alone exist, and in addition, "a plurality" means two or more than two in the description of the embodiments of the present application.
In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as implying or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of embodiments of the application, unless stated otherwise, "plurality" means two or more.
Fig. 1 shows a schematic structural diagram of an intelligent terminal 100.
The following describes an embodiment of the smart terminal 100. It should be understood that the smart terminal 100 shown in fig. 1 is only one example, and the smart terminal 100 may have more or less components than those shown in fig. 1, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.
A block diagram of a hardware configuration of the smart terminal 100 according to an exemplary embodiment is exemplarily shown in fig. 1. As shown in fig. 1, the smart terminal 100 includes: a Radio Frequency (RF) circuit 110, a memory 120, a display unit 130, a camera 140, a sensor 150, an audio circuit 160, a Wireless Fidelity (Wi-Fi) module 170, a processor 180, a bluetooth module 181, and a power supply 190.
The RF circuit 110 may be used for receiving and transmitting signals during information transmission and reception or during a call, and may receive downlink data of a base station and then send the downlink data to the processor 180 for processing; the uplink data may be transmitted to the base station. Typically, the RF circuitry includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
The memory 120 may be used to store software programs and data. The processor 180 performs various functions of the smart terminal 100 and data processing by executing software programs or data stored in the memory 120. The memory 120 may include high speed random access memory and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. The memory 120 stores an operating system that enables the smart terminal 100 to operate. The memory 120 may store an operating system and various application programs, and may also store codes for performing the methods described in the embodiments of the present application.
The display unit 130 may be used to receive input numeric or character information and generate signal input related to user settings and function control of the smart terminal 100, and particularly, the display unit 130 may include a touch screen 131 disposed on the front of the smart terminal 100 and may collect touch operations of a user thereon or nearby, such as clicking a button, dragging a scroll box, and the like.
The display unit 130 may also be used to display a Graphical User Interface (GUI) of information input by or provided to the user and various menus of the terminal 100. Specifically, the display unit 130 may include a display screen 132 disposed on the front surface of the smart terminal 100. The display screen 132 may be configured in the form of a liquid crystal display, a light emitting diode, or the like. The display unit 130 may be used to display various graphical user interfaces described herein.
The touch screen 131 may cover the display screen 132, or the touch screen 131 and the display screen 132 may be integrated to implement the input and output functions of the intelligent terminal 100, and after the integration, the touch screen may be referred to as a touch display screen for short. In the present application, the display unit 130 may display the application programs and the corresponding operation steps.
The camera 140 may be used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing elements convert the light signals into electrical signals which are then passed to the processor 180 for conversion into digital image signals.
The smart terminal 100 may further include at least one sensor 150, such as an acceleration sensor 151, a distance sensor 152, a fingerprint sensor 153, a temperature sensor 154. The smart terminal 100 may also be configured with other sensors such as a gyroscope, barometer, hygrometer, thermometer, infrared sensor, light sensor, motion sensor, and the like.
The audio circuitry 160, speaker 161, microphone 162 may provide an audio interface between a user and the smart terminal 100. The audio circuit 160 may transmit the electrical signal converted from the received audio data to the speaker 161, and convert the electrical signal into a sound signal for output by the speaker 161. The smart terminal 100 may also be configured with a volume button for adjusting the volume of the sound signal. On the other hand, the microphone 162 converts the collected sound signal into an electrical signal, converts the electrical signal into audio data after being received by the audio circuit 160, and outputs the audio data to the RF circuit 110 to be transmitted to, for example, another terminal or outputs the audio data to the memory 120 for further processing. In this application, the microphone 162 may capture the voice of the user.
Wi-Fi belongs to a short-distance wireless transmission technology, and the intelligent terminal 100 can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the Wi-Fi module 170, and provides wireless broadband internet access for the user.
The processor 180 is a control center of the smart terminal 100, connects various parts of the entire terminal using various interfaces and lines, and performs various functions of the smart terminal 100 and processes data by running or executing software programs stored in the memory 120 and calling data stored in the memory 120. In some embodiments, processor 180 may include one or more processing units; the processor 180 may also integrate an application processor, which mainly handles operating systems, user interfaces, applications, etc., and a baseband processor, which mainly handles wireless communications. It will be appreciated that the baseband processor described above may not be integrated into the processor 180. In the present application, the processor 180 may run an operating system, an application program, a user interface display, and a touch response, and the processing method described in the embodiments of the present application. In addition, processor 180 is coupled to display unit 130 and display unit 140.
And the bluetooth module 181 is configured to perform information interaction with other bluetooth devices having a bluetooth module through a bluetooth protocol. For example, the smart terminal 100 may establish a bluetooth connection with a wearable electronic device (e.g., a smart watch) having a bluetooth module via the bluetooth module 181, so as to perform data interaction.
The smart terminal 100 also includes a power supply 190 (such as a battery) to power the various components. The power supply may be logically connected to the processor 180 through a power management system to manage charging, discharging, power consumption, etc. through the power management system. The intelligent terminal 100 may also be configured with a power button for powering on and off the terminal, and locking the screen.
Fig. 2 is a block diagram of a software configuration of the intelligent terminal 100 according to the embodiment of the present invention.
The layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, an application layer, an application framework layer, an Android runtime (Android runtime) and system library, and a kernel layer from top to bottom.
The application layer may include a series of application packages.
As shown in fig. 2, the application package may include applications such as camera, gallery, calendar, phone call, map, navigation, WLAN, bluetooth, music, video, short message, etc.
The application framework layer provides an Application Programming Interface (API) and a programming framework for the application. The application framework layer includes a number of predefined functions.
As shown in FIG. 2, the application framework layers may include a window manager, content provider, view system, phone manager, resource manager, notification manager, and the like.
The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like. The content provider is used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.
The phone manager is used to provide a communication function of the smart terminal 100. Such as management of call status (including on, off, etc.). The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like.
The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short dwell, and does not require user interaction. Such as a notification manager used to inform download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, text information is prompted in the status bar, a prompt tone is given, the intelligent terminal vibrates, and the indicator light flickers.
The Android Runtime comprises a core library and a virtual machine. The Android runtime is responsible for scheduling and managing an Android system.
The core library comprises two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.
The application layer and the application framework layer run in a virtual machine. And executing java files of the application program layer and the application program framework layer into a binary file by the virtual machine. The virtual machine is used for performing the functions of object life cycle management, stack management, thread management, safety and exception management, garbage collection and the like.
The system library may include a plurality of functional modules. For example: surface managers (surface managers), Media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), and the like.
The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.
The media library supports a variety of commonly used audio, video format playback and recording, and still image files, among others. The media library may support a variety of audio-video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, and the like. The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like. The 2D graphics engine is a drawing engine for 2D drawing.
The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.
The following describes exemplary work flows of software and hardware of the intelligent terminal 100 in connection with capturing a photo scene.
When the touch screen 131 receives a touch operation, a corresponding hardware interrupt is issued to the kernel layer. The kernel layer processes the touch operation into an original input event (including touch coordinates, a time stamp of the touch operation, and other information). The raw input events are stored at the kernel layer. And the application program framework layer acquires the original input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch click operation, and taking a control corresponding to the click operation as a control of a camera application icon as an example, the camera application calls an interface of an application framework layer, starts the camera application, further starts a camera drive by calling a kernel layer, and captures a still image or a video through the camera 140.
The intelligent terminal 100 in the embodiment of the present application may be a mobile phone, a tablet computer, a wearable device, a notebook computer, a television, and the like.
Fig. 3 is a schematic diagram for illustrating a user interface on a smart terminal. In some implementations, a user can open a corresponding application by touching an application icon on the user interface, or can open a corresponding folder by touching a folder icon on the user interface.
In some embodiments, a vital signs detector 155 can be further built in the smart terminal 100, and the vital signs detector 155 can be one of the sensors 150 for detecting vital signs parameter data of the user. Such as a respiration sensor, a heartbeat sensor, etc. The detected vital sign parameters can be used to determine the physical health status of the user. Vital sign parameters detected in different detection periods, or different detection states, may serve as different types of vital sign data. For example, the detection cycle may be set such that the vital sign parameters detected by vital sign detector 155 during the night time period 22:00 to the next morning 6:00 are taken as sleep data, including respiration data and heartbeat data during this time period, etc.
The vital sign detector 155 may be built in the intelligent terminal 100, and directly detect the vital sign parameters of the user as a functional module of the intelligent terminal 100. For example, when intelligent terminal 100 is wearable equipment such as intelligent wrist-watch, intelligent bracelet, can be between with heartbeat sensor setting in intelligent terminal 100 to directly wear position detection heartbeat data at the laminating. The vital sign detector 155 can also be externally connected to the intelligent terminal 100.
That is, as shown in fig. 4, in some embodiments, the smart terminal 100 may be connected to the vital signs detector 155 through a communicator or a specific external device interface, and the vital signs detector 155 may be worn on a plurality of parts of the user to detect vital sign parameters of the plurality of parts, respectively. The vital sign detector 155 is then connected to the intelligent terminal 100, so that the intelligent terminal 100 can receive the vital sign parameters detected by the vital sign detector 155. The intelligent terminal 100 and the external vital sign detector 155 can be connected through data lines or wireless transmission. For example, the smart terminal 100 may be equipped with a device capable of detecting respiration or heartbeat, such as a smart bracelet or a smart medical device, and the device may be internally equipped with a WiFi module or a bluetooth module to transmit the vital sign parameters through a wireless network or a bluetooth connection.
The specific sensor form of the vital sign detector 155 can be determined according to the type of vital sign parameter to be detected and the type of the smart terminal 100. For example, to detect heartbeat data of the user, vital signs detector 155 may include a heartbeat sensor. The heartbeat sensor can detect the pressure change of the skin tissue of the user based on piezoelectric, piezoresistive and photoelectric detection elements, and obtains heartbeat parameters by combining time information. Similarly, vital signs detector 155 may incorporate a respiration sensor in detecting the respiration data. The respiration sensor can detect parameters such as the fluctuation of the thoracic cavity of the user, the pressure of the thoracic cavity, the flow of the respiratory gas and the like based on an image type, a piezoelectric type and a flow type detection side element so as to obtain the respiration parameters.
Obviously, besides the heartbeat data and the respiration data, the intelligent terminal 100 can also detect other vital sign parameters of the user, such as body temperature, blood pressure, and the like. The vital sign parameters can also be obtained by comprehensive calculation according to data detected by a plurality of sensors. For example, for the detection of sleep data, the sleeping posture can be acquired through an image, the heartbeat data can be acquired through a heartbeat sensor, the respiratory data can be acquired through a respiratory sensor, the snore parameter can be acquired through a sound sensor, and the like, and the data can be used for comprehensively evaluating the sleep quality of a user.
Before the parameters detected by the vital sign detector 155 are sent to the processor 180 of the intelligent terminal 100, a built-in circuit may be used to perform preliminary processing, such as analog-to-digital conversion, noise reduction, and the like, so as to convert the detected initial electrical signal into vital sign parameter data that can be recognized by the processor 180 of the intelligent terminal 100. The vital sign parameter data can be in a data form such as a data table and a data frame through a unified configuration data form, and then sent to the processor 180 one by one according to the actual sampling frequency.
In some embodiments, the vital sign parameters may be transmitted via a specific parameter protocol. The parameter protocol can stipulate the specific data form of the vital sign parameters so as to complete data transmission by a small data volume. For example, the data of heartbeat, respiration and the like are determined by detecting the phase of the signal, namely the phase represents the amplitude change magnitude of respiration and heartbeat. A phase data protocol may be defined in the smart terminal 100. The phase data protocol includes: start bit, respiration phase data, heartbeat phase data, stop bit. The total length of data is 66 characters, which occupies 528 bits. Namely:
"DSB 150150150150150150150150150150H150150150150150150150150150150 DE"; wherein, the initial bit is a fixed DS occupying 16 bits; the breathing phase data is that the 'B +3 multiplied by 10 bit digital character' occupies 248 bits; the heartbeat phase data is that 248 bits are occupied by 'H +3 multiplied by 10 bit digital characters'; the stop bit is a fixed "DE" accounting for 16 bits.
The processor 180 can extract and analyze the obtained data one by one to analyze the health status of the user according to the vital sign data. For example, after the smart terminal 100 detects heartbeat data and respiration data of the user from 22:00 to 6:00 of the next day through the vital sign detector, an analysis result such as a heartbeat frequency and a respiration frequency can be calculated according to the heartbeat data and the respiration data, so that sleep states of the user, including states such as deep sleep, light sleep, waking and the like, can be determined according to the heartbeat frequency and the respiration frequency.
The processor 180 of the intelligent terminal 100 may further record the vital sign parameters after receiving the detected vital sign parameters each time, and perform statistical analysis on the detection result of the vital sign parameters each time to obtain a change rule of the parameters, so as to determine the health state change condition of the user in a longer time period.
For example, in the case that the intelligent terminal 100 determines the sleep state of the user according to the heartbeat frequency and the breathing frequency, the sleep quality dimension may be determined to include 6 dimensions in combination with the recorded time, that is: deep sleep time (td), light sleep time (tw), total sleep time (ts), number of wakefulness times (w), wakefulness time (tq), sleep onset time (tb). And then determining that the user is in a normal sleep state or an abnormal sleep state according to the sleep quality dimension time ratio. Namely, the judgment condition of the sleep normal state is as follows: the deep sleep time accounts for 20-25% of the whole sleep time, the light sleep time accounts for 50-60% of the whole sleep time, the waking time is normally 0-30 minutes, the waking times are normally 0 times, and the sleep starting time is 23: 00. The sleep data meeting the judgment condition determines that the user is in a normal sleep state, and the sleep data not meeting the judgment condition determines that the user is in an abnormal sleep state.
After the processor 180 completes the analysis processing of the vital sign parameters, the intelligent terminal 100 may also display the analysis result through a push message or a specific user interface. For example, after obtaining the sleep data of 22:00 to 6:00 of the next day, the smart terminal 100 may display the sleep data and data such as a sleep state obtained based on the sleep data analysis in the sleep monitoring interface. Obviously, as shown in fig. 5, in order to create a more intuitive user experience, in some embodiments, the smart terminal 100 may further generate an auxiliary graph, such as a histogram, a scale graph, a graph, and the like, according to the vital sign parameters.
While the intelligent terminal 100 displays the vital sign parameters, prompt information can be pushed or displayed according to the analysis result of the vital sign parameters. For example, as shown in fig. 6, when it is detected that the number of wakefulness times in the sleep data is excessive, that is, the number of wakefulness times is greater than or equal to the time threshold, a prompt text "is a little more wakefulness times, and is the latest pressure not a little large? "
In some embodiments, in order to facilitate the user to perform the operation, the intelligent terminal 100 may further display the recommended media asset item according to the analysis result while displaying the prompt text. For example, when it is monitored that the user has not fallen asleep for a long time, i.e. the sleep onset time (tb) is later than 23:00 and in the waking state, the playing link or the option of the sleep-aiding music can be displayed while the prompt characters are displayed, and the user is prompted to play the relaxing music or the natural environment sound.
As shown in fig. 7, in some embodiments, the intelligent terminal 100 may also perform coordinated control with other devices according to the detected vital sign parameters. For example, when it is monitored that the user is in an abnormal sleep state, the intelligent terminal 100 may further detect a current indoor temperature, and when it is determined that the current indoor temperature is higher than an appropriate temperature threshold, may obtain an intelligent device list of a current room through an Artificial Intelligence Internet of Things (AIoT) system, and automatically control temperature control devices such as an air conditioner or a fan to operate, and adjust the indoor temperature.
In order to implement the foregoing functions, in some embodiments of the present application, a sleep detection display method is provided, which may be applied to an intelligent home system including an intelligent terminal 100 and a server 200. In order to satisfy the normal operation of the method, the intelligent terminal 100 at least comprises: a display 132, a vital signs detector 155, a communicator, and a processor 180. Wherein, the display is used for displaying a user interface; vital signs detector 155 is used to detect sleep data of the user; the communicator is used for establishing communication connection with the server 200; the processor 180 may execute a part of the steps in the sleep detection display method to implement the sleep monitoring function, as shown in fig. 8, which specifically includes the following contents:
and acquiring a control instruction which is input by a user and used for displaying the user interface. When the user uses the intelligent terminal 100, the intelligent terminal 100 can be controlled to display a corresponding user interface through a specific interactive action. Wherein portions of the user interface may be used to display the sleep monitoring interface. For example, a user may control to select a "sleep detection" application program in the application interface by a click operation, control the intelligent terminal 100 to start running the "sleep detection" application program, and switch the intelligent terminal 100 from the application interface to the sleep detection interface along with the start of the application program. Therefore, the control instruction for displaying the user interface can be input by selecting the interactive operation.
The "sleep detection" application may be a third-party application installed on the smart terminal 100, or may be a system application embedded in the operating system of the smart terminal 100. When the sleep detection application program is a system application, the sleep detection interface can also be triggered to display through a specific trigger condition. For example, when the screen of the smart terminal 100 is first lit each day, the smart terminal 100 may automatically start the sleep detection application to display the sleep condition of the previous night.
In some embodiments, for the intelligent terminal 100 supporting special interaction modes such as touch operation and intelligent voice operation, a user may input a control instruction for displaying a sleep detection interface based on the special interaction modes. For example, as shown in fig. 9, when the smart terminal 100 is a handheld terminal device such as a mobile phone, the user may switch to the sleep detection interface by sliding right on the main interface into the minus one screen and clicking on the minus one screen to select the "healthy" option. For another example, after calling the voice assistant program, the user may input the contents of "show sleep data", "how did i sleep last night", and the like, and control the intelligent terminal 100 to display the sleep detection interface.
After the user inputs a control instruction for displaying the sleep detection interface, the smart terminal 100 may acquire sleep data within a preset detection period in response to the control instruction. The sleep data refers to a series of vital sign parameters, such as respiratory data, heartbeat data, monitoring images, and the like, obtained by the vital sign detector 155 built in or externally connected to the smart terminal 100.
The preset detection period may refer to a detection period set according to a user's sleep habit. For example, the user can set the daily ratio of 22:00 to the next day 6:00 is a preset detection period. After the user inputs a control instruction for displaying the sleep detection interface, the smart terminal 100 may acquire sleep data in one or more detection periods close to the current time. For example, when the user inputs a control instruction in 13:30 at 10/2020, the smart terminal 100 may acquire sleep data of the previous night, that is, acquire sleep data recorded in a period from 22:00 at 9/10/2020 to 6:00 at 10/2020.
The sleep data may also be data detected by vital signs detector 155 in real time. That is, in the process that the user is in the sleep state (within the preset detection period), the intelligent terminal 100 may also respond to the control instruction to obtain sleep data in real time, thereby implementing remote and real-time monitoring of the sleep process of the user. For example, a parent may monitor a sleep state of a child through the intelligent terminal 100, that is, during a sleep process of the child, input a control instruction for displaying a sleep detection interface, at this time, the intelligent terminal 100 may first determine whether a current time is within a preset detection period, and after determining the current time is the monitoring period, detect sleep data of the child through the respiration sensor and the heartbeat sensor in real time.
Since not only the recent sleep state but also the accumulated sleep pattern and other contents within a certain time can be displayed in the sleep detection interface, in some embodiments, the smart terminal 100 not only acquires the sleep data in the adjacent preset detection period, but also acquires the recorded sleep data in a plurality of detection periods. To this end, in some embodiments, the source of the sleep data acquired by the intelligent terminal 100 may be the real-time detection data of the vital sign detector 155, or the recorded data, i.e. the data storage.
After the sleep data is acquired, the intelligent terminal 100 may further calculate sleep state information according to the sleep data, that is, the intelligent terminal 100 may analyze the sleep data to determine the sleep states of multiple dimensions. For example, through analysis of the breathing frequency and the heartbeat frequency in the sleep data, states such as a deep sleep state, a light sleep state, an awake state, etc., and corresponding parameters can be determined. And combining the start-stop time of the states, the following sleep time parameters of 6 dimensions can be calculated, including: deep sleep time (td), light sleep time (tw), total sleep time (ts), number of wakefulness times (w), wakefulness time (tq), sleep onset time (tb). Wherein the duration unit is minutes.
According to the calculated sleep state information, whether the user is in the abnormal sleep state can be judged. For example, the sleep normality determination conditions may be set such that the deep sleep time period accounts for 20% to 25% of the total sleep time, the light sleep time period accounts for 50% to 60% of the total sleep time, the waking time period normally ranges from 0 to 30 minutes, the waking frequency normally ranges from 0 time, and the sleep initiation time is before 23: 00. Meanwhile, a judgment value can be calculated according to the time parameter, and whether the sleep data meets the condition or not is determined based on the judgment value, namely the user is determined to be in the abnormal sleep state. Namely, deep sleep is insufficient: td/ts is less than 0.2; deep sleep too much: td/ts > 0.25; light sleep with little sleep: tw/ts is less than 0.5; excessive light sleep: tw/ts is more than 0.6; the wakefulness frequency is abnormal, wherein w is more than or equal to 1; abnormal waking time: tq is more than 30; sleep initiation time: tb > 23.
After calculating the sleep state information, the intelligent terminal 100 may further send the sleep state information to the server 200, so that the server 200 feeds back the recommended media asset data according to the sleep state information. The specific data sent to the server 200 may include a final result of the sleep state information, or may include an intermediate result in calculating the sleep state information. For example, the smart terminal 100 may transmit only the sleep state in which the user is in a deep sleep deficiency state to the server 200, or may transmit intermediate parameters such as a deep sleep time (td), a light sleep time (tw), a total sleep time (ts), the number of wakefulness times (w), a wakefulness time (tq), and a sleep start time (tb) to the server 200 while transmitting the sleep state in a deep sleep deficiency state to the server 200.
After receiving the sleep state information, the server 200 feeds back recommended media asset data to the intelligent terminal 100 according to the sleep state information. To this end, as shown in fig. 10, in some embodiments, the server 200 should include at least: the device comprises a storage module, a communication module and a processing module. The storage module is used for storing media asset data and application programs related to recommended media assets; the communication module is used for establishing a communication connection relationship with the intelligent terminal 100. The processing module may run an application program associated with the recommended media asset function, and specifically includes:
receiving sleep state information sent by the intelligent terminal 100, wherein the sleep state information is obtained by calculating according to sleep data detected in a preset detection period by the intelligent terminal 100. Matching the media asset data adaptive to the sleep state information in the storage module according to the sleep state information to obtain recommended media asset data; and finally, feeding back the recommended media asset data to the intelligent terminal 100.
For example, when the sleep state of the user is abnormal in the number of wakefulness times in the sleep state information sent by the smart terminal 100 to the server 200, it may be determined that the user may have difficulty falling asleep due to excessive mental stress. Accordingly, the server 200 may push the media asset for relieving stress to the smart terminal 100. Such as sports competition, yoga, etc. to decompress sports video, or movies, TV plays, etc.
After the server 200 queries the appropriate media assets and generates the recommended media asset data, the intelligent terminal 100 may receive the recommended media asset data fed back by the server 200, and control the display to display the recommended media asset data in the user interface according to the recommended media asset data.
For example, the recommended media asset data pushed by the server 200 to the intelligent terminal 100 may be delivered in the form of a message, and the specific message content may include: push title, push link, etc. After receiving the push, the intelligent terminal 100 may parse and analyze the content in the recommended media asset data. In the message corresponding to the recommended asset data, the asset content may be represented by specific characters, for example, "startupType" represents a skip type, and a specific value thereof represents a skip type value, that is, "startupType ═ 1" represents video assets; the "packagemame" represents a name of a skipped video application package, and a specific value of the "packagemame" refers to a specific application, that is, the "packagemame ═ com.ktcp.csvideo" refers to an application that is skipped and corresponds to the name of the application package; "uri" represents a specific link identification, and its specific value represents a specific link address.
After receiving the message content, the smart terminal 100 may render the push message first, for example, as shown in fig. 11, the message content is "wake-up times are a little more, and the latest pressure is not a little greater? The release can be done as a point movement ". Meanwhile, the push message can also support the interactive operation of the user while being displayed, that is, the user can jump to specific details or an application interface through the interactive operation on the intelligent terminal 100, such as a menu key of a remote controller. For example, as shown in fig. 12, through the above push message, the user may control the smart terminal 100 to directly jump to an olympic live details page for the user to view after clicking a menu.
According to the technical scheme, the sleep detection display method provided by the embodiment can recommend proper media asset data based on the sleep data, so that a user can obtain the media assets according with mood, the display function of the intelligent terminal 100 is enriched, and the user experience is improved.
When the intelligent terminal 100 detects the sleep data, a specific position relationship needs to be maintained between the user and the intelligent terminal 100, that is, the user is required to cooperate with the intelligent terminal 100 to detect the sleep data. Accordingly, in some embodiments, the smart terminal 100 further comprises: a distance sensor. The distance sensor is used for detecting the space distance of a user. The distance sensor can detect the spatial distance of the user based on ranging principles such as laser, infrared and ultrasonic. The distance sensor may also be integrated with vital signs detector 155, for example, vital signs detector 155 may be a millimeter wave radar-based space detector that, in operation, may detect both a state of relief of the user's chest to obtain breathing data and a distance between the user and smart terminal 100 to obtain user distance data.
The sleep state may include a first state and a second state, where the first state is a primary state for determining whether sleep detection is appropriate. The second state is a progressive state for determining a user specific sleep condition. As shown in fig. 13, after the smart terminal 100 acquires the user distance data through the distance sensor, the first state of the user may be detected according to the user distance data. Wherein the first state comprises a mated state and a unmated state. The cooperation state is used to indicate that a set positional relationship is maintained between the user and the intelligent terminal 100, and if the user is located in an area directly in front of the intelligent terminal 100, the intelligent terminal 100 can detect accurate sleep data. The non-cooperative state is used to indicate that the set positional relationship between the user and the smart terminal is not maintained, and the smart terminal 100 cannot detect accurate sleep data.
For the detection process of the sleep data, it is required that the user is in the front area of the intelligent terminal 100 and keeps a relatively static state, so as to determine that the user is sleeping, in order to determine the first state of the user, in some embodiments, in the step of detecting the first state of the user according to the user distance data, the intelligent terminal 100 may first acquire the distance detection interval, that is, the reasonable area where the user should be located. The intelligent terminal 100 may determine whether the user is in a reasonable area by comparing the user distance data with the distance detection interval. For example, if the preset distance detection interval is an interval 1-5m from the area in front of the intelligent terminal, when the user distance data is detected to be 2.4m, it is determined that the user distance data is in the distance detection interval.
When the user distance data is within the distance detection interval, the intelligent terminal 100 may detect whether the user is in a stationary state. The user's stationary state can be detected by the distance sensor, that is, when the user distance detected by the sensor is stabilized within a reasonable interval, it is determined that the user is in the stationary state. The still state may also be obtained by a separate image collector, that is, in some embodiments, the intelligent terminal 100 further includes an image collector, and the image collector is configured to determine whether the user is in the still state by comparing the positions of the main objects in the images, that is, when the relative positions of the main objects in the images, which are used to represent that the user corresponds to, in the images, have not changed, it is determined that the user is in the still state.
When it is determined that the user is in the static state, the intelligent terminal 100 may further record the duration of the user in the static state, and compare the duration with a preset time judgment threshold in real time. If the duration is greater than or equal to the time judgment threshold, determining that the user is in a matching state; and if the duration is less than the time judgment threshold, determining that the user is in the non-fit state. For example, the time determination threshold may be 10 seconds, that is, after the user is stationary in the sleep detection area for 10 seconds, the smart terminal 100 may start the detection of the sleep data.
The smart terminal 100 may perform different controls according to the detection result of the first state. If the user is detected to be in the matching state, executing the step of acquiring sleep data in a preset detection period; and if the user is detected to be in the non-matching state, re-detecting the first state of the user within the preset time.
For example, the presence or absence of a target in the detection area may be determined based on the set detection farthest distance and closest distance of the millimeter wave radar. If the distance between the target and the radar exceeds the set radar detection maximum distance, the target is in an unmanned state; if the target is located outside the farthest distance of the radar and moves to the radar, the target is in an unmanned state after entering a detection area and enters a state switching mode; if the distance between the target and the radar is smaller than the nearest distance, the target is in an over-close state; if the target is between the closest distance and the farthest distance, distinguishing a matching state and a non-matching state according to whether the target moves, and if the target moves, judging that the target is in the non-matching state; if the target does not move obviously in the non-fit state, the target enters the fit state after counting down for 10 seconds, and respiratory heartbeat data are output; and if the target is in motion, judging various states again according to the distance between the target and the radar.
After determining that the user is in the coordination state, the smart terminal 100 may further detect a specific sleep state of the user, that is, in some embodiments, the smart terminal 100 may extract a time parameter and a waking number from the sleep data, where the time parameter includes: deep sleep time, light sleep time, wake time, and total time. The time parameter and the wakefulness number may be obtained by calculation in accordance with the sleep state information provided in the above-described embodiment.
The smart terminal 100 detects the second state of the user according to the time parameter and the number of wakefulness times. Wherein the second state includes a sleep abnormal state and a sleep normal state. The intelligent terminal 100 further executes different control functions according to different second states, that is, as shown in fig. 14, if it is detected that the user is in the abnormal sleep state, a step of sending sleep state information to the server 200 is executed, so that the server 200 can determine corresponding push messages and control actions according to the abnormal sleep state. And if the user is detected to be in the normal sleep state, recording the sleep data for the follow-up user to check in the sleep detection interface.
Obviously, according to different specific sleeping situations, after the second state is determined to be the abnormal sleeping state, it can be further determined which abnormal state is. For example, in the case where the first state is the fitting state, the second state may be a deep-sleep or light-sleep state; the target is in the radar detection area, and in a plurality of times of non-matching states, the second state is a turnover state; the target is in the radar detection area, and at other moments, the second state is the waking state; the target is within the radar detection zone and then moves out of the detection zone for a number of times, the second state switching to the out-of-bed state.
In some embodiments, the intelligent terminal 100 may convert and process the sleep state information according to a specific state data protocol according to the sleep state information, so as to generate data for transmission and analysis. That is, in the step of sending the sleep state information to the server, the intelligent terminal 100 may generate the state data according to the sleep data, where the state data is a fixed-length character string composed of a start bit, a first state bit, a second state bit, a vital sign parameter bit, and a stop bit.
For example, in a data protocol, the start bit is a fixed ST of 16 bits. The first status bit is a one-bit character, occupying 8 bits. The first status bit includes: an unattended state ('a'), a state transition from unattended ('b'), an too close state ('c'), a disengaged state ('d'), an engaged state ('e'), a unattended 3 minute alarm state ('f'), and a countdown ('9' to '0'). The second state bit is a bit character occupying 8 bits, and comprises: awake state ('0'), light sleep state ('1'), deep sleep state ('2'), roll-over state ('3'), out-of-bed state ('4'). The vital sign parameter bits comprise breathing data and heartbeat data, and the breathing data is 'B' and the 2-bit digital character occupies 24 bits; the heartbeat data is 'H' and the 3-bit numeric characters occupy 32 bits. The stop bit is 16 bits for the fixed ED.
When the first status bit is the unattended state, the status switch, the over-close state, the countdown state (a, b, c, d, 9-0), the respiration data and the heartbeat data are set to 0, for example: STa1B00H000 ED. When the first status bit is the engaged status (e), the smart terminal 100 should send actual data, such as STe1B21H072ED, indicating that the respiration data is 21 times per minute and the heartbeat data is 72 times per minute.
After the state data is generated, the intelligent terminal 100 may send the state data to the server 200, so that the server 200 may obtain sleep state information by analyzing the state data, and match recommended media assets according to an analysis result of the state data. After receiving the recommended media asset data fed back by the server 200 according to the state data, the intelligent terminal 100 may complete displaying the sleep detection result.
According to the technical scheme, by setting the two-stage sleep states of the first state and the second state, the sleep data acquired by the intelligent terminal 100 can reflect the real sleep state of the user more accurately, the types of the media assets pushed by the server 200 are more accurate, and the user experience is improved.
In some embodiments, while the server 200 pushes the recommended media asset data to the smart terminal 100, the smart terminal 100 or the server 200 may further control other devices in the smart home system according to the specific sleep state of the user, that is, the communicator is further configured to connect to an associated device group, where the associated device group may include smart devices such as a display device, a lighting device, a network device, and an environment adjusting device. The associated equipment groups can establish connection through the intelligent home system network and can be mutually controlled to realize a synergistic effect. For example, in the smart home system, an associated device group formed by devices such as a smart television, a smart air conditioner, and a smart refrigerator may be included. Multiple devices may communicate control signals through the AIoT system.
When the intelligent terminal 100 detects that the user is in an abnormal sleep state, the environment parameter can be acquired through a built-in environment parameter sensor or a related device group, then the environment parameter is compared with a preset comfortable parameter interval, and when the environment parameter is not in the comfortable parameter interval, an adjusting instruction is sent to the environment adjusting device to control the environment adjusting device to operate.
For example, the smart terminal 100 may implement a child sleep monitoring function based on a smart home system, that is, push related information according to the number of times a child turns over in combination with the local weather condition, and turn on an air conditioner via AIOT or infrared to adjust to a suitable mode if the weather is too hot or too cold. That is, the intelligent terminal 100 determines that the user is in the abnormal sleep state by calculating the sleep state information when it is monitored that the turnover frequency of the child is too high, that is, the turnover frequency is greater than the turnover number threshold. At this time, the smart terminal 100 may acquire the current room temperature. The current room temperature can come from the AIoT system, namely, the air conditioning equipment in the room is provided with a temperature and humidity sensor, and the detected temperature and humidity data is uploaded to the AIoT system. And then, judging the current room temperature, if the current room temperature is summer and is higher than the proper temperature by 26 ℃, the intelligent terminal 100 can acquire an intelligent device list of the current room through the AIoT system and determine air-conditioning equipment or fan equipment in the device list, so that the air-conditioning equipment or the fan is automatically controlled through the AIoT system to adjust the indoor temperature.
Obviously, when controlling the devices in the associated device group to run, the intelligent terminal 100 may also interact with the server 200 to obtain the recommended media asset items. For example, if the number of turns of a child is not reduced within a specific time after the air conditioning device is controlled to operate, the intelligent terminal 100 may push an abnormal message to remind a parent user. And if no air conditioner and other equipment exists in the room, the AIoT system can synchronize the information to the content pushing system, push a purchasing link at the terminal and simultaneously push abnormal information to remind the parents of the user.
It should be noted that the above control process may also be controlled by the server 200, that is, as shown in fig. 16, after the intelligent terminal 100 sends the sleep state information to the server 200, it may also receive control data fed back by the server 200, where the control data includes a control instruction for the associated device group; and forwarding the control instruction to the associated equipment group to control the equipment in the associated equipment group to operate.
In addition, in some embodiments, the associated device group may further include a device unrelated to environmental regulation, such as a refrigerator. When the above control process is controlled by the server 200, the server 200 may also present the content related to the current sleep detection result by using the device function in the associated device group.
For example, for a refrigerator device with a built-in screen, the server 200 may push a menu thereto to improve sleep through a dietary therapy; the pushed recipe may be associated with food materials within the refrigerator and remind the user what food materials should be prepared. That is, after the intelligent terminal 100 monitors that the sleep state is abnormal and sends the sleep abnormality to the server 200, the server 200 may push different contents to the intelligent terminal 100 and/or the refrigerator device according to different abnormalities. If the menu is related, the related content of the menu can be obtained from a third party such as 'bean and fruit food' and the like, and the related content of the menu can be displayed at the screen end of the refrigerator.
In some embodiments, server 200 may also establish a personal health profile for different users for storing health data for each user separately. I.e. the storage module of the server 200 is further configured to store the association data. After receiving the sleep state information, the server 200 may acquire user information of the user using the intelligent terminal 100, and extract personal health data from the associated data according to the user information.
And then different control modes are executed according to the extraction result of the personal health data. And if the personal health data are extracted from the associated data, generating a prompt message according to the sleep data and the personal health data, and pushing the prompt message to the intelligent terminal. And if the personal health data are not extracted from the associated data, sending a physical examination instruction to the intelligent terminal so that the intelligent terminal detects the personal health data of the user in response to the physical examination instruction.
For example, the smart terminal 100 may cooperate with the server 200 to implement sleep monitoring for elderly users. Namely, the sleep quality of the old is judged according to whether the waking time (w) and the waking time (tq) of the old exceed the threshold range. And the system is associated with the health data of the old people, so that the old people can carry out preliminary physical examination on a health remote controller, and if the old people have already undergone physical examination, the historical physical examination data of the old people are analyzed to remind the old people of carrying out regular physical examination.
And then, uploading the data of the judgment result of the sleep quality to the server 200, and judging whether the current user has health detection data by the server 200, wherein the health detection data comprises physical detection results such as heart rate, blood oxygen, blood pressure, microcirculation and the like. If the blood pressure of the old is abnormal, the detection data can be used for judging whether the blood pressure of the old is abnormal or not, and if the blood pressure is abnormal, the information of abnormal blood pressure is prompted. And recommends some blood pressure related lecture videos to the smart terminal 100. If the blood pressure is not abnormal, the sleep abnormal information is pushed to the intelligent terminal 100, and the content distribution service system pushes the decompression video. If no health detection data is stored in server 200, the user may be prompted for health detection via a push message.
As can be seen from the foregoing technical solutions, the sleep detection display method provided in the foregoing embodiments may be applied to an intelligent home system, where the intelligent home system includes an intelligent terminal 100 and a server 200, and the sleep detection display method obtains a control instruction for displaying a user interface, which is input by a user, through the intelligent terminal 100, and obtains sleep data in a preset detection period in response to the control instruction; the intelligent terminal 100 calculates the sleep state information according to the sleep data and sends the sleep state information to the server 200; the server 200 matches the media asset data adapted to the sleep state information to obtain recommended media asset data and feed back the recommended media asset data; finally, the recommended-media data is displayed in the user interface by the intelligent terminal 100. The method can enrich the display function of the intelligent terminal 100, and the sleep detection function can be operated cooperatively by multiple devices, thereby improving the user experience.
The embodiments provided in the present application are only a few examples of the general concept of the present application, and do not limit the scope of the present application. Any other embodiments extended according to the scheme of the present application without inventive efforts will be within the scope of protection of the present application for a person skilled in the art.

Claims (10)

1. An intelligent terminal, comprising:
a display configured to display a user interface;
a vital signs detector configured to detect sleep data of a user;
a communicator configured to establish a communication connection with a server;
a processor configured to:
acquiring a control instruction which is input by a user and used for displaying a user interface;
responding to the control instruction, and acquiring sleep data in a preset detection period;
calculating sleep state information according to the sleep data, and sending the sleep state information to the server so that the server feeds back recommended media asset data according to the sleep state information;
and controlling the display to display the recommended media asset data in the user interface.
2. The intelligent terminal of claim 1, further comprising: a distance sensor configured to detect a spatial distance of a user, the processor being further configured to:
acquiring user distance data through the distance sensor;
detecting a first state of a user according to the user distance data, wherein the first state comprises a matching state and a non-matching state;
if the user is detected to be in the cooperation state, executing the step of acquiring sleep data in a preset detection period;
and if the user is detected to be in the non-matching state, re-detecting the first state of the user within preset time.
3. The intelligent terminal of claim 2, wherein the processor is further configured to:
in the step of detecting the first state of the user according to the user distance data, a distance detection interval is obtained;
when the user distance data is in the distance detection interval, acquiring a user static state;
recording the duration of the user in a static state;
if the duration is greater than or equal to a time judgment threshold, marking that the user is in the fit state;
and if the duration is less than the time judgment threshold, marking that the user is in the non-fit state.
4. The intelligent terminal of claim 1, wherein the processor is further configured to:
in the step of calculating sleep state information according to the sleep data, a time parameter and a waking number are extracted from the sleep data, wherein the time parameter includes: deep sleep time, light sleep time, waking time, and total time;
detecting a second state of the user according to the time parameter and the waking times, wherein the second state comprises a sleep abnormal state and a sleep normal state;
if the user is detected to be in the abnormal sleep state, executing the step of sending the sleep state information to a server;
and if the user is detected to be in the normal sleep state, recording the sleep data.
5. The intelligent terminal of claim 1, wherein the communicator is further configured to connect to an associated device group, the associated device group including the environmental conditioning device; the processor is further configured to:
if the user is detected to be in the abnormal sleep state, acquiring environmental parameters;
comparing the environment parameter with a comfortable parameter interval;
and when the environmental parameter is not in the comfortable parameter interval, sending an adjusting instruction to the environment adjusting equipment so as to control the environment adjusting equipment to operate.
6. The intelligent terminal of claim 5, wherein the processor is further configured to:
after the step of sending the sleep state information to the server, receiving control data fed back by the server, wherein the control data comprises a control instruction for the associated device group;
and forwarding the control instruction to the associated equipment group to control the equipment in the associated equipment group to operate.
7. The intelligent terminal of claim 1, wherein the processor is further configured to:
in the step of sending the sleep state information to the server, generating state data according to the sleep data, wherein the state data is a fixed-length character string consisting of a start bit, a first state bit, a second state bit, a vital sign parameter bit and a stop bit;
sending the state data to the server so that the server analyzes the state data and matches recommended media assets according to the analysis result of the state data;
and receiving the recommended media asset data fed back by the server aiming at the state data.
8. A server, comprising:
a storage module configured to store media asset data;
the communication module is configured to establish a communication connection relation with the intelligent terminal;
a processing module configured to:
receiving sleep state information sent by the intelligent terminal, wherein the sleep state information is obtained by the intelligent terminal through calculation according to sleep data detected in a preset detection period;
matching the media asset data adaptive to the sleep state information in the storage module to obtain recommended media asset data;
and feeding back the recommended media asset data to the intelligent terminal.
9. The server according to claim 8, wherein the storage module is further configured to store association data, the processing module being further configured to:
acquiring user information of a user using the intelligent terminal;
extracting personal health data from the associated data according to the user information;
if the personal health data are extracted from the associated data, generating a prompt message according to the sleep data and the personal health data, and pushing the prompt message to the intelligent terminal;
if the personal health data are not extracted from the associated data, a physical examination instruction is sent to the intelligent terminal, so that the intelligent terminal detects the personal health data of the user in response to the physical examination instruction.
10. The sleep detection display method is applied to an intelligent home system, the intelligent home system comprises an intelligent terminal and a server, and the sleep detection display method comprises the following steps:
the intelligent terminal acquires a control instruction which is input by a user and used for displaying a user interface, and responds to the control instruction to acquire the sleep data in a preset detection period;
the intelligent terminal calculates sleep state information according to the sleep data and sends the sleep state information to the server;
the server matches the media asset data adaptive to the sleep state information to obtain recommended media asset data and feeds back the recommended media asset data;
and the intelligent terminal displays the recommended media asset data in the user interface.
CN202111275391.4A 2021-10-29 2021-10-29 Intelligent terminal, server and sleep detection display method Pending CN114007141A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111275391.4A CN114007141A (en) 2021-10-29 2021-10-29 Intelligent terminal, server and sleep detection display method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111275391.4A CN114007141A (en) 2021-10-29 2021-10-29 Intelligent terminal, server and sleep detection display method

Publications (1)

Publication Number Publication Date
CN114007141A true CN114007141A (en) 2022-02-01

Family

ID=79925496

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111275391.4A Pending CN114007141A (en) 2021-10-29 2021-10-29 Intelligent terminal, server and sleep detection display method

Country Status (1)

Country Link
CN (1) CN114007141A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116860034A (en) * 2023-06-20 2023-10-10 北京自动化控制设备研究所 Hardware-independent temperature control module safety protection method and system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108443965A (en) * 2018-03-29 2018-08-24 广东美的制冷设备有限公司 Dormant detection method, device, air conditioner and readable storage medium storing program for executing
CN109274757A (en) * 2018-10-15 2019-01-25 珠海格力电器股份有限公司 Music pushing method, household appliance equipment and computer storage medium
CN109616206A (en) * 2018-12-12 2019-04-12 广州医科大学附属第医院 Health states monitoring method, system and computer readable storage medium
CN110604859A (en) * 2019-10-24 2019-12-24 深圳易嘉恩科技有限公司 Sleep assisting control method and system based on intelligent household equipment
CN110825449A (en) * 2019-09-19 2020-02-21 咪咕音乐有限公司 Music playing method, electronic equipment and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108443965A (en) * 2018-03-29 2018-08-24 广东美的制冷设备有限公司 Dormant detection method, device, air conditioner and readable storage medium storing program for executing
CN109274757A (en) * 2018-10-15 2019-01-25 珠海格力电器股份有限公司 Music pushing method, household appliance equipment and computer storage medium
CN109616206A (en) * 2018-12-12 2019-04-12 广州医科大学附属第医院 Health states monitoring method, system and computer readable storage medium
CN110825449A (en) * 2019-09-19 2020-02-21 咪咕音乐有限公司 Music playing method, electronic equipment and storage medium
CN110604859A (en) * 2019-10-24 2019-12-24 深圳易嘉恩科技有限公司 Sleep assisting control method and system based on intelligent household equipment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116860034A (en) * 2023-06-20 2023-10-10 北京自动化控制设备研究所 Hardware-independent temperature control module safety protection method and system

Similar Documents

Publication Publication Date Title
US8509922B2 (en) Mobile terminal
US9886454B2 (en) Image processing, method and electronic device for generating a highlight content
CN105373227A (en) Method and device for intelligently closing electronic device
US20160246259A1 (en) Method, appararus and wearable apparatus for automatically reminding user to sleep
US20150137994A1 (en) Data-capable band management in an autonomous advisory application and network communication data environment
KR102233602B1 (en) Method and device for setting and recommending device action using user context
CN113854969A (en) Intelligent terminal and sleep monitoring method
US10623198B2 (en) Smart electronic device for multi-user environment
CN112087666B (en) Method for adjusting multimedia playing progress
WO2015083411A1 (en) Information-processing apparatus, information-processing method, and program
CN111917918B (en) Augmented reality-based event reminder management method and device and storage medium
KR102480914B1 (en) Electornic apparatus and operating method thereof
CN108229920B (en) Affair reminding method and mobile terminal
CN109327606A (en) A kind of message prompt method and terminal
CN114543313A (en) Air conditioner control method, server, air conditioner and user terminal
CN111083022A (en) Mobile terminal, control method thereof and computer storage medium
CN109660872A (en) A kind of method of adjustment and terminal of multimedia progress
CN114007141A (en) Intelligent terminal, server and sleep detection display method
JP2011239029A (en) Image display unit, power saving control unit and power saving method
CN103905837A (en) Image processing method and device and terminal
CN116649951A (en) Exercise data processing method, wearable device, terminal, body-building device and medium
CN113256238B (en) Reminding method and device and electronic equipment
CN112462997B (en) Content display method and device, electronic equipment and storage medium
CN113520361A (en) Heart rate detection method, terminal equipment and storage medium
EP3062691A1 (en) Data-capable band management

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination