WO2020118882A1 - Method, apparatus and smart device for monitoring study status - Google Patents

Abstract

Disclosed are a method, an apparatus and a smart device for monitoring study status. The method for monitoring study status comprises: capturing a first image; analyzing whether the first image contains content information; if so, capturing a second image; analyzing whether the second image contains human subject information; if so, analyzing whether the human subject information meets a predetermined human subject status standard; if not, forming a first monitoring result. The method for monitoring study status can detect whether a reader studies hard.

Description

学习状态监测方法、装置及智能设备Learning state monitoring method, device and intelligent equipment 技术领域Technical field

本发明涉及到信息处理技术领域，特别是涉及到一种学习状态监测方法、装置及智能设备。The invention relates to the field of information processing technology, in particular to a learning state monitoring method, device and intelligent equipment.

背景技术Background technique

现有技术中，阅读机器人只能自动翻书，自动读书，但是无法做到在读书的时候，检验小孩子是否有在认真学习，还是在做其他无关的事。In the prior art, the reading robot can only automatically turn over books and read books automatically, but it cannot test whether the children are seriously studying or doing other unrelated things while reading.

因此，如何在使用阅读机器人的过程中检验小孩是否在认真学习，以对小孩的学习进行监督，提高小孩的学习效率，是本领域技术人员亟待解决的技术问题。Therefore, how to test whether a child is seriously studying in the process of using a reading robot to supervise the child's learning and improve the child's learning efficiency is a technical problem that needs to be solved urgently by those skilled in the art.

技术问题technical problem

本发明的主要目的为提供一种学习状态监测方法、装置及智能设备，该学习状态监测方法可在使用智能设备进行阅读的过程中检验阅读者是否在认真学习。The main purpose of the present invention is to provide a learning state monitoring method, device and intelligent equipment. The learning state monitoring method can check whether the reader is studying seriously during the reading process using the intelligent equipment.

技术解决方案Technical solution

本发明提出一种学习状态监测方法，包括：The present invention provides a learning state monitoring method, including:

采集第一图像；Acquire the first image;

分析第一图像中是否含有指定的内容信息；Analyze whether the first image contains the specified content information;

若第一图像中含有指定的内容信息，则采集第二图像；If the first image contains the specified content information, the second image is collected;

分析第二图像中是否含有人物信息；Analyze whether the second image contains person information;

若第二图像中含有人物信息，则分析人物信息是否符合预设的人物状态标准；If the second image contains character information, analyze whether the character information meets the preset character status standard;

若否，则形成对应阅读者学习状态的第一监测结果；If not, the first monitoring result corresponding to the reader's learning status is formed;

若是，则形成对应阅读者学习状态的第二监测结果。If so, a second monitoring result corresponding to the reader's learning status is formed.

本发明还提出一种学习状态监测装置，包括：The invention also proposes a learning state monitoring device, including:

第一采集模块，用于采集第一图像；The first acquisition module is used to acquire the first image;

第一分析模块，用于分析第一图像中是否含有指定的内容信息；The first analysis module is used to analyze whether the first image contains the specified content information;

第二采集模块，用于当第一图像中含有指定的内容信息时，采集第二图像；The second collection module is used to collect the second image when the first image contains the specified content information;

第二分析模块，用于分析第二图像中是否含有人物信息；The second analysis module is used to analyze whether the second image contains person information;

第三分析模块，用于当第二图像中含有人物信息时，分析人物信息是否符合预设的人物状态标准；The third analysis module is used to analyze whether the character information meets the preset character status standard when the second image contains the character information;

第一形成模块，用于当人物信息不符合预设的人物状态标准时，形成对应阅读者学习状态的第一监测结果；The first forming module is used to form a first monitoring result corresponding to the reader's learning state when the character information does not meet the preset character state standard;

第二形成模块，用于当人物信息符合预设的人物状态标准时，形成对应阅读者学习状态的第二监测结果。The second forming module is used to form a second monitoring result corresponding to the reader's learning state when the character information meets the preset character state standard.

本发明还提出一种智能设备，包括存储器、处理器和计算机程序，计算机程序被存储在存储器中并被配置为由处理器执行，计算机程序被配置为用于执行前述的学习状态监测方法。The present invention also provides an intelligent device including a memory, a processor, and a computer program. The computer program is stored in the memory and configured to be executed by the processor, and the computer program is configured to perform the foregoing learning state monitoring method.

有益效果Beneficial effect

本发明与现有技术相比，有益效果在于：本发明的学习状态监测方法通过采集阅读者进行阅读学习时的图像，进而通过分析图像中的人物信息是否符合预设的人物状态标准，得出阅读者当前是否在认真学习，当人物信息不符预设的人物状态标准时，则说明阅读者当前没有在认真学习，进而可以通过设置提醒来督促阅读者认真学习，如通过向阅读者发出警报来提醒阅读者认真学习，又或者通过向监督者的终端设备发送提示信息来告知监督者当前阅读者没有认真学习，由监督者督促阅读者认真学习，从而能有效地在使用智能设备进行阅读的过程中对阅读者的学习状态进行监测，提高小孩的学习效率。Compared with the prior art, the present invention has the beneficial effect that the learning state monitoring method of the present invention acquires the image during reading learning by the reader, and then analyzes whether the character information in the image meets the preset character state standard to obtain Whether the reader is currently studying seriously, when the character information does not meet the preset character status standards, it means that the reader is not studying seriously, and then can set the reminder to urge the reader to study hard, such as by alerting the reader Readers study hard, or inform the supervisor by sending a prompt message to the supervisor’s terminal device that the current reader is not studying seriously, and the supervisor urges the reader to study carefully, so that it can effectively use the smart device for reading Monitor the reader's learning status to improve children's learning efficiency.

附图说明BRIEF DESCRIPTION

图1是本发明一实施中学习状态监测方法的流程示意图；FIG. 1 is a schematic flowchart of a learning state monitoring method in an implementation of the present invention;

图2是本发明一实施例中智能设备的结构示意图；2 is a schematic structural diagram of an intelligent device in an embodiment of the present invention;

图3是本发明一实施中学习状态监测装置的结构示意图；3 is a schematic structural diagram of a learning state monitoring device in an implementation of the present invention;

图4是本发明另一实施中学习状态监测装置的结构示意图；4 is a schematic structural diagram of a learning state monitoring device in another implementation of the present invention;

图5是图3的具体结构示意图。FIG. 5 is a schematic diagram of the specific structure of FIG. 3.

本发明目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。The implementation, functional characteristics and advantages of the present invention will be further described in conjunction with the embodiments and with reference to the drawings.

本发明的最佳实施方式Best Mode of the Invention

应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not intended to limit the present invention.

参照图1，本发明实施例提出一种学***板，机器人可以为阅读机器人，为方便理解，本发明以阅读机器人为例进行阐述。该方法包括：Referring to FIG. 1, an embodiment of the present invention proposes a learning state monitoring method, which is applied to a smart device. The smart device may be a speaker, a robot, a mobile phone, or a tablet. The robot may be a reading robot. For ease of understanding, the present invention regards the reading robot as Examples. The method includes:

S11，采集第一图像；S11, acquiring the first image;

S12，分析第一图像中是否含有指定的内容信息；S12, analyze whether the first image contains the specified content information;

S13，若第一图像中含有指定的内容信息，则采集第二图像；S13, if the first image contains the specified content information, collect the second image;

S14，分析第二图像中是否含有人物信息；S14, analyze whether the second image contains person information;

S15，若第二图像中含有人物信息，则分析人物信息是否符合预设的人物状态标准；S15. If the second image contains character information, analyze whether the character information meets the preset character status standard;

若否，则执行S16，形成对应阅读者学习状态的第一监测结果；If not, execute S16 to form a first monitoring result corresponding to the reader's learning status;

若是，则执行S17, 形成对应阅读者学习状态的第二监测结果。If yes, execute S17 to form a second monitoring result corresponding to the reader's learning status.

在上述S11中，具体地，可通过在阅读机器人上设置摄像头来采集所需的图像，例如，可在阅读机器人上设置用于扫描内容信息的第一摄像头以及用于监视阅读者活动状态的第二摄像头来分别采集所需的图像，又例如，可在阅读机器人上设置用于同时扫描内容信息和监视阅读者活动状态的全景摄像头来采集所需的图像，等等，对此不作具体的限制，为了方便说明和解释本发明实施例的内容，本发明实施例以在阅读机器人上设置用于扫描内容信息的第一摄像头以及用于监视阅读者活动状态的第二摄像头来分别采集所需的图像为例，进行相关的说明和解释；In the above S11, specifically, a camera can be installed on the reading robot to acquire a desired image. For example, a first camera for scanning content information and a first camera for monitoring the activity status of the reader can be provided on the reading robot Two cameras to collect the required images separately, for example, a panoramic camera can be set on the reading robot to scan the content information and monitor the reader's activity status to collect the required images, etc. There is no specific limitation on this In order to facilitate the description and explanation of the content of the embodiment of the present invention, the embodiment of the present invention sets a first camera for scanning content information and a second camera for monitoring the reader's activity status on the reading robot to separately collect the required The image is used as an example to explain and explain;

具体地，在使用阅读机器人进行阅读之前，阅读者面向阅读机器人，同时，将图书放于阅读机器人的指定位置上，其中，第一摄像头的视角范围覆盖指定位置以对图书的内容进行扫描，第二摄像头的视角范围覆盖阅读者的上半身区域以对阅读者的活动状态进行监视；使用时，可通过开启第一摄像头对图书的内容进行扫描，从而采集到第一图像，以便后续阅读机器人根据第一图像正确读出图书的内容以及确定是否开启第二摄像头进行拍摄。Specifically, before using the reading robot for reading, the reader faces the reading robot, and at the same time, places the book at the designated position of the reading robot, wherein the angle of view of the first camera covers the designated position to scan the content of the book. The angle of view of the two cameras covers the upper body area of the reader to monitor the reader's activity status; when in use, the content of the book can be scanned by turning on the first camera to collect the first image, so that the subsequent reading robot can An image reads the content of the book correctly and determines whether to turn on the second camera for shooting.

在上述S12中，指定的内容信息可以是图书上的文字，也可以是图书上的图画，也可以是图书上的文字和图画，采集到第一图像后，通过对第一图像进行文字识别或图像识别，可获知第一图像中是否含有指定的内容信息，例如，通过对第一图像进行文字识别，可分析出第一图像中是否含有文字，当分析出第一图像中含有文字时，再通过现有的语音合成技术即可将识别出的文字转换成对应的语音，从而实现阅读机器人的读书功能。In the above S12, the specified content information may be text on the book, pictures on the book, or text and pictures on the book. After collecting the first image, perform text recognition on the first image or Image recognition, you can know whether the first image contains the specified content information, for example, by performing text recognition on the first image, you can analyze whether the first image contains text, when it is analyzed that the first image contains text, then Through the existing speech synthesis technology, the recognized text can be converted into corresponding speech, thereby realizing the reading function of the reading robot.

在上述S13中，当分析出第一图像中含有指定的内容信息时，阅读机器人进行“读书”，同时开启第二摄像头，通过第二摄像头对自身视角范围内的景象进行拍摄，从而采集到连续多帧的第二图像，以便后续根据第二图像进行相关操作。In the above S13, when it is analyzed that the first image contains the specified content information, the reading robot performs "reading", and at the same time turns on the second camera, and shoots the scene within its own angle of view through the second camera, thereby collecting continuous Multiple frames of the second image for subsequent related operations based on the second image.

在上述S14中，通过对第二图像进行视觉检测，分析出第二图像中是否含有人物信息，若第二图像中含有人物信息，则表明当前有阅读者在进行阅读。In the above S14, by visually inspecting the second image, it is analyzed whether the second image contains person information. If the second image contains person information, it indicates that a reader is currently reading.

在上述S15中，当分析出第二图像中含有人物信息时，则进一步分析第二图像中的人物信息是否符合预设的人物状态标准，若人物信息符合预设的人物状态标准，则表明当前阅读者正在认真学习，但若人物信息不符合预设的人物状态标准，则表明当前阅读者没有在认真学习，而是在做其他无关阅读的事。In the above S15, when it is analyzed that the second image contains character information, it is further analyzed whether the character information in the second image meets the preset character status standard. If the character information meets the preset character status standard, it indicates that the current The reader is studying carefully, but if the character information does not meet the preset character status standards, it indicates that the current reader is not studying seriously, but is doing other things that have nothing to do with reading.

在上述S16、S17中，当第二图像中的人物信息不符合预设的人物状态标准时，则阅读机器人形成对应阅读者学习状态为不认真学习的监测结果，即上述第一监测结果；而当第二图像中的人物信息符合预设的人物状态标准时，则阅读机器人形成对应阅读者学习状态为认真学习的监测结果，即上述第二监测结果，从而达到检验阅读者是否在认真学习的目的。In the above S16 and S17, when the character information in the second image does not meet the preset character status standard, the reading robot forms a monitoring result corresponding to the reader's learning status as inadequate learning, that is, the first monitoring result; and when When the character information in the second image meets the preset character status standard, the reading robot forms a monitoring result corresponding to the reader's learning status as serious learning, that is, the above-mentioned second monitoring result, so as to achieve the purpose of checking whether the reader is studying seriously.

在一个优选的实施例中，形成对应阅读者学习状态的第二监测结果的步骤之后，还包括：In a preferred embodiment, after the step of forming the second monitoring result corresponding to the reader's learning state, the method further includes:

S18，在第一预设时间后采集第三图像；S18, acquiring a third image after the first preset time;

S19，分析第三图像与第一图像是否相同；S19, analyzing whether the third image is the same as the first image;

S20，若第三图像与第一图像相同，则采集第四图像；S20, if the third image is the same as the first image, acquire a fourth image;

S21，分析第四图像中是否含有人物信息；S21, analyze whether the fourth image contains person information;

S22，若第四图像中含有人物信息，则分析人物信息是否符合预设的人物状态标准；S22, if the fourth image contains character information, analyze whether the character information meets the preset character status standard;

S23，若人物信息不符合预设的人物状态标准，则形成对应阅读者学习状态的第一监测结果。S23. If the character information does not meet the preset character status standard, a first monitoring result corresponding to the reader's learning status is formed.

在上述S18中，当阅读机器人形成对应阅读者学习状态的第二监测结果时，则可初步说明当前阅读者正在认真学习，此时在第一预设时间（如30秒）后可通过第一摄像头来采集第三图像，即隔段时间后再次通过第一摄像头进行图像的采集，以便后续进行相关操作。In the above S18, when the reading robot forms the second monitoring result corresponding to the reader's learning state, it can initially indicate that the current reader is studying seriously, and at this time, after the first preset time (such as 30 seconds), the first The third image is acquired by the camera, that is, the image is acquired by the first camera again after an interval of time, so as to perform related operations later.

在上述S19中，具体地，采集到第三图像后，将第三图像与之前采集到的第一图像进行比较，分析第三图像与第一图像是否相同，以便后续进行相关操作。In the above S19, specifically, after the third image is collected, the third image is compared with the first image previously collected, and whether the third image is the same as the first image is analyzed to facilitate subsequent related operations.

在上述S20中，当分析出第三图像与第一图像相同时，则表明在相当一段时间内阅读者并没有翻书，此时再次开启第二摄像头，通过第二摄像头对自身视角范围内的景象再次进行拍摄，从而采集到连续多帧的第四图像，以便后续根据第四图像进行相关操作。In the above S20, when it is analyzed that the third image is the same as the first image, it indicates that the reader has not turned the book within a certain period of time. At this time, the second camera is turned on again, and the second camera The scene is photographed again, so as to collect the fourth image in consecutive multiple frames, so as to perform related operations according to the fourth image later.

在上述S21中，通过对第四图像进行视觉检测，分析出第四图像中是否含有人物信息，若第四图像中含有人物信息，则表明当前有阅读者在进行阅读。In the above S21, by visually inspecting the fourth image, it is analyzed whether the fourth image contains person information. If the fourth image contains person information, it indicates that a reader is currently reading.

在上述S22中，当分析出第四图像中含有人物信息时，则进一步分析第四图像中的人物信息是否符合预设的人物状态标准，若人物信息符合预设的人物状态标准，则表明当前阅读者正在认真学习，但若人物信息不符合预设的人物状态标准时，则表明当前阅读者没有在认真学习，而是在做其他无关阅读的事。In the above S22, when it is analyzed that the fourth image contains character information, it is further analyzed whether the character information in the fourth image meets the preset character status standard. If the character information meets the preset character status standard, it indicates that the current The reader is studying carefully, but if the character information does not meet the preset character status standard, it means that the current reader is not studying seriously, but is doing other things that have nothing to do with reading.

在上述S23中，若第四图像中的人物信息不符合预设的人物状态标准，则阅读机器人可据此得到阅读者不认真学习的监测结果，即上述的第一监测结果；若第四图像中的人物信息符合预设的人物状态标准，则说明当前阅读者正在认真看书，此时阅读机器人可据此得到阅读者认真学习的监测结果，即上述的第二监测结果。In the above S23, if the character information in the fourth image does not meet the preset character status standard, the reading robot can accordingly obtain the monitoring result that the reader does not study seriously, namely the first monitoring result; if the fourth image The character information in the file meets the preset character status standard, which means that the current reader is reading the book seriously. At this time, the reading robot can obtain the monitoring result of the reader's serious learning based on this, that is, the above-mentioned second monitoring result.

在本实施例中，当初步发现阅读者处于认真学习的状态时，则通过每隔一段时间检测阅读者是否有翻书的方式，来进一步确认接下来的时间里阅读者是否仍处于认真学习的状态，使得阅读机器人可持续地对阅读者的学习状态进行监测，提高了阅读机器人的实用性。In this embodiment, when it is initially found that the reader is in a state of serious learning, then by checking whether the reader has turned the book every other time, to further confirm whether the reader is still in a serious study in the following time The status allows the reading robot to continuously monitor the reader's learning status and improves the practicability of the reading robot.

在一个优选的实施例中，人物信息包括双肩与水平方向之间的角度，此时可通过以下方式分析第二图像或第四图像中的人物信息是否符合预设的人物状态标准：In a preferred embodiment, the character information includes the angle between the shoulders and the horizontal direction. At this time, it can be analyzed whether the character information in the second image or the fourth image meets the preset character status standard in the following manner:

S15a，分析双肩与水平方向之间的角度是否大于第一预设角度；S15a, analyzing whether the angle between the shoulders and the horizontal direction is greater than the first preset angle;

S15b，若双肩与水平方向之间的角度大于第一预设角度，则判定人物信息不符合预设的人物状态标准。S15b: If the angle between the shoulders and the horizontal direction is greater than the first preset angle, it is determined that the character information does not meet the preset character status standard.

在本实施例中，通过对第二摄像头采集到的连续多帧的人物图像进行视觉检测，可分析出双肩与水平方向之间的角度是否大于第一预设角度（如30度），若双肩与水平方向之间的角度大于第一预设角度，则表明当前阅读者的身体倾斜幅度过大，如趴在桌子上或倚靠在椅子上偷懒或睡觉，此时可据此判定出人物信息不符合预设的人物状态标准，即当前阅读者没有在认真学习，进而便于后续通过设置提醒来督促阅读者认真学习，以提高阅读者的学习效率，同时，这也意味着阅读者在进行阅读时需要保持较好的阅读姿势才不会被阅读机器人“误判”，这样有利于督促阅读者养成良好的阅读姿势。In this embodiment, by visually detecting the continuous multi-frame character images collected by the second camera, it can be analyzed whether the angle between the shoulder and the horizontal direction is greater than the first preset angle (such as 30 degrees). The angle from the horizontal direction is greater than the first preset angle, indicating that the current reader's body tilt is too large, such as lying on the table or leaning on a chair to lazy or sleep, at this time it can be determined that the person information is not It meets the preset character status standard, that is, the current reader is not studying seriously, so as to facilitate the follow-up to set the reminder to urge the reader to study carefully, so as to improve the reader's learning efficiency. At the same time, it also means that the reader is reading It is necessary to maintain a good reading posture so as not to be "misjudged" by the reading robot, which is conducive to urging readers to develop a good reading posture.

在一个优选的实施例中，人物信息包括头部与任意一肩膀之间的角度，此时可通过以下方式分析第二图像或第四图像中的人物信息是否符合预设的人物状态标准：In a preferred embodiment, the character information includes the angle between the head and any shoulder. In this case, it can be analyzed whether the character information in the second image or the fourth image meets the preset character status standard in the following manner:

S15c，分析头部与任意一肩膀之间的角度是否小于第二预设角度；S15c, analyzing whether the angle between the head and any shoulder is smaller than the second preset angle;

S15d，若头部与任意一肩膀之间的角度小于第二预设角度，则判定人物信息不符合预设的人物状态标准。S15d: If the angle between the head and any shoulder is smaller than the second preset angle, it is determined that the character information does not meet the preset character status standard.

在本实施例中，通过对第二摄像头采集到的连续多帧的人物图像进行视觉检测，可分析出头部与任意一肩膀之间的角度是否小于第二预设角度（如60度），若头部与任意一肩膀之间的角度小于第二预设角度，则表明当前阅读者的头部倾斜幅度过大，例如在打瞌睡，此时可据此判定出人物信息不符合预设的人物状态标准，即当前阅读者没有在认真学习，进而便于后续通过设置提醒来督促阅读者认真学习，以提高阅读者的学习效率，同时，这也意味着阅读者在进行阅读时需要保持较好的阅读姿势才不会被阅读机器人“误判”，这样有利于督促阅读者养成良好的阅读姿势。In this embodiment, by visually detecting the continuous multi-frame character images collected by the second camera, it can be analyzed whether the angle between the head and any shoulder is less than the second preset angle (such as 60 degrees), If the angle between the head and any shoulder is less than the second preset angle, it indicates that the current reader's head tilt is too large, such as dozing, at this time it can be determined that the character information does not meet the preset The character status standard, that is, the current reader is not studying seriously, so as to facilitate the follow-up to set the reminder to urge the reader to study carefully, so as to improve the reader's learning efficiency. At the same time, it also means that the reader needs to maintain good while reading The reading posture will not be "misjudged" by the reading robot, which is conducive to urging the reader to develop a good reading posture.

在一个优选的实施例中，人物信息包括眼睛持续闭合的时间，此时可通过以下方式分析第二图像或第四图像中的人物信息是否符合预设的人物状态标准：In a preferred embodiment, the character information includes the time that the eyes continue to be closed. At this time, whether the character information in the second image or the fourth image meets the preset character status standard can be analyzed in the following manner:

S15e，分析眼睛持续闭合的时间是否超出第二预设时间；S15e, analyzing whether the time that the eyes continue to close exceeds the second preset time;

S15f，若眼睛持续闭合的时间超出第二预设时间，则判定人物信息不符合预设的人物状态标准。S15f: If the time that the eyes continue to close exceeds the second preset time, it is determined that the character information does not meet the preset character status standard.

在本实施例中，通过对第二摄像头采集到的连续多帧的人物图像进行人脸检测和人脸识别，可分析出眼睛持续闭合的时间是否超出第二预设时间（如20秒），若眼睛持续闭合的时间超出第二预设时间，则表明当前阅读者眼睛持续闭合的时间过长，例如在打瞌睡，此时可据此判定出人物信息不符合预设的人物状态标准，即当前阅读者没有在认真学习，进而便于后续通过设置提醒来督促阅读者认真学习，以提高阅读者的学习效率。In this embodiment, by performing face detection and face recognition on the continuous multi-frame character images collected by the second camera, it can be analyzed whether the time of continuous eye closure exceeds the second preset time (such as 20 seconds), If the time that the eyes continue to close exceeds the second preset time, it means that the current reader's eyes continue to close for too long, for example, while dozing, at this time it can be determined that the character information does not meet the preset character status standards, that is At present, the reader is not studying seriously, so as to facilitate the follow-up to set the reminder to urge the reader to study seriously, so as to improve the reader's learning efficiency.

在一个优选的实施例中，人物信息包括第三预设时间内的眨眼次数，此时可通过以下方式分析第二图像或第四图像中的人物信息是否符合预设的人物状态标准：In a preferred embodiment, the character information includes the number of blinks within a third preset time, and at this time, it can be analyzed whether the character information in the second image or the fourth image meets the preset character status standard in the following manner:

S15g，分析第三预设时间内的眨眼次数是否超出预设次数；S15g, analyzing whether the number of blinks in the third preset time exceeds the preset number of times;

S15h，若第三预设时间内的眨眼次数超出预设次数，则判定人物信息不符合预设的人物状态标准。S15h, if the number of blinks in the third preset time exceeds the preset number of times, it is determined that the character information does not meet the preset character status standard.

在本实施例中，通过对第二摄像头采集到的连续多帧的人物图像进行人脸检测和人脸识别，可分析出第三预设时间（如20秒）内的眨眼次数是否超出预设次数（如10次），若第三预设时间内的眨眼次数超出预设次数，则表明当前阅读者在频繁地眨眼，例如在打瞌睡或者开小差，此时可据此判定出人物信息不符合预设的人物状态标准，即当前阅读者没有在认真学习，进而便于后续通过设置提醒来督促阅读者认真学习，以提高阅读者的学习效率。In this embodiment, by performing face detection and face recognition on the continuous multi-frame character images collected by the second camera, it can be analyzed whether the number of blinks in the third preset time (such as 20 seconds) exceeds the preset The number of times (such as 10 times). If the number of blinks in the third preset time exceeds the preset number, it indicates that the current reader is blinking frequently, for example, dozing off or opening a small gap. At this time, it can be determined that the person information does not match The preset character status standard, that is, the current reader is not studying seriously, and then facilitates the follow-up to set the reminder to urge the reader to study carefully, so as to improve the reader's learning efficiency.

在一个优选的实施例中，人物信息包括嘴巴的高度与宽度之比，此时可通过以下方式分析第二图像或第四图像中的人物信息是否符合预设的人物状态标准：In a preferred embodiment, the character information includes the ratio of the height of the mouth to the width. At this time, it can be analyzed whether the character information in the second image or the fourth image meets the preset character status standard in the following manner:

S15i，分析嘴巴的高度与宽度之比是否大于预设值；S15i, analyze whether the ratio of the height of the mouth to the width is greater than the preset value;

S15j，若嘴巴的高度与宽度之比大于预设值，则判定人物信息不符合预设的人物状态标准。S15j, if the ratio of the height of the mouth to the width is greater than the preset value, it is determined that the character information does not meet the preset character status standard.

在本实施例中，通过对第二摄像头采集到的连续多帧的人物图像进行视觉检测，可分析出嘴巴的高度与宽度之比是否大于预设值（例如预设值可设置为“1”），若嘴巴的高度与宽度之比大于预设值，则表明当前阅读者嘴巴的动作幅度过大，例如在打哈欠，此时可据此判定出人物信息不符合预设的人物状态标准，即当前阅读者没有在认真学习，进而便于后续通过设置提醒来督促阅读者认真学习，以提高阅读者的学习效率。In this embodiment, by visually detecting the continuous multi-frame character images collected by the second camera, it can be analyzed whether the ratio of the height of the mouth to the width is greater than a preset value (for example, the preset value can be set to "1" ), if the ratio of the height of the mouth to the width is greater than the preset value, it means that the current reader’s mouth movement is too large, such as yawning, at this time it can be determined that the character information does not meet the preset character status standards, That is, the current reader is not studying seriously, and it is convenient for the follow-up to set the reminder to urge the reader to study seriously, so as to improve the reader's learning efficiency.

优选地，形成对应阅读者学习状态的第一监测结果的步骤之后，还包括：Preferably, after the step of forming the first monitoring result corresponding to the reader's learning state, the method further includes:

S16a，向阅读者发出警报或/和向监督者的终端设备发送提示信息。S16a, issue an alarm to the reader or/and send prompt information to the terminal device of the supervisor.

在本实施例中，具体地，当阅读机器人形成对应阅读者学习状态的第一监测结果时，则表明当前阅读者没有在认真学习，而是在做其他无关阅读的事，此时可通过向阅读者发出警报来提醒阅读者认真学习，又或者通过向监督者（家长）的终端设备（如智能手机）发送提示信息来告知监督者当前阅读者（小孩）没有认真学习，以便监督者督促阅读者认真学习，从而有利于提高阅读者的学习效率，这两种提醒方式可择一使用，亦可同时进行使用，对此不作具体的限制。In this embodiment, specifically, when the reading robot forms the first monitoring result corresponding to the learning state of the reader, it indicates that the current reader is not studying seriously, but is doing other things that have nothing to do with reading. The reader issues an alert to remind the reader to study seriously, or by sending a prompt message to the terminal device (such as a smartphone) of the supervisor (parent) to inform the supervisor that the current reader (child) is not studying seriously so that the supervisor can urge reading The learners study carefully, which is conducive to improving the learning efficiency of the readers. These two reminder methods can be used one at a time or at the same time. There are no specific restrictions on this.

在一个可选的实施例中，若第四图像中含有人物信息，则分析人物信息是否符合预设的人物状态标准的步骤之后，还包括：In an optional embodiment, if the fourth image contains character information, after the step of analyzing whether the character information meets the preset character status standard, the method further includes:

S22a，若第四图像中的人物信息符合预设的人物状态标准，则分析未发出提醒信息的时间长度是否超出预设时间长度，其中，发出提醒信息包括向阅读者发出警报或/和向监督者的终端设备发送提示信息；S22a, if the character information in the fourth image meets the preset character status standard, analyze whether the length of time for which no reminder information is issued exceeds the preset time length, where the issue of the reminder information includes alerting the reader or/and supervising The terminal device of the sender sends a prompt message;

S22b，若未发出提醒信息的时间长度超出预设时间长度，则向阅读者播放用于鼓励阅读者的语音信息或/和向监督者的终端设备发送阅读者正在认真学习的状态信息。S22b: If the length of time for which no reminder information is sent exceeds the preset time length, play a voice message to encourage the reader or/and send the status information that the reader is studying carefully to the terminal device of the supervisor.

在本实施例中，若第四图像中的人物信息符合预设的人物状态标准，则说明阅读者在相当一段时间内均处于认真学习的状态，此时进一步分析未发出提醒信息的时间长度是否超出预设时间长度（如30分钟），若未发出提醒信息的时间长度超出预设时间长度，则说明阅读者在相当长的一段时间内（该时间段的长度由预设时间长度而定）均处于认真学习的状态，此时阅读机器人可向阅读者（小孩）播放用于鼓励阅读者的语音信息，如“宝宝你已经认真学习30分钟啦，好棒哦！要继续加油哦！”，又或者向监督者（家长）的终端设备发送阅读者正在认真学习的状态信息，如“您的小孩已经认真学习30分钟啦，值得表扬哦！”，从而有利于提高用户的使用体验，这两种提醒方式可择一使用，亦可同时进行使用，对此不作具体的限制。In this embodiment, if the character information in the fourth image meets the preset character status standard, it means that the reader is in a state of serious study for a considerable period of time. At this time, it is further analyzed whether the length of time that no reminder message is issued Exceeds the preset length of time (such as 30 minutes), if the length of time without a reminder message exceeds the preset length of time, it means that the reader has been in a fairly long period of time (the length of this period of time is determined by the preset length of time) They are all in a state of serious learning. At this time, the reading robot can play a voice message to encourage the reader (child), such as "baby, you have been studying hard for 30 minutes, great! Please continue to cheer!", Or send the status information that the reader is studying seriously to the terminal device of the supervisor (parent), such as "Your child has been studying hard for 30 minutes, it is worthy of praise!", which is conducive to improving the user experience, these two You can choose one of these reminder methods or use them at the same time. There are no specific restrictions on this.

因此，本发明实施例的学习状态监测方法通过采集阅读者进行阅读学习时的图像，进而通过分析图像中的人物信息是否符合预设的人物状态标准，得出阅读者当前是否在认真学习，当人物信息不符预设的人物状态标准时，则说明阅读者当前没有在认真学习，进而可以通过设置提醒来督促阅读者认真学习，如通过向阅读者发出警报来提醒阅读者认真学习，又或者通过向监督者的终端设备发送提示信息来告知监督者当前阅读者没有认真学习，由监督者督促阅读者认真学习，从而能有效地在使用阅读机器人进行阅读的过程中对阅读者的学习状态进行监测，提高小孩的学习效率。Therefore, the learning state monitoring method according to the embodiment of the present invention acquires the image of the reader during reading learning, and then analyzes whether the character information in the image meets the preset character state standard to obtain whether the reader is currently studying seriously. When the character information does not meet the preset character status standard, it means that the reader is not studying seriously, and then can set the reminder to urge the reader to study seriously, such as by alerting the reader to remind the reader to study seriously, or by The supervisor’s terminal device sends a prompt message to inform the supervisor that the current reader is not studying seriously. The supervisor urges the reader to study carefully, so that the reader’s learning status can be effectively monitored during the reading process using the reading robot. Improve children's learning efficiency.

参照图3，本发明实施例还提出一种学习状态监测装置，包括：Referring to FIG. 3, an embodiment of the present invention further provides a learning state monitoring device, including:

第一采集模块1，用于采集第一图像；The first acquisition module 1 is used to acquire the first image;

第一分析模块2，用于分析第一图像中是否含有指定的内容信息；The first analysis module 2 is used to analyze whether the first image contains the specified content information;

第二采集模块3，用于当第一图像中含有指定的内容信息时，采集第二图像；The second collection module 3 is used to collect a second image when the first image contains specified content information;

第二分析模块4，用于分析第二图像中是否含有人物信息；The second analysis module 4 is used to analyze whether the second image contains person information;

第三分析模块5，用于当第二图像中含有人物信息时，分析人物信息是否符合预设的人物状态标准；The third analysis module 5 is used to analyze whether the character information meets the preset character status standard when the second image contains the character information;

第一形成模块6，用于当人物信息不符合预设的人物状态标准时，形成对应阅读者学习状态的第一监测结果；The first forming module 6 is used to form a first monitoring result corresponding to the reader's learning state when the character information does not meet the preset character state standard;

第二形成模块7，用于当人物信息符合预设的人物状态标准时，形成对应阅读者学习状态的第二监测结果。The second forming module 7 is used to form a second monitoring result corresponding to the reader's learning state when the character information meets the preset character state standard.

在上述第一采集模块1中，具体地，可通过在阅读机器人上设置摄像头来采集所需的图像，例如，可在阅读机器人上设置用于扫描内容信息的第一摄像头以及用于监视阅读者活动状态的第二摄像头来分别采集所需的图像，又例如，可在阅读机器人上设置用于同时扫描内容信息和监视阅读者活动状态的全景摄像头来采集所需的图像，等等，对此不作具体的限制；为了方便说明和解释本发明实施例的内容，本发明实施例以在阅读机器人上设置用于扫描内容信息的第一摄像头以及用于监视阅读者活动状态的第二摄像头来分别采集所需的图像为例，进行相关的说明和解释；In the above-mentioned first collection module 1, specifically, a camera can be set on the reading robot to acquire a desired image, for example, a first camera for scanning content information and a reader can be set on the reading robot The second camera in the active state to separately acquire the required images. For example, a panoramic camera for simultaneously scanning content information and monitoring the active state of the reader can be set on the reading robot to acquire the required images, etc. There is no specific limitation; in order to facilitate the description and explanation of the content of the embodiment of the present invention, the embodiment of the present invention sets a first camera for scanning content information and a second camera for monitoring the reader's activity status on the reading robot respectively Take the required images as an example to make relevant explanations and explanations;

具体地，在使用阅读机器人进行阅读之前，阅读者面向阅读机器人，同时将图书放于阅读机器人的指定位置上，其中，第一摄像头的视角范围覆盖指定位置以对图书的内容进行扫描，第二摄像头的视角范围覆盖阅读者的上半身区域以对阅读者的状态进行监视；使用时，第一采集模块1可通过开启第一摄像头对图书的内容进行扫描，从而采集到第一图像，以便后续阅读机器人根据第一图像正确读出图书的内容以及确定是否开启第二摄像头进行拍摄。Specifically, before using the reading robot for reading, the reader faces the reading robot, and at the same time places the book at the designated position of the reading robot, wherein the viewing angle range of the first camera covers the designated position to scan the content of the book, and the second The angle of view of the camera covers the upper body area of the reader to monitor the state of the reader; when in use, the first acquisition module 1 can scan the content of the book by turning on the first camera to acquire the first image for subsequent reading The robot correctly reads the content of the book according to the first image and determines whether to turn on the second camera to shoot.

在上述第一分析模块2中，指定的内容信息可以是图书上的文字，也可以是图书上的图画，也可以是图书上的文字和图画，第一分析模块2从第一采集模块1中获得第一图像后，通过对第一图像进行文字识别或图像识别，可获知第一图像中是否含有指定的内容信息，例如，通过对第一图像进行文字识别，可分析出第一图像中是否含有文字，当第一分析模块2分析出第一图像中含有文字时，再通过现有的语音合成技术即可将识别出的文字转换成对应的语音，从而实现阅读机器人的读书功能。In the above-mentioned first analysis module 2, the specified content information may be text on the book, or pictures on the book, or text and pictures on the book. The first analysis module 2 from the first collection module 1 After obtaining the first image, by performing text recognition or image recognition on the first image, you can know whether the first image contains the specified content information. For example, by performing text recognition on the first image, you can analyze whether the first image Contains text. When the first analysis module 2 analyzes that the first image contains text, the recognized text can be converted into the corresponding voice through the existing speech synthesis technology, thereby realizing the reading function of the reading robot.

在上述第二采集模块3中，当第一分析模块2分析出第一图像中含有指定的内容信息时，阅读机器人进行“读书”，同时第二采集模块3可通过开启第二摄像头对自身视角范围内的景象进行拍摄，从而采集到连续多帧的第二图像，以便后续根据第二图像进行相关操作。In the above-mentioned second collection module 3, when the first analysis module 2 analyzes that the first image contains the specified content information, the reading robot performs "reading", and at the same time, the second collection module 3 can view its own perspective by turning on the second camera The scene within the range is photographed, so as to collect a second image of consecutive multiple frames, so as to subsequently perform related operations according to the second image.

在上述第二分析模块4中，可通过第二分析模块4对第二图像进行视觉检测，分析出第二图像中是否含有人物信息，若第二图像中含有人物信息，则表明当前有阅读者在进行阅读。In the above second analysis module 4, the second analysis module 4 can perform visual inspection on the second image to analyze whether the second image contains person information. If the second image contains person information, it indicates that there is currently a reader Reading.

在上述第三分析模块5中，当第二分析模块4分析出第二图像中含有人物信息时，则进一步通过第三分析模块5分析第二图像中的人物信息是否符合预设的人物状态标准，若人物信息符合预设的人物状态标准，则表明当前阅读者正在认真学习，但若人物信息不符合预设的人物状态标准，则表明当前阅读者没有在认真学习，而是在做其他无关阅读的事。In the above third analysis module 5, when the second analysis module 4 analyzes that the second image contains person information, the third analysis module 5 further analyzes whether the person information in the second image meets the preset person status standard , If the character information meets the preset character status standard, it indicates that the current reader is studying seriously, but if the character information does not meet the preset character status standard, it indicates that the current reader is not studying seriously, but doing other irrelevant Things to read.

在上述第一形成模块6、第二形成模块7中，当通过第三分析模块5分析出第二图像中的人物信息不符合预设的人物状态标准时，则通过第一形成模块6形成对应阅读者学习状态为不认真学习的监测结果，即上述第一监测结果；而当通过第三分析模块5分析出第二图像中的人物信息符合预设的人物状态标准时，则通过第二形成模块7形成对应阅读者学习状态为认真学习的监测结果，即上述第二监测结果，从而达到检验阅读者是否在认真学习的目的。In the first forming module 6 and the second forming module 7, when the third analysis module 5 analyzes that the character information in the second image does not meet the preset character status standard, the corresponding reading is formed by the first forming module 6 The learner's learning status is the monitoring result of inattentive learning, that is, the above-mentioned first monitoring result; and when the character information in the second image analyzed by the third analysis module 5 meets the preset character status standard, the second forming module 7 A monitoring result corresponding to the learning status of the reader is carefully studied, that is, the above-mentioned second monitoring result, so as to achieve the purpose of checking whether the reader is studying seriously.

参照图4，该学习状态监测装置还包括第三采集模块8、第四分析模块9、第四采集模块10，其中，4, the learning state monitoring device further includes a third collection module 8, a fourth analysis module 9, and a fourth collection module 10, wherein,

第三采集模块8，用于在第一预设时间后采集第三图像；The third acquisition module 8 is used to acquire the third image after the first preset time;

第四分析模块9，用于分析第三图像与第一图像是否相同；The fourth analysis module 9 is used to analyze whether the third image is the same as the first image;

第四采集模块10，用于当第三图像与第一图像相同时，采集第四图像；The fourth collection module 10 is used to collect a fourth image when the third image is the same as the first image;

第二分析模块4，还用于分析第四图像中是否含有人物信息；The second analysis module 4 is also used to analyze whether the fourth image contains person information;

第三分析模块5，还用于当第四图像中含有人物信息时，分析人物信息是否符合预设的人物状态标准。The third analysis module 5 is also used to analyze whether the character information meets the preset character status standard when the fourth image contains the character information.

在上述第三采集模块8中，当第二形成模块7形成对应阅读者学习状态的第二监测结果时，则可初步说明当前阅读者正在认真学习，此时第三采集模块8在第一预设时间（如30秒）后可通过第一摄像头来采集第三图像，以便后续进行相关操作。In the above third collection module 8, when the second forming module 7 forms a second monitoring result corresponding to the reader's learning state, it can initially indicate that the current reader is studying seriously, and at this time the third collection module 8 is in the first After setting the time (for example, 30 seconds), the third image can be collected by the first camera, so as to perform related operations later.

在第四分析模块9中，具体地，第四分析模块9从第三采集模块8中获得第三图像后，第四分析模块9将第三图像与之前采集到的第一图像进行比较，分析第三图像与第一图像是否相同，以便后续进行相关操作。In the fourth analysis module 9, specifically, after the fourth analysis module 9 obtains the third image from the third acquisition module 8, the fourth analysis module 9 compares the third image with the previously acquired first image to analyze Whether the third image is the same as the first image, so as to perform related operations later.

在上述第四采集模块10中，当第四分析模块9分析出第三图像与第一图像相同时，则表明在相当一段时间内阅读者并没有翻书，此时第四采集模块10可通过开启第二摄像头对自身视角范围内的景象再次进行拍摄，从而采集到连续多帧的第四图像，以便后续第二分析模块4根据第四图像进行相关操作。In the above fourth collection module 10, when the fourth analysis module 9 analyzes that the third image is the same as the first image, it indicates that the reader has not turned the book within a certain period of time, and the fourth collection module 10 can pass The second camera is turned on to take pictures of the scene within its own angle of view again, so as to acquire fourth images in consecutive multiple frames, so that the subsequent second analysis module 4 performs related operations according to the fourth images.

在上述第二分析模块4中，通过第二分析模块4对第四图像进行视觉检测，分析出第四图像中是否含有人物信息，若第四图像中含有人物信息，则表明当前有阅读者在进行阅读。In the above-mentioned second analysis module 4, the second analysis module 4 visually inspects the fourth image to analyze whether the fourth image contains person information. If the fourth image contains person information, it indicates that a reader is currently in Read it.

在上述第三分析模块5中，当第二分析模块4分析出第四图像中含有人物信息时，则通过第三分析模块5进一步分析第四图像中的人物信息是否符合预设的人物状态标准，若第四图像中的人物信息不符合预设的人物状态标准，则第一形成模块6可据此得到阅读者不认真学习的监测结果，即上述的第一监测结果；若第四图像中的人物信息符合预设的人物状态标准，则说明当前阅读者正在认真看书，此时第二形成模块7可据此得到阅读者认真学习的监测结果，即上述的第二监测结果。In the above-mentioned third analysis module 5, when the second analysis module 4 analyzes that the fourth image contains person information, the third analysis module 5 further analyzes whether the person information in the fourth image meets the preset person status standard If the character information in the fourth image does not meet the preset character status standard, the first forming module 6 can accordingly obtain the monitoring result that the reader does not study seriously, that is, the above-mentioned first monitoring result; if the fourth image The character information of the user meets the preset character status standard, which means that the current reader is reading the book seriously. At this time, the second forming module 7 can obtain the monitoring result of the reader's serious study, that is, the above-mentioned second monitoring result.

在本实施例中，当初步发现阅读者处于认真学习的状态时，则通过每隔一段时间检测阅读者是否有翻书的方式，来进一步确认接下来的时间里阅读者是否仍处于认真学习的状态，使得阅读机器人可持续地对阅读者的学习状态进行监测，提高了阅读机器人的实用性。In this embodiment, when it is initially found that the reader is in a state of serious learning, then by checking whether the reader has turned the book every other time, to further confirm whether the reader is still in a serious study in the following time The status allows the reading robot to continuously monitor the reader's learning status and improves the practicability of the reading robot.

参照图3和图5，具体地，人物信息包括双肩与水平方向之间的角度，此时第三分析模块5包括第一分析单元5a和第一判定单元5b，其中，Referring to FIGS. 3 and 5, specifically, the character information includes the angle between the shoulders and the horizontal direction, and at this time, the third analysis module 5 includes a first analysis unit 5a and a first determination unit 5b, where,

第一分析单元5a，用于分析双肩与水平方向之间的角度是否大于第一预设角度；The first analysis unit 5a is configured to analyze whether the angle between the shoulders and the horizontal direction is greater than the first preset angle;

第一判定单元5b，用于当双肩与水平方向之间的角度大于第一预设角度时，判定人物信息不符合预设的人物状态标准。The first determining unit 5b is configured to determine that the character information does not meet the preset character status standard when the angle between the shoulders and the horizontal direction is greater than the first preset angle.

在本实施例中，通过第一分析单元5a对第二摄像头采集到的连续多帧的人物图像进行视觉检测，可分析出双肩与水平方向之间的角度是否大于第一预设角度（如30度），若双肩与水平方向之间的角度大于第一预设角度，则表明当前阅读者的身体倾斜幅度过大，如趴在桌子上或倚靠在椅子上偷懒或睡觉，此时第一判定单元5b可据此判定出人物信息不符合预设的人物状态标准，即当前阅读者没有在认真学习，进而便于后续通过设置提醒模块11来督促阅读者认真学习，以提高阅读者的学习效率，同时，这也意味着阅读者在进行阅读时需要保持较好的阅读姿势才不会被阅读机器人“误判”，这样有利于督促阅读者养成良好的阅读姿势。In this embodiment, the first analysis unit 5a performs visual detection on the continuous multi-frame character images collected by the second camera to analyze whether the angle between the shoulders and the horizontal direction is greater than the first preset angle (such as 30 Degrees), if the angle between the shoulders and the horizontal direction is greater than the first preset angle, it means that the current reader’s body tilt is too large, such as lying on the table or leaning on the chair to lazy or sleep, the first judgment Unit 5b can determine that the character information does not meet the preset character status standards, that is, the current reader is not studying seriously, which is convenient for subsequent follow-up through setting reminder module 11 to urge the reader to study carefully, so as to improve the learning efficiency of the reader, At the same time, this also means that the reader needs to maintain a good reading posture in order not to be "misjudged" by the reading robot, which is conducive to urging the reader to develop a good reading posture.

参照图3和图5，具体地，人物信息包括头部与任意一肩膀之间的角度，此时第三分析模块5包括第二分析单元5c和第二判定单元5d，其中，Referring to FIGS. 3 and 5, specifically, the character information includes the angle between the head and any shoulder, and at this time, the third analysis module 5 includes a second analysis unit 5c and a second determination unit 5d, where,

第二分析单元5c，用于分析头部与任意一肩膀之间的角度是否小于第二预设角度；The second analysis unit 5c is used to analyze whether the angle between the head and any shoulder is smaller than the second preset angle;

第二判定单元5d，用于当头部与任意一肩膀之间的角度小于第二预设角度时，判定人物信息不符合预设的人物状态标准。The second determining unit 5d is configured to determine that the character information does not meet the preset character status standard when the angle between the head and any shoulder is smaller than the second preset angle.

在本实施例中，通过第二分析单元5c对第二摄像头采集到的连续多帧的人物图像进行视觉检测，可分析出头部与任意一肩膀之间的角度是否小于第二预设角度（如60度），若头部与任意一肩膀之间的角度小于第二预设角度，则表明当前阅读者的头部倾斜幅度过大，例如在打瞌睡，此时第二判定单元5d可据此判定出人物信息不符合预设的人物状态标准，即当前阅读者没有在认真学习，进而便于后续通过设置提醒模块11来督促阅读者认真学习，以提高阅读者的学习效率，同时，这也意味着阅读者在进行阅读时需要保持较好的阅读姿势才不会被阅读机器人“误判”，这样有利于督促阅读者养成良好的阅读姿势。In this embodiment, the second analysis unit 5c performs visual detection on the continuous multi-frame character images collected by the second camera to analyze whether the angle between the head and any shoulder is less than the second preset angle ( For example, 60 degrees), if the angle between the head and any shoulder is less than the second preset angle, it indicates that the current reader’s head tilt is too large, for example, while dozing, at this time the second determination unit 5d can This determines that the character information does not meet the preset character status standards, that is, the current reader is not studying seriously, and it is convenient for the follow-up to set the reminder module 11 to urge the reader to study carefully to improve the reader's learning efficiency. At the same time, this also It means that the reader needs to maintain a good reading posture in order not to be "misjudged" by the reading robot, which is conducive to urging the reader to develop a good reading posture.

参照图3和图5，人物信息包括眼睛持续闭合的时间，此时第三分析模块5包括第三分析单元5e和第三判定单元5f，其中，Referring to FIGS. 3 and 5, the character information includes the time that the eyes continue to be closed, and at this time, the third analysis module 5 includes a third analysis unit 5e and a third determination unit 5f, where,

第三分析单元5e，用于分析眼睛持续闭合的时间是否超出第二预设时间；The third analysis unit 5e is used to analyze whether the time of continuous eye closure exceeds the second preset time;

第三判定单元5f，用于当眼睛持续闭合的时间超出第二预设时间时，判定人物信息不符合预设的人物状态标准。The third determining unit 5f is configured to determine that the character information does not meet the preset character status standard when the time that the eyes continue to close exceeds the second preset time.

在本实施例中，通过第三分析单元5e对第二摄像头采集到的连续多帧的人物图像进行人脸检测和人脸识别，可分析出眼睛持续闭合的时间是否超出第二预设时间（如20秒），若眼睛持续闭合的时间超出第二预设时间，则表明当前阅读者眼睛持续闭合的时间过长，例如在打瞌睡，此时第三判定单元5f可据此判定出人物信息不符合预设的人物状态标准，即当前阅读者没有在认真学习，进而便于后续通过设置提醒模块11来督促阅读者认真学习，以提高阅读者的学习效率。In this embodiment, the third analysis unit 5e performs face detection and face recognition on the continuous multi-frame character images collected by the second camera, and it can be analyzed whether the duration of continuous eye closure exceeds the second preset time ( Such as 20 seconds), if the time that the eyes continue to close exceeds the second preset time, it means that the current reader's eyes continue to close for too long, for example, while dozing, at this time, the third determination unit 5f can determine the person information according to this It does not meet the preset character status standard, that is, the current reader is not studying seriously, and it is convenient for the follow-up to set the reminder module 11 to urge the reader to study carefully, so as to improve the reader's learning efficiency.

参照图3和图5，人物信息包括第三预设时间内的眨眼次数，此时第三分析模块5包括第四分析单元5g和第四判定单元5h，其中，Referring to FIGS. 3 and 5, the person information includes the number of blinks within a third preset time, and at this time, the third analysis module 5 includes a fourth analysis unit 5g and a fourth determination unit 5h, where,

第四分析单元5g，用于分析第三预设时间内的眨眼次数是否超出预设次数；The fourth analysis unit 5g is configured to analyze whether the number of blinks in the third preset time exceeds the preset number of times;

第四判定单元5h，用于当第三预设时间内的眨眼次数超出预设次数时，判定人物信息不符合预设的人物状态标准。The fourth determining unit 5h is configured to determine that the character information does not meet the preset character status standard when the number of blinks in the third preset time exceeds the preset number of times.

在本实施例中，通过第四分析单元5g对第二摄像头采集到的连续多帧的人物图像进行人脸检测和人脸识别，可分析出第三预设时间（如20秒）内的眨眼次数是否超出预设次数（如10次），若第三预设时间内的眨眼次数超出预设次数，则表明当前阅读者在频繁地眨眼，例如在打瞌睡或者开小差，此时第四判定单元5h可据此判定出人物信息不符合预设的人物状态标准，即当前阅读者没有在认真学习，进而便于后续通过设置提醒模块11来督促阅读者认真学习，以提高阅读者的学习效率。In this embodiment, the fourth analysis unit 5g performs face detection and face recognition on the continuous multi-frame character images collected by the second camera to analyze the blink within a third preset time (such as 20 seconds) Whether the number of times exceeds the preset number of times (such as 10 times), if the number of blinks exceeds the preset number of times within the third preset time, it indicates that the current reader is blinking frequently, for example, dozing off or opening a small gap, at this time the fourth determination unit According to 5h, it can be determined that the character information does not meet the preset character status standard, that is, the current reader is not studying seriously, which is convenient for subsequent follow-up through setting the reminder module 11 to urge the reader to study carefully, so as to improve the reader's learning efficiency.

参照图3和图5，人物信息包括嘴巴的高度与宽度之比，此时第三分析模块5包括第五分析单元5i和第五判定单元5j，其中，Referring to FIGS. 3 and 5, the character information includes the ratio of the height of the mouth to the width. At this time, the third analysis module 5 includes a fifth analysis unit 5i and a fifth determination unit 5j, where,

第五分析单元5i，用于分析嘴巴的高度与宽度之比是否大于预设值；The fifth analysis unit 5i is used to analyze whether the ratio of the height of the mouth to the width is greater than a preset value;

第五判定单元5j，用于当嘴巴的高度与宽度之比大于预设值时，判定人物信息不符合预设的人物状态标准。The fifth determining unit 5j is configured to determine that the character information does not meet the preset character status standard when the ratio of the height of the mouth to the width is greater than the preset value.

在本实施例中，通过第五分析单元5i对第二摄像头采集到的连续多帧的人物图像进行视觉检测，可分析出嘴巴的高度与宽度之比是否大于预设值（例如预设值可设置为“1”），若嘴巴的高度与宽度之比大于预设值，则表明当前阅读者嘴巴的动作幅度过大，例如在打哈欠，此时第五判定单元5j可据此判定出人物信息不符合预设的人物状态标准，即当前阅读者没有在认真学习，进而便于后续通过设置提醒模块11来督促阅读者认真学习，以提高阅读者的学习效率。In this embodiment, the fifth analysis unit 5i performs visual detection on the continuous multi-frame character images collected by the second camera, and it can be analyzed whether the ratio of the mouth height to the width is greater than a preset value (for example, the preset value can be Set to "1"), if the ratio of the height of the mouth to the width is greater than the preset value, it means that the current reader’s mouth movement is too large, such as yawning, at this time the fifth judgment unit 5j can judge the character accordingly The information does not conform to the preset character status standard, that is, the current reader is not studying seriously, which is convenient for subsequent follow-up by setting the reminder module 11 to urge the reader to study seriously, so as to improve the reader's learning efficiency.

参照图4，优选地，该学习状态监测装置还包括提醒模块11，该提醒模块11用于向阅读者发出警报或/和向监督者的终端设备发送提示信息。Referring to FIG. 4, preferably, the learning state monitoring device further includes a reminder module 11, which is used to issue an alarm to the reader or/and send prompt information to the terminal device of the supervisor.

在本实施例中，具体地，当第一形成模块6形成对应阅读者学习状态的第一监测结果时，则表明当前阅读者没有在认真学习，而是在做其他无关阅读的事，此时可通过提醒模块11向阅读者发出警报来提醒阅读者认真学习，又或者通过提醒模块11向监督者（家长）的终端设备（如智能手机）发送提示信息来告知监督者当前阅读者（小孩）没有认真学习，以便监督者督促阅读者认真学习，从而有利于提高阅读者的学习效率，这两种提醒方式可择一使用，亦可同时进行使用，对此不作具体的限制。In this embodiment, specifically, when the first forming module 6 forms the first monitoring result corresponding to the learning state of the reader, it indicates that the current reader is not studying seriously, but is doing other things that have nothing to do with reading. The reminder module 11 can alert the reader to remind the reader to study seriously, or the reminder module 11 can send a prompt message to the terminal device (such as a smartphone) of the supervisor (parent) to inform the supervisor of the current reader (child) There is no serious study, so that the supervisor urges the reader to study carefully, which is conducive to improving the reader's learning efficiency. These two reminder methods can be used one at a time or at the same time. There are no specific restrictions on this.

参照图4，优选地，该学习状态监测装置还包括第五分析模块12和汇报模块13，其中，Referring to FIG. 4, preferably, the learning state monitoring device further includes a fifth analysis module 12 and a reporting module 13, wherein,

第五分析模块12，用于当第四图像中的人物信息符合预设的人物状态标准时，分析未发出提醒信息的时间长度是否超出预设时间长度，其中，发出提醒信息包括向阅读者发出警报或/和向监督者的终端设备发送提示信息；The fifth analysis module 12 is used to analyze whether the length of time that no reminder information is sent exceeds the preset time length when the character information in the fourth image meets the preset character status standard, wherein the issue of the reminder information includes an alert to the reader Or/and send prompt information to the supervisor's terminal equipment;

汇报模块13，用于当未发出提醒信息的时间长度超出预设时间长度时，向阅读者播放用于鼓励阅读者的语音信息或/和向监督者的终端设备发送阅读者正在认真学习的状态信息。The reporting module 13 is used to play a voice message to encourage the reader or/and send the status of the reader to the terminal device of the supervisor when the reminder message is not sent out beyond the preset length of time information.

在本实施例中，若第四图像中的人物信息符合预设的人物状态标准，则说明阅读者在相当一段时间内均处于认真学习的状态，此时可通过第五分析模块12进一步分析提醒模块11未发出提醒信息的时间长度是否超出预设时间长度（如30分钟），若提醒模块11未发出提醒信息的时间长度超出预设时间长度，则说明阅读者在相当长的一段时间内（该时间段的长度由预设时间长度而定）均处于认真学习的状态，此时可通过汇报模块13向阅读者（小孩）播放用于鼓励阅读者的语音信息，如“宝宝你已经认真学习30分钟啦，好棒哦！要继续加油哦！”，又或者通过汇报模块13向监督者（家长）的终端设备发送阅读者正在认真学习的状态信息，如“您的小孩已经认真学习30分钟啦，值得表扬哦！”，从而有利于提高用户的使用体验，这两种提醒方式可择一使用，亦可同时进行使用，对此不作具体的限制。In this embodiment, if the character information in the fourth image meets the preset character status standard, it means that the reader is in a state of serious learning for a considerable period of time. At this time, the fifth analysis module 12 can further analyze and remind Whether the length of time that the module 11 does not issue a reminder message exceeds the preset length of time (such as 30 minutes). If the length of time that the reminder module 11 does not issue a reminder message exceeds the preset length of time, it means that the reader has been in a considerable period of time ( The length of this time period is determined by the preset time length) are in a state of serious learning, at this time, the voice message used to encourage the reader can be played to the reader (child) through the reporting module 13, such as "baby you have studied hard 30 minutes, great! Keep going!", or send the status information that the reader is studying hard to the terminal device of the supervisor (parent) through the report module 13, such as "Your child has been studying hard for 30 minutes Oh, it’s commendable!", so as to help improve the user experience, these two reminders can be used one at a time, or they can be used at the same time. There are no specific restrictions on this.

因此，本发明实施例的学习状态监测装置通过采集阅读者进行阅读学习时的图像，进而通过分析图像中的人物信息是否符合预设的人物状态标准，得出阅读者当前是否在认真学习，当人物信息不符预设的人物状态标准时，则说明阅读者当前没有在认真学习，进而可以通过设置提醒来督促阅读者认真学习，如通过向阅读者发出警报来提醒阅读者认真学习，又或者通过向监督者的终端设备发送提示信息来告知监督者当前阅读者没有认真学习，由监督者督促阅读者认真学习，从而能有效地在使用阅读机器人进行阅读的过程中对阅读者的学习状态进行监测，提高小孩的学习效率。Therefore, the learning status monitoring device of the embodiment of the present invention can acquire whether the reader is currently studying seriously by collecting the image of the reader during reading learning and then analyzing whether the character information in the image meets the preset character status standard. When the character information does not meet the preset character status standard, it means that the reader is not studying seriously, and then can set the reminder to urge the reader to study seriously, such as by alerting the reader to remind the reader to study seriously, or by The supervisor’s terminal device sends a prompt message to inform the supervisor that the current reader is not studying seriously. The supervisor urges the reader to study carefully, so that the reader’s learning status can be effectively monitored during the reading process using the reading robot. Improve children's learning efficiency.

参照图2，本发明实施例还提出一种智能设备，包括存储器100、处理器200和计算机程序300，计算机程序300被存储在存储器100中并被配置为由处理器200执行，计算机程序300被配置为用于执行上述任一实施例中的学习状态监测方法。Referring to FIG. 2, an embodiment of the present invention further provides an intelligent device, including a memory 100, a processor 200, and a computer program 300. The computer program 300 is stored in the memory 100 and configured to be executed by the processor 200, and the computer program 300 is It is configured to perform the learning state monitoring method in any of the above embodiments.

以上所述仅为本发明的优选实施例，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。The above are only the preferred embodiments of the present invention, and therefore do not limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made by the description and drawings of the present invention, or directly or indirectly used in other related In the technical field, the same reason is included in the patent protection scope of the present invention.

Claims (19)

1. 一种学习状态监测方法，其特征在于，包括：A learning state monitoring method, characterized by including:

   采集第一图像；Acquire the first image;

   分析所述第一图像中是否含有指定的内容信息；Analyzing whether the first image contains the specified content information;

   若所述第一图像中含有指定的内容信息，则采集第二图像；If the first image contains the specified content information, the second image is collected;

   分析所述第二图像中是否含有人物信息；Analyzing whether the second image contains person information;

   若所述第二图像中含有人物信息，则分析所述人物信息是否符合预设的人物状态标准；If the second image contains character information, analyze whether the character information meets a preset character status standard;

   若否，则形成对应阅读者学习状态的第一监测结果；If not, the first monitoring result corresponding to the reader's learning status is formed;

   若是，则形成对应阅读者学习状态的第二监测结果。If so, a second monitoring result corresponding to the reader's learning status is formed.
2. 根据权利要求1所述的学习状态监测方法，其特征在于，所述形成对应阅读者学习状态的第二监测结果的步骤之后，还包括：The learning status monitoring method according to claim 1, wherein after the step of forming a second monitoring result corresponding to the reader's learning status, the method further comprises:

   在第一预设时间后采集第三图像；Acquire a third image after the first preset time;

   分析所述第三图像与所述第一图像是否相同；Analyzing whether the third image is the same as the first image;

   若所述第三图像与所述第一图像相同，则采集第四图像；If the third image is the same as the first image, acquire a fourth image;

   分析所述第四图像中是否含有人物信息；Analyzing whether the fourth image contains character information;

   若所述第四图像中含有人物信息，则分析所述人物信息是否符合预设的人物状态标准；If the fourth image contains character information, analyze whether the character information meets a preset character status standard;

   若所述人物信息不符合预设的人物状态标准，则形成对应所述阅读者学习状态的所述第一监测结果。If the character information does not meet the preset character state standard, the first monitoring result corresponding to the reader's learning state is formed.
3. 根据权利要求1所述的学习状态监测方法，其特征在于，所述形成对应阅读者学习状态的第一监测结果的步骤之后，还包括：The learning state monitoring method according to claim 1, wherein after the step of forming the first monitoring result corresponding to the reader's learning state, the method further comprises:

   向阅读者发出警报或/和向监督者的终端设备发送提示信息。Alert readers and/or send prompt messages to supervisors’ terminal devices.
4. 根据权利要求2所述的学习状态监测方法，其特征在于，所述若所述第四图像中含有人物信息，则分析所述人物信息是否符合预设的人物状态标准的步骤之后，还包括：The learning state monitoring method according to claim 2, wherein after the step of analyzing whether the character information meets a preset character state standard if the fourth image contains character information, the method further includes:

   若所述第四图像中的人物信息符合预设的人物状态标准，则分析未发出提醒信息的时间长度是否超出预设时间长度，其中，发出提醒信息包括向阅读者发出警报或/和向监督者的终端设备发送提示信息；If the character information in the fourth image meets the preset character status standard, analyze whether the length of time for which no reminder information is issued exceeds the preset time length, where the issue of the reminder information includes alerting the reader or/and supervising The terminal device of the sender sends prompt information;

   若未发出提醒信息的时间长度超出预设时间长度，则向所述阅读者播放用于鼓励所述阅读者的语音信息或/和向监督者的终端设备发送所述阅读者正在认真学习的状态信息。If the length of time for which no reminder message is issued exceeds the preset length of time, a voice message for encouraging the reader is played to the reader or/and a state where the reader is studying carefully is sent to the terminal device of the supervisor information.
5. 根据权利要求1至4任一项所述的学***方向之间的角度，所述分析所述人物信息是否符合预设的人物状态标准的步骤，包括：The learning state monitoring method according to any one of claims 1 to 4, wherein the character information includes an angle between shoulders and a horizontal direction, and the analysis of whether the character information meets a preset character state standard The steps include:

   分析所述双肩与水平方向之间的角度是否大于第一预设角度；Analyzing whether the angle between the shoulders and the horizontal direction is greater than the first preset angle;

   若所述双肩与水平方向之间的角度大于第一预设角度，则判定所述人物信息不符合预设的人物状态标准。If the angle between the shoulders and the horizontal direction is greater than the first preset angle, it is determined that the character information does not meet the preset character status standard.
6. 根据权利要求1至4任一项所述的学习状态监测方法，其特征在于，所述人物信息包括头部与任意一肩膀之间的角度，所述分析所述人物信息是否符合预设的人物状态标准的步骤，包括：The learning state monitoring method according to any one of claims 1 to 4, wherein the character information includes an angle between a head and any shoulder, and the analysis of whether the character information matches a preset character The steps of the status standard include:

   分析所述头部与任意一肩膀之间的角度是否小于第二预设角度；Analyzing whether the angle between the head and any shoulder is smaller than the second preset angle;

   若所述头部与任意一肩膀之间的角度小于第二预设角度，则判定所述人物信息不符合预设的人物状态标准。If the angle between the head and any shoulder is smaller than the second preset angle, it is determined that the character information does not meet the preset character status standard.
7. 根据权利要求1至4任一项所述的学习状态监测方法，其特征在于，所述人物信息包括眼睛持续闭合的时间，所述分析所述人物信息是否符合预设的人物状态标准的步骤，包括：The learning state monitoring method according to any one of claims 1 to 4, wherein the character information includes a time when the eyes continue to be closed, and the step of analyzing whether the character information meets a preset character state standard, include:

   分析所述眼睛持续闭合的时间是否超出第二预设时间；Analyzing whether the time for which the eyes continue to close exceeds the second preset time;

   若所述眼睛持续闭合的时间超出第二预设时间，则判定所述人物信息不符合预设的人物状态标准。If the time for which the eyes continue to close exceeds the second preset time, it is determined that the character information does not meet the preset character status standard.
8. 根据权利要求1至4任一项所述的学习状态监测方法，其特征在于，所述人物信息包括第三预设时间内的眨眼次数，所述分析所述人物信息是否符合预设的人物状态标准的步骤，包括：The learning state monitoring method according to any one of claims 1 to 4, wherein the character information includes the number of blinks within a third preset time, and the analysis of whether the character information conforms to a preset character state Standard steps include:

   分析所述第三预设时间内的眨眼次数是否超出预设次数；Analyzing whether the number of blinks in the third preset time exceeds the preset number of times;

   若第三预设时间内的眨眼次数超出预设次数，则判定所述人物信息不符合预设的人物状态标准。If the number of blinks in the third preset time exceeds the preset number of times, it is determined that the character information does not meet the preset character status standard.
9. 根据权利要求1至4任一项所述的学习状态监测方法，其特征在于，所述人物信息包括嘴巴的高度与宽度之比，所述分析所述人物信息是否符合预设的人物状态标准的步骤，包括：The learning state monitoring method according to any one of claims 1 to 4, wherein the character information includes a ratio of a mouth's height to a width, and the analysis of whether the character information meets a preset character state standard The steps include:

   分析所述嘴巴的高度与宽度之比是否大于预设值；Analyzing whether the ratio of the height of the mouth to the width is greater than a preset value;

   若所述嘴巴的高度与宽度之比大于预设值，则判定所述人物信息不符合预设的人物状态标准。If the ratio of the height of the mouth to the width is greater than the preset value, it is determined that the character information does not meet the preset character status standard.
10. 一种学习状态监测装置，其特征在于，包括：A learning state monitoring device, characterized in that it includes:

    第一采集模块，用于采集第一图像；The first acquisition module is used to acquire the first image;

    第一分析模块，用于分析所述第一图像中是否含有指定的内容信息；A first analysis module, used to analyze whether the first image contains specified content information;

    第二采集模块，用于当所述第一图像中含有指定的内容信息时，采集第二图像；A second collection module, configured to collect a second image when the first image contains specified content information;

    第二分析模块，用于分析所述第二图像中是否含有人物信息；A second analysis module, used to analyze whether the second image contains person information;

    第三分析模块，用于当所述第二图像中含有人物信息时，分析所述人物信息是否符合预设的人物状态标准；A third analysis module, configured to analyze whether the character information meets a preset character status standard when the second image contains character information;

    第一形成模块，用于当所述人物信息不符合预设的人物状态标准时，形成对应阅读者学习状态的第一监测结果；A first forming module, configured to form a first monitoring result corresponding to a reader's learning state when the character information does not meet a preset character state standard;

    第二形成模块，用于当所述人物信息符合预设的人物状态标准时，形成对应阅读者学习状态的第二监测结果。The second forming module is configured to form a second monitoring result corresponding to the reader's learning state when the character information meets a preset character state standard.
11. 根据权利要求10所述的学习状态监测装置，其特征在于，还包括第三采集模块、第四分析模块、第四采集模块，其中，The learning state monitoring device according to claim 10, further comprising a third collection module, a fourth analysis module, and a fourth collection module, wherein,

    所述第三采集模块，用于在第一预设时间后采集第三图像；The third collection module is configured to collect a third image after a first preset time;

    所述第四分析模块，用于分析所述第三图像与所述第一图像是否相同；The fourth analysis module is configured to analyze whether the third image is the same as the first image;

    所述第四采集模块，用于当所述第三图像与所述第一图像相同时，采集第四图像；The fourth collection module is configured to collect a fourth image when the third image is the same as the first image;

    所述第二分析模块，还用于分析所述第四图像中是否含有人物信息；The second analysis module is also used to analyze whether the fourth image contains person information;

    所述第三分析模块，还用于当所述第四图像中含有人物信息时，分析所述人物信息是否符合预设的人物状态标准。The third analysis module is further configured to analyze whether the person information meets a preset person state standard when the fourth image contains person information.
12. 根据权利要求10所述的学习状态监测装置，其特征在于，还包括：The learning state monitoring device according to claim 10, further comprising:

    提醒模块，用于向阅读者发出警报或/和向监督者的终端设备发送提示信息。The reminder module is used to issue an alarm to the reader or/and send prompt information to the terminal device of the supervisor.
13. 根据权利要求11所述的学习状态监测装置，其特征在于，还包括：The learning state monitoring device according to claim 11, further comprising:

    第五分析模块，用于当所述第四图像中的人物信息符合预设的人物状态标准时，分析未发出提醒信息的时间长度是否超出预设时间长度，其中，发出提醒信息包括向阅读者发出警报或/和向监督者的终端设备发送提示信息；The fifth analysis module is used to analyze whether the length of time that no reminder information is sent exceeds the preset time length when the character information in the fourth image meets the preset character status standard, wherein the issue of the reminder information includes sending to the reader Alert or/and send prompt information to the supervisor's terminal equipment;

    汇报模块，用于当未发出提醒信息的时间长度超出预设时间长度时，向所述阅读者播放用于鼓励阅读者的语音信息或/和向监督者的终端设备发送阅读者正在认真学习的状态信息。The reporting module is used to play a voice message to encourage the reader or/and send to the terminal device of the supervisor what the reader is seriously studying when the length of time for which no reminder message is sent exceeds the preset length of time status information.
14. 根据权利要求10至13任一项所述的学***方向之间的角度，所述第三分析模块包括第一分析单元和第一判定单元，其中，The learning state monitoring device according to any one of claims 10 to 13, wherein the character information includes an angle between shoulders and a horizontal direction, and the third analysis module includes a first analysis unit and a first determination Unit, where,

    所述第一分析单元，用于分析所述双肩与水平方向之间的角度是否大于第一预设角度；The first analysis unit is configured to analyze whether the angle between the shoulders and the horizontal direction is greater than a first preset angle;

    所述第一判定单元，用于当所述双肩与水平方向之间的角度大于第一预设角度时，判定所述人物信息不符合预设的人物状态标准。The first determining unit is configured to determine that the character information does not meet a preset character state standard when the angle between the shoulders and the horizontal direction is greater than the first preset angle.
15. 根据权利要求10至13任一项所述的学习状态监测装置，其特征在于，所述人物信息包括头部与任意一肩膀之间的角度，所述第三分析模块包括第二分析单元和第二判定单元，其中，The learning state monitoring device according to any one of claims 10 to 13, wherein the character information includes an angle between the head and any shoulder, and the third analysis module includes a second analysis unit and a Two decision units, where,

    所述第二分析单元，用于分析所述头部与任意一肩膀之间的角度是否小于第二预设角度；The second analysis unit is configured to analyze whether the angle between the head and any shoulder is smaller than a second preset angle;

    所述第二判定单元，用于当所述头部与任意一肩膀之间的角度小于第二预设角度时，判定所述人物信息不符合预设的人物状态标准。The second determining unit is configured to determine that the character information does not meet a preset character state standard when the angle between the head and any shoulder is smaller than the second preset angle.
16. 根据权利要求10至13任一项所述的学习状态监测装置，其特征在于，所述人物信息包括眼睛持续闭合的时间，所述第三分析模块包括第三分析单元和第三判定单元，其中，The learning state monitoring device according to any one of claims 10 to 13, wherein the character information includes a time during which the eyes continue to be closed, and the third analysis module includes a third analysis unit and a third determination unit, wherein ,

    所述第三分析单元，用于分析所述眼睛持续闭合的时间是否超出第二预设时间；The third analysis unit is configured to analyze whether the time for which the eyes continue to close exceeds the second preset time;

    所述第三判定单元，用于当所述眼睛持续闭合的时间超出第二预设时间时，判定所述人物信息不符合预设的人物状态标准。The third determining unit is configured to determine that the character information does not meet a preset character state standard when the time that the eyes continue to close exceeds the second preset time.
17. 根据权利要求10至13任一项所述的学习状态监测装置，其特征在于，所述人物信息包括第三预设时间内的眨眼次数，所述第三分析模块包括第四分析单元和第四判定单元，其中，The learning state monitoring device according to any one of claims 10 to 13, wherein the character information includes the number of blinks within a third preset time, and the third analysis module includes a fourth analysis unit and a fourth Decision unit, where,

    所述第四分析单元，用于分析所述第三预设时间内的眨眼次数是否超出预设次数；The fourth analysis unit is configured to analyze whether the number of blinks in the third preset time exceeds the preset number of times;

    所述第四判定单元，用于当所述第三预设时间内的眨眼次数超出预设次数时，判定所述人物信息不符合预设的人物状态标准。The fourth determination unit is configured to determine that the character information does not meet a preset character status standard when the number of blinks in the third preset time exceeds a preset number of times.
18. 根据权利要求10至13任一项所述的学习状态监测装置，其特征在于，所述人物信息包括嘴巴的高度与宽度之比，所述第三分析模块包括第五分析单元和第五判定单元，其中，The learning state monitoring device according to any one of claims 10 to 13, wherein the character information includes a ratio of height and width of the mouth, and the third analysis module includes a fifth analysis unit and a fifth determination unit ,among them,

    所述第五分析单元，用于分析所述嘴巴的高度与宽度之比是否大于预设值；The fifth analysis unit is configured to analyze whether the ratio of the height to the width of the mouth is greater than a preset value;

    所述第五判定单元，用于当所述嘴巴的高度与宽度之比大于预设值时，判定所述人物信息不符合预设的人物状态标准。The fifth determining unit is configured to determine that the character information does not meet a preset character status standard when the ratio of the height of the mouth to the width is greater than a preset value.
19. 一种智能设备，其特征在于，包括存储器、处理器和计算机程序，所述计算机程序被存储在所述存储器中并被配置为由所述处理器执行，所述计算机程序被配置为用于执行如权利要求1至9任一项所述的学习状态监测方法。An intelligent device, characterized in that it includes a memory, a processor, and a computer program, the computer program is stored in the memory and configured to be executed by the processor, and the computer program is configured to be executed The learning state monitoring method according to any one of claims 1 to 9.