WO2020118882A1 - Procédé, appareil et dispositif intelligent de surveillance d'état d'études - Google Patents

Procédé, appareil et dispositif intelligent de surveillance d'état d'études Download PDF

Info

Publication number
WO2020118882A1
WO2020118882A1 PCT/CN2019/073758 CN2019073758W WO2020118882A1 WO 2020118882 A1 WO2020118882 A1 WO 2020118882A1 CN 2019073758 W CN2019073758 W CN 2019073758W WO 2020118882 A1 WO2020118882 A1 WO 2020118882A1
Authority
WO
WIPO (PCT)
Prior art keywords
preset
character
image
reader
character information
Prior art date
Application number
PCT/CN2019/073758
Other languages
English (en)
Chinese (zh)
Inventor
李梁
Original Assignee
深圳市沃特沃德股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市沃特沃德股份有限公司 filed Critical 深圳市沃特沃德股份有限公司
Publication of WO2020118882A1 publication Critical patent/WO2020118882A1/fr

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • G08B21/24Reminder alarms, e.g. anti-loss alarms
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the invention relates to the field of information processing technology, in particular to a learning state monitoring method, device and intelligent equipment.
  • the reading robot can only automatically turn over books and read books automatically, but it cannot test whether the children are seriously studying or doing other unrelated things while reading.
  • the main purpose of the present invention is to provide a learning state monitoring method, device and intelligent equipment.
  • the learning state monitoring method can check whether the reader is studying seriously during the reading process using the intelligent equipment.
  • the present invention provides a learning state monitoring method, including:
  • the second image is collected
  • the invention also proposes a learning state monitoring device, including:
  • the first acquisition module is used to acquire the first image
  • the first analysis module is used to analyze whether the first image contains the specified content information
  • the second collection module is used to collect the second image when the first image contains the specified content information
  • the second analysis module is used to analyze whether the second image contains person information
  • the third analysis module is used to analyze whether the character information meets the preset character status standard when the second image contains the character information
  • the first forming module is used to form a first monitoring result corresponding to the reader's learning state when the character information does not meet the preset character state standard;
  • the second forming module is used to form a second monitoring result corresponding to the reader's learning state when the character information meets the preset character state standard.
  • the present invention also provides an intelligent device including a memory, a processor, and a computer program.
  • the computer program is stored in the memory and configured to be executed by the processor, and the computer program is configured to perform the foregoing learning state monitoring method.
  • the present invention has the beneficial effect that the learning state monitoring method of the present invention acquires the image during reading learning by the reader, and then analyzes whether the character information in the image meets the preset character state standard to obtain Whether the reader is currently studying seriously, when the character information does not meet the preset character status standards, it means that the reader is not studying seriously, and then can set the reminder to urge the reader to study hard, such as by alerting the reader Readers study hard, or inform the supervisor by sending a prompt message to the supervisor’s terminal device that the current reader is not studying seriously, and the supervisor urges the reader to study carefully, so that it can effectively use the smart device for reading Monitor the reader's learning status to improve children's learning efficiency.
  • FIG. 1 is a schematic flowchart of a learning state monitoring method in an implementation of the present invention
  • FIG. 2 is a schematic structural diagram of an intelligent device in an embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of a learning state monitoring device in an implementation of the present invention.
  • FIG. 4 is a schematic structural diagram of a learning state monitoring device in another implementation of the present invention.
  • FIG. 5 is a schematic diagram of the specific structure of FIG. 3.
  • an embodiment of the present invention proposes a learning state monitoring method, which is applied to a smart device.
  • the smart device may be a speaker, a robot, a mobile phone, or a tablet.
  • the robot may be a reading robot.
  • the present invention regards the reading robot as Examples.
  • the method includes:
  • a camera can be installed on the reading robot to acquire a desired image.
  • a first camera for scanning content information and a first camera for monitoring the activity status of the reader can be provided on the reading robot
  • Two cameras to collect the required images separately, for example, a panoramic camera can be set on the reading robot to scan the content information and monitor the reader's activity status to collect the required images, etc.
  • the embodiment of the present invention sets a first camera for scanning content information and a second camera for monitoring the reader's activity status on the reading robot to separately collect the required
  • the image is used as an example to explain and explain;
  • the reader faces the reading robot, and at the same time, places the book at the designated position of the reading robot, wherein the angle of view of the first camera covers the designated position to scan the content of the book.
  • the angle of view of the two cameras covers the upper body area of the reader to monitor the reader's activity status; when in use, the content of the book can be scanned by turning on the first camera to collect the first image, so that the subsequent reading robot can An image reads the content of the book correctly and determines whether to turn on the second camera for shooting.
  • the specified content information may be text on the book, pictures on the book, or text and pictures on the book.
  • the first image After collecting the first image, perform text recognition on the first image or Image recognition, you can know whether the first image contains the specified content information, for example, by performing text recognition on the first image, you can analyze whether the first image contains text, when it is analyzed that the first image contains text, then Through the existing speech synthesis technology, the recognized text can be converted into corresponding speech, thereby realizing the reading function of the reading robot.
  • the reading robot when it is analyzed that the first image contains the specified content information, the reading robot performs "reading", and at the same time turns on the second camera, and shoots the scene within its own angle of view through the second camera, thereby collecting continuous Multiple frames of the second image for subsequent related operations based on the second image.
  • the character information in the second image meets the preset character status standard. If the character information meets the preset character status standard, it indicates that the current The reader is studying carefully, but if the character information does not meet the preset character status standards, it indicates that the current reader is not studying seriously, but is doing other things that have nothing to do with reading.
  • the reading robot when the character information in the second image does not meet the preset character status standard, the reading robot forms a monitoring result corresponding to the reader's learning status as inadequate learning, that is, the first monitoring result; and when the character information in the second image meets the preset character status standard, the reading robot forms a monitoring result corresponding to the reader's learning status as serious learning, that is, the above-mentioned second monitoring result, so as to achieve the purpose of checking whether the reader is studying seriously.
  • the method further includes:
  • the reading robot when the reading robot forms the second monitoring result corresponding to the reader's learning state, it can initially indicate that the current reader is studying seriously, and at this time, after the first preset time (such as 30 seconds), the first The third image is acquired by the camera, that is, the image is acquired by the first camera again after an interval of time, so as to perform related operations later.
  • the first preset time such as 30 seconds
  • the third image is compared with the first image previously collected, and whether the third image is the same as the first image is analyzed to facilitate subsequent related operations.
  • the fourth image contains character information
  • the reading robot can accordingly obtain the monitoring result that the reader does not study seriously, namely the first monitoring result; if the fourth image The character information in the file meets the preset character status standard, which means that the current reader is reading the book seriously. At this time, the reading robot can obtain the monitoring result of the reader's serious learning based on this, that is, the above-mentioned second monitoring result.
  • the character information includes the angle between the shoulders and the horizontal direction. At this time, it can be analyzed whether the character information in the second image or the fourth image meets the preset character status standard in the following manner:
  • the angle between the shoulder and the horizontal direction is greater than the first preset angle (such as 30 degrees).
  • the angle from the horizontal direction is greater than the first preset angle, indicating that the current reader's body tilt is too large, such as lying on the table or leaning on a chair to lazy or sleep, at this time it can be determined that the person information is not It meets the preset character status standard, that is, the current reader is not studying seriously, so as to facilitate the follow-up to set the reminder to urge the reader to study carefully, so as to improve the reader's learning efficiency.
  • the reader is reading It is necessary to maintain a good reading posture so as not to be "misjudged" by the reading robot, which is conducive to urging readers to develop a good reading posture.
  • the character information includes the angle between the head and any shoulder. In this case, it can be analyzed whether the character information in the second image or the fourth image meets the preset character status standard in the following manner:
  • the angle between the head and any shoulder is less than the second preset angle (such as 60 degrees)
  • the angle between the head and any shoulder is less than the second preset angle
  • it indicates that the current reader's head tilt is too large, such as dozing at this time it can be determined that the character information does not meet the preset
  • the character status standard that is, the current reader is not studying seriously, so as to facilitate the follow-up to set the reminder to urge the reader to study carefully, so as to improve the reader's learning efficiency.
  • the reader needs to maintain good while reading The reading posture will not be "misjudged" by the reading robot, which is conducive to urging the reader to develop a good reading posture.
  • the character information includes the time that the eyes continue to be closed. At this time, whether the character information in the second image or the fourth image meets the preset character status standard can be analyzed in the following manner:
  • the second preset time such as 20 seconds
  • the time that the eyes continue to close exceeds the second preset time
  • the character information does not meet the preset character status standards, that is At present, the reader is not studying seriously, so as to facilitate the follow-up to set the reminder to urge the reader to study seriously, so as to improve the reader's learning efficiency.
  • the character information includes the number of blinks within a third preset time, and at this time, it can be analyzed whether the character information in the second image or the fourth image meets the preset character status standard in the following manner:
  • the third preset time such as 20 seconds
  • the number of times such as 10 times. If the number of blinks in the third preset time exceeds the preset number, it indicates that the current reader is blinking frequently, for example, dozing off or opening a small gap. At this time, it can be determined that the person information does not match
  • the preset character status standard that is, the current reader is not studying seriously, and then facilitates the follow-up to set the reminder to urge the reader to study carefully, so as to improve the reader's learning efficiency.
  • the character information includes the ratio of the height of the mouth to the width. At this time, it can be analyzed whether the character information in the second image or the fourth image meets the preset character status standard in the following manner:
  • the ratio of the height of the mouth to the width is greater than a preset value (for example, the preset value can be set to "1" ), if the ratio of the height of the mouth to the width is greater than the preset value, it means that the current reader’s mouth movement is too large, such as yawning, at this time it can be determined that the character information does not meet the preset character status standards, That is, the current reader is not studying seriously, and it is convenient for the follow-up to set the reminder to urge the reader to study seriously, so as to improve the reader's learning efficiency.
  • a preset value for example, the preset value can be set to "1"
  • the method further includes:
  • S16a issue an alarm to the reader or/and send prompt information to the terminal device of the supervisor.
  • the reading robot when the reading robot forms the first monitoring result corresponding to the learning state of the reader, it indicates that the current reader is not studying seriously, but is doing other things that have nothing to do with reading.
  • the reader issues an alert to remind the reader to study seriously, or by sending a prompt message to the terminal device (such as a smartphone) of the supervisor (parent) to inform the supervisor that the current reader (child) is not studying seriously so that the supervisor can urge reading
  • the learners study carefully, which is conducive to improving the learning efficiency of the readers.
  • the method further includes:
  • S22b If the length of time for which no reminder information is sent exceeds the preset time length, play a voice message to encourage the reader or/and send the status information that the reader is studying carefully to the terminal device of the supervisor.
  • the character information in the fourth image meets the preset character status standard, it means that the reader is in a state of serious study for a considerable period of time.
  • the length of time that no reminder message is issued Exceeds the preset length of time (such as 30 minutes)
  • the length of time without a reminder message exceeds the preset length of time
  • the reading robot can play a voice message to encourage the reader (child), such as "baby, you have been studying hard for 30 minutes, great!
  • the learning state monitoring method acquires the image of the reader during reading learning, and then analyzes whether the character information in the image meets the preset character state standard to obtain whether the reader is currently studying seriously.
  • the character information does not meet the preset character status standard, it means that the reader is not studying seriously, and then can set the reminder to urge the reader to study seriously, such as by alerting the reader to remind the reader to study seriously, or by
  • the supervisor’s terminal device sends a prompt message to inform the supervisor that the current reader is not studying seriously.
  • the supervisor urges the reader to study carefully, so that the reader’s learning status can be effectively monitored during the reading process using the reading robot. Improve children's learning efficiency.
  • an embodiment of the present invention further provides a learning state monitoring device, including:
  • the first acquisition module 1 is used to acquire the first image
  • the first analysis module 2 is used to analyze whether the first image contains the specified content information
  • the second collection module 3 is used to collect a second image when the first image contains specified content information
  • the second analysis module 4 is used to analyze whether the second image contains person information
  • the third analysis module 5 is used to analyze whether the character information meets the preset character status standard when the second image contains the character information
  • the first forming module 6 is used to form a first monitoring result corresponding to the reader's learning state when the character information does not meet the preset character state standard;
  • the second forming module 7 is used to form a second monitoring result corresponding to the reader's learning state when the character information meets the preset character state standard.
  • a camera can be set on the reading robot to acquire a desired image, for example, a first camera for scanning content information and a reader can be set on the reading robot The second camera in the active state to separately acquire the required images.
  • a panoramic camera for simultaneously scanning content information and monitoring the active state of the reader can be set on the reading robot to acquire the required images, etc.
  • the embodiment of the present invention sets a first camera for scanning content information and a second camera for monitoring the reader's activity status on the reading robot respectively Take the required images as an example to make relevant explanations and explanations;
  • the reader before using the reading robot for reading, faces the reading robot, and at the same time places the book at the designated position of the reading robot, wherein the viewing angle range of the first camera covers the designated position to scan the content of the book, and the second The angle of view of the camera covers the upper body area of the reader to monitor the state of the reader; when in use, the first acquisition module 1 can scan the content of the book by turning on the first camera to acquire the first image for subsequent reading The robot correctly reads the content of the book according to the first image and determines whether to turn on the second camera to shoot.
  • the specified content information may be text on the book, or pictures on the book, or text and pictures on the book.
  • the first analysis module 2 from the first collection module 1 After obtaining the first image, by performing text recognition or image recognition on the first image, you can know whether the first image contains the specified content information. For example, by performing text recognition on the first image, you can analyze whether the first image Contains text.
  • the first analysis module 2 analyzes that the first image contains text, the recognized text can be converted into the corresponding voice through the existing speech synthesis technology, thereby realizing the reading function of the reading robot.
  • the reading robot when the first analysis module 2 analyzes that the first image contains the specified content information, the reading robot performs "reading", and at the same time, the second collection module 3 can view its own perspective by turning on the second camera The scene within the range is photographed, so as to collect a second image of consecutive multiple frames, so as to subsequently perform related operations according to the second image.
  • the second analysis module 4 can perform visual inspection on the second image to analyze whether the second image contains person information. If the second image contains person information, it indicates that there is currently a reader Reading.
  • the third analysis module 5 when the second analysis module 4 analyzes that the second image contains person information, the third analysis module 5 further analyzes whether the person information in the second image meets the preset person status standard , If the character information meets the preset character status standard, it indicates that the current reader is studying seriously, but if the character information does not meet the preset character status standard, it indicates that the current reader is not studying seriously, but doing other irrelevant Things to read.
  • the third analysis module 5 when the third analysis module 5 analyzes that the character information in the second image does not meet the preset character status standard, the corresponding reading is formed by the first forming module 6
  • the learner's learning status is the monitoring result of inattentive learning, that is, the above-mentioned first monitoring result; and when the character information in the second image analyzed by the third analysis module 5 meets the preset character status standard, the second forming module 7 A monitoring result corresponding to the learning status of the reader is carefully studied, that is, the above-mentioned second monitoring result, so as to achieve the purpose of checking whether the reader is studying seriously.
  • the learning state monitoring device further includes a third collection module 8, a fourth analysis module 9, and a fourth collection module 10, wherein,
  • the third acquisition module 8 is used to acquire the third image after the first preset time
  • the fourth analysis module 9 is used to analyze whether the third image is the same as the first image
  • the fourth collection module 10 is used to collect a fourth image when the third image is the same as the first image
  • the second analysis module 4 is also used to analyze whether the fourth image contains person information
  • the third analysis module 5 is also used to analyze whether the character information meets the preset character status standard when the fourth image contains the character information.
  • the second forming module 7 when the second forming module 7 forms a second monitoring result corresponding to the reader's learning state, it can initially indicate that the current reader is studying seriously, and at this time the third collection module 8 is in the first After setting the time (for example, 30 seconds), the third image can be collected by the first camera, so as to perform related operations later.
  • the fourth analysis module 9 specifically, after the fourth analysis module 9 obtains the third image from the third acquisition module 8, the fourth analysis module 9 compares the third image with the previously acquired first image to analyze Whether the third image is the same as the first image, so as to perform related operations later.
  • the fourth analysis module 9 when the fourth analysis module 9 analyzes that the third image is the same as the first image, it indicates that the reader has not turned the book within a certain period of time, and the fourth collection module 10 can pass
  • the second camera is turned on to take pictures of the scene within its own angle of view again, so as to acquire fourth images in consecutive multiple frames, so that the subsequent second analysis module 4 performs related operations according to the fourth images.
  • the second analysis module 4 visually inspects the fourth image to analyze whether the fourth image contains person information. If the fourth image contains person information, it indicates that a reader is currently in Read it.
  • the third analysis module 5 when the second analysis module 4 analyzes that the fourth image contains person information, the third analysis module 5 further analyzes whether the person information in the fourth image meets the preset person status standard If the character information in the fourth image does not meet the preset character status standard, the first forming module 6 can accordingly obtain the monitoring result that the reader does not study seriously, that is, the above-mentioned first monitoring result; if the fourth image The character information of the user meets the preset character status standard, which means that the current reader is reading the book seriously. At this time, the second forming module 7 can obtain the monitoring result of the reader's serious study, that is, the above-mentioned second monitoring result.
  • the character information includes the angle between the shoulders and the horizontal direction
  • the third analysis module 5 includes a first analysis unit 5a and a first determination unit 5b, where,
  • the first analysis unit 5a is configured to analyze whether the angle between the shoulders and the horizontal direction is greater than the first preset angle
  • the first determining unit 5b is configured to determine that the character information does not meet the preset character status standard when the angle between the shoulders and the horizontal direction is greater than the first preset angle.
  • the first analysis unit 5a performs visual detection on the continuous multi-frame character images collected by the second camera to analyze whether the angle between the shoulders and the horizontal direction is greater than the first preset angle (such as 30 Degrees), if the angle between the shoulders and the horizontal direction is greater than the first preset angle, it means that the current reader’s body tilt is too large, such as lying on the table or leaning on the chair to lazy or sleep, the first judgment Unit 5b can determine that the character information does not meet the preset character status standards, that is, the current reader is not studying seriously, which is convenient for subsequent follow-up through setting reminder module 11 to urge the reader to study carefully, so as to improve the learning efficiency of the reader, At the same time, this also means that the reader needs to maintain a good reading posture in order not to be "misjudged" by the reading robot, which is conducive to urging the reader to develop a good reading posture.
  • the first preset angle such as 30 Degrees
  • the character information includes the angle between the head and any shoulder
  • the third analysis module 5 includes a second analysis unit 5c and a second determination unit 5d, where,
  • the second analysis unit 5c is used to analyze whether the angle between the head and any shoulder is smaller than the second preset angle
  • the second determining unit 5d is configured to determine that the character information does not meet the preset character status standard when the angle between the head and any shoulder is smaller than the second preset angle.
  • the second analysis unit 5c performs visual detection on the continuous multi-frame character images collected by the second camera to analyze whether the angle between the head and any shoulder is less than the second preset angle (for example, 60 degrees), if the angle between the head and any shoulder is less than the second preset angle, it indicates that the current reader’s head tilt is too large, for example, while dozing, at this time the second determination unit 5d can This determines that the character information does not meet the preset character status standards, that is, the current reader is not studying seriously, and it is convenient for the follow-up to set the reminder module 11 to urge the reader to study carefully to improve the reader's learning efficiency. At the same time, this also It means that the reader needs to maintain a good reading posture in order not to be "misjudged" by the reading robot, which is conducive to urging the reader to develop a good reading posture.
  • the second preset angle For example, 60 degrees
  • the character information includes the time that the eyes continue to be closed, and at this time, the third analysis module 5 includes a third analysis unit 5e and a third determination unit 5f, where,
  • the third analysis unit 5e is used to analyze whether the time of continuous eye closure exceeds the second preset time
  • the third determining unit 5f is configured to determine that the character information does not meet the preset character status standard when the time that the eyes continue to close exceeds the second preset time.
  • the third analysis unit 5e performs face detection and face recognition on the continuous multi-frame character images collected by the second camera, and it can be analyzed whether the duration of continuous eye closure exceeds the second preset time (such as 20 seconds), if the time that the eyes continue to close exceeds the second preset time, it means that the current reader's eyes continue to close for too long, for example, while dozing, at this time, the third determination unit 5f can determine the person information according to this It does not meet the preset character status standard, that is, the current reader is not studying seriously, and it is convenient for the follow-up to set the reminder module 11 to urge the reader to study carefully, so as to improve the reader's learning efficiency.
  • the second preset time such as 20 seconds
  • the person information includes the number of blinks within a third preset time, and at this time, the third analysis module 5 includes a fourth analysis unit 5g and a fourth determination unit 5h, where,
  • the fourth analysis unit 5g is configured to analyze whether the number of blinks in the third preset time exceeds the preset number of times;
  • the fourth determining unit 5h is configured to determine that the character information does not meet the preset character status standard when the number of blinks in the third preset time exceeds the preset number of times.
  • the fourth analysis unit 5g performs face detection and face recognition on the continuous multi-frame character images collected by the second camera to analyze the blink within a third preset time (such as 20 seconds) Whether the number of times exceeds the preset number of times (such as 10 times), if the number of blinks exceeds the preset number of times within the third preset time, it indicates that the current reader is blinking frequently, for example, dozing off or opening a small gap, at this time the fourth determination unit According to 5h, it can be determined that the character information does not meet the preset character status standard, that is, the current reader is not studying seriously, which is convenient for subsequent follow-up through setting the reminder module 11 to urge the reader to study carefully, so as to improve the reader's learning efficiency.
  • the character information includes the ratio of the height of the mouth to the width.
  • the third analysis module 5 includes a fifth analysis unit 5i and a fifth determination unit 5j, where,
  • the fifth analysis unit 5i is used to analyze whether the ratio of the height of the mouth to the width is greater than a preset value
  • the fifth determining unit 5j is configured to determine that the character information does not meet the preset character status standard when the ratio of the height of the mouth to the width is greater than the preset value.
  • the fifth analysis unit 5i performs visual detection on the continuous multi-frame character images collected by the second camera, and it can be analyzed whether the ratio of the mouth height to the width is greater than a preset value (for example, the preset value can be Set to "1"), if the ratio of the height of the mouth to the width is greater than the preset value, it means that the current reader’s mouth movement is too large, such as yawning, at this time the fifth judgment unit 5j can judge the character accordingly
  • the information does not conform to the preset character status standard, that is, the current reader is not studying seriously, which is convenient for subsequent follow-up by setting the reminder module 11 to urge the reader to study seriously, so as to improve the reader's learning efficiency.
  • the learning state monitoring device further includes a reminder module 11, which is used to issue an alarm to the reader or/and send prompt information to the terminal device of the supervisor.
  • the first forming module 6 forms the first monitoring result corresponding to the learning state of the reader, it indicates that the current reader is not studying seriously, but is doing other things that have nothing to do with reading.
  • the reminder module 11 can alert the reader to remind the reader to study seriously, or the reminder module 11 can send a prompt message to the terminal device (such as a smartphone) of the supervisor (parent) to inform the supervisor of the current reader (child) There is no serious study, so that the supervisor urges the reader to study carefully, which is conducive to improving the reader's learning efficiency.
  • These two reminder methods can be used one at a time or at the same time. There are no specific restrictions on this.
  • the learning state monitoring device further includes a fifth analysis module 12 and a reporting module 13, wherein,
  • the fifth analysis module 12 is used to analyze whether the length of time that no reminder information is sent exceeds the preset time length when the character information in the fourth image meets the preset character status standard, wherein the issue of the reminder information includes an alert to the reader Or/and send prompt information to the supervisor's terminal equipment;
  • the reporting module 13 is used to play a voice message to encourage the reader or/and send the status of the reader to the terminal device of the supervisor when the reminder message is not sent out beyond the preset length of time information.
  • the fifth analysis module 12 can further analyze and remind Whether the length of time that the module 11 does not issue a reminder message exceeds the preset length of time (such as 30 minutes). If the length of time that the reminder module 11 does not issue a reminder message exceeds the preset length of time, it means that the reader has been in a considerable period of time ( The length of this time period is determined by the preset time length) are in a state of serious learning, at this time, the voice message used to encourage the reader can be played to the reader (child) through the reporting module 13, such as "baby you have studied hard 30 minutes, great!
  • the learning status monitoring device of the embodiment of the present invention can acquire whether the reader is currently studying seriously by collecting the image of the reader during reading learning and then analyzing whether the character information in the image meets the preset character status standard.
  • the character information does not meet the preset character status standard, it means that the reader is not studying seriously, and then can set the reminder to urge the reader to study seriously, such as by alerting the reader to remind the reader to study seriously, or by
  • the supervisor’s terminal device sends a prompt message to inform the supervisor that the current reader is not studying seriously.
  • the supervisor urges the reader to study carefully, so that the reader’s learning status can be effectively monitored during the reading process using the reading robot. Improve children's learning efficiency.
  • an embodiment of the present invention further provides an intelligent device, including a memory 100, a processor 200, and a computer program 300.
  • the computer program 300 is stored in the memory 100 and configured to be executed by the processor 200, and the computer program 300 is It is configured to perform the learning state monitoring method in any of the above embodiments.

Landscapes

  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Analysis (AREA)

Abstract

L'invention concerne un procédé, un appareil et un dispositif intelligent de surveillance d'état d'études. Le procédé de surveillance d'état d'études comporte les étapes consistant à: capturer une première image; analyser si la première image contient des informations de contenu; si oui, capturer une seconde image; analyser si la seconde image contient des informations de sujet humain; si oui, analyser si les informations de sujet humain se conforment à une norme prédéterminée d'état de sujet humain; si ce n'est pas le cas, former un premier résultat de surveillance. Le procédé de surveillance d'état d'études peut détecter si un lecteur étudie consciencieusement.
PCT/CN2019/073758 2018-12-12 2019-01-29 Procédé, appareil et dispositif intelligent de surveillance d'état d'études WO2020118882A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811519099.0A CN109658673A (zh) 2018-12-12 2018-12-12 学习状态监测方法、装置、可读存储介质及智能设备
CN201811519099.0 2018-12-12

Publications (1)

Publication Number Publication Date
WO2020118882A1 true WO2020118882A1 (fr) 2020-06-18

Family

ID=66114277

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/073758 WO2020118882A1 (fr) 2018-12-12 2019-01-29 Procédé, appareil et dispositif intelligent de surveillance d'état d'études

Country Status (2)

Country Link
CN (1) CN109658673A (fr)
WO (1) WO2020118882A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111594773B (zh) * 2020-05-19 2022-01-25 马鞍山三投光电科技有限公司 一种智能护眼可调节led灯
CN112613444A (zh) * 2020-12-29 2021-04-06 北京市商汤科技开发有限公司 一种行为检测的方法、装置、电子设备及存储介质
CN112990677B (zh) * 2021-03-04 2022-03-01 青岛海科虚拟现实研究院 一种基于人工智能的教学***、计算机设备、存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150070263A1 (en) * 2013-09-09 2015-03-12 Microsoft Corporation Dynamic Displays Based On User Interaction States
CN105354986A (zh) * 2015-11-12 2016-02-24 熊强 汽车司机驾驶状态监测***及方法
CN106023693A (zh) * 2016-05-25 2016-10-12 北京九天翱翔科技有限公司 一种基于虚拟现实技术和模式识别技术的教育***及方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100980470B1 (ko) * 2008-02-27 2010-09-07 주식회사 글맥학원 책상형 학습 장치 및 이를 이용한 학습 방법
CN103824481B (zh) * 2014-02-28 2016-05-25 广东小天才科技有限公司 一种检测用户背诵的方法及装置
CN106101827A (zh) * 2016-06-19 2016-11-09 乐视控股(北京)有限公司 终端提醒方法及装置
CN107358213B (zh) * 2017-07-20 2020-02-21 湖南科乐坊教育科技股份有限公司 一种儿童阅读习惯检测方法及装置
CN107392146A (zh) * 2017-07-20 2017-11-24 湖南科乐坊教育科技股份有限公司 一种儿童坐姿检测方法及装置
CN108521606A (zh) * 2018-04-25 2018-09-11 上海与德科技有限公司 一种观看电视的监控方法、装置、存储介质及智能电视
CN108874122A (zh) * 2018-04-28 2018-11-23 深圳市赛亿科技开发有限公司 智能眼镜及其控制方法、计算机可读存储介质

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150070263A1 (en) * 2013-09-09 2015-03-12 Microsoft Corporation Dynamic Displays Based On User Interaction States
CN105354986A (zh) * 2015-11-12 2016-02-24 熊强 汽车司机驾驶状态监测***及方法
CN106023693A (zh) * 2016-05-25 2016-10-12 北京九天翱翔科技有限公司 一种基于虚拟现实技术和模式识别技术的教育***及方法

Also Published As

Publication number Publication date
CN109658673A (zh) 2019-04-19

Similar Documents

Publication Publication Date Title
US10311289B2 (en) Face recognition method and device and apparatus
CN105022981B (zh) 一种检测人眼健康状态的方法、装置及移动终端
WO2020118882A1 (fr) Procédé, appareil et dispositif intelligent de surveillance d'état d'études
CN109345156A (zh) 一种基于机器视觉的课堂教学质量评价***
CN104754216B (zh) 一种拍照方法及装置
CN109637097B (zh) 学习状态监测方法、装置及智能设备
WO2015133195A1 (fr) Dispositif de traitement d'informations, procédé de traitement d'informations, et programme
TW201137795A (en) System and method for detecting baby sleeping
JP2009258175A (ja) 講義システムおよび集計システム
CN108961679A (zh) 一种注意力提醒方法、装置及电子设备
CN105183170B (zh) 头戴式可穿戴设备及其信息处理方法、装置
CN108898079A (zh) 一种监控方法及装置、存储介质、拍摄终端
WO2020020022A1 (fr) Procédé de reconnaissance visuelle et système associé
CN107958572B (zh) 一种婴儿监控***
JP2009157780A (ja) 監視システム
CN114926957B (zh) 基于智能家居的婴幼儿监护***及监护方法
CN112183238A (zh) 一种远程教育注意力检测方法及***
KR20170053906A (ko) 유아 감정상태 분석 방법 및 이를 이용한 심리상태 분석 시스템과 스마트폰 연동 앱 개발
US11418757B1 (en) Controlled-environment facility video communications monitoring system
KR20090001848A (ko) 얼굴표정 감시 방법 및 얼굴표정 감시 시스템
KR20190063690A (ko) 동공 추적을 이용한 온라인 강의의 수강태도 감독 시스템
CN110309693B (zh) 多层次状态侦测***与方法
CN111402094B (zh) 一种具有防近视功能的学生学习用辅助***
CN111402096A (zh) 一种在线授课质量管理方法、***、设备和介质
CN106445135B (zh) 通过智能机器人进行体态纠正的数据交互方法和***

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19894804

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19894804

Country of ref document: EP

Kind code of ref document: A1