CN112989968A - Intelligent education AIOT AI intelligent brain analysis platform and device - Google Patents
Intelligent education AIOT AI intelligent brain analysis platform and device Download PDFInfo
- Publication number
- CN112989968A CN112989968A CN202110219420.9A CN202110219420A CN112989968A CN 112989968 A CN112989968 A CN 112989968A CN 202110219420 A CN202110219420 A CN 202110219420A CN 112989968 A CN112989968 A CN 112989968A
- Authority
- CN
- China
- Prior art keywords
- module
- analysis
- function
- emotion
- intelligent
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004458 analytical method Methods 0.000 title claims abstract description 95
- 210000004556 brain Anatomy 0.000 title claims abstract description 25
- 230000006870 function Effects 0.000 claims abstract description 92
- 230000008451 emotion Effects 0.000 claims abstract description 73
- 238000012545 processing Methods 0.000 claims abstract description 19
- 238000004364 calculation method Methods 0.000 claims abstract description 17
- 238000002076 thermal analysis method Methods 0.000 claims abstract description 15
- 230000006399 behavior Effects 0.000 claims description 32
- 230000008859 change Effects 0.000 claims description 26
- 238000001514 detection method Methods 0.000 claims description 25
- 210000003128 head Anatomy 0.000 claims description 25
- 230000009471 action Effects 0.000 claims description 19
- 238000004422 calculation algorithm Methods 0.000 claims description 19
- 238000000605 extraction Methods 0.000 claims description 19
- 230000000694 effects Effects 0.000 claims description 18
- 238000013461 design Methods 0.000 claims description 16
- 238000005516 engineering process Methods 0.000 claims description 15
- 208000003464 asthenopia Diseases 0.000 claims description 9
- 238000001914 filtration Methods 0.000 claims description 9
- 230000004379 myopia Effects 0.000 claims description 9
- 208000001491 myopia Diseases 0.000 claims description 9
- 238000012552 review Methods 0.000 claims description 9
- 230000000007 visual effect Effects 0.000 claims description 9
- 238000000034 method Methods 0.000 claims description 8
- 238000004590 computer program Methods 0.000 claims description 6
- 238000010195 expression analysis Methods 0.000 claims description 6
- 238000012544 monitoring process Methods 0.000 claims description 6
- 230000002265 prevention Effects 0.000 claims description 6
- 238000000926 separation method Methods 0.000 claims description 6
- 238000009825 accumulation Methods 0.000 claims description 4
- 210000000988 bone and bone Anatomy 0.000 claims description 4
- 238000010586 diagram Methods 0.000 claims description 4
- 230000003993 interaction Effects 0.000 claims description 4
- 238000011160 research Methods 0.000 claims description 4
- 238000012360 testing method Methods 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000013135 deep learning Methods 0.000 claims description 3
- 230000008909 emotion recognition Effects 0.000 claims description 3
- 230000004438 eyesight Effects 0.000 claims description 3
- 230000006872 improvement Effects 0.000 claims description 3
- 230000006698 induction Effects 0.000 claims description 3
- 230000000877 morphologic effect Effects 0.000 claims description 3
- 230000007935 neutral effect Effects 0.000 claims description 3
- 238000010606 normalization Methods 0.000 claims description 3
- 238000009877 rendering Methods 0.000 claims description 3
- 230000004397 blinking Effects 0.000 claims description 2
- 238000010219 correlation analysis Methods 0.000 claims description 2
- 238000005457 optimization Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 description 3
- 238000012351 Integrated analysis Methods 0.000 description 2
- 208000027418 Wounds and injury Diseases 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000006378 damage Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 208000014674 injury Diseases 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000007123 defense Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000007670 refining Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/30—Noise filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Entrepreneurship & Innovation (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention provides an AIOT AI intelligent brain analysis platform for intelligent education, which comprises an intelligent processing center, an emotion calculation module, a voice analysis module, a natural language understanding module, a thermal analysis module, an image enhancement processing module, a concentration analysis module and a behavior recognition module, wherein the AI student classroom emotion function, the AI knowledge point function, the AI student active state function, the AI classroom blackboard-writing function, the AI student concentration function and the AI campus security function are integrated on the same platform to be realized; the invention also provides a device for realizing the intelligent AIOT AI brain analysis platform for intelligent education.
Description
Technical Field
The invention relates to the field of intelligent education of block chains, in particular to an AIOT AI intelligent brain analysis platform and device for intelligent education.
Background
With the development of IOT technology (sensors, mobile networks, communication standards, technology platforms) and AI (chips, algorithms), the development of intelligent education by means of AIOT has become a necessary trend.
The classroom emotion is closely related to the learning effect and the psychological state of students. In a traditional classroom, a teacher can only judge the emotion change of students by subjective observation and teaching experience and cannot obtain accurate data feedback; by means of the AI technology, through student class emotion analysis data, abstract emotions are quantized, a teacher can be assisted to know the psychological state and class performance of students, teaching design is improved on the basis, and teaching effect is improved.
The combing and refining of the classroom knowledge points are important basis for the review of students after class. However, the traditional classroom knowledge point extraction cannot be automated, a system and logic are difficult to establish, and the assistance to students is limited; under the addition of AI technology, teachers can be helped to prepare knowledge points in teaching contents before classes, ideas and association relations of the teaching contents in the classes can be analyzed in the classes, the teaching contents are evaluated, knowledge cards of the taught knowledge points can be generated for students after the classes, and the students can review conveniently.
The active state of the students can reflect the classroom participation condition of the students, and in the traditional classroom, teachers can not obtain timely and effective active state feedback and only can observe the active state by means of classroom; through AI technique, the teacher can learn the active state of class fast after class to link the active state with the teaching design, supplementary teacher carries out optimization and improvement of teaching design.
The classroom blackboard writing records the knowledge key points, venation, problem solving process and thought of a classroom, although a teacher spends a great deal of time and energy, the classroom blackboard writing of the traditional classroom can be erased after class, the classroom is not fully and effectively utilized, and some students delay lessons for recording notes and are not compensated; the classroom blackboard writing is stored as pictures by utilizing AI technology, and teachers can store the pictures for teaching research after class, can share the pictures for colleagues to communicate for teaching, can also share the pictures for parents to help students to review after class, and can also be used as the accumulation of school teaching resources.
Concentration can reflect whether students enter a learning state, in a traditional classroom, a teacher improves the concentration of the students by increasing the volume, increasing interaction, improving content and the like, but the teacher cannot know the concentration of each class of each student carefully due to heavy teaching task, more number of classes and limited energy; under the additional holding of AI technique, visual for the mr present every class or every student's concentration on the strength change, the mr can utilize data adjustment teaching design to the test improves the effect, promotes classroom teaching quality.
The campus security and protection is mainly based on a monitoring system, the traditional monitoring system needs to search videos by manpower, cannot perform early warning at the first time of an accident, is used for obtaining evidence afterwards, and is a passive and lagging defense system; with the help of AI technology, the computer can substitute security personnel, stare at and analyze the monitoring picture all the time, detect various dangerous behaviors occurring in the campus, and actively send out an alarm to the security personnel in time, thereby reducing the risks to students, staff members for professors and school facilities to the maximum extent.
Disclosure of Invention
The invention aims to provide an AIOT AI intelligent brain analysis platform and device for intelligent education, which are realized by integrating an AI student classroom emotion function, an AI knowledge point function, an AI student active state function, an AI classroom writing function, an AI student concentration function and an AI campus security function on the same platform.
In order to achieve the purpose, the invention adopts the technical scheme that: the invention provides an AIOT AI intelligent brain analysis platform for intelligent education, which comprises an intelligent processing center, an emotion calculation module, a voice analysis module, a natural language understanding module, a thermal analysis module, an image enhancement processing module, a concentration analysis module and a behavior recognition module, wherein the emotion calculation module is used for calculating emotion of a user; the intelligent processing center is respectively connected with the emotion calculating module, the voice analyzing module, the natural language understanding module, the thermal analyzing module, the image enhancing and processing module, the concentration analyzing module and the behavior recognizing module; the intelligent processing center comprehensively processes and analyzes the received analysis results of the emotion calculation module, the voice analysis module, the natural language understanding module, the thermal analysis module, the image enhancement processing module, the concentration analysis module and the behavior recognition module, so as to realize an AI student classroom emotion function, an AI knowledge point function, an AI student active state function, an AI classroom blackboard-writing function, an AI student concentration function and an AI school yard security function;
the emotion calculation module is used for detecting and analyzing emotion changes of students to realize classroom emotion functions of the AI students and comprises a face detection module and a micro-expression analysis module, wherein the face detection module realizes face detection by defining key region positions of a face part, and the micro-expression analysis module is used for detecting and analyzing emotion and emotion change states according to the realization of emotion and emotion change states;
the voice analysis module is used for detecting the speech interaction between teachers and students, the natural language understanding module is used for knowing the point extraction, so as to realize the AI knowledge point function, the voice analysis module comprises a voice activity detection module and a speaker recognition module, the natural language understanding module comprises a keyword extraction module and an entity link module, the voice activity detection module is used for detecting voice, the speaker recognition module is used for recognizing speakers, the keyword extraction module is used for extracting keywords for classroom teaching from the voice, and the entity link module is used for detecting the relevant relation between knowledge points;
the thermal analysis module is used for detecting the active state of a student to realize the active state function of an AI student, and comprises an image background separation module and a foreground pixel change analysis module, wherein the image background separation module is used for separating a background image from a video through a thermal value analysis technology, and the foreground pixel change analysis module is used for further rendering the background image to generate an action thermodynamic diagram by recording and analyzing the change of pixels in a foreground based on a deep learning algorithm;
the image enhancement processing module is used for classroom blackboard writing extraction to realize AI classroom blackboard writing function, and comprises a filtering operation module and a binarization algorithm module, wherein the binarization algorithm module adopts a binarization algorithm of a self-adaptive threshold value to convert blackboard writing pictures into white paper black character effects, the filtering operation module adopts morphological filtering operation to eliminate noise content and smooth handwriting, and adopts an edge extraction algorithm to accurately extract font outlines;
the attention-focusing analysis module is used for detecting attention to realize the attention focusing function of AI students and comprises a head posture estimation module and a sight direction tracking module, wherein the head posture estimation module adopts a head posture estimation technology to establish a head three-dimensional space posture model, the specific orientation of the head is judged through the mutual conversion of the head posture among different coordinate systems, the sight direction tracking module adopts a sight direction tracking technology to calculate the sight direction of human eyes, and then secondary analysis is carried out on the summarized data to identify behaviors through the sight direction;
behavior identification module is used for detecting classroom teacher and student's action and campus dangerous action to realize AI campus security protection function, including skeleton key point detection module, human gesture estimation module, skeleton key point detection module detects the human position that can the accurate positioning through skeleton key point, human gesture estimation module is through human gesture estimation technique discernment, chase after in the discernment campus and beat, leave the dangerous action of post, crowd, suspicious stay.
Furthermore, the AI student classroom emotion function quantifies abstract emotion, and realizes emotion recognition of happiness, surprise, neutrality, injury, vitality and fear, proportion analysis of positive emotion, neutral emotion and negative emotion, analysis of positive emotion change state and negative emotion change state by adopting face alignment, face data enhancement, face normalization and emotion feature extraction algorithms according to data transmitted by the emotion calculation module, so as to assist teachers to know the psychological states and classroom performance of students, improve teaching design on the basis and improve teaching effect.
Further, the AI knowledge point function performs correlation analysis on the extracted keywords and the entities in the basic education knowledge map according to the data transmitted by the voice analysis module, and counts the distribution of teaching knowledge points of teachers and the correlation between the knowledge points, so that teachers are helped to prepare the knowledge points in teaching contents before class, the thought and the correlation of the teaching contents of class are analyzed in class, the teaching contents are evaluated, and knowledge cards of the teaching knowledge points are generated after class to facilitate the students to review.
Furthermore, the AI student active state function generates a classroom thermal value analysis result according to the data transmitted by the thermal analysis module, so that a teacher can quickly know the class active state after class, and the active state is linked with the teaching design to assist the teacher in optimizing and improving the teaching design.
Further, the AI classroom blackboard-writing function stores the extracted blackboard-writing as a picture according to the data transmitted by the image enhancement processing module, and is used for teaching research of teachers after class, sharing among teachers for teaching traffic, sharing for parents to help students review after class and accumulation as school teaching resources.
Further, the AI student is absorbed in the power function according absorb in the data that power analysis module conveyed, with the head specifically orientation and the comprehensive analysis of people's eye sight direction, accurate discernment student's action, visual for the teacher present every student of every class's the power of absorbing in change for the teacher can in time adjust the teaching design, and the test improves the effect, promotes classroom teaching quality.
Further, the AI campus security function is used for replacing security personnel, staring at and analyzing the monitoring picture all the time, detecting dangerous behaviors occurring in the campus according to the data transmitted by the behavior identification module, and giving an alarm to the security personnel within a specified time, so that the risks to students, teaching staff and school facilities are reduced to the maximum extent.
Further, the action recognition module can also be used for realizing AI visual fatigue and reminds the function, AI visual fatigue reminds the function through right the skeleton key point detected data and the human body posture estimated data of action recognition module conveying carry out integrated analysis, with the student eyes that the analysis reachs with the vertical distance of books, open the eye size and blink number of times carry out corresponding collection and induction, further reachs the visual fatigue degree, and the myopia risk grade is obtained in final analysis, and will the myopia risk grade presents teacher and head of a family with visual report's form, supplementary teacher and head of a family judge student's visual condition to the realization is effectively prevented myopia.
Furthermore, the behavior recognition module can also be used for realizing an AI (AI sitting posture) prevention function, and the AI sitting posture prevention function trains an unhealthy posture model through the bone key point detection data and the human posture estimation data transmitted by the behavior recognition module.
The invention also provides a device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the intelligent education AIOT AI intelligent brain analysis platform as described above.
Compared with the prior art, the intelligent AIOT AI brain analysis platform for intelligent education provided by the invention comprises an intelligent processing center, an emotion calculation module, a voice analysis module, a natural language understanding module, a thermal analysis module, an image enhancement processing module, a concentration analysis module and a behavior recognition module, wherein an AI student classroom emotion function, an AI knowledge point function, an AI student active state function, an AI classroom blackboard-writing function, an AI student concentration function and an AI campus security function are integrated on the same platform for realization; the invention also provides a device for realizing the intelligent AIOT AI brain analysis platform for intelligent education.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a structural diagram of an intelligent brain analysis platform system of an intelligent education AIOT AI intelligent brain analysis platform and device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The same or similar reference numerals in the drawings of the present embodiment correspond to the same or similar components; in the description of the present invention, it should be understood that if there is an orientation or positional relationship indicated by terms such as "upper", "lower", "left", "right", etc., based on the orientation or positional relationship shown in the drawings, it is only for convenience of description and simplification of description, but it is not intended to indicate or imply that the referred device or element must have a specific orientation, be constructed in a specific orientation, and be operated, and therefore, the terms describing the positional relationship in the drawings are only for illustrative purposes and are not to be construed as limiting the present patent, and the specific meaning of the above terms will be understood by those skilled in the art according to the specific circumstances.
The technical solution of the present invention is described in detail below with reference to the accompanying drawings and specific embodiments.
Referring to fig. 1, the intelligent education AIOT AI intelligent brain analysis platform provided by the invention comprises an intelligent processing center, an emotion calculation module, a voice analysis module, a natural language understanding module, a thermal analysis module, an image enhancement processing module, a concentration analysis module and a behavior recognition module; the intelligent processing center is respectively connected with the emotion calculation module, the voice analysis module, the natural language understanding module, the thermal analysis module, the image enhancement processing module, the concentration analysis module and the behavior recognition module; the intelligent processing center comprehensively processes and analyzes the received analysis results of the emotion calculation module, the voice analysis module, the natural language understanding module, the thermal analysis module, the image enhancement processing module, the concentration analysis module and the behavior recognition module, so as to realize an AI student classroom emotion function, an AI knowledge point function, an AI student active state function, an AI classroom blackboard-writing function, an AI student concentration function and an AI campus security function;
the emotion calculation module is used for detecting and analyzing emotion changes of students to realize classroom emotion functions of the AI students and comprises a face detection module and a micro-expression analysis module, wherein the face detection module realizes face detection by defining key region positions of a face part, and the micro-expression analysis module is used for detecting and analyzing emotion and emotion change states according to the realization of emotion and emotion change states;
the voice analysis module is used for detecting the speech interaction between teachers and students, the natural language understanding module is used for knowing the point extraction, so as to realize the AI knowledge point function, the voice analysis module comprises a voice activity detection module and a speaker recognition module, the natural language understanding module comprises a keyword extraction module and an entity link module, the voice activity detection module is used for detecting voice, the speaker recognition module is used for recognizing speakers, the keyword extraction module is used for extracting keywords for classroom teaching from the voice, and the entity link module is used for detecting the relevant relation between knowledge points;
the thermal analysis module is used for detecting the active state of a student to realize the active state function of an AI student, and comprises an image background separation module and a foreground pixel change analysis module, wherein the image background separation module is used for separating a background image from a video through a thermal value analysis technology, and the foreground pixel change analysis module is used for further rendering the background image to generate an action thermodynamic diagram by recording and analyzing the change of pixels in a foreground based on a deep learning algorithm;
the image enhancement processing module is used for classroom blackboard writing extraction to realize AI classroom blackboard writing function, and comprises a filtering operation module and a binarization algorithm module, wherein the binarization algorithm module adopts a binarization algorithm of a self-adaptive threshold value to convert blackboard writing pictures into white paper black character effects, the filtering operation module adopts morphological filtering operation to eliminate noise content and smooth handwriting, and adopts an edge extraction algorithm to accurately extract font outlines;
the attention-focusing analysis module is used for detecting attention to realize the attention focusing function of AI students and comprises a head posture estimation module and a sight direction tracking module, wherein the head posture estimation module adopts a head posture estimation technology to establish a head three-dimensional space posture model, the specific orientation of the head is judged through the mutual conversion of the head posture among different coordinate systems, the sight direction tracking module adopts a sight direction tracking technology to calculate the sight direction of human eyes, and then secondary analysis is carried out on the summarized data to identify behaviors through the sight direction;
behavior identification module is used for detecting classroom teacher and student's action and campus dangerous action to realize AI campus security protection function, including skeleton key point detection module, human gesture estimation module, skeleton key point detection module detects the human position that can the accurate positioning through skeleton key point, human gesture estimation module is through human gesture estimation technique discernment, chase after in the discernment campus and beat, leave the dangerous action of post, crowd, suspicious stay.
Above-mentioned technical scheme provides wisdom education AIOT AI wisdom brain analysis platform and device, including intelligent processing center, emotion calculation module, speech analysis module, natural language understanding module, thermal analysis module, image enhancement processing module, be absorbed in power analysis module and action identification module, realize AI student classroom emotion function, AI knowledge point function, AI student active state function, AI classroom blackboard-writing function, AI student special attention function, AI campus security protection function integration in same platform.
Specifically, the AI student classroom emotion function quantifies abstract emotion, and realizes emotion recognition of happiness, surprise, neutrality, injury, anger and fear, proportion analysis of positive emotion, neutral emotion and negative emotion, and analysis of positive emotion change state and negative emotion change state by adopting face alignment, face data enhancement, face normalization and emotion feature extraction algorithms according to data transmitted by the emotion calculation module, so as to assist teachers to know the psychological states and classroom performance of students, improve teaching design and improve teaching effect on the basis.
Specifically, the AI knowledge point function performs associative analysis on the extracted keywords and the entities in the basic education knowledge map according to the data transmitted by the voice analysis module, and counts the distribution of teaching knowledge points of teachers and the associative relations among the knowledge points, thereby helping teachers prepare the knowledge points in teaching contents before class, analyzing the thought and associative relations of the teaching contents in class, evaluating the teaching contents, and generating knowledge cards of the teaching knowledge points after class for the convenience of students to review.
Specifically, the AI student active state function generates a classroom heat value analysis result according to the data transmitted by the heat analysis module, so that a teacher can quickly know the class active state after class, link the active state with a teaching design and assist the teacher in optimizing and improving the teaching design.
Specifically, the AI classroom blackboard writing function stores the extracted blackboard writing as a picture according to the data transmitted by the image enhancement processing module, and is used for teacher teaching research, sharing among teachers for teaching communication, sharing for parents to help students review after class and accumulation as school teaching resources.
Specifically, the AI student is absorbed in the power function according absorb in the data that power analysis module conveyed, with the head specifically orientation and the comprehensive analysis of people's eye sight direction, accurate discernment student's action, visual for the teacher present every student of every class's the power of absorbing in change for the teacher can in time adjust the teaching design, and the test improves the effect, promotes classroom teaching quality.
Specifically, the AI campus security function is used for replacing security personnel, staring at and analyzing a monitoring screen all the time, detecting dangerous behaviors occurring in the campus according to data transmitted by the behavior identification module, and giving an alarm to the security personnel within a specified time, so that risks to students, teaching staff and school facilities are reduced to the maximum extent.
Preferably, the action recognition module can also be used to realize AI visual fatigue and remind the function, AI visual fatigue reminds the function through right the bone key point detected data and the human posture estimation data of action recognition module conveying carry out integrated analysis, the student eyes that will analyze and reachs carry out corresponding collection and induction with the vertical distance of books, the size of opening the eyes and the number of times of blinking, further reachs the visual fatigue degree, and final analysis reachs myopia risk level, and will myopia risk level presents for teacher and head of a family with visual report's form, assists teacher and head of a family to judge student's visual condition to the realization is effectively prevented in advance to myopia.
Preferably, the behavior recognition module can be further used for realizing an AI sitting posture prevention function, and the AI sitting posture prevention function trains an unhealthy posture model through the bone key point detection data and the human body posture estimation data transmitted by the behavior recognition module.
The invention also provides a device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the intelligent education AIOT AI intelligent brain analysis platform as described above.
Preferably, the functions of all modules related to the invention are described by using the existing and published functions; the framework modes of all modules related to the invention all adopt the existing and public framework modes; all the modules related to the present invention are implemented by using a published, mature and open-source program architecture and program codes, and the functions described by those skilled in the art according to the present technical solution can be easily implemented by using the existing and published program architecture and program codes.
The embodiments of the present invention have been described in detail, but the invention is not limited to the embodiments, and those skilled in the art can make many equivalent modifications or substitutions without departing from the spirit of the present invention, and the equivalent modifications or substitutions are included in the protection scope defined by the claims of the present application.
Claims (10)
1. The intelligent education AIOT AI intelligent brain analysis platform is characterized by comprising an intelligent processing center, an emotion calculation module, a voice analysis module, a natural language understanding module, a thermal analysis module, an image enhancement processing module, a concentration analysis module and a behavior recognition module; the intelligent processing center is respectively connected with the emotion calculating module, the voice analyzing module, the natural language understanding module, the thermal analyzing module, the image enhancement processing module, the concentration analyzing module and the behavior recognizing module; the intelligent processing center performs comprehensive processing and analysis on the received analysis results of the emotion calculation module, the voice analysis module, the natural language understanding module, the thermal analysis module, the image enhancement processing module, the concentration analysis module and the behavior recognition module, so as to realize an AI student classroom emotion function, an AI knowledge point function, an AI student active state function, an AI classroom blackboard-writing function, an AI student concentration function and an AI campus security function;
the emotion calculation module is used for detecting and analyzing emotion changes of students to realize classroom emotion functions of the AI students and comprises a face detection module and a micro-expression analysis module, wherein the face detection module realizes face detection by defining key region positions of a face part, and the micro-expression analysis module is used for detecting and analyzing emotion and emotion change states according to the realization of emotion and emotion change states;
the voice analysis module is used for detecting the speaking interaction of teachers and students, the natural language understanding module is used for knowledge point extraction to realize the AI knowledge point function, the voice analysis module comprises a voice activity detection module and a speaker recognition module, the natural language understanding module comprises a keyword extraction module and an entity link module, the voice activity detection module is used for detecting voice, the speaker recognition module is used for recognizing speakers, the keyword extraction module is used for extracting keywords for classroom teaching from the voice, and the entity link module is used for detecting the relevant relation among the knowledge points;
the thermal analysis module is used for detecting the active state of a student to realize the active state function of an AI student, and comprises an image background separation module and a foreground pixel change analysis module, wherein the image background separation module is used for separating a background image from a video through a thermal value analysis technology, and the foreground pixel change analysis module is used for recording and analyzing the change of pixels in a foreground through a deep learning algorithm, and further rendering the background image to generate an action thermodynamic diagram;
the image enhancement processing module is used for classroom blackboard writing extraction to realize AI classroom blackboard writing function, and comprises a filtering operation module and a binarization algorithm module, wherein the binarization algorithm module adopts a binarization algorithm of a self-adaptive threshold value to convert blackboard writing pictures into white paper black character effects, the filtering operation module adopts morphological filtering operation to eliminate noise content and smooth handwriting, and adopts an edge extraction algorithm to accurately extract font outlines;
the attention-focusing analysis module is used for detecting attention to realize the attention focusing function of AI students and comprises a head posture estimation module and a sight direction tracking module, wherein the head posture estimation module adopts a head posture estimation technology to establish a head three-dimensional space posture model, the specific orientation of the head is judged through the mutual conversion of the head posture among different coordinate systems, the sight direction tracking module adopts a sight direction tracking technology to calculate the sight direction of human eyes, then secondary analysis is carried out on the summarized data, and behaviors are identified through the sight direction;
behavior identification module is used for detecting classroom teacher and student's action and campus dangerous action to realize AI campus security protection function, including skeleton key point detection module, human gesture estimation module, skeleton key point detection module detects the human position of accurate positioning through the skeleton key point, human gesture estimation module is through human gesture estimation technique discernment, chase after in the discernment campus and make an alarm, leave the dangerous action of post, crowd, suspicious stop.
2. The intelligent education AIOT AI intelligent brain analysis platform as claimed in claim 1, wherein the AI student classroom emotion function quantifies abstract emotion, and uses face alignment, face data enhancement, face normalization and emotion feature extraction algorithms to realize emotion recognition of happiness, surprise, neutrality, hurt, anger and fear, proportion analysis of positive emotion, neutral emotion and negative emotion, and analysis of positive emotion change state and negative emotion change state according to the data transmitted by the emotion calculation module, thereby assisting teachers to know the psychological state and classroom performance of students, improving teaching design and improving teaching effect.
3. The intelligent education AIOT AI intelligent brain analysis platform as claimed in claim 1, wherein the AI knowledge point function performs correlation analysis of the extracted keywords with the entities in the basic education knowledge map according to the data transmitted by the voice analysis module, counts the distribution of teaching knowledge points of the teacher and the correlation between knowledge points, thereby helping the teacher prepare the knowledge points in the teaching contents before class, analyze the thought and correlation of the teaching contents in class, evaluate the teaching contents, and generate the knowledge card of the teaching knowledge points after class for the convenience of students to review.
4. The intelligent education AIOT AI intelligent brain analysis platform as claimed in claim 1, wherein the AI student liveness status function generates classroom thermal value analysis results based on the data transmitted by the thermal analysis module, so that teachers can quickly learn class liveness status after class and link liveness status with teaching design to assist teachers in optimization and improvement of teaching design.
5. The intelligent education AIOT AI intelligent brain analysis platform of claim 1, wherein the AI classroom blackboard-writing function saves the extracted blackboard-writing as pictures for teachers teaching research, sharing among teachers for teaching exchange, sharing to parents to help students review after school and accumulation as school teaching resources based on the data transmitted by the image enhancement processing module.
6. The intelligent education AIOT AI intelligent brain analysis platform of claim 1, wherein the AI student concentration function analyzes the head specific orientation and the human eye sight direction comprehensively according to the data transmitted by the concentration analysis module, accurately identifies the student behavior, visualizes the concentration change of each student in each class for the teacher, enables the teacher to adjust the teaching design in time, tests the improvement effect and improves the class teaching quality.
7. The intelligent education AIOT AI intelligent brain analysis platform of claim 1, wherein the AI campus security function is used to replace security personnel, watch and analyze the monitoring screen all the time, detect the dangerous behaviors occurring in the campus according to the data transmitted by the behavior recognition module, and send out an alarm to the security personnel within a specified time to minimize the risk to students, instructor personnel and school facilities.
8. The intelligent education AIOT AI intelligent brain analysis platform as claimed in claim 1, wherein the behavior recognition module can be further used to realize AI visual fatigue reminding function, the AI visual fatigue reminding function performs comprehensive analysis on the bone key point detection data and the human posture estimation data transmitted by the behavior recognition module, and performs targeted collection and induction on the vertical distance between the eyes and the book, the eye opening size and the blinking number of the analyzed students, further obtains the visual fatigue degree, finally obtains the myopia risk level through analysis, and presents the myopia risk level to teachers and parents in the form of visual reports to assist the teachers and the parents in judging the visual conditions of the students, thereby realizing effective prevention of myopia.
9. The intelligent educational AIOT AI intelligent brain analysis platform of claim 8, wherein the behavior recognition module is further operable to implement an AI out-of-position prevention function that trains an out-of-position model from the skeletal key point detection data and the body pose estimation data transmitted by the behavior recognition module.
10. An apparatus comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the intelligent educational AIOT AI intelligent brain analysis platform of any of claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110219420.9A CN112989968A (en) | 2021-02-26 | 2021-02-26 | Intelligent education AIOT AI intelligent brain analysis platform and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110219420.9A CN112989968A (en) | 2021-02-26 | 2021-02-26 | Intelligent education AIOT AI intelligent brain analysis platform and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112989968A true CN112989968A (en) | 2021-06-18 |
Family
ID=76351142
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110219420.9A Pending CN112989968A (en) | 2021-02-26 | 2021-02-26 | Intelligent education AIOT AI intelligent brain analysis platform and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112989968A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114390331A (en) * | 2022-01-13 | 2022-04-22 | 徐州工业职业技术学院 | Video teaching method, system, equipment and medium |
| CN115239527A (en) * | 2022-06-27 | 2022-10-25 | 重庆市科学技术研究院 | Teaching behavior analysis system for teaching characteristic fusion and modeling based on knowledge base |
-
2021
- 2021-02-26 CN CN202110219420.9A patent/CN112989968A/en active Pending
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114390331A (en) * | 2022-01-13 | 2022-04-22 | 徐州工业职业技术学院 | Video teaching method, system, equipment and medium |
| CN114390331B (en) * | 2022-01-13 | 2023-09-08 | 徐州工业职业技术学院 | Video teaching method, system, equipment and medium |
| CN115239527A (en) * | 2022-06-27 | 2022-10-25 | 重庆市科学技术研究院 | Teaching behavior analysis system for teaching characteristic fusion and modeling based on knowledge base |
| CN115239527B (en) * | 2022-06-27 | 2024-05-07 | 重庆市科学技术研究院 | Teaching behavior analysis system based on knowledge base teaching feature fusion and modeling |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104637246B (en) | Driver multi-behavior early warning system and danger evaluation method | |
| CN101216884B (en) | A method and system for face authentication | |
| CN111027486A (en) | Auxiliary analysis and evaluation system and method for big data of teaching effect of primary and secondary school classroom | |
| CN101604382A (en) | A kind of learning fatigue recognition interference method based on human facial expression recognition | |
| CN108182409A (en) | Biopsy method, device, equipment and storage medium | |
| CN112989968A (en) | Intelligent education AIOT AI intelligent brain analysis platform and device | |
| Abdulkader et al. | Optimizing student engagement in edge-based online learning with advanced analytics | |
| CN109284713A (en) | A kind of Emotion identification analysis system based on camera acquisition expression data | |
| Bouhlal et al. | Emotions recognition as innovative tool for improving students’ performance and learning approaches | |
| CN115205764B (en) | Online learning concentration monitoring method, system and medium based on machine vision | |
| CN104183029A (en) | Portable quick crowd attendance method | |
| CN104077568A (en) | High-accuracy driver behavior recognition and monitoring method and system | |
| CN107578015B (en) | First impression recognition and feedback system and method based on deep learning | |
| Alyuz et al. | An unobtrusive and multimodal approach for behavioral engagement detection of students | |
| CN116050892A (en) | Intelligent education evaluation supervision method based on artificial intelligence | |
| Agarwal et al. | Face recognition based smart and robust attendance monitoring using deep CNN | |
| CN114970701A (en) | Multi-mode fusion-based classroom interaction analysis method and system | |
| Yang et al. | Student eye gaze tracking during MOOC teaching | |
| CN109472228A (en) | A kind of yawn detection method based on deep learning | |
| Javed et al. | An intelligent alarm based visual eye tracking algorithm for cheating free examination system | |
| Ray et al. | Design and implementation of affective e-learning strategy based on facial emotion recognition | |
| CN106651689A (en) | Intelligent examination system | |
| CN116110091A (en) | Online learning state monitoring system | |
| Huang et al. | Research on learning state based on students’ attitude and emotion in class learning | |
| Sonth et al. | Explainable Driver Activity Recognition Using Video Transformer in Highly Automated Vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |