CN115953272A - Teaching demonstration system combining vision and image processing - Google Patents
Teaching demonstration system combining vision and image processing Download PDFInfo
- Publication number
- CN115953272A CN115953272A CN202211632302.1A CN202211632302A CN115953272A CN 115953272 A CN115953272 A CN 115953272A CN 202211632302 A CN202211632302 A CN 202211632302A CN 115953272 A CN115953272 A CN 115953272A
- Authority
- CN
- China
- Prior art keywords
- module
- image
- processing system
- acquisition
- teaching demonstration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 104
- 238000012800 visualization Methods 0.000 claims abstract description 16
- 238000011156 evaluation Methods 0.000 claims abstract description 11
- 238000013135 deep learning Methods 0.000 claims description 20
- 238000004891 communication Methods 0.000 claims description 12
- 230000003993 interaction Effects 0.000 claims description 6
- 238000012544 monitoring process Methods 0.000 claims description 6
- 230000011218 segmentation Effects 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 3
- 238000011897 real-time detection Methods 0.000 description 3
- 238000000034 method Methods 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000003709 image segmentation Methods 0.000 description 1
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention discloses a teaching demonstration system combining vision and image processing, which relates to the field of teaching demonstration and comprises a teaching demonstration host, wherein the teaching demonstration host comprises a sound acquisition module, an image system, an acquisition processing system, an automatic teaching module, a central processing system, a loudspeaker, a visualization module and a cloud storage module; the voice acquisition module transmits voice to the acquisition processing system, the face recognition module, the action recognition module and the sight line in the acquisition processing system are matched with the sight line comparison module to realize the recognition of the face, the action and the sight line of students in a classroom, and meanwhile, the evaluation module is used for judging the face, the action and the sight line of the students according to the recognition data, so that the lecture rate in the classroom is judged, and a lecturer can master the lecture state of the students in the classroom in real time.
Description
Technical Field
The invention relates to the technical field of teaching demonstration, in particular to a teaching demonstration system combining vision and image processing.
Background
Common image processing is image digitization, image coding, image enhancement, image restoration, image segmentation, image analysis, and the like. Although some processes can also be implemented optically or by analog techniques, they are far less flexible and convenient than digital image processing, which becomes a major aspect of image processing.
Through retrieval, the invention patent with the Chinese patent number of CN108184077A discloses a recording and broadcasting teaching demonstration system, which comprises a control terminal and a plurality of recording and broadcasting devices; the plurality of recording and broadcasting devices are respectively erected in corresponding classrooms; the recording and broadcasting equipment comprises: the camera device comprises an infrared camera, a visible light camera and an environment camera; the image capturing module is used for cutting the image recorded by the visible light camera by using the figure outline in the infrared camera, further eliminating a background image and extracting a pure figure image; the control terminal includes: the server is used for storing the video recorded by the recording and playing equipment and storing related information; the display module is used for displaying the status of the video and/or the recording and playing equipment in the server; the monitoring module is used for monitoring the condition of the recording and broadcasting equipment; the management module is used for managing the video and the recording and playing equipment in the server; the control module is used for selecting the recording and broadcasting equipment as required and sending an operation instruction to the recording and broadcasting equipment; and the playing module is used for generating the 2D/3D teaching video from the environment image and the figure image according to the requirement and playing the video.
However, the above system can only realize 2D/3D playing in combination with actual conditions, has a sense of reality, and can remotely control recording and playing equipment in batch, breaks through space limitation, saves human resources consumed by equal operations, and further reduces energy consumption, but lacks real-time detection of the student listening state inside a classroom in actual use, and further is difficult to adjust teaching demonstration in real time according to the student state, and reduces the enthusiasm of students listening, so that a teaching demonstration system combining vision and image processing is needed.
Disclosure of Invention
The invention aims to solve the defects that the real-time detection of the listening state of a student in a classroom is lacked, and then the real-time regulation of teaching demonstration according to the state of the student is difficult in the prior art, and provides a teaching demonstration system combining vision and image processing.
In order to achieve the purpose, the invention adopts the following technical scheme:
a teaching demonstration system combining vision and image processing comprises a teaching demonstration host, wherein the teaching demonstration host comprises a sound acquisition module, an image system, an acquisition processing system, an automatic teaching module, a central processing system, a loudspeaker, a visualization module and a cloud storage module, the sound acquisition module is in communication connection with the acquisition processing system, and the sound acquisition module is used for recording the sounds of students and lecturers in a classroom in real time;
the system comprises a sound acquisition module, an image system, an acquisition processing system and a central processing system, wherein the sound acquisition module transmits sound to the acquisition processing system, the image system acquires images in a classroom in real time, the image system transmits the acquired images to the acquisition processing system, the acquisition processing system comprises a face recognition module, an action recognition module and a sight line comparison module, the acquisition processing system performs face recognition, action recognition and sight line comparison on the acquired sound and image data, the acquisition processing system is in communication connection with the central processing system, the central processing system comprises a deep learning module, a data interaction module and an evaluation module, and the central processing system performs deep learning according to acquired data information;
the automatic teaching module is in communication connection with the central processing system, and the automatic teaching module performs automatic teaching according to personal information of students.
The above technical solution further comprises:
the image system collects images in a classroom through the monitoring camera, the image system performs segmentation processing on the collected images, and meanwhile, the image system identifies image data after the segmentation processing.
The face recognition module acquires the image data transmitted to the inside of the acquisition processing system, and simultaneously performs face recognition according to the image data.
The motion recognition module acquires image data transmitted to the acquisition processing system, the motion recognition module recognizes the image data once every 0.5s, the time period of each recognition processing of the motion recognition module is two seconds, the motion recognition module recognizes the image within two seconds, and introduces motion inertia, so that the motion of a person in the image is recognized.
The sight line comparison module acquires the images transmitted to the acquisition processing system, and detects and compares the sight lines of the students in real time.
The deep learning module receives data information transmitted to the central processing system, the deep learning module performs deep learning on the received data to generate a class listening and speaking judgment model, and the evaluation module judges the class listening and speaking rate of the data information transmitted to the central processing system.
The central processing system is in communication connection with the visualization module, the central processing system transmits the processed information to the visualization module, and the visualization module classifies the received data and transmits the data to the teaching demonstration host for display.
And the cloud storage module stores the data in the teaching demonstration host in real time.
Compared with the prior art, the invention has the beneficial effects that:
1. when the classroom lecture monitoring system is used, the face recognition module, the action recognition module and the sight line comparison module in the acquisition processing system are matched to recognize faces, actions and sight lines of students in a classroom, and meanwhile, the evaluation module judges recognition data of the faces, the actions and the sight lines of the students, so that the lecture rate of a classroom is judged, and a lecturer can conveniently master the lecture state of the students in the classroom in real time.
2. When the invention is used, the data information transmitted to the central processing system is deeply learned through the deep learning module, so that a classroom listening and speaking judgment model is generated, and the automatic teaching module is adaptively adjusted through the classroom listening and speaking judgment model, thereby improving the classroom listening and speaking efficiency of students.
Drawings
FIG. 1 is a system diagram of a teaching demonstration system using vision combined with image processing according to the present invention;
FIG. 2 is a system block diagram of an acquisition processing system of the present invention;
FIG. 3 is a system block diagram of a central processing system according to the present invention.
In the figure: 1. a sound collection module; 2. an image system; 3. an acquisition processing system; 4. an automatic teaching module; 5. a central processing system; 6. a speaker; 7. a visualization module; 8. a cloud storage module; 9. a deep learning module; 10. a data interaction module; 11. an evaluation module; 12. a face recognition module; 13. an action recognition module; 14. and a sight line comparison module.
Detailed Description
The technical solution of the present invention is further explained with reference to the accompanying drawings and specific embodiments.
Example one
As shown in fig. 1-3, the teaching demonstration system combining vision and image processing provided by the invention comprises a teaching demonstration host, wherein the teaching demonstration host comprises a sound acquisition module 1, an image system 2, an acquisition processing system 3, an automatic teaching module 4, a central processing system 5, a loudspeaker 6, a visualization module 7 and a cloud storage module 8, the sound acquisition module 1 is in communication connection with the acquisition processing system 3, and the sound acquisition module 1 is used for recording the sounds of students and lecturers in a classroom in real time;
the voice acquisition module 1 transmits voice to the acquisition processing system 3, the image system 2 acquires images in a classroom in real time, the image system 2 transmits the acquired images to the acquisition processing system 3, the acquisition processing system 3 internally comprises a face recognition module 12, an action recognition module 13 and a sight line comparison module 14, the acquisition processing system 3 performs face recognition, action recognition and sight line comparison on the acquired voice and image data, the acquisition processing system 3 is in communication connection with the central processing system 5, the central processing system 5 internally comprises a deep learning module 9, a data interaction module 10 and an evaluation module 11, the central processing system 5 performs deep learning according to acquired data information, and the data interaction module 10 interacts data in a demonstration host to realize data combing;
communication connection between automatic teaching module 4 and central processing system 5, automatic teaching module 4 carries out the automatic teaching according to student's personal information, and image system 2 gathers the inside image in classroom through the surveillance camera head, and image system 2 cuts apart the processing to the image of gathering, and image system 2 discerns the image data after the segmentation processing simultaneously, and data in the high in the clouds storage module 8 is to the demonstration host computer of teaching carry out real-time storage.
The teaching demonstration system based on the first embodiment and combining vision and image processing has the working principle that the sound acquisition module 1 is used for recording the sounds of students and lecturers in a classroom in real time, the image system 2 is used for acquiring images in the classroom through the monitoring camera, the image system 2 is used for segmenting the acquired images, and meanwhile, the image system 2 is used for identifying the image data after segmentation;
the acquisition processing system 3 carries out face recognition, action recognition and sight comparison to the sound and the image data of gathering, and central processing system 5 carries out the degree of depth study again according to the data information who gathers, and automatic teaching module 4 carries out automatic teaching according to student's personal information, and the high in the clouds storage module 8 carries out real-time storage to the data in the demonstration host computer of imparting knowledge to students simultaneously.
Example two
As shown in fig. 1 to 3, based on the first embodiment, the face recognition module 12 acquires image data transmitted to the inside of the acquisition processing system 3, and the face recognition module 12 performs face recognition according to the image data;
the motion recognition module 13 acquires image data transmitted to the acquisition processing system 3, the motion recognition module 13 recognizes every 0.5s, the time period of each recognition processing of the motion recognition module 13 is two seconds, the motion recognition module 13 recognizes the image within two seconds, and introduces motion inertia, so as to recognize the human motion in the image;
the sight line comparison module 14 acquires the images transmitted to the acquisition processing system 3, and the sight line comparison module 14 detects and compares the sight lines of the students in real time.
In this embodiment, in operation, the face recognition module 12 performs face recognition according to image data, the motion recognition module 13 performs recognition every 0.5s, the motion recognition module 13 recognizes an image within two seconds and introduces motion inertia to recognize a person motion in the image, the sight line comparison module 14 performs real-time detection and comparison on the sight line of a student, and the sight line comparison module 14 combines with the processing results of the face recognition module 12 and the motion recognition module 13 during recognition to obtain a realization moving path of the student.
EXAMPLE III
As shown in fig. 1 to 3, based on the first or second embodiment, the deep learning module 9 receives data information transmitted to the central processing system 5, the deep learning module 9 performs deep learning on the received data, so as to generate a "class listening and speaking judgment model", and the evaluation module 11 judges a class listening and speaking rate of the data information transmitted to the central processing system 5;
the central processing system 5 is in communication connection with the visualization module 7, the central processing system 5 transmits the processed information to the visualization module 7, and the visualization module 7 classifies the received data and transmits the data to the teaching demonstration host for display.
In this embodiment, the deep learning module 9 performs deep learning on the received data to generate a "classroom listening and speaking judgment model", and the evaluation module 11 judges the classroom listening and speaking rate of the data information transmitted to the central processing system 5;
the central processing system 5 transmits the processed information to the visualization module 7, the visualization module 7 classifies the received data, transmits the data to the teaching demonstration host for displaying, and performs adaptive adjustment on the automatic teaching module 4 through the class listening and speaking judgment model, thereby improving the listening and speaking efficiency of students to the class.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.
Claims (8)
1. The teaching demonstration system combining vision and image processing comprises a teaching demonstration host and is characterized in that the teaching demonstration host comprises a sound acquisition module (1), an image system (2), an acquisition processing system (3), an automatic teaching module (4), a central processing system (5), a loudspeaker (6), a visualization module (7) and a cloud storage module (8), the sound acquisition module (1) is in communication connection with the acquisition processing system (3), and the sound acquisition module (1) is used for recording the sounds of students and lecturers in a classroom in real time;
the system comprises a sound acquisition module (1), an image system (2), an action recognition module (13), a sight line comparison module (14), a central processing system (5), a deep learning module (9), a data interaction module (10) and an evaluation module (11), wherein the sound acquisition module (1) transmits sound to the acquisition processing system (3), the image system (2) acquires images in a classroom in real time, the image system (2) transmits the acquired images to the acquisition processing system (3), the acquisition processing system (3) internally comprises a face recognition module (12), an action recognition module (13) and a sight line comparison module (14), the acquisition processing system (3) performs face recognition, action recognition and sight line comparison on the acquired sound and image data, the acquisition processing system (3) is in communication connection with the central processing system (5), the central processing system (5) internally comprises the deep learning module (9), the data interaction module (10) and the evaluation module (11), and the central processing system (5) performs deep learning according to the acquired data information;
the automatic teaching module (4) is in communication connection with the central processing system (5), and the automatic teaching module (4) performs automatic teaching according to personal information of students.
2. A teaching demonstration system combining vision and image processing according to claim 1, wherein the image system (2) acquires images in the classroom through a monitoring camera, the image system (2) performs segmentation processing on the acquired images, and the image system (2) identifies the segmented image data.
3. A combined vision and image processing instructional presentation system according to claim 2, wherein the face recognition module (12) acquires image data transmitted to the inside of the acquisition and processing system (3), and the face recognition module (12) performs face recognition based on the image data.
4. A teaching demonstration system combining vision and image processing according to claim 3, characterized in that the motion recognition module (13) acquires the image data transmitted to the acquisition processing system (3), the motion recognition module (13) recognizes every 0.5s, the time period of each recognition processing of the motion recognition module (13) is two seconds, the motion recognition module (13) recognizes the image within two seconds and introduces motion inertia, thereby recognizing the human motion in the image.
5. The teaching demonstration system combining vision and image processing as claimed in claim 4, wherein the sight line comparison module (14) acquires the images transmitted to the acquisition processing system (3), and the sight line comparison module (14) detects and compares the sight lines of students in real time.
6. A teaching demonstration system combining vision and image processing according to claim 5, wherein the deep learning module (9) receives data information transmitted to the central processing system (5), the deep learning module (9) performs deep learning on the received data to generate a "class listening and speaking judgment model", and the evaluation module (11) judges class listening and speaking rates of the data information transmitted to the central processing system (5).
7. A teaching demonstration system combining vision and image processing according to claim 6, wherein said central processing system (5) is in communication with said visualization module (7), said central processing system (5) transmits the processed information to said visualization module (7), said visualization module (7) classifies the received data and transmits the data to the teaching demonstration host for display.
8. An instructional presentation system combining vision and image processing according to claim 7, wherein said cloud storage module (8) stores data in an instructional presentation host in real time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211632302.1A CN115953272A (en) | 2022-12-19 | 2022-12-19 | Teaching demonstration system combining vision and image processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211632302.1A CN115953272A (en) | 2022-12-19 | 2022-12-19 | Teaching demonstration system combining vision and image processing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115953272A true CN115953272A (en) | 2023-04-11 |
Family
ID=87282079
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211632302.1A Pending CN115953272A (en) | 2022-12-19 | 2022-12-19 | Teaching demonstration system combining vision and image processing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115953272A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110992741A (en) * | 2019-11-15 | 2020-04-10 | 深圳算子科技有限公司 | Learning auxiliary method and system based on classroom emotion and behavior analysis |
| CN112598552A (en) * | 2020-12-24 | 2021-04-02 | 贵州树精英教育科技有限责任公司 | Education classroom data analysis system |
| CN114037954A (en) * | 2021-11-09 | 2022-02-11 | 江西师范大学 | Human body behavior analysis system based on classroom intensive population |
| CN114693480A (en) * | 2022-03-18 | 2022-07-01 | 四川轻化工大学 | A teachers and students real-time interactive system for practising course |
-
2022
- 2022-12-19 CN CN202211632302.1A patent/CN115953272A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110992741A (en) * | 2019-11-15 | 2020-04-10 | 深圳算子科技有限公司 | Learning auxiliary method and system based on classroom emotion and behavior analysis |
| CN112598552A (en) * | 2020-12-24 | 2021-04-02 | 贵州树精英教育科技有限责任公司 | Education classroom data analysis system |
| CN114037954A (en) * | 2021-11-09 | 2022-02-11 | 江西师范大学 | Human body behavior analysis system based on classroom intensive population |
| CN114693480A (en) * | 2022-03-18 | 2022-07-01 | 四川轻化工大学 | A teachers and students real-time interactive system for practising course |
Non-Patent Citations (1)
| Title |
|---|
| 程萌萌 等: "应用表情识别与视线跟踪的智能教学***研究", 中国远程教育, no. 3, pages 59 - 64 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP4184927A1 (en) | Sound effect adjusting method and apparatus, device, storage medium, and computer program product | |
| CN109727167B (en) | Teaching auxiliary system | |
| CN106128188A (en) | Desktop education focus analyzes system and the method for analysis thereof | |
| Temkar et al. | Internet of things for smart classrooms | |
| JP2009258175A (en) | Lecture system and tabulation system | |
| CN113132741A (en) | Virtual live broadcast system and method | |
| CN108877361A (en) | The man-machine robot system for teaching mode altogether | |
| CN107133611A (en) | A kind of classroom student nod rate identification with statistical method and device | |
| CN109889881A (en) | A kind of teachers ' classroom teaching data collection system | |
| CN111325853B (en) | Remote coaching system and method based on augmented reality glasses | |
| CN109448463A (en) | Foreign language pronunciation autonomous learning training system and its method based on virtual reality technology | |
| CN114257776B (en) | Classroom interaction system | |
| CN108735031A (en) | A kind of teaching and training system based on virtual reality | |
| CN208873311U (en) | The man-machine robot system for teaching mode altogether | |
| CN115953272A (en) | Teaching demonstration system combining vision and image processing | |
| TWI709915B (en) | Curriculum index detection warning method, device, electronic equipment, and storage medium | |
| CN114255426A (en) | Student concentration degree evaluation system based on video recognition and voice separation technology | |
| CN115543075A (en) | VR teaching system with long-range interactive teaching function | |
| CN111768729A (en) | VR scene automatic explanation method, system and storage medium | |
| CN110262662A (en) | A kind of intelligent human-machine interaction method | |
| CN111435268A (en) | Human-computer interaction method based on image recognition and reconstruction and system and device using same | |
| CN109089099A (en) | Image processing method, device, equipment and storage medium | |
| CN213634902U (en) | Somatosensory interactive education integrated equipment | |
| CN111860294A (en) | Face capture equipment convenient to trail | |
| CN111754827A (en) | Presentation system based on AR interactive teaching equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |