CN117912317A - Mandarin speech and short video guide auxiliary learning system - Google Patents

Abstract

A Mandarin speech and short video guide auxiliary learning system is a learning system integrating Mandarin teaching, training, short video guide and evaluation, an automatic teaching platform formed by APP sets and comprising software, hardware, a central processing unit, a teaching and training display screen, VR intelligent equipment, intelligent wearing and the like is used for interconnection and intercommunication in the system, and the technology of celebrity speech skills, language text AI technology, machine writing and machine evaluation are integrated.

Description

Mandarin speech and short video guide auxiliary learning system

1. Technical field

The invention relates to the technical field of teaching and assessment of mandarin lectures and short videos, in particular to an intelligent multimedia interactive teaching and assessment system and method.

2. Background art

The traditional speech teaching is unidirectional output of teaching, the content of the traditional teaching is quite scattered, the celebrity name section is not quite used for systematic teaching, a large number of celebrity video speech case teaching is adopted, a plurality of imitated celebrities are selected for speech, and the problem of popularization of speech education is solved. Secondly, according to the different circumstances of every student, need to tutor student's speech skill one by one, prepare a certain amount of teaching aid, solve such as "afraid of the platform, Stage fright are nervous to forget the word, speak and have no regulations, the speech does not have the infection power" etc. if apply the new technology VR glasses, get into virtual scene such as the repeated live-action speech training of many times such as speech report hall, meeting room, etc. overcome the stress of speech and forget the word condition, overcome the fear of speech from the mind, so both saved the building speech live-action and reduced the cost input of assisting the mr, improve ordinary teaching's teaching equipment. Thirdly, the lectures are skills, the students have to practice, the practice is changed into habit through repeated practice, the robot is adopted for shooting, observing and identifying, the whole process of lecture training is managed from lectures, shots and editing, the lectures are guided by a teacher, and the game type psychological training, the gas training and the machine intelligent scoring are performed, so that the lecture teaching and the training are interesting in temperature, the traditional teaching mode is improved, and the teaching quality and the teaching efficiency are improved. Finally, the traditional lecture teaching lacks application scenes, and the emerging transmission medium, namely the short video, is output in a mode of taking oral broadcasting as a main mode, so that the teaching is performed in a mode of combining the lecture with the short video, the application scenes are greatly improved, and students can understand the learned knowledge more deeply.

3. Summary of the invention

The invention relates to a Mandarin lecture and short video guidance auxiliary learning system, which integrates software, hardware, a central processing unit, a teaching and training display screen, VR intelligent equipment and an intelligent wearable lecture intelligent teaching system, and particularly comprises the following aspects of teaching, learning, training, assessment, evaluation and editing short video overall intelligent systemization teaching: ① Teacher teaching system: the method comprises the steps that a local database, a cloud database, a central processing unit, a video courseware module, an online course module and a teacher are integrated, log in through a man-machine operation module, enter a central control system and give lessons at a teaching display screen port; the system can also record character lesson preparation data, audio and video data through data processing modules such as an audio acquisition module, a video acquisition module, a character acquisition module and the like, and can also share celebrity video speech case teaching in a central processing unit to correct and annotate student speech videos; ② Student speech training and assessment system: multiple aspects of examining the learning achievements of students, including multiple projects such as intelligent scoring, gas training, psychological training and the like, establishing a dynamic three-dimensional model, performing posture and mental exercises by using an interactive three-dimensional model, and comparing the dynamic three-dimensional model with the posture and mental exercises in a local database to obtain scores; for example: the students check in a dynamic three-dimensional model in a game mode, the memory, the attention and the space thinking of the lecture are trained, the speech speed and the limb form are tracked by a camera of a training machine screen, the training machine screen is compared with the three-dimensional model of a local database, and training score collection is obtained through the check; the students wear VR intelligent equipment, intelligently wear to carry out lecture exercise, through psychological test, heart rate test and three-dimensional model virtual scene exercise, help the students overcome the fear of lecture, obtain psychological test score, gather and store the completion condition that the students are contacted in each item in the learning process, and evaluate the received data according to preset algorithm, send the evaluation result to the central controller and show in the teaching display screen, the mr knows the student learning condition through the score, and tutor with pertinence. ③ The speech helper, the intelligent lecture draft Al generation module of system collection includes famous person name, text Al generation module, grammar Al modification module, the function of correcting errors of grammar certainly, discern the famous person name in the article, show provenance and quotation, the student puts forward the keyword, the machine initiatively generates the manuscript, both improve student's speech interest and help improving the performance of speech. ④ Short video assists to improve student's lecture lens sense, and the collection is tugged and is shot clipping module, tutoring sub-lens module, tutoring clipping module, and the student utilizes the built-in camera of training machine screen assembly to carry out means such as shooting, sub-lens, clipping and observe facial expression, mind, limbs action when the lecture, and repeated megaphone part is played in the clipping lecture process, and the repeated exercise of the lecture manuscript that is played again and is played back reaches satisfied effect. ⑤ The device development software can upload books, excellent documents, short videos and other learning materials from the background, has reading functions, note taking functions and labeling functions, and can promote introduction of books, promotion reasons and wonderful paragraph sharing and book reading modes. ⑥ And the learning card punching is used for summarizing and storing the completion condition of daily tasks of students in the course of self-learning, evaluating the received data according to a preset algorithm and sending the evaluation result to the central control system. ⑦ The learning result matching work is used for intelligent evaluation and teacher comment of the whole learning of the students, and the intelligent matching work units are preferentially recommended to the cooperation units for the students.

The invention has the beneficial effects that the popularization of the Mandarin lecture skill education is improved, the traditional lecture teaching lacks application scenes, and the emerging transmission medium, namely the short video, is output in a main mode of oral broadcasting, so the teaching is realized in a mode of combining the lecture with the short video, the application scenes are greatly improved, and students can understand the learned knowledge more deeply; the novel technology VR glasses are used for entering virtual scenes such as a speech report hall, a conference hall and the like for repeated training for many times, so that the condition of tension in speech and word forgetting is overcome, the fear of speech is overcome from the mind, the real scene of speech is built, the cost input of auxiliary teachers is reduced, and the teaching equipment for common teaching is improved.

4. Description of the drawings

In order to more clearly illustrate the embodiments of the invention or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the description below are only some embodiments of the invention, and that other drawings can be obtained according to these drawings without inventive faculty for a person skilled in the art.

FIG. 1 is a block diagram of an embodiment of the present invention

5. Detailed description of the preferred embodiments

The following description of the embodiments of the present invention will be made more apparent and fully hereinafter with reference to the accompanying drawings, in which some, but not all embodiments of the invention are shown. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

As shown in fig. 1, the mandarin lecture and short video guidance auxiliary learning system provided by the invention is applied to an intelligent practical training classroom or classroom, and consists of hardware equipment such as a training machine screen, a teaching display screen, a router, a central control system, VR intelligent equipment, intelligent wearing equipment, a mobile terminal and the like, wherein the equipment performs signal transmission and exchange through a wireless network system or a wired transmission system; the training machine screen is a touch large screen carrying a 3D camera and is mainly used for a student end to dynamically capture and input and output contents; the teaching display screen can be one or more of a projector, a projection curtain and an electronic whiteboard, and the video output device in the embodiment is a display screen and is mainly used for a teacher end to output content and teach; the router is responsible for network transmission and exchange and is mainly used for connecting a cloud database and a mobile terminal through a network; the central control system (hereinafter referred to as "central control") is responsible for controlling a training machine screen, a teaching display screen, a VR intelligent device and an intelligent wearing device, and all output contents and input contents are uniformly controlled or regulated by the central control; the VR intelligent device, the intelligent wearable device and the mobile terminal are mainly used for realizing some special scenes and some student test modules;

the training machine screen is characterized by comprising a training machine screen, a training camera module, a training shot module, a training editing module, a central processing unit and a training editing module, wherein the training camera module, the training shot module and the training editing module are independent software and courseware to be installed in the training machine screen, and the data processing is extracted from a local database by the central processing unit and operated. The students can take photos, divide shots and clip knowledge learned in daily self-learning and review lessons on the screen, or can copy data for some lessons to learn home independently;

As shown in FIG. 1, the intelligent scoring module, the gas training module, the psychological training module and the student training score summarizing and evaluating module are important components in the whole system, the intelligent scoring module, the gas training module, the psychological training module and the student training score summarizing and evaluating module are used for processing information and comparing the information by acquiring data of a local database and sending the data to a central processor, and a final output port is a training machine screen. Students use the modules to conduct autonomous exercises, teachers use the modules to check the students 'usual learning, including tests such as voice, intonation, appearance, eye, expression form, in-situ performance and the like, and can intelligently score the students' lectures or short videos;

The celebrity name Al query module, the text Al generation module, the grammar Al modification module and the lecture manuscript Al generation module are another important component in the whole system, the celebrity name Al query module, the text Al generation module, the grammar Al modification module and the lecture manuscript Al generation module transmit data obtained through a cloud database to a central processor to process information and compare to obtain a result, and a final output port is a training machine screen and a teaching display screen. The students can input keywords or lectures on the training machine screen to obtain specific celebrity dialects, texts and manuscripts with suggested grammar modification, a complete lecture can be formed according to the functions, and intelligent scoring can be carried out on the lectures of the students;

As shown in fig. 1, the book recommendation module, the video recommendation module, the learning and punching module and the learning result matching work module are one or more complete APP and are installed on a mobile terminal (mobile phone or plane computer). Therefore, students can learn and apply Mandarin lectures and short videos more effectively in daily life, and meanwhile, teachers can teach students and supervise students more effectively;

the guidance auxiliary learning system provided by the invention breaks through the traditional speech teaching concept, is a learning system integrating Mandarin teaching, training, short video guidance and evaluation, and is an automatic teaching platform formed by integrating software, hardware, a central processing unit, a teaching and training display screen, VR intelligent equipment, intelligent wearing and the like. The system is internally interconnected and intercommunicated, integrates the techniques of celebrity speech skills, intelligent text extraction, intelligent writing, intelligent assessment, intelligent voice, big data analysis, short video production and the like, can be used for popularizing mandarin, and improves the learning efficiency of mandarin speech. Therefore, the ordinary lecture teaching, lecture training and application thereof in the current stage are further improved, materials for old teachers and students are obtained deeply, learning results can be consolidated, and the method is applied to short videos. The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (6)

1. The Mandarin speech and short video guide auxiliary learning system is characterized by comprising a central control system, a Virtual Reality (VR) intelligent device and a virtual reality (other than VR) intelligent device, wherein the central control system is used for inputting control commands to a training machine screen, a teaching display screen central control system and other data; the man-machine operation module is used for logging in by student users and performing various control commands; the theory teaching module is used for teaching theory knowledge of the Mandarin lectures and the short video lectures in a text, audio and video mode; the online course module is used for teaching theoretical knowledge of mandarin lectures and short video guidance by a different place name teacher through online live video; the video acquisition module is used for the students to record videos of interactive exercises and learning through a depth sensor (3D camera) in the training machine screen, acquire actions and send the actions to the central processing unit through the data transmission module; the audio acquisition module is used for recording the sounds of the interaction exercise and the learning by the students through the microphone in the training machine screen, acquiring the audio and sending the audio to the central processing unit through the data transmission module; the data processing module is used for transmitting the acquired video data and audio data to the central processing unit, comparing the identification result with a local database and a cloud database, and finally acquiring exercise results and learning scores; the central control system is used for user registration, authority management and password modification; the intelligent virtual machine display device is used for calling corresponding data in a local database and a cloud database according to a data calling command input by the man-machine operation module and sending the corresponding data to a training machine screen, a teaching display screen and VR intelligent equipment for display; the central processing unit is used for receiving control commands and data of the man-machine operation module, the data processing module and the central control system and sending the control commands to the designated module according to a preset algorithm; the coaching camera module is used for assisting students to learn the exercise of photography according to preset software and audio-visual materials in the training machine screen system; the tutoring shot module is used for assisting students in learning exercises of shot writing according to preset software and audio-visual materials in the training machine screen system; the coaching editing module is used for assisting students in learning editing exercises according to preset software and audio-visual materials in the training machine screen system; the intelligent scoring module is used for calling corresponding data from a local database according to a control command sent by the central processing unit to establish various scenes, displaying each dynamic three-dimensional model and each interactive three-dimensional model through a training machine screen or VR intelligent equipment to carry out speech exercise, checking the voice, the speech speed and the strain capacity of students, and sending the checked results to the comprehensive evaluation module; the air quality training module is used for calling corresponding data from a local database according to a control command sent by the central processing unit to establish various scenes, training a dynamic three-dimensional model and an interactive three-dimensional model of a machine screen to carry out gesture and attitude training, comparing the gesture and attitude training with the gesture and attitude in the local database to obtain scores, and sending the assessment result to the comprehensive assessment module; secondly, the method can be used for testing students according to a preset game through a memory training game, an attention training game and a space thinking training game, and sending the result of the assessment to a comprehensive assessment module; the psychological training module is firstly used for calling corresponding data from a local database according to a control command sent by the central processing unit to establish various scenes, displaying a dynamic three-dimensional model and an interactive three-dimensional model through the VR intelligent device to perform exercises for overcoming psychological disorders, and sending data such as heart rate and the like to the comprehensive evaluation module; secondly, the method can be used for carrying out psychological test on students by selecting test questions from a local database according to a preset method in a psychological test mode, and sending the result of the assessment to a comprehensive assessment module; the student training score summarizing and evaluating module is used for summarizing and storing the completion condition of each item of contact of the students in the learning process, evaluating the received data according to a preset algorithm, sending the evaluation result to the central controller for display on a teaching display screen, and further evaluating by a coaching teacher; the celebrity name AI query module is used for intelligently querying the celebrity name through the processing of the central processing unit according to the keywords input by the students, wherein the data are extracted through the cloud database; the text AI generation module is used for automatically generating a section of lecture according to the keywords input by the students and processed by the central processing unit, wherein the data is extracted through the cloud database; the grammar AI modifying module is used for automatically labeling and suggesting to modify grammar errors in articles input by students according to the articles processed by the central processing unit, wherein the data are extracted through the cloud database; the lecture AI generation module is used for detecting the completion condition of each item of contact in the lecture writing process according to articles input by students, evaluating the received data according to a preset algorithm, sending an evaluation result to the central controller for display on a teaching display screen, and further evaluating by a coaching teacher; the book recommendation module is used for recommending books for students to learn and comprises book introduction, recommendation reason, wonderful paragraph sharing and book reading modes; the video recommendation module is used for recommending videos for students to learn and comprises a video reading mode, a recommendation reason mode and a highlight selection mode; the learning card punching module is used for summarizing and storing the completion condition of daily tasks of students in the course of self-learning, evaluating the received data according to a preset algorithm and sending the evaluation result to the central control system; and the learning result matching work module is used for intelligent evaluation and teacher comment of the whole learning of the students, and the intelligent matching work units are preferentially recommended to the cooperation units for the students.

2. The mandarin chinese speech and short video guided learning aid system of claim 1, further comprising a training machine screen, a teaching display screen, a central control system, a VR intelligent device, and an intelligent wearable device for playing teaching videos, teaching audios, teaching texts, and teaching pictures; and the system is also used for displaying various data input by the man-machine operation module and data required to be displayed in the whole using process.

3. The mandarin chinese speech and short video guide aided learning system of claim 1, further comprising a courseware sharing module for the teacher uploading the courseware of the lesson, thereby realizing the sharing of the courseware of the students and the teacher.

4. A mandarin chinese speech and short video guided assisted learning system in accordance with claim 1 wherein the students upload, download and browse data via mobile terminals or designated APPs.

5. The mandarin chinese speech and short video guided learning aid system of claim 1, wherein the local and cloud databases store therein various character, event related construction models, text, audio and video data.

6. The system for mandarin chinese speech and short video guided learning assistance of claim 1, wherein the local database and the cloud database are each connected with a data update module for performing real-time update of data in each database.