CN110827595A - Interaction method and device in virtual teaching and computer storage medium - Google Patents

Interaction method and device in virtual teaching and computer storage medium Download PDF

Info

Publication number
CN110827595A
CN110827595A CN201911276742.6A CN201911276742A CN110827595A CN 110827595 A CN110827595 A CN 110827595A CN 201911276742 A CN201911276742 A CN 201911276742A CN 110827595 A CN110827595 A CN 110827595A
Authority
CN
China
Prior art keywords
behavior
student
teaching
behavior type
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911276742.6A
Other languages
Chinese (zh)
Inventor
张浩雨
赵付栋
刘磊磊
牛记一
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Huanju Shidai Information Technology Co Ltd
Original Assignee
Guangzhou Huaduo Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Huaduo Network Technology Co Ltd filed Critical Guangzhou Huaduo Network Technology Co Ltd
Priority to CN201911276742.6A priority Critical patent/CN110827595A/en
Publication of CN110827595A publication Critical patent/CN110827595A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/08Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
    • G09B5/14Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/02Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

The application discloses an interaction method and device in virtual teaching and a computer storage medium, and belongs to the technical field of internet. The method comprises the following steps: and determining the behavior type of the student, and if the behavior type of the student is the target behavior type, acquiring the type of the target feedback behavior matched with the target behavior type. And displaying the animation corresponding to the target feedback behavior type, wherein the animation comprises the feedback behavior of the virtual teacher aiming at the behavior of the student. That is, in this application embodiment, the virtual teacher can make feedback in time according to the behavior of the student, so the interaction link between the student and the teacher is increased in the virtual teaching process, thereby the learning interest of the student is greatly increased, and the user viscosity of the virtual teaching mode provided by this application embodiment is correspondingly improved.

Description

Interaction method and device in virtual teaching and computer storage medium
Technical Field
The present application relates to the field of internet technologies, and in particular, to an interaction method and apparatus in virtual teaching, and a computer storage medium.
Background
With the rapid development of the internet technology, the traditional teaching mode of on-line live broadcasting teaching cannot meet the flexibility and convenience required by modern teaching. For example, the teaching time of the traditional on-line live broadcasting teaching is often arranged according to the time of a live broadcasting teacher, and if the live broadcasting teacher asks for a disease, the normal teaching progress is delayed. At this time, if a virtual teacher is used for teaching, the convenience and flexibility of the students can be greatly increased.
In the related art, a virtual teacher is created first, teaching contents are configured for the virtual teacher in advance, the teaching contents can be a section of voice, and the virtual teacher is controlled to play the voice, so that the virtual teacher can teach like a real teacher. However, in the virtual teaching mode, the interaction between the virtual teacher and the student is lacked, so that the interest of the student in class is reduced, and the user viscosity of the virtual teaching mode is low.
Disclosure of Invention
The embodiment of the application provides an interaction method and device in virtual teaching and a computer storage medium, which can increase the interaction between a virtual teacher and a student and further increase the user viscosity of a virtual teaching mode. The technical scheme is as follows:
in one aspect, an interaction method in virtual teaching is provided, where the method includes:
determining the behavior type of the student, wherein the behavior type is used for indicating the behavior of the student in the virtual teaching process;
if the behavior type of the student is a target behavior type, acquiring a target feedback behavior type matched with the target behavior type, wherein the target feedback behavior type is used for indicating a behavior responding to the behavior of the student;
and displaying an animation corresponding to the target feedback behavior type, wherein the animation comprises a feedback behavior made by a virtual teacher aiming at the behavior of the student.
Optionally, after obtaining the target feedback behavior type matched with the target behavior type, the method further includes:
and synchronously playing the voice corresponding to the animation.
Optionally, the determining the behavior type of the student includes:
collecting audio and video data of the students in the virtual teaching process;
and determining the behavior type of the student according to the audio and video data and a behavior recognition model, wherein the behavior recognition model is used for recognizing the behavior type based on the audio and video data.
Optionally, the obtaining a target feedback behavior type matched with the target behavior type includes:
acquiring a behavior type corresponding relation, wherein the behavior type corresponding relation comprises a plurality of behavior types and a plurality of feedback behavior types which are matched with the behavior types one by one;
and determining a target feedback behavior type matched with the target behavior type according to the behavior type corresponding relation.
Optionally, the method further includes:
determining the knowledge mastering degree of the student on first teaching content, wherein the first teaching content is teaching content before the current time and within a first time length from the current time;
acquiring second teaching content, wherein the second teaching content refers to teaching content after the current time;
and adjusting the second teaching content according to the knowledge mastering degree of the student on the first teaching content.
Optionally, the adjusting the second teaching content according to the knowledge mastering degree of the student on the first teaching content includes:
determining contents to be reviewed according to the knowledge mastery degree of the students on the first teaching contents;
and adding the audio and video data corresponding to the content to be reviewed into the audio and video data containing the second teaching content.
Optionally, the determining the knowledge mastery degree of the student on the first teaching content includes:
determining test content according to the first teaching content;
displaying the test content;
acquiring the answer information of the student based on the test content;
and determining the knowledge mastery degree of the student on the first teaching content according to the reply information.
In another aspect, an interactive device in virtual education is provided, the device including:
the first determining module is used for determining the behavior type of the student, and the behavior type is used for indicating the behavior of the student in the virtual teaching process;
a first obtaining module, configured to obtain a target feedback behavior type that is matched with a target behavior type if the behavior type of the student is the target behavior type, where the target feedback behavior type is used to indicate a behavior that responds to the behavior of the student;
and the display module is used for displaying the animation corresponding to the target feedback behavior type, wherein the animation comprises the feedback behavior of the virtual teacher aiming at the behavior of the student.
Optionally, the apparatus further comprises:
and the playing module is used for synchronously playing the voice corresponding to the animation.
Optionally, the first determining module includes:
the acquisition submodule is used for acquiring audio and video data of the students in the virtual teaching process;
the first determining submodule is used for determining the behavior type of the student according to the audio and video data and a behavior recognition model, and the behavior recognition model is used for recognizing the behavior type based on the audio and video data.
Optionally, the first obtaining module includes:
the first obtaining submodule is used for obtaining a behavior type corresponding relation, and the behavior type corresponding relation comprises a plurality of behavior types and a plurality of feedback behavior types which are matched with the behavior types one by one;
and the second determining submodule is used for determining a target feedback behavior type matched with the target behavior type according to the behavior type corresponding relation.
Optionally, the apparatus further comprises:
the second determination module is used for determining the knowledge mastering degree of the student on first teaching contents, wherein the first teaching contents are teaching contents before the current time and within a first time length from the current time;
the second obtaining module is used for obtaining second teaching contents, wherein the second teaching contents refer to teaching contents after the current time;
and the adjusting module is used for adjusting the second teaching content according to the knowledge mastering degree of the first teaching content by the student.
Optionally, the adjusting module includes:
the third determining submodule is used for determining contents to be reviewed according to the knowledge mastering degree of the students on the first teaching contents;
and the adding submodule is used for adding the audio and video data corresponding to the content to be reviewed into the audio and video data containing the second teaching content.
Optionally, the second determining module includes:
the fourth determining submodule is used for determining test contents according to the first teaching contents;
the display submodule is used for displaying the test content;
the second acquisition submodule is used for acquiring the answer information of the student based on the test content;
and the fifth determining submodule is used for determining the knowledge mastering degree of the student on the first teaching content according to the reply information.
On the other hand, an interactive device in virtual teaching is provided, and comprises a processor, a communication interface, a memory and a communication bus;
the processor, the communication interface and the memory complete mutual communication through the communication bus;
the memory is used for storing computer programs;
the processor is used for executing the program stored in the memory so as to realize the interaction method in the virtual teaching.
In another aspect, a computer readable storage medium is provided, having stored therein a computer program, which when executed by a processor, implements the steps of the virtual teaching method provided above.
The beneficial effects brought by the technical scheme provided by the embodiment of the application at least comprise:
in the embodiment of the application, the behavior type of the student is determined, and if the behavior type of the student is the target behavior type, the type of the target feedback behavior matched with the target behavior type is obtained. And displaying the animation corresponding to the target feedback behavior type, wherein the animation comprises the feedback behavior of the virtual teacher aiming at the behavior of the student. That is, in this application embodiment, the virtual teacher can make feedback in time according to the behavior of the student, so the interaction link between the student and the teacher is increased in the virtual teaching process, thereby the learning interest of the student is greatly increased, and the user viscosity of the virtual teaching mode provided by this application embodiment is correspondingly improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is an architecture diagram of an interactive system for virtual education according to an embodiment of the present application.
Fig. 2 is a flowchart of an interaction method for virtual education provided in an embodiment of the present application.
Fig. 3 is an interface schematic diagram of virtual teaching provided in an embodiment of the present application.
Fig. 4 is an interface schematic diagram of virtual teaching provided in an embodiment of the present application.
Fig. 5 is an interface schematic diagram of virtual teaching provided in an embodiment of the present application.
Fig. 6 is a flowchart of an interaction method for virtual education provided in an embodiment of the present application.
Fig. 7 is an interface schematic diagram of virtual teaching provided in an embodiment of the present application.
Fig. 8 is an interface schematic diagram of virtual teaching provided in an embodiment of the present application.
Fig. 9 is a schematic structural diagram of an interaction device for virtual teaching according to an embodiment of the present application.
Fig. 10 is a schematic structural diagram of a server according to an embodiment of the present application.
Detailed Description
To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
Before explaining the embodiments of the present application in detail, an application scenario related to the embodiments of the present application will be described.
Traditional on-line live broadcast teaching needs schedule the teaching time according to mr's time, and when mr's time is inconvenient, for example mr is sick, and can't implement the teaching, then can delay normal teaching progress, and student self can't arrange the time of getting into class according to self hobby. Therefore, as artificial intelligence is applied to the teaching field, the adoption of virtual teachers to implement teaching has slowly become a new trend of future development of the teaching field. The interaction method in the virtual teaching provided by the embodiment of the application can be applied to the teaching scene through the virtual teacher.
Next, a system architecture related to the interaction method in virtual teaching provided in the embodiment of the present application is described.
Fig. 1 is an architecture diagram of an interactive system for virtual education according to an embodiment of the present application. As shown in figure 1 of the drawings, in which,
the system 100 includes a terminal 101 and a server 102. The terminal 101 and the server 102 are connected by wireless or wired connection to communicate with each other.
The terminal 101 may be deployed with a camera, the terminal 101 may collect audio and video data of a student in a class based on the deployed camera and send the audio and video data to the server 102, and the server 102 may determine a behavior type of the student according to the audio and video data and determine a feedback behavior type according to the behavior type, so as to implement that a virtual teacher takes the determined behavior as a feedback behavior. In addition, the server 102 may also adjust the teaching content according to the knowledge mastery degree of the student, so as to enable the virtual teacher to teach according to the adjusted teaching content.
That is, through the interaction method in the virtual teaching provided by the embodiment of the application, the behavior types of the students intelligently identified by the virtual teacher can be simulated, and the corresponding feedback behaviors are executed according to the behavior types of the students. For example, the feedback behavior may be the appearance of a more beautiful teacher in order to reward students or a more ugly teacher in order to punish students. In addition, through the interaction method in the virtual teaching provided by the embodiment of the application, the degree of knowledge mastery of a student by a virtual teacher can be simulated to be tested, and a corresponding feedback behavior is executed like a real teacher according to a test result, wherein the feedback behavior can be that review content is added and is used for reviewing or repeatedly teaching knowledge points which are not mastered by the student. The feedback behaviors can increase the interaction between the virtual teacher and the student, and avoid the lack of interaction between the virtual teacher and the student to reduce the learning interest of the student.
A specific implementation manner of the server executing the interaction method in the virtual teaching provided by the embodiment of the present application will be described in detail in the following embodiments, and a description thereof is not necessarily provided herein.
In addition, in this embodiment of the present application, the terminal 101 may be a device such as a tablet computer, a desktop computer, a mobile phone, and the like, and the server 102 may be a server or a server cluster that is used in this embodiment to determine a display manner of a virtual teacher so as to enable the virtual teacher to perform some feedback behaviors, which is not limited in this embodiment of the present application.
It should be noted that, the above description is given by taking an example where the server executes the interaction method in the virtual teaching provided in the embodiment of the present application. Optionally, the interaction method in the virtual teaching provided in the embodiment of the present application may also be applied to a terminal, and this is not specifically limited in the embodiment of the present application.
The following explains the interaction method in virtual education provided in the embodiment of the present application in detail. The following embodiments take an example in which a server executes an interaction method in virtual teaching provided in the embodiments of the present application.
Fig. 2 is a flowchart of a virtual education method provided in an embodiment of the present application, and is applied to a server. Referring to fig. 2, the method includes the following steps.
Step 201: the server determines the behavior type of the student, and the behavior type is used for indicating the behavior of the student in the virtual teaching process.
Wherein the behavior type of the student is used for indicating the student's behavior in class, for example, the behavior in class may include sleeping in class, shaking head and shaking brain in class, eating things in class, listening to speech seriously in class, answering questions positively in class, etc. The embodiment of the application does not limit the specific types of the lesson taking behaviors, and when the interaction method in the virtual teaching is applied, the server can set various types of lesson taking behaviors according to the requirements.
In a possible implementation manner, the possible implementation procedures of step 201 are: collecting audio and video data of students in a virtual teaching process; and determining the behavior type of the student according to the audio and video data and the behavior recognition model. The behavior recognition model is used for recognizing the type of the trip based on the audio and video data. That is, in the embodiment of the present application, the behavior type of the student may be determined by means of AI (Artificial Intelligence) recognition.
It should be noted that the behavior recognition model may be a trained model directly obtained from a database, or may be a model temporarily trained by a server.
The implementation manner of the behavior recognition model obtained by training may be: the method comprises the steps of obtaining a plurality of sample audio and video data and a label of each sample audio and video data in the plurality of sample audio and video data, wherein the label of each sample audio and video data is used for indicating the behavior type of the behavior of a student indicated in the sample audio and video data. The plurality of sample audio-video data are input into an initialized neural network model. And if the output behavior type of the initialized neural network model is inconsistent with the behavior type indicated in the label of each sample audio-video data, adjusting parameters in the initialized neural network model. And repeating the operation until the behavior type output by the adjusted neural network model is consistent with the behavior type indicated in the label of each sample audio/video data, and calling the neural network model with the parameters adjusted for the last time as a behavior recognition model.
The behavior recognition model provided in the embodiments of the present application is described above by taking a neural network model as an example, and it should be noted that the behavior recognition model is not limited to the neural network model, and may be other types of learning models.
Step 202: and if the behavior type of the student is the target behavior type, the server acquires the target feedback behavior type matched with the target behavior type, wherein the target feedback behavior type is used for indicating the behavior responding to the behavior of the student.
In the embodiment of the application, the virtual teacher can only feed back a part of behavior types of the students so as to relieve the pressure of the server on processing data. For example, when the current behavior type of the student is a significant negative behavior type or a positive behavior type, the virtual teacher needs to give feedback on the behavior types. Therefore, it is necessary to first determine whether the behavior type of the student is the target behavior type. Wherein the target behavior type refers to a behavior that requires a virtual teacher as feedback.
In one possible implementation manner, the possible implementation process of determining whether the behavior type of the student is the target behavior type is as follows: setting a plurality of behavior types, and setting feedback behavior types matched with the behavior types one by one. And traversing the plurality of behavior types, and determining the behavior type as a target behavior type when the behavior type of the current student is judged to be one of the plurality of behavior types. Accordingly, when it is determined that the current behavior type of the student is not one of the plurality of behavior types, there is no need to feed back the behavior of the student through the virtual teacher.
When the server determines that the behavior type of the student is the target behavior type, a target feedback behavior type matching the target behavior type needs to be obtained, so as to implement the feedback of the virtual teacher to the behavior of the student through the following step 203. The implementation manner of obtaining the target feedback behavior type matched with the target behavior type may be: acquiring a behavior type corresponding relation, wherein the behavior type corresponding relation comprises a plurality of behavior types and a plurality of feedback behavior types which are matched with the behavior types one by one; and determining a target feedback behavior type matched with the target behavior type according to the behavior type corresponding relation.
Table 1 shows a corresponding relationship between a behavior type and a feedback behavior type provided in the embodiments of the present application. As shown in Table 1, the behavior types include behavior type 1, behavior type 2, and behavior type N. Wherein, the behavior indicated by the behavior type 1 goes to sleep in class, the feedback behavior type of the virtual teacher matched with the behavior type 1 is the feedback behavior type 1, and the behavior indicated by the feedback behavior type 1 is the expression of frowning. The behavior indicated by the behavior type 2 is shaking the head in class, the feedback behavior type of the virtual teacher matched with the behavior type 2 is the feedback behavior type 2, and the behavior indicated by the feedback behavior type 2 is the expression of making angry. The behavior indicated by the behavior type 3 is listened to in class, the feedback behavior type of the virtual teacher matched with the behavior type 3 is the feedback behavior type 3, and the behavior indicated by the feedback behavior type 3 is a changeable image.
TABLE 1
Figure BDA0002315763270000081
Step 203: and the terminal displays the animation corresponding to the target feedback behavior type, wherein the animation comprises the feedback behavior of the virtual teacher aiming at the behavior of the student.
Since the feedback behavior of the virtual teacher to the behavior of the student is included in the animation, the behavior of the virtual teacher to the student can be implemented as the feedback behavior through step 203.
For example, based on table 1, as shown in fig. 3, when the behavior type of the student is shaking the head in class, the behavior indicated by the feedback behavior type of the virtual teacher is an angry expression, and thus, the animation corresponding to the current virtual teacher includes an angry expression. In fig. 3, the related introduction of the word "name" displayed in the right block diagram of the virtual teacher is used to indicate the current teaching content.
As shown in fig. 4, when the behavior type of the student is to take a class to listen to the talk seriously, the feedback behavior type of the virtual teacher is to change the lovely character. Thus, the animation to which the virtual teacher currently corresponds includes the appearance of a machine cat that is changed to be lovely. The associated introduction of the word "name" shown in the block diagram to the right of the virtual teacher in FIG. 4 is also used to indicate the current tutorial.
In addition, the behavior of the virtual teacher to the student as the feedback behavior may include sound in addition to the motion, and thus, the server may also play the voice corresponding to the animation in synchronization after acquiring the target feedback behavior type matching the target behavior type.
For example, as shown in fig. 5, the virtual teacher intelligently recognizes that the behavior types of the current student are: when shaking the head and shaking the brain on class, virtual mr makes the expression of engendering qi to synchronous broadcast pronunciation are reminded: please listen to the talk seriously in class. The associated introduction of the word "watch" shown in the block diagram to the right of the virtual teacher in FIG. 5 is used to indicate the current tutorial.
In the embodiment of the application, the behavior type of a student is determined; if the behavior type of the student is the target behavior type, acquiring the type of the target feedback behavior matched with the target behavior type; and displaying the animation corresponding to the target feedback behavior type, wherein the animation comprises the feedback behavior of the virtual teacher aiming at the behavior of the student. That is, in this application embodiment, the virtual teacher can make feedback in time according to the behavior of the student, so the interaction link between the student and the teacher is increased in the virtual teaching process, thereby the learning interest of the student is greatly increased, and the user viscosity of the virtual teaching mode provided by this application embodiment is correspondingly improved.
Through the embodiment, the feedback of the virtual teacher to the behavior type of the student can be simulated through AI identification. In addition, the server may simulate the feedback of the knowledge mastery degree of the student by the virtual teacher through the following embodiments.
Fig. 6 is a flowchart of another interaction method in virtual education according to the embodiment of the present application. As shown in fig. 6, the method includes the following steps:
step 601: the server determines the knowledge mastery degree of the student on first teaching content, wherein the first teaching content is teaching content before the current time and within a first time length from the current time.
In this application embodiment, in order to realize that virtual mr can in time adjust teaching content according to student's knowledge mastery degree, the server can confirm the student to the mastery degree of teaching content in this period of time after imparting knowledge to students through virtual mr for a period of time, promptly, the server confirms the knowledge mastery degree of student to first teaching content. The first teaching content refers to teaching content before the current time and within a first time length from the current time.
In one possible implementation manner, the possible implementation procedures of step 601 are: determining test content according to the first teaching content; displaying the test content; acquiring the response information of the student based on the test content; and determining the knowledge mastery degree of the student on the first teaching content according to the response information.
The first time length may be a time length of a lesson, and the time length of the lesson may be preset by the server or may be set manually.
For example, the duration of the class may be 40 minutes. The server determines a test content according to the teaching content 40 minutes before the current time, namely the teaching content of the previous lesson, wherein the test content can be '30 words included in the teaching content of the previous lesson are identified', namely the test content comprises the 30 words and prompt information aiming at the 30 words, and the prompt information is used for prompting the student to identify the 30 words. The server pushes the test content to the user side corresponding to the student, and the user side displays the test content, so that the user side can collect the reply information of the student and return the reply information of the student to the server.
As shown in fig. 7, the test content displayed on the current client display interface is the word card "watch", and meanwhile, the virtual teacher sends out a prompt voice: please read the word with the same students. And the terminal starts to collect the audio and video after the teacher sends out the prompt voice, and finishes recording after 5s, and stores the collected audio and video. The collected audio and video information is response information, the stored audio and video is compared with the correct pronunciation of the watch in the background database, and the mastering degree of the student on the word is determined according to the comparison result. The testing process for the other remaining 29 words can refer to the testing process for the word 'watch', and is not described in detail here. And after the 30 words are tested, determining a test score according to the test condition of the 30 words, and displaying the test score. The test score may represent a degree of knowledge mastery of the first instructional content by the student.
Step 602: the server acquires second teaching content, wherein the second teaching content refers to teaching content after the current time.
After determining the knowledge mastering degree of the student for the teaching content within a certain period of time through step 601, the server may adjust the teaching content to be performed next, so that the student can skillfully master the already-taught content, and therefore, the server needs to acquire the teaching content to be performed next, that is, the second teaching content.
In one possible implementation manner, the possible implementation procedures of step 602 are: acquiring a plurality of teaching segments and a teaching sequence number of each teaching segment in the plurality of teaching segments, determining one or more education sequence numbers which are adjacent to the teaching sequence number of the teaching segment corresponding to the first teaching content and are behind the teaching sequence number of the teaching segment corresponding to the first teaching content according to the teaching sequence number of the teaching segment corresponding to the first teaching content in the step 601, and taking the teaching segment corresponding to the determined one or more education sequence numbers as a second teaching content.
For example, the server obtains a plurality of teaching fragments and a teaching sequence number of each teaching fragment in the plurality of teaching fragments, and assumes that the server obtains 5 teaching fragments, which are teaching fragment 1, teaching fragment 2, teaching fragment 3, teaching fragment 4, and teaching fragment 5. The teaching sequence number corresponding to the teaching fragment 1 is 001; the teaching sequence number corresponding to the teaching segment 2 is 002; the teaching sequence number corresponding to the teaching fragment 3 is 003, and the teaching sequence number corresponding to the teaching fragment 4 is 004; the teaching sequence number corresponding to the teaching fragment 5 is 005. If the first teaching content in the step (1) is teaching segment 1 and the corresponding teaching sequence number is 001, obtaining teaching segment 2 with the teaching sequence number of 002, wherein the teaching segment 2 is the second teaching content.
Step 603: the server adjusts the second teaching content according to the knowledge mastery degree of the student on the first teaching content.
In a possible implementation manner, the possible implementation procedures of step 603 are: determining the content to be reviewed according to the knowledge mastery degree of the student on the first teaching content; and adding the audio and video data corresponding to the content to be reviewed into the audio and video data containing the second teaching content.
After the audio and video data corresponding to the content to be reviewed is added to the audio and video data containing the second teaching content, the server can set a "teaching review" link in the teaching process, wherein the "teaching review" link is used for prompting the students to review the content to be reviewed. For example, the server may use a plurality of words included in a word card that is read by the student in the test content as the content to be reviewed, then present the content to be reviewed to the student based on the display interface, and the virtual teacher brings the plurality of words to the student for follow-up reading, so as to achieve review of the plurality of words by the student. As shown in fig. 8, the words in the test content that the student answered in error are: { Watch, egg, water, fly, sky, picture, have }, and displays the words on a display interface, and prompts the student to review the words through a virtual teacher. For example, the virtual teacher may be controlled to play the prompt message "please review the words".
For another example, the virtual teacher determines the test content included in the test content according to the teaching content in a month before the current time, where the test content may be a "teaching review test", and the "teaching review test" may be words that the students in the month wrongly read in all the test content, and performs a test again in the form of the "teaching review test", or may be a method of extracting a part of knowledge points in the word teaching content in a month before the current time, determining words included in the test content according to the knowledge points, and performing a test in the form of the "teaching review test". The server refers to the process of obtaining the test result in the above embodiment, and adjusts the teaching content included in the teaching outline according to the test result, for example, when the test result of the student is high, the "review of teaching" link included in each lesson may be deleted.
In the embodiment of the application, the server determines the knowledge mastery degree of the student on the first teaching content, acquires the second teaching content, and adjusts the second teaching content according to the knowledge mastery degree of the student on the first teaching content. In this application embodiment, because virtual mr can adjust the second teaching content according to the student to the knowledge mastery degree of first teaching content, consequently virtual teaching process can be more close real man mr's teaching process. That is, the virtual teacher can timely make feedback according to the knowledge mastering degree of the student, so that the interaction link between the student and the teacher is increased in the virtual teaching process, the learning interest of the student is greatly increased, and the user viscosity of the virtual teaching mode provided by the embodiment of the application is correspondingly improved. In addition, the teaching content can be adjusted in time according to the knowledge mastering conditions of students, and the teaching quality can be improved. All the above optional technical solutions can be combined arbitrarily to form an optional embodiment of the present application, and the present application embodiment is not described in detail again.
Fig. 9 is a schematic structural diagram of an interaction apparatus in virtual teaching according to an embodiment of the present application, where the interaction apparatus in virtual teaching can be implemented by software, hardware, or a combination of the two. The interactive device in the virtual teaching can comprise:
a first determining module 901, configured to determine a behavior type of a student, where the behavior type is used to indicate a behavior of the student in a virtual teaching process;
a first obtaining module 902, configured to obtain a target feedback behavior type that matches the target behavior type if the behavior type of the student is the target behavior type, where the target feedback behavior type is used to indicate a behavior that responds to the behavior of the student;
and a display module 903, configured to display an animation corresponding to the target feedback behavior type, where the animation includes a feedback behavior made by a virtual teacher for a behavior of the student.
Optionally, the apparatus further comprises:
and the playing module is used for synchronously playing the voice corresponding to the animation.
Optionally, the first determining module includes:
the acquisition submodule is used for acquiring audio and video data of the student in the virtual teaching process;
the first determining submodule is used for determining the behavior type of the student according to the audio and video data and a behavior recognition model, and the behavior recognition model is used for recognizing the behavior type based on the audio and video data.
Optionally, the first obtaining module includes:
the first obtaining submodule is used for obtaining a behavior type corresponding relation, and the behavior type corresponding relation comprises a plurality of behavior types and a plurality of feedback behavior types which are matched with the behavior types one by one;
and the second determining submodule is used for determining the target feedback behavior type matched with the target behavior type according to the behavior type corresponding relation.
Optionally, the apparatus further comprises:
the second determining module is used for determining the knowledge mastering degree of the student on first teaching content, wherein the first teaching content is teaching content before the current time and within a first time length from the current time;
the second acquisition module is used for acquiring second teaching contents, wherein the second teaching contents refer to teaching contents after the current time;
and the adjusting module is used for adjusting the second teaching content according to the knowledge mastering degree of the student on the first teaching content.
Optionally, the adjusting module includes:
the third determining submodule is used for determining the content to be reviewed according to the knowledge mastering degree of the student on the first teaching content;
and the adding submodule is used for adding the audio and video data corresponding to the content to be reviewed into the audio and video data containing the second teaching content.
Optionally, the second determining module includes:
the fourth determining submodule is used for determining the test content according to the first teaching content;
the display submodule is used for displaying the test content;
the second acquisition submodule is used for acquiring the reply information of the student based on the test content;
and the fifth determining submodule is used for determining the knowledge mastering degree of the student on the first teaching content according to the reply information.
In the embodiment of the application, the behavior type of a student is determined; if the behavior type of the student is the target behavior type, acquiring the type of the target feedback behavior matched with the target behavior type; and displaying the animation corresponding to the target feedback behavior type, wherein the animation comprises the feedback behavior of the virtual teacher aiming at the behavior of the student. That is, in this application embodiment, the virtual teacher can make feedback in time according to the behavior of the student, so the interaction link between the student and the teacher is increased in the virtual teaching process, thereby the learning interest of the student is greatly increased, and the user viscosity of the virtual teaching mode provided by this application embodiment is correspondingly improved.
It should be noted that: in the virtual teaching, when the interaction device provided in the above embodiment performs interaction in the virtual teaching, only the division of the above functional modules is used for illustration, and in practical applications, the function distribution can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the above described functions. In addition, the interaction device in virtual teaching provided by the above embodiments and the interaction method embodiment in virtual teaching belong to the same concept, and specific implementation processes thereof are described in detail in the method embodiments and are not described herein again.
Fig. 10 is a schematic structural diagram of a server according to an embodiment of the present application. The server may be a server in a cluster of background servers. The server in fig. 1 may be implemented by the server shown in fig. 10. Specifically, the method comprises the following steps:
the server 1000 includes a Central Processing Unit (CPU)1001, a system memory 1004 including a Random Access Memory (RAM)1002 and a Read Only Memory (ROM)1003, and a system bus 1005 connecting the system memory 1004 and the central processing unit 1001. The server 1000 also includes a basic input/output system (I/O system) 1006, which facilitates the transfer of information between devices within the computer, and a mass storage device 1007, which stores an operating system 1013, application programs 1014, and other program modules 1015.
The basic input/output system 1006 includes a display 1008 for displaying information and an input device 1009, such as a mouse, keyboard, etc., for user input of information. Wherein a display 1008 and an input device 1009 are connected to the central processing unit 1001 via an input-output controller 1010 connected to the system bus 1005. The basic input/output system 1006 may also include an input/output controller 1010 for receiving and processing input from a number of other devices, such as a keyboard, mouse, or electronic stylus. Similarly, the input-output controller 1010 also provides output to a display screen, a printer, or other type of output device.
The mass storage device 1007 is connected to the central processing unit 1001 through a mass storage controller (not shown) connected to the system bus 1005. The mass storage device 1007 and its associated computer-readable media provide non-volatile storage for the server 1000. That is, the mass storage device 1007 may include a computer-readable medium (not shown) such as a hard disk or CD-ROM drive.
Without loss of generality, computer readable media may comprise computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes RAM, ROM, EPROM, EEPROM, flash memory or other solid state memory technology, CD-ROM, DVD, or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices. Of course, those skilled in the art will appreciate that computer storage media is not limited to the foregoing. The system memory 1004 and mass storage device 1007 described above may be collectively referred to as memory.
According to various embodiments of the present application, the server 1000 may also operate as a remote computer connected to a network through a network, such as the Internet. That is, the server 1000 may be connected to the network 1012 through a network interface unit 1011 connected to the system bus 1005, or the network interface unit 1011 may be used to connect to another type of network or a remote computer system (not shown).
The memory further includes one or more programs, and the one or more programs are stored in the memory and configured to be executed by the CPU.
The embodiment of the present application further provides a non-transitory computer-readable storage medium, and when instructions in the storage medium are executed by a processor of a server, the server is enabled to execute the interaction method in virtual teaching provided by the above embodiment.
The embodiment of the present application further provides a computer program product containing instructions, which when run on a server, causes the server to execute the interaction method in virtual education provided by the above embodiment.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (10)

1. An interaction method in virtual teaching, the method comprising:
determining the behavior type of the student, wherein the behavior type is used for indicating the behavior of the student in the virtual teaching process;
if the behavior type of the student is a target behavior type, acquiring a target feedback behavior type matched with the target behavior type, wherein the target feedback behavior type is used for indicating a behavior responding to the behavior of the student;
and displaying an animation corresponding to the target feedback behavior type, wherein the animation comprises a feedback behavior made by a virtual teacher aiming at the behavior of the student.
2. The method of claim 1, wherein after obtaining a target feedback behavior type that matches the target behavior type, further comprising:
and synchronously playing the voice corresponding to the animation.
3. The method of claim 1, wherein the determining the type of behavior of the student comprises:
collecting audio and video data of the students in the virtual teaching process;
and determining the behavior type of the student according to the audio and video data and a behavior recognition model, wherein the behavior recognition model is used for recognizing the behavior type based on the audio and video data.
4. The method of claim 1, wherein the obtaining a target feedback behavior type that matches the target behavior type comprises:
acquiring a behavior type corresponding relation, wherein the behavior type corresponding relation comprises a plurality of behavior types and a plurality of feedback behavior types which are matched with the behavior types one by one;
and determining a target feedback behavior type matched with the target behavior type according to the behavior type corresponding relation.
5. The method of any of claims 1 to 4, further comprising:
determining the knowledge mastering degree of the student on first teaching content, wherein the first teaching content is teaching content before the current time and within a first time length from the current time;
acquiring second teaching content, wherein the second teaching content refers to teaching content after the current time;
and adjusting the second teaching content according to the knowledge mastering degree of the student on the first teaching content.
6. The method of claim 5, wherein said adjusting said second instructional content based on said student's knowledge of said first instructional content comprises:
determining contents to be reviewed according to the knowledge mastery degree of the students on the first teaching contents;
and adding the audio and video data corresponding to the content to be reviewed into the audio and video data containing the second teaching content.
7. The method of claim 5, wherein said determining a level of knowledge mastery of the first instructional content by the student comprises:
determining test content according to the first teaching content;
displaying the test content;
acquiring the answer information of the student based on the test content;
and determining the knowledge mastery degree of the student on the first teaching content according to the reply information.
8. An interactive device in virtual teaching, the device comprising:
the first determining module is used for determining the behavior type of the student, and the behavior type is used for indicating the behavior of the student in the virtual teaching process;
a first obtaining module, configured to obtain a target feedback behavior type that is matched with a target behavior type if the behavior type of the student is the target behavior type, where the target feedback behavior type is used to indicate a behavior that responds to the behavior of the student;
and the display module is used for displaying the animation corresponding to the target feedback behavior type, wherein the animation comprises the feedback behavior of the virtual teacher aiming at the behavior of the student.
9. An interactive device in virtual teaching, the device comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to perform the steps of the method of any of the above claims 1 to 7.
10. A computer-readable storage medium having stored thereon instructions which, when executed by a processor, carry out the steps of the method of any of claims 1 to 7.
CN201911276742.6A 2019-12-12 2019-12-12 Interaction method and device in virtual teaching and computer storage medium Pending CN110827595A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911276742.6A CN110827595A (en) 2019-12-12 2019-12-12 Interaction method and device in virtual teaching and computer storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911276742.6A CN110827595A (en) 2019-12-12 2019-12-12 Interaction method and device in virtual teaching and computer storage medium

Publications (1)

Publication Number Publication Date
CN110827595A true CN110827595A (en) 2020-02-21

Family

ID=69545152

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911276742.6A Pending CN110827595A (en) 2019-12-12 2019-12-12 Interaction method and device in virtual teaching and computer storage medium

Country Status (1)

Country Link
CN (1) CN110827595A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111796846A (en) * 2020-07-06 2020-10-20 成都艾乐橙文化传播有限公司 Information updating method and device, terminal equipment and readable storage medium
CN112071138A (en) * 2020-09-05 2020-12-11 胡振刚 Companion processing method and device, and electronic device
CN112070865A (en) * 2020-08-25 2020-12-11 北京大米科技有限公司 Classroom interaction method and device, storage medium and electronic equipment
CN112908066A (en) * 2021-03-04 2021-06-04 深圳技术大学 Online teaching implementation method and device based on sight tracking and storage medium

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5174759A (en) * 1988-08-04 1992-12-29 Preston Frank S TV animation interactively controlled by the viewer through input above a book page
WO2000004478A2 (en) * 1998-07-17 2000-01-27 The Franklin Institute A system containing a multi-user virtual learning environment
CN102945624A (en) * 2012-11-14 2013-02-27 南京航空航天大学 Intelligent video teaching system based on cloud calculation model and expression information feedback
CN106023693A (en) * 2016-05-25 2016-10-12 北京九天翱翔科技有限公司 Education system and method based on virtual reality technology and pattern recognition technology
CN108073888A (en) * 2017-08-07 2018-05-25 中国科学院深圳先进技术研究院 A kind of teaching auxiliary and the teaching auxiliary system using this method
CN109147440A (en) * 2018-09-18 2019-01-04 周文 A kind of interactive education system and method
CN109377802A (en) * 2018-11-26 2019-02-22 暗物质(香港)智能科技有限公司 A kind of automatic and interactive intellectual education system and method
CN109448467A (en) * 2018-11-01 2019-03-08 深圳市木愚科技有限公司 A kind of virtual image teacher teaching program request interaction systems
CN110175534A (en) * 2019-05-08 2019-08-27 长春师范大学 Teaching assisting system based on multitask concatenated convolutional neural network
CN110414415A (en) * 2019-07-24 2019-11-05 北京理工大学 Human bodys' response method towards classroom scene

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5174759A (en) * 1988-08-04 1992-12-29 Preston Frank S TV animation interactively controlled by the viewer through input above a book page
WO2000004478A2 (en) * 1998-07-17 2000-01-27 The Franklin Institute A system containing a multi-user virtual learning environment
CN102945624A (en) * 2012-11-14 2013-02-27 南京航空航天大学 Intelligent video teaching system based on cloud calculation model and expression information feedback
CN106023693A (en) * 2016-05-25 2016-10-12 北京九天翱翔科技有限公司 Education system and method based on virtual reality technology and pattern recognition technology
CN108073888A (en) * 2017-08-07 2018-05-25 中国科学院深圳先进技术研究院 A kind of teaching auxiliary and the teaching auxiliary system using this method
CN109147440A (en) * 2018-09-18 2019-01-04 周文 A kind of interactive education system and method
CN109448467A (en) * 2018-11-01 2019-03-08 深圳市木愚科技有限公司 A kind of virtual image teacher teaching program request interaction systems
CN109377802A (en) * 2018-11-26 2019-02-22 暗物质(香港)智能科技有限公司 A kind of automatic and interactive intellectual education system and method
CN110175534A (en) * 2019-05-08 2019-08-27 长春师范大学 Teaching assisting system based on multitask concatenated convolutional neural network
CN110414415A (en) * 2019-07-24 2019-11-05 北京理工大学 Human bodys' response method towards classroom scene

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111796846A (en) * 2020-07-06 2020-10-20 成都艾乐橙文化传播有限公司 Information updating method and device, terminal equipment and readable storage medium
CN111796846B (en) * 2020-07-06 2023-12-12 广州一起精彩艺术教育科技有限公司 Information updating method, device, terminal equipment and readable storage medium
CN112070865A (en) * 2020-08-25 2020-12-11 北京大米科技有限公司 Classroom interaction method and device, storage medium and electronic equipment
CN112071138A (en) * 2020-09-05 2020-12-11 胡振刚 Companion processing method and device, and electronic device
CN112908066A (en) * 2021-03-04 2021-06-04 深圳技术大学 Online teaching implementation method and device based on sight tracking and storage medium

Similar Documents

Publication Publication Date Title
US11151892B2 (en) Internet teaching platform-based following teaching system
CN110827595A (en) Interaction method and device in virtual teaching and computer storage medium
CN107633719B (en) Anthropomorphic image artificial intelligence teaching system and method based on multi-language human-computer interaction
WO2019095446A1 (en) Following teaching system having speech evaluation function
CN109801194A (en) It is a kind of to follow teaching method with remote evaluation function
CN109189535B (en) Teaching method and device
JP6606750B2 (en) E-learning system
US20210150924A1 (en) Interactive situational teaching system for use in K12 stage
CN109035079B (en) Recorded broadcast course follow-up learning system and method based on Internet
US20180144651A1 (en) Teaching method using pupil's own likeness as a virtual teacher
CN103761894A (en) Interaction classroom implementing method and interactive platform
CN110767006A (en) Situational English learning system
WO2019075825A1 (en) Internet teaching platform-based accompanying teaching method and system
CN112887790A (en) Method for fast interacting and playing video
CN114429412A (en) Digital teaching content production system for vocational education
JP2013539075A (en) Educational system combining live teaching and automatic teaching
CN110046290B (en) Personalized autonomous teaching course system
CN109040797B (en) Internet teaching recording and broadcasting system and method
US9547995B1 (en) Dynamic instructional course
US20230368690A1 (en) Mobile application for generating and viewing video clips in different languages
CN113963306B (en) Courseware title making method and device based on artificial intelligence
CN112712738B (en) Student display processing method and device and electronic device
JP3930402B2 (en) ONLINE EDUCATION SYSTEM, INFORMATION PROCESSING DEVICE, INFORMATION PROVIDING METHOD, AND PROGRAM
CN115965251A (en) Teaching evaluation method, teaching evaluation device, storage medium, and server
CN111081101A (en) Interactive recording and broadcasting system, method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20210901

Address after: 511442 23 floors of B-1 Building, Wanda Commercial Square North District, Wanbo Business District, 79 Wanbo Second Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province (office use only)

Applicant after: Guangzhou gathered era Mdt InfoTech Ltd.

Address before: 510000 2803, floor 28, building B-1, North District, Wanda Commercial Plaza, Wanbo business district, No. 79, Wanbo Second Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province

Applicant before: Guangzhou Sanxing Yibai Education Technology Co.,Ltd.