CN112257457A

CN112257457A - Student classroom performance evaluation method and device and electronic equipment

Info

Publication number: CN112257457A
Application number: CN202011167453.5A
Authority: CN
Inventors: 胡训安
Original assignee: Shanghai Hannto Technology Inc
Current assignee: Shanghai Hannto Technology Inc
Priority date: 2020-10-27
Filing date: 2020-10-27
Publication date: 2021-01-22
Anticipated expiration: 2040-10-27
Also published as: CN112257457B

Abstract

The application provides an evaluation method and device for classroom performance of a student and electronic equipment. The evaluation method for classroom performance of trainees provided by the application comprises the following steps: receiving audio data collected by the audio collecting equipment; when an analysis instruction is received, voice recognition is carried out on the audio data to obtain speaking texts of teachers and students in a classroom; for each student, the classroom performance of the student is evaluated based on the teacher speech text and the student speech text of the student. The method and the device for evaluating the classroom performance of the student and the electronic equipment can evaluate the classroom performance of the student and meet the requirements of users.

Description

Student classroom performance evaluation method and device and electronic equipment

Technical Field

The application relates to the field of intelligent teaching, in particular to a method and a device for evaluating classroom performance of a student and electronic equipment.

Background

In some scenarios, the classroom performance of the trainee needs to be known. For example, parents or teachers need to know the classroom performance of children in order to improve the efficiency of post-lesson coaching or to improve the quality of teaching; for another example, in order to determine the end-of-term performance of a student, the teacher needs to know the regular lesson performance of the student and determine the end-of-term performance based on the regular lesson performance and the end-of-term examination book performance of the student. Therefore, it is highly desirable to provide an evaluation method for classroom performance of trainees.

Disclosure of Invention

In view of this, the application provides a method and a device for evaluating classroom performance of a student, and an electronic device, so as to meet user requirements.

The application provides an evaluation method of student classroom performance in a first aspect, the method is applied to electronic equipment, the electronic equipment is connected with a plurality of audio acquisition devices, the audio acquisition devices are used for acquiring audio data sent by corresponding acquisition objects, the acquisition objects comprise teachers and students, and the method comprises the following steps:

receiving audio data collected by the audio collecting equipment;

when an analysis instruction is received, voice recognition is carried out on the audio data to obtain speaking texts of teachers and students in a classroom;

for each student, the classroom performance of the student is evaluated based on the teacher speech text and the student speech text of the student.

The second aspect of the application provides an evaluation device for classroom performance of trainees, which is applied to an electronic device, wherein the electronic device is connected with a plurality of audio acquisition devices, the audio acquisition devices are used for acquiring audio data sent by corresponding acquisition objects, the acquisition objects comprise teachers and trainees, the device comprises a receiving module, an identification module and a processing module, wherein,

the receiving module is used for receiving the audio data acquired by the audio acquisition equipment;

the recognition module is used for carrying out voice recognition on the audio data when an analysis instruction is received to obtain speaking texts of teachers and students in a classroom;

and the processing module is used for evaluating the classroom performance of each student based on the teacher speaking text and the student speaking text of the student.

A third aspect of the present application provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements any of the student classroom performance assessment methods provided herein.

A fourth aspect of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the program to implement the method for evaluating classroom performance of any student provided by the present application.

The student classroom performance evaluation method, the student classroom performance evaluation device and the electronic equipment are characterized in that audio data collected by audio collecting equipment are received, and then when an analysis instruction is received, voice recognition is carried out on the audio data to obtain the speaking texts of a teacher and students in a classroom, so that classroom performance of each student is evaluated based on the speaking texts of the teacher and the speaking texts of the students. Therefore, the classroom performance of the student can be evaluated, and the user requirements can be met.

Drawings

FIG. 1 is a flow chart of a first embodiment of student classroom performance provided by the present application;

FIG. 2 is a flowchart of a second example of classroom performance of a student provided by the present application;

fig. 3 is a flowchart illustrating a process of determining the current speaking performance of the trainee according to an exemplary embodiment;

fig. 4 is a flowchart of a third embodiment of the evaluation method for classroom performance of a student according to the present application;

fig. 5 is a hardware configuration diagram of an electronic device in which an evaluation apparatus for classroom performance of a student is shown according to an exemplary embodiment of the present application;

fig. 6 is a schematic structural diagram of a first example of the evaluation apparatus for classroom performance of a student according to the present application.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present application. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.

The application provides an evaluation method and device for classroom performance of a student and electronic equipment, so that classroom performance of the student can be evaluated.

The method and the device for evaluating the classroom performance of the student are applied to electronic equipment, and the electronic equipment can be a printer.

Several specific embodiments are given below to describe the technical solutions of the present application in detail, and these specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.

Fig. 1 is a flowchart of a first embodiment of a method for evaluating classroom performance of a student according to the present application. Referring to fig. 1, the method provided in this embodiment is applied to an electronic device, where the electronic device is connected to a plurality of audio acquisition devices, the audio acquisition devices are configured to acquire audio data sent by corresponding acquisition objects, and the acquisition objects include teachers and trainees, and the method includes:

s101, receiving audio data collected by the audio collecting device.

And S102, when the analysis instruction is received, carrying out voice recognition on the audio data to obtain speaking texts of the teacher and the student in the classroom.

And S103, evaluating the classroom performance of each student based on the teacher speaking text and the student speaking text of the student.

Specifically, the electronic device may be connected to the audio capture device in a wired manner or a wireless manner (e.g., in a WIFI manner or a bluetooth manner). In addition, the capture objects (teachers and trainees) may wear the audio capture device on their body or fix the audio capture device on a platform or desk so that the audio capture device captures audio data it emits. For example, in one embodiment, the audio capture device may be a headset that may be worn by teachers and trainees to capture their emitted audio data via the headset.

It should be noted that, in an embodiment, the audio acquisition device may always acquire audio data during the course of the teacher giving lessons. For example, when a teacher goes lessons, the audio acquisition device is started and connected with the electronic device, and further the audio acquisition device acquires audio data of the teacher all the time and sends the audio data to the electronic device. In another embodiment, the audio acquisition device may not always acquire audio data during the course of the teacher giving lessons, but acquire audio data again when the teacher asks questions. For example, when a teacher asks a question, the teacher may turn on its own audio acquisition device to enable the audio acquisition device to acquire its audio data, and correspondingly, when a student answers a question posed by the teacher, turn on its own audio acquisition device to enable the audio acquisition device to acquire its audio data. In the present embodiment, the number of components is not limited.

Specifically, the analysis instruction is triggered by the teacher, for example, when a classroom is over, or after a question is over, the teacher may trigger the analysis instruction, so that the electronic device evaluates classroom performance of the student. In addition, the audio data can be recognized by adopting a related speech recognition algorithm to obtain the speaking text. For a specific implementation principle and implementation process of the speech recognition algorithm, reference may be made to the description in the related art, and details are not described herein. It should be noted that the teacher's speech text includes at least one speech text, and correspondingly, the speech text of each student also includes at least one speech text. In addition, the audio data carries a timestamp and the recognized utterance text carries an utterance time, which includes an utterance start time and an utterance end time.

Further, for each trainee, the classroom performance of the trainee can be evaluated based on the teacher speech text and the trainee speech text of the trainee. For example, in one embodiment, a standard student utterance text for the teacher utterance text may be determined based on the teacher utterance text (for example, the teacher utterance text includes at least one question posed by the teacher, an answer corresponding to each question posed by the teacher may be obtained based on the internet, and then the answers corresponding to each question are summarized to obtain the standard student utterance text), and then, for each student, a semantic similarity between the student utterance text of the student and the standard student utterance text is calculated, and then, the classroom performance of the student is evaluated based on the semantic similarity.

For example, in one embodiment, the teacher's spoken text contains a question "How are you? "the answer corresponding to the question is obtained as" I am fine ", at this time, the standard student speaking text is determined as" I am fine ", further, semantic similarity between the student speaking text of each student and the standard student speaking text can be calculated, and classroom performance of the student is evaluated based on the semantic similarity. For example, there are 3 trainees, and for the sake of distinction, these 3 trainees are respectively recorded as trainee 1, trainee 2, and trainee 3, and the trainees of these 3 trainees speak respectively as "I am happy", "Fine", and "I do not konw", and at this time, it can be determined that the classroom performance of trainee 1 is good, the classroom performance of trainee 2 is excellent, and the classroom performance of trainee 3 is poor.

According to the method provided by the embodiment, the audio data collected by the audio collecting device is obtained, and then when the analysis instruction is received, the audio data is subjected to voice recognition to obtain the speaking texts of the teacher and the trainees in the classroom, so that the classroom performance of each trainee is evaluated based on the speaking text of the teacher and the speaking text of the trainee. Therefore, the classroom performance of the student can be evaluated, and the user requirements can be met.

Fig. 2 is a flowchart of a second example of classroom performance of a student according to the present application. On the basis of the foregoing embodiment, the method provided by this embodiment, step S103, may include:

s201, aiming at each section of teacher speaking text, determining student speaking texts corresponding to the teacher speaking text according to speaking time.

Specifically, referring to the foregoing description, the audio data carries a timestamp, and when speech recognition is performed on the audio data to obtain a speech text, a speech time of the speech text can be obtained based on the timestamp carried by the audio data, that is, the speech text can carry a time axis, and a speech start time and a speech end time are marked on the time axis.

In this step, for each teacher's speech text, the student's speech text corresponding to the teacher's speech text may be determined based on the first speech start time and the first speech end time of the teacher's speech text and the second speech start time of the student's speech text. For example, in an embodiment, the student speaking text of which the time difference between the second speaking starting time and the second speaking ending time is smaller than the preset threshold may be determined as the student speaking text corresponding to the teacher speaking text.

It should be noted that the preset threshold is set according to actual needs, and in this embodiment, a specific value of the preset threshold is not limited. For example, in one embodiment, the predetermined threshold may be 3Min, 5Min, etc. The preset threshold value of 5Min will be described as an example.

For example, in one embodiment, the utterance start time of a teacher utterance text is 10:05 at 9/30/2020 and the utterance end time is 10:15 at 9/30/2020, and a student a has a student utterance text, and the utterance start time of the student utterance text is 10:17 at 9/30 at 2020, and at this time, the student utterance text is determined to be a student utterance text corresponding to the teacher utterance text.

For example, the student B also has a student utterance text, and the utterance start time of the student utterance text is 9/30/10: 17 in 2020, and at this time, it is determined that the student utterance text is not a student utterance text corresponding to the teacher utterance text, and the student does not have a student utterance text corresponding to the teacher utterance text.

S202, aiming at each student, determining the current speaking performance of the student based on the target teacher speaking text and the target student speaking text of the student, wherein the target teacher speaking text and the target student speaking text of the student have corresponding relations.

Specifically, fig. 3 is a flowchart illustrating an exemplary embodiment of determining the performance of the student speaking this time, and referring to fig. 3, in a possible implementation manner of the present application, a specific implementation process of the step may include:

s301, recognizing the sentence type of the target teacher speaking text.

Specifically, the sentence type of the text spoken by the target teacher may be identified based on a pre-trained sentence type identification model. The training process of the sentence type recognition model and the recognition process of the sentence type recognition model can be referred to the description in the related art, and are not described herein again.

S302, when the sentence type of the target teacher speaking text is an interrogative sentence, a standard answer text corresponding to the target teacher speaking text is obtained.

Specifically, when the sentence type of the target teacher utterance text is a question sentence, the representation teacher presents a question in the target teacher utterance text, and at this time, the standard answer text corresponding to the question can be acquired. In specific implementation, the corresponding standard answer text can be obtained from the internet, or obtained from a preset standard answer text library. In the present embodiment, this is not limited.

And S303, determining the similarity between the standard answer text and the target student speaking text.

For example, in one embodiment, the similarity between the two may be determined based on the way the keywords match. In the concrete implementation, a plurality of keywords can be predefined in the standard answer text, and as long as the student speaking text can be matched with the keywords, higher similarity can be output.

For another example, in another embodiment, the similarity between the two may be determined based on a pre-trained semantic similarity model. The training process and the implementation principle of the semantic similarity model can be referred to the description in the related art, and are not described herein again.

And S304, determining the current speaking performance of the student based on the similarity.

Specifically, the accuracy score corresponding to the similarity may be searched from a preset correspondence between the similarity and the accuracy score, and the accuracy score is determined as the current speaking performance of the learner.

For example, table 1 shows the preset correspondence between similarity and accuracy score according to an exemplary embodiment of the present application:

TABLE 1

Degree of similarity	Accuracy scoring
		More than 80 percent	9
[60％80％]	7
		[40％60％)	5
Less than 40 percent	3

With reference to the example shown in table 1, for example, in one possible implementation manner of the present application, for example, if the similarity between the standard answer text and the target student utterance text of the student is 70%, the accuracy score of the answer question of this time is determined to be 7, that is, the student utterance score is determined to be 7.

Of course, in a possible implementation manner of the present application, the method may further include: and when the sentence type of the target teacher speaking text is a statement sentence, determining the current speaking performance of the student based on the similarity between the teacher speaking text and the student speaking text.

In one scenario, the teacher may request the students to follow up, and during the follow-up, the performance of each student is not only the same, and in this case, it is necessary to evaluate the follow-up situation of the students. In the application, when the target teacher utterance text with the corresponding relationship is determined to be the statement sentence, the teacher is considered to require the student to read, and at this time, the student utterance performance can be determined based on the similarity between the teacher utterance text and the student utterance text.

Specifically, at this time, the text similarity between the speech text of the target teacher and the speech text of the target student can be determined based on a text similarity calculation algorithm, an accuracy score corresponding to the text similarity is further searched for from a preset correspondence between the text similarity and the accuracy score, and the accuracy score is determined as the performance of the current speech of the student.

And S203, evaluating the classroom performance of the student by integrating the speech performances of all times.

In connection with the above example, when the accuracy scores are used to represent one speech performance of the student, at this time, the highest value or the lowest value of each accuracy score may be used to represent the classroom performance of the student; alternatively, the classroom performance of the student is characterized using the sum or average of all accuracy scores. In the present embodiment, this is not limited.

The method provided by the embodiment provides a method for evaluating classroom performance of students based on teacher speaking texts and student speaking texts.

Fig. 4 is a flowchart of a third method for evaluating classroom performance of a student according to the present application, please refer to fig. 4, and the method according to this embodiment determines the current speaking performance of the student based on similarity on the basis of the above embodiment, which may include:

s401, determining the response time of the student to the teacher to speak according to the first speaking time of the target teacher speaking text and the second speaking time of the target student speaking text.

Specifically, the response time of the student to the teacher speaking is equal to the time difference between the second speaking start time of the target student and the first speaking time of the target teacher speaking text.

For example, in the second example in embodiment two, the response time period for the trainee a to speak for the teacher is determined to be 2 Min.

S402, determining the current speaking performance of the student based on the similarity and the response time length.

Specifically, the specific implementation process of this step may include:

(1) and searching the accuracy grade corresponding to the similarity from the preset corresponding relation between the similarity and the accuracy grade.

For the specific implementation principle and implementation process of this step, reference may be made to the description in the foregoing embodiments, and details are not described here.

(2) And checking and receiving a response timeliness grade corresponding to the response duration from preset response duration and response timeliness grade.

Specifically, the preset response duration and the response timeliness score are set according to actual needs, and in this embodiment, this is not limited. For example, table 2 shows the correspondence between the preset response duration and the response timeliness score according to an exemplary embodiment of the present application:

TABLE 2

Duration of response	Response timeliness scoring
		Less than 1Min	8
[1Min 2Min]	6
		(2Min 4min]	5
(4Min 5min]	1

In connection with the above example, student A was determined to have a response timeliness score of 6.

(3) And determining the comprehensive score of the student at this time according to the accuracy scoring weight, the response timeliness scoring weight, the accuracy scoring and the comprehensive response timeliness scoring, and representing the speaking performance of the student at this time by adopting the comprehensive score.

Specifically, the comprehensive score of the student at this time can be calculated according to the following formula:

integrated score accuracy score weight accuracy score + response timeliness score weight response timeliness score

In addition, the specific values of the accuracy scoring weight and the response and timeliness scoring weight are set according to actual needs, and in this embodiment, the specific values are not limited. For example, in one possible implementation, the accuracy score is weighted 60%, and the response and timeliness score is weighted 40%, at which point, the student a is determined to have a composite score of 7.2 (7.2 ═ 8 × 60% +6 × 40%). It should be noted that, when the comprehensive score is used to represent the present speech presentation of the student, in step S203, the highest value or the lowest value of each comprehensive score may be used to represent the classroom presentation of the student; alternatively, the classroom performance of the student is characterized using the sum or average of all composite scores. In the present embodiment, this is not limited.

According to the method provided by the embodiment, when the classroom performance of the student is evaluated, the accuracy of answering questions or reading by the student is considered, and the response timeliness of the student is also considered, so that the classroom performance of the student can be evaluated more objectively, and the user experience can be further improved.

In the present application, if a student speaks for a section of teacher speak text, if a student speaks for the section of teacher speak text, it is determined that the score of the student speaking this time is a preset value. For example, the score of the student speaking this time is determined to be 0.

In correspondence with the foregoing embodiments of the method for evaluating the classroom performance of a trainee, the present application also provides embodiments of an apparatus for evaluating classroom performance of a trainee.

The embodiment of the evaluation device for classroom performance of the student can be applied to electronic equipment. The device embodiments may be implemented by software, or by hardware, or by a combination of hardware and software. Taking a software implementation as an example, as a logical device, the device is formed by reading corresponding computer program instructions in a memory into an internal memory for operation through a processor of the electronic device where the device is located. From a hardware aspect, as shown in fig. 5, a hardware structure diagram of an electronic device where an evaluation apparatus for student classroom performance shown in an exemplary embodiment of the present application is located is shown, except for the storage 510, the processor 520, the memory 530, and the network interface 540 shown in fig. 5, the electronic device where the apparatus is located in the embodiment may also include other hardware according to the actual function of the evaluation apparatus for student classroom performance, which is not described again.

Fig. 6 is a schematic structural diagram of a first example of the evaluation apparatus for classroom performance of a student according to the present application. Referring to fig. 6, the apparatus provided in this embodiment is applied to an electronic device, the electronic device is connected to a plurality of audio collecting devices, the audio collecting devices are used to collect audio data sent by corresponding collecting objects, the collecting objects include teachers and trainees, the apparatus includes a receiving module, an identifying module and a processing module, wherein,

the receiving module 610 is configured to receive audio data acquired by the audio acquisition device;

the recognition module 620 is configured to perform voice recognition on the audio data when an analysis instruction is received, so as to obtain speaking texts of a teacher and a student in a classroom;

the processing module 630 is configured to, for each trainee, evaluate the classroom performance of the trainee based on the teacher utterance text and the trainee utterance text of the trainee.

The apparatus provided in this embodiment may be used to implement the technical solution of the method embodiment shown in fig. 1, and the implementation principle and the technical effect are similar, which are not described herein again.

Further, the processing module 630 is specifically configured to:

aiming at each section of teacher speaking text, determining student speaking texts corresponding to the teacher speaking texts according to speaking time;

aiming at each student, determining the current speaking performance of the student based on the target teacher speaking text and the target student speaking text of the student, which have the corresponding relation;

and evaluating the classroom performance of the student by integrating the speech performance of each time.

Further, the processing module 630 is further specifically configured to:

identifying a sentence type of the target teacher speaking text;

when the sentence type of the target teacher speaking text is an interrogative sentence, acquiring a standard answer text corresponding to the target teacher speaking text;

determining the similarity between the standard answer text and the student speaking text;

and determining the current speaking performance of the student based on the similarity.

Further, the processing module 630 is further configured to determine a response time length of the student speaking to the teacher according to the first speaking time of the target teacher speaking text and the second speaking time of the target student speaking text, and determine the performance of the student speaking this time based on the similarity and the response time length.

Further, the processing module 630 is further configured to determine, when the sentence type of the target teacher utterance text is a statement sentence, the performance of the student speaking this time based on the similarity between the teacher utterance text and the student utterance text.

The present application also provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of any of the student classroom performance assessment methods provided herein.

In particular, computer-readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including by way of example semiconductor memory devices (e.g., EPROM, EEPROM, and flash memory devices), magnetic disks (e.g., internal hard disk or removable disks), magneto-optical disks, and CD ROM and DVD-ROM disks.

With continued reference to fig. 5, the present application further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method for evaluating classroom performance of any student provided by the present application when executing the computer program.

The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.

Claims

1. The method for evaluating the classroom performance of the trainees is applied to electronic equipment, the electronic equipment is connected with a plurality of audio acquisition devices, the audio acquisition devices are used for acquiring audio data sent by corresponding acquisition objects, the acquisition objects comprise teachers and the trainees, and the method comprises the following steps:

receiving audio data collected by the audio collecting equipment;

2. The method of claim 1, wherein evaluating the classroom performance of the student based on the teacher utterance text and the student utterance text of the student comprises:

3. The method of claim 2, wherein the determining the student's speech performance based on the teacher's speech text and the student's speech text with the correspondence comprises:

identifying a sentence type of the target teacher speaking text;

determining the similarity between the standard answer text and the target student speaking text;

4. The method of claim 3, wherein determining the performance of the student on the current utterance based on the similarity comprises:

determining the response time of the student to the teacher to speak according to the first speaking time of the target teacher speaking text and the second speaking time of the target student speaking text;

and determining the student speaking performance of the time based on the similarity and the response time length.

5. The method of claim 3, further comprising: and when the sentence type of the target teacher speaking text is a statement sentence, determining the student speaking performance at this time based on the similarity between the target teacher speaking text and the target student speaking text.

6. The device for evaluating the classroom performance of the trainees is applied to electronic equipment, the electronic equipment is connected with a plurality of audio acquisition devices, the audio acquisition devices are used for acquiring audio data sent by corresponding acquisition objects, the acquisition objects comprise teachers and the trainees, the device comprises a receiving module, an identification module and a processing module, wherein,

7. The apparatus of claim 6, wherein the processing module is specifically configured to:

8. The apparatus of claim 7, wherein the processing module is further specifically configured to:

identifying a sentence type of the target teacher speaking text;

9. A computer-readable storage medium on which a computer program is stored, wherein the program, when executed by a processor, implements any of the student classroom performance assessment methods provided herein.

10. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method for assessing classroom performance of any student provided herein when executing the program.