CN113657770B - Experiment operation scoring system and method - Google Patents

Experiment operation scoring system and method Download PDF

Info

Publication number
CN113657770B
CN113657770B CN202110954307.5A CN202110954307A CN113657770B CN 113657770 B CN113657770 B CN 113657770B CN 202110954307 A CN202110954307 A CN 202110954307A CN 113657770 B CN113657770 B CN 113657770B
Authority
CN
China
Prior art keywords
scoring
data
basis
voice
text
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110954307.5A
Other languages
Chinese (zh)
Other versions
CN113657770A (en
Inventor
陈创举
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Dafeng Laboratory Equipment Co ltd
Original Assignee
Shanghai Dafeng Laboratory Equipment Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Dafeng Laboratory Equipment Co ltd filed Critical Shanghai Dafeng Laboratory Equipment Co ltd
Priority to CN202110954307.5A priority Critical patent/CN113657770B/en
Publication of CN113657770A publication Critical patent/CN113657770A/en
Application granted granted Critical
Publication of CN113657770B publication Critical patent/CN113657770B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0639Performance analysis of employees; Performance analysis of enterprise or organisation operations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/20Education
    • G06Q50/205Education administration or guidance
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Human Resources & Organizations (AREA)
  • Strategic Management (AREA)
  • Educational Administration (AREA)
  • Physics & Mathematics (AREA)
  • Economics (AREA)
  • Tourism & Hospitality (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Educational Technology (AREA)
  • Health & Medical Sciences (AREA)
  • Marketing (AREA)
  • Theoretical Computer Science (AREA)
  • Development Economics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Game Theory and Decision Science (AREA)
  • Quality & Reliability (AREA)
  • Operations Research (AREA)
  • General Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Computational Linguistics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

The embodiment of the invention discloses an experimental operation scoring system and method. The system comprises an interactive terminal and a scoring server; the interactive terminal is used for receiving the evaluation starting signal, jumping to a preset grading basis and displaying corresponding text test question data; the interactive terminal is also used for receiving the voice response data for matching, obtaining corresponding text answer data and sending the text answer data and the identification code to the scoring server; the interactive terminal is also used for collecting experimental image data of the user and sending the experimental image data and the corresponding identification codes to the scoring server; the scoring server is used for receiving text answer data, experimental image data and identification codes, and calling an image identification model to identify so as to obtain an operation information set; the scoring server is also used for calling the scoring logic data to comprehensively score, obtaining scoring results and returning the scoring results to the interaction terminal; the interactive terminal is also used for displaying the scoring result. The method improves the accuracy of image identification scoring.

Description

Experiment operation scoring system and method
Technical Field
The invention relates to the field of artificial intelligence, in particular to an experimental operation scoring system and method.
Background
Along with the progress of science and technology, the AI image recognition technology starts to be used in more and more fields, and after the opinion of education department about strengthening and improving middle and primary school experiment teaching is released, a physical and chemical examination system is gradually popularized, and meanwhile, in order to further reduce the labor cost of examination scoring and improve the efficiency, the AI technology is also applied to the physical and chemical examination scoring. Through using the auxiliary grading of the physicochemical examination AI, the purpose of improving grading efficiency is achieved, and meanwhile, the problems that students accept information differently in a teaching scene, and the correction efficiency of teachers in the examination scene is low and grading standards are different are solved. However, in an actual examination, the examinee still needs to manually input an answer of an experiment result and execute an interactive operation of an examination procedure, at this time, the hands of the examinee need to be switched between the experiment equipment and the interactive equipment (such as a computer device with a touch screen or a keyboard and a mouse) so as to complete the control of recording the experiment data and the examination procedure, the probability of misoperation of the examinee is increased by repeatedly switching, and meanwhile, the picture of operating the interactive equipment is recorded, so that the accuracy of AI image identification is affected.
Disclosure of Invention
The embodiment of the invention provides an experimental operation scoring system and method, which aim to solve the problem of low scoring accuracy of experimental examination in the prior art.
In a first aspect, an embodiment of the present invention provides an experimental operation scoring system, which includes an interaction terminal and a scoring server, where the interaction terminal is wirelessly connected with the scoring server;
the interactive terminal is used for receiving the starting evaluation signal, jumping to a preset grading basis and displaying text test question data in the grading basis;
the interactive terminal is also used for receiving the voice response data and matching the voice response data to obtain corresponding text answer data and sending the text answer data and the corresponding identification code to the scoring server;
the interactive terminal is also used for collecting experimental image data of a user and sending the experimental image data and the corresponding identification codes to the scoring server;
the scoring server is used for receiving the text answer data, the experimental image data and the identification codes, calling the scoring according to the identification codes and identifying the experimental image data according to the corresponding image identification model to obtain an operation information set;
the scoring server is also used for calling the scoring according to the same identification code, comprehensively scoring the text answer data and the operation information set according to the corresponding scoring logic data, obtaining a scoring result and returning the scoring result to the interactive terminal;
the interactive terminal is also used for displaying the received scoring result.
In a second aspect, an embodiment of the present invention provides an experimental operation scoring method, including:
the interactive terminal receives the starting evaluation signal, jumps to a preset grading basis and displays text test question data in the grading basis;
the interactive terminal receives the voice response data and matches the voice response data to obtain corresponding text answer data and sends the text answer data and the corresponding identification code to a scoring server;
the interactive terminal collects experimental image data of a user and sends the experimental image data and corresponding identification codes to a scoring server;
the scoring server receives the text answer data, the experimental image data and the identification codes, calls the scoring according to the identification codes and identifies the experimental image data according to the corresponding image identification model to obtain an operation information set;
the scoring server calls the scoring according to the same identification code, comprehensively scores the text answer data and the operation information set according to the corresponding scoring logic data, obtains a scoring result and returns the scoring result to the interactive terminal;
and the interactive terminal displays the received scoring result.
The embodiment of the invention provides an experimental operation scoring system and method. The system comprises an interactive terminal and a scoring server, wherein the interactive terminal is in wireless connection with the scoring server; the interactive terminal is used for receiving the starting evaluation signal, jumping to a preset grading basis and displaying text test question data in the grading basis; the interactive terminal is also used for receiving the voice response data and matching the voice response data to obtain corresponding text answer data and sending the text answer data and the corresponding identification code to the scoring server; the interactive terminal is also used for collecting experimental image data of a user and sending the experimental image data and the corresponding identification codes to the scoring server; the scoring server is used for receiving the text answer data, the experimental image data and the identification codes, calling the scoring according to the identification codes and identifying the experimental image data according to the corresponding image identification model to obtain an operation information set; the scoring server is also used for calling the scoring according to the same identification code, comprehensively scoring the text answer data and the operation information set according to the corresponding scoring logic data, obtaining a scoring result and returning the scoring result to the interactive terminal; the interactive terminal is also used for displaying the received scoring result. In the system, the interactive terminal receives the voice response data of the user and the experimental image data to score so as to obtain a scoring result, and compared with the traditional experimental examination system, all the interactive requirements of the system are carried out through voice instructions, the manual operation of the interactive terminal is avoided while the examination interactive requirements are met, the influence of the manual operation of the interactive terminal on the experimental image data is effectively avoided, and therefore the accuracy of image recognition scoring is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic block diagram of an experimental operation scoring system provided by an embodiment of the present invention;
FIG. 2 is a flowchart illustrating an embodiment of an experimental operation scoring method according to an embodiment of the present invention;
fig. 3 is a schematic flow chart of step S110 in the experimental operation scoring method according to the embodiment of the present invention;
fig. 4 is a schematic flow chart of step S120 in the experimental operation scoring method according to the embodiment of the present invention;
fig. 5 is a schematic flow chart of step S140 in the experimental operation scoring method according to the embodiment of the present invention;
fig. 6 is a flowchart of another embodiment of the scoring method for experimental operations according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be understood that the terms "comprises" and "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
It is also to be understood that the terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be further understood that the term "and/or" as used in the present specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
Referring to fig. 1, fig. 1 is a schematic block diagram of an experimental operation scoring system according to an embodiment of the present invention;
as shown in fig. 1, the experimental operation scoring system comprises an interactive terminal and a scoring server, wherein the interactive terminal is in wireless connection with the scoring server;
the interactive terminal is used for receiving the starting evaluation signal, jumping to a preset grading basis and displaying text test question data in the grading basis;
the interactive terminal is also used for receiving the voice response data and matching the voice response data to obtain corresponding text answer data and sending the text answer data and the corresponding identification code to the scoring server;
the interactive terminal is also used for collecting experimental image data of a user and sending the experimental image data and the corresponding identification codes to the scoring server;
the scoring server is used for receiving the text answer data, the experimental image data and the identification codes, calling the scoring according to the identification codes and identifying the experimental image data according to the corresponding image identification model to obtain an operation information set;
the scoring server is also used for calling the scoring according to the same identification code, comprehensively scoring the text answer data and the operation information set according to the corresponding scoring logic data, obtaining a scoring result and returning the scoring result to the interactive terminal;
the interactive terminal is also used for displaying the received scoring result.
The interactive terminal comprises an input device and an output device, wherein the input device comprises any device capable of collecting voice signals and any device capable of collecting image data, such as a microphone and a camera; the output device includes any device that can display the scoring result, such as a display. Specifically, a microphone receives a start evaluation signal, voice response data, and a finish evaluation signal from a user in a voice signal. And acquiring experimental image data of the user through a camera.
The embodiment of the application also provides an experimental operation scoring method, wherein the experimental operation scoring method is suitable for the experimental operation scoring system, refer to fig. 2, and fig. 2 is a flow chart of the experimental operation scoring method provided by the embodiment of the invention;
as shown in fig. 2, the experimental operation scoring method includes steps S110 to S160.
Step S110, the interactive terminal receives a starting evaluation signal, jumps to a preset grading basis and displays text test question data in the grading basis;
in this embodiment, the interactive terminal monitors in real time whether the interactive terminal receives the start evaluation signal. When the interactive terminal receives the evaluation starting signal, the interactive terminal jumps to a preset grading basis and displays text test question data in the grading basis.
As shown in fig. 3, in an embodiment, step S110 includes:
step S111, the interactive terminal starts a monitoring thread, monitors a voice signal input from a microphone, starts recording voice information when the microphone volume is larger than a threshold value, ends recording the voice information when the microphone volume is smaller than the threshold value, and extracts a characteristic value of the recorded voice information;
step S112, matching the extracted characteristic value with a voice instruction in test question data and a voice instruction in a scoring basis; the test question data comprises a starting evaluation voice command, a finishing evaluation voice command and a scoring basis list, wherein the scoring basis list comprises a plurality of scoring bases, and each scoring basis comprises a skip voice command, a plurality of answer voice commands, text test question data, an image recognition model, scoring logic data, recognition codes and a plurality of text answer data which are in one-to-one correspondence with the answer voice commands;
and step 113, when the characteristic value is matched with the starting evaluation voice instruction in the test question data or the jump voice instruction in the scoring basis, jumping to the corresponding scoring basis and displaying the text test question data in the scoring basis.
In this embodiment, the interactive terminal starts a monitoring thread, monitors a voice signal input by a microphone, starts recording the voice signal when the volume of the voice signal is greater than a threshold value, ends recording voice information when the volume of the microphone is less than the threshold value, and extracts a feature value of the recorded voice signal; then matching the extracted characteristic value with the voice command in the test question data and the voice command in the grading basis; when the characteristic value is matched with the starting evaluation voice instruction in the test question data or the jump voice instruction in the grading basis, jumping to the corresponding grading basis and displaying the text test question data in the grading basis. The voice instructions in the test question data comprise a voice instruction for starting evaluation, a voice instruction for finishing evaluation and a scoring basis list; the scoring basis list comprises a plurality of scoring basis, and each scoring basis comprises a skip voice instruction, a plurality of answer voice instructions, text test question data, an image recognition model, scoring logic data, recognition codes and a plurality of text answer data which are in one-to-one correspondence with the answer voice instructions. The scoring basis refers to the scoring basis of the experimental test questions (i.e. test question requirements, etc.); the jump voice instruction refers to a jump instruction between scoring bases; the answer voice instruction refers to voice corresponding to each score according to the associated option answer, such as voice corresponding to the test tube A, the test tube B and the alcohol lamp.
For example, the microphone receives a voice signal, and if the voice signal is determined to be a voice command to begin evaluating after matching, the microphone jumps to the first scoring basis in the scoring basis list; if the voice signal is determined to be the jump voice instruction, jumping to the grading basis of the voice signal to be jumped and displaying corresponding text test question data on a display.
In one embodiment, before step S110, the method further includes:
step S001, the interactive terminal loads a starting evaluation voice instruction, a finishing evaluation voice instruction in the test question data, and loads a skip voice instruction, a plurality of answer voice instructions, text test question data, identification codes and a plurality of text answer data which are in one-to-one correspondence with the answer voice instructions of each scoring basis in the scoring basis list one by one, and the scoring server loads an image identification model, scoring logic data and identification codes of each scoring basis in the scoring basis list one by one.
In this embodiment, before starting the test, the interactive terminal loads a test question data start test voice command, a test question completion voice command, and a jump voice command, a plurality of answer voice commands, text test question data, identification codes, and a plurality of text answer data corresponding to the answer voice commands one by one according to each score basis in the score basis list. The scoring server loads the image recognition model, the scoring logic data and the recognition codes of each scoring basis in the scoring basis list one by one.
For example, the interactive terminal may be an AI interactive device, the scoring server may be an AI server, and the test question data is composed of a scoring basis list L, a starting evaluation voice instruction RS, a finishing evaluation voice instruction RE, and an experiment repetition number J. The scoring basis list L comprises scoring basis Pn, and the scoring basis Pn comprises a voice jump instruction Rn. Optionally, the scoring basis includes answer voice instructions Am, each answer voice instruction Am corresponds to the text answer data Wm one by one, where m is an integer of 1, 2, 3. AI image recognition model Mn, AI scoring logic data Sn, and recognition code In according to scoring, where n is an integer of 1, 2, 3. The AI interaction device loads the starting evaluation voice command RS, the finishing evaluation voice command RE, the answer voice command Am corresponding to Pn In the grading basis list L, the text answer data Wm, the voice jump command Rn, the text test question data Tn and the identification code In one by one, and the AI server loads the AI image identification model Mn, the AI grading logic data Sn and the identification code In corresponding to Pn In the basis list L one by one.
Step S120, the interactive terminal receives the voice response data and matches the voice response data to obtain corresponding text answer data and sends the text answer data and the corresponding identification code to a scoring server;
in this embodiment, the interactive terminal responds according to the received voice response data, specifically, after receiving the voice response data, the interactive terminal matches the voice response data with the preloaded answer voice command, determines the corresponding answer voice command, and sends the text answer data corresponding to the answer voice command and the current score to the scoring server according to the corresponding identification code.
As shown in fig. 4, in an embodiment, step S120 includes:
step S121, the interactive terminal monitors the voice signal input from the microphone, starts to record voice information when the microphone volume is larger than a threshold value, ends to record the voice information when the microphone volume is smaller than the threshold value, and extracts the characteristic value of the recorded voice information;
step S122, matching the extracted characteristic value with a voice instruction in test question data and a voice instruction in a scoring basis;
and step 123, when the characteristic value is matched with an answer voice instruction, acquiring text answer data corresponding to the characteristic value, and transmitting the text answer data and a corresponding identification code to a scoring server.
In this embodiment, when the interactive terminal monitors a voice signal greater than a threshold, the interactive terminal records the voice signal and extracts a feature value, so that the extracted feature value is matched with a voice command in test question data and a voice command in a scoring basis, and when the feature value is matched with an answer voice command, text answer data corresponding to the answer voice command is obtained, and the text answer data and a current scoring basis are sent to a scoring server according to a corresponding identification code.
For example, the AI interaction device starts a listening thread, listens to a voice signal input from a microphone, starts recording voice information O when the microphone volume is greater than a threshold S, ends recording the voice information O when the microphone volume is less than the threshold S, extracts a feature value of the voice information O, compares the feature value with a voice instruction (the starting evaluation voice instruction RS, the finishing evaluation voice instruction RE) In test question data and each feature value of the scoring-dependent answer voice instruction Am according to the corresponding voice instruction Rn In the scoring-dependent list L, and jumps to a starting experiment when the microphone volume is greater than the threshold S, jumps to a finishing experiment when the microphone volume is greater than the threshold S, jumps to a scoring-dependent answer corresponding to the answer voice instruction RE when the microphone volume is greater than the threshold S, and transmits a text answer Wm corresponding to the scoring-dependent answer Am as a text answer of the current answer-dependent answer and a recognition code In to the AI server. When the characteristic value of the voice information O is matched with the RS, jumping to start an experiment, jumping to a first grading basis P1 in test question data, displaying text test question data T1 corresponding to the first grading basis P1 on a display screen, and controlling a camera to start collecting image data of test taker experiment operation.
Step S130, the interactive terminal collects experimental image data of a user and sends the experimental image data and corresponding identification codes to a scoring server;
step S140, the scoring server receives the text answer data, the experimental image data and the identification codes, calls the scoring according to the identification codes and identifies the experimental image data according to the corresponding image identification model to obtain an operation information set;
in this embodiment, the test operation of the test taker is also required to be scored in the test examination, so the interactive terminal needs to collect the test image data of the test taker, and send the test image data and the identification code corresponding to the scoring basis to the scoring server; and after receiving the text answer data, the experimental image data and the identification codes, the scoring server calls an image identification model corresponding to the scoring basis according to the identification codes to identify the experimental image data, so as to obtain an operation information set. It should be noted that, because the test is not necessarily to answer the test before the test, and may be to answer the test before the test, the sequence of collecting the text answer data and the test image data of the examinee is not fixed.
For example, a camera captures x frames of image data Fx per second, where x is an integer of 1, 2, 3. The image data Fx collected by the camera and the identification code In according to the current grading are transmitted to an AI server through AI interaction equipment, and the AI server calls an AI image identification model Mn corresponding to the grading basis Pn according to the identification code In to detect and identify a plurality of image data Fx, so that an operation information set is obtained.
As shown in fig. 5, in an embodiment, step S140 includes:
step S141, the scoring server calls the image recognition model to carry out image recognition on the experimental image data according to the recognition code to obtain image characteristics;
and step S142, calling a CNN target detection algorithm by the scoring server to detect the image characteristics to obtain an operation information set, wherein the operation information set comprises operation limb information, equipment state information and equipment coordinate information.
In the embodiment, the scoring server calls an image recognition model to perform image recognition on experimental image data according to the recognition codes to obtain image features; and then the scoring server invokes a CNN (convolutional neural network) target detection algorithm to detect the image characteristics, so as to obtain an operation information set. The operation information set includes, but is not limited to, information such as relative limb coordinates, state of experimental equipment, coordinates of experimental equipment and the like when an examinee performs an experiment.
Step S150, the scoring server calls the scoring according to the same identification code to comprehensively score the text answer data and the operation information set according to the corresponding scoring logic data, so as to obtain a scoring result and return the scoring result to the interactive terminal;
and step 160, the interactive terminal displays the received grading result.
In this embodiment, the general experiment questions need to score the experiment operation and the text answers, so that the scoring server calls the scoring according to the same identification code to comprehensively score the text answer data and the operation information set according to the corresponding scoring logic data, obtains the scoring result and returns to the interactive terminal. And the interactive terminal displays the scoring result after receiving the scoring result.
As shown in fig. 6, in an embodiment, after step S160, the method includes:
step S170, the interactive terminal traverses the scoring basis list and judges whether scoring basis of incomplete scoring exists or not;
and step S180, if yes, jumping to a scoring basis of the first incomplete scoring and displaying text test question data corresponding to the scoring basis until scoring of all scoring basis is completed.
In this embodiment, after the interactive terminal finishes scoring according to one scoring basis and displays the scoring result, the interactive terminal traverses the scoring basis list and determines whether the scoring basis list has a scoring basis with incomplete scoring; if the scoring basis of the incomplete scoring exists, jumping to the scoring basis of the first incomplete scoring and displaying the text test question data of the scoring basis until all scoring basis in the scoring basis list finish scoring.
In an embodiment, the test question data further includes a target experiment round number, and the experiment operation scoring method further includes:
after the scoring according to all the scoring is finished, checking whether the number of the finished experimental rounds reaches the target experimental rounds, if so, ending the examination, and if not, continuing the scoring of the next experimental operation.
The system receives the voice response data of the user and the experimental image data through the interactive terminal to score so as to obtain a scoring result, and compared with a traditional experimental examination system, the system has the advantages that all interaction requirements are met through voice instructions, the manual operation of the interactive terminal is avoided while examination interaction requirements are met, the influence of the manual operation of the interactive terminal on the experimental image data is effectively avoided, and therefore the accuracy of image identification scoring is improved.
In this embodiment, since a part of experiments in practical application need to be performed for multiple rounds, the test question data further includes a target experiment round number, after the scoring according to all scoring bases is completed, the current completed experiment round number is checked to determine whether the target experiment round number is reached, and if the experiment round number reaches the target experiment round number, the test is ended; and if the number of experimental rounds does not reach the target number of experimental rounds, continuing the scoring of the experimental operation of the next round.
While the invention has been described with reference to certain preferred embodiments, it will be understood by those skilled in the art that various changes and substitutions of equivalents may be made and equivalents will be apparent to those skilled in the art without departing from the scope of the invention. Therefore, the protection scope of the invention is subject to the protection scope of the claims.

Claims (4)

1. The experimental operation scoring system is characterized by comprising an interactive terminal and a scoring server, wherein the interactive terminal is in wireless connection with the scoring server;
the interactive terminal is used for receiving the starting evaluation signal, jumping to a preset grading basis and displaying text test question data in the grading basis;
the receiving of the evaluation starting signal is skipped to a preset grading basis and text test question data in the grading basis are displayed, and the method comprises the following steps:
starting a monitoring thread, monitoring a voice signal input from a microphone, starting to record the voice signal when the microphone volume is larger than a threshold value, ending to record voice information when the microphone volume is smaller than the threshold value, and extracting a characteristic value of the recorded voice signal;
matching the extracted characteristic value with a voice instruction in the text test question data and a voice instruction in a scoring basis; the method comprises the steps that a voice command in text test question data comprises a start evaluation voice command, a finish evaluation voice command and a scoring basis list, wherein the scoring basis list comprises a plurality of scoring bases, and each scoring basis comprises a skip voice command, a plurality of answer voice commands, text test question data, an image recognition model, scoring logic data, recognition codes and a plurality of text answer data which are in one-to-one correspondence with the answer voice commands;
when the characteristic value is matched with a starting evaluation voice instruction in the text test question data or a jump voice instruction in the scoring basis, jumping to the corresponding scoring basis and displaying the text test question data in the scoring basis;
the interactive terminal is used for receiving the starting evaluation signal, and before jumping to a preset grading basis and displaying text test question data in the grading basis, the interactive terminal comprises:
the interactive terminal loads a starting evaluation voice instruction and a finishing evaluation voice instruction in the text test question data, loads a skip voice instruction, a plurality of answer voice instructions, text test question data, identification codes and a plurality of text answer data which are in one-to-one correspondence with the answer voice instructions of each grading basis in the grading basis list one by one, and the grading server loads an image identification model, grading logic data and identification codes of each grading basis in the grading basis list one by one;
the interactive terminal is also used for receiving the voice response data and matching the voice response data to obtain corresponding text answer data and sending the text answer data and the corresponding identification code to the scoring server;
the receiving the voice response data and matching the voice response data to obtain corresponding text answer data and sending the text answer data and the corresponding identification code to a scoring server, which comprises the following steps:
monitoring a voice signal input from a microphone, starting to record voice information when the microphone volume is larger than a threshold value, ending to record the voice information when the microphone volume is smaller than the threshold value, and extracting a characteristic value of the recorded voice information;
matching the extracted characteristic value with a voice instruction in the text test question data and a voice instruction in a scoring basis;
when the characteristic value is matched with an answer voice instruction, text answer data corresponding to the characteristic value is obtained, and the text answer data and a corresponding identification code are sent to a scoring server;
the interactive terminal is also used for collecting experimental image data of a user and sending the experimental image data and the corresponding identification codes to the scoring server;
the scoring server is used for receiving the text answer data, the experimental image data and the identification codes, calling the scoring according to the identification codes and identifying the experimental image data according to the corresponding image identification model to obtain an operation information set;
the step of calling the score according to the identification code to identify the experimental image data according to the corresponding image identification model to obtain an operation information set, comprising the following steps:
invoking the image recognition model to perform image recognition on the experimental image data according to the recognition code to obtain image features;
calling a CNN target detection algorithm to detect the image characteristics to obtain an operation information set, wherein the operation information set comprises operation limb information, equipment state information and equipment coordinate information;
the scoring server is also used for calling the scoring according to the same identification code, comprehensively scoring the text answer data and the operation information set according to the corresponding scoring logic data, obtaining a scoring result and returning the scoring result to the interactive terminal;
the interactive terminal is also used for displaying the received scoring result;
after the received scoring result is displayed, the method comprises the following steps:
traversing the scoring basis list, and judging whether scoring basis of incomplete scoring exists or not;
if yes, jumping to a scoring basis of the first incomplete scoring and displaying text test question data corresponding to the scoring basis until scoring of all scoring basis is completed;
the text test question data also comprises target experiment round numbers, and the scoring method of the experiment operation scoring system further comprises the following steps:
after the scoring according to all the scoring is finished, checking whether the number of the finished experimental rounds reaches the target experimental rounds, if so, ending the examination, and if not, continuing the scoring of the next experimental operation.
2. The experimental operation scoring system of claim 1, wherein the interactive terminal comprises an input device comprising a microphone and a camera.
3. The experimental operation scoring system of claim 2, wherein the interactive terminal further comprises an output device comprising a display.
4. A scoring method of the experimental procedure scoring system according to any one of claims 1 to 3, comprising:
the interactive terminal receives the starting evaluation signal, jumps to a preset grading basis and displays text test question data in the grading basis;
the interactive terminal receives the voice response data and matches the voice response data to obtain corresponding text answer data and sends the text answer data and the corresponding identification code to a scoring server;
the interactive terminal collects experimental image data of a user and sends the experimental image data and corresponding identification codes to a scoring server;
the scoring server receives the text answer data, the experimental image data and the identification codes, calls the scoring according to the identification codes and identifies the experimental image data according to the corresponding image identification model to obtain an operation information set;
the scoring server calls the scoring according to the same identification code, comprehensively scores the text answer data and the operation information set according to the corresponding scoring logic data, obtains a scoring result and returns the scoring result to the interactive terminal;
the interactive terminal displays the received scoring result;
the interactive terminal receives the starting evaluation signal, jumps to a preset grading basis and displays text test question data in the grading basis, and comprises the following steps:
the interactive terminal starts a monitoring thread, monitors a voice signal input from a microphone, starts to record the voice signal when the microphone volume is larger than a threshold value, finishes recording voice information when the microphone volume is smaller than the threshold value, and extracts a characteristic value of the recorded voice signal;
matching the extracted characteristic value with a voice instruction in test question data and a voice instruction in a grading basis; the test question data comprises a starting evaluation voice instruction, a finishing evaluation voice instruction and a scoring basis list, wherein the scoring basis list comprises a plurality of scoring bases, and each scoring basis comprises a skip voice instruction, a plurality of answer voice instructions, text test question data, an image recognition model, scoring logic data, recognition codes and a plurality of text answer data which are in one-to-one correspondence with the answer voice instructions;
when the characteristic value is matched with a starting evaluation voice instruction in the test question data or a jump voice instruction in the scoring basis, jumping to the corresponding scoring basis and displaying text test question data in the scoring basis;
the interactive terminal receives the starting evaluation signal, jumps to a preset grading basis and displays text test question data in the grading basis, and comprises the following steps:
the interactive terminal loads a starting evaluation voice instruction and a finishing evaluation voice instruction in the test question data, loads a skip voice instruction, a plurality of answer voice instructions, text test question data, identification codes and a plurality of text answer data which are in one-to-one correspondence with the answer voice instructions of each grading basis in the grading basis list one by one, and the grading server loads an image identification model, grading logic data and identification codes of each grading basis in the grading basis list one by one;
the interactive terminal receives the voice response data and matches the voice response data to obtain corresponding text answer data and sends the text answer data and the corresponding identification code to a scoring server, and the method comprises the following steps:
the interactive terminal monitors voice signals input from the microphone, starts to record voice information when the microphone volume is larger than a threshold value, ends to record the voice information when the microphone volume is smaller than the threshold value, and extracts characteristic values of the recorded voice information;
matching the extracted characteristic value with a voice instruction in test question data and a voice instruction in a grading basis;
when the characteristic value is matched with an answer voice instruction, text answer data corresponding to the characteristic value is obtained, and the text answer data and a corresponding identification code are sent to a scoring server;
the step of calling the score according to the identification code to identify the experimental image data according to the corresponding image identification model to obtain an operation information set, comprising the following steps:
the scoring server calls the image recognition model to carry out image recognition on the experimental image data according to the recognition code to obtain image characteristics;
the scoring server calls a CNN target detection algorithm to detect the image characteristics to obtain an operation information set, wherein the operation information set comprises operation limb information, equipment state information and equipment coordinate information;
after the interactive terminal displays the received scoring result, the interactive terminal comprises:
the interactive terminal traverses the scoring basis list and judges whether scoring basis of incomplete scoring exists or not;
if yes, jumping to a scoring basis of the first incomplete scoring and displaying text test question data corresponding to the scoring basis until scoring of all scoring basis is completed;
the text test question data also comprises a target experiment round number, and the experiment operation scoring method further comprises the following steps:
after the scoring according to all the scoring is finished, checking whether the number of the finished experimental rounds reaches the target experimental rounds, if so, ending the examination, and if not, continuing the scoring of the next experimental operation.
CN202110954307.5A 2021-08-19 2021-08-19 Experiment operation scoring system and method Active CN113657770B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110954307.5A CN113657770B (en) 2021-08-19 2021-08-19 Experiment operation scoring system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110954307.5A CN113657770B (en) 2021-08-19 2021-08-19 Experiment operation scoring system and method

Publications (2)

Publication Number Publication Date
CN113657770A CN113657770A (en) 2021-11-16
CN113657770B true CN113657770B (en) 2024-03-12

Family

ID=78492365

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110954307.5A Active CN113657770B (en) 2021-08-19 2021-08-19 Experiment operation scoring system and method

Country Status (1)

Country Link
CN (1) CN113657770B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114881541B (en) * 2022-07-06 2022-11-11 成都西交智汇大数据科技有限公司 Evaluation method, device and equipment for examinee score and readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140052132A (en) * 2012-10-19 2014-05-07 에스케이텔레콤 주식회사 Method and apparatus for electronic scoring road-driving test by using image information
CN207732796U (en) * 2018-01-20 2018-08-14 辽宁文彬教学设备有限公司 A kind of internet remote measurement and control teaching experiment system platform
CN109472472A (en) * 2018-10-26 2019-03-15 南京米好信息安全有限公司 A kind of artificial intelligence points-scoring system
CN109727172A (en) * 2019-03-18 2019-05-07 上海中科教育装备集团有限公司 A kind of artificial intelligence machine study experimental skill points-scoring system
CN111242813A (en) * 2018-11-29 2020-06-05 杭州海康威视数字技术股份有限公司 Evaluation method, device and system based on video analysis

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140052132A (en) * 2012-10-19 2014-05-07 에스케이텔레콤 주식회사 Method and apparatus for electronic scoring road-driving test by using image information
CN207732796U (en) * 2018-01-20 2018-08-14 辽宁文彬教学设备有限公司 A kind of internet remote measurement and control teaching experiment system platform
CN109472472A (en) * 2018-10-26 2019-03-15 南京米好信息安全有限公司 A kind of artificial intelligence points-scoring system
CN111242813A (en) * 2018-11-29 2020-06-05 杭州海康威视数字技术股份有限公司 Evaluation method, device and system based on video analysis
CN109727172A (en) * 2019-03-18 2019-05-07 上海中科教育装备集团有限公司 A kind of artificial intelligence machine study experimental skill points-scoring system

Also Published As

Publication number Publication date
CN113657770A (en) 2021-11-16

Similar Documents

Publication Publication Date Title
CN111460889B (en) Abnormal behavior recognition method, device and equipment based on voice and image characteristics
CN106210836B (en) Interactive learning method and device in video playing process and terminal equipment
CN109408384A (en) Test method, device, processor and the electronic device of software application
CN105608005B (en) The test method and system of a kind of television system
CN104834597B (en) Using the measuring method and system of response time
CN111126553A (en) Intelligent robot interviewing method, equipment, storage medium and device
CN113657770B (en) Experiment operation scoring system and method
CN106113054A (en) service processing method based on robot
CN109800301B (en) Weak knowledge point mining method and learning equipment
CN106601257A (en) Sound identification method and device and first electronic device
CN111368808A (en) Method, device and system for acquiring answer data and teaching equipment
CA3048542A1 (en) System for peer-to-peer, self-directed or consensus human motion capture, motion characterization, and software-augmented motion evaluation
CN116229777A (en) Internet comprehensive teaching training method, system, medium and equipment
CN113205281A (en) Scene simulation-based personnel ability evaluation method and related equipment
CN111079499B (en) Writing content identification method and system in learning environment
CN111046293B (en) Method and system for recommending content according to evaluation result
CN111159379B (en) Automatic question setting method, device and system
CN112819174A (en) Artificial intelligence algorithm-based improved ethical virtual simulation experiment method and robot
CN116778771A (en) First aid training and checking system
CN114297425A (en) Recognition interaction method, device, medium and intelligent terminal
CN110968669A (en) Intelligent video analysis police test question classification recommendation method
KR102453835B1 (en) The apparatus and method of modeling of robot motion
CN114625302B (en) Electronic question making method, device, system and storage medium
CN111488431B (en) Hit determination method, device and system
CN113515605B (en) Intelligent robot question-answering method based on artificial intelligence and intelligent robot

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant