KR20120022100A

KR20120022100A - Method and system for managing online correction of practice test

Info

Publication number: KR20120022100A
Application number: KR1020100085214A
Authority: KR
Inventors: 김영각; 윤지영
Original assignee: 김영각
Priority date: 2010-09-01
Filing date: 2010-09-01
Publication date: 2012-03-12

Abstract

Online simulation test correction system according to the embodiments of the present invention, online simulation test processing unit for providing a mock foreign language test online to the test taker's account connected through the network and receiving the answer information entered by the test taker, the type of answer information And a job distribution unit for selecting the corrector to perform the correcting operation among the plurality of correctors according to the working conditions, and assigning the correcting operation to the selected corrector's account for correcting the candidate's answer information transmitted from the online simulation test processing unit. It may include a result management unit for generating a test result report based on the correction results entered after the self-added work assigned to his account to provide to the candidate's account.

Description

METHOD AND SYSTEM FOR MANAGING ONLINE CORRECTION OF PRACTICE TEST}

The present invention relates to an online test system, and more particularly, to an additive management method and system for an online test.

On-line practice tests typically consist of reading, writing, and speaking sections identical to real-world language tests such as TOEFL. In the reading section, the answer usually consists of the number of questions selected for each question, so there is no particular difficulty in scoring or adding. However, in the writing sector, a qualified grader or corrector must read the answers directly so that they can be scored and corrected by topic development, sentence structure, word choice, and mechanics. . Furthermore, in the speech section, scoring and correction should be made in the areas of topic development, delivery, and language usage.

In the case of the writing sector, there has conventionally been an online practice test service which has the structure of passing the candidate's answer text to the grader online and delivering the graded and corrected result back to the grader. However, such online foreign language mock examinations do not provide scoring and correction for the speaking section.

Further, in the case of the conventional online simulation service which can provide the writing and correcting service of the writing answer, the smooth assignment of the scoring work between the service operator and the grader and the return of the scoring / correction result, the scoring / adaptation quality maintenance, the scoring performance Due to the lack of systematic management, it is difficult for service operators to secure excellent language resources, and for the linguists, no reasonable compensation is guaranteed.

The problem to be solved by the present invention is to provide scoring and correction services in the speaking section in the online foreign language simulation test, to provide systematic scoring work assignment and return of scoring and correction results, to maintain the quality of scoring and correction, and to manage scoring performance. To provide an online foreign language simulation test system and operation method.

Online simulation test correction system according to an aspect of the present invention,

An online simulation test processing unit which provides a simulated foreign language test online to an account of an examinee connected through a network and receives answer information input by the examinee;

According to the type and the working conditions of the answer information, a plurality of correctors to select the corrector to perform the corrective work, and the corrective work on the answer information of the test taker delivered from the online simulation test processing unit for the selected corrector's account A job distribution unit assigned to the; And

The corrector may include a result management unit that generates a test result report based on the corrected result input after performing the corrective work assigned to the account and provides the test result to the candidate's account.

According to one embodiment, the job distribution unit

Based on the workload unit of the ablation operation, the attendance status, the ablation capability, and the current workload of the plurality of correctors, randomly or among the correctors among those who can process the ablation work among the plurality of correctors. It may be operable to select the correctors in the order of the list.

According to one embodiment, the job distribution unit

The attendance state is attendance, and may be operable to select correctors whose clearance between the current workload and the maximum workload is greater than the workload unit of the ablation work.

According to one embodiment, the mock foreign language test comprises a speaking test,

The answer information input by the candidate includes speech recording data,

The work distribution unit,

It is operable to assign the correcting operation on the recording record made by the recorder based on the testee's speaking recording data transmitted from the online simulation test processing unit to the selected corrector's account.

According to one embodiment, the job distribution unit

Selecting a recorder to perform a recording operation among a plurality of recorders, assigning a recording operation for the testee's speech recording data transmitted from the online simulation test processing unit to the selected recorder's account, and the selected recorder After performing the recording operation assigned to his account, the user may operate to receive the recording record.

According to one embodiment, the job distribution unit

The selected recorder may be operable to receive and include a transmission power sector score evaluated based on the speech recording data in the recording record.

According to one embodiment, the result management unit

The corrector may be operable to receive the correcting result of adding the speech data according to the pronunciation of the native speaker with respect to the testee's speech recording data.

According to one embodiment, the result management unit

Receive the corrective result inputted by the corrector to the manager, and at the discretion of the manager, the instruction to approve the corrected result to send the re-correction instruction to the corrector account or to terminate the correcting operation. Send to the distribution, and generate a test results report based on the approved additive results.

According to one embodiment, the online simulation test correction system is

A monitor unit for monitoring the amount of the additive work performed for each of the correctors, the progress of the current corrective work and the amount of the pending corrective work, and the amount of the corrected work exceeding the processing period, based on the corrective work assigned by the task distribution unit; It may further include.

According to one embodiment, the monitor unit

If the amount of corrective work exceeding the processing period exceeds a predetermined value, the attendant state of the corrector may be forcibly changed to non-attendance according to the instruction of the manager so that no further corrective work may be allocated.

According to one embodiment, the job distribution unit

The corrector which is determined to have exceeded the processing period by the monitor unit is deleted from the account of the current corrector, and the corrector to perform the correcting operation among the plurality of correctors except the current corrector according to the type and the working condition of the answer information. Operate to select.

Online simulation test additive system operating method according to another aspect of the present invention,

In the method of operating an online mock test correction system that can provide a simulated foreign language test online to the test taker account connected through the network and receive the answer information entered by the test taker,

Selecting, at a job distribution unit, a corrector to perform corrective work among a plurality of correctors according to the type of answer information and the work condition;

Assigning, by the job distribution unit, the correction work on the candidate's answer information to the selected corrector's account;

Receiving, at the job distribution unit, the correction result input after the corrector executes the correction operation assigned to his account; And

The result management unit may include generating a test result report based on the correction result and providing the test result to the candidate's account.

According to one embodiment, in the job distribution unit, the step of selecting a corrector to perform the correcting operation among the plurality of correctors,

Selecting the correctors capable of processing the correcting work among the plurality of correctors based on the workload unit of the correcting work, the attendance status, the correcting ability, and the current workload of the plurality of correctors; And

The method may include selecting a corrector randomly or in order of a list from among the selected correctors in order to process the correcting work.

According to one embodiment, the step of selecting the correctors that can process the correcting operation,

And selecting attendees whose attendance status is attendance and a margin between the current workload and the maximum workload is greater than the workload unit of the ablation work.

The answer information input by the candidate includes speech recording data,

In the job distribution unit, selecting a corrector to perform an additive operation among the plurality of correctors may include:

The method may further include assigning a correction operation on the recording record made by the recorder based on the speech recording data included in the answer information to the selected corrector account.

According to one embodiment, the step of selecting a corrector to perform the correction operation from the plurality of correctors,

Selecting a recorder to perform a recording operation from among the plurality of recorders according to the working conditions;

Assigning a recording operation of the test taker's speaking recording data transmitted from the online simulation test processing unit to the selected recorder's account; And

The selected recorder may include receiving a recording record input after the recording operation assigned to the account.

According to an embodiment of the present disclosure, the receiving of the selected recording record after executing the recording operation assigned to the account of the selected recorder may include:

And including the transmission power score evaluated by the selected recorder based on the speech recording data in the recording record.

According to one embodiment, the step of generating a test result report on the basis of the correction result in the result management unit to provide to the candidate's account,

The corrector may include receiving a correcting result of adding utterance data according to a native speaker's pronunciation with respect to the testee's speech recording data.

Delivering the correction result inputted by the corrector to a manager;

Transmitting an instruction to approve the correction result to the job distribution unit to transmit a re-adding instruction to the corrector account or to terminate the correcting operation at the administrator's discretion; And

And generating a test result report based on the approved correction result and providing the test result report to the candidate's account.

According to one embodiment, the online simulation test correction system operating method,

Monitoring the amount of correcting work performed for each corrector, the progress of the current correcting work and the amount of waiting work corrected, and the amount of correcting work exceeding the processing period, based on the correcting work assigned by the work distribution unit. It may further include.

According to one embodiment, the online simulation test operation system operating method is

If the amount of corrective work exceeding the processing period exceeds a predetermined value may include the step of forcibly changing the attendance state of the corrector to non-attendance according to the instructions of the administrator so that no further corrective work is allocated.

According to one embodiment, in the job distribution unit, a plurality of correctors except for the current corrector according to the type and the work conditions of the corrective information, and deletes the corrective job is determined to exceed the processing period in the current corrector's account; Among them, the method may further include selecting a corrector to perform the correction operation.

A recording medium readable by a computer device according to an aspect of the present invention,

It may be a recording medium having recorded thereon a program for functioning the computer device as an online simulation test addition system according to embodiments of the present invention.

The recording medium readable by the computer device according to another aspect of the present invention may be a recording medium that records a program for executing each step of the online simulation test additive system operating method according to the embodiments of the present invention on the computer device.

According to the foreign language simulation test system and the operating method of the present invention, it is possible to provide a scoring and correction service in the reading, writing and speaking section in the online foreign language simulation test. In addition, the online foreign language simulation test system and operating method of the present invention can provide systematic scoring task assignment and return of scoring / addition results, scoring / adaptation quality maintenance, and scoring performance management.

Furthermore, from the user's point of view, the online foreign language simulation test system and operating method of the present invention can provide an additive service to the user within a designated time.

The online foreign language simulation test system and operating method of the present invention can recruit and manage the correctors worldwide, regardless of time or country, and can be industrialized, large-scaled, and standardized.

1 is a block diagram illustrating an online simulation test additive system in accordance with an embodiment of the present invention.
FIG. 2 is a flowchart illustrating a method in which a candidate views a simulation test and receives scoring and correction results using an online simulation test addition system according to an embodiment of the present invention.
3 is a flowchart illustrating a method of operating an online simulation test additive system according to an embodiment of the present invention.
4 is a diagram illustrating a procedure of distributing additive work in an online simulation test additive system according to an embodiment of the present invention.
5 is a diagram illustrating a procedure for monitoring the correcting operation of the corrector in the operating method of the online simulation test correction system according to an embodiment of the present invention.
6 is a diagram illustrating the management of wages corresponding to the performance of the corrector in the operating method of the online simulation test correction system according to an embodiment of the present invention.

With respect to the embodiments of the present invention disclosed in the text, specific structural to functional descriptions are merely illustrated for the purpose of describing embodiments of the present invention, embodiments of the present invention may be implemented in various forms and It should not be construed as limited to the embodiments described in.

Hereinafter, with reference to the accompanying drawings, it will be described in detail a preferred embodiment of the present invention. The same reference numerals are used for the same constituent elements in the drawings and redundant explanations for the same constituent elements are omitted.

1 is a block diagram illustrating an online simulation test additive system in accordance with an embodiment of the present invention.

The online simulation test correction system 10 includes an online simulation test processing unit 110, a job distribution unit 120, a result management unit 130, and a monitoring unit 140, and a test DB 151 and a lecture data DB 152. ) May further include a candidate account DB 153, an answer DB 154, and a scorer account DB 155. Online simulation test correction system 10 is connected to the main site web server 210, affiliate site web server 220, candidate account management server 230, scorer account management server 240, manager server 250, The candidate 310, the recorder 320, the corrector 330, the manager 340, and the affiliated site lecturer 350 are connected to the main site web server 210 and the affiliate site web server 220 through the network 160. The scorer account management server 240 may be connected to the manager server 250.

Online simulation test correction system 10 of the present invention retains the simulated test content in the test DB (151), the lecture content, teaching material content, etc. in the lecture material DB 152, respectively, the main site web server ( Simulated test content and lecture / teaching material content through the 210 may be provided to the terminal of the candidate 310, for example in the form of a web service. In addition, the online simulation test correction system 10 of the present invention also provides a predetermined content in the form of a web service, for example, to a terminal of the candidate 310 connected to the affiliated site web server 220 contracted to receive the content. Can provide.

The service provider is a company that operates the online simulation test correction system 10 of the present invention, and can directly recruit members and provide simulation test contents and lecture / teaching contents, and provide simulation tests, scoring, and correction services. Can be. Furthermore, service providers continue to develop mock exam content and lecture / teacher content, which sells licenses to affiliates for the developed content. Affiliates may purchase the right to use the necessary content and provide mock exam content and lecture / teacher content to their members. Affiliates can also provide their members with mock exams, scoring and correction services through service providers. By retaining affiliates, service providers can reduce their marketing costs while paying for content development and grader hiring, while affiliates can provide members with high-quality content and mock test / scoring / adding services.

Service providers can have access to the mock exam services with varying levels of membership. Affiliates, such as schools, schools, online foreign language communities, and private tutors, can purchase content licenses directly and receive coupons to use mock exam services. Service providers and affiliates can provide their general members with coupons for accessing the content associated with the lecture. In this case, the members may not purchase the content use right, but may use the simulation test service by inputting identification information of the coupon provided from the company to the online simulation test correction system 10.

The candidate 310 corresponding to the general member uses a terminal such as a PC to access the main site web server 210 or the affiliated site web server 220 according to a company he subscribes to and selects an online simulation test service. The main site web server 210 or the affiliated site web server 220 is connected to the online simulation test processing unit 110, and after confirming the coupon identification information input by the candidate 310, the online simulation test is performed on the terminal of the candidate 310. Serve the page as a web service.

Online practice exams are organized into reading, listening, writing and speaking sections in the same way as actual foreign language exams such as TOEFL. In the Reading and Listening section, the answer usually consists of the number of questions selected for each question, so there is no particular difficulty in scoring or correcting. However, in the case of the TOEFL, for example in the writing section, a qualified grader or corrector should read the answer directly to the topic development, sentence structure, word choice, and mechanics areas. I can grade and correct it very much. Furthermore, in the speech section, scoring and correction should be made in the areas of topic development, delivery, and language usage. Depending on the type of test, the areas requiring correction may vary somewhat.

In the online simulation test addition system 10 of the present invention, a grader may be classified into a transcriptor capable of recording a speaking answer, an evaluator capable of scoring and correcting, and a supervisor. . Managers can monitor recording / scoring / adding operations, review test results reported by recorders and correctors, and approve or direct re-adding. In addition, the manager may redistribute the work by bypassing the work distribution unit 120. For example, an administrator may return some of the corrector's corrective work that has a record that is past the due date and assign it to another corrector. In addition, managers can manage performance compensation based on the scorers' recording, scoring, and correction performance.

On the other hand, such redistribution process can be automatically assigned to other graders through the normal grader selection process once again by canceling the work assignment for the corresponding grader if a certain condition is satisfied according to the grader's scoring state without the manager's instructions .

This redistribution process allows the present invention to ensure that the additive service is provided to the user, for example within 48 hours.

The online simulation test addition system 10 of the present invention acquires data recording the speaking of the test taker 310 in the online simulation test processing unit 110, and performs scoring and correction of the transmission force area in the course of recording by the recorder. Based on the recording record made by the recorder, the corrector performs the development of the theme and the scoring and correction of the vocabulary area. Further, where possible, data recorded by native speakers or recordings by native speakers may be attached to test results reports.

To this end, the online simulation test processing unit 110 provides a simulated foreign language test online to the terminal of the candidate 310 connected through the network 160. The simulated foreign language test may be displayed on the terminal of the candidate 310 through a conventional web browser, for example, Flash ™, Java ™ plug-in as a web service, or may be displayed by driving a dedicated client program. The test taker 310 inputs answer information for each section, and the only simulation test processing unit 110 receives an answer number, a writing text, and speaking recording data as answer information.

The online simulation test processing unit 110 may grade the received answer information directly by referring to the test DB 151 when the answer information is the answer number. However, when the answer information is the writing text or the speech recording data, the work distribution unit may include the answer information. Forward to 120. The online simulation test processor 110 may transfer the read answer information scored by itself to the result manager 130.

The job distribution unit 120 receives the answer information, and the type of answer information and the conditions of the scoring / addition work on the online simulation test, for example, the language skills and qualifications required for the scoring / addition, and the amount of labor required (man- scoring / adding a number of scorers, depending on conditions such as the unit of work quantifying the hour, the status of the grader's attendance, the amount of work currently assigned by the grader, the maximum number of graders' work, and the frequency at which the grader has not recently processed the task in a timely manner. Select a grader to perform the task.

To do this, each grader pre-sets his or her area of processing, the maximum amount of work he or she can do, the area of testing he or she is assigned to, the language proficiency, the qualifications, and the difficulty of the test. Such scorer-specific information may be stored and managed in the grader account DB (155).

Administrators can manage groups of multiple scorers. In addition, managers can predetermine the unit of work for quantified recording / scoring / addition work according to the distribution criteria for each foreign language test, test field, scoring field, and difficulty level. For example, if an English practice test consists of a writing and speaking field, the manager may set the amount of work to be scored in the writing field, or the unit of work, to be 0.5 for recording in the speaking field and 0.5 for scoring. The unit of work can be set in advance.

The job distribution unit 120 may process the additive work among the multiple correctors based on the unit of work amount of the preset tasks set by the administrator in advance, the attendance status, the correction ability, and the current workload of the plurality of correctors. One of them may be selected as the corrector of the corrective operation. At this time, the corrector in the ranking may be selected as the corrector to perform the correcting operation from the list of correctors.

In particular, the job distribution unit 120 is the current attendance state among the plurality of correctors, 'attendance', the current work being assigned on the day and the amount of work between the current workload and the maximum amount of work is larger than the work unit of the correcting work, the new corrective work The correctors can be selected from among the correctors who can be assigned to

For example, if a corrector has the ability to grade / correct advanced English writing and speaking, and set the maximum amount of work he can handle per day to 4, the corrector will have a workload unit of 2 per day. One set of English mock exams, two speech corrections with a workload unit of 0.2, an essay correction with a workload unit of 0.5, and four English diary corrections with a workload unit of 0.1, are assigned and processed for the workload of 3.3. Can be. At this time, if the new test taker advanced writing correction work of the unit of work amount of 0.25 occurs, the work margin of the upper corrector reaches 0.7 so that the job distribution unit 120 can assign the correcting work to the above correctors. have. At this time, the job distribution unit 120 may assign a corrective job to the corrector in the ranking among the list of correctors satisfying such a work condition.

On the other hand, the corrector may be selected in plurality for cross-checking or providing an average score.

The job distribution unit 120 assigns the recording / scoring / additional work on the answer information of the candidates delivered to the selected scorer's account. Recording / scoring / adding operations assigned to the grader account are stored in the grader account DB 155.

The scorers 320 and 330 connect to the scorer account management server 240 through a web page for each job provided by the main site web server 210. The grader account management server 240 refers to the grader account DB 155 and provides the recording / scoring / addition work assigned to the account of the graders 320 and 330 to the terminal of the graders in the form of a web service.

The job distribution unit 120 assigns a scoring / addition task of the writing text to the account of the corrector 330 selected among the plurality of correctors regarding the writing text among the answer information.

In addition, the job distribution unit 120 assigns the recording operation of the speaking recording data to the account of the recorder 320 selected from among the plurality of recordingers regarding the speaking recording data among the answer information. Furthermore, when a recording record corresponding to the speech recording data of the answer information is transmitted, the job distribution unit 120 scores / adds the recording recording and the speech recording data to the account of the selected corrector 330 among the plurality of correctors. Assign work.

At this time, the job distribution unit 120 may automatically distribute the correction jobs to the correctors without the intervention of the administrator.

The scorers 320 and 330 perform their assigned recording / scoring / addition tasks and upload the results. The grader account management server 240 transmits the graded / corrected result uploaded from the corrector 330 to the result manager 130. On the other hand, for the recording record made by the recorder 320, the scorer account management server 240 transfers the uploaded recording record back to the job distribution unit 120.

The result management unit 130, if the corrector 330 inputs the scoring / correction result after performing the scoring / correction task assigned to their account, generates a test result report based on the input scoring / correction result, The generated test result report is provided to the candidate 310's account. The test result report may be generated based on some or all of the scorer's scoring record, the additive record, or the native speaker's voice recording data.

The test result report is generated when the manager 340 approves the entered scoring / addition result as appropriate. If the manager 340 determines that the scoring / adding result is not appropriate, the manager 340 instructs the re-scoring / re-adding without approval.

On the other hand, according to an embodiment, when the test taker 310 is a member of an affiliate company, the test result report is not delivered in a state that the test taker 310 can view, and firstly, the affiliate company has its own report in the test result report. It can be delivered to some kind of server managed by an affiliate for adding comments. Subsequently, the candidate 310 may check the test result report after processing in an affiliate company in his / her account.

The monitoring unit 140 continuously monitors the scoring / adding work assigned to each grader in the job distribution unit 120, and the amount of the correcting work performed for each corrector, the progress of the current correcting work, and the amount of waiting correcting work. And monitor the amount of additive work that has passed the deadline. The monitoring result is transmitted to the result manager 130.

On the other hand, the manager 340 is connected to the manager server 250 through the main site web server 210, the manager server 250 is the result management unit 130 and the monitoring unit 140 of the online simulation test correction system 10 ), Review the reported scoring / adding results to instruct approval or re-scoring / re-adding, or view the status of the registered graders 320 and 330, The job distribution unit 120 may be instructed to recover from the current grader and assign it to another grader.

In addition, the manager, through the manager server 250, the amount of compensation corresponding to the results calculated based on the amount of additive work performed for each corrector of the registered scorers (320, 330) and the amount of additive work beyond the processing deadline Can manage.

FIG. 2 is a flowchart illustrating a method in which a candidate views a simulation test and receives scoring and correction results using an online simulation test addition system according to an embodiment of the present invention.

Referring to FIG. 2, the test taker is a special individual member who purchases the mock test content and receives the mock test coupon, or a general member who receives the mock test coupon from an affiliate company as a member of an affiliate company.

In step S21, the test taker accesses the online simulation test correction system and logs in, and inputs an identification number of the simulation test take coupon.

In step S22, if the identification number of the coupon is approved, the candidate starts the online mock foreign language test service and inputs an appropriate answer according to the test progress.

In step S23, the candidate submits an answer and logs out of the system.

In step S24, after a predetermined time period for scoring / correcting, the candidate is scored and corrected in regard to reading, listening, writing and speaking sections in his account, and optionally the corrected voice data of the native speaker is further added. You can check the attached test result report.

3 is a flowchart illustrating a method of operating an online simulation test additive system according to an embodiment of the present invention.

In general, the online mock examination is performed by the test taker by providing a mock foreign language test online to the account of the test taker 310 connected through the network 160 and receiving answer information input by the test taker 310.

However, the online simulation test correction system 10 of the present invention differs from the conventional online simulation test in a procedure in which answer information input by the test taker 310 is processed and provided to the account of the test result report test taker 301 again. .

Referring to FIG. 3, in operation S31, a method of operating an online simulation test correction system 10 may include a scorer who performs scoring / addition work among a plurality of scorers according to the type of answer information and work conditions. Beginning with the step of selecting from the allocation (120). As described above, the scorer includes a transcript and an additive.

Specifically, step S31 is based on the unit of work of the weighting operation and the state of attendance, the correcting ability and the current workload of the plurality of correctors, among the plurality of correctors to meet the working conditions that can handle the correcting work Select the correctors to be corrected sequentially from the list of selected correctors.

In particular, correctors who meet the working conditions are those who are present and who have the ability or qualification to make corrections in the area, and whose current and maximum workloads are larger than the workload units of the additive work. Can be selected.

Subsequently, in step S32, the job distribution unit 120 assigns the correction work on the candidate's answer information to the selected corrector's account.

In step S33, if the corrector inputs the correcting result after the corrector is assigned to his or her account at the terminal of the corrector, the correcting result is received by the work distribution unit 120. According to an embodiment, the correction result may be accompanied by corrected voice data of the native speaker corrector.

In step S34, based on the additive work assigned by the job distribution unit 120, the amount of the correcting work performed for each corrector, the progress of the current correcting work, the amount of the correcting work waiting, and the correcting work beyond the processing deadline. Monitor the amount of. If the amount of corrective work exceeding the processing period exceeds a predetermined value, the attendance state of the corrector 330 may be forcibly changed to non-attendance according to the instruction of the manager 340 so that no further corrective work may be allocated. have. In addition, managers can reduce their maximum workload by ex officio for those who frequently miss the deadline.

In step S35, the result management unit 130 generates a test result report based on the correction result and provides it to the account of the candidate 310.

At this time, the manager 340 receives the correction result input by the corrector 330 while connected to the manager server 250, and returns the correction operation to the corrector account while instructing to re-add, or corrects. The work can be approved. The result manager 130 may generate a test result report based on the approved correction result and provide it to the account of the candidate 310. On the other hand, the result management unit 130 may transmit an instruction for approval of the additive result to the job distribution unit 120 so that when the manager 340 approved the additive result is completed.

On the other hand, the frequency of approval or rejection of the additive result of step S35 may also be monitored by an administrator in the monitoring step of step S34. For high-density additives, administrators can reduce the maximum amount of work on their own, change attendance to non-attendance, prevent new assignments, or change the difficulty or type of process that can be processed.

The candidate 310 may check the scoring results and corrections posted on his or her account after a predetermined period of time.

4 is a diagram illustrating a procedure of distributing additive work and reporting of additive and scoring results in an online simulation test additive system according to an embodiment of the present invention.

Referring to FIG. 4, the detailed steps of step S31 of FIG. 3, which is a procedure of distributing the additive work, may be illustrated as follows.

In step S311, the procedure branches according to the type of answer information.

If the answer information is a reading and listening answer, the scoring may be performed mechanically by comparing the answer number in the answer information with the correct answer number stored in the test DB 151 without selecting a scorer in step S312. The result is immediately transmitted to the result manager 130.

If the answer information is the writing text on the writing section, the answer information is directly transmitted to the job distribution unit 120 in step S313.

Finally, if the answer information is speech recording data about the speaking section, in step S314, a recorder to perform a recording operation is selected from among a plurality of recorders according to the working conditions.

In step S315, the recording operation of the candidate's speech recording data is allocated to the selected recorder's account, and the selected recorder uploads the recording record uploaded after performing the recording operation assigned to his / her account. 120 receives. The job distribution unit 120 may treat the input recording record as answer information along with the speaking recording data that is the object of recording.

In step S316, the corrector is selected from among the plurality of the correctors according to the conditions capable of processing the correcting task, based on the workload unit of the correcting operation, the attendance status of the plurality of correctors, the correcting ability, and the current workload. At this time, the attendant in attendance is eligible to select the attendant in the list from among the survivors whose attendance status is present, and who is entitled to process the correcting area, and whose current amount of work and the maximum amount of work allowance are larger than the unit of work amount of the additive operation. .

In step S32, a scoring / correcting operation is assigned to each corrector.

In step S33, the corrector 330 at the terminal of the corrector 330 performs the scoring / correction task assigned to its account and then transmits the scoring / correction result.

In step S35, the test result report is generated based on the correction result and provided to the account of the candidate 310.

At this time, in step S351, the manager 340 may receive the correction result inputted by the corrector 330, and return the correction operation to the corrector account while instructing to reject the approval and re-adding, Alternatively, the additive operation may be approved in step S352.

In step S353, a test result report based on the approved additive result is generated and provided to the candidate 310's account.

5 is a diagram illustrating a procedure for monitoring the correcting operation of the corrector in the operating method of the online simulation test correction system according to an embodiment of the present invention.

Referring to FIG. 5, IDs, names, total rejects, recent rejects, current progress, standbys, maximum units, and attendance status of the correctors (on / off) and overtime traffic are monitored respectively.

On the other hand, the manager can forcibly change the maximum work amount and attendance status of the corrector while monitoring the progress of the corrective work.

6 is a diagram illustrating the management of wages corresponding to the performance of the corrector in the operating method of the online simulation test correction system according to an embodiment of the present invention.

One of the important features of the present invention is that, if it can be connected to the network, it is possible to recruit a number of competent correctors at any time and place, and commission the corrective work according to the ability and situation of the correctors. Can be distributed. Furthermore, the correctors can correctly receive the wage corresponding to the performance by performing the correcting work properly within a predetermined time.

For example, the first corrector performed the additive work corresponding to the workload unit 2 on the 101 product which is one of the simulated test contents, and a predetermined salary is calculated for each workload unit to determine the total wage.

As described above, although the present invention has been described by way of limited embodiments and drawings, the present invention is not limited to the above-described embodiments, which can be variously modified and modified by those skilled in the art to which the present invention pertains. Modifications are possible. Accordingly, the spirit of the invention should be understood only by the claims set forth below, and all equivalent or equivalent modifications will fall within the scope of the invention.

In addition, the apparatus according to the present invention can be embodied as computer readable codes on a computer readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the recording medium include ROM, RAM, optical disk, magnetic tape, floppy disk, hard disk, nonvolatile memory, and the like, and also include a carrier wave (for example, transmission through the Internet). The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

10 online practice test correction system
110 Online practice test 120 Job distribution
130 Results Management Unit 140 Monitoring Unit
151 Exam DB 152 Syllabus DB
153 Candidate Account DB 154 Answer DB
155 Scorer Account DB 160 Network
210 Main Site Web Server 220 Affiliate Site Web Server
230 Candidate Account Management Servers 240 Scorer Account Management Servers
250 Admin Server 310 Candidate
320 Recorder 330 Corrector
340 administrators 350 affiliate site instructors

Claims

An online simulation test processing unit which provides a simulated foreign language test online to an account of an examinee connected through a network and receives answer information input by the examinee;
According to the type and the working conditions of the answer information, a plurality of correctors to select the corrector to perform the corrective work, and the corrective work on the answer information of the test taker delivered from the online simulation test processing unit for the selected corrector's account A job distribution unit assigned to the; And
And a result management unit for generating a test result report based on the correction result entered after the correction operation is assigned to the account of the corrector and providing the test result report to the candidate's account.

The method of claim 1, wherein the job distribution unit
Based on the workload unit of the ablation operation, the attendance status, the ablation capability, and the current workload of the plurality of correctors, randomly or among the correctors among those who can process the ablation work among the plurality of correctors. An online simulation test additive system, characterized in that it operates to select the correctors according to the order of the list.

The method of claim 2, wherein the job distribution unit
And wherein the attendance state is attendance and is operable to select correctors whose clearance between the current workload and the maximum workload is greater than the workload unit of the ablation work.

The method of claim 1, wherein the simulated foreign language test comprises a speaking test,
The answer information input by the candidate includes speech recording data,
The work distribution unit,
And assigning a correction operation on a recording record made by a recorder based on the testee's speaking recording data transmitted from the online simulation test processing unit to an account of the selected corrector.

The method of claim 4, wherein the job distribution unit
Selecting a recorder to perform a recording operation among a plurality of recorders, assigning a recording operation for the testee's speech recording data transmitted from the online simulation test processing unit to the selected recorder's account, and the selected recorder An online simulation test correction system, characterized in that it operates to receive the recording records entered after the recording operation assigned to his account.

The method of claim 5, wherein the job distribution unit
And the recording unit is operable to receive the transmission power sector score evaluated by the selected recorder based on the speech recording data in the recording record.

The method of claim 5, wherein the result management unit
And the corrector receives a correction result of adding utterance data according to a native speaker's pronunciation with respect to the testee's speech recording data.

The method of claim 1, wherein the result management unit
Receive the corrective result inputted by the corrector to the manager, and at the discretion of the manager, the instruction to approve the corrected result to send the re-correction instruction to the corrector account or to terminate the correcting operation. Send to the distribution and generate a test result report based on the approved additive result.

The method according to claim 1,
A monitor unit for monitoring the amount of the additive work performed for each of the correctors, the progress of the current corrective work and the amount of the pending corrective work, and the amount of the corrected work exceeding the processing period, based on the corrective work assigned by the task distribution unit; An online simulation test additive system further comprising.

The method of claim 9, wherein the monitor unit
If the amount of corrective work exceeding the processing period exceeds a predetermined value, the online simulation forcibly changes the attendance status of the corrector to non-attendance according to the manager's instruction so that no further corrective work can be allocated. Test additive system.
The method according to claim 9, wherein the job distribution unit
The correction operation which is determined to have exceeded the processing period by the monitor unit is deleted from the current corrector's account, and the alternative correcting operation is performed among the plurality of correctors except the current corrector according to the type and the working condition of the answer information. An online simulation test additive system, characterized in that it operates to select the ruler.

The method according to claim 9, wherein the job distribution unit
The corrector which is determined to have exceeded the processing period by the monitor unit is deleted from the account of the current corrector, and the corrector to perform the correcting operation among the plurality of correctors except the current corrector according to the type and the working condition of the answer information. An online simulation test additive system, characterized in that it is operative to select.

In the method of operating an online mock test correction system that can provide a simulated foreign language test online to the test taker account connected through the network and receive the answer information entered by the test taker,
Selecting, at a job distribution unit, a corrector to perform corrective work among a plurality of correctors according to the type of answer information and the work condition;
Assigning, by the job distribution unit, the correction work on the candidate's answer information to the selected corrector's account;
Receiving, at the job distribution unit, the correction result input after the corrector executes the correction operation assigned to his account; And
And a test result report generated by the result manager based on the corrected result and provided to the candidate's account.

The method of claim 12, wherein in the job distribution unit, selecting a corrector to perform the correcting operation among the plurality of correctors,
Selecting the correctors capable of processing the correcting work among the plurality of correctors based on the workload unit of the correcting work, the attendance status, the correcting ability, and the current workload of the plurality of correctors; And
Selecting the correctors to process the corrective work among the selected correctors at random or in the order of the list.

The method of claim 13, wherein selecting the correctors capable of processing the correcting operation,
And selecting the correctors whose attendance status is attendance and the margin between the current workload and the maximum workload is greater than the workload unit of the ablation work.

The method of claim 12, wherein the simulated foreign language test comprises a speaking test,
The answer information input by the candidate includes speech recording data,
In the job distribution unit, selecting a corrector to perform an additive operation among the plurality of correctors may include:
And assigning a correction operation on the recording record made by the recorder based on the speech recording data included in the answer information to the account of the selected corrector.

The method according to claim 15, wherein the step of selecting a corrector to perform the correcting operation from the plurality of correctors,
Selecting a recorder to perform a recording operation from among the plurality of recorders according to the working conditions;
Assigning a recording operation of the test taker's speaking recording data transmitted from the online simulation test processing unit to the selected recorder's account; And
And receiving a recording record input after the selected recorder performs a recording operation assigned to his or her account.

The method according to claim 16, wherein the recording step of receiving the recording records input after the recording operation assigned to the account of the selected recorder,
And a step of receiving the transmission power score evaluated by the selected recorder based on the speech recording data in the recording record.

The method of claim 16, wherein the result management unit generates a test result report based on the correction result and provides it to the candidate's account,
And the corrector receiving a correction result of adding utterance data according to a native speaker's pronunciation with respect to the test taker's speech recording data.

The method of claim 12, wherein the result management unit generates a test result report based on the correction result and provides the test result to the candidate's account.
Delivering the correction result inputted by the corrector to a manager;
Transmitting an instruction to approve the correction result to the job distribution unit to transmit a re-adding instruction to the corrector account or to terminate the correcting operation at the administrator's discretion; And
And generating a test result report based on the approved additive result and providing the test result report to the test taker's account.

The method of claim 12,
Monitoring the amount of correcting work performed for each corrector, the progress of the current correcting work and the amount of waiting work corrected, and the amount of correcting work exceeding the processing period, based on the correcting work assigned by the work distribution unit. On-line simulation test correction system operating method characterized in that it further comprises.

The method of claim 20,
And forcibly changing the attendance state of the corrector to non-attendance according to the administrator's instruction so that no further additive work may be allocated when the amount of the corrective work beyond the processing period exceeds a predetermined value. How to operate an online practice test correction system.

21. The method according to claim 20, wherein in the job distribution unit, a plurality of correctors except for the current corrector according to the type of answer information and the work condition are deleted, and the corrective job determined to have exceeded the processing period is deleted from the account of the current corrector. The online simulation test correction system further comprising the step of selecting a corrector to perform the correction operation among.

A recording medium readable by a computer device having recorded thereon a program for functioning the computer device as the online simulation test addition system of any one of claims 1 to 10.

A computer-readable recording medium having recorded thereon a program for executing steps of the method for operating an online simulation test system according to any one of claims 12 to 21 on a computer device.