WO2000067225A1 - Test, editing and playing system and method - Google Patents
Test, editing and playing system and method Download PDFInfo
- Publication number
- WO2000067225A1 WO2000067225A1 PCT/US2000/011774 US0011774W WO0067225A1 WO 2000067225 A1 WO2000067225 A1 WO 2000067225A1 US 0011774 W US0011774 W US 0011774W WO 0067225 A1 WO0067225 A1 WO 0067225A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- test
- question
- questions
- editor method
- category
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
- G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
- G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
Definitions
- the present invention relates to a test editor and player, and more particularly a test editor and player that is superior in dynamically creating, editing, encrypting and disseminating of test.
- Prior art test creation programs experience problems in that the interfaces employed to use the programs are complex and require substantial user capability in order to create simple tests and the export methods employed allow the user the ability to view the source of the test questions, which could allow the user to compromise the integrity of the test itself. Furthermore, the prior art test creation programs also limit the test output to only an electronic format that precludes it from being utilized in an off-line type of mode.
- the present invention provides a very easy to use interface for editing of the test data that can be saved and exported as a simple rich text format document for distribution as a paper based test or exported as an encrypted test for playback across an electronic medium such as the web.
- the present invention also has the capability to weight categories of test questions along with the ability to pull questions from a category or pool of questions for each category, thus allowing for a very flexible test creation and playback experience.
- the test editor data can also easily be re- purposed for entry into other electronic mediums for analysis in a variety of ways.
- the present invention has been made in view of the above circumstances and has as an object a simple to operate test editor capable of dynamically editing and creating categories and test questions within categories and formatting the questions for play back on a test player.
- a further object of the present invention is to provide a test player capable of reading encrypted tests and further capable of operating pursuant to the formatting of the test.
- a still further object of the present invention is to provide a system having a CPU with memory operating pursuant to instructions to facilitate the creation of, editing, disbursement, encrypting and playing back to the end user via a player a formatted test.
- one aspect of the present invention comprises a test player capable of playing for a user a preformatted test, the test player including a CPU with a memory, capable of receiving and transmitting associated test data to and from a network.
- the software is capable of decrypting and playing back for a user test, wherein the playing back of the test is solely controlled by the format of the test and wherein the software provides the user several capabilities.
- the capabilities are browsing the test questions, saving and terminating the test for later, review past answers, editing answers before submission and interpreting test results.
- test editor method for creating and encrypting test for distribution
- the test editor method includes the steps of defining one or more categories representing sections of a test and assigning each category a weight.
- the method additionally provides for selecting and entering a type of question for each question in each category, inputting question content, along with an associated answer, wherein the question can be entered as a new question or chosen from a pool of available questions.
- the method also provides for formatting the categories and questions such that they are capable of being played back over at least one of a network, stand alone device and a personal digital assistant (PDA) .
- PDA personal digital assistant
- a still further aspect of the present invention provides for a test editor system for creating and encrypting test for distribution over a global network and includes general purpose computer capable of defining one or more categories representing sections of a test and assigning each category a weight .
- the test editor further provides for selecting and entering a type of question for each question in each category, inputting question content, along with an associated answer, wherein the question can be entered as a new question or chosen from a pool of available questions, and formatting the categories and questions such that they are capable of being played back over at least one of a network, stand alone device and a personal digital assistant (PDA) .
- PDA personal digital assistant
- Fig. 1 is flow diagram of the test editing process of the present invention
- Fig. 2 is diagram depicting an entry template of the test editor of the present invention
- Fig. 3 is diagram of a pull -down menu associated with the entry template of Fig. 2 of the present invention
- Fig. 4 is a diagram depicting selection of a category pull-down menu of the present invention.
- Fig. 5 is a diagram depicting selection of a question pull-down menu of the present invention.
- Fig. 6 is a diagram depicting selection of a view pull -down menu of the present invention
- Fig. 7 is a diagram depicting selection of a help pull -down menu of the present invention
- Fig. 8 is a diagram depicting a tool bar of frequently used functions of the editor of the present invention
- Fig. 9 is a diagram depicting selection of the category window of Fig. 4, of the present invention
- Fig. 10 is a diagram depicting selection of the question window of Fig. 5, of the present invention.
- Fig. 11 is a diagram depicting a set of entry fields specific to the type of question selected of the present invention.
- Fig. 12 is a diagram depicting message or instructions dialogue box to the user from the test properties pull-down menu of the present invention.
- Fig. 13 is a diagram depicting category names and percentages and providing the user limit control of these functions of the test properties pull -down menu of the present invention
- Fig. 14 is a diagram depicting a control environment capable of being set by the user from test properties pull -down menu of the present invention
- Fig. 15 is a diagram depicting an appearance dialogue box capable of setting aesthetic attributes of the test from the test properties pull -down menu of the present invention
- Fig. 16 is a diagram depicting a test record dialogue box for providing the user the capability of setting recording options from the test properties pull-down menu of the present invention
- Fig. 17 is a diagram depicting a sample test of the present inven ion
- Fig. 18 is a diagram depicting a sample test of the present invention
- Fig. 19 is a diagram depicting an answer key to a sample test of the present invention
- Fig. 20 is a diagram of an introductory interface of the present invention.
- Fig. 21 is a diagram of a data entry form for a user of the test editor player of the present invention.
- Fig. 22 is a diagram depicting an instruction page of the test of the present invention.
- Fig. 23 is a diagram depicting a sample test of the present invention.
- the test editor system is comprised of an editor and a player.
- the editor is used to create and encrypt tests for distribution.
- the test creator can disseminate the encrypted test file by disk, e-mail, FTP, or other electronic means.
- the player is an application that is used by the user to decrypt and playback tests locally or on the internet. When tests are completed, the player can report scores locally or via the internet or WAN or LAN, as illustrated in Fig. For paper-based tests, the Player application is not required .
- the interface of the test editor application is made up of four main areas: pull-down menus, a toolbar, a category window & a question window.
- a New selection button 310 of File pull -down menu 210 creates a new test data file (TWD extension) .
- An Open selection button 320 opens a previously saved test data file.
- a Close selection button 330 closes the current test data file.
- a Save selection button 340 saves the current test data file to disk or some other storage medium. If the TWD file has not been saved before, this selection prompts the user for a filename.
- Save As selection button 350 prompts the user to save the current test data file with a different filename.
- a View As Text option button 360 hides category and question windows and displays the test material in an RTF format.
- a Properties selection button 370 opens a Properties dialog box. It should be noted that the pull -down menus contain all of the functionality of the player in a standard WindowsTM pull -down menu format .
- a Verify selection button 380 checks the TWD file for omissions and errors and displays these to the user in a window that appears below the category and question windows. Users can double-click on the line item problems to go directly to them.
- a Build selection button 390 initiates a verification process and, if passed, prompts the user for a filename to save an encrypted test file (TST extension) . Under the Build selection button 390 are shortcut selections to the four most recent TWD files. An Exit selection button 395 closes the current test data file and exits the test editor.
- An Edit selection button 220 opens the category name field of the currently selected category, allowing the user to edit the name of the category.
- a Delete selection button 430 deletes the currently selected category from the TWD file. If that category has questions in it, the test editor will prompt the user to erase those questions or assign them to a new category before the deletion process can proceed.
- a New selection button 510 displays a list of question types (such as multiple choice, true/false, matching & ranking, labeling or short answer) that the user can create.
- An Edit selection button 520 opens a dialog box of selected questions, allowing the user to edit its contents.
- a Delete selection button 530 deletes the selected question and its line in the question window from the test data file.
- a last selection in the Question menu 230 is a toggle button (show all) 540 that switches the contents of the question window between all test questions and questions attached to the selected category.
- a Toolbar selection button 610 toggles the display of the toolbar on and off.
- a Status Bar selection button 620 toggles the display of a status bar (along the bottom of the Editor interface) on and off.
- a Messages selection button 630 toggles the display of the Messages window.
- a Help pull-down menu 250 contains a Help Topics selection button 710 that opens a standard Windows HLP file.
- a tutorial selection button 720 launches the test editor computer-based training application.
- An About Test Wizard selection button 730 displays version information and credits for the test editor. It also has an HTML link to the test editor website.
- a toolbar 800 as illustrated in Fig. 8, contains short-cut buttons to frequently used functions of the test editor. These shortcuts have the exact functionality of the pull -down menus selections of the same name.
- a category window 810 lists all categories for a test with their percentages (which must add up to 100%) An area directly above this window displays the path and filename of the current TWD file.
- a left side of the category window (not shown) displays categories in the order they were created. Clicking a category name selects it. Double-clicking it allows the user to edit the name. A right side of the window displays the percentage weight of each category. Double-clicking these values opens the Properties dialog 370 to the Categories tab 220, allowing the percentages to be edited. By default, the percentages are equally distributed to categories as they are created.
- the question window 230 lists questions in the user's test by category or for the full test, as shown in Fig. 9.
- a checkbox directly above the question window allows the user to toggle the display of questions between all in the TWD and only those under the selected category.
- a questions column as shown in Fig. 10, contains question references. By default this is the first twenty characters of the question. Their purpose is to help distinguish questions from each other.
- a type column indicates the type of question. The view column indicates whether the questions is a required or optional question with an R or an 0.
- Each question within a category may be of a different type, (i.e. ranking, matching, T/F, etc.
- Double-clicking on a question line item launches that question's dialog box for editing, as shown in Fig. 12.
- Each question type has a set of entry fields and buttons specific to the type of question.
- the multiple choice question dialog box has an entry field for the question and several for possible answers. Description, Reference, Category and
- Required/Optional Display are items common to all question type dialog boxes.
- the Description is used to help locate questions in the Question Window quickly.
- the Reference is presented to users who do not answer the questions correctly so that they know where to find the answer.
- the Category is a drop-down list of categories from the Category Window. All questions must be assigned to a category.
- a Required/Optional display buttons determine whether or not to display a question every time (required) a test is taken or to add this question to a pool of optional questions for each category. After questions are placed in pools, users can open the Properties box 370 to the Categories tab 220 and set the number of randomly selected questions that should be shown from these pools in each test.
- a Test Properties dialog box depicted in Figs. 13-16, is opened from the pull -down menu or the Properties button 820 on the toolbar 800. It contains five tabs. The first is a Messages tab 1210. This tab contains text items that are shown to the user when the test is administered, as depicted in Fig. 12. The instructions are shown to the student before the test begins, while the pass and fail messages are given to students after they have completed the test - for better or for worse.
- a Categories tab 1220 gives the user control of category names and percentages. It also gives the user a tally of the total number of questions in a category, broken down further by Optional and Required settings. This is the area where the number of optional questions to display per pool is set.
- a Controls tab 1230 gives the user broad control of the testing environment.
- the user can specify a test to be timed 1420, which causes the test to end at the specified time regardless of completion status.
- Bookmarking 1430 allows a user/student to exit the test and return to the point at which he or she left off.
- a Skipping function 1440 lets students skip questions which may be too difficult to answer. Those questions are then presented after all others have been completed.
- a Delete Test On Exit checkbox 1450 will delete the encrypted test from a user's hard drive after completion.
- Test attributes 1460 are version and passing score. Version 1470 is useful to specify the latest revision of a test.
- a passing score 1480 is just that. Any score below this is given a failing designation.
- a Web Control for pass and fail are used when the Player is run via a web browser. These controls cause the URLs specified in each field to be jumped to upon student exit from the test. Which URL is jumped to is determined by whether or not the student passed.
- An Appearance tab 1240 depicted in Fig. 15, is used to set aesthetic attributes of the test.
- the title, instructor and test code appear on the opening screen of the test.
- Login information is used to gather data from the student before the test begins.
- the feedback is used to display or hide correct or incorrect responses to individual questions. This feature allows the Player to function as a survey tool as well.
- the interface drop-down list set the color of some text and graphics on the Player interface .
- a Records tab 1250 depicted in Fig. 16, is where data recording options are set.
- a Print feature causes test data to be printed in RTF format once the test is complete.
- a Save records locally 1620 feature saves test data in RTF format to the user's hard drive.
- a Report passing only 1630 will only invoke record keeping options if the user passes the test.
- a do not score option 1640 will prevent score information from being displayed - for use in surveys.
- An output AICC data 1650 causes test information to be reported to AICC compliant Computer-Managed Instruction systems.
- a FTP transfer settings allows test results to be sent to any FTP location as long as users have an active internet connection at the time the test is complete. Fields are standard FTP protocols with the addition of two directory fields for organization use.
- an e-mail feature 1670 will send test data to the e-mail address specified, provided there is an active internet connection.
- a View As Text feature When a View As Text feature is invoked, as shown in Figs. 17 and 18, the interface changes to show the test in an RTF format.
- Each of the three views is configurable according to font type and size. Any view can also be printed or saved to disk. The first view is the full view. This lists each question of the test in the order it was created. All questions are included along with their correct answer.
- the Test View displays questions in a random order and according to the optional settings the user have specified, if any.
- This view is a preview of an actual printed test, and indeed the user can print a copy directly from the editor to give to a student.
- the shuffle button become active, allowing the user to randomize the display of the questions .
- An Answer Key is a listing of test answers corresponding to questions in the order they appear in the current test view. This view can be printed as an answer key to the test printed under the Test View. Operation of the Player will now be reviewed with reference to Figs. 20-23, begins the display of tests with an introductory screen. At this point the test has been decrypted and the questions have been randomized. At the bottom of the interface is status information or prompts for the user. The top bar displays the test title and the Test editor name. The following screen gathers user data for tracking purposes. This is the login information that is specified to be collected in the editor.
- the test begins. If it is a timed test, the timer will start at this time.
- the test questions are displayed within the center of the Player window. Each type of question has a set of standard instructions which appear in grey under the test title.
- the bottom bar contains action buttons specific to questions, such as reset, submit, next question, etc. It also shows "correct” and "incorrect” feedback per question. In a timed test, a countdown clock is also visible in this bar.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
Claims
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU48120/00A AU4812000A (en) | 1999-04-30 | 2000-04-30 | Test, editing and playing system and method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13202599P | 1999-04-30 | 1999-04-30 | |
US60/132,025 | 1999-04-30 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2000067225A1 true WO2000067225A1 (en) | 2000-11-09 |
WO2000067225A9 WO2000067225A9 (en) | 2002-06-13 |
Family
ID=22452099
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2000/011774 WO2000067225A1 (en) | 1999-04-30 | 2000-04-30 | Test, editing and playing system and method |
Country Status (2)
Country | Link |
---|---|
AU (1) | AU4812000A (en) |
WO (1) | WO2000067225A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111402654A (en) * | 2020-04-02 | 2020-07-10 | 郑善义 | Interactive teaching system based on Internet of things |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO1996021212A1 (en) * | 1994-12-29 | 1996-07-11 | Telide S.A. | Work stations, system and method for a multimedia learning application |
US5657256A (en) * | 1992-01-31 | 1997-08-12 | Educational Testing Service | Method and apparatus for administration of computerized adaptive tests |
WO1998013807A1 (en) * | 1996-09-25 | 1998-04-02 | Sylvan Learning Systems, Inc. | Automated testing and electronic instructional delivery and student management system |
-
2000
- 2000-04-30 WO PCT/US2000/011774 patent/WO2000067225A1/en active Search and Examination
- 2000-04-30 AU AU48120/00A patent/AU4812000A/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5657256A (en) * | 1992-01-31 | 1997-08-12 | Educational Testing Service | Method and apparatus for administration of computerized adaptive tests |
WO1996021212A1 (en) * | 1994-12-29 | 1996-07-11 | Telide S.A. | Work stations, system and method for a multimedia learning application |
WO1998013807A1 (en) * | 1996-09-25 | 1998-04-02 | Sylvan Learning Systems, Inc. | Automated testing and electronic instructional delivery and student management system |
Also Published As
Publication number | Publication date |
---|---|
AU4812000A (en) | 2000-11-17 |
WO2000067225A9 (en) | 2002-06-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US5797754A (en) | Method and system for computerized learning, response, and evaluation | |
Reips et al. | WEXTOR: A Web-based tool for generating and visualizing experimental designs and procedures | |
US10503812B2 (en) | Method and apparatus for materials in different screen sizes using an imaging sensor | |
CA2285468C (en) | Methods and systems for presentation and evaluation of constructed responses assessed by human evaluators | |
Fulcher | Interface design in computer-based language testing | |
Newton et al. | Teaching science with ICT | |
US6808393B2 (en) | Interactive assessment tool | |
KR20070061535A (en) | Systems and methods for teaching a person to interact with a computer program having a graphical user interface | |
EP2027546A2 (en) | Document annotation | |
Brantley et al. | Usability testing of a customizable library web portal | |
WO2001080153A1 (en) | Method and system for network-based education and training capable of evaluating learner"s faithfulness and computer-readable medium recording its program | |
US6632096B1 (en) | Method and apparatus for teaching and learning | |
Lee et al. | Introducing expanding hypertext based on working memory capacity and the feeling of disorientation: Tailored communication through effective hypertext design | |
Danielson et al. | ID and HCI: A marriage of necessity | |
WO2000067225A1 (en) | Test, editing and playing system and method | |
US20030023642A1 (en) | Method and system for marking writings online | |
Eggen et al. | Layered protocols: hands-on experience | |
WO2007134373A1 (en) | Providing user assistance for a software application | |
Small et al. | Evaluating the effectiveness of web sites | |
Cieri et al. | LanguageARC-a tutorial | |
Opdenacker et al. | QuADEM: manual for the quality assessment of digital educational material | |
Hale | The technical assessment of software usability with reference to screen readers for the graphical user interface (GUI) | |
Voelkerding | PowerPoint as an assistive technology tool | |
McCormac | Exploring the Use of Formative Measures for the Comprehensive Evaluation of a Nursing Computer Assisted Learning (N-CAL) Package: Challenging the Traditional Approach to N-CAL Package Construction, Evaluation and Use | |
Stone | Preparing for Web-based Instruction: An exercise in planning and design |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
AK | Designated states |
Kind code of ref document: C2 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: C2 Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG |
|
COP | Corrected version of pamphlet |
Free format text: PAGES 1/5-5/5, DRAWINGS, REPLACED BY NEW PAGES 1/9-9/9; DUE TO LATE TRANSMITTAL BY THE RECEIVING OFFICE |
|
122 | Ep: pct application non-entry in european phase | ||
NENP | Non-entry into the national phase |
Ref country code: JP |
|
DPE2 | Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101) |