ExamView Test Manager User Guide 9.
ExamView Test Manager 2 © 2015 Turning Technologies, LLC. All rights reserved. Portions Responsive Innovations, LLC, Microsoft Corporation No part of this document may be reproduced or transmitted in any form or by any means, electronic or mechanical, for any purpose, without the express written permission of Turning Technologies, LLC. All rights reserved. Turning Technologies, LLC, 255 West Federal Street, Youngstown, OH 44503 USA. TurningPoint® is a registered trademark of Turning Technologies, LLC.
ExamView Test Manager 3 Table of Contents TABLE OF CONTENTS 3 ABOUT EXAMVIEW TEST MANAGER Getting Started Navigating the Software The Test Manager Toolbar 5 5 6 7 CLASSES Creating a New Class Opening an Existing Class Importing a Class Roster from Text (Mac) Importing a Class Roster from Text (PC) Importing a Class Roster Through the Wizard Performing Advanced Import Mapping (PC Only) Importing a Class Roster from CPS Exporting a Class Roster as a Text File Exporting a Class Roster as a CPS Database A
ExamView Test Manager Exporting Assignment Results as a Text File Exporting Assignment Results as an XML File Exporting Detailed Results 4 33 33 34 REPORTS Creating/Managing Custom Filters Class Reports Assignment Results by Class Class Assignment Summary Open-Ended Responses Worksheet Item Analysis Summary Item Remediation Summary Learning Focus by Class Performance Summary by Class Class Performance Progress Chart Class Roster Student Reports Assignment Results by Student Assignment Review Student Pro
ExamView Test Manager About ExamView Test Manager ExamView® Test Manager provides the features you need to track results for paper and online tests created with the ExamView Test Generator. With the ExamView Test Manager, you can... l create class rosters that can include a wide range of student information including demographic information. l score paper tests automatically using a scanner. l administer paper tests and get results immediately using response pads.
ExamView Test Manager Navigating the Software The ExamView Test Manager software was designed with the look and feel of a standard gradebook. Students are listed in rows along the left side with assignments listed in columns to the right. A Toolbar - Click the toolbar icons to quickly access common tasks. B Class Information - Double-click this area to edit the class information. C Column Headers - Click the column header to sort the data by that information.
ExamView Test Manager 7 The Test Manager Toolbar The Test Manager toolbar provides ready access to the most commonly used tools. Because all the toolbar tool functions can also be accessed using menus, you may select to turn off the toolbar completely to allow the maximum screen space for viewing the class gradebook. PC users can further customize their toolbar to select which tools are displayed and the size of the tool icons.
ExamView Test Manager 8 Classes The ExamView Test Manager provides the features you need to track results for paper and online tests. To begin, you must create a new class. Then, you can manually enter the student information or import a roster from another format such as your grade book.
ExamView Test Manager 9 Creating a New Class By default, class files (with a CLS extension) are stored in the Classes folder within the ExamView folder. 1 Open ExamView Test Manager and select . If you are already working in the ExamView Test Manager, save the current class, click File from the menu bar and select New Class or click . 2 Enter the class name. 3 Optionally, enter other class information, such as a Class ID, Period, Section, and Password.
ExamView Test Manager 10 4 Use the drop down lists to map the text data to the ExamView Test Manager field. NOTE First name, Last name, and Student ID fields are required. The other data fields are optional. Text information can be used for multiple Test Manager fields. For example, a student's last name could also be used for their student ID. 5 Click OK. The imported students are added to the current class.
ExamView Test Manager 11 Importing a Class Roster Through the Wizard The Import Class Roster Wizard is a three-step process that allows advanced import mapping of a text file to the Test Manager's Student Information. 1 Step 1: a Set the row number to start importing student roster records. l Use the Preview window to view the first 10 rows of the text file. The row numbers are included in the preview. l l Many text rosters contain header information, a row of labels for each data column.
ExamView Test Manager 12 3 Step 3: a Value restricted fields correspond to check boxes in the Student Information dialog and require additional text mapping to indicate which check box should be selected. Value restricted fields flagged for import will display either a check mark or warning icon next to their name. To ensure successful import of all the desired data, advanced field mapping should be performed until no warning icons are displayed. Click Edit Mapping to perform this step.
ExamView Test Manager l 13 Mapping is not limited to the entries present in the current file. To make the import definition profile more generalized, you may key in values not shown in the Unique File Entries list but anticipate needing in a future import. 2 Refer to the Unique File Entries list to determine if all unique entries have been mapped. Entries not yet mapped appear in red. Click Update List to refresh the list.
ExamView Test Manager 14 1 Click File from the menu bar, mouse over Export and select Class Roster as Text. 2 Depending on the requirements of the program into which you wish to import the file, select the appropriate name format, data, field separator, and quote option. 3 Click OK. 4 Enter a file name for your text file and select an appropriate save location. 5 Click Save.
ExamView Test Manager 15 Enter information in the Password field if you plan on using online (LAN) tests and want your students to each have a unique password. You can also set an overall test password for each online test and have all students use this password. In this case, you would leave the Password field blank for your students. NOTE If you plan to use clickers, you will need to fill in the clicker ID number. Valid clicker ID values are whole numbers between 1 - 1000.
ExamView Test Manager 16 Editing Student Information 1 From the main window, double click the student you want to edit. Or, highlight the student, click Student from the menu bar and select Edit Student Information. 2 Add, edit, or delete any of the student information as desired. Click More to view additional fields. IMPORTANT Remember, the First name, Last name, and Student ID fields are required and cannot be blank. 3 To cancel any edits made to the current student, click Reset.
ExamView Test Manager 1 To save a class, click File from the menu bar and select Save or click 17 . NOTE If any of your online test (EOT) files have been moved or deleted since you created the assignment, you will be given the opportunity to locate these files when you save your class. To see the original location of the test file, choose Edit Assignment Information from the Assignment menu or select Update Online Tests from the File menu.
ExamView Test Manager 18 Assignments Gathering detailed data and presenting it in useful reports to help you make effective decisions is the primary purpose of the ExamView Test Manager. The software can gather data from printed tests (either manually graded or automatically graded with a scanner), and from online (LAN-based) tests taken with the ExamView Test Player software. Before you can gather data from a test, you must create an assignment from the test using the ExamView Test Manager.
ExamView Test Manager 19 Creating a New Assignment (Paper Test) When you create an assignment, you can choose to administer a test as both a paper test and an online test. 1 Use ExamView Test Generator to build a test and print copies for each student. 2 Open ExamView Test Manager and open your class. NOTE A single class may contain up to 200 assignments. 3 Click Assignment from the menu bar and select Create New Assignment or click . 4 Enter the assignment name.
ExamView Test Manager 20 Creating a New Assignment (LAN Test) When you create an assignment, you can choose to administer a test as both a paper test and an online test. 1 Use ExamView Test Generator to build a test and publish it as an online test (EOT file) for use with the ExamView Test Player. See the ExamView Test Generator help file for more details on how to publish an online test.
ExamView Test Manager 21 NOTE If you specify a date and time when an online test is accessible to students, the test will not appear in the list of tests in the ExamView Test Player when it is outside of that date/time range. 13 Click Next. 14 Optionally, set a time limit for the test. You can also choose whether or not students can pause the timer. While a test is paused, questions do not appear on the screen. 15 Select the question presentation order.
ExamView Test Manager 22 from LAN Test from the Assignment menu. You should see the score for that student. Next, highlight (select) the student record and choose Clear Student Results from the Student menu. Be sure to clear the results for the test you just previewed. l l l l Many ExamView question banks contain feedback information. Feedback provides hints or tips for finding the correct answer. See the ExamView Test Generator help file for more information on feedback.
ExamView Test Manager 23 b Once the roster is verified, select some or all of the session data listed. Each session data listing that is selected is imported into Test Manager as a separate assignment. 6 Assign point values, then click Next. CPS assigns equal point values for all questions within a session. By default, this value is 1 point per question. A different per question point value may be entered for each assignment.
ExamView Test Manager 24 IMPORTANT Changing assignment information with the Edit Assignment Information command only changes the information for the specified assignment in the current class. For example, if you change an answer in an online test and then reuse the test in a different class, the original answer will be used. 2 Click the General tab to edit the assignment name, ID, category, term, and date. 3 Click the Questions tab to edit answers, question information, or question point values.
ExamView Test Manager 25 1 Click File and select Update Online Tests. A list of the active LAN test assignments appears. For each assignment, the test file name and status appear. The status indicates whether the test file is currently in-sync with Test Manager or if information needs to be communicated. The status of an assignment may be any of the following: l OK - Everything is up to date. l needs update - The information in the online (EOT) test file does not match the information in Test Manager.
ExamView Test Manager 26 Results from Scanners ExamView Test Manager currently supports a variety of scanner models and forms that allow you to collect student assignment results. Visit the eInstruction by Turning Technologies website (www.turningtechnologies.com) to get the most upto-date list of ExamView supported scanners and form options.
ExamView Test Manager 27 5 Click Start Scanning to activate the scanning session. NOTE Verify that the scanner is connected properly before you try to scan the forms. If you have trouble with the scanner, view the Troubleshooting section of this help file. If you are still having problems, contact the scanner manufacturer for support. 6 Scan the forms. If the student ID on the form does not match an ID in your class roster, the program allows you to select the student from your roster.
ExamView Test Manager 28 4 Select the desired scanner from the drop-down list. A separate entry will appear for every imaging device with TWAIN drivers installed on the computer. Some scanner manufacturers will install multiple drivers for a scanner, so multiple entries will appear in the list for a single scanner. Try to select the entry for the scanner that is most appropriate for the model and connection of your scanner. Refer to the Troubleshooting section for additional details.
ExamView Test Manager l l 29 You can scan forms in multiple sessions. If there are problems with a student’s form—such as missing responses, multiple responses, answer out of range (e.g., entering an E if only A-D valid)—an asterisk ( * ) will appear next to that student’s name. Click Stop Scanning, highlight the student name, and click Edit. You can change the response for any item. Click Start Scanning to continue.
ExamView Test Manager 30 Results from LAN Test This section covers the following topics: Getting Results from LAN Test Canceling/Resuming LAN Test Troubleshooting Entering/Editing Scores Clearing Student Results Deleting an Assignment Getting Results from LAN Test After your students take an online test using ExamView Test Player, the next step is to get the results into ExamView Test Manager. When you perform this step, the program reads the results and stores the data in the class record.
ExamView Test Manager 31 Canceling/Resuming LAN Test After all of your students have taken a LAN test and you have received the results, you might want to cancel the test. When you cancel a LAN test, students will no longer see that test among the list of available tests when they log into the ExamView Test Player. 1 Click Assignment from the menu bar and select Cancel LAN Test.
ExamView Test Manager 32 NOTE If you discover that an answer on your key is incorrect, do not use the Edit Scores command for each student. Instead, click Assignment from the menu bar and select Edit Assignment Information, click the Question tab, and adjust the correct answer. 3 If necessary, click the name of the student whose scores you wish to edit. 4 Enter/edit the scores in the Points Earned column as necessary.
ExamView Test Manager 3 Select which assignment results you wish to clear. To select all assignments, click Select All. NOTE If an assignment is linked to an online test, you will not be able to clear the results if the online test (EOT) is no longer available. First, click Assignments and select Cancel LAN Test. Since the assignment is no longer associated with an active online test, you can clear the results. 4 Click OK. 5 Click Yes to confirm that you want to clear the results.
ExamView Test Manager Some of the information exported includes: l student name, ID, alias, password l student demographic data (gender, birth date, etc.) l student responses for an assignment l points earned for each question 1 Click to highlight the assignment you wish to export. 2 Click File from the menu bar, mouse over Export and select Assignment Results as XML. 3 Enter a file name for your XML file and choose an appropriate save location. 4 Click Save.
ExamView Test Manager 35 Reports ExamView Test Manager enables you to prepare numerous reports based on your students’ assignment results data. You can print a report for a single assignment, a group or all assignments. You can also customize a report to include selected students filtered by various criteria. Many of the reports include useful graphs and charts.
ExamView Test Manager 36 Creating/Managing Custom Filters Creating custom filters allows you to print reports for only those students who meet a set of predefined selection criteria. When you apply a filter to a report, the class averages (and other cumulative averages and calculations) are based on the population that matches the filter. For example, suppose you have a class of 99 students with 33 students in three different periods (defined using the custom field).
ExamView Test Manager 37 Class Reports The following class reports are available: Assignment Results by Class Class Assignment Summary Open-Ended Responses Worksheet Item Analysis Summary Item Remediation Summary Learning Focus by Class Performance Summary by Class Class Performance Progress Chart Class Roster Assignment Results by Class The Assignment Results report provides performance data for each student for a particular assignment.
ExamView Test Manager 38 EXAMPLE For example, if you are printing the report to post in your classroom so students can see their scores, you might want to print only the alias so students know only which score is theirs. 4 Select the sort order from the Sort by drop-down list. 5 If necessary, set the score ranges for the graph that displays with the report. To change the default settings for these ranges, set them in the Preferences. 6 To view reports for selected students only, select a report filter.
ExamView Test Manager 39 3 Select the information to display for each student. You can display the Student name and/or the Student identification (which can be either the student ID or alias). Deciding which student information to display depends on the purpose of the report. EXAMPLE For example, if you are printing the report to post in your classroom so students can see their scores you might want to print only the alias so students know only which score is theirs.
ExamView Test Manager 40 How to view the open-ended responses worksheet... 1 Click Report from the menu bar and select Open-Ended Responses Worksheet. 2 Select the assignment for which you wish to view open-ended responses. You can limit the number of assignments that appear in the list by choosing a Category and/or Term. 3 Optionally, select a report filter to view open ended responses for selected students. Click Filters to create, edit, or delete an existing filter. 4 Click OK to view the report.
ExamView Test Manager 41 3 If necessary, set the Threshold level to identify questions answered incorrectly by a certain percentage of the class. Questions that are answered incorrectly by this percentage of students are marked with a warning icon. To change the default setting for this threshold level, set it in the Preferences. 4 To view reports for selected students only, select a report filter. Click Filters to create, edit, or delete an existing filter. 5 Click OK to view the report.
ExamView Test Manager 42 4 If you wish to view reports for selected students only, select a report filter. Click Filters to create, edit, or delete an existing filter. 5 Click OK to view the report. NOTE The answers and student responses for multiple choice and multiple response questions use the A-E choice sequence regardless of how the test was set. This is to avoid confusion if you administer tests using multiple delivery methods and/or deliver scrambled versions of the tests.
ExamView Test Manager 43 NOTE Remediation hyperlinks are only available for state standards. The state standard information must include an alignment code in order to link to remedial instruction. The ExamView® Learning Series questions include state standard alignment codes. Learn more at our website www.einstruction.com. 1 Click Report from the menu bar and select Learning Focus by Class. 2 Select which assignments the report should include. You can choose assignments by Category or Term.
ExamView Test Manager 44 Performance Summary by Class The Performance Summary report provides a summary of your class’ performance for all class assignments in a category over a specified date range. The Performance Summary report lists a learning objective/standard, the number of items (i.e., questions) that assess that objective/standard, and the proficiency level that the class as a whole has attained.
ExamView Test Manager 45 Class Performance Progress Chart The Class Performance Progress Chart report shows at a glance how each student is performing on each of the learning objectives/standards for all assignments in a category over a specified date range. The report lists a learning objective/standard, the number of items (i.e., questions) that assess that learning objective/standard, and a proficiency indicator for each of the students.
ExamView Test Manager 46 Class Roster The Class Roster report generates an alphabetical list of the students in a particular class. You can create a filter to include all of the class or selected students. Additionally, you can customize the Class Roster report by including the supplemental student information (i.e., ID/alias, password, grade, date of birth, sociological/economic, etc.). You might use this report to have a printed record of the ID/alias and password for each of the students in each class.
ExamView Test Manager 47 Student Reports The following student reports are available: Assignment Results by Student Assignment Review Student Progress Report Learning Focus by Student Performance Summary by Student Assignment Results by Student The Assignment Results report reflects a student’s performance for one assignment. The report includes the following information: assignment average, points earned for each question, and the student’s response for each question.
ExamView Test Manager 48 7 Click OK to view the report. NOTE The shaded area shows the performance for the median 70% of the students in a class. For example, if there are 20 students in a class, the top 3 scores (15%) and lowest 3 scores (15%) would not be included. The range of scores for 14 students (70%) would be represented. The diamond shows your students' actual performance. Use the graphs to see how a student performed in relation to his/her class.
ExamView Test Manager 49 5 If students took the test on a scanner form, select the choice sequence from the scanner form for multiple choice/multiple response questions. Since this report displays the student's response for each question, the choice sequence is necessary to display these in a way that matches the scanner form. 6 To view reports for selected students only, select a report filter. Click Filters to create, edit, or delete an existing filter. 7 Click OK to view the report.
ExamView Test Manager 50 Learning Focus by Student The Learning Focus report identifies areas where a student needs to focus his/her learning efforts. Based on a proficiency level you set, the report lists the learning objective/standards that a student has not mastered.
ExamView Test Manager 51 10 Click Print to print your report. You can print the report for the current student or for all students. 11 Click Close to exit the report. 12 Repeat steps 2 to 11 above to view another report, or click Cancel to exit. Performance Summary by Student The Performance Summary report shows at a glance how a student is performing on all learning objectives/standards for all assignments in a category over a specified date range.
ExamView Test Manager 7 Click OK to view the report. NOTE The shaded area shows the performance for the median 70% of the students in a class. For example, if there are 20 students in a class, the top 3 scores (15%) and lowest 3 scores (15%) would not be included. The range of scores for 14 students (70%) would be represented. The diamond shows your students' actual performance. Use the graphs to see how a student performed in relation to his/her class.
ExamView Test Manager 53 Preferences The preference settings are divided into four sections: Changing the Preferences General Assignments Students Reports Changing the Preferences Changes made to most ExamView Test Manager preferences will only affect the currently open class (this excludes the General preferences and color settings). If you wish to change the preferences for all new classes you create, you must choose to save the preferences as the default preferences.
ExamView Test Manager 54 Alternating color Click here to change the color used in the background behind every other student. The default RGB color is pale blue (RGB: 237, 243, 254). Alert color Click here to change the color used to identify a student score that has any type of missing results information. For example, if your test included open-ended questions that you have not scored, the student's score will appear in red. The default color is dark red (RGB:191, 0, 0).
ExamView Test Manager 55 Default grade level Set this option to automatically fill the Grade level field when creating new students. Reports Graph ranges for Assignment Results and Assignment Summary reports Enter/edit the default graph ranges for the score frequency distribution bar chart in the Assignment Results by Class and Class Assignment Summary reports. You may want to base the ranges on your school's grading scale.
ExamView Test Manager 56 Troubleshooting Dedicated OMR Scanning l l l If the Apperson Advantage 1200 scanner becomes unresponsive, click Stop Scanning, press the Reset Options button (located on the scanner), and then click Start Scanning. If that does not solve the problem, cancel the scanning process. Turn the scanner off, then back on, and try to scan the forms again. The Apperson Advantage 1200 scanner prints the percentage score on the scanner form.
ExamView Test Manager l l l 57 Forms must either be printed directly from ExamView or photocopied from an original printout. Do not use forms that are photocopied from a photocopy. Verify that the forms are placed properly into the scanner ADF or flatbed. Check that the orientation of the image side of the form matches the direction specified by the scanner manufacturer. Verify that the bubbles are properly filled in with dark marks and erasures are complete.
ExamView Test Manager 58 Contact Us For additional help, contact Turning Technologies Technical Support. Technical Support is available from 7 a.m. - 9 p.m. EST. From within the contiguous United States, you can reach Technical Support toll-free by calling 866.746.3015. If you are calling from outside of the United States, please call +1 330.746.3015. Technical Support may also be reached via e-mail at support@turningtechnologies.com or support@einstruction.com, a brand of Turning Technologies.