Quizzes & Tests II
From CLEW Wiki
UW Quizzing Tool
This tool has been enhanced as of Fall 2013 to enable instructors the ability to create their own quizzes & tests, therefore removing the requirement to produce them 3 weeks in advance, as was the practice previously. With this new functionality however, comes the added responsibility for instructors to take extra care in the preparation of their online quizzes & tests, and preparing their students to use the tool. It is highly recommended to test out the quiz in advance of the actual quiz date to avoid unintended circumstances.
The Quizzes & Tests II tool enables an instructor to add, create and administer multiple choice quizzes, tests, or exams on-line where questions groups can also be subdivided by Sections.
Questions can be randomly ordered, or appear in the order that they were created.
Choices within a question can be randomly ordered; or by using the Order option, can be positioned with a specified order (see the Choices section for more information).
Using the online rich text editor, you can include links or other formatting features available with the editor, or paste in graphics to customize the appearance of the Assessment Instructions, Section Introductions, Questions or Choices.
Get Started with Quizzes & Tests II
Ensure that you have the Quizzes & Tests II tool enabled in your site. Check the left menu to see if the Quizzes & Tests II tool is visible. If it is not, follow these steps to activate it:
- Click on the Site Editor tool in the left menu.
- Click on the Edit Tools link.
- Verify that Quizzes & Tests II tool has a checkmark beside it.
- Click on Continue and Finish to finalize the activation.
Quizzes & Tests II Permissions
Adjustments to permissions for the Quizzes & Tests II tool are only able to be performed by the LMS Administrator. The following describe which roles have certain permissions:
- Write: Only available for instructors. If you want other individuals to have permission, to write, please contact the LMS Administrator
- Read: Available for instructors, students, and TA’s or other assistants to site.
This is the first view you see when entering the tool (see image below).
Features in the Quizzes & Tests II home page include:
- Assessment List (Home): Returns you to the main Quizzes & Tests II Status Screen that displays all active and non-active assessments.
- Create Assessment: Provides options to create the overall assessment including components such as Time Limit, Assessment available from, Assessment available to, etc.
- Sections, and Creating Questions become available AFTER you have saved the information about the assessment. For more details about the overall assessment, see the Create Assessment section. For details about creating and editing sections, questions and choices, see the Sections, Questions and Choices area of this article.
- Copy Quiz (Under Development): Provides a list of all assessments from other CLEW sites you belong to (as an instructor/organizer) where you can import into a copy of a selected quiz into the current site. Once copied, the assessment comes into the current site with the Unpublished status and with previous information settings about the assessment. Review carefully to see if the previous settings will still apply in the current site.
- Import QTI quiz file: Provides option to upload a Question and Test Interoperability standards (QTI) file (publisher or vendor supplied) which should then appear directly in the Site’s Assessment list. Instructors still need to establish the Open/Closed/Publish status of the assessment, along with the other assessment information (e.g. duration) and then click Save to complete. File types that will import with this feature include .xml or .zip. This tool only imports Titles and Questions, and populates into ONE Section only. Further customization, such as sub-dividing into additional Sections, needs to be done manually, following the import. See the Sections section for further information on editing a section. There is no option to move or organize the order of the questions of the imported file currently available in this tool. Please see the Considerations section of the Import QTI quiz file section for important notes about this feature.
Create Assessment: Opens screen that provides options to select from and edit for the overall entire assessment. Once you have set up the initial framework of the assessment, you will be given the option to Save and Add Questions.
- Assessment Name: Enter a name for your assessment.
- Instructions: Rich text field for you to enter information about the test for your participants to read upon entry to the assessment. This will be displayed at top of the assessment, and contained in a box with a light green background to differentiate it from the contents of the assessment. This editor enables you to paste in images (Copy and ctrl + V), and utilize any other formatting features provided by the editor to provide customization of the look of the content. The maximum number of characters is 4000, including any pasted in graphics.
- Time Limit: Enter the maximum time students are allowed to complete the assessment (note students with exceptions are handled elsewhere – this is for the majority of the students taking the assessment).
- Classification of Assessment (i.e. Test, Exam, Quiz): is just a label that is used throughout the assessment, which is visible to users. This label is displayed on the "setup" page, which you see before you start actually taking the quiz, which is the page with the "Start" button.
- Shuffle questions to appear in random order: When this has been selected, the questions will appear in a random order, otherwise, they will appear in the order they have been created.
- Number of attempts available to all students: Enter how many times the student may take the test using the drop-down list available. This may be from 1-10 attempts, or unlimited.
- Assessment available from: Enter the start date and time for the test to become available to students using either the “date picker” tool, or by entering directly into the text field. Order of entry is MM/DD/YYYY hr:mi.
- Assessment available to: Enter the date and time the test will no longer be available for the students to access using either the “date picker” tool, or by entering directly into the text field. Order of entry is MM/DD/YYYY hr:mi.
- The date on which grades will be available: Enter the date and time to show students their results using either the “date picker” tool, or by entering directly into the text field. Order of entry is MM/DD/YYYY hr:mi. This is only to select when students see their grades, not their actual answers.
- When will students be able to review their answers?: Enter the date and time to show students how they answered the questions from the available choices(and the correct choice) using either the “date picker” tool, or by entering directly into the text field. Order of entry is MM/DD/YYYY hr:mi. If this field is left blank, the student’s won’t be able to review their choice selection ever.
- Email Notifications: The instructor can choose to have an email notification sent to the students upon completion of the assessment. To turn this feature on, the instructor must check the Send Students an Email Notification? check-box option in the Assessment Creation/Edit screen.
Note: The values for the options 9 & 10 above may vary if you don’t want to reveal the student’s choices and grade results simultaneously by setting different date/times in those two fields. Alternatively, you can make both the date on which grades will be available and When will students be able to review their answers the same date/time if you want students to have immediate feedback about their results and their answer choices.
Save Assessment Options
The following options are available for you to determine the status of your assessment:
- Save and Continue: Saves your current “state” either as Draft or as Published. Once you select this option you will be returned to the same screen you were editing the assessment from.
- Save Draft: Saves and puts assessment into Draft Status. Once clicked, you are returned to the main Assessment List (Home) page. Draft status means only instructors can view the assessment.
- Save and Publish: Saves and changes status to Publish and returns to main Assessment List (Home) page. Published status means students will be able to take the assessment.
- Cancel: Discards all content not saved.
Preview Quiz: Opens a preview window of current saved assessment in another window.
Unpublished: If an assessment is unpublished, students cannot see it. If an assessment has been published, but nobody has completed it, it can be unpublished by clicking Save as Draft. Once published, and at least one student has completed it, you will see a warning if you edit the assessment, as any changes may alter the results.
Published: The assessment is available to be seen by the students.
If the Assessment available to date has passed, the student has completed the assessment, and options have been enabled to see the grades and / or responses, the students will be able to see their result when visiting the tool.
Open: When the date is between the Assessment available from and Assessment available to, it is considered Open.
Closed: When the date is before or past the Assessment available to date/time it will appear as Closed.
To complete the Assessment Information section, click Save and Add Questions, or click Cancel to clear changes.
After Save and Add Questions has been clicked, you will be able to create Sections and/or Create Questions and Choices.
This screen summarizes the entire list of student results by various categories as described below. Additionally, a log of the student’s attempt is available to help troubleshoot problems.
View Question Analysis
Features available in the View Question Analysis section
- This feature is accessed by clicking the View Question Analysis link in the View Grades screen of the Quizzes & Tests II tool.
- View Question Analysis contains a table and pop-up preview of each question along with the analytical breakdown of the number of times the question was given and how many times it was answered correctly. For more specific details about what each column means, review the Question Analysis Details section.
Clicking on the arrows for a column header in the data table will provide sorting options (alphabetically - ascending or descending).
Name: Last Name, First Name (same as found in the Roster tool). If you click on student’s name, it will show you a preview (snapshot) of the student’s final submission for the assessment, question by question, and with the actual answer submitted.
If for some reason, the student didn’t actually submit the assessment, instructors can still see efforts that were completed, as the tool takes “snapshots” as the student progresses. Contact LMS Administrator for additional help, or manually override student’s grade in Gradebook if applicable.
UWinID: Displays the student’s UWinID in this column.
Submitted: Displays the date/time when the assessment was actually submitted, or the currently in progress status, or if the assessment was not finished.
Score: Displays the correct number of answers achieved (out of the maximum total possible) for the assessment.
%: Displays the correct number of answers achieved (divided by maximum total possible) as a percentage value.
Duration: Displays the length of time the individual took to complete the assessment (Hr/Min/Sec), or displays if they didn’t complete the assessment.
View Log: Displays the sequence of each question / answer and ordered by time, as they answered throughout quiz, (only visible to instructors)
- A Snapshot Conversion option exists for instructors to preview the snapshots taken during the student's assessment. This is provided in the event that some kind of technical difficulty arises during the assessment, and an instructor wants to convert the submitted attempt into one of the chosen log entry snapshots for the quiz for more accuracy. This is especially effective if a student accidentally closes the browser window before completing the assessment, or there is a problem with the internet connection. To activate this feature, select the Convert to Attempt link corresponding with the most accurate snapshot of the student's work, and click OK to the "Are you sure you want to select this snapshot into an attempt?"
Export Grades to Gradebook: Pick from drop-down list for export choices
Highest Grade: if more than one attempt, the tool will pick the highest achieved grade for all quiz attempts
Mean Grade: if more than one attempt, the average of all attempts to 1 decimal place
Median Grade: Middle grade out of more than one attempt for student quiz, to 1 decimal place
Last Grade: Last attempt before quiz closes. No submissions are possible after quiz closes. If a quiz is incomplete when quiz closes, the previous fully submitted quiz will be used. If the student runs out of time (when the timer on the page reaches 0:00) the tool will auto-submit the student’s answers up to that point, and the student will be directed to a “Submission Complete” page. All results and attempts can be viewed by the instructor in the View Log of the View Grades interface.
Remove from Gradebook: Remove entry associated with this assessment from Gradebook
Question Analysis - Details
When you select the View Question Analysis link, it provides you with a statistical summary analysis of the quiz after it has been closed or while active. Click the link question number, if you require more detail about what a question contained and which option was selected as the correct answer. Table headers are explained below:
- [Question]: The question number chronologically as listed in the quiz, and when link selected, you will see what the question was and the associated options. The correct option is identified with bold green text.
- [Times given]: Times given: Refers to the total number of quiz participants who received that particular question.
- [Times correct]: Refers to the number of quiz participants who answered the question with the correct answer.
- [Percentage correct]: Calculates the percentage of correct answers from the total number of answers selected based on the answer defined as correct. (Formula = (Times correct / Times given)* 100)
Note, in instances where a quiz section is set up to select for example, 3 out of 5 questions, the number of "Times Given," "Times correct," or "Percentage correct" may not be the same for all questions.
- [A(-J)]: In this column, and those that follow (up to # who chose answer J), the number of quiz participants who selected a particular response to the question identified in the first column. The results found here might help you determine if possible distracter/alternate answers need to be rethought for subsequent tests, or if the distribution on the number of responses is within an acceptable range. Additional columns will appear if there are more than six columns, but without a heading.
Note: Select the Return to Grades link to be directed to the main grading screen for that quiz.
Export Grades to Gradebook
- Click the View Grades link.
- Beside the Export to: field, click Gradebook from the drop-down list. You can also choose the type of export to Gradebook from the following options related to the individual student's quiz or test results: Highest Grade, Mean Grade, Median Grade, Last Grade. This will create an entry in the Gradebook for the assessment.
- Gradebook then creates a Gradebook Item that can be modified or deleted from within the Gradebook tool only.
- Note, you will still need to associate the entry with a Gradebook Category if applicable.
- For grade changes, see Gradebook wiki article.
Students may have situations that require specific treatment, such as extra time, different open/close times, number of attempts, etc.
To access the exceptions options, click the Manage Exceptions link found beside the assessment on the main page of Quizzes & Tests II tool.
- You will be provided with the student roster with test criteria listed in a table, where you can click the arrows on the header of a column to access sorting options for display (Name, Uwin ID, Time Limit, Number of Attempts, Date Quiz Opens, Date Quiz Closes, Answer Review, Options).
- Click the New Exception link beside the name of the student requiring the exception.
- Any previous exception(s) for that student will be displayed. If no exception exists, the options with the default quiz conditions that were set up when creating quiz will be visible.
- Click and edit any of the following fields requiring the change:
- Select Time Limit (adjustable)
- Number of attempts (for that specific student): Dropdown menu (max 10, or unlimited)
- Quiz available to: (mm/dd/yyyy/ hh:mm) (select from calendar, pick date/time)
- Quiz available from: (mm/dd/yyyy/ hh:mm) (select from calendar, pick date/time)
- When will this student be able to review their answers? (ex. MM/DD/YYYY hh:mi)
- Click Save to complete or Cancel to clear changes.
Copy Quiz (Under Development)
Copy Quiz (Under Development): Provides a list of all assessments from other CLEW sites you belong to (as an instructor/organizer) where you can import a copy of a selected quiz into the current site. Once copied, the assessment comes into the current site with the Unpublished status, with previous information settings about the assessment. Review carefully to see if the previous settings will still apply in the current site.
Sections, Questions and Choices
When saving the assessment for the first time (using the Save and Add Questions button), you will automatically be given a Section to work within, and the Add Question button will appear. Sections cannot be reordered and will appear in the order that they were created. There is no option to re-position a section within the assessment.
A Section is a container for a group of questions with:
- The number of questions that student is required to answer from that section. The tool will randomly choose from the available number of questions created for that section, the defined number for the assessment. E.g. system will choose 2 of the 5 questions in this area that the instructor has established
- An introduction, which is similar to the assessment instructions, but it is displayed with each section. The rich text editor can enable pictures to be pasted into this area in addition to the other standard text editing features that can be accessed to customize the content. The maximum number of characters for this field is 4000, which includes any graphics.
- Click Add Section to start. A new blank section will appear at the bottom of existing list.
- Click Add Question to begin with a new question (within the section) or Delete Section to remove the entire section. (See the Add Question topic below for more information on this feature).
- Enter an optional Introduction into the rich text field for description of the Section. This field can remain blank if the user wishes. The field has a limit of 4000 characters. Users can copy and paste an image, but that will reduce the amount of characters available. A best practice is to link to external image instead of pasting into field to save on character availability.
- Click Save and Continue for content to be saved. There is NO auto-save as you progress.
Every question is worth one mark only.
- Click the Add Question button, on the Section Header. The rich text Editor will appear on the New Question panel.
- Enter content into the Question Prompt rich text field input, (pictures, links, etc.) for Question Stem including instructions on how to complete or answer the question. This editor enables you to paste in images (Copy and Ctrl + V, or Cmd + V), and utilize any other formatting features provided by the editor to provide customization of the look of the content. The maximum number of characters is 4000, including any pasted in graphics.
- Once the Question Prompt section has been completed, continue to add Choices for the question.
- Click Save to complete the question, or Save and Add Another Question to continue adding question in the section, or Cancel to clear any changes.
Edit or Delete Questions
(For the Current Section)
- Edit: Enables editing for that question, and the question choices
- Delete: Deletes the entire question selected, and the choices. A warning prompting you to confirm your actions requested will also be displayed.
The maximum number of choices that can be defined for any question is ten. Choice options appear below the instructions to provide a correct answer to the question (Correct Choice – Yes), or if the choice is a distractor for the question (Correct Choice – No). This editor enables you to paste in images (Copy and ctrl + V), and utilize any other formatting features provided by the editor to provide customization of the look of the content. The maximum number of characters is 4000, including any pasted in graphics.
To Add a Choice
- Click Add Choice
- Enter content into the Choice Text rich text field
- Select whether this choice is the Correct Choice or not from the drop-down options (Yes or No). Only one correct choice can exist for the question.
- Enter an optional Order number.
- Order: Defines choices ordered numerically (1, 2, 3, 4 etc.) based on the assignment you have determined they should be for the correct choice and the distractors. For example, if you assign a choice for position 1, (enter 1 in the Order field) and it will appear first. If you assign Order number 5, it will appear following numbers with lower values above it. The higher the number, the further down the choices list it will appear. This tool can also provide some randomization within a question with existing ordering e.g. if Order 1 is assigned twice to two separate Choices, then those two Choices will be randomly positioned and the others will follow in sequence as defined by their order number.
- A best practice for having a consistent order for True/False answers (e.g. True always appearing first, followed by False) is to put the Order value of 1 for the True and it will position it first.
- Click Add Choice to add another choice or complete the question by clicking one of the following choices:
Below the Choice Option panel you can select from the following functions:
- Add Choice – Brings up the rich text editor for creating an additional choice to add to the current question.
- Save: Saves the current question and returns to the current assessment editing page.
- Save and Add Another Question: Saves the current question and opens interface for adding a question in the current section.
- Cancel: Returns you to the current assessment you are editing, and discards any changes to the current quiz.
To Delete a Choice:
- To remove a choice, click Delete Choice
- Click Cancel to discard the current changes made to choice (if never saved previously). ))</span>
Import QTI Quiz File (Beta)
The QTI import feature is under development, and may produce erratic results or fail to import valid QTI files. Vigilant checking of material is required when using this feature. Please contact the CLEW team if your QTI file does not import properly by using the Problem Report form available on every CLEW site by clicking the Ask for Help link in the lower left menu.
Your textbook publisher may offer prepared quizzes in a file format known as QTI (which stands for Question and Test Interoperability). Often, the file comes bundled as a .zip (compressed format possibly containing several files), or as an .xml, which is a type of file with additional coding in so various systems can read content.
You can import properly formatted QTI quizzes into this Quizzes & Tests II tool.
- Only multiple-choice questions can be imported from QTI files. Questions of other types (long answer, etc.) will be skipped.
- After successful importation of the QTI file, instructor’s still need to establish the Open/Closed/Publish status, along with the quiz duration, etc.
- This tool only imports title, and questions, and populates them into either ONE section or each question is in its own section, depending on the formatting of the original file. Further customization, such as sub-dividing by additional sections, needs to be done manually, following the import.
- At this time, there are no options for reorganizing the imported file structure, so you can’t move or reorganize the order of the questions after import.
To upload a file, follow these steps:
- Click Import QTI Quiz File
- In the Attach your QTI file (.xml or .zip) here: section click Browse, and navigate to the file on your computer
- Click Upload QTI Quiz File
- If your file has been successfully imported, you will see it appear in the Assessment List (Home) list. If it has not imported correctly, you will see a warning similar to the following:
If you see this type of warning, please contact the email@example.com for further support.
- We strongly suggest that you test out the quiz yourself to know what the students will experience, and to identify any problems in advance of the actual assessment.
For Your Students
- Consider including a statement in your syllabus and / or in an announcement to indicate how you will handle problems such as computer lock-ups, browser issues, incomplete assessment session or other system / personal problems. Indicate what you are willing or not willing to do to mitigate problems or requested retakes. (e.g., Some instructors will not entertain retake requests unless there is a verified system problem. Some instructors will grant 2 takes to cover problems and only accept the 2nd if the 1st is labelled incomplete.)
- Add an announcement early about what will happen and what students should expect and do to prepare.
- Advise your students that using the Firefox browser, available at http://www.mozilla.com will help reduce browser issues.
- Requests to CLEW Support for retakes of the assessment will not be approved and will be referred to the instructor for further action.
- Students with exceptional needs can be given extra attempts, longer completion periods, or completely different “start” and “finish” dates/times.
- It will be up to you to decide whether or not you will entertain retake requests and if you decide that any of your students should get a second attempt. This can be managed by using the Exceptions feature where you can give extra attempts, change the Open / Close dates, and adjust when the answer review will be available.