Introduction on Creating Items and their settings
In this article we will look at how to add Items and the different options of the 'Question settings' in the panel on the right hand side.
- Adding an Item
- Item Options: setting up feedback on Items or feedback on answer alternatives
- Item Options: randomise order and more - offering additional options for MC and MR items.
- The Item's side panel for setting:
- Saving & Previewing Items
- Editing Items that are being used - only small changes are aloud if the item has been used in an assessment.
- Moving an item / importing items from another collection
- Item Sharing - who can edit the item?
In our article 'Item management in Collections' you can read all about creating, copying and archiving your questions and about bulk actions (doing this for multiple questions at once). Once you create or open a question you can start working on the Item itself. Let's take a look at a Multiple Choice question for example:
- In this part you enter the question, answer alternatives et cetera. You can find more details in our article on the different item types in Cirrus
- Item options - use this button to access the item's specific options regarding feedback, ordering answer options scoring type which determines if dichotomous or polytomous scoring is used.
- The Item side-bar is where you setup and access the meta-data for the question but also the revision history with comments.
Feedback on questions allows authors to enter feedback per question in case the candidate answers the question correct, incorrect or partially correct. It will be shown after each question when the candidate submits the answer:
- If the answer is correct, display the following feedback...
- If the answer is partially correct, display the following feedback...
- If the answer is incorrect, display the following feedback...
Usage of feedback on Items - This feature is mainly used for formative assessments and requires the option feedback on questions to be set by the assessment author. It applies to all question types except Essay and Mathematical/Sowiso questions.
It is also often used for documenting why something is the correct answer - Some of our customers use feedback on questions / feedback on alternatives fields to document why something is a correct answer without showing this to the candidate.
How do I enable feedback on items? Simply use the options button when adding / editing an item and check the option 'Show feedback on question'. Alternatively you can use our import of items using Excel.
Multiple Choice and Multiple Response questions come with an additional options button. When clicking it you access the options available for the question type you are editing:
Read more about their specific options in our article on the different Item types.
For each item you create, you will be able to define certain settings against the item before saving it. These settings will be available for all question types in the right-hand panel of the item editing screen. By default the the 'Tags' section is open when editing an item:
- The status of the item relates to the item workflow from 'Draft', 'Ready for Review', 'Review - approved/'Review - not approved' through to 'Live' and 'Withdrawn'.
- Please note: only Live items can be used in an assessment.
- Setting permissions on status management is done under Admin > Roles > Collection > Status Management.
- You can filter on Item status and view the status of an item at a glance when looking at a collection of items / a list of items in the Library.
- When you create an Item it will by default have the status 'Draft'.
Status when editing:
|Example of Item status listed in a Collection:|
You can withdraw individual questions in collections that should no longer be active / usable in assessment. This does not mean that existing assessments will be affected - the questions will not automatically disappear. These assessments need to be actioned by their authors. You need to inform them so they can create a new version of the assessment and work from there.
You can archive complete collections of questions - sometimes this works better.
Under Section you will see if the item has been added to a specific section page. (If the item is a section you will see a list of items if any have been added.) This linking questions to in the library is more formal than more freehandedly manually linking questions in the assessment form.
Assigning a Learning Objective will help when selecting items for an assessment, and also to provide meaningful feedback for learners using the Score Report for example. You can set the Learning Objectives against each item you create:
- Click the ‘Set’ button in the Learning Objectives section of the right-hand panel.
- A pop-up will appear with a folder tree, allowing you to navigate and select the Learning Objective(s) you wish to assign to the question.
Note: The setup of Learning Objectives can be done in Cirrus via the Administration panel. If your assessments will be created using a blueprint, you will need to assign a Learning Objective to each item that should be included.
The Item Purpose: states if the question's is for Formative or Summative examination. In other words: this will determine in what kind of assessments the Item can be used. See Adding an assessment: choosing a formative, summative or mixed If you leave this value empty the item can only be used in assessments of type 'Mixed'.
Item Taxonomy: the taxonomy term(s) applicable to the Item. You can select from an existing Taxonomy as set up by an Admin. If your assessments will be created using a blueprint, you will need to assign a Taxonomy term to all items involved.
Seed items are used in real life exams to gather psychometric data but do not count towards the candidates score- it is 'unscored'. The candidate will not see any difference and cannot see that the question in his exam is a seed item.
Typically this is used if you want to test the item and gather psychometric data before applying the item to be counting towards the candidate score in the high stakes assessments you deliver. By default this option is set to 'No' when creating an Item.
The second part of the side panel (behind the 'clipboard-icon' consists of the Revision History and comment section for the item:
- Last Modified - Here you will be able to see when the item was last modified under 'Revision'. If you click the ‘View History’ you will be able to see the revision history of the item.
- Comments on the item - below the view history you enter comments and view comments from (co-)authors
- You can view comments from (co-)authors including the version the comment was made on and date and time stamp. You can easily reply to comments.
Revision history of an item (and roll-back)
In the Revision history window of an item you can compare versions and select a previous version to roll back to:
- The blue bar and light blue highlight show which version you are viewing comments for. Please note: comments are saved against this specific highlighted version of the Item.
The bold blue version is the one that is currently active.
- Using the pencil-button you can edit your own comments, or using the trash-button you can delete your own comments.
- Use the‘Write a comment…-box’ and click the 'Add comment-button' (or hit 'Enter') to save your comment before doing anything else.
- Select a version (using the check-box and click the ‘Rollback’ button to restore this version. Select two versions and click the ‘Compare’ button to open the 'Compare Revision-window':
- The different columns show valuable information such as version number, question summary, changes, score and Item workflow status.
- Tip: You can move the revision pop-up to better see the current version of the Item.
- Tip: An Item needs to be Saved first, before it shows as a version in these item revision windows.
When creating items in Cirrus, you can click 'Save' and then use the ‘Preview’ button at the bottom of the item editing screen to view the item as a candidate would see it during their assessment. You will be able to interact with the question and, if it’s automatically marked, check that the marks are being assigned to the correct answer.
To exit the item editing screen, click the ‘Save and Close’ button. You will then be returned to the Items screen.
If you wish to discard the item you are creating (and haven’t already saved it), click ‘Cancel’.
To edit an existing item, simply double click on the item you wish to edit when you are in the ’Items-Tab’. The item will open and you will be able to make any necessary changes before re-saving it.
Note on editing live items that are in use: If the item is already being used in an assessment, you will only be able to make small textual changes. In other words: you cannot add or remove answering options or change the Item purpose or metadata like Learning Objectives or Taxonomies. Should you open an item that is being used in an assessment, you will see a warning message that the item is in use.
Small changes to Items take effect in new and existing schedules that start at least 10 minutes after the change was made.
Should you need to do major changes: please create a copy of the question and use that in an updated version of your assessment. You can withdraw the outdated version of your question - and remove it were needed.
Because of the data structure in Cirrus there is no 'move' button. In order to move an item into a new collection for example (or to an existing collection):
- Create the new collection and amend the prefix (or go to an existing one)
- Click the Action button and select select import from the dropdown
- On the modal window that opens select "From another collection" and click continue.
- The question import screen opens:
- You can filter on collection (using the dropdown) or by question type (left column)
- Select the questions you want to move
- Click on 'Import Selected' (note: it does not look like a button).
- Archiving the old collection is recommended
- Please note that with this move your psychometric data is reset / start anew when you start using the question.
Beneath the tags, you will be able to see who the item is shared with. Sharing Collections enables author to collaborate on the Items in that Collection. Also see the article on Sharing in Cirrus.