Marking > Rescoring - adjusting scored results

Cirrus Assessment Support Team -

Marking > Rescoring - adjusting scored results

After auto-scoring by the system or marking by assessors is done, results are submitted in Cirrus. This means that they are ready for the next step: publication. It is however always possible that a  mistake is discovered in one of your questions during or after marking. For this you can use Rescoring: authorised users can change the question score for a whole group of candidates that were scheduled to take the assessment together. In short you can:

  • Authorise users to have access to rescoring for specific groups (hierarchies)
  • Award 'Full Score' for questions or Remove questions from Scoring for all question types.
  • Change the correct answer for Multiple Choice, Multiple Response and Either/Or questions
  • Rescoring can be done per schedule after submission or publication of all results

Let's look at an example of a test with 1 MC and 1 numeric question (1 point each)
The candidate gets the MC question correct, but the numeric question needs to be reconsidered

1) You can give full score for the numeric question > the candidate will score 2/2 points
2) You can remove the numeric question > the candidate will score 1/1 points.

How to authorise users to become re-scorer for a scheduled group of candidates

The 'Rescoring-tab' has permission-based access: user administrators can define who can see which results:

  • Users should have Admin > Roles > Marking: 'View Rescoring tab' turned on.
  • In the user profile you give access to specific hierarchies: check the box under Admin > User > Hierarchy > Re-score (inherits down).

The Rescoring-tab: your overview

The Rescoring-tab will show all schedules for which all results have been submitted and the schedule time has ended. Rescoring is available only for assessments with fixed form. If none of your candidates in the schedule submitted work, it will not show up here:

2017-11-30_1607-Rescoring-tab-overview.png

Available actions under rescoring

Rescoring can be done per schedule after submission or publication of all results (the schedule needs to have ended). 

  • To start rescoring select a schedule by clicking on the title on the rescoring-tab.
  • On the next screen you will see the question listed delivered via that schedule:

 2017-11-30_1613-Rescore-tab-for-a-schedule.png

On the Rescore-tab for a schedule the following actions will be available:

  1. Select a question to rescore by clicking on it - it will stay high-lighted
  2. Choose the action you want to take:
    1. Award 'Full Score' for the question: all candidates in the schedule will receive the maximum amount points for this question
    2. Remove questions from Scoring: the question will no longer be taken into account towards the passmark and grade for all candidates in the schedule
    3. Change - you can change the correct answer for Multiple Choice, Multiple Response and Either/Or questions or the maximum score for the question.

Next you go to Results to preview the effect of your changes so you can decide on applying or discarding them.

Please note: you can only rescore a question once after you've applied the changes.

Consequences of rescoring:

What are the consequences of full score / remove / change answer / change max score?

Once you click on 'apply' the rescoring will take effect: the results for the candidates will be recalculated (this can take a little time) based on the new maximum score for the assessment if that was affected.

What effects will I see in Cirrus upon rescoring?

  • Rescoring the question will not influence psychometrics.
  • A rescored question will probably need to be looked at. Using the question ID you can withdraw it for example to ensure it will no longer be used.

Visibility of rescored questions:

  • On Marking > Results tab and in Reports and on Candidate Dashboard new (recalculated results will show)
  • Removed questions won’t be shown anymore
  • Full score will be shown with full score (no flag / indicator about change)
  • Changed question: will be shown with full score (no flag / indicator about change)

Send us your ideas and suggestions. If you are looking for rescoring questions per candidate, please do not hesitate to mail our product owner.

Comments 0

Cirrus uses Zendesk to provide our Help Center services. Check out Zendesk's Terms of Service and Privacy Policy, as they govern your use of these services.

Powered by Zendesk