Reports in Cirrus: viewing and exporting candidate results

Cirrus Assessment Support Team -

Reports in Cirrus: viewing and exporting candidate results

So your candidates have taken their assessment and their attempts have been scored automatically or by a marker. As soon as these results are published, Cirrus offers several reports on the results. You can also download these results in several formats:

2017-03-17_1523-Reports-overview.png

Reports > Candidate Results > Candidates

This report shows a list of all submitted scores (auto-submit or via markers) and published results per candidate for a schedule:

2018-08-15_1716-Reports-Canidates-results-filter.png

When searching within candidate results the following can help you get your results:

  • Simply search on user name or user ID to find their results
  • Use a combination of filters to drill down to certain subsets:
    • Click on the filter icon to drill down on group/hierarchy or dates
    • Click on "Filter by: Assessments"  to see results for specific assessments 
  • Remember: the results need to be published by the marker(s) for human scored questions to show up.

Exporting the results of a candidate or a set of candidates

Remember: the results need to be published by the marker(s) for human scored questions to show up.

  • Go to Reports > Candidate results > Candidates
  • Select the date range or use one of the predefined ranges.
  • Select the candidates you want to export the results for by checking the boxes
  • Click on the 'Export' button and you will be offered to choose what kind of data you want in your export.

Tip: This results are published immediately and automatically if auto publish is enabled for the assessment (when the assessment does not contain open questions) and thus Marking is completely skipped.

Explanation on the date range search in reports:

If there is an intersection between filter [start, end] dates range and schedule [start, end] dates range is not empty, then items are added to result list.

This means the following exams will be shown in the search results:

  • exams that start before the search start date and end after search end date
  • exams that start before the sreach start date and end between the search dates
  • exams that start between the search dates and end after search end date
  • exams that start and end between the search dates

Viewing detailed reports on individual candidates in Cirrus

Whether viewing the report per schedule or per candidate in Reports, you can simply click on 'Show' at the right of any of the listed candidates that participated. This will lead to reports showing:

  1. Summary = questions + what the candidate scored on that question
  2. Detailed = questions + correct answers + what answers the candidate selected
  3. Score Report shows mastery level per Learning Objective (if you've used those).

Example of Reports > Candidate results > Candidate for a specific user with all report types enabled via the assessment options:

2017-04-10_1322-reports-detailed-view-tabs.png

Reports: Viewing the Summary and Detailed Report

These results under Reports are for viewing only, they cannot be exported or downloaded at this point in time.

Reports: Viewing the Score Report

The Score Report does offer the option to print an overview listing the candidates mastery of the learning objectives tested for in your assessment. In addition to viewing it you can print:

  • Print Score Reports of individual candidates
  • Print Score reports of only candidates that failed.

Reports > Candidate Results > Schedules

This report shows a list of all finished schedules and the results associated with them:

Exporting the results of a schedule or a set of schedules

Remember: the results need to be published by the marker(s) for human scored questions to show up.

  • Go to Reports > Candidate results > Schedules
  • Select the date range or use one of the predefined ranges.
  • Select the schedules you want to export the results for by checking the boxes
  • Click on the 'Export' button and an Excel file will be downloaded, containing the results of your candidates. If you've used a registration form, this information will also be include in the download.

Viewing results of a schedule

If you click on a schedule listed in this report a screen will open showing the results of all candidates who participated - similar to what will be in the downloaded if you export the results.

You can also delve deeper and view more detailed reports on individual candidates. See 'Viewing detailed reports on individual candidates' below.

Please note: this report shows results at of a schedule. Viewing all results of the assessment you delivered is on our roadmap! Please contact support@cirrusassessment.com if you have any questions.

Exporting reports: select what you want to export to an Excel file

Remember: the results need to be published by the marker(s) for human scored questions to show up.

  • Go to Reports > Candidate results > Candidates
  • Select the date range or use one of the predefined ranges.
  • Select the candidates you want to export the results for by checking the boxes
  • Click on the 'Export' button and you will be offered be offered options on what to export:

    2017-05-18_2124-Reports-export-options.png
  • Candidate Scores - Shows the total score the candidate scored on each question.
  • Candidate Answers - Shows the alternative(s) the candidate answered on each question.
    • The result is an Excel sheet listing all the question by ID and the answer option selected by the candidate.

      2019-09-11_1605-Reports-download-candidate-answers-explained.png

    • Answer option in the Excel - this letter (A, B, C and so on) refers to the answer option as entered by / listed for the item author

      2019-09-11_1605-Reports-download-candidate-answers-question-with-answer-options.png

    • Answer option on screen versus in the Excel - Looking at this in more detail this can mean Joanna Doe's answer on file in the Excel sheet for ItemID 1000-135 can be 'A' but in the on screen in the detailed report she has selected the second answer option - as the answers for this were randomised during delivery. (The detailed report shows the options like she would've seen them taking the test).
    • Supported question types for which answer can be exported to Excel: currently answers to the following item types can be exported to Excel (others are not suitable): Multiple Choice (MC), Multiple Response (MR) Either/Or (E/O), Fill in the Blank (FIB), Select From List (SFL), Short Answer (SA) and Numerical (NUM) questions.
  • Candidate results - extended - Shows the results for each candidate including answers to MC and MR questions, Short Answer (SA) and Numerical (NUM) questions and their answers on Essay questions and comments from assessors. This is also known as the 'Candidate Feedback report' which can be used to discuss their work or appeals.
  • Candidate results - Shows the results for each candidate including total score, grade and whether the candidate passed or not.
  • Candidate results including registration form data -Shows the results for each candidate including total score, grade and whether the candidate passed or not. In addition it shows what the candidates answered on their registration forms.
  • Including seed items - this gives you the option to include seed item data in your export (by default not selected)

Please note: not all answer data might be suitable for export to Excel.

Most notably: if candidate or Markers/Moderators use images or tables in their answer (using the WYSIWYG editor provided to them, these will show up as [image] and [table] in the Excel cell containing the answer. Always do a trail run to see if the export suits your needs.

When will the results show up in these reports?

If a schedule is set to start November 1, 2016 and end June 30, 2017, if all candidates complete the test by December 10, 2016 that are in the schedule. This will not show up under Reports>Candidate Results>Schedules until June 30, 2017.
It will show up under Reports>Candidate Results>Candidates.

Please note: Reports > Candidate Results > Candidates shows the results of published attempts of candidates. If a candidate has multiple attempts for an assessment the author of the assessment can select which attempt counts. This has the following repercussions for the report:

  • Multiple attempts, last attempt counts > the results in the report will be overwritten each time they are published.
  • Multiple attempts, best attempt counts > with every new attempt the report will show the best attempt, it will only be overwritten if the results are better than for previous attempts.

Printing Reports

Apart from exporting the reports in different formats you can

  • Print Score Reports of individual candidates
  • Print Score reports of only candidates that failed.

Setting up access to score report: determining who can see which scores and results

Setting up who can access reports on your candidate's results is both role-based and depends and hierarchy based. 

The user's Role needs access to Score Reports enabled

First a user will need access to the Score Reports via his or her role:

  • Go to Admin > Roles
  • Check the tick-box for Reports (this is first step is needed to show reports in the user's left-hand menu)
  • Check the option View candidate results / Assessment performance depending on what reports you want to allow access to:

2017-09-13_1110-Admin-Roles-Reports-access.png

The user's profile needs to have access to specific hierarchies to access related scores.

Secondly you can decide for each user which score reports they can see by setting up access in their user-profile. Exams are delivered via scheduled that have a hierarchy level assigned to them. In the users profile you setup if they can view reports for this.

2017-09-13_1114-Reports-access-by-hierarchy-at-user-level-inherits-down-example.png

  • Go to Admin > Users > John Doe
  • Go to the Hierarchies tab
  • Check the boxes under 'View Reports' for access.
  • Please note: this access inherits down (see screenshot as an example)

Reports > Assessment performance

This report shows statistical information for each of your schedules (delivered sessions). These are less useful if you schedule per candidate, for example when using the ProctorU integration. The ‘Assessment performance’ report allows you to:

  • Search for assessments in Assessment performance list [A]
  • See an high-level overview on your assessments
    • Last sat, pass rate, Reliability, Times Delivered and Number of Items in the assessment
  • Drill down the results shown to any specific assessment: simply click on an assessment title to view more detailed assessment statistics [B]
  • Export these data [C]

2017-04-10_1411-Reports-Assessment-Performance.png

When you click on the assessment title you will see more detailed information:2017-04-10_1431-Reports-assessment-performance-details.png

  • Average Chance score for the assessment
  • Average Rir value
  • Average Rit value
  • Reliability for the assessment
  • Average Pc-Value (corrected P value)
  • Average P-value (difficulty)

Clicking once more on the assessment title will lead you to a list of the items in your assessment and their statistics at item level measured for the assessment:

2017-04-10_1432-Reports-assessment-performance-details-items.png

Please note: this Report is in bèta - Feel free to send your thoughts and suggestions to support@cirrusassessment.com

Comments 0

Cirrus uses Zendesk to provide our Help Center services. Check out Zendesk's Terms of Service and Privacy Policy, as they govern your use of these services.

Powered by Zendesk