Guide

How to write an answer key a machine can mark from

A good answer key for AI marking uses the paper's exact question numbers, states the marks for each question, and makes clear which answers are separate blanks and which are alternatives for one blank. Written questions need a model answer or key points, because a topic alone gives the marker nothing to check. evaleasy reads keys written this way in plain words, typed or uploaded as a file.

Updated

Why does an answer key need more care for an AI grader?

An answer key needs more care because an AI grader applies what is written, while a colleague fills the gaps from experience. A colleague who sees "6. Tokyo, Rome" glances at the paper and knows there are two blanks. A tool needs that written down.

What does a complete answer key look like?

A complete key gives the total, the general rules and one line per question. Here is a full key for a 30-mark science test. The left column is all you would type.

Type this in your keyWhat it tells the marker
Class 8 science, unit test 3. Total 30 marks.A total to check your key and the report against
Questions 1 to 5 carry 1 mark each.A rule for a group of questions
Negative marking: -0.25 for each wrong multiple choice or true/false answer. No deduction for questions left empty.The deduction and where it applies
Ignore minor spelling slips in written answers.A general rule for near-misses
1. BOne correct option
2. DOne correct option
3. A and CBoth are needed for the mark
4. TrueTrue/false
5. FalseTrue/false
6. Tokyo, Rome (2 marks)Two blanks, 1 mark each
7. color / colour (1 mark)One blank accepting either spelling
8. evaporation or vaporisation (1 mark)One blank accepting either word
9. 12 m/s (2 marks)A number that needs its unit
10. 0.5 (1 mark)A number with no unit, so 1/2 also matches
11. Match the following: a-3, b-1, c-4, d-2 (4 marks)Four blanks, 1 mark each
12. Why does ice float on water? (4 marks) Key points: ice is less dense than liquid water (2); water molecules form a more open structure when they freeze (2).Marks per point
13. Describe the water cycle. (10 marks) Key points: evaporation from surface water (2); condensation into clouds (2); precipitation (2); water returning to the sea (2); stages in order and linked by cause (2). No diagram needed.Marks per point, and what isn't required

How should you number questions in the key?

Use the numbers printed on the paper, because answers and key lines are matched by number. Small differences in format are fine: evaleasy treats Q3, 3., (3), Question 3 and 3 as one question, and 2(a) the same as 2a. A different scheme is a problem, so 1(i) in the key won't match 1a on the paper.

A mismatch causes two errors at once. In evaleasy, a key question that isn't on the paper counts as unanswered but stays in the total, while a paper question with no key line is marked from an answer the model works out.

If numbering starts again in a new section, make the section clear in the key, with "Section B" above its answers or "B1" on the line. evaleasy keeps Section A's question 1 and Section B's question 1 apart when the sections are clear, and the report tells you when the key's numbers and the paper's don't line up. Numbering straight through is the simplest way to avoid any doubt.

How do you separate blanks from alternatives?

Use a comma or semicolon between separate blanks, and a slash or the word "or" between alternatives for one blank.

In your keyHow it is read
Tokyo, RomeTwo blanks: the first accepts Tokyo, the second accepts Rome
color / colourOne blank accepting either spelling
evaporation or vaporisationOne blank accepting either word
water / H2O; carbon dioxide / CO2Two blanks, each accepting two answers

What should you watch for with blanks?

Watch for order, large numbers and equal shares.

  • Order: blanks are checked in order, so "Tokyo, Rome" doesn't match an answer of "Rome, Tokyo". If any order is fine, add the note "either order".
  • Large numbers: write 1000 without a comma so it can't be read as two blanks. A student's 1,000 still matches by value.
  • Equal shares: in evaleasy each blank is an equal share of the question, so 3 marks across two blanks gives 1.5 each. If one blank deserves more, number the parts separately on the paper.

Which alternatives should you list?

List every answer you would accept that differs in wording, such as Mumbai / Bombay or DNA / deoxyribonucleic acid. In evaleasy you can leave out differences of capitals and punctuation, and numbers compare by value, so 12.0 matches 12.

Listing an answer makes it certain. Anything else goes to the model under your strictness setting, which decides on spelling slips and synonyms. To overrule that, add a rule such as "spelling must be exact". For units, only the same number with the same unit is an exact match: against a key of 12, an answer of 12 m/s goes to the model's judgement, and so does a bare 12 against a key of 12 m/s. To settle it yourself, list both, as in "12 / 12 m/s".

How should you state the marks?

State the marks on each line, or give one rule for a group such as "Q1-10 carry 2 marks each", because a missing value forces the marker to assume. evaleasy takes marks from the key, then what's printed on the paper, then a rule in your instructions. Failing those, it uses 1 for objective questions, 1 per blank, 5 for a short answer and 10 for a long answer.

How should you word negative marking?

Write the deduction as a plain rule, such as "-1 for each wrong answer", and say which questions it covers. Take 20 one-mark multiple choice questions with -0.25 for each wrong answer: a student with 12 right, 4 wrong and 4 left empty scores 12 minus 1, which is 11 out of 20.

evaleasy applies one deduction to every wrong multiple choice and true/false answer on a paper. Wrong blanks and numbers score zero with no deduction, empty answers are never penalised, and a paper's total can't go below zero. Choosing only A when the key says A and C counts as wrong and takes the deduction.

What should key points say for written questions?

Key points should name what a student must say and the marks each point earns, because a model answer alone doesn't show which parts matter.

WeakStrong
Q12. Photosynthesis.Q12 (3 marks). Light energy is used to make glucose from carbon dioxide and water (2). Oxygen is released (1).
Q9. x = 7, show working.Q9 (3 marks), a written answer. Reaches 3x = 21 (1). Divides both sides by 3 (1). x = 7 (1). Accept any correct method. Full marks only with working.

Common questions

Can my key be a copy of the paper with the right options highlighted?
Yes, as long as the correct option stands out. In a Word key, evaleasy recognises bold, underline, highlight and ticked boxes when only the correct option has them.
What happens if I don't provide a key?
evaleasy can still mark the paper: the model works out the answers, and the report says so on every question it affects. Check those answers first, because no teacher has confirmed them.
Do capital letters matter in an answer key?
No. In evaleasy, exact comparisons ignore case, so Paris and paris match. That also means CO and Co count as the same answer, so check by hand any question where capitals change the meaning, such as chemical symbols.
What if I find a mistake in my key after marking?
Correct the key and upload the affected papers again, which uses credits again. Identical files reuse their first reading, so only the marking changes. Redo won't fix this in evaleasy, because it keeps the same key.
Should the question paper and the key be separate files?
In evaleasy, yes, if you have both. They're separate uploads, so the marker knows which questions to expect and which answers are right. Correct answers never come from the question paper, even if an option on it looks marked.

Your next stack of papers doesn't have to be your problem.

Signing up is free. Marking uses credits, at 1 credit per page.

Get started