Two reviews of the same tool
Review A: "The tool was fine. It worked well. I am happy."
Review B: "The tool refuses a double booking. Test 5 shows it. It cannot yet cancel by phone number, so desk staff need the full name. I would add a search box."
Which review helps the client? Which would you trust?
Key words
| Word | What it means | Example |
|---|---|---|
| Evaluation | Saying how good something is, and giving reasons. | The tool meets 5 of 7 needs |
| Reflective | Looking back at what you did and learning from it. | I should have tested earlier |
| Strength | Something that works well. | The double booking check |
| Weakness | Something that does not work well or is missing. | No search box |
| Improvement | A change that would make it better. | Add a search box |
| Evidence | Proof for what you say. | test 5 passed |
| Requirement | Something the solution must do. | refuse a double booking |
| Success measure | A check that shows a requirement is met. Also called a success criterion. | a booking takes under 2 minutes |
| Command word | The word at the start of an exam question that tells you what to do. | Describe, Evaluate |
| User needs | What the people who use the tool need from it. | desk staff need it to be simple |
The cells students fill in are left blank in this preview.
Step 1: check each requirement
| Requirement | Met? | Evidence |
|---|---|---|
| Book a court | Yes | Test 1: booking saved |
| Refuse a double booking | Yes | Test 5: second booking refused |
| Refuse hours before 9 or after 20 | Yes | Tests 4 and 7: refused |
| Show the price | Yes | Test 9: 8 pounds for 2 hours, member |
| Cancel a booking | Partly | Test 11: works by full name only |
| A desk worker books a court in under 2 minutes | Yes | A friend made 3 bookings. They took 1 minute 30 seconds, 1 minute, and 1 minute 10 seconds |
| Send a text message | No | Not built: could-have, no time |
The cells students fill in are left blank in this preview.
Try it: count what is met
results = ["yes", "yes", "yes", "yes", "partly", "yes", "no"]
met = results.count("yes")
print("Met", met, "out of", len(results))
print("Partly:", results.count("partly"))
print("Not met:", results.count("no"))
# Change a result and run it again.
Step 2: say what it means
A table is not an evaluation. You must say what it means.
Use three parts for each point: what you found, the evidence, and what you would do next.
Sentence starters
| Part | Starter | Example |
|---|---|---|
| Found | The tool meets requirement ... because ... | The tool refuses a double booking because in test 5 the second booking was refused. |
| Not found | It does not yet ... which means ... | It does not yet cancel by phone number, which means staff must type the full name. |
| Next | To improve this, I would ... so that ... | I would add a search box so that staff find a booking faster. |
| Decision | Overall, the tool ... because ... | Overall, the tool solves the main problem because every must-have passed its tests. |
The cells students fill in are left blank in this preview.
Quick check: a good evaluation
Have a go
Quick check: a good evaluation
4 questionsYour answers are marked here and are not kept. A college account keeps every student’s marks.
Ask a real user
data-callouts.tip.label
Ask somebody to use your tool, like a friend or a classmate. Watch what they find hard. Write it down. What a user says is good evidence that you meet their needs.