Easier to read with cream paper, a tint, more contrast or larger text? Choose your colours and text, once, for every page.

Preview

Eight ways to get feedback and data

This is the first page of the lesson. Read it and have a go at the activities. The rest is in the full lesson.

50 minutes

Is the app any good?

Your team finishes a quiz app. You think it is great. But what do the users think?

You could ask them. You could watch them. You could count how often they use it.

Each way gives you a different kind of answer. A good developer knows many ways, and chooses the right one.

Key words

WordWhat it meansExample
Qualitative dataData in words: opinions, feelings and reasons."The menu is confusing."
Quantitative dataData in numbers: counts, times and scores.4 out of 5 stars; 12 seconds
SurveyA set of questions that many people answer.an online form
InterviewA planned conversation with one person.ten minutes with a teacher
Focus groupA small group of users who talk about a product together.six students and a leader
ObservationWatching people use the product and noting what happens.seeing a user get stuck
Performance dataNumbers about how the software runs.page load time
Use dataNumbers about how people use the software.how many users press Pay
AppraisalA planned meeting where your manager looks at your work and gives feedback.a yearly review with your line manager
Peer mentoringA person at a similar level helps and advises you.a classmate reviews your code

The cells students fill in are left blank in this preview.

Two kinds of data

QuestionQualitativeQuantitative
FormWords, opinions, storiesNumbers
Answers the questionWhy? How do you feel?How many? How long? How much?
Example"I could not find the Pay button."14 of 20 users could not find the Pay button.
Good forUnderstanding reasonsSeeing the size of a problem
WeaknessHard to count, takes timeDoes not say why

The cells students fill in are left blank in this preview.

Quick check: words or numbers?

Have a go

Quick check: words or numbers?

8 questions
Have a go: your answers are marked here and then forgotten. Sign in if you would like your score kept, and to pick up where you left off.Sign in to keep your score

Your answers are marked here and are not kept. A college account keeps every student’s marks.

Eight methods

MethodWhat you doKind of data
Verbal feedback (informal)Chat with a user and listenQualitative
Verbal feedback (formal)A planned meeting, with notesQualitative
Survey or questionnaireMany people answer the same questionsBoth: ratings (numbers) and comments (words)
Performance and use dataRead logs and countersQuantitative
ObservationWatch users, fill in a recordBoth: times (numbers) and behaviour (words)
Focus groupTalk with a group that is like the usersQualitative
InterviewAsk one person many questionsQualitative
Peer mentoring, line management, appraisalA peer or your manager gives feedback on your workMostly qualitative

The cells students fill in are left blank in this preview.

Try it: read some performance data

Code: python
load_times = [2, 3, 2, 8, 3, 2, 4, 9, 3, 2]   # seconds

total = sum(load_times)
average = total / len(load_times)
slowest = max(load_times)
slow_pages = 0
for t in load_times:
    if t > 5:
        slow_pages = slow_pages + 1

print("Average:", average)
print("Slowest:", slowest)
print("Pages slower than 5 seconds:", slow_pages)

# Change a number and run it again.

Observation: watch and write

In an observation you watch a user try the app. You say nothing. You do not help.

You fill in an observation record. It says the task, the time taken, what went wrong, and what the user said. Watching shows problems that people forget to tell you about.

An observation record

TaskTimeProblems seenWhat the user said
Find the homework page40 secondsPressed Messages by mistake"Where is it?"
Hand in work1 minute 10 secondsDid not see the Upload button"Oh, it is there."
Log out5 secondsNoneNothing

The cells students fill in are left blank in this preview.

The lesson goes on

4 more parts of this lesson are in the full curriculum, with the tasks, the final check and the labs. A college account gives your students all of it.