Version 4 Testing Prep

This is the final prototype, so i'd like to gather as large a range of data about it as possible. The best way to this is probably through surveys, and i may also conduct an interview and an observation of two users using it to see whether they understand it and to get their feedback on it. I will triangulate this feedback.


What do i want to find out?
The manual: does it make sense, does it explain the prototype well enough for them to use it alone?
Would people use it?
How would they use it?
What improvements they'd make to it.


The survey


DECIDE framework will be used again

1. Determine the goals
2. Explore the questions
3. Choose the evaluation paradigm and techniques
4. Identify the practical issues
5. Decide how to deal with the ethical issues
6. Evaluate, interpret, and present the data

1. The goals are to see if people like the prototype, understand it, and how they would use it

2. The exact questions

EXPLAIN THE PROTOTYPE VISUALLY & DESCRIPTIVELY FIRST

AGE

DO YOU UNDERSTAND THE SYSTEM

WHAT ARE YOUR IMMEDIATE RESPONSES

DO YOU LIKE IT

WOULD YOU USE IT

WHO WOULD YOU USE IT WITH

WHAT IMPROVEMENTS WOULD YOU MAKE TO IT

WOULD YOU LIKE A 2-WAY SYSTEM

3. Survey, will be conducted online using surveymonkey but a pilot survey will be conducted on paper first

4. practical issues-distribution, how to clarify the concept. use a visual storyboard or do an instructional video?

5. ethical issues-data protection & anonymity; make this clear to users

6. evaluation will be largely quantitative for this

Observation & Interviews

This will be conducted in natural settings with two users who are unfamiliar with the prototype. They will be given the prototype and the manual and then seen how they interact with it. They will then be interviewed and their feedback analysed. The goals for the interview are the same as with the previous focus group. The observation will be recorded through notes. I'd also like to ask them if they'd like a two way system where both users are present at purchase and involved in the audio embedded in both. This would make it less of a surprise, but in a way it might make them feel more connected through this joint experience. The receiving user will also be asked if they'd like to be able to provide feedback themselves i.e. saying 'thankyou'. .

These two methods will allow for final evaluation of the prototype, and planning will be conducted for the observation/interview. An informed consent form and prep sheet will be made the observation/interview.

I may also conduct a predictive evaluation.