Carry out usability tests on your prototype.

Depending on the maturity of your students, you might consider having the students conduct a “dress rehearsal,” where you act as the test user and the students conduct the test on you. This will give them another chance to practice and you can help them fine-tune their presentation and demeanor.
Make sure that they give the appropriate pre-test orientation to the user, including instructions on how to use the prototype and offering an informed consent. Also check their test scenarios. They should state a goal such as, “Buy a ____” or “Find a ___”. They should not include instructions on what button to press.
You can observe the test team administering a test to a user. The following is a possible scoring sheet for such an observation. In fact, we distribute the scoring sheet when we assign this homework as a means of focusing their preparation. Edit the sheet to suit your purposes.
A note about the scoring sheet: There is an attempt to balance individual performance versus overall team performance. There is an individual score and a team score. Each individual is responsible for a certain number of points. The greeter is responsible for 25 points; the facilitator is responsible for 20 points; the computer for 11 points and the observer for 13 points. The individual score is the percentage of points earned out of the individual points possible. Thus, one person who performed very well when the rest of team did poorly will not overly punished. Conversely, one person performing poorly will not be buoyed up as much by a strong team performance.

Greeter Puts user at ease: 1. 3
2. 3
3. 3 In a written document, greeter explains: 1 The purpose of the test 2
Explains user’s contribution / empowers user (3 ways) 6 Explains how user should interact with prototype 3 Encourages user to "think aloud" 2 Offers Informed Consent document. Waits while user reads and signs. 2
FacilitatorGives users tasks to perform, one task per card 3 Encourages user to express thoughts 3 Allows user to struggle without offering help too quickly 5 Makes sure that tests finish on time 4 Maintains a neutral demeanor at all times 3 Concludes each task in a neutral manner 2
Computer Correctly responds to user input 4
Responds to user input in a timely manner 4
Maintains a neutral demeanor at all times. Does not speak during test. 3
Observer Stands out of line of direct sight of user 2 Positions self to see the user’s hands, face and screen 2 Takes notes, one per card 3 Takes notes quietly 3 Maintains neutral demeanor at all times. Does not speak during test. 3
Conclusion Thank user for participating (all team members can do this) 3
General Test team arrives on time and sets up quickly 5 Finished within scheduled time without prompting from instructor 2
Consent Form is clearly written and includes 1 "I have freely volunteered to participate" 1 Statement of purpose 1 Statement of benefit and any risk 1 User has the opportunity to ask questions 1 Affirmation of confidentiality 1 "I am at least 18 years of age." 1 Contact information of tester; tester’s supervisor 1 "My signature below affirms all of the above prior to participation" 1
Pretest Questionnaire includes A method to determine if person is part of target user group 4
Task list Clearly stated/phrased 2
Tasks Appropriate tasks for each user group 7
Team Total (out of 100)Individual contribution (percentage of points for specific role)Overall score (50% team total + 50% individual contribution)