Web Advisory Group
Instructions for Observers, page 2
There are 2 sets of test questions (A and B). Half of you will be using A and half B. This is to make sure we cover a wide variety of questions.
Download the PDF versions of these questions here:
- Test A: observer worksheets
- Test A: large-size questions
- Test B: observer worksheets
- Test B: large-size questions
Remember to bring:
- The printouts of test A or B (above)
- A watch (a stopwatch would be great)
- A pen or pencil
- Thank you's: Toscanini's coupons
1. Read the following instructions to the tester:
The goal of this test is to evaluate how users find information on the MIT Libraries web site. I will ask you a series of questions and would like you to think out loud while you look for the answer. I will be timing you, and will stop you after 3 minutes have passed for each question. Some questions are easy and some are more difficult. Don't worry if you can't find the answer every time. Remember: we are testing the effectiveness of our site design -- this is not a test of you! The whole test should take about 1/2 hour. Do you have any questions?
2. Do not offer comments or assist unless absolutely necessary.
3. Read the first question to the tester and then write down the time started.
4. Fill out the observer form while watching them or immediately after watching them do each question.
5. Write down the time stopped. Finish making your notes on the form before moving on the next question.
6. Read the next question, and repeat the process.
7. Remember to stop the tester and move on if it is taking longer than 3 minutes. It's OK to show the answer at completion of the question if the tester couldn't find it and they are curious.
8. When the tester is finished (or when 1/2 hour has passed), ask him/her to fill
out the post-test questions.
Have them go directly to this URL for the post-test questions:
http://libstaff.mit.edu/webgroup/usability/survey.html
9. If they would like to find out about the results of this study, tell them that it will be posted on our staff web sometime in April. (somewhere on the webgroup page: http://libstaff.mit.edu/webgroup/ )
10. Thank them for their input and give them the Toscanini's coupon before you leave.
[back to: Instructions, page 1]