First Formative Evaluation : Post-Test Interview Topics

1. TYPING A QUERY
   1. WAS IT EASY/NOT EASY TO FIGURE OUT WHERE TO START?
   2. HOW DID YOU DECIDE TO DESCRIBE WHAT YOU WERE SEARCHING FOR IN THE WAY YOU DID?
   3. WAS IT EASY OR DIFFICULT TO DESCRIBE YOUR TOPIC?
   4. WHEN WORDS APPEARED HERE (THESAURUS PARTIAL MATCHES), WHAT DID YOU THINK WAS GOING ON?
   5. WERE THESE WORDS AND PHRASES USEFUL OR NOT? HOW?

2. THE THESAURUS
   1. DID YOU NAVIGATE THE THESAURUS ?
   2. WHY DID YOU DECIDE TO NAVIGATE THE THESAURUS?
   3. COULD YOU EXPLAIN TO ME WHAT THESE BOXES ARE FOR:
      1. the Broader Words/Phrases box
      2. the Narrower Words/Phrases box
      3. the Related Words/Phrases box
      4. the Words and Phrases to be Added to Your Query box
   4. WHAT DO YOU THINK THE THESAURUS IS FOR?
   5. WAS IT HELPFUL OR NOT HELPFUL? IN WHAT WAYS?

3. FULL DOCUMENT DISPLAY
   1. WHEN THE FIRST DOCUMENT DISPLAYED, WAS THIS THE RESULT YOU EXPECTED?
   2. WAS THE FIRST BOOK DISPLAYED THE SORT OF THING YOU WERE LOOKING FOR?
   3. DID YOU FIND THIS DECISION EASY OR DIFFICULT TO MAKE? WHY?
   4. WHEN YOU CLICKED THE YES BUTTON, WHAT DO YOU THINK ENQUIRE DOES. HOW ABOUT THE NO BUTTON?
   5. WHEN NEW TERMS APPEARED IN THE QUERY TERMS LIST, WHAT DO YOU THINK WAS HAPPENING?

4. THE HITLIST BUTTON
   1. WHEN YOU CLICKED ON THE HITLIST BUTTON, WAS THIS THE RESULT YOU EXPECTED?
   2. IN WHAT WAY WAS IT AS YOU EXPECTED/NOT AS YOU EXPECTED?

5. CURRENT QUERY AND YOUR REMOVED TERMS
   1. WHAT DO YOU THINK THESE LISTS WERE FOR? WERE THEY HELPFUL?
   2. WHY DO YOU SUPPOSE CERTAIN TERMS/PHRASES WERE IN DIFFERENT COLOURS?
   3. WHEN YOU DID THIS (MOVED WORDS/PHRASES INTO OR OUT OF THE THE QUERY TERM LIST?), WHAT DO YOU THINK WAS HAPPENING?
   4. WHEN THE WORDS/PHRASES CHANGED ORDER IN THIS LIST, WHAT DO YOU THINK WAS HAPPENING?

6. EXPANDING A SEARCH --- THE EXPAND SEARCH BUTTON
   1. HOW DID YOU DECIDE WHEN TO CLICK THE EXPAND SEARCH BUTTON?
   2. WHAT DO YOU THINK THAT ENQUIRE DOES WHEN YOU CLICK EXPAND SEARCH
   3. WERE THE RESULTS OF CLICKING THE EXPAND SEARCH BUTTON AS YOU EXPECTED?
   4. IN WHAT WAY WERE THEY AS YOU EXPECTED/NOT AS YOU EXPECTED?

7. THE TYPE EXTRA WORDS BUTTON
   1. DID YOU EVER WANT TO TYPE ADDITIONAL WORDS TO ADD TO YOUR QUERY?
   2. WAS IT CLEAR HOW TO DO THIS?

8. ENDING A SESSION
   1. WHY DID YOU DECIDE TO END THE SEARCH SESSION?
   2. WERE YOU SATISFIED/NOT SATISFIED WITH THE RESULTS OF YOUR SEARCH?
   3. IN WHAT WAY WERE YOU SATISFIED/NOT SATISFIED?

9. ENQUIRE IN GENERAL
   1. WAS THERE ANYTHING YOU FOUND IRRITATING ABOUT THE WAY ENQUIRE BEHAVED?
   2. WAS THERE ANYTHING YOU FOUND IRRITATING ABOUT THE ENQUIRE INTERFACE?
   3. WAS THERE ANYTHING THAT YOU FELT WAS MISSING?
   4. DID YOU LOOK AT THE HELP MESSAGES?
      1. How often did you look at the help messages?
      2. Did you find them useful?
      3. Would you have liked more help?
   5. HOW WOULD YOU RATE/COMPARE THIS SYSTEM WITH OTHERS YOU HAVE USED?
   6. HOW DO YOU THINK THAT THIS SYSTEM IS DIFFERENT FROM OTHERS?