Formative Evaluations

• Iterative Design
• First Formative Evaluation
  • Resources
  • Participants
  • Evaluation Methods
    • Observation
    • Think-aloud
    • Interviews
  • Questionnaire Results
  • System Usage
    • Using the widgets
    • Making use of the Help notes
    • Getting to and from the thesaurus
    • Moving terms into and out of the query
    • Adding new terms
    • Navigating the hitlist
    • Recognising the significance of thesaurus partial matches
    • Recognising the implications of relevance judgements
    • Recognising why extracted terms were added to the query
    • Recognising when the hitlist changed
    • How do users formulate their initial query?
    • How did users decide which terms to add?
    • How did users interpret the thesaurus display and functionality?
    • How did users make relevance judgements?
    • How did users compare ENQUIRE with other systems?
• Second Evaluation
  • Test Design
  • Method
  • Participants
  • Queries
  • System Usage
    • Search success
  • Questionnaire Analysis
    • How users formulated their initial query
    • How users perceived the ``Suggested Words'' list
    • Whether users understood the implications of their relevance judgements
    • What users thought of ENQUIRE in general