Wizard of Oz Experiment

--> to the BOTwiki - The Chatbot Wiki

In the field of human-computer interaction, the Wizard of Oz method refers to a research experiment in which subjects interact with a computer system that is considered autonomous by the subjects but is actually operated or partially operated by an unseen human.[1]

Chatbots and Wizard of Oz

Chatbots are enormously suitable for the Wizard of Oz experiment. This means that a use case can already be examined for its "chatbot suitability" before implementation. The findings can then be used to iteratively expand existing flows and define new communication strands. In addition, the collected data, such as utterances, can be used directly for the Chatbot Training be used. A mature human handover tool is even able to automatically convert the tested data into a chatbot.

Recommended procedure

  1. Define different chatbot flows
  2. Integration of a live chat or an empty chatbot that only triggers a human handover.
  3. Manual response to user queries
  4. Derive chatbot flows
  5. Answering the queries based on the chatbot flows
  6. Iterative revision and expansion of the chatbot flows
  7. Manual or automated transfer of the flows into a chatbot builder

> Back to BOTwiki - The Chatbot Wiki


[1] Kelley, J. F., "An empirical methodology for writing user-friendly natural language computer applications". Proceedings of ACM SIG-CHI '83 Human Factors in Computing systems (Boston, 12-15 December 1983), New York, ACM, pp. 193-196