Conversational testing

--> to the BOTwiki - The Chatbot Wiki

Conversational testing is a part of conversational design that comes into play when creating the conversational map or the conversation flow. This is where the chatbot's conversation threads are formulated and acted out in a real conversation. Primarily the so-called Happy Paths are tested to confirm the viability of the scenario. The testing could look like this:

Procedure for Conversational Testing

  1. Two interlocutors come together as testers. One represents the chatbot and one the user.
  2. A conversation thread from the Conversational Map is set for testing.
  3. The test person is immersed in the personality of the chatbot.
  4. The subjects sit back to back.
  5. The role of the user(s) tries to solve a specific problem with the chatbot and the partner tries to answer as the chatbot would.
  6. The conversation is recorded and transcribed.
  7. The conversation is revised if necessary and thus optimised.


The aim of conversational testing is to make the conversation as natural as possible with the user. In conversational copywriting, the messages are formulated taking into account the chatbot's tone, but it is difficult to get a feeling for whether this corresponds to a natural conversation. Conversational testing can, for example, reveal complex formulations or sentences that are too convoluted.

Because the following applies: A person wants to write in a chat in the same way as he communicates with his fellow human beings.

Another way to test the viability of a chatbot is the Wizard of Oz method.

> Back to BOTwiki - The Chatbot Wiki