Confidence Score / Confidence Level

--> to the BOTwiki - The Chatbot Wiki

The Confidence Score, or Classification Threshhold, indicates how sure the NLP service / machine learning model is that the respective intent was correctly assigned. The score can have a value between 0 and 1 , depending on how the neural networks work. In general, a score for each intent is calculated for each user input and the one with the highest value is returned as the result. If the confidence level falls below a predefined limit, a fallback intent is issued.

An example for the calculation of the Confidence Score at Google Dialogflow:

The following four training phrases were entered for the intent "Burger_order". Training phrases have been added:

"Burger Order",

"Order burger",

"I would like to place an order for a burger",

"I want to order a burger"

Dialogflow calculated a confidence score of 0.8 for the user input of "I would like to order a burger from you" . The NLP service Dialogflow is therefore 80% sure that the response issued from the intent "Order_a_burger" was correct. Based on this data and previously defined rules, no fallback intent is issued.

> Back to BOTwiki - The Chatbot Wiki