Key Benefits
- Improved Accuracy. Adjustable thresholds enhance the reliability of Intent mapping by setting clear confidence levels.
- Flexible Control. You can fine-tune the system’s sensitivity to match specific use cases or performance needs.
Prerequisites
Before using thresholds, ensure the following:- An active Flow is set up within the Project.
- Intents are defined to allow the NLU to classify user inputs.
How to Use
Explore threshold types, then set them up.Explore Threshold Types
Type | Description |
---|---|
Confidence Threshold | Intents with a score higher than this threshold are considered as confirmed. |
Reconfirmation Threshold | Intents with a score higher than the reconfirmation threshold but lower than the confidence threshold require reconfirmation. |
Not Found Threshold | Intents with a score lower than the reconfirmation threshold aren’t considered. |
Reconfirmation Threshold Specifics
The reconfirmation threshold behaves differently depending on whether a confirmation sentence exists in your Intent:- With a confirmation sentence, the reconfirmation threshold triggers the reconfirmation sentence.
- Without a confirmation sentence, the reconfirmation threshold confirms the user input.
Set up Thresholds
Thresholds can be configured at either the Flow or Project level. To set them up:- Flow level
- Project level
- In the Flow editor, go to Settings > Configuration.
- Activate the Thresholds option. As soon as activated, this option overrides the Thresholds values set up at the Project level.
- Adjust the threshold sliders:
- Reconfirmation Threshold (default: 0.2):
- Move the slider left to increase reconfirmation prompts.
- Move the slider right to reduce reconfirmation prompts.
- Confidence Threshold (default: 0.4):
- Move the slider left to allow lower-confidence matches.
- Move the slider right to require higher confidence for matches.
- Reconfirmation Threshold (default: 0.2):
Example
Imagine a user asksCan you book a flight?
in the chat with the AI Agent. The NLU model assigns a score to the BookFlight
Intent:
Score | Threshold Range | Outcome | AI Agent Response |
---|---|---|---|
0.5 | Above confidence threshold (0.4) | The Intent is confirmed and the conversation proceeds. | — |
0.3 | Between reconfirmation threshold (0.2) and confidence threshold (0.4) | AI Agent seeks confirmation. | Did you mean to book a flight? |
0.1 | Below reconfirmation threshold (0.2) | The Intent not recognized. | I'm not sure what you mean. |