Key benefits
- Rapid quality assessment. You can evaluate the NLU model’s effectiveness at a glance without extensive manual testing.
- Targeted improvements. The intent analyzer includes detailed scoring that highlights specific areas for refinement, thereby improving intent recognition.
Restrictions
- After editing example sentences, the NLU model must be retrained to update scores.
- Strong overall intent model scores don’t guarantee perfect individual intents. Red or yellow intents may still need work.
- An intent requires at least five example sentences. If you train it with fewer, a red indicator appears after the build, signaling that while the intent still functions, its performance will be significantly reduced.
How to set up
- Go to Advanced > NLU and select the Intents tab.
- Add a variety of example sentences to each intent.
- In the upper-right corner, click Build Model to process the sentences and generate the initial model.
- View scores for the overall model, individual intents, and example sentences.
Explore intent analyzer
The intent analyzer assesses three main components:- Overall intent model. Shows a total score for the NLU model’s quality.
- Individual intent. Shows scores for each intent, which reflect how well the NLU model recognizes them and if they overlap with other intents. You’ll see the NLU score along with names of any overlapping intents.
- Individual example sentence. Each example sentence receives a score based on how effective it is within the NLU model. You can see the score and any overlapping intents by hovering over the traffic light in the interface.
How to test
You can test NLU scores using the following interfaces:- GUI
- API
In the Interaction Panel, activate Debug Mode and explore the detailed results in the
input.nlu.intentMapperResults.scores object.