How to use chat mode
To open chat mode, click theDebug mode
To trace an agent, turn on Advanced mode and use tracing. The trace shows the LLM calls, tool calls, and skills of each turn.
- Triggered Intents and their scores
- Triggered Yes/No Intents and their scores
- Matched Slots
- Found Lexicon Keyphrases
- Flow Transitions, for example, when executing a Go To Node, an Execute Flow Node, or triggering an Attached Flow
- Node-specific output, for example, from an HTTP Request Node
- LLM call details for flows. For more information, see LLM call details for flows.

LLM call details for flows
With Advanced mode on, the trace shows an LLM call span for each call of an LLM Prompt Node, an AI Agent Node, or a Search Extract Output Node. The span details show how the call was served, including:- The model that served the call
- Latency metrics, such as total latency, time to first token, time per output token, tokens per second, and inter-token latency
- Prompt, completion, and total token counts, plus a cache token breakdown (cache read, cache write, and uncached tokens) when the model reports it
- The stop reason and the number of retries
- A callout when a fallback model served the call instead of the main model, along with the reason for the failover
- On a failed call, a breakdown of every model that was attempted and why each attempt failed
Connection loss and reconnection
If the interaction panel loses its connection, it automatically tries to reconnect and keeps your conversation. You don’t need to reload the page.- Short interruptions. If the connection returns within about 5 seconds, nothing appears.
- Longer interruptions. A banner appears above the message input. If your browser is offline, the banner says so. Otherwise, it says that the connection was lost and that the interaction panel is reconnecting. The message input stays enabled, and any text you typed is kept.
- Retries. The interaction panel keeps retrying with increasing delays between attempts, up to 30 seconds. To retry immediately, click Try now.
- After 30 seconds. The Reload page button appears. The interaction panel continues to retry in the background, so the banner disappears if the connection comes back. Reloading the page starts a new conversation and the current one is lost, so use it only as a last resort.
Messages typed during a connection loss
If the interaction panel loses its connection while you chat, it doesn’t fail the messages you send. Instead, it holds them in a queue above the message input and delivers them in order once the connection returns.- Brief interruptions: if the connection drops and recovers within about 5 seconds, no connection warning appears. Queued messages look the same as any other queued message.
- Longer interruptions: when the connection banner appears, queued messages are highlighted with a warning color and the label Waiting for connection. A screen reader announces that the message is waiting for a connection.
- Multiple messages: if two or more messages are queued, the queue shows a count of queued messages. Click the menu button to view and manage the individual messages.
- Remove a message: click the X button on a queued message to remove it before it’s sent.
- Full queue: when the queue reaches its maximum length, a hint below the message input says that the queue is full. Remove a queued message or wait for one to send before adding more.