Step Explorer¶
Description¶
The main purpose of Step Explorer is to help you understand how the customer progresses through a conversation. The Step Explorer can visualize all significant situations/step paths of a conversation through the Flow (customers reactions to Virtual Agents answers and questions, when did the customer drop off, etc…) in a defined time period. Based on these findings you are able to evaluate may improve your Virtual Agent for better understanding in order to increase e.g. the number of orders or bookings or to reduce the number of support requests. The Step Explorer allows to explore conversational steps and can show how these steps are interconnected with each other.
- Start the Step Explorer via sidebar menu selection.
When the Step Explorer is selected, the agent name is displayed in the top left corner. Insights processes the current Agent's data and the Step Explorer report displays the data-related analytic graphs. If multiple agents are available in Cognigy.AI, you can select them here in a drop-down menu to analyze each of them.
Note
When switching between your Virtual Agent in Cognigy.AI to Cognigy Insights all filters are set in the way that you see the data concerning the active Agent. You can see how this Agent performs over a time period. To switch between Cognigy.AI and the Cognigy Insights application click on the correspondent "Insights" menu point in your user menu.
Filter options¶
Warning
Every change in filter settings needs to be confirmed with Apply to be active.
Local filter options
Note
The local filter options at the top are specific to the Step Explorer.
Starting Step
Conversational steps are only available and displayed here when you first have configured the Node settings in your Flow with annotations in the “Analytics steps” section e.g. with 'Welcome New Caller'. Then you can select the starting step here for Step Explorer processing starting at this point.
Note
Additionally, you can right-click on a Step and choose "Select as starting step" from the context menu.
Direction
You can choose between Forward and Backward. If you apply the forward direction, the step report starts with the first step (from the conversation's beginning to the end). If you apply the backward direction, the step report starts at the last step (from the conversation's end to the beginning).
Global filter options
Note
The global filter options at the bottom apply to all applications running in Cognigy Insights. More information about global filters you can find here: Global Filter.
Annotations¶
Before working with Step Explorer you need to annotate certain components in Cognigy.AI. Annotations can be defined in the Node settings of your configured Flow. Start the Node Editor, go to “Settings” and enter a meaningful annotation in the “Analytics step” section. The annotation should have an informative reference to the configured node. When you want to annotate for example a Say Node which starts a customer conversation with a welcome you can enter “Greetings” or “Welcome New Caller”. For Order Intents, you can enter the “Analytics step“ field for example “Order Intent triggered” as an annotation.
The more Flow Nodes you name with annotations in the “Analytics step” sections, the more fine graduation you will get with the Step Explorer data display.
Danger
The Step Explorer absolutely requires defined annotations for the evaluation and display of analytics data.
The Step Explorer provides the following advantages:
- Order intent understanding (how many customers have ordered something).
- Understanding of customer reactions at certain steps (how many, how often,….).
- You can define different time frames for evaluation.
- You can display the step report both in "Forward" and "Backward" directions.
- You can get the step report beginning at a „Starting Step“.
- You can click on a step to see details.
- You can select available snapshots from different Virtual Agent versions to compare them for improvement purposes.
Analysis¶
When local filter "Forward Direction" is set, the Step Explorer displays the conversations analysis results with the conversation's start on the left side to the conversation's end on the right side.
Using the previously in Cognigy.AI defined annotations in your Flow Nodes the Step Explorer can analyze the conversation steps and every annotation is assigned to a specific step. The corresponding conversation data in relation to the defined steps lead to a percentage distribution which the Step Explorer visualizes on the screen.
Analysis example:
100% of the users went through the starting step at the beginning of a conversation.
99% of the users who started a conversation went through a welcome as a new caller.
66% of the 'new callers' made an appointment - 11% of the new callers initiated a handover request.
51% of the users who made an appointment completed the booking.
48% of users who made an appointment needed explanations .....etc.
89% of users who needed an explanation completed the booking.
Note
The red marked areas of a step represent the number of users who dropped off at that point. You may take an early "drop off" in a conversation to improve your Agent and to inspect with our Message Explorer what did the Virtual Agent say before the user dropped off.
- You can get more details displayed when you hover the mouse over any step.
-
You can select any step as "Starting Step" in the local filter settings. The Step Explorer will then visualize the analysis beginning at that step.
-
You can change the conversation's "Forward" direction to a "Backward" direction. The Step Explorer will then display the analysis starting on the left side with the end of a conversation.
- You can click on a step, for example on "Make an appointment", and the Step Explorer will change the displayed analysis by a separated display of the selected step and the related analytics data in detail.
Fields with an 'arrow' icon are placeholders for hidden steps. These hidden steps will be displayed only when you click on an 'arrow field'. Using arrow fields make sure that the displayed steps are clearly arranged.
Example step analysis of "Make an Appointment":
Step label: 66% of the 'new callers' from the previous step made an appointment. Additional information via hover field: 66 % of the users who started a conversation made an appointment (the number found by Step Explorer: 5,477).
48% of the users who started to make an appointment needed explanations of what the Agent just did. 89% of them who needed explanations completed the booking and all of them dropped off afterward (100%).
48% of the users who started to make an appointment completed the booking.
100% of the users who completed a booking dropped off.
Note
The rated value of a conversation step relates directly to the previous step value before.
Example step "Completed Booking" and evaluation of additional displayed analytics data:
89% of the users who needed explanations completed the booking and all of them dropped off afterward (100%; end of conversation).
additional information (via hover function):
89% of the users completed the booking from the previous step. 28% of the users who started a conversation completed the booking. The Step Explorer found 2,368 as a total number of completed bookings.
Open Flow¶
To check your Flow or to improve the configuration the Step Explorer provides the context menu "Open Flow" option when right-clicking on a specific step, for example "Make an Appointment". Clicking the button leads you to the Flow in Cognigy.AI.
Note
The context menu "Open Flow" is not available on "drop off" steps or collapsed steps (steps with arrows). The "Open Flow" option is not available when there is no related Flow available in Cognigy. AI or when the Step Explorer visualizes steps of a Snapshot.
Open Node¶
Calling context menu on a Step defined in a Node will present "Open Node" menu option. Clicking it opens the Flow Editor with editing mode for the respective Node.
Go to Transcript Explorer¶
In case you want to evaluate the early drop-offs during conversations to improve your Virtual Agent a right-click on a 'Drop off' step provides a context menu "Go to Transcript Explorer" which allows you to check the conversations by searching keywords representing the steps when the customer drops off.
Inspecting conversations by taken Steps¶
In the context menu of a Step there are two options for inspecting the conversations. Activating one of them will open Transcript Explorer showing following conversations:
- "Open conversations that took this path" This option shows conversation that took exactly the path of the chosen Step. On the illustration below we have called a context menu on "Completed Booking" Step. Open conversations that took this path will show only conversations which contained the following Step Path: "Welcome New Caller" - "Make an Appointment" - "Explain" - "Completed Booking" Steps.
- "Open conversations which contain this step" This option shows all the conversations which have at least chosen Step, the exact path in this case is not important.