To ensure that flows operate correctly, it is essential to monitor the processes of ClaudIA and Controlled Flows.
We have a platform called ClaudIA panel, where all interactions passing through ClaudIA are recorded. On the panel, you can view the interactions, track flows triggered by Controlled Flows, and identify opportunities for improvement, ensuring increasingly efficient and well-monitored service.
ClaudIA panel Overview: Main screen displaying ClaudIA's conversation history
The panel functions as a central dashboard that allows auditing, analyzing, and improving customer service. It provides a detailed view of the conversation flows, helping to identify potential bottlenecks and facilitating actions for continuous optimization.
Flow Tracking in the ClaudIA Panel: Example of a conversation showing the start of a Controlled Flow and a return marker to ClaudIA at the end of interaction.
ClaudIA panel Features
✔ Complete recording of conversations: all messages exchanged between customers and ClaudIA are stored for analysis and audit.
✔ Monitoring Controlled Flow executions: whenever ClaudIA triggers a Controlled Flow, the panel displays an indication with the flow name and the messages exchanged within, allowing tracking of the customer's journey.
✔ Indication of flow end: when a flow is completed, there is a notification of returning to ClaudIA, helping to understand when the interaction reverted to AI.
✔ Audits for continuous improvement: The ClaudIA Panel enables strategic adjustments, such as refining N1 and N2 contents, creating interactive flows, and identifying failure points that impact the customer experience.
✔ Error monitoring in Controlled Flow requests: If there is a failure in API calls or integrations within a Controlled Flow, the ClaudIA Panel allows identifying these issues, enabling quick corrections to prevent impact on service. A high-level block with a log is shown at the time of failure to facilitate issue identification.
ClaudIA Panel Log Example: indication of a failure in a Controlled Flow request
The ClaudIA Panel is an essential tool to ensure efficiency, transparency, and continuous evolution of the service, providing strategic insights into the interaction between ClaudIA, Controlled Flows, and customers.
The following features are available for analysis and optimization:
Identifying When a Controlled Flow is Called
-
On the ClaudIA Panel, it is possible to see exactly when a Controlled Flow was triggered within a conversation.
-
The start and end of the flow are recorded, allowing clear tracking of what happened during execution.
Suggested Process for Testing and Improving Controlled Flows
To ensure quality and ongoing improvement of flows created in Controlled Flows, following a structured testing and enhancement process is crucial. Since Controlled Flows does not have native version control, best practices include backup, isolated testing, and validation before publishing.
Building and Modularizing
-
Whenever possible, break complex flows into smaller, reusable parts.
-
Use flow calls to facilitate maintenance and avoid rework.
-
Ensure all conditions (if/else) are correctly set to prevent incorrect decisions.
Testing Before Publishing
-
Before publishing any changes, duplicate the flow and run tests in an isolated environment.
-
Execute comprehensive simulations, verifying decision logic, sent messages, and configured integrations.
-
Validate response times by observing the interval between the customer's message and ClaudIA's response in the panel. This helps identify potential delays in requests, even without exact duration details. Avoid requests that may exceed the 45-second timeout.
Backup and Change Control
-
Since there is no native versioning system, download a copy of the flow before any modification.
-
Publish only after all changes are validated to avoid unexpected failures.
-
If a downgrade is needed, use the saved version to quickly restore the previous flow.
Continuous Monitoring and Improvement
-
Monitor flow executions on the ClaudIA Panel, checking which were triggered and if there were failures or unexpected deviations.
-
Analyze logs and error messages to identify optimization points.
-
If recurrent failures occur, adjust decision conditions and alternative flows to ensure smoother service.
This structured process minimizes errors, optimizes Controlled Flow performance, and enhances the customer experience, ensuring each flow operates at its best.