Skip to main content

Validating and Troubleshooting AI Responses

How to Troubleshoot and Identify the Source of Information

T
Written by Team at Myma.ai
Updated over a week ago

View Published Content

The AI learns from content that comes from your website, uploaded documents, FAQs, room descriptions, and other sources within the Knowledge Hub.

To see everything that’s currently published, navigate to the Knowledge Hub and select Publish AI. On that page, click View Published Content

Once you click this it will automatically download a text file that houses all the information that is published at that time.

This file contains all the information that the chatbot currently uses to answer guest questions. Reviewing this file can be very helpful for verifying the content that is live and ensuring that your chatbot provides accurate and up-to-date information.

Conversation Logs

Sometimes, there is a need to investigate the AI response to determine the source of the response. This can help determine if the source of the response is coming from an unpublished page, an outdated FAQ, or content hidden within a document, making it difficult to trace the exact source manually.

For every response, you can view the source in Unified Inbox. Locate the conversation, look under the Unique Chat ID, and select the arrow icon to view where the information originated.

After selecting this, a window will pop up showing every query that was asked, along with all the information the chatbot used to generate its response. From here, you can search for specific details or missing information by pressing Command + F on Mac or Ctrl + F on Windows.

Once you’ve found it, you can locate where the information is stored and update or remove it as needed.

Correcting the Information

Once you’ve located the source of the incorrect content, you can take the appropriate action:

  • Edit the text within the knowledge hub or connected document to update it.

  • Remove the outdated information if it is no longer relevant.

  • Unpublish or disconnect old sources that the chatbot should no longer reference.

After making the necessary adjustments, perform a quick test chat to confirm that the AI is now responding accurately.

Summary

This new feature is designed to make troubleshooting inaccurate chatbot responses simpler and more transparent. By using the Unique Chat ID and arrow icon within the Unified Inbox, you can easily trace responses back to their original sources, verify accuracy, and make corrections within minutes instead of hours.

Did this answer your question?