• Response should not send links that don't exist
• Response should be faithful to the context provided
• Response should answer the user's query directly
• Response should be < 200 words
• Response should not contain profanity
• Response should not ask the user for card information
• Response should not ask the user to contact customer support
• Response should not claim to have taken an action (updated shipping address, processed a refund, etc)

// GENERATED BY GPT

Elevating your AI chatbot to top performance requires a strategic approach—with a comprehensive eval suite that underscores quality and relevance. Top teams focus on specific, actionable evaluations to streamline their chatbot's interactions.

For a Customer Support Chatbot serving ecommerce websites, the eval suite would home in on the following points:

• Ensuring responses are concise and informative, capped at under 200 words.
• Responses strictly avoid sending non-existent links.
• Every reply faithfully adheres to the given context.
• Directly answering the user’s query is paramount.
• Profanity is a no-go, maintaining a clean and professional dialogue.
• No requests for the user's card information are made to protect privacy.
• Avoidance of diverting the user to contact human support.