Yes, you can really configure an eval that quickly with Athina.

(Here's a tutorial where I set up an eval in 14 seconds)

We just shipped a new UI for configuring evals. 🚢

Any automatic eval is now just a few clicks away.

These evals will run automatically against inferences you've logged to Athina.

Documentation | Try it yourself

Want to run the evals programmatically instead?

Then run them using our Open Source Python Library.

Lots of users want to run evals programmatically during their development workflow.

So we've released an Open-Source library of evals you can use to run evals: https://github.com/athina-ai/athina-evals (⭐️ stars are much appreciated ⭐️)

It's also very simple to use.