Athina AI
Collaborative platform to build, evaluate and monitor LLM apps, with 50+ evals, prompt management and production tracing.
What it does
Athina AI is a collaborative development platform for teams shipping LLM features. It lets technical and non-technical users manage and test prompts, evaluate datasets with preset or custom evals, annotate results, and monitor production traces. Everything works through the UI or programmatically via SDKs and a GraphQL API.
How to use: Athina provides a UI and API to manage prompts, evaluate datasets, log inferences, and create datasets. Users can prototype chains, run evaluations, and monitor model performance in production.
Core features
Prompt management and testing across models
50+ preset plus custom evaluations
Dataset experimentation and comparison
Human annotation for QA teams
Production monitoring, tracing and analytics
Self-hosted deployment, SOC-2 Type 2, custom models
Best for
→Evaluate LLM output quality
→Monitor AI apps in production
→Manage and compare prompts
→Collaborate across technical and QA teams
Pricing
Starter
$0/mo
Toolspool rankingby monthly traffic