
by Keywords AI
Respan is an open-source AI gateway with built-in observability and evals. It routes requests to 1,000+ models through one API and traces, monitors and tests every agent run.
Web appFreemium
Step 1: Sign up and get an API key.
Step 2: Point your existing SDK at the Respan endpoint.
Step 3: List the fallback models and set caching and spend limits.
Step 4: Open traces and monitors to watch agent runs.
Step 5: Set up evals to score outputs on a test set and in production.
You list the models to fall back to, and Respan moves to the next one as soon as a model errors or rate-limits.
Yes. You can set budgets and rate limits per key, per customer or org-wide, get warned near them, and block requests before spend runs away.
It stores a request and its response and serves the same call again instantly, cutting cost and latency on repeats.
The site says you point the SDK you already use at one endpoint.
GalileoGalileo is an AI observability and evaluation platform where offline evals become production guardrails. It includes 20+ out-of-the-box evals and compact Luna models for monitoring all traffic.
Agnost AIAgnost AI monitors production AI agents, finds silent failures and turns trace data into tested fixes. It can open a pull request with the fix.
Confident AIConfident AI is an AI quality platform for evaluating, tracing and monitoring LLM applications and agents. It turns failing production traces into evals that run on every release.