by AgentOps
AgentOps is a developer platform for tracing, debugging and monitoring AI agents and LLM apps. One SDK works with major agent frameworks and tracks cost and tokens.
Web appFreemium
Step 1: Install the SDK with pip install agentops.
Step 2: Create a free account and add your API key.
Step 3: Run your agent so events are recorded.
Step 4: Open a session to inspect LLM calls, tools and costs.
Step 5: Replay a run to debug a failure.
The site names OpenAI, CrewAI and Autogen and cites 400+ LLMs and frameworks.
It lets you rewind and replay agent runs with point-in-time precision.
Self-hosting on AWS, GCP or Azure is listed under Enterprise.
Yes. It tracks token counts and cost across agents.
Keywords AIRespan is an open-source AI gateway with built-in observability and evals. It routes requests to 1,000+ models through one API and traces, monitors and tests every agent run.