
by Solo.io
agentgateway from Solo.io is an open source, Rust-based gateway for LLM, MCP and agent-to-agent traffic. It adds security, rate limits and tracing between your agents and the models and tools they call.
APIContact for pricing
Step 1: Deploy agentgateway on Kubernetes using the quick start in the docs.
Step 2: Configure an LLM provider and send a request through the gateway endpoint.
Step 3: Add guardrails, rate limits and key storage as policies.
Step 4: Point your MCP servers or OpenAPI specs at the gateway to expose tools.
Step 5: Open the metrics endpoint or your OpenTelemetry stack to review token usage and traces.
The pages list OpenAI, Anthropic, Azure, Gemini and self-hosted models behind one OpenAI-compatible endpoint.
Guardrails run in sequence on requests and responses. A regex check runs first, then external moderation and custom webhooks if configured, and each layer can pass, mask or reject the content.
Yes. You supply an OpenAPI spec and the gateway exposes it as MCP tools without code changes.
It exposes a token usage metric and normalizes input and output token counts across providers, including cache-read and cache-creation tokens.
VirusTotalVirusTotal checks files and URLs against dozens of antivirus scanners and blocklists and shows each engine's verdict. It has a web interface and an HTTP API.