Ploba logo

Find the right AI tool for the job: apps, agents, APIs, MCP servers and datasets, explained plainly.

Get the AI Digest

Discover

  • Explore
  • Top Charts
  • Categories
  • Agents
  • MCP servers
  • Developer tools

Learn & community

  • Learn AI
  • AI Glossary
  • Blog
  • Hackathons
  • People
  • AI Digest

For makers

  • List your tool
  • Docs
  • Claim a listing
  • Advertise
  • Write for us

Company

  • About
  • Careers
  • Changelog
  • Trust
  • Security
  • Contact

© 2026 Ploba. All rights reserved.

  • Privacy
  • Terms
  • Cookies
  • Advertising
  • All policies
llms.txt
Ploba logo
DiscoverHackathonsPeopleLearnAI Digest
Sign inGet started
HomeTop ChartsExploreCategories
TypesWeb apps1,894Agents585Plugins416APIs376Mobile apps152Datasets85
AdvertisingYour product hereReach people browsing AI tools on Ploba.Advertise hereAdvertisingYour product hereReach people browsing AI tools on Ploba.Advertise here
  1. Explore
  2. /
  3. Developer Tools
  4. /
  5. Gloo AI Gateway
Developer Tools
Gloo AI Gateway icon

Gloo AI Gateway

by Solo.io

agentgateway from Solo.io is an open source, Rust-based gateway for LLM, MCP and agent-to-agent traffic. It adds security, rate limits and tracing between your agents and the models and tools they call.

API·Contact for pricing

Visit solo.io(opens in a new tab)

About Gloo AI Gateway

Key features of Gloo AI Gateway

  • OpenAI-compatible endpoint for many LLM providers and self-hosted models
  • Token and request rate limits to control spend
  • Layered guardrails: regex filters, external moderation and custom webhooks
  • Centralized storage of provider keys with access control
  • OpenTelemetry tracing, logs and token usage metrics
  • MCP and A2A gateway with a single policy across tools
  • Expose any OpenAPI spec as MCP tools
  • Inference routing to self-hosted models with priority scheduling

Who Gloo AI Gateway is for

  • Platform and DevOps teams running AI agents on Kubernetes
  • Security teams governing MCP and LLM access
  • Teams hosting their own models who need request routing

How to use Gloo AI Gateway

  1. 1

    Step 1: Deploy agentgateway on Kubernetes using the quick start in the docs.

  2. 2

    Step 2: Configure an LLM provider and send a request through the gateway endpoint.

  3. 3

    Step 3: Add guardrails, rate limits and key storage as policies.

  4. 4

    Step 4: Point your MCP servers or OpenAPI specs at the gateway to expose tools.

  5. 5

    Step 5: Open the metrics endpoint or your OpenTelemetry stack to review token usage and traces.

Gloo AI Gateway FAQ

Which LLM providers can it route to?

The pages list OpenAI, Anthropic, Azure, Gemini and self-hosted models behind one OpenAI-compatible endpoint.

How do guardrails work?

Guardrails run in sequence on requests and responses. A regex check runs first, then external moderation and custom webhooks if configured, and each layer can pass, mask or reject the content.

Can it expose existing REST APIs to agents?

Yes. You supply an OpenAPI spec and the gateway exposes it as MCP tools without code changes.

What does it log about token use?

It exposes a token usage metric and normalizes input and output token counts across providers, including cache-read and cache-creation tokens.

Details

Pricing
Contact for pricingThe core project is open source under Apache 2.0. The docs also describe a paid Solo Enterprise for agentgateway edition.
Type
API
Platforms
  • API
  • MCP
Categories
Developer ToolsSecurity
Added
Sep 16, 2026
Solo.io iconPublisherSolo.io

Built from public sources

We put this page together from Gloo AI Gateway’s own website and docs so you can compare it with other tools. Ploba isn’t affiliated with Gloo AI Gateway.

Work at Gloo AI Gateway? Claim the listing to manage it yourself.

Something wrong here?

Related tools

See more
agentgateway iconagentgatewayLinux Foundation · Freeagentgateway is an AI-native product for high-performance gateway for agent, LLM, and MCP traffic with routing, policy, security, and observability controls.Developer Tools · FreeVirusTotal iconVirusTotalVirusTotal · FreemiumVirusTotal checks files and URLs against dozens of antivirus scanners and blocklists and shows each engine's verdict. It has a web interface and an HTTP API.Developer Tools · FreemiumLLM Guard iconLLM GuardProtect AI · FreeLLM Guard uses AI for open-source toolkit for sanitizing, detecting, and validating risky LLM prompts and outputs.Developer Tools · Free