
by Portkey
Portkey is an AI gateway and LLMOps platform with a unified API to many LLMs, plus observability, guardrails, governance and prompt management. The site says it is now Prisma AIRS AI Gateway.
APIFreemium
Step 1: Sign up for the free Developer plan.
Step 2: Add your provider keys in Portkey.
Step 3: Install the SDK and swap in three lines of code.
Step 4: Route requests, add guardrails and caching as needed.
Step 5: Watch logs, cost and usage in the dashboard.
The site says it takes 3 lines of code with no changes to your existing stack.
Yes. There is an open source gateway you can host yourself, and enterprise offers private cloud and VPC hosting.
It can automatically redact PII from requests before they reach the LLM.
Its MCP Gateway centralizes authentication, access and observability for MCP servers.
NEAR AI CloudNEAR AI Cloud is a private AI inference platform that runs open-weight models inside hardware enclaves and returns a signed proof with each response. It uses an OpenAI-compatible API.
PyRITPyRIT uses AI for open-source Python framework for automated generative-AI red teaming and security risk identification.