Edgee

What it does

Edgee is an AI Gateway designed to optimize and manage LLM traffic at the edge. Its standout feature is edge-native token compression, which reduces the size of prompts before they reach providers like OpenAI or Anthropic, cutting costs by up to 50% without losing the user's intent. It provides a single, OpenAI-compatible API to access over 200 models, offering intelligent routing, fallbacks, real-time observability, and cost governance. Developers can use it to track spending by feature or team, host private models, and invoke edge tools to lower latency and improve reliability in production AI applications.

Core features

• ✦Token Compression (reduces prompt size up to 50%)
• ✦OpenAI-compatible API for 200+ models
• ✦Intelligent Routing, Fallbacks, and Retries
• ✦Cost Governance with custom tags and spend alerts
• ✦Edge-native Observability (latency, usage, and error tracking)
• ✦Private Model Hosting and Edge Tools

Use cases

• →Reducing token costs for long-context RAG pipelines
• →Implementing multi-provider redundancy to prevent downtime
• →Tracking AI expenditure across different teams or features using metadata tags
• →Running small models at the edge for request classification or redaction