Higress
What it does
Higress is an AI native API gateway based on Istio and Envoy, which can be extended with Wasm plugins written in Go/Rust/JS. It offers AI Gateway, MCP Server Hosting, Kubernetes ingress controller, Microservice gateway and Security gateway. Higress AI网关提供多模型灵活切换与兜底重试、大模型内容安全与合规、语义化缓存、多 API Key 均衡、Token 配额管理和限流、大模型流量灰度、调用成本审计等能力，帮助企业开发 Agent、管理LLM API.
How to use: Higress can be used to develop AI Agents and manage LLM APIs. It provides features like multi-model switching, content security, semantic caching, API key balancing, token management, traffic graying, and cost auditing. It also supports converting existing RESTful APIs to MCP Servers.
Core features
- ✦AI Gateway
- ✦MCP Server Hosting
- ✦Kubernetes Ingress Controller
- ✦Microservice Gateway
- ✦Security Gateway
- ✦Multi-model flexible switching and fallback retries
- ✦Large model content security and compliance
- ✦Semantic caching
- ✦Multi-API Key balancing
- ✦Token quota management and rate limiting
Use cases
- →Developing AI Agents
- →Managing LLM APIs
- →Converting RESTful APIs to MCP Servers
- →Securing AI model traffic
- →Implementing rate limiting and token management for AI services
- →Auditing AI service call costs