Higress
Createdalibaba
Provides an AI-native API gateway for cloud-native applications, extending Envoy and Istio with Wasm plugins.
About
Higress is a cloud-native API gateway built upon Istio and Envoy, designed to address challenges faced by large-scale services like Tengine. It excels in supporting long-connection services and offers enhanced load balancing for gRPC/Dubbo. With a focus on AI, Higress acts as an AI Gateway, supporting various model providers and offering features such as AI observability, load balancing, rate limiting, and caching. It also functions as a Kubernetes ingress controller, a microservice gateway, and a security gateway, making it a versatile solution for modern application architectures.
Key Features
- Out-of-the-box UI console
- AI gateway capabilities with multi-model support
- Microservice gateway capabilities with service discovery
- Wasm plugin support for extensibility in Go/Rust/JS
- 4,875 GitHub stars
- Kubernetes ingress controller functionality
Use Cases
- Functioning as a feature-rich Kubernetes ingress controller for managing external access to services.
- Serving as an AI Gateway, connecting to multiple LLM providers with unified protocols.
- Hosting MCP Servers to provide unified authentication, authorization, and observability for AI tool calls.
