Higress is a cloud-native API gateway built upon Istio and Envoy, designed to address challenges faced by large-scale services like Tengine. It excels in supporting long-connection services and offers enhanced load balancing for gRPC/Dubbo. With a focus on AI, Higress acts as an AI Gateway, supporting various model providers and offering features such as AI observability, load balancing, rate limiting, and caching. It also functions as a Kubernetes ingress controller, a microservice gateway, and a security gateway, making it a versatile solution for modern application architectures.
Key Features
01Out-of-the-box UI console
02AI gateway capabilities with multi-model support
03Microservice gateway capabilities with service discovery
04Wasm plugin support for extensibility in Go/Rust/JS
054,875 GitHub stars
06Kubernetes ingress controller functionality
Use Cases
01Functioning as a feature-rich Kubernetes ingress controller for managing external access to services.
02Serving as an AI Gateway, connecting to multiple LLM providers with unified protocols.
03Hosting MCP Servers to provide unified authentication, authorization, and observability for AI tool calls.
