Skip to content
Huan Lin

GPROXY

2026-01 – present

A multi-protocol LLM API gateway written in Rust, speaking OpenAI / Anthropic / Gemini

RustAxumTokioSeaORMWASM

Repository

A high-performance LLM API gateway built on Rust, Axum and Tokio. 200+ GitHub stars.

Protocol compatibility

Speaks the OpenAI, Anthropic and Gemini protocols simultaneously, with multi-provider routing, cross-protocol request and response translation, and programmable streaming.

Governance

Multi-tenant user and API key management, model permissions, three tiers of rate limiting (RPM, RPD, tokens), USD quotas, credential failover, circuit breaking and usage auditing, alongside a built-in web console.

Deployment

Backed by SeaORM for SQLite, PostgreSQL and MySQL. Ships as a native binary, a Docker image, or a WASM/edge deployment.