AI Gateway Platform — Multi-Provider LLM Orchestration Engine (Node.js/Express/PostgreSQL/Docker)
Engineered an OpenAI-compatible AI gateway that orchestrates inference requests across multiple LLM providers (Ollama, vLLM, Gemini) via a provider abstraction layer. Added operational controls including dual authentication (JWT and hashed API keys), per-key IP whitelisting, plan-based rate limiting, and atomic per-token credit billing. Implemented usage analytics, conversation history with context replay, and provider health monitoring with automatic database synchronization. • Provider abstraction layer for routing inference requests • JWT + API key authentication and IP whitelisting • Per-token credit billing and request/token rate limiting • Usage analytics, audit trail, and health monitoring with DB sync