nan-llm-bridge. Local HTTP proxy that adds resilience (retry, recovery, rate-limiting, per-client profiles) between OpenAI-compatible clients (Codex, opencode, OpenAI Agents SDK, …) and OpenAI-compatible upstreams (LiteLLM, vLLM, llama.cpp, …)

github.com/juankysoriano/nan-llm-bridge

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.