arq-langchain-fastapi. A scalable FastAPI application using Asynchronous Redis Queue (ARQ) for handling concurrent LLM requests. Features include job queue management, worker processes, and integration with Google's Generative AI through LangChain. Built with asyncio for high concurrency, Redis for job persistence, and Docker for easy deployment.

github.com/dangquan1402/arq-langchain-fastapi

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.