av-local-llm-api. Allows to easily run local REST API with a custom LLM, running locally or remotely, with user defined system instructions. Useful for quick local autmations that require problem solving with large langague models and interaction via a REST API.

github.com/avatsaev/av-local-llm-api

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.