Llama-Optimizer. Automatically find the fastest possible settings for running large language models on your machine. Supports llamma.cpp and ik_llama.cpp

github.com/VykosX/Llama-Optimizer

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.