This is your work, valued
KoboldAI-Client. For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
