erew123

alltalk_tts. AllTalk is based on the Coqui TTS engine, similar to the Coqui_tts extension for Text generation webUI, however supports a variety of advanced features, such as a settings page, low VRAM support, DeepSpeed, narrator, model finetuning, custom models, wav file maintenance. It can also be used with 3rd Party software via JSON calls.

deepspeedpatcher. A graphical tool to simplify building and installing DeepSpeed 0.15.x or later on Windows systems.

DeepSpeed. DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

lite.koboldai.net. A zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde

text-generation-webui. A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

text-generation-webui-extensions.

SillyTavern. LLM Frontend for Power Users.

koboldcpp. Run GGUF models easily with a KoboldAI UI. One File. Zero Install.