llamacpp-speculative. llama-cpp-python server with speculative decoding

github.com/fabiomatricardi/llamacpp-speculative

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.