Rare find

transformers-stream-generator. This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.

github.com/LowinLi/transformers-stream-generator

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.