tik-tokenizer. .NET and Typescript implementation of BPE tokenizer for OpenAI LLMs.

github.com/mjbvz/tik-tokenizer

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

No recent activity.