Rare find

Rustbpe. Train AI word-breaking tools that are simple and fast.

github.com/karpathy/rustbpe
by @karpathy

Vaya's read on this project

Problem, audience, market, and the verdict — sign in to see it.

Updates

January 2026
  • add tags to readme
  • Release —v0.1.0
  • Bump PyO3 to 0.27, fix deprecated API calls
  • Bump PyO3 to 0.27 for Python 3.14 support
  • Fix: allow forward compatibility with newer Python versions
  • Fix CI: use maturin build instead of develop
  • Fix CI: use correct rust-toolchain action name
  • Add CI and release workflows, fix clippy/fmt issues, and fix release …
  • Add release workflow for PyPI publishing of the package
  • add LLM assistance note docs
  • small touchups and changes and more tests
  • v0 essentially copy pasted from nanochat repo, forking from here on