rustbpe
PyPIA BPE (Byte Pair Encoding) tokenizer written in Rust with Python bindings
Latest v0.1.0 · Jan 3, 202628.6K downloads · 30dMIT
Downloads
Daily downloads
PyPI · excludes known mirrors
downloads1.2K
Oct 26
Linked repositories
| ## | RepositoryRepository | ConnectionConnection |
|---|---|---|
| 1 | karpathy/rustbpe | Source package · Manifest |
Recent releases
| Version | Published |
|---|---|
| 0.1.0 | Jan 3, 2026 |