Trending / Packages / crates.io

rustbpe

crates.io

A BPE (Byte Pair Encoding) tokenizer written in Rust with Python bindings

Latest v0.1.0 · Jan 3, 2026

Downloads

No download history yet.

Linked repositories

##RepositoryRepositoryConnectionConnection
1karpathy/rustbpeSource package · Manifest

Recent releases

VersionPublished
0.1.0Jan 3, 2026

Metadata updated Oct 28, 2026 · Downloads updated Oct 28, 2026

Download counts include automated and repeat installs. Gaps indicate missing observations.