lmcache
PyPIA LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.
Latest v0.5.7rc2 · Oct 27, 202667K downloads · 30d
Downloads
Daily downloads
PyPI · excludes known mirrors
downloads5.1K
Oct 28
Linked repositories
| ## | RepositoryRepository | ConnectionConnection |
|---|---|---|
| 1 | bojieli/ai-infra-book | Source package · Manifest |
| 2 | LMCache/LMCache | Registry metadata |
Recent releases
| Version | Published |
|---|---|
| 0.5.7rc2 | Oct 27, 2026 |
| 0.5.6 | Oct 15, 2026 |
| 0.5.6rc5 | Oct 12, 2026 |
| 0.5.6rc4.dev27 | Oct 10, 2026 |
| 0.5.6rc3 | Oct 6, 2026 |