robotstxt
crates.ioA native Rust port of Google's robots.txt parser and matcher C++ library.
Latest v0.3.0 · Feb 13, 2021
Downloads
No download history yet.
Linked repositories
| ## | RepositoryRepository | ConnectionConnection |
|---|---|---|
| 1 | Folyd/robotstxt | Registry metadata |
| 2 | StractOrg/stract | Source package · Manifest |
Recent releases
| Version | Published |
|---|---|
| 0.3.0 | Feb 13, 2021 |
| 0.2.0 | May 24, 2020 |
| 0.1.0yanked | Apr 19, 2019 |