GitHub · JavaScript
samclarke/robots-parser
NodeJS robots.txt parser with support for wildcard (*) matching.
- Stars
- 168
- Forks
- 19
- Stars gained in 24 hours
- 0
- Forks gained in 24 hours
- 0
Topics: javascript, nodejs, rfc-9309, robots-exclusion-standard, robots-parser, robots-txt, user-agent
Latest data point: Nov 20, 2026 · 168 stars · 19 forks