Spix0r/robofinder
Robofinder fetches historical robots.txt files from Archive.org to uncover old directories, hidden paths, and valuable OSINT data for reconnaissance.
GitHub repository with 247 stars and 23 forks.
Language: Python
Topics: bugbounty, bugbounty-tool, osint, osint-python, osint-resources, osint-tool, osint-tools, recon, reconnaissance