pzaino/thecrowler
A Content Discovery and Development Platform. Empowering Cybersecurity, AI, Marketing, and Finance professionals and researchers to discover, analyze, and interact with the web in all its dimensions.
GitHub repository with 55 stars and 11 forks.
Language: Go
Topics: crawler, crawling, golang, indexer, indexing, search-engine, automation, content-detection, content-discovery, cyber-security