alphaparkinc/genpark-bloom-filter-url-dedup-crawler-skill
In-memory Bloom filter for URL and document hash deduplication preventing redundant web crawler ingestion
GitHub repository with 7 stars and 0 forks.
Language: Python
Topics: agent-skills, bloom-filter, data-pipeline, high-performance, mcp, probabilistic-data-structure, python-standard-library, rag-ingestion, search, url-deduplication