web-scraper repositories
Trending repositories tagged web-scraper, ranked by trending score. Updated daily.
-
1
firecrawl/firecrawl
Knowledge infrastructure to make your agents smarter. Search, scrape and access 550+ data providers through one API.
GitHub · TypeScript · 206,099 stars · 10,774 forks · +2,082 stars in 24 hours · Trending score 5.92
-
2
D4Vinci/Scrapling
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
GitHub · Python · 104,811 stars · 10,964 forks · +448 stars in 24 hours · Trending score 5.23
-
3
Panniantong/Agent-Reach
Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
GitHub · Python · 113,755 stars · 10,208 forks · +508 stars in 24 hours · Trending score 5.14
-
4
lexmount/moli
Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust
GitHub · Rust · 24,204 stars · 696 forks · +140 stars in 24 hours · Trending score 4.11
-
5
dondai44423/donsetch
Web fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.
GitHub · Rust · 1,138 stars · 76 forks · +120 stars in 24 hours · Trending score 3.60
-
6
getmaxun/maxun
Turn any website into a structured API. Extract, automate, search and monitor the web.
GitHub · TypeScript · 18,540 stars · 1,598 forks · +17 stars in 24 hours · Trending score 3.00
-
7
SenZmaKi/Senpwai
A less annoying way to download anime
GitHub · Dart · 406 stars · 54 forks · +69 stars in 24 hours · Trending score 2.87
-
8
spider-rs/spider
Foundational low latency web data collecting in Rust
GitHub · Rust · 2,856 stars · 332 forks · +23 stars in 24 hours · Trending score 2.47
-
9
fastcrw/crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
GitHub · Rust · 1,283 stars · 102 forks · +16 stars in 24 hours · Trending score 2.35
-
10
gosom/google-maps-scraper
scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
GitHub · Go · 8,288 stars · 1,319 forks · 0 stars in 24 hours · Trending score 2.03
-
11
itsOwen/CyberScraper-2077
A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama
GitHub · Python · 3,302 stars · 360 forks · +14 stars in 24 hours · Trending score 1.76
-
12
anaskhan96/soup
Web Scraper in Go, similar to BeautifulSoup
GitHub · Go · 2,302 stars · 180 forks · +5 stars in 24 hours · Trending score 1.36
-
13
juancarlospaco/faster-than-requests
Faster requests on Python 3
GitHub · Nim · 1,131 stars · 89 forks · +4 stars in 24 hours · Trending score 1.03
-
14
milahu/opensubtitles-scraper
scrape subtitles from opensubtitles.org
GitHub · Python · 57 stars · 6 forks · +3 stars in 24 hours · Trending score 0.91
-
15
monbooru/monloader
Online media downloader for monbooru
GitHub · Go · 20 stars · 8 forks · 0 stars in 24 hours · Trending score 0.90
-
16
0x676e67/wreq
An ergonomic, privacy-aware Rust HTTP Client
GitHub · Rust · 1,116 stars · 148 forks · 0 stars in 24 hours · Trending score 0.78
-
17
TulipFarm/huntsman
Self-hosted web scraper that turns any web page into clean Markdown. Firecrawl-compatible API, powered by Lightpanda.
GitHub · Go · 15 stars · 1 forks · +1 stars in 24 hours · Trending score 0.76
-
18
gildas-lormeau/single-file-cli
CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)
GitHub · JavaScript · 1,697 stars · 147 forks · 0 stars in 24 hours · Trending score 0.52
-
19
HenryLok0/AnyDownload
CLI website downloader for offline browsing. Static + Playwright render for SPAs, path discovery, local HTTP preview. npm install -g anydownload
GitHub · JavaScript · 32 stars · 5 forks · 0 stars in 24 hours · Trending score 0.48
-
20
Sriram-PR/doc-scraper
Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)
GitHub · Go · 110 stars · 25 forks · 0 stars in 24 hours · Trending score 0.37
-
21
oxylabs/google-ai-mode-scraper
Scrape Google AI Mode responses without blocks on a large scale.
GitHub · Java · 3,633 stars · 33 forks · 0 stars in 24 hours · Trending score 0.30
-
22
HeadlessXLabs/hexium-browser
Stealth antidetect browser for Playwright — patched Chromium 151 with C++ persona, persistent profiles, humanize & GeoIP. launch() in, Chrome out.
GitHub · Python · 25 stars · 2 forks · 0 stars in 24 hours · Trending score 0.23
-
23
cassidoo/scrapers
A list of scrapers from around the web.
GitHub · 732 stars · 109 forks · 0 stars in 24 hours · Trending score 0.22
-
24
VrachZDE/scrape-sake
Best Anime & Hentai Video Downloader CLI 2026
GitHub · HTML · 119 stars · 0 forks · 0 stars in 24 hours · Trending score 0.20