web-scraper repositories

Trending repositories tagged web-scraper, ranked by trending score. Updated daily.

  1. 1
    firecrawl/firecrawl

    Knowledge infrastructure to make your agents smarter. Search, scrape and access 550+ data providers through one API.

    GitHub · TypeScript · 206,099 stars · 10,774 forks · +2,082 stars in 24 hours · Trending score 5.92

  2. 2
    D4Vinci/Scrapling

    🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

    GitHub · Python · 104,811 stars · 10,964 forks · +448 stars in 24 hours · Trending score 5.23

  3. 3
    Panniantong/Agent-Reach

    Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.

    GitHub · Python · 113,755 stars · 10,208 forks · +508 stars in 24 hours · Trending score 5.14

  4. 4
    lexmount/moli

    Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust

    GitHub · Rust · 24,204 stars · 696 forks · +140 stars in 24 hours · Trending score 4.11

  5. 5
    dondai44423/donsetch

    Web fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.

    GitHub · Rust · 1,138 stars · 76 forks · +120 stars in 24 hours · Trending score 3.60

  6. 6
    getmaxun/maxun

    Turn any website into a structured API. Extract, automate, search and monitor the web.

    GitHub · TypeScript · 18,540 stars · 1,598 forks · +17 stars in 24 hours · Trending score 3.00

  7. 7
    SenZmaKi/Senpwai

    A less annoying way to download anime

    GitHub · Dart · 406 stars · 54 forks · +69 stars in 24 hours · Trending score 2.87

  8. 8
    spider-rs/spider

    Foundational low latency web data collecting in Rust

    GitHub · Rust · 2,856 stars · 332 forks · +23 stars in 24 hours · Trending score 2.47

  9. 9
    fastcrw/crw

    Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

    GitHub · Rust · 1,283 stars · 102 forks · +16 stars in 24 hours · Trending score 2.35

  10. 10
    gosom/google-maps-scraper

    scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

    GitHub · Go · 8,288 stars · 1,319 forks · 0 stars in 24 hours · Trending score 2.03

  11. 11
    itsOwen/CyberScraper-2077

    A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama

    GitHub · Python · 3,302 stars · 360 forks · +14 stars in 24 hours · Trending score 1.76

  12. 12
    anaskhan96/soup

    Web Scraper in Go, similar to BeautifulSoup

    GitHub · Go · 2,302 stars · 180 forks · +5 stars in 24 hours · Trending score 1.36

  13. 13
    juancarlospaco/faster-than-requests

    Faster requests on Python 3

    GitHub · Nim · 1,131 stars · 89 forks · +4 stars in 24 hours · Trending score 1.03

  14. 14
    milahu/opensubtitles-scraper

    scrape subtitles from opensubtitles.org

    GitHub · Python · 57 stars · 6 forks · +3 stars in 24 hours · Trending score 0.91

  15. 15
    monbooru/monloader

    Online media downloader for monbooru

    GitHub · Go · 20 stars · 8 forks · 0 stars in 24 hours · Trending score 0.90

  16. 16
    0x676e67/wreq

    An ergonomic, privacy-aware Rust HTTP Client

    GitHub · Rust · 1,116 stars · 148 forks · 0 stars in 24 hours · Trending score 0.78

  17. 17
    TulipFarm/huntsman

    Self-hosted web scraper that turns any web page into clean Markdown. Firecrawl-compatible API, powered by Lightpanda.

    GitHub · Go · 15 stars · 1 forks · +1 stars in 24 hours · Trending score 0.76

  18. 18
    gildas-lormeau/single-file-cli

    CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)

    GitHub · JavaScript · 1,697 stars · 147 forks · 0 stars in 24 hours · Trending score 0.52

  19. 19
    HenryLok0/AnyDownload

    CLI website downloader for offline browsing. Static + Playwright render for SPAs, path discovery, local HTTP preview. npm install -g anydownload

    GitHub · JavaScript · 32 stars · 5 forks · 0 stars in 24 hours · Trending score 0.48

  20. 20
    Sriram-PR/doc-scraper

    Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)

    GitHub · Go · 110 stars · 25 forks · 0 stars in 24 hours · Trending score 0.37

  21. 21
    oxylabs/google-ai-mode-scraper

    Scrape Google AI Mode responses without blocks on a large scale.

    GitHub · Java · 3,633 stars · 33 forks · 0 stars in 24 hours · Trending score 0.30

  22. 22
    HeadlessXLabs/hexium-browser

    Stealth antidetect browser for Playwright — patched Chromium 151 with C++ persona, persistent profiles, humanize & GeoIP. launch() in, Chrome out.

    GitHub · Python · 25 stars · 2 forks · 0 stars in 24 hours · Trending score 0.23

  23. 23
    cassidoo/scrapers

    A list of scrapers from around the web.

    GitHub · 732 stars · 109 forks · 0 stars in 24 hours · Trending score 0.22

  24. 24
    VrachZDE/scrape-sake

    Best Anime & Hentai Video Downloader CLI 2026

    GitHub · HTML · 119 stars · 0 forks · 0 stars in 24 hours · Trending score 0.20