scraping-websites repositories

Trending repositories tagged scraping-websites, ranked by trending score. Updated daily.

  1. 1
    shurco/goClone

    🌱 goClone - clone websites in seconds

    GitHub · Go · 132 stars · 14 forks · +5 stars in 24 hours · Trending score 1.48

  2. 2
    scp-data/scp-api

    A dataset of SCP Items, Articles, and Metadata - Updated Daily

    GitHub · Shell · 51 stars · 18 forks · +1 stars in 24 hours · Trending score 0.63

  3. 3
    spmedia/Threat-Actor-Usernames-Scrape

    A collection & lists of intel and usernames scraped from various cybercrime sources & forums. DarkForums, HackForums, Patched, Cracked, BreachForums, OGUser, XSS, Dread, & more

    GitHub · 261 stars · 42 forks · 0 stars in 24 hours · Trending score 0.58

  4. 4
    gildas-lormeau/single-file-cli

    CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)

    GitHub · JavaScript · 1,697 stars · 147 forks · 0 stars in 24 hours · Trending score 0.52

  5. 5
    alex-on-ai/WebReaper

    AI-native web scraper. Single binary with a bundled Claude Code skill. MIT-licensed alternative to Firecrawl.

    GitHub · C# · 153 stars · 33 forks · 0 stars in 24 hours · Trending score 0.32

  6. 6
    HeadlessXLabs/hexium-browser

    Stealth antidetect browser for Playwright — patched Chromium 151 with C++ persona, persistent profiles, humanize & GeoIP. launch() in, Chrome out.

    GitHub · Python · 25 stars · 2 forks · 0 stars in 24 hours · Trending score 0.23

  7. 7
    elixir-crawly/crawly

    Crawly, a high-level web crawling & scraping framework for Elixir.

    GitHub · Elixir · 1,129 stars · 127 forks · −2 stars in 24 hours · Trending score 0.09

  8. 8
    hhuayuan/spiderbuf

    Python 爬虫实战与反爬练习平台 | Python Web Scraping & Anti-Scraping Practice Platform.

    GitHub · Python · 148 stars · 15 forks · 0 stars in 24 hours · Trending score 0.08

  9. 9
    Stream4me/addon

    Stream4me addon main repository

    GitHub · Python · 144 stars · 25 forks · 0 stars in 24 hours · Trending score 0.00

  10. 10
    simwai/perplexity-ai-export

    Grabs all your Perplexity conversations data, spits it out into a nice file folder structure and allows you to find your old conversations again.

    GitHub · TypeScript · 64 stars · 16 forks · 0 stars in 24 hours · Trending score 0.00

  11. 11
    martial-god/Benny-Scraper

    Local-first, cross-platform CLI for downloading and updating web novels as EPUB and manga as PDF or CBZ. Supports Selenium, FlareSolverr, and configurable sites.

    GitHub · C# · 46 stars · 9 forks · 0 stars in 24 hours · Trending score 0.00

  12. 12
    unixfox/pupflare

    A webpage proxy that request through Chromium (puppeteer) - can be used to bypass Cloudflare anti bot / anti ddos on any application (like curl)

    GitHub · JavaScript · 459 stars · 80 forks · 0 stars in 24 hours · Trending score 0.00

  13. 13
    Ali-Hasan-Khan/Scrape-Whoscored-Event-Data

    Get match event data from whoscored.com

    GitHub · Jupyter Notebook · 55 stars · 14 forks · 0 stars in 24 hours · Trending score 0.00

  14. 14
    omkarcloud/imdb-scraper

    Search movies and TV shows, get title details, pull cast & crew, and fetch trending movies from IMDb via a simple REST API. 5,000 free requests/month.

    GitHub · Python · 13 stars · 7 forks · 0 stars in 24 hours · Trending score 0.00