scrape repositories

Trending repositories tagged scrape, ranked by trending score. Updated daily.

  1. 1
    oxylabs/scrape-google-python

    In this tutorial, we showcase how to scrape public Google data with Python and Oxylabs API.

    GitHub 路 1,731 stars 路 4 forks 路 0 stars in 24 hours 路 Trending score 1.38

  2. 2
    any4ai/AnyCrawl

    AnyCrawl 馃殌: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

    GitHub 路 TypeScript 路 3,528 stars 路 372 forks 路 0 stars in 24 hours 路 Trending score 0.96

  3. 3
    html2rss/html2rss

    馃摪 Build RSS 2.0 feeds from websites (and JSON APIs) automatically or with a few CSS selectors.

    GitHub 路 Ruby 路 172 stars 路 13 forks 路 0 stars in 24 hours 路 Trending score 0.32

  4. 4
    haithamaouati/BlackCat

    BalckCat 馃悎鈥嶁瑳 TikTok User Region Scraper

    GitHub 路 JavaScript 路 78 stars 路 15 forks 路 0 stars in 24 hours 路 Trending score 0.20

  5. 5
    Issung/GChan

    Scrape boards & threads from 4chan. Download images, videos and HTML if desired.

    GitHub 路 C# 路 83 stars 路 11 forks 路 0 stars in 24 hours 路 Trending score 0.01

  6. 6
    vasu-devs/JustHireMe

    Local-first AI job intelligence workbench for scraping roles, ranking fit, and generating tailored application materials.

    GitHub 路 Python 路 2,279 stars 路 364 forks 路 0 stars in 24 hours 路 Trending score 0.00

  7. 7
    simwai/perplexity-ai-export

    Grabs all your Perplexity conversations data, spits it out into a nice file folder structure and allows you to find your old conversations again.

    GitHub 路 TypeScript 路 59 stars 路 16 forks 路 0 stars in 24 hours 路 Trending score 0.00

  8. 8
    danieldotnl/ha-multiscrape

    Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.

    GitHub 路 Python 路 451 stars 路 22 forks 路 0 stars in 24 hours 路 Trending score 0.00

  9. 9
    supadata-ai/mcp

    Official Supadata MCP Server - Adds powerful video & web scraping to Cursor, Claude and any other LLM clients.

    GitHub 路 TypeScript 路 63 stars 路 10 forks 路 0 stars in 24 hours 路 Trending score 0.00

  10. 10
    unixfox/pupflare

    A webpage proxy that request through Chromium (puppeteer) - can be used to bypass Cloudflare anti bot / anti ddos on any application (like curl)

    GitHub 路 JavaScript 路 459 stars 路 80 forks 路 0 stars in 24 hours 路 Trending score 0.00

  11. 11
    serpapi/serpapi-golang

    Official Golang wrapper for SerpApi HTTP endpoints

    GitHub 路 Go 路 30 stars 路 12 forks 路 0 stars in 24 hours 路 Trending score 0.00

  12. 12
    kevinblanco/shorts-radar

    Find the YouTube Shorts that beat their own channel in any niche, then let an AI agent turn them into Short proposals you can shoot.

    GitHub 路 Python 路 6 stars 路 0 forks 路 0 stars in 24 hours 路 Trending score 0.00