scrape repositories
Trending repositories tagged scrape, ranked by trending score. Updated daily.
-
1
oxylabs/scrape-google-python
In this tutorial, we showcase how to scrape public Google data with Python and Oxylabs API.
GitHub 路 1,731 stars 路 4 forks 路 0 stars in 24 hours 路 Trending score 1.38
-
2
any4ai/AnyCrawl
AnyCrawl 馃殌: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
GitHub 路 TypeScript 路 3,528 stars 路 372 forks 路 0 stars in 24 hours 路 Trending score 0.96
-
3
html2rss/html2rss
馃摪 Build RSS 2.0 feeds from websites (and JSON APIs) automatically or with a few CSS selectors.
GitHub 路 Ruby 路 172 stars 路 13 forks 路 0 stars in 24 hours 路 Trending score 0.32
-
4
haithamaouati/BlackCat
BalckCat 馃悎鈥嶁瑳 TikTok User Region Scraper
GitHub 路 JavaScript 路 78 stars 路 15 forks 路 0 stars in 24 hours 路 Trending score 0.20
-
5
Issung/GChan
Scrape boards & threads from 4chan. Download images, videos and HTML if desired.
GitHub 路 C# 路 83 stars 路 11 forks 路 0 stars in 24 hours 路 Trending score 0.01
-
6
vasu-devs/JustHireMe
Local-first AI job intelligence workbench for scraping roles, ranking fit, and generating tailored application materials.
GitHub 路 Python 路 2,279 stars 路 364 forks 路 0 stars in 24 hours 路 Trending score 0.00
-
7
simwai/perplexity-ai-export
Grabs all your Perplexity conversations data, spits it out into a nice file folder structure and allows you to find your old conversations again.
GitHub 路 TypeScript 路 59 stars 路 16 forks 路 0 stars in 24 hours 路 Trending score 0.00
-
8
danieldotnl/ha-multiscrape
Home Assistant custom component for scraping (html, xml or json) multiple values (from a single HTTP request) with a separate sensor/attribute for each value. Support for (login) form-submit functionality.
GitHub 路 Python 路 451 stars 路 22 forks 路 0 stars in 24 hours 路 Trending score 0.00
-
9
supadata-ai/mcp
Official Supadata MCP Server - Adds powerful video & web scraping to Cursor, Claude and any other LLM clients.
GitHub 路 TypeScript 路 63 stars 路 10 forks 路 0 stars in 24 hours 路 Trending score 0.00
-
10
unixfox/pupflare
A webpage proxy that request through Chromium (puppeteer) - can be used to bypass Cloudflare anti bot / anti ddos on any application (like curl)
GitHub 路 JavaScript 路 459 stars 路 80 forks 路 0 stars in 24 hours 路 Trending score 0.00
-
11
serpapi/serpapi-golang
Official Golang wrapper for SerpApi HTTP endpoints
GitHub 路 Go 路 30 stars 路 12 forks 路 0 stars in 24 hours 路 Trending score 0.00
-
12
kevinblanco/shorts-radar
Find the YouTube Shorts that beat their own channel in any niche, then let an AI agent turn them into Short proposals you can shoot.
GitHub 路 Python 路 6 stars 路 0 forks 路 0 stars in 24 hours 路 Trending score 0.00