scraping-websites repositories
Trending repositories tagged scraping-websites, ranked by trending score. Updated daily.
-
1
shurco/goClone
🌱 goClone - clone websites in seconds
GitHub · Go · 132 stars · 14 forks · +5 stars in 24 hours · Trending score 1.48
-
2
scp-data/scp-api
A dataset of SCP Items, Articles, and Metadata - Updated Daily
GitHub · Shell · 51 stars · 18 forks · +1 stars in 24 hours · Trending score 0.63
-
3
spmedia/Threat-Actor-Usernames-Scrape
A collection & lists of intel and usernames scraped from various cybercrime sources & forums. DarkForums, HackForums, Patched, Cracked, BreachForums, OGUser, XSS, Dread, & more
GitHub · 261 stars · 42 forks · 0 stars in 24 hours · Trending score 0.58
-
4
gildas-lormeau/single-file-cli
CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)
GitHub · JavaScript · 1,697 stars · 147 forks · 0 stars in 24 hours · Trending score 0.52
-
5
alex-on-ai/WebReaper
AI-native web scraper. Single binary with a bundled Claude Code skill. MIT-licensed alternative to Firecrawl.
GitHub · C# · 153 stars · 33 forks · 0 stars in 24 hours · Trending score 0.32
-
6
HeadlessXLabs/hexium-browser
Stealth antidetect browser for Playwright — patched Chromium 151 with C++ persona, persistent profiles, humanize & GeoIP. launch() in, Chrome out.
GitHub · Python · 25 stars · 2 forks · 0 stars in 24 hours · Trending score 0.23
-
7
elixir-crawly/crawly
Crawly, a high-level web crawling & scraping framework for Elixir.
GitHub · Elixir · 1,129 stars · 127 forks · −2 stars in 24 hours · Trending score 0.09
-
8
hhuayuan/spiderbuf
Python 爬虫实战与反爬练习平台 | Python Web Scraping & Anti-Scraping Practice Platform.
GitHub · Python · 148 stars · 15 forks · 0 stars in 24 hours · Trending score 0.08
-
9
Stream4me/addon
Stream4me addon main repository
GitHub · Python · 144 stars · 25 forks · 0 stars in 24 hours · Trending score 0.00
-
10
simwai/perplexity-ai-export
Grabs all your Perplexity conversations data, spits it out into a nice file folder structure and allows you to find your old conversations again.
GitHub · TypeScript · 64 stars · 16 forks · 0 stars in 24 hours · Trending score 0.00
-
11
martial-god/Benny-Scraper
Local-first, cross-platform CLI for downloading and updating web novels as EPUB and manga as PDF or CBZ. Supports Selenium, FlareSolverr, and configurable sites.
GitHub · C# · 46 stars · 9 forks · 0 stars in 24 hours · Trending score 0.00
-
12
unixfox/pupflare
A webpage proxy that request through Chromium (puppeteer) - can be used to bypass Cloudflare anti bot / anti ddos on any application (like curl)
GitHub · JavaScript · 459 stars · 80 forks · 0 stars in 24 hours · Trending score 0.00
-
13
Ali-Hasan-Khan/Scrape-Whoscored-Event-Data
Get match event data from whoscored.com
GitHub · Jupyter Notebook · 55 stars · 14 forks · 0 stars in 24 hours · Trending score 0.00
-
14
omkarcloud/imdb-scraper
Search movies and TV shows, get title details, pull cast & crew, and fetch trending movies from IMDb via a simple REST API. 5,000 free requests/month.
GitHub · Python · 13 stars · 7 forks · 0 stars in 24 hours · Trending score 0.00