web-scraping-python repositories
Trending repositories tagged web-scraping-python, ranked by trending score. Updated daily.
-
1
D4Vinci/Scrapling
๐ท๏ธ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
GitHub ยท Python ยท 104,965 stars ยท 10,981 forks ยท +411 stars in 24 hours ยท Trending score 5.15
-
2
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
GitHub ยท Python ยท 65,538 stars ยท 12,148 forks ยท +25 stars in 24 hours ยท Trending score 2.98
-
3
tinyfish-io/agentql
AgentQL is a suite of tools for connecting your AI to the web. Featuring a query language and Playwright integrations for interacting with elements and extracting data quickly, precisely, and at scale. Includes REST API, Python and JavaScript SDKs, browser debugger.
GitHub ยท Python ยท 1,510 stars ยท 179 forks ยท +9 stars in 24 hours ยท Trending score 1.59
-
4
scrapfly/scrapfly-scrapers
Scalable Python web scraping scripts for +80 popular domains
GitHub ยท Python ยท 1,133 stars ยท 207 forks ยท +2 stars in 24 hours ยท Trending score 0.91
-
5
HeadlessXLabs/hexium-browser
Stealth antidetect browser for Playwright โ patched Chromium 151 with C++ persona, persistent profiles, humanize & GeoIP. launch() in, Chrome out.
GitHub ยท Python ยท 25 stars ยท 2 forks ยท 0 stars in 24 hours ยท Trending score 0.14
-
6
hexsyro/Anti-Scraping-Playwright
A browser-based web scraping framework that bypasses common anti-bot measures using advanced evasion techniques.
GitHub ยท Python ยท 72 stars ยท 3 forks ยท 0 stars in 24 hours ยท Trending score 0.08
-
7
hhuayuan/spiderbuf
Python ็ฌ่ซๅฎๆไธๅ็ฌ็ปไน ๅนณๅฐ | Python Web Scraping & Anti-Scraping Practice Platform.
GitHub ยท Python ยท 148 stars ยท 15 forks ยท 0 stars in 24 hours ยท Trending score 0.08
-
8
oxylabs/web-scraping-google-sheets
Guide to Using Google Sheets for Basic Web Scraping
GitHub ยท 757 stars ยท 3 forks ยท 0 stars in 24 hours ยท Trending score 0.08
-
9
oxylabs/how-to-scrape-amazon-product-data
The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.
GitHub ยท Python ยท 3,248 stars ยท 14 forks ยท โ11 stars in 24 hours ยท Trending score 0.08
-
10
Hashimk101/Kleros
An Agentic System that finds free LLM APIs and tokens from the website
GitHub ยท Python ยท 9 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.00
-
11
makralabs/makra
Makra is a memory layer between the web and your AI agents. It serves real-time structured data from the open web at the cost of a vector search.
GitHub ยท Python ยท 30 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.00