web-scraping-python repositories

Trending repositories tagged web-scraping-python, ranked by trending score. Updated daily.

  1. 1
    D4Vinci/Scrapling

    ๐Ÿ•ท๏ธ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

    GitHub ยท Python ยท 104,965 stars ยท 10,981 forks ยท +411 stars in 24 hours ยท Trending score 5.15

  2. 2
    scrapy/scrapy

    Scrapy, a fast high-level web crawling & scraping framework for Python.

    GitHub ยท Python ยท 65,538 stars ยท 12,148 forks ยท +25 stars in 24 hours ยท Trending score 2.98

  3. 3
    tinyfish-io/agentql

    AgentQL is a suite of tools for connecting your AI to the web. Featuring a query language and Playwright integrations for interacting with elements and extracting data quickly, precisely, and at scale. Includes REST API, Python and JavaScript SDKs, browser debugger.

    GitHub ยท Python ยท 1,510 stars ยท 179 forks ยท +9 stars in 24 hours ยท Trending score 1.59

  4. 4
    scrapfly/scrapfly-scrapers

    Scalable Python web scraping scripts for +80 popular domains

    GitHub ยท Python ยท 1,133 stars ยท 207 forks ยท +2 stars in 24 hours ยท Trending score 0.91

  5. 5
    HeadlessXLabs/hexium-browser

    Stealth antidetect browser for Playwright โ€” patched Chromium 151 with C++ persona, persistent profiles, humanize & GeoIP. launch() in, Chrome out.

    GitHub ยท Python ยท 25 stars ยท 2 forks ยท 0 stars in 24 hours ยท Trending score 0.14

  6. 6
    hexsyro/Anti-Scraping-Playwright

    A browser-based web scraping framework that bypasses common anti-bot measures using advanced evasion techniques.

    GitHub ยท Python ยท 72 stars ยท 3 forks ยท 0 stars in 24 hours ยท Trending score 0.08

  7. 7
    hhuayuan/spiderbuf

    Python ็ˆฌ่™ซๅฎžๆˆ˜ไธŽๅ็ˆฌ็ปƒไน ๅนณๅฐ | Python Web Scraping & Anti-Scraping Practice Platform.

    GitHub ยท Python ยท 148 stars ยท 15 forks ยท 0 stars in 24 hours ยท Trending score 0.08

  8. 8
    oxylabs/web-scraping-google-sheets

    Guide to Using Google Sheets for Basic Web Scraping

    GitHub ยท 757 stars ยท 3 forks ยท 0 stars in 24 hours ยท Trending score 0.08

  9. 9
    oxylabs/how-to-scrape-amazon-product-data

    The process of extracting product data from Amazon using Python, including titles, ratings, prices, images, and descriptions.

    GitHub ยท Python ยท 3,248 stars ยท 14 forks ยท โˆ’11 stars in 24 hours ยท Trending score 0.08

  10. 10
    Hashimk101/Kleros

    An Agentic System that finds free LLM APIs and tokens from the website

    GitHub ยท Python ยท 9 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.00

  11. 11
    makralabs/makra

    Makra is a memory layer between the web and your AI agents. It serves real-time structured data from the open web at the cost of a vector search.

    GitHub ยท Python ยท 30 stars ยท 0 forks ยท 0 stars in 24 hours ยท Trending score 0.00