scrapy repositories

Trending repositories tagged scrapy, ranked by trending score. Updated daily.

  1. 1
    juancarlospaco/faster-than-requests

    Faster requests on Python 3

    GitHub · Nim · 1,131 stars · 89 forks · +4 stars in 24 hours · Trending score 1.03

  2. 2
    netweir/netweir

    An ultra-fast, self-healing, undetectable web scraper. Rust does the work; you write Python.

    GitHub · Rust · 8 stars · 4 forks · +1 stars in 24 hours · Trending score 0.56

  3. 3
    wildovortex96622/Youtube-resocket-viewbot

    🦊 Fast views botter based on proxies

    GitHub · 50 stars · 0 forks · 0 stars in 24 hours · Trending score 0.50

  4. 4
    Suvastutech-Ltd/scrapy-stealth

    Stealthy Crawling. Maximum Results. A pluggable anti-bot and stealth framework for Scrapy.

    GitHub · Python · 17 stars · 9 forks · +1 stars in 24 hours · Trending score 0.46

  5. 5
    alltheplaces/alltheplaces

    A set of spiders and scrapers to extract location information from places that post their location on the internet.

    GitHub · Python · 852 stars · 311 forks · 0 stars in 24 hours · Trending score 0.38

  6. 6
    rmax/scrapy-redis

    Redis-based components for Scrapy.

    GitHub · Python · 5,648 stars · 1,579 forks · −1 stars in 24 hours · Trending score 0.28

  7. 7
    stummjr/books_crawler

    A Scrapy crawler for http://books.toscrape.com

    GitHub · Python · 27 stars · 1,030 forks · 0 stars in 24 hours · Trending score 0.10

  8. 8
    shengchenyang/AyugeSpiderTools

    使 scrapy 开发不用在意 item,pipeline,middleware 等通用场景下模块的编写,解放开发者的双手。

    GitHub · Python · 102 stars · 17 forks · 0 stars in 24 hours · Trending score 0.07

  9. 9
    scrapy-plugins/scrapy-splash

    Scrapy+Splash for JavaScript integration

    GitHub · Python · 3,224 stars · 455 forks · 0 stars in 24 hours · Trending score 0.00

  10. 10
    imflyn/decoration-design-crawler

    土巴兔和谷居装修网站爬虫

    GitHub · Python · 108 stars · 37 forks · 0 stars in 24 hours · Trending score 0.00

  11. 11
    bitmakerla/estela

    estela, an elastic web scraping cluster 🕸

    GitHub · TypeScript · 202 stars · 17 forks · 0 stars in 24 hours · Trending score 0.00

  12. 12
    scrapfly/python-scrapfly

    Official Python SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Integrates with Scrapy, LlamaIndex, and LangChain.

    GitHub · Python · 63 stars · 17 forks · 0 stars in 24 hours · Trending score 0.00

  13. 13
    tech-engine/goscrapy

    GoScrapy: High perfomance webscraping framework in Go, inspired by Python's Scrapy.

    GitHub · Go · 373 stars · 41 forks · 0 stars in 24 hours · Trending score 0.00

  14. 14
    discourselab/scrapai-cli

    AI-powered web scraping CLI. Describe what you want, get a production-ready Scrapy spider. Write once, reuse forever.

    GitHub · Python · 116 stars · 18 forks · 0 stars in 24 hours · Trending score 0.00

  15. 15
    scrapy/itemadapter

    Common interface for data container classes

    GitHub · Python · 70 stars · 22 forks · 0 stars in 24 hours · Trending score 0.00

  16. 16
    RayXBuilds/Movie_Recommend

    历史学习项目:Spark 电影推荐、爬虫、Web 与后台。新版持续开发见 cinematch-recommender。

    GitHub · Java · 3,013 stars · 1,049 forks · 0 stars in 24 hours · Trending score 0.00

  17. 17
    Stormettenebula/Youtube-resocket-viewbot

    🦊 Fast views botter based on proxies

    GitHub · HTML · 34 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00