scrapy repositories
Trending repositories tagged scrapy, ranked by trending score. Updated daily.
-
1
juancarlospaco/faster-than-requests
Faster requests on Python 3
GitHub · Nim · 1,131 stars · 89 forks · +4 stars in 24 hours · Trending score 1.03
-
2
netweir/netweir
An ultra-fast, self-healing, undetectable web scraper. Rust does the work; you write Python.
GitHub · Rust · 8 stars · 4 forks · +1 stars in 24 hours · Trending score 0.56
-
3
wildovortex96622/Youtube-resocket-viewbot
🦊 Fast views botter based on proxies
GitHub · 50 stars · 0 forks · 0 stars in 24 hours · Trending score 0.50
-
4
Suvastutech-Ltd/scrapy-stealth
Stealthy Crawling. Maximum Results. A pluggable anti-bot and stealth framework for Scrapy.
GitHub · Python · 17 stars · 9 forks · +1 stars in 24 hours · Trending score 0.46
-
5
alltheplaces/alltheplaces
A set of spiders and scrapers to extract location information from places that post their location on the internet.
GitHub · Python · 852 stars · 311 forks · 0 stars in 24 hours · Trending score 0.38
-
6
rmax/scrapy-redis
Redis-based components for Scrapy.
GitHub · Python · 5,648 stars · 1,579 forks · −1 stars in 24 hours · Trending score 0.28
-
7
stummjr/books_crawler
A Scrapy crawler for http://books.toscrape.com
GitHub · Python · 27 stars · 1,030 forks · 0 stars in 24 hours · Trending score 0.10
-
8
shengchenyang/AyugeSpiderTools
使 scrapy 开发不用在意 item,pipeline,middleware 等通用场景下模块的编写,解放开发者的双手。
GitHub · Python · 102 stars · 17 forks · 0 stars in 24 hours · Trending score 0.07
-
9
scrapy-plugins/scrapy-splash
Scrapy+Splash for JavaScript integration
GitHub · Python · 3,224 stars · 455 forks · 0 stars in 24 hours · Trending score 0.00
-
10
imflyn/decoration-design-crawler
土巴兔和谷居装修网站爬虫
GitHub · Python · 108 stars · 37 forks · 0 stars in 24 hours · Trending score 0.00
-
11
bitmakerla/estela
estela, an elastic web scraping cluster 🕸
GitHub · TypeScript · 202 stars · 17 forks · 0 stars in 24 hours · Trending score 0.00
-
12
scrapfly/python-scrapfly
Official Python SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Integrates with Scrapy, LlamaIndex, and LangChain.
GitHub · Python · 63 stars · 17 forks · 0 stars in 24 hours · Trending score 0.00
-
13
tech-engine/goscrapy
GoScrapy: High perfomance webscraping framework in Go, inspired by Python's Scrapy.
GitHub · Go · 373 stars · 41 forks · 0 stars in 24 hours · Trending score 0.00
-
14
discourselab/scrapai-cli
AI-powered web scraping CLI. Describe what you want, get a production-ready Scrapy spider. Write once, reuse forever.
GitHub · Python · 116 stars · 18 forks · 0 stars in 24 hours · Trending score 0.00
-
15
scrapy/itemadapter
Common interface for data container classes
GitHub · Python · 70 stars · 22 forks · 0 stars in 24 hours · Trending score 0.00
-
16
RayXBuilds/Movie_Recommend
历史学习项目:Spark 电影推荐、爬虫、Web 与后台。新版持续开发见 cinematch-recommender。
GitHub · Java · 3,013 stars · 1,049 forks · 0 stars in 24 hours · Trending score 0.00
-
17
Stormettenebula/Youtube-resocket-viewbot
🦊 Fast views botter based on proxies
GitHub · HTML · 34 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00