sammy310/Danawa-Crawler

다나와 크롤러 - PC부품 크롤링

GitHub repository with 36 stars and 13 forks.

Language: Python

Topics: crawler

Open provider repository

Latest metric snapshot

2026-06-05: 36 stars and 13 forks.

Similar repositories

  1. 1. CharlesPikachu/videodl

    Videodl: A lightweight video downloader written in pure python. (轻量级视频下载器,优先高清无水印,支持抖音,快手,小红书,B站,TikTok,YouTube,FIFA+,优酷,腾讯,爱奇艺,1905电影网,乐视,芒果,咪咕,PPTV,搜狐,Facebook,Twitter,新浪微博,今日头条,网易公开课,全民K歌,CCTV央视频,酷狗音乐MV,新片场,知乎,百度贴吧,TED等海量流媒体平台)

    GitHub repository with 2,207 stars and 397 forks.

    Trending score: 2.34; stars gained: +24; forks gained: +2.

    Language: Python

    Topics: video-downloader, cntv, douyin, crawler, migu, bilibili

  2. 2. ScrapeGraphAI/Scrapegraph-ai

    Python scraper based on AI

    GitHub repository with 26,738 stars and 2,486 forks.

    Trending score: 1.91; stars gained: +105; forks gained: +7.

    Language: Python

    Topics: ai-crawler, ai-scraping, ai-search, crawler, data-extraction, firecrawl-alternative

  3. 3. apify/crawlee-python

    Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

    GitHub repository with 9,144 stars and 747 forks.

    Trending score: 1.08; stars gained: +7; forks gained: -1.

    Language: Python

    Topics: apify, automation, beautifulsoup, crawler, crawling, headless

  4. 4. CharlesPikachu/freeproxy

    FreeProxy: Collecting free proxies from internet. (全球海量高质量免费代理,支持爬取数十个免费代理分享源,支持自定义规则代理筛选,爬虫与数据分析必备,每日更新海量免费代理。)

    GitHub repository with 452 stars and 79 forks.

    Trending score: 0.60; stars gained: +3; forks gained: +0.

    Language: Python

    Topics: proxy-sources, 996icu, crawler, icu, proxy, proxy-server

  5. 5. MarshalX/telegram-crawler

    🕷 Automatically detect changes made to the official Telegram sites, clients and servers.

    GitHub repository with 351 stars and 46 forks.

    Trending score: 0.41; stars gained: +1; forks gained: +0.

    Language: Python

    Topics: crawler, parser, telegram, telegram-org, telegram-updates, crawling

  6. 6. 0xDarkMatter/flarecrawl

    Flarecrawl CLI — Cloudflare Browser Rendering alternative to Firecrawl, cost-efficient at scale

    GitHub repository with 6 stars and 0 forks.

    Trending score: 0.33; stars gained: +1; forks gained: +0.

    Language: Python

    Topics: browser-rendering, cli, cloudflare, crawler, favicon, firecrawl

Trending in Python

  1. 1. NousResearch/hermes-agent

    The agent that grows with you

    GitHub repository with 181,615 stars and 31,159 forks.

    Trending score: 5.95; stars gained: +1,867; forks gained: +361.

    Language: Python

    Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude

  2. 2. chopratejas/headroom

    Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.

    GitHub repository with 13,361 stars and 853 forks.

    Trending score: 5.69; stars gained: +2,829; forks gained: +175.

    Language: Python

    Topics: agent, ai, anthropic, compression, context-engineering, context-window

  3. 3. Imbad0202/academic-research-skills

    Academic Research Skills for Claude Code: research → write → review → revise → finalize

    GitHub repository with 27,422 stars and 2,253 forks.

    Trending score: 5.52; stars gained: +1,079; forks gained: +89.

    Language: Python

    Topics: academic-pipeline, academic-writing, ai-research, claude, claude-code, literature-review

  4. 4. anthropics/financial-services

    GitHub repository with 30,002 stars and 4,224 forks.

    Trending score: 4.88; stars gained: +688; forks gained: +114.

    Language: Python

  5. 5. virgiliojr94/book-to-skill

    Turn any technical book PDF into a Claude Code skill — ready to study, reference, and use while you work.

    GitHub repository with 4,250 stars and 534 forks.

    Trending score: 4.88; stars gained: +476; forks gained: +68.

    Language: Python

  6. 6. vinta/awesome-python

    An opinionated list of Python frameworks, libraries, tools, and resources

    GitHub repository with 301,371 stars and 28,044 forks.

    Trending score: 4.60; stars gained: +518; forks gained: +24.

    Language: Python

    Topics: awesome, python, collections, python-frameworks, python-libraries, python-tools

Trending topic: crawler

  1. 1. firecrawl/firecrawl

    The API to search, scrape, and interact with the web at scale. 🔥

    GitHub repository with 128,853 stars and 7,670 forks.

    Trending score: 4.80; stars gained: +954; forks gained: +49.

    Language: TypeScript

    Topics: ai, ai-agents, ai-crawler, ai-scraping, ai-search, crawler

  2. 2. CharlesPikachu/videodl

    Videodl: A lightweight video downloader written in pure python. (轻量级视频下载器,优先高清无水印,支持抖音,快手,小红书,B站,TikTok,YouTube,FIFA+,优酷,腾讯,爱奇艺,1905电影网,乐视,芒果,咪咕,PPTV,搜狐,Facebook,Twitter,新浪微博,今日头条,网易公开课,全民K歌,CCTV央视频,酷狗音乐MV,新片场,知乎,百度贴吧,TED等海量流媒体平台)

    GitHub repository with 2,207 stars and 397 forks.

    Trending score: 2.34; stars gained: +24; forks gained: +2.

    Language: Python

    Topics: video-downloader, cntv, douyin, crawler, migu, bilibili

  3. 3. ScrapeGraphAI/Scrapegraph-ai

    Python scraper based on AI

    GitHub repository with 26,738 stars and 2,486 forks.

    Trending score: 1.91; stars gained: +105; forks gained: +7.

    Language: Python

    Topics: ai-crawler, ai-scraping, ai-search, crawler, data-extraction, firecrawl-alternative

  4. 4. apify/crawlee

    Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

    GitHub repository with 23,677 stars and 1,417 forks.

    Trending score: 1.27; stars gained: +20; forks gained: +0.

    Language: TypeScript

    Topics: apify, automation, crawler, crawling, headless, headless-chrome

  5. 5. 0x676e67/wreq

    An ergonomic Rust HTTP Client with TLS fingerprint

    GitHub repository with 842 stars and 109 forks.

    Trending score: 1.21; stars gained: +3; forks gained: +0.

    Language: Rust

    Topics: akamai, client, crawler, fingerprint, http, http-client

  6. 6. 0xMassi/webclaw

    Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

    GitHub repository with 1,287 stars and 148 forks.

    Trending score: 1.20; stars gained: +17; forks gained: +0.

    Language: Rust

    Topics: ai-agents, cli, llm, markdown, mcp, rust