bda-research/node-crawler

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

GitHub repository with 6,786 stars and 868 forks.

Language: TypeScript

Topics: crawler, javascript, spider, extract-data, cheerio, jquery, nodejs

Open provider repository

Latest metric snapshot

2026-06-05: 6,786 stars and 868 forks.

Similar repositories

  1. 1. firecrawl/firecrawl

    The API to search, scrape, and interact with the web at scale. 🔥

    GitHub repository with 128,853 stars and 7,670 forks.

    Trending score: 4.80; stars gained: +954; forks gained: +49.

    Language: TypeScript

    Topics: ai, ai-agents, ai-crawler, ai-scraping, ai-search, crawler

  2. 2. apify/crawlee

    Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

    GitHub repository with 23,677 stars and 1,417 forks.

    Trending score: 1.27; stars gained: +20; forks gained: +0.

    Language: TypeScript

    Topics: apify, automation, crawler, crawling, headless, headless-chrome

  3. 3. KoreanThinker/billboard-json

    🎧 Get json type billboard hot 100 chart

    GitHub repository with 58 stars and 8 forks.

    Trending score: 0.05; stars gained: +0; forks gained: +0.

    Language: TypeScript

    Topics: api, billboard, billboard-charts, billboards-hot-100, crawler, crawling

  4. 4. coder-hxl/x-crawl

    Flexible Node.js AI-assisted crawler library

    GitHub repository with 1,860 stars and 114 forks.

    Trending score: 0.05; stars gained: +0; forks gained: +0.

    Language: TypeScript

    Topics: crawl, crawler, nodejs, typescript, spider, flexible

  5. 5. lightfeed/scrapedown

    HTML to Markdown with CSS selector and XPath annotations

    GitHub repository with 11 stars and 0 forks.

    Trending score: 0.00; stars gained: +0; forks gained: +0.

    Language: TypeScript

    Topics: crawler, data-pipeline, html-parser, html-to-markdown, llm, llm-extraction

Trending in TypeScript

  1. 1. nexu-io/open-design

    🎨 Local-first, open-source Claude Design alternative. 🖥️ Native desktop app. ⚡ 259+ Skills · ✨ 142+ Design Systems 🖼️ Web · desktop · mobile prototypes · slides · images · videos · HyperFrames 📦 Sandboxed preview · HTML/PDF/PPTX/MP4 export 🤖 Claude Code / OpenClaw / Codex / Cursor / OpenCode / Qwen / Copilot / Hermes / Kimi & 17+ CLIs.

    GitHub repository with 59,120 stars and 6,648 forks.

    Trending score: 5.98; stars gained: +1,178; forks gained: +117.

    Language: TypeScript

    Topics: agent-skills, ai-agents, ai-design, byok, claude-code-for-design, claude-design

  2. 2. colbymchenry/codegraph

    Pre-indexed code knowledge graph for Claude Code, Codex, Gemini, Cursor, OpenCode, AntiGravity, Kiro, and Hermes Agent — fewer tokens, fewer tool calls, 100% local

    GitHub repository with 41,600 stars and 2,573 forks.

    Trending score: 5.83; stars gained: +2,953; forks gained: +188.

    Language: TypeScript

  3. 3. can1357/oh-my-pi

    ⌥ AI Coding agent for the terminal — hash-anchored edits, optimized tool harness, LSP, Python, browser, subagents, and more

    GitHub repository with 10,626 stars and 889 forks.

    Trending score: 4.82; stars gained: +560; forks gained: +62.

    Language: TypeScript

    Topics: ai-agent, ai-coding-agent, anthropic, bun, claude, cli

  4. 4. firecrawl/firecrawl

    The API to search, scrape, and interact with the web at scale. 🔥

    GitHub repository with 128,853 stars and 7,670 forks.

    Trending score: 4.80; stars gained: +954; forks gained: +49.

    Language: TypeScript

    Topics: ai, ai-agents, ai-crawler, ai-scraping, ai-search, crawler

  5. 5. ruvnet/ruflo

    🌊 The leading agent meta-harness for Claude. Deploy intelligent multi-agent swarms, coordinate autonomous workflows, and build conversational AI systems. Features adaptive memory, self-learning swarm intelligence, RAG integration, and native Claude Code / Codex Integration

    GitHub repository with 57,929 stars and 6,621 forks.

    Trending score: 4.76; stars gained: +401; forks gained: +52.

    Language: TypeScript

    Topics: agentic-ai, agentic-framework, agentic-rag, agentic-workflow, agents, ai-agents

  6. 6. heygen-com/hyperframes

    Write HTML. Render video. Built for agents.

    GitHub repository with 24,519 stars and 2,280 forks.

    Trending score: 4.72; stars gained: +732; forks gained: +60.

    Language: TypeScript

    Topics: ai, animation, ffmpeg, framework, gsap, html

Trending topic: crawler

  1. 1. firecrawl/firecrawl

    The API to search, scrape, and interact with the web at scale. 🔥

    GitHub repository with 128,853 stars and 7,670 forks.

    Trending score: 4.80; stars gained: +954; forks gained: +49.

    Language: TypeScript

    Topics: ai, ai-agents, ai-crawler, ai-scraping, ai-search, crawler

  2. 2. CharlesPikachu/videodl

    Videodl: A lightweight video downloader written in pure python. (轻量级视频下载器，优先高清无水印，支持抖音，快手，小红书，B站，TikTok，YouTube，FIFA+，优酷，腾讯，爱奇艺，1905电影网，乐视，芒果，咪咕，PPTV，搜狐，Facebook，Twitter，新浪微博，今日头条，网易公开课，全民K歌，CCTV央视频，酷狗音乐MV，新片场，知乎，百度贴吧，TED等海量流媒体平台)

    GitHub repository with 2,207 stars and 397 forks.

    Trending score: 2.34; stars gained: +24; forks gained: +2.

    Language: Python

    Topics: video-downloader, cntv, douyin, crawler, migu, bilibili

  3. 3. ScrapeGraphAI/Scrapegraph-ai

    Python scraper based on AI

    GitHub repository with 26,738 stars and 2,486 forks.

    Trending score: 1.91; stars gained: +105; forks gained: +7.

    Language: Python

    Topics: ai-crawler, ai-scraping, ai-search, crawler, data-extraction, firecrawl-alternative

  4. 4. apify/crawlee

    Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

    GitHub repository with 23,677 stars and 1,417 forks.

    Trending score: 1.27; stars gained: +20; forks gained: +0.

    Language: TypeScript

    Topics: apify, automation, crawler, crawling, headless, headless-chrome

  5. 5. 0x676e67/wreq

    An ergonomic Rust HTTP Client with TLS fingerprint

    GitHub repository with 842 stars and 109 forks.

    Trending score: 1.21; stars gained: +3; forks gained: +0.

    Language: Rust

    Topics: akamai, client, crawler, fingerprint, http, http-client

  6. 6. 0xMassi/webclaw

    Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

    GitHub repository with 1,287 stars and 148 forks.

    Trending score: 1.20; stars gained: +17; forks gained: +0.

    Language: Rust

    Topics: ai-agents, cli, llm, markdown, mcp, rust