html-to-markdown repositories
Trending repositories tagged html-to-markdown, ranked by trending score. Updated daily.
-
1
firecrawl/firecrawl
Knowledge infrastructure to make your agents smarter. Search, scrape and access 550+ data providers through one API.
GitHub · TypeScript · 205,170 stars · 10,743 forks · +1,470 stars in 24 hours · Trending score 5.69
-
2
fastcrw/crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
GitHub · Rust · 1,281 stars · 102 forks · +14 stars in 24 hours · Trending score 2.30
-
3
YOLOW92/pagesift
Local-first web & document ingestion engine in Rust — HTTP/browser capture, layout-aware PDF/Office/OCR parsing, persistent sync, verifiable data graphs, and evidence-grounded AI context.
GitHub · Rust · 284 stars · 37 forks · +5 stars in 24 hours · Trending score 1.71
-
4
adbar/trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
GitHub · Python · 7,138 stars · 510 forks · 0 stars in 24 hours · Trending score 1.14
-
5
any4ai/AnyCrawl
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
GitHub · TypeScript · 3,528 stars · 372 forks · 0 stars in 24 hours · Trending score 0.96
-
6
SylphxAI/anymd
Any file → clean Markdown for AI agents: PDF, Word, PowerPoint, Excel, EPUB, HTML and web pages, images (OCR), audio and video (metadata, subtitles, transcripts). A fast Rust MCP server and CLI that runs on your machine. No API key.
GitHub · Rust · 1,071 stars · 94 forks · +1 stars in 24 hours · Trending score 0.76
-
7
janreges/siteone-crawler
SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA engineers, and consultants. Supports Windows, macOS, and Linux (x64 and arm64).
GitHub · Rust · 1,017 stars · 98 forks · 0 stars in 24 hours · Trending score 0.75
-
8
harehare/mq
A jq-like Markdown query language for command-line processing
GitHub · Rust · 1,084 stars · 24 forks · +1 stars in 24 hours · Trending score 0.69
-
9
0xMassi/webclaw
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
GitHub · Rust · 2,441 stars · 245 forks · −4 stars in 24 hours · Trending score 0.53
-
10
ilien-dev/svipall
Local-first MCP server and CLI in Rust: any page as LLM-ready Markdown, whole-site crawls, keyless search, and local captcha solving. No cloud, no API keys.
GitHub · Rust · 22 stars · 2 forks · 0 stars in 24 hours · Trending score 0.36
-
11
AeternaLabsHQ/pullmd
Self-hosted URL- and file-to-Markdown service for humans and AI agents - web pages, documents, images, audio, YouTube. PWA + REST + MCP + Claude Code skill, Reddit-aware, refreshable share links.
GitHub · JavaScript · 528 stars · 43 forks · 0 stars in 24 hours · Trending score 0.32
-
12
context-dot-dev/context-dev-cli
Context.dev CLI: scrape, crawl, search and screenshot the web from your terminal. Returns LLM-ready markdown or JSON.
GitHub · Go · 9 stars · 2 forks · 0 stars in 24 hours · Trending score 0.23
-
13
77777R7/Octocrawl
Web scraping MCP server and API for AI agents: any public URL to clean Markdown, plus site maps. Hosted MCP works without an API key or sign-up (20 pages a day); crawls and batches with a free account. Self-host with npx. Each page comes with an Evidence Record.
GitHub · TypeScript · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.19
-
14
iamsaquib8/domq
A tiny, zero-dependency, never-panicking HTML parser with CSS selectors — for Rust, your shell, JavaScript (a ~58 KB gzipped WebAssembly module, ~80 KB with reader mode and extraction) and Python.
GitHub · Rust · 12 stars · 7 forks · 0 stars in 24 hours · Trending score 0.16
-
15
kinorai/omnifeed
LLM-friendly web crawler & scraper with a dedicated Reddit engine, built on Crawl4AI — Open WebUI compatible
GitHub · Go · 11 stars · 2 forks · 0 stars in 24 hours · Trending score 0.09
-
16
thomas-villani/all2md
Convert PDF, Word, PowerPoint, HTML, email & 40+ formats to clean Markdown — and back. Built for LLMs, RAG & Python pipelines, with a built-in MCP server.
GitHub · Python · 34 stars · 5 forks · 0 stars in 24 hours · Trending score 0.09
-
17
wevm/curl.md
URL to markdown for agents
GitHub · TypeScript · 295 stars · 17 forks · 0 stars in 24 hours · Trending score 0.08
-
18
inaridiy/webforai
Any HTML to the cleanest Markdown, for humans and AI agents: a TypeScript library, a CLI with an Agent Skill, and a hosted crawl/scrape API.
GitHub · TypeScript · 82 stars · 5 forks · 0 stars in 24 hours · Trending score 0.03
-
19
oidlabs-com/Lexoid
The open-source universal adapter for LLMs. Turn messy real-world data into clean, agent-ready context.
GitHub · Python · 109 stars · 15 forks · 0 stars in 24 hours · Trending score 0.03
-
20
Nano-Collective/get-md
A fast, lightweight HTML to Markdown converter optimized for LLM consumption. Uses proven parsing libraries to deliver clean, well-structured markdown with intelligent content extraction and noise filtering.
GitHub · TypeScript · 96 stars · 6 forks · 0 stars in 24 hours · Trending score 0.01
-
21
Spenhouet/confluence-markdown-exporter
Export Atlassian Confluence pages as markdown files.
GitHub · Python · 598 stars · 135 forks · 0 stars in 24 hours · Trending score 0.00
-
22
mrusme/reader
reader is for your command line what the “readability” view is for modern browsers: A lightweight tool offering better readability of web pages (and EML files!) on the CLI. (https://tty.fail/mrus/reader)
GitHub · Go · 420 stars · 16 forks · 0 stars in 24 hours · Trending score 0.00
-
23
AntonG87/codearia-sieve
Parses a web page into the exact format a decision model needs: dates as dates, numbers with units, chunks that fit the model's window. MCP server + TypeScript library, no model or API key required.
GitHub · TypeScript · 5 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
24
AbdoslamB/InkDoc
Turn any document into clean, AI-ready Markdown — locally on your machine. Desktop app for Windows, macOS & Linux powered by MarkItDown, Docling, GLM-OCR and Markit.
GitHub · Python · 60 stars · 9 forks · 0 stars in 24 hours · Trending score 0.00