html-to-markdown repositories

Trending repositories tagged html-to-markdown, ranked by trending score. Updated daily.

  1. 1
    firecrawl/firecrawl

    Knowledge infrastructure to make your agents smarter. Search, scrape and access 550+ data providers through one API.

    GitHub · TypeScript · 205,170 stars · 10,743 forks · +1,470 stars in 24 hours · Trending score 5.69

  2. 2
    fastcrw/crw

    Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

    GitHub · Rust · 1,281 stars · 102 forks · +14 stars in 24 hours · Trending score 2.30

  3. 3
    YOLOW92/pagesift

    Local-first web & document ingestion engine in Rust — HTTP/browser capture, layout-aware PDF/Office/OCR parsing, persistent sync, verifiable data graphs, and evidence-grounded AI context.

    GitHub · Rust · 284 stars · 37 forks · +5 stars in 24 hours · Trending score 1.71

  4. 4
    adbar/trafilatura

    Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

    GitHub · Python · 7,138 stars · 510 forks · 0 stars in 24 hours · Trending score 1.14

  5. 5
    any4ai/AnyCrawl

    AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

    GitHub · TypeScript · 3,528 stars · 372 forks · 0 stars in 24 hours · Trending score 0.96

  6. 6
    SylphxAI/anymd

    Any file → clean Markdown for AI agents: PDF, Word, PowerPoint, Excel, EPUB, HTML and web pages, images (OCR), audio and video (metadata, subtitles, transcripts). A fast Rust MCP server and CLI that runs on your machine. No API key.

    GitHub · Rust · 1,071 stars · 94 forks · +1 stars in 24 hours · Trending score 0.76

  7. 7
    janreges/siteone-crawler

    SiteOne Crawler is a cross-platform website crawler and analyzer for SEO, security, accessibility, and performance optimization—ideal for developers, DevOps, QA engineers, and consultants. Supports Windows, macOS, and Linux (x64 and arm64).

    GitHub · Rust · 1,017 stars · 98 forks · 0 stars in 24 hours · Trending score 0.75

  8. 8
    harehare/mq

    A jq-like Markdown query language for command-line processing

    GitHub · Rust · 1,084 stars · 24 forks · +1 stars in 24 hours · Trending score 0.69

  9. 9
    0xMassi/webclaw

    Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

    GitHub · Rust · 2,441 stars · 245 forks · −4 stars in 24 hours · Trending score 0.53

  10. 10
    ilien-dev/svipall

    Local-first MCP server and CLI in Rust: any page as LLM-ready Markdown, whole-site crawls, keyless search, and local captcha solving. No cloud, no API keys.

    GitHub · Rust · 22 stars · 2 forks · 0 stars in 24 hours · Trending score 0.36

  11. 11
    AeternaLabsHQ/pullmd

    Self-hosted URL- and file-to-Markdown service for humans and AI agents - web pages, documents, images, audio, YouTube. PWA + REST + MCP + Claude Code skill, Reddit-aware, refreshable share links.

    GitHub · JavaScript · 528 stars · 43 forks · 0 stars in 24 hours · Trending score 0.32

  12. 12
    context-dot-dev/context-dev-cli

    Context.dev CLI: scrape, crawl, search and screenshot the web from your terminal. Returns LLM-ready markdown or JSON.

    GitHub · Go · 9 stars · 2 forks · 0 stars in 24 hours · Trending score 0.23

  13. 13
    77777R7/Octocrawl

    Web scraping MCP server and API for AI agents: any public URL to clean Markdown, plus site maps. Hosted MCP works without an API key or sign-up (20 pages a day); crawls and batches with a free account. Self-host with npx. Each page comes with an Evidence Record.

    GitHub · TypeScript · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.19

  14. 14
    iamsaquib8/domq

    A tiny, zero-dependency, never-panicking HTML parser with CSS selectors — for Rust, your shell, JavaScript (a ~58 KB gzipped WebAssembly module, ~80 KB with reader mode and extraction) and Python.

    GitHub · Rust · 12 stars · 7 forks · 0 stars in 24 hours · Trending score 0.16

  15. 15
    kinorai/omnifeed

    LLM-friendly web crawler & scraper with a dedicated Reddit engine, built on Crawl4AI — Open WebUI compatible

    GitHub · Go · 11 stars · 2 forks · 0 stars in 24 hours · Trending score 0.09

  16. 16
    thomas-villani/all2md

    Convert PDF, Word, PowerPoint, HTML, email & 40+ formats to clean Markdown — and back. Built for LLMs, RAG & Python pipelines, with a built-in MCP server.

    GitHub · Python · 34 stars · 5 forks · 0 stars in 24 hours · Trending score 0.09

  17. 17
    wevm/curl.md

    URL to markdown for agents

    GitHub · TypeScript · 295 stars · 17 forks · 0 stars in 24 hours · Trending score 0.08

  18. 18
    inaridiy/webforai

    Any HTML to the cleanest Markdown, for humans and AI agents: a TypeScript library, a CLI with an Agent Skill, and a hosted crawl/scrape API.

    GitHub · TypeScript · 82 stars · 5 forks · 0 stars in 24 hours · Trending score 0.03

  19. 19
    oidlabs-com/Lexoid

    The open-source universal adapter for LLMs. Turn messy real-world data into clean, agent-ready context.

    GitHub · Python · 109 stars · 15 forks · 0 stars in 24 hours · Trending score 0.03

  20. 20
    Nano-Collective/get-md

    A fast, lightweight HTML to Markdown converter optimized for LLM consumption. Uses proven parsing libraries to deliver clean, well-structured markdown with intelligent content extraction and noise filtering.

    GitHub · TypeScript · 96 stars · 6 forks · 0 stars in 24 hours · Trending score 0.01

  21. 21
    Spenhouet/confluence-markdown-exporter

    Export Atlassian Confluence pages as markdown files.

    GitHub · Python · 598 stars · 135 forks · 0 stars in 24 hours · Trending score 0.00

  22. 22
    mrusme/reader

    reader is for your command line what the “readability” view is for modern browsers: A lightweight tool offering better readability of web pages (and EML files!) on the CLI. (https://tty.fail/mrus/reader)

    GitHub · Go · 420 stars · 16 forks · 0 stars in 24 hours · Trending score 0.00

  23. 23
    AntonG87/codearia-sieve

    Parses a web page into the exact format a decision model needs: dates as dates, numbers with units, chunks that fit the model's window. MCP server + TypeScript library, no model or API key required.

    GitHub · TypeScript · 5 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  24. 24
    AbdoslamB/InkDoc

    Turn any document into clean, AI-ready Markdown — locally on your machine. Desktop app for Windows, macOS & Linux powered by MarkItDown, Docling, GLM-OCR and Markit.

    GitHub · Python · 60 stars · 9 forks · 0 stars in 24 hours · Trending score 0.00