adbar/trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
GitHub repository with 6,122 stars and 382 forks.
Language: Python
Topics: web-scraping, text-extraction, nlp, html2text, text-mining, crawler, text-cleaning, text-preprocessing, article-extractor, readability