news-crawler-lm-3c0a1558·1 events·first seen Aliases: news-crawler-LM
Researchers introduce news-crawler-LM, a small long-context language model fine-tuned on human-validated extractions from the Fundus news-crawling library to convert raw HTML into plaintext and structured JSON. The model outperforms baselines on HTML-to-Markdown and HTML-to-JSON tasks by +4.8 BLEU/+6.1 METEOR and +2.2 BLEU/+4.1 METEOR respectively, though it only marginally beats rule-based parsers on HTML-to-plaintext for unseen publishers. All models and artifacts are released publicly, targeting the practical gap between expensive LLMs and brittle rule-based crawlers.