fasttext-72e7be57·2 events·first seen Aliases: fastText
A new arXiv paper evaluates six NLP architectures for Bangla hate speech detection, finding severe performance degradation when models trained on benchmark datasets are applied to real-world social media content. BanglaBERT drops from 91.4% F1 on benchmarks to 63.4% on implicit hate speech involving sarcasm and emojis. The study highlights a broader generalization crisis for low-resource language moderation systems and finds that emoji-aware preprocessing recovers up to 12% of lost performance.
Hugging Face has integrated fastText models into its Hub, enabling users to discover, share, and use fastText models through the standard Hub interface. fastText, originally developed by Facebook AI Research, is a widely-used library for efficient text classification and word vector representation. This integration extends the Hub's coverage of classical NLP tooling alongside modern transformer-based models.