OpenDCAI

OpenDCAI/DataFlow: LLM-based data preparation pipeline library gains traction on GitHub

DataFlow is an open-source Python library from OpenDCAI that provides LLM-based operators and pipelines for data preparation tasks. The repository has accumulated 6,971 stars with 139 added in a single day, indicating growing community interest. It targets the data curation and preprocessing workflow that underpins LLM training and fine-tuning pipelines.