4GitHub Trending (AI/LLM filtered)·
OpenDCAI/DataFlow: LLM-based data preparation pipeline library gains traction on GitHub
DataFlow is an open-source Python library from OpenDCAI that provides LLM-based operators and pipelines for data preparation tasks. The repository has accumulated 6,971 stars with 139 added in a single day, indicating growing community interest. It targets the data curation and preprocessing workflow that underpins LLM training and fine-tuning pipelines.
Related guides (2)
Related events (8)
FlowPipe: LLM-conditioned Generative Flow Networks for automated data preparation pipeline construction
FlowPipe is a new framework that frames ML data preparation pipeline synthesis as conditional probabilistic flow generation over a directed acyclic graph, using Conditional Generative Flow Networks (C-GFlowNets) with a Trajectory Balance objective. LLM-derived semantic priors are injected into the policy via Feature-wise Linear Modulation (FiLM), and a failure-aware flow objective steers search away from invalid states. Evaluated on 74 real-world datasets across two benchmark suites, FlowPipe improves accuracy by 11.96% on average over SOTA baselines and achieves 12.5x faster training convergence. The work addresses long-standing limitations in automated data pipeline construction including weak credit assignment and inefficient exploration.
MLflow trending on GitHub as open-source AI engineering platform
MLflow, an open-source platform for managing AI/ML workflows, is trending on GitHub with 26,442 total stars and 22 new stars today. The project supports agents, LLMs, and traditional ML models, offering debugging, evaluation, monitoring, and optimization capabilities for production AI applications. It is a mature, widely-used tooling platform in the MLOps space.
Langflow: Visual AI Agent and Workflow Builder Trending on GitHub
Langflow is an open-source Python framework for building and deploying AI-powered agents and workflows, currently accumulating 148,425 total GitHub stars with 155 new stars today. It provides a visual interface for composing LLM-based pipelines and agent workflows. The continued traction signals ongoing community interest in low-code/visual tooling for AI agent construction.
DataOrchestra: Per-example adaptive curation pipeline for LLM pretraining data
DataOrchestra is a proposed framework that replaces fixed corpus-level data processing strategies with an example-specific orchestration pipeline for LLM pretraining. An orchestrator model decides per data chunk whether to drop, leave unchanged, or clean it, selecting from programmatic editing or LLM-based rewriting with generated instructions. Models pretrained from 0.5B to 7B on DataOrchestra-processed web data show consistent gains across 11 benchmarks over individual processing methods, with additional benefits for math continued pretraining and reduced compute from skipping unnecessary operations.
Flowise: open-source visual builder for AI agents gains traction on GitHub
Flowise is an open-source TypeScript project for building AI agents and LLM workflows through a visual drag-and-drop interface. The repository has accumulated over 53,000 GitHub stars with 107 new stars on the day of observation. It represents a no-code/low-code approach to agent and chain construction in the LangChain ecosystem.
Crawl4AI: Open-Source LLM-Friendly Web Crawler & Scraper
Crawl4AI is an open-source Python library designed to make web crawling and scraping compatible with LLM pipelines. The project has accumulated over 66,500 GitHub stars with strong daily momentum (+216 today), indicating significant community adoption. It targets the data ingestion layer for AI agents and RAG systems that require structured web content.
Langfuse: Open Source LLM Engineering Platform Trending on GitHub
Langfuse is an open-source LLM engineering platform providing observability, metrics, evaluations, prompt management, and dataset tooling. It integrates with OpenTelemetry, LangChain, OpenAI SDK, and LiteLLM. The project has accumulated 28,075 GitHub stars with 89 new stars today, indicating sustained community traction. Backed by Y Combinator (W23), it represents a notable entry in the LLM ops/tooling ecosystem.
AWS Labs releases AI-Driven Life Cycle (AI-DLC) adaptive workflow steering rules for AI coding agents
AWS Labs has open-sourced aidlc-workflows, a Python repository providing adaptive workflow steering rules for AI coding agents under an AI-Driven Life Cycle (AI-DLC) framework. The project aims to guide AI agents through structured software development lifecycle phases. With 2,367 stars and modest daily growth (+31), it represents a community-level tooling contribution from AWS Labs in the agent orchestration space.