6arXiv cs.AI (Artificial Intelligence)·
Autodata: Meta-optimized agentic data scientist for high-quality synthetic data generation
Researchers introduce Autodata, a framework that trains AI agents to act as data scientists capable of generating high-quality synthetic training and evaluation data. The method includes a meta-optimization loop (Agentic Self-Instruct) that improves the data scientist agent itself, yielding further performance gains. Experiments on CS research, legal reasoning, and mathematical reasoning tasks show improvements over classical synthetic data methods. The authors frame this as a path to converting inference compute into higher-quality training data.
Related guides (3)
Related events (8)
SynAE: Framework for Evaluating Synthetic Data Quality in Tool-Calling Agent Benchmarks
SynAE is a proposed evaluation framework for measuring how well synthetic datasets replicate and augment real data trajectories for multi-turn, tool-calling agent testing. It assesses validity, fidelity, and diversity across four metric categories: task instructions, tool calls, final outputs, and downstream evaluation. The paper demonstrates that no single metric suffices to characterize synthetic data quality, motivating multi-axis evaluation. A demo and code are publicly available.
Data Intelligence Agents (DIA): Autonomous coding agents for enterprise data integration and SQL generation
Researchers present Data Intelligence Agents (DIA), a production-deployed system of three autonomous coding agents (Data Interpreter, Schema Creator, Query Generator) that automate enterprise data integration workflows. Rather than generating text, the agents produce, execute, validate, and repair concrete artifacts (code, schemas, SQL) with shared memory for experience reuse. The Query Generator is evaluated across seven SQL benchmarks spanning four dialects and task categories, matching or surpassing best published results on all seven. The system is deployed in production for enterprise customers, making it a notable applied research contribution.
Synthetic Data: Save Money, Time and Carbon with Open Source
A Hugging Face blog post advocates for using synthetic data generation with open-source tools as a cost-effective, time-efficient, and environmentally friendlier alternative to real data collection and labeling. The post likely covers techniques and tooling available in the open-source ecosystem for generating synthetic training data. This is relevant to the broader trend of reducing dependency on expensive human-labeled datasets in ML pipelines.
Activation Steering for Synthetic Safety Data Generation: Diversity as a Critical Quality Axis
This paper investigates whether activation steering (AS) can generate high-quality synthetic training data for downstream safety detection classifiers, filling a gap in the literature. Across 4 safety concepts × 2 models × 4 steering methods, the authors find that AS-generated data outperforms prompt-generated data on 3 of 4 concepts, but only 41 of 136 configurations succeed, indicating a narrow effective regime. The study introduces sample- and set-level diversity as a previously absent quality axis, finding that higher steering strength reduces diversity and that the harmonic mean of success, coherence, and diversity correlates more reliably with downstream AUROC than prior metrics alone. The results provide a practical heuristic for practitioners tuning AS hyperparameters for safety data generation.
Microsoft RD-Agent: automated AI-driven R&D for data and model development
Microsoft has released RD-Agent, an open-source Python framework aimed at automating high-value R&D processes in AI, with a focus on data and model development. The project positions AI as the driver of data-driven AI workflows, targeting industrial productivity use cases. With 13,500 GitHub stars, it has attracted meaningful community interest, and a technical report is available.
Inside OpenAI's In-House Data Agent
OpenAI describes the architecture and capabilities of an internal AI data agent built on GPT-5 and Codex, designed to reason over large datasets and return reliable analytical insights within minutes. The system incorporates memory components to handle complex, multi-step data queries at scale. This represents a concrete internal deployment of frontier models in an agentic, tool-using workflow. The post offers a rare look at how OpenAI itself operationalizes its own models for enterprise-style data analysis.
Introducing the Synthetic Data Generator - Build Datasets with Natural Language
Hugging Face has launched a Synthetic Data Generator tool that allows users to create datasets using natural language descriptions. The tool is designed to lower the barrier for dataset creation, enabling practitioners to generate training data without writing code. This is relevant to the broader trend of synthetic data as a scalable alternative to manual data collection and annotation.
OpenAI Introduces Deep Research Agent
OpenAI has launched 'deep research,' an agentic capability that uses reasoning to synthesize large volumes of online information and complete multi-step research tasks autonomously. The feature is initially available to ChatGPT Pro users, with rollout to Plus and Team tiers to follow. It represents a step toward practical autonomous research agents built on OpenAI's reasoning model infrastructure.