Almanac
← Events
6arXiv cs.CL (Computation and Language)·9d ago

EurekAgent: Environment Engineering as the Key Bottleneck for Autonomous Scientific Discovery

EurekAgent is a new LLM-based agent system that reframes autonomous scientific discovery around 'environment engineering' — designing the resources, constraints, and interfaces that shape agent behavior — rather than prescribing agent workflows. The system engineers four dimensions: permissions, artifact management (filesystem/Git), budget awareness, and human-in-the-loop oversight. It achieves state-of-the-art results on mathematics, kernel engineering, and ML tasks, including new 26-circle packing results at under $11 in API cost, and is fully open-sourced.

Related guides (2)

Related events (8)

5arXiv · cs.CL·10d ago·source ↗

Survey: Agentic Environment Engineering for LLMs — Modeling, Synthesis, Evaluation, and Application

A comprehensive arXiv survey systematically reviews the design and engineering of interactive environments for LLM-based agents, covering the full lifecycle from environment modeling and synthesis to evaluation and application. The paper categorizes environments across eight attributes and eight domains, introduces symbolic and neural synthesis paradigms, and characterizes four pathways for agent-environment co-evolution including memory-centric, orchestration-centric, trajectory-centric, and exploration-centric approaches. It also identifies three paradigms of environment evolution (neural-driven, difficulty-driven, scaling-driven) and proposes future directions such as Environment-as-a-Service and multi-agent environments. This is a reference-organizing contribution for the rapidly growing agent tooling and evaluation space.

7arXiv · cs.CL·1mo ago·source ↗

EnvFactory: Scaling Tool-Use Agents via Executable Environments Synthesis and Robust RL

EnvFactory is a fully automated framework for training tool-use LLM agents via Agentic Reinforcement Learning, addressing two key bottlenecks: scalable execution environments and realistic multi-turn training data. It autonomously constructs stateful, executable tool environments from authentic resources and synthesizes natural trajectories with implicit human intents via topology-aware sampling. Using only 85 verified environments across 7 domains, it generates 2,575 SFT and RL trajectories and improves Qwen3-series models by up to +15% on BFCLv3, +8.6% on MCP-Atlas, and +6% on conversational benchmarks, outperforming prior approaches that use 5x more environments.

6arXiv · cs.AI·16d ago·source ↗

Benchmark Agent: Autonomous system for end-to-end benchmark construction

Researchers introduce Benchmark Agent, a fully autonomous agentic system that orchestrates the complete benchmark construction pipeline — from query analysis and subtask design to data annotation and quality control. The system was used to produce 15 benchmarks spanning text understanding, multimodal understanding, and domain-specific reasoning, with evaluation via human judges, LLM-as-a-judge, and consistency checks. The work addresses two persistent problems in the field: the labor intensity of benchmark creation and rapid performance saturation after release. Code and a demo will be publicly released.

4Github Trending·1mo ago·source ↗

E2B: Open-Source Secure Sandbox Environment for Enterprise AI Agents

E2B is an open-source project providing secure, sandboxed execution environments designed for enterprise-grade AI agents with access to real-world tools. The repository has accumulated 12,290 GitHub stars with 31 new stars today, indicating steady community interest. It targets the agent-tool ecosystem by offering isolated runtime environments where agents can safely execute code and interact with external systems.

6arXiv · cs.CL·6d ago·source ↗

AgentSpec: A modular framework for controlled composition and analysis of embodied LLM agent scaffolds

AgentSpec is a new modular specification framework that represents embodied LLM agents as typed compositions of reusable policy components with standardized interfaces across perception, memory, reasoning, reflection, action, and learning modules. The framework enables controlled swapping and recombination of components, instantiated across four benchmarks (DeliveryBench, ALFRED, MiniGrid, RoboTHOR). Key findings include that agent performance is governed by scaffold compatibility and interaction effects rather than isolated module strength, and that RL-trained policies compose best when optimized with deployment-time scaffold structure. Code, baselines, and an interactive playground are publicly released.

4Github Trending·1mo ago·source ↗

K-Dense-AI/scientific-agent-skills: Ready-to-Use Agent Skills Library for Research and Engineering

A Python repository providing a collection of pre-built agent skills targeting research, science, engineering, analysis, finance, and writing tasks. The project has accumulated 24,087 stars with a notable single-day gain of 762 stars, indicating significant community traction. No detailed technical documentation is available from the snippet, but the scope suggests a modular agent tooling library.

5Hugging Face Blog·1mo ago·source ↗

OpenEnv in Practice: Evaluating Tool-Using Agents in Real-World Environments

This Hugging Face blog post introduces OpenEnv, a framework for evaluating tool-using AI agents in real-world environments. The piece appears to address the challenge of benchmarking agentic systems that interact with external tools and environments, moving beyond static benchmarks toward dynamic, practical evaluation settings. As a tier-2 commentary piece, it likely discusses methodology, design choices, and results from applying OpenEnv to assess agent capabilities.

6arXiv · cs.AI·9d ago·source ↗

Agents-K1: End-to-end knowledge orchestration pipeline for agent-native scientific knowledge graphs

Agents-K1 is a new pipeline that converts raw scientific documents into structured knowledge graphs for use by LLM-based research agents, addressing the gap where existing systems reduce papers to abstracts and flat citation edges. The system integrates a multimodal parser, a 4B information-extraction model trained with GRPO, and a tri-source agent interface combining web search, graph retrieval, and cross-document traversal. The authors process 2.46 million scientific papers to produce Scholar-KG, releasing a one-million-paper subset. Experiments show improvements in scientific information extraction, knowledge graph construction, and multi-hop reasoning.