4arXiv cs.CL (Computation and Language)·
MyAG: Graph-based framework for composable LLM agent system design and analysis
Researchers introduce MyAG, an open-source framework that structures LLM agent systems using three graph abstractions: a component graph, a workflow graph, and a search graph for runtime execution. The separation enables flexible component reuse across different execution strategies, with support for hierarchical composition via recursive system nodes and built-in monitoring and visualization tools. Experiments on representative agent applications demonstrate performance-efficiency tradeoff analysis capabilities.
Related guides (1)
Related events (8)
Agentic CLEAR: Automating Multi-Level Evaluation of LLM Agents
Agentic CLEAR is an automatic evaluation framework for LLM-based agentic systems that analyzes behavior at three granularity levels: system, trace, and node. Unlike existing tools that rely on static error taxonomies or focus only on observability, it dynamically generates textual insights and integrates above the observability layer with an accessible UI. Experiments across four benchmarks and seven agentic settings demonstrate strong alignment with human-annotated errors and predictive accuracy for task success rates.
TradingAgents: Multi-Agent LLM Financial Trading Framework
TradingAgents is an open-source Python framework by TauricResearch that applies multi-agent LLM architectures to financial trading tasks. The repository has accumulated 81,650 GitHub stars with 284 added today, indicating strong community traction. It represents a concrete deployment pattern for agentic AI systems in quantitative finance.
Open-source LLMs as LangChain Agents
This Hugging Face blog post explores using open-source LLMs as agents within the LangChain framework. It examines the capability of various open-weight models to perform tool use, reasoning, and multi-step task execution in agentic settings. The post likely benchmarks or compares several models on agent-relevant tasks, providing practical guidance for deploying open-source alternatives to proprietary models in agent pipelines.
AgentSpec: A modular framework for controlled composition and analysis of embodied LLM agent scaffolds
AgentSpec is a new modular specification framework that represents embodied LLM agents as typed compositions of reusable policy components with standardized interfaces across perception, memory, reasoning, reflection, action, and learning modules. The framework enables controlled swapping and recombination of components, instantiated across four benchmarks (DeliveryBench, ALFRED, MiniGrid, RoboTHOR). Key findings include that agent performance is governed by scaffold compatibility and interaction effects rather than isolated module strength, and that RL-trained policies compose best when optimized with deployment-time scaffold structure. Code, baselines, and an interactive playground are publicly released.
Agentic LLM collectives proposed as interpretable substrates for Artificial Life research
A preprint from arXiv argues that populations of agentic LLMs — equipped with persistent memory, tools, and autonomous action — can serve as a computational substrate for Artificial Life (ALife) research. The key claim is that because agents communicate in natural language, their collective emergent behaviors are directly interpretable by examining textual traces or querying the agents themselves. The paper extends existing notions of LLM interpretability to multi-agent collectives and surveys recent examples of agentic LLM systems in both controlled and deployed settings. This positions multi-agent LLM systems as a novel lens for studying emergence and complexity while retaining interpretability.
OptiAgent: Multi-agent framework for end-to-end operations research optimization modeling
OptiAgent is a multi-agent LLM framework that converts natural language descriptions of Operations Research problems into solver-ready mathematical formulations and executable code. The architecture uses dedicated agents for extracting decision variables and constraints, with a multi-loop validation system featuring four specialized feedback mechanisms targeting distinct failure modes. The system claims state-of-the-art performance on 3 of 4 benchmarks spanning LP, MILP, and Nonlinear Programming tasks, while also improving transparency through auditable agent reasoning.
Agentopia: Long-term multi-agent life simulation framework for training LLMs on social behavior
Researchers introduce Agentopia, a framework for simulating 10 years of social life across 100 LLM-powered agents, enabling study of emergent social behaviors and long-term personal growth dynamics. The system defines a 'life reward' metric mirroring human well-being and uses it to train LLMs via rejection sampling. Training on simulated social experience yields a +15.6% improvement on downstream role-playing benchmarks, suggesting that synthetic social simulation can generalize to real capability gains.
Benchmark and study of LLM agents in deliberative multi-agent collaboration under partial observability
Researchers introduce a scalable benchmark for evaluating LLM agents on cooperative joint decision-making tasks where agents must exchange information under partial and asymmetric observations to reach a shared decision. A systematic evaluation of representative LLMs finds that state-of-the-art models still struggle with complex deliberative collaboration, failing in either information alignment or downstream reasoning even with external mathematical tools. Diagnostic analysis also reveals that deliberation can enable reflection and error correction, sometimes outperforming centralized baselines, offering a nuanced picture of multi-agent LLM capabilities.