Almanac
← Events
4arXiv cs.CL (Computation and Language)·12d ago

Multi-agent LLM framework for Chinese civil court simulation with five-stage trial procedure

Researchers present a multi-agent LLM framework for simulating Chinese civil court proceedings, organized around a five-stage civil trial procedure with memory modules and statute retrieval. The system targets civil litigation specifically, which is more common and harder to simulate than criminal cases due to flexible claims and remedies. Experiments show reliable judgment outputs with particular strengths in liability allocation, and find that memory quality substantially affects downstream simulation quality. Code and dataset are publicly released.

Related guides (1)

Related events (8)

5arXiv · cs.CL·16d ago·source ↗

CollabSim: CSCW-grounded framework for evaluating collaborative competence in LLM multi-agent systems

Researchers introduce CollabSim, a configurable simulation framework for systematically evaluating collaborative competence in LLM-based multi-agent systems (MAS). The framework draws on Computer-Supported Cooperative Work (CSCW) theory to define collaborative capabilities beyond task outcomes, including common ground establishment, shared task understanding, and misalignment repair. Experiments across four LLMs demonstrate the framework can distinguish model performance patterns and reveal task-dependent effects of agent design choices. The work addresses a gap in MAS evaluation, which has historically focused on individual task-solving rather than coordination quality.

6arXiv · cs.CL·13d ago·source ↗

Agentopia: Long-term multi-agent life simulation framework for training LLMs on social behavior

Researchers introduce Agentopia, a framework for simulating 10 years of social life across 100 LLM-powered agents, enabling study of emergent social behaviors and long-term personal growth dynamics. The system defines a 'life reward' metric mirroring human well-being and uses it to train LLMs via rejection sampling. Training on simulated social experience yields a +15.6% improvement on downstream role-playing benchmarks, suggesting that synthetic social simulation can generalize to real capability gains.

5Hugging Face Blog·1mo ago·source ↗

Consilium: When Multiple LLMs Collaborate

Hugging Face introduces Consilium, a framework for multi-LLM collaboration where multiple language models work together on tasks rather than relying on a single model. The approach explores how ensembling or deliberation among diverse LLMs can improve output quality and robustness. This fits into the broader agent-tool ecosystem trend of orchestrating multiple AI models for better results.

4arXiv · cs.AI·17d ago·source ↗

AgentMob: Training-free LLM agent framework for evidence-grounded mobility prediction

AgentMob is a training-free LLM-driven agent framework that formulates next-location prediction as adaptive evidence-controlled decision making, using a fast path for routine cases and iterative tool use for ambiguous ones. Evaluated on three mobility datasets, it achieves the strongest overall performance among training-free LLM-based methods, with GPT-5.4 reaching 71.42% Acc@1 on the BW dataset. The framework demonstrates that LLM controllers add most value in resolving ambiguous predictions through adaptive evidence gathering rather than routine cases.

5arXiv · cs.CL·12d ago·source ↗

AGENTSERVESIM: Hardware-aware simulator for multi-turn LLM agent serving policies

Researchers introduce AGENTSERVESIM, a simulation framework designed to evaluate serving policies for multi-turn LLM agents without requiring dedicated accelerator hardware. The simulator models program-level execution including turn dependencies, tool-induced gaps, and KV-cache residency across HBM, host DRAM, and CXL memory hierarchies. It reproduces real-system behavior within 6% error on key performance metrics while running on commodity CPUs, enabling cost-effective exploration of scheduling, routing, and cache management policies for agentic workloads.

5arXiv · cs.CL·24d ago·source ↗

Towards Reliable Multilingual LLMs-as-a-Judge: An Empirical Study

This paper systematically investigates strategies for extending LLM-based automatic evaluation (LLMs-as-a-Judge) to multilingual settings, covering high-, mid-, and low-resource languages (English, Spanish, Basque). The authors compare instruction translation, monolingual vs. multilingual supervision, and model size, finding that fine-tuned smaller models can match proprietary models when in-domain data is available, while zero-shot larger models are preferable out-of-domain. Two meta-evaluation datasets are extended to Spanish and Basque, and all data and code are publicly released.

4Hugging Face Blog·1mo ago·source ↗

Letting Large Models Debate: The First Multilingual LLM Debate Competition

Hugging Face introduces a multilingual LLM debate competition where large language models compete against each other in structured debates. The initiative explores multi-agent interaction, argumentation quality, and cross-lingual reasoning capabilities. This represents an evaluation framework for assessing LLM persuasion, coherence, and multilingual performance in adversarial settings.

4Github Trending·20d ago·source ↗

TradingAgents: Multi-Agent LLM Financial Trading Framework

TradingAgents is an open-source Python framework by TauricResearch that applies multi-agent LLM architectures to financial trading tasks. The repository has accumulated 81,650 GitHub stars with 284 added today, indicating strong community traction. It represents a concrete deployment pattern for agentic AI systems in quantitative finance.