4arXiv cs.CL (Computation and Language)·
Theoretical framework proposes native meta-architecture to replace application-layer LLM cognitive simulation
A preprint from arXiv proposes a theoretical framework for embedding cognitive architecture natively into LLMs rather than simulating it via prompt engineering and context management. The framework introduces three mechanisms: Structural Tension (an endogenous loss function from information-manifold conflict), an Offline Recurrent Loop (sandboxed self-processing without external input), and Inference-time Plasticity (topology reconfiguration without weight modification). The authors argue these mechanisms could produce heterogeneous model instances with distinct topological structures through path-dependent evolution, while remaining within governance rails. The paper is primarily theoretical, offering operational definitions, reconfiguration operators, and falsification criteria rather than empirical results.
Related guides (2)
Related events (8)
AutoMem: Automated framework trains LLMs to manage memory as a learnable cognitive skill
AutoMem is a new framework that treats memory management in LLMs as a trainable skill, using two optimization loops: one that iteratively revises memory structure via trajectory review by a strong LLM, and one that distills good memory decisions into direct training signal for the agent model. Evaluated on three long-horizon procedurally generated games (Crafter, MiniHack, NetHack), optimizing memory alone yielded 2x-4x performance improvements, bringing a 32B open-weight model competitive with frontier systems like Claude Opus 4.5 and Gemini 3.1 Pro Thinking. The work draws on cognitive science concepts of metamemory and demonstrates that memory management is an independently learnable, high-leverage capability for long-horizon agentic tasks.
Survey chapter on LLM mechanisms, emergent capabilities, and cognition debates
A new arXiv preprint surveys current understanding of large language models, covering the Transformer architecture, emergent capabilities resembling human cognition (symbolic reasoning, theory of mind, deception), and explainability approaches from neuron activation analysis to circuit tracing. The chapter also engages the debate over whether LLMs genuinely understand or merely pattern-match, arguing against reductive anti-anthropomorphism while acknowledging human-LLM differences. It is framed as a book chapter synthesizing recent empirical findings and theoretical positions.
Survey proposes four-layer architecture for token-operations-oriented LLM inference optimization
A new arXiv preprint introduces a four-layer technical architecture—Multi-model Fusion, Model Optimization, Compute-Model Fusion, and Compute-Network-Model Fusion—for systematically organizing LLM inference optimization techniques. The paper reviews key technologies and industry status at each layer and analyzes their application in real-world business scenarios. The framing around 'token operations' positions inference optimization as an operational discipline analogous to traditional IT operations.
Semantic persistence model for LLM workflows as inspectable knowledge objects
A new arXiv preprint proposes a conceptual model for treating LLM workflow components — definitions, instances, inference records, context snapshots — as persistent, inspectable knowledge objects in a shared substrate. The framework draws on Lisp-inspired ideas (symbolic forms, object identity, live-image thinking) as explanatory lenses rather than implementation commitments. A central distinction is drawn between 'derive' (deterministic computation) and 'infer' (LLM-mediated judgment under declared context), with formal transition semantics left as future work. The work addresses a gap in how agentic workflow systems represent and reason about their own execution state.
Agentic LLM collectives proposed as interpretable substrates for Artificial Life research
A preprint from arXiv argues that populations of agentic LLMs — equipped with persistent memory, tools, and autonomous action — can serve as a computational substrate for Artificial Life (ALife) research. The key claim is that because agents communicate in natural language, their collective emergent behaviors are directly interpretable by examining textual traces or querying the agents themselves. The paper extends existing notions of LLM interpretability to multi-agent collectives and surveys recent examples of agentic LLM systems in both controlled and deployed settings. This positions multi-agent LLM systems as a novel lens for studying emergence and complexity while retaining interpretability.
FluxMem: Connectivity-Evolving Memory Framework for LLM Agents
FluxMem proposes a heterogeneous graph-based memory framework for LLM agents that continuously evolves its topology through three stages: initial connection formation, feedback-driven refinement, and long-term consolidation. Unlike static memory repositories, FluxMem repairs missing links, prunes interference, aligns abstraction granularity, and distills successful trajectories into reusable procedural circuits. The system is guided by a single metric for memory generalizability and evolutionary maturity, achieving state-of-the-art results on LoCoMo, Mind2Web, and GAIA benchmarks.
Paper argues LLMs learn causal structure via difference-making logic, not Pearl/Rubin frameworks
A new arXiv preprint proposes that LLMs learn causal structure through 'variational induction' — a difference-making logic — rather than through the dominant formalisms of Judea Pearl's interventionist approach or the Neyman-Rubin potential outcomes framework. The author analyzes how this logic is realized during training and maps specific architectural features (token embeddings, self-attention) to their roles in this inductive process. The argument draws a parallel between LLM causal learning and the experimental method of systematically varying circumstances. This is a theoretical contribution to understanding how LLMs represent causal and world-model structure.
A Methodology for Selecting and Composing Runtime Architecture Patterns for Production LLM Agents
This paper introduces the stochastic-deterministic boundary (SDB) as a foundational architectural primitive for production LLM agent runtimes, defining it as a four-part contract (proposer, verifier, commit step, reject signal) governing how LLM outputs become system actions. The authors organize agent runtime design around Coordination, State, and Control concerns, presenting a catalog of six runtime patterns applicable to conversational, autonomous, and long-horizon agents. A five-step pattern-selection methodology and diagnostic procedure mapping production failures to pattern weaknesses are contributed, along with a newly named failure mode—replay divergence—where LLM consumers of deterministic event logs produce inconsistent outputs across model versions or prompt changes. The paper argues that as model variance decreases, architectural pattern choice and SDB strength become the dominant reliability levers.