5arXiv cs.CL (Computation and Language)·
LightMem-Ego: Lightweight streaming multimodal memory system for egocentric AI assistants
Researchers from Zhejiang University NLP Lab introduce LightMem-Ego, a lightweight multimodal memory system designed for mobile and wearable AI assistants. The system continuously ingests egocentric visual and audio streams, organizes them into a hierarchical three-tier memory (current, short-term, long-term), and routes retrieval dynamically based on user queries. It targets practical deployment on smartphones and AI glasses for tasks like object finding, conversation recall, and routine discovery, with code released publicly.
Related guides (3)
Related events (8)
VisualMem: Personal Visual Memory Benchmark and Architecture for Personalized AI Agents
This paper introduces a benchmark and hybrid architecture (VisualMem) for personal visual memory in long-term AI agent memory systems. The work addresses a gap in existing text-centric memory systems by capturing both explicit evidence (recurring user-associated entities) and implicit evidence (latent user facts from visual/multimodal cues) from images. VisualMem augments a text-memory backend with a structured personal visual memory module that uses conversational context to resolve identity, ownership, and durable user facts. Experiments show VisualMem substantially outperforms prior memory systems on the new benchmark while remaining competitive on standard text-memory benchmarks.
Cognitive-structured Multimodal Agent with Episodic Visual Memory for long-horizon dialogue
Researchers propose a Cognitive-structured Multimodal Agent (CMA) that externalizes visual context into an Episodic Visual Memory to avoid token explosion in long multimodal dialogues. The architecture includes a Perceptual Abstraction Engine, Cognitive Retrieval Engine, and Multimodal Executive Controller, trained with reinforcement learning on a synthetically generated multi-turn dataset. An 8B parameter agent achieves 91.4% retrieval accuracy over 20-turn sessions, outperforming 32B baselines by 8.2% while nearly halving inference time. The authors also release CMA-Harness, a tool-augmented deployment integrating persistent memory, web access, and image generation tools with OpenAI-compatible serving.
MemOS: Self-Evolving Memory OS for LLM Agents with Hybrid Retrieval and Token Savings
MemOS is an open-source TypeScript project providing a memory operating system layer for LLM and AI agents, featuring ultra-persistent memory, hybrid retrieval, and cross-task skill reuse. The project claims 35.24% token savings through its memory management approach. It has accumulated 9,329 GitHub stars with moderate daily momentum (+67). The system targets agent memory persistence and efficiency as a foundational infrastructure component.
IMLogic benchmark and RootMem framework target implicit logical memory retrieval for personalized LLMs
Researchers introduce IMLogic, a benchmark for evaluating implicit logical memory retrieval in long-dialogue personalized LLM scenarios, addressing gaps in existing semantic-similarity-based retrieval methods. They also propose RootMem, a plug-and-play framework that distills user histories into structured 'root memories' and uses an LLM-based router to activate logically relevant memories alongside semantic retrieval. Experiments show RootMem outperforms retrieval baselines and improves existing memory agents. The work targets a concrete weakness in current personalized LLM memory systems where logically critical memories lack semantic overlap with queries.
MemDreamer: Hierarchical graph memory and agentic retrieval for long video understanding
MemDreamer is a plug-and-play framework that decouples perception and reasoning for long-video understanding by incrementally building a three-tier Hierarchical Graph Memory capturing spatiotemporal and causal relations. During inference, a reasoning model uses an Observation-Reason-Action loop with agentic tool-augmented retrieval to navigate the memory graph, constraining the context window to 2% of full-context ingestion while achieving a 12.5-point absolute accuracy gain. The system reaches SOTA on four benchmarks, narrowing the gap with human experts to 3.7 points. The authors also report a strong linear correlation between logical reasoning performance and long-video understanding, proposing agentic capability scaling as a new paradigm for multimodal comprehension.
ManimAgent: Self-evolving multimodal agent with cross-task episodic memory for code generation
ManimAgent is a multimodal agent system that accumulates reflection experience across tasks via a dual-channel Episodic Memory Bank, without weight updates or human-curated seeds. The agent generates Python/Manim animations from scientific paper sections, and a vision-language model scores rendered keyframes to populate positive (success rationales) and negative (failure patterns) memory channels. On a fixed-probe evaluation, Pass@1 improves and reflection rounds decrease as memory grows, outperforming no-memory, RAG, and shuffled-memory baselines. The work addresses a known limitation of single-episode reflection in LLM agents by enabling persistent, self-generated learning across task boundaries.
Mem-π: Adaptive Memory for LLM Agents via On-Demand Generation and Decoupled RL
Mem-π introduces a framework where a dedicated language or vision-language model generates context-specific guidance for LLM agents on demand, rather than retrieving static entries from episodic memory banks. The system is trained with a decision-content decoupled reinforcement learning objective that jointly learns when to generate guidance and what to generate, enabling abstention when generation would not help. Evaluated across web navigation, terminal-based tool use, and text-based embodied interaction benchmarks, Mem-π achieves over 30% relative improvement on web navigation tasks compared to retrieval-based and prior RL-optimized memory baselines.
Mistral Launches Le Chat Memory (Beta) with Transparency and User-Control Design Principles
Mistral AI has released a beta memory system for its Le Chat assistant, featuring automatic storage with smart, visible recall and source citations. The system is built around three principles—transparency, agency, and sovereignty—allowing users to view, edit, delete, export, and import memories. Under the hood, Mistral uses a graph-based architecture to improve context-awareness over time. A companion feature called Memory Insights surfaces trends and summaries derived from a user's stored data.