Entity · paper

Online Neural Space Time Memory for Dynamic Novel View Synthesis

paperactiveprovisionalonline-neural-space-time-memory-for-dynamic-novel-view-synthesis-eef113b5·1 events·first seen 4d ago

Aliases: Online Neural Space Time Memory for Dynamic Novel View Synthesis

Co-occurring entities

test-time training

More like this (12)

novel view synthesis Neural Surrogate Models Graph Neural Network Encoder AdaJEPA: An Adaptive Latent World Model Dynamic Time Warping TempoVLA: Learning Speed-Controllable Vision-Language-Action Policies EvolveNav: Proactive Preflection and Self-Evolving Memory for Zero-Shot Object Goal Navigation neural-ODE temporal decay Controllable Neural Variational Agents Modeling Complex Behaviors: Multi-Personality Composition and Dynamic Switching in Vision-Language Models FlashbackCL: Mitigating Temporal Forgetting in Federated Learning Latent Memory Palace: Reasoning for Control as Autoregressive Variational Inference

Recent events (1)

4arXiv · cs.LG·4d ago·source ↗

Online Neural Space-Time Memory enables real-time dynamic novel view synthesis from streaming video

A new arXiv preprint proposes a neural memory architecture for real-time novel view synthesis from multi-view streaming video of dynamic scenes. The method decouples memory update frequency from memory application frequency, using periodic gradient-based updates with per-frame cross-view attention to handle deformations. Two mechanisms — an auxiliary Memory Loss and a Memory Caching strategy — prevent catastrophic forgetting over long contexts. The approach achieves state-of-the-art performance on dynamic human motion scenes with minute-scale online memorization at real-time speeds.

Multimodal Progress test-time training Online Neural Space Time Memory for Dynamic Novel View Synthesis