dgx-spark-8bf86115·2 events·first seen Aliases: DGX Spark
Researchers introduce execution-state capsules, a checkpoint-and-restore mechanism that snapshots the complete execution state (KV cache, recurrent state, convolution state, MTP state, and metadata) at graph boundaries rather than managing only KV fragments. The FlashRT runtime implements this on NVIDIA CUDA with sub-millisecond GPU-resident snapshot/restore, achieving TTFT speedups of 3.9x at 2k tokens and 27x at 16k tokens over cold prefill on an RTX 5090. The work targets low-latency, small-batch, on-device physical-AI scenarios—interactive agents, speech systems, robot policies—where branching, rollback, and re-entry are common. This is positioned as complementary to, not a replacement for, high-throughput KV-cache serving.
NVIDIA is integrating its DGX Spark computing platform with the Reachy Mini robot to enable embodied AI agents. The collaboration, highlighted on the Hugging Face blog, demonstrates running agent workloads on edge hardware for robotics applications. This represents a convergence of NVIDIA's inference infrastructure with open robotics platforms.