Haitao Wu

BrainJanus: Unified autoregressive model for brain encoding/decoding across vision and language

BrainJanus is a unified model that integrates brain neural activity, vision, and language within a single autoregressive framework using next-token prediction. The system introduces a Unified Brain Tokenizer to quantize neural dynamics into discrete tokens aligned with visual and linguistic representations in a shared embedding space. It supports any-to-any generation including image-to-brain, text-to-brain, brain-to-image, and brain-to-text tasks, with reported zero-shot generalization and interpretable biological topography. The work positions itself as a general-purpose brain modeling paradigm at the intersection of neuroscience and multimodal AI.