technique

Modal-Aware Rotary Positional Embedding

techniqueactiveprovisionalmodal-aware-rotary-positional-embedding-7b0c6081·1 events·first seen 15h ago

Aliases: Modal-Aware Rotary Positional Embedding

Co-occurring entities

Sparse-structure Multimodal Diffusion Transformer FLUX3D Diffusion-Aligned Structured Latents

More like this (12)

Rotary Position Embedding (RoPE)Surface-Anchored Position Embedding Positional Encoding embedding models multimodal embedding instruction embedding models Instructional Segment Embeddings Geometric Action Model for Robot Policy Learning Joint Embedding Predictive Architecture (JEPA)static embeddings Modal LCO-Embedding

Recent events (1)

5arXiv · cs.AI·15h ago·source ↗

FLUX3D: Diffusion-aligned sparse representation for high-fidelity image-to-3D Gaussian Splatting

Researchers introduce FLUX3D, an image-to-3D Gaussian Splatting framework that addresses two structural bottlenecks in sparse voxel-based 3D generation: a representation bottleneck from discriminative 2D features and a cross-modal correspondence bottleneck in diffusion transformers. The system introduces Diffusion-Aligned Structured Latents (DA-SLAT) and a Sparse-structure Multimodal Diffusion Transformer (SMDiT) with Modal-Aware Rotary Positional Embedding (MARoPE) to improve 2D-3D alignment. Benchmark results claim substantial improvements in appearance fidelity over all current state-of-the-art methods for 3DGS asset generation.

Multimodal Progress Sparse-structure Multimodal Diffusion Transformer FLUX3D Diffusion-Aligned Structured Latents +1 more