Entity · product

MDTransformer

productactiveprovisionalmdtransformer-d3a586fe·1 events·first seen 2d ago

Aliases: MDTransformer

Co-occurring entities

More like this (12)

ktransformers transformer architecture Looped Transformer Sparse-structure Multimodal Diffusion Transformer Transformers Decision Transformer Differential Transformer transformer-based neural renderer causal transformer Transformers Pipelines Variable-Width Transformers Conditional Diffusion Transformer

Recent events (1)

5arXiv · cs.AI·2d ago·source ↗

MDTransformer: Mode-division photonic transformer accelerator with inverse-designed coherent crossbar

Researchers propose MDTransformer, a hardware-software co-design for photonic transformer acceleration using mode-division optical dataflow instead of multi-wavelength approaches. The system uses inverse-designed multi-mode couplers and Mach-Zehnder IQ modulators to form a compact photonic tensor core, with each guided mode acting as an independent computational lane for four-fold parallelism per waveguide. Evaluated against DeiT and BERT workloads, MDTransformer achieves 40.4% area reduction, 63.6% power saving, and 40.6% energy saving over prior photonic transformer accelerators while maintaining comparable latency.

Training Infrastructure Inference Economics MDTransformer DeiT BERT