technique
Layer-Adaptive Expert Pruning
techniqueactiveprovisional
layer-adaptive-expert-pruning-4426578c·1 events·first seen 14d agoAliases: Layer-Adaptive Expert Pruning
Co-occurring entities
More like this (12)
layer pruningdepth pruningTying the Loop -- Tied Expert Layers in Mixture-of-Experts Language ModelsSparse Subspace-to-Expert Sharing for Task-Agnostic Continual LearningParameter-Efficient Fine-TuningIterative Skill-Aware Decompositionadversarial refinementPreference-Aware Rubric LearningObserve-and-Act Adaptive Context SelectionAdaptive Multi-Resolution Procedural Knowledge Compression for Large Language ModelsRedesign Mixture-of-Experts Routers with Manifold Power IterationPersona-Pruner
Recent events (1)
Data Points: GPT-5.4 Pro, Luma Uni-1, Phi-4-reasoning-vision-15B, Yuan 3.0 Ultra, OpenAI hardware chief resignation
The Batch's weekly roundup covers several significant AI developments: OpenAI released GPT-5.4 and GPT-5.4 Pro with computer-use agent capabilities, 1M token context, and strong benchmark gains on GDPval and OSWorld-Verified; Luma AI released Uni-1, a unified autoregressive model for visual understanding and generation; Microsoft released Phi-4-reasoning-vision-15B, an open-weights multimodal model trained on 200B tokens; Yuan Lab AI released Yuan 3.0 Ultra, a 1T-parameter MoE model with SOTA on document retrieval benchmarks. Additionally, OpenAI hardware chief Caitlin Kalinowski resigned over the company's Pentagon deal, citing concerns about surveillance and autonomous weapons governance.