technique
Curriculum Continuity
techniqueactiveprovisional
curriculum-continuity-9610f389·1 events·first seen 19d agoAliases: Curriculum Continuity
Co-occurring entities
More like this (12)
curriculum learningContinual Learningconsistency trainingPreserving Plasticity in Continual Learning via Dynamical IsometryConsistency Training Can Entrench MisalignmentClass-Incremental LearningContinuous-Time Consistency ModelsMultimodal Continual Instruction TuningThe Stable Recovery Manifold: Geometric Principles Governing Recoverability in Continual LearningContinueoperadic consistencyCanvas LMS
Recent events (1)
Demystifying Data Organization for Enhanced LLM Training
This Microsoft Research paper systematically investigates how data organization—distinct from data selection—affects LLM training efficiency across pre-training and SFT stages. The authors formalize four guidelines (Boundary Sharpening, Cyclic Scheduling, Curriculum Continuity, and Local Diversity) and introduce two novel data ordering methods, STR and SAW, that reuse pre-computed sample-level scores with minimal additional overhead. Experiments across multiple model scales and dataset sizes demonstrate improved training stability and performance, with code released publicly.