benchmark
ATE-Bench
benchmarkactiveprovisional
ate-bench-050cbf41·1 events·first seen 16d agoAliases: ATE-Bench
Co-occurring entities
More like this (12)
Recent events (1)
PithTrain: A Compact and Agent-Native MoE Training System
PithTrain is a new MoE training framework designed around 'agent-native' principles, enabling AI coding agents to more efficiently understand, operate, and extend the framework. The authors introduce a new evaluation dimension called agent-task efficiency (ATE) and an accompanying benchmark ATE-Bench to measure the cost of using coding agents on training-framework tasks. PithTrain matches the throughput of production frameworks while achieving up to 62% fewer Agent Turns and 64% less Active GPU Time on ATE-Bench compared to existing systems.