MTraining: Distributed Dynamic Sparse Attention for Efficient Ultra-Long Context Training

Wenxuan Li*, Chengruidong Zhang*, Huiqiang Jiang*, Yucheng Li, Yuqing Yang, Lili Qiu

Published in Proceedings of Machine Learning and Systems (MLSys), 2026