MTraining: Distributed Dynamic Sparse Attention for Efficient Ultra-Long Context Training
Published in Proceedings of Machine Learning and Systems (MLSys), 2026
Publications
You can also find my articles on my Google Scholar profile.
Conference Papers
Preprints
Navigating in High-Dimensional Search Space: A Hierarchical Bayesian Optimization Approach
Published in arXiv preprint arXiv:2410.23148, 2024