Scaling Large Language Model Training on Frontier with Low-Bandwidth Partitioning
L. Xu, Q. Anthony, J. Hatef, A. Shafi, H. Subramoni, D. Panda
31st IEEE International Conference on High Performance Computing, Data, and Analytics,
Dec 2024.