Hy-Fi: Hybrid Five-Dimensional Parallel DNN Training on High-Performance GPU Clusters
A. Jain, A. Shafi, Q. Anthony, P. Kousha, H. Subramoni, D. Panda
ISC HIGH PERFORMANCE 2022,
May 2022.