Demystifying the Communication Characteristics for Distributed Transformer Models
Q. Anthony, B. Michalowicz, J. Hatef, L. Xu, M. Abduljabbar, A. Shafi, H. Subramoni, D. Panda
IEEE Hot Interconnects Symposium 2024,
Aug 2024.