NOWLAB :: Publications

Jinghan Yao

This page lists the publications by Jinghan Yao

Conferences &
Workshops

Conferences & Workshops (11)
1	From Skew to Symmetry: Node-Interconnect Multi-Path Balancing with Execution-time Planning for Modern GPU Clusters J. Yao, K. Suresh, B. Ramesh, H. Subramoni, and DK Panda, 40th IEEE International Parallel & Distributed Processing Symposium, May 2026 [Bib - Plain]
2	MAC-Attention: a Match-Amend-Complete Scheme for Fast and Accurate Attention Computation J. Yao, S. Jacobs, W. Krichene, M. Tanaka, and DK Panda, Ninth Annual Conference on Machine Learning and Systems, MLSys 26, May 2026 [Bib - Plain]
3	Design and Optimization of GPU-Aware MPI Allreduce Using Direct Sendrecv Communication C. Chen, J. Yao, H. Subramoni, and DK Panda, NVIDIA GTC AI Conference 2026, Mar 2026 [Research Poster] [Bib - Plain]
4	Design and Optimization of GPU-Aware MPI Allreduce Using Direct Sendrecv Communication C. Chen, J. Yao, H. Subramoni, and DK Panda, 54th International Conference on Parallel Processing, Sep 2025 [Bib - Plain]
5	Unified Designs of Multi-rail-aware MPI Allreduce and Alltoall Operations Across Diverse GPU and Interconnect Systems C. Chen, J. Yao, L. Xu, H. Subramoni, and DK Panda, 39th IEEE International Parallel & Distributed Processing Symposium, Jun 2025 [Bib - Plain]
6	Training ultra long context language model with fully pipelined distributed transformer J. Yao, S. Jacobs, M. Tanaka, O. Ruwase, H. Subramoni, and DK Panda, The Eighth Annual Conference on Machine Learning and Systems, May 2025 [Bib - Plain]
7	HyperSack: Distributed Hyperparameter Optimization for Deep Learning using Resource-Aware Scheduling on Heterogeneous GPU Systems N. Alnaasan, B. Ramesh, J. Yao, A. Shafi, H. Subramoni, and DK Panda, 31st IEEE International Conference on High Performance Computing, Data, and Analytics, Dec 2024 [Bib - Plain]
8	Exploiting Inter-Layer Expert Affinity for Accelerating Mixture-of-Experts Model Inference J. Yao, Q. Anthony, A. Shafi, H. Subramoni, and DK Panda, 38th IEEE International Parallel & Distributed Processing Symposium, May 2024 [Bib - Plain]
9	Flover: A Temporal Fusion Framework for Efficient Autoregressive Model Parallel Inference J. Yao, N. Alnaasan, T. Chen, A. Shafi, H. Subramoni, and DK Panda, 30th IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING, DATA, & ANALYTICS, Dec 2023 [Bib - Plain]
10	MPI-xCCL: A Portable MPI Library over Collective Communication Libraries for Various Accelerators C. Chen, K. Khorassani, P. Kousha, Q. Zhou, J. Yao, H. Subramoni, and DK Panda, Sixth Annual Workshop on Emerging Parallel and Distributed Runtime Systems and Middleware, Nov 2023 [Bib - Plain]
11	A Novel Framework for Efficient Offloading of Communication Operations to Bluefield SmartNICs K. Suresh, B. Michalowicz, B. Ramesh, N. Contini, J. Yao, S. Xu, A. Shafi, H. Subramoni, and DK Panda, 37th IEEE International Parallel & Distributed Processing Symposium (IPDPS '23), May 2023 [Bib - Plain]