NOWLAB :: Publications

This page lists the publications by Arpan Jain

Journals
Conferences &
Workshops

Journals (2)
1	A. Jain, N. Alnaasan, A. Shafi, H. Subramoni, and DK Panda, Optimizing Distributed DNN Training using CPUs and BlueField-2 DPUs , IEEE Micro, doi: 10.1109/MM.2021.3139027 , .
2	Ammar Awan, A. Jain, C. Chu, H. Subramoni, and DK Panda, Communication Profiling and Characterization of Deep Learning Workloads on Clusters with High-Performance Interconnects , IEEE Micro, vol. 40, no. 1, pp. 35-43, 1 Jan.-Feb. 2020. , .

Conferences & Workshops (15)
1	AccDP: Accelerated Data-Parallel Distributed DNN Training for Modern GPU-Based HPC Clusters N. Alnaasan , A. Jain , A. Shafi , H. Subramoni , and DK Panda 29th IEEE International Conference on High Performance Computing, Data, and Analytics, Dec 2022 [Bib - Plain]
2	OMB-Py: Python Micro-Benchmarks for Evaluating Performance of MPI Libraries on HPC Systems N. Alnaasan , A. Jain , A. Shafi , H. Subramoni , and DK Panda 23rd Parallel and Distributed Scientific and Engineering Computing Workshop (PDSEC) at IPDPS22, May 2022 [Bib - Plain]
3	Hy-Fi: Hybrid Five-Dimensional Parallel DNN Training on High-Performance GPU Clusters A. Jain , A. Shafi , Q. Anthony , P. Kousha , H. Subramoni , and DK Panda ISC HIGH PERFORMANCE 2022, May 2022 [Bib - Plain]
4	"Hey CAI" - Enhancing User Productivity through a Conversational AI Enabled User Interface for HPC Tools P. Kousha , A. Jain , A. Kolli , S. Prasanna , S. Miriyala , H. Subramoni , A. Shafi , and DK Panda ISC HIGH PERFORMANCE 2022, May 2022 [Bib - Plain]
5	OMB-Py: Python Micro-Benchmarks for Evaluating Performance of MPI Libraries and Machine Learning Applications on HPC Systems N. Alnaasan , A. Jain , A. Shafi , H. Subramoni , and DK Panda ISC HIGH PERFORMANCE 2022, May 2022 [Research Poster] [Best Poster Award] [Bib - Plain]
6	Accelerating CPU-based Distributed DNN Training on Modern HPC Clusters using BlueField-2 DPUs A. Jain , N. Alnaasan , A. Shafi , H. Subramoni , and DK Panda 28th IEEE Hot Interconnects, Aug 2021 [Bib - Plain]
7	INAM: Cross-stack Profiling and Analysis of Communication in MPI-based Applications P. Kousha , Kamal Raj Sankarapandian Dayala Ganesh Ram , M. Kedia , H. Subramoni , A. Jain , A. Shafi , DK Panda , Trey Dockendorf , Heechang Na , and K. Tomko Practice and Experience in Advanced Research Computing 2021, Jul 2021 [Bib - Plain]
8	SUPER: SUb-Graph Parallelism for TransformERs A. Jain , T. Moon , T. Benson , H. Subramoni , S. Jacobs , DK Panda , and B. Essen 35th IEEE International Parallel & Distributed Processing Symposium, May 2021 [Bib - Plain]
9	GEMS: GPU Enabled Memory Aware Model Parallelism System for Distributed DNN Training A. Jain , Ammar Awan , A. Aljuhani , J. Hashmi , Q. Anthony , H. Subramoni , DK Panda , R. Machiraju , and A. Parwani SC 2020, Nov 2020 [Bib - Plain]
10	HyPar-Flow: Exploiting MPI and Keras for Scalable Hybrid-Parallel DNN Training with TensorFlow Ammar Awan , A. Jain , Q. Anthony , H. Subramoni , and DK Panda ISC HIGH PERFORMANCE 2020, Jun 2020 [Bib - Plain]
11	Efficient Training of Semantic Image Segmentation on Summit using Horovod and MVAPICH2-GDR Q. Anthony , Ammar Awan , A. Jain , H. Subramoni , and DK Panda Scalable Deep Learning over Parallel and Distributed Infrastructures (ScaDL) at IPDPS '20, May 2020 [Bib - Plain]
12	Designing a Profiling and Visualization Tool for Scalable and In-Depth Analysis of High-Performance GPU Clusters P. Kousha , B. Ramesh , K. Suresh , C. Chu , A. Jain , N. Sarkauskas , H. Subramoni , and DK Panda 26th IEEE International Conference on High Performance Computing, Data, Analytics and Data Science, Dec 2019 [Bib - Plain]
13	Scaling TensorFlow, PyTorch, and MXNet using MVAPICH2 for High-Performance Deep Learning on Frontera A. Jain , Ammar Awan , H. Subramoni , and DK Panda 3rd Deep Learning on Supercomputers Workshop (DLS) at SC19, Nov 2019 [Bib - Plain]
14	Performance Characterization of DNN Training using TensorFlow and PyTorch on Modern Clusters A. Jain , Ammar Awan , Q. Anthony , H. Subramoni , and DK Panda 21st IEEE International Conference on Cluster Computing, Sep 2019 [Bib - Plain]
15	Communication Profiling and Characterization of Deep-Learning Workloads on Clusters With High-Performance Interconnects Ammar Awan , A. Jain , C. Chu , H. Subramoni , and DK Panda 26th Symposium on High-Performance Interconnects (HotI '19), Aug 2019 [Bib - Plain]