NOWLAB :: Publications

Journals
Conferences &
Workshops

Journals (3)
1	Q. Anthony, B. Michalowicz, J. Hatef, L. Xu, M. Abduljabbar, A. Shafi, H. Subramoni, and DK Panda, Understanding and Characterizing Communication Characteristics for Distributed Transformer Models, IEEE Micro, Jan 2025.
2	T. Tran, B. Ramesh, B. Michalowicz, M. Abduljabbar, H. Subramoni, A. Shafi, and DK Panda, Accelerating Communication with Multi-HCA Aware Collectives in MPI, Concurrency and Computation: Practice and Experience (CCPE), July 2023,
3	K. Suresh, K. Khorassani, C. Chen, B. Ramesh, M. Abduljabbar, A. Shafi, H. Subramoni, and DK Panda, Network Assisted Non-Contiguous Transfers for GPU-Aware MPI Libraries, IEEE Micro, Jan 2023.

Conferences & Workshops (21)
1	Using BlueField-3 SmartNICs to Offload Vector Operations in Krylov Subspace Methods K. Suresh, B. Michalowicz, N. Contini, B. Ramesh, M. Abduljabbar, A. Shafi, H. Subramoni, and DK Panda, 31st IEEE International Conference on High Performance Computing, Data, and Analytics, Dec 2024 [Bib - Plain]
2	Effective and Efficient Offloading Designs for One-Sided Communication to SmartNICs B. Michalowicz, K. Suresh, H. Subramoni, M. Abduljabbar, DK Panda, and S. Poole, 31st IEEE International Conference on High Performance Computing, Data, and Analytics, Dec 2024 [Bib - Plain]
3	Demystifying the Communication Characteristics for Distributed Transformer Models Q. Anthony, B. Michalowicz, J. Hatef, L. Xu, M. Abduljabbar, A. Shafi, H. Subramoni, and DK Panda, IEEE Hot Interconnects Symposium 2024, Aug 2024 [Q. Anthony and B. Michalowicz are co-lead authors] [Bib - Plain]
4	OHIO: Improving RDMA Network Scalability in MPI_Alltoall through Optimized Hierarchical and Intra/Inter-Node Communication Overlap Design T. Tran, G. Kuncham, B. Ramesh, S. Xu, H. Subramoni, M. Abduljabbar, and DK Panda, IEEE Hot Interconnects Symposium 2024, Aug 2024 [Bib - Plain]
5	OMB-CXL: A Micro-Benchmark Suite for Evaluating MPI Communication Utilizing Compute Express Link Memory Devices T. Tran, M. Abduljabbar, H. Ahn, Seonyoung Kim, Yoomi Park, Woojong Han, H. Ahn, H. Subramoni, and DK Panda, Practice and Experience in Advanced Research Computing, Jul 2024 [July 21st to July 25th, 2024 in Providence, RI.] [Bib - Plain]
6	OMB-FPGA: A Microbenchmark Suite for FPGA-aware MPIs using OpenCL and SYCL N. Contini, M. Abduljabbar, H. Subramoni, and DK Panda, Practice and Experience in Advanced Research Computing, Jul 2024 [Jul 2024] [Bib - Plain]
7	PML-MPI: A Pre-Trained ML Framework for Efficient Collective Algorithm Selection in MPI M. Han, G. Kuncham, B. Michalowicz, R. Vaidya, M. Abduljabbar, A. Shafi, H. Subramoni, and DK Panda, iWAPT '24 (IPDPSW), May 2024 [Bib - Plain]
8	HINT: Designing Cache-Efficient MPI_Alltoall using Hybrid Memory Copy Ordering and Non-Temporal Instructions B. Ramesh, N. Contini, N. Alnaasan, K. Suresh, M. Abduljabbar, A. Shafi, H. Subramoni, and DK Panda, 38th IEEE International Parallel & Distributed Processing Symposium, May 2024 [Bib - Plain]
9	Accelerating MPI AllReduce Communication with Efficient GPU-Based Compression Schemes on Modern GPU Clusters Q. Zhou, B. Ramesh, A. Shafi, M. Abduljabbar, H. Subramoni, and DK Panda, ISC HIGH PERFORMANCE 2024, May 2024 [Bib - Plain]
10	Optimized All-to-all Connection Establishment for High-Performance MPI Libraries over InifiniBand S. Xu, G. Kuncham, M. Abduljabbar, H. Subramoni, and DK Panda, 30th IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING, DATA, & ANALYTICS, Dec 2023 [Bib - Plain]
11	Designing In-network Computing Aware Reduction Collectives in MPI B. Ramesh, G. Kuncham, K. Suresh, R. Vaidya, N. Alnaasan, M. Abduljabbar, A. Shafi, and DK Panda, Hot Interconnects 2023, Aug 2023 [Bib - Plain]
12	Enabling Reconfigurable HPC through MPI-based Inter-FPGA Communication N. Contini, B. Ramesh, K. Suresh, T. Tran, B. Michalowicz, M. Abduljabbar, H. Subramoni, and DK Panda, International Conference on Supercomputing 2023, Jun 2023 [Bib - Plain]
13	MCR-DL: Mix-and-Match Communication Runtime for Deep Learning Q. Anthony, Ammar Awan, J. Rasley, Y. He, A. Shafi, M. Abduljabbar, H. Subramoni, and DK Panda, 37th IEEE International Parallel & Distributed Processing Symposium (IPDPS '23), May 2023 [Bib - Plain]
14	Accelerating Distributed Deep Learning Training with Compression Assisted Allgather and Reduce-Scatter Communication Q. Zhou, Q. Anthony, L. Xu, A. Shafi, M. Abduljabbar, H. Subramoni, and DK Panda, 37th IEEE International Parallel & Distributed Processing Symposium (IPDPS '23), May 2023 [Bib - Plain]
15	In-Depth Evaluation of a Lower-Level Direct-Verbs API on InfiniBand-based Clusters: Early Experiences B. Michalowicz, K. Suresh, B. Ramesh, A. Shafi, H. Subramoni, M. Abduljabbar, and DK Panda, 25th Workshop on Advances in Parallel and Distributed Computational Models, May 2023 [Held in conjunction with IPDPS 2023] [Bib - Plain]
16	Implementing and Optimizing a GPU-aware MPI Library for Intel GPUs: Early Experiences C. Chen, K. Khorassani, G. Kuncham, R. Vaidya, M. Abduljabbar, A. Shafi, H. Subramoni, and DK Panda, THE 23RD IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing, May 2023 [Bib - Plain]
17	Performance Characterization of using Quantization for DNN Inference on Edge Devices H. Ahn, T. Chen, N. Alnaasan, A. Shafi, M. Abduljabbar, H. Subramoni, and DK Panda, 7TH IEEE INTERNATIONAL CONFERENCE ON FOG AND EDGE COMPUTING, May 2023 [Bib - Plain]
18	Efficient Personalized and Non-Personalized Alltoall Communication for Modern Multi-HCA GPU-Based Clusters K. Suresh, A. Paniraja Guptha, B. Michalowicz, B. Ramesh, M. Abduljabbar, A. Shafi, H. Subramoni, and DK Panda, 29th IEEE International Conference on High Performance Computing, Data, and Analytics, Dec 2022 [Bib - Plain]
19	Designing Efficient Pipelined Communication Schemes using Compression in MPI Libraries B. Ramesh, Q. Zhou, A. Shafi, M. Abduljabbar, H. Subramoni, and DK Panda, 29th IEEE International Conference on High Performance Computing, Data, and Analytics, Dec 2022 [Bib - Plain]
20	Spark Meets MPI: Towards High-Performance Communication Framework for Spark using MPI K. Al Attar, A. Shafi, M. Abduljabbar, H. Subramoni, and DK Panda, IEEE Cluster '22, Sep 2022 [Bib - Plain]
21	Network-Assisted Non-Contiguous Transfers for GPU-Aware MPI Libraries K. Suresh, K. Khorassani, C. Chen, B. Ramesh, M. Abduljabbar, A. Shafi, and DK Panda, Hot Interconnects 29, Aug 2022 [Bib - Plain]

NOWLAB: Network Based Computing Lab

This page lists the publications by Mustafa Abduljabbar

Journals (3)

Conferences & Workshops (21)

Using BlueField-3 SmartNICs to Offload Vector Operations in Krylov Subspace Methods

Effective and Efficient Offloading Designs for One-Sided Communication to SmartNICs

Demystifying the Communication Characteristics for Distributed Transformer Models

OHIO: Improving RDMA Network Scalability in MPI_Alltoall through Optimized Hierarchical and Intra/Inter-Node Communication Overlap Design

OMB-CXL: A Micro-Benchmark Suite for Evaluating MPI Communication Utilizing Compute Express Link Memory Devices

OMB-FPGA: A Microbenchmark Suite for FPGA-aware MPIs using OpenCL and SYCL

PML-MPI: A Pre-Trained ML Framework for Efficient Collective Algorithm Selection in MPI

HINT: Designing Cache-Efficient MPI_Alltoall using Hybrid Memory Copy Ordering and Non-Temporal Instructions

Accelerating MPI AllReduce Communication with Efficient GPU-Based Compression Schemes on Modern GPU Clusters

Optimized All-to-all Connection Establishment for High-Performance MPI Libraries over InifiniBand

Designing In-network Computing Aware Reduction Collectives in MPI

Enabling Reconfigurable HPC through MPI-based Inter-FPGA Communication

MCR-DL: Mix-and-Match Communication Runtime for Deep Learning

Accelerating Distributed Deep Learning Training with Compression Assisted Allgather and Reduce-Scatter Communication

In-Depth Evaluation of a Lower-Level Direct-Verbs API on InfiniBand-based Clusters: Early Experiences

Implementing and Optimizing a GPU-aware MPI Library for Intel GPUs: Early Experiences

Performance Characterization of using Quantization for DNN Inference on Edge Devices

Efficient Personalized and Non-Personalized Alltoall Communication for Modern Multi-HCA GPU-Based Clusters

Designing Efficient Pipelined Communication Schemes using Compression in MPI Libraries

Spark Meets MPI: Towards High-Performance Communication Framework for Spark using MPI

Network-Assisted Non-Contiguous Transfers for GPU-Aware MPI Libraries