SUPER: SUb-Graph Parallelism for TransformERs A. Jain, T. Moon, T. Benson, H. Subramoni, S. Jacobs, D. Panda, B. Essen 35th IEEE International Parallel & Distributed Processing Symposium, May 2021.