SciDAC-4
Researchers from PAR are engaged in a number of activities in the Scientific Discovery through Advanced Computing (SciDAC) initiative. The SciDAC program was initiated in 2001 in order to develop the Scientific Computing Software and Hardware Infrastructure needed to advance scientific discovery using supercomputers. As supercomputers continuously evolve, direct engagement of computer scientists and applied mathematicians with the scientists of targeted application domains becomes ever more necessary for taking full advantage of these new systems. In this regard, SciDAC is a partnership involving all of the Department of Energy (DOE) Office of Science (SC) programs - Advanced Scientific Computing Research (ASCR), Basic Energy Sciences (BES), Biological and Environmental Research (BER), Fusion Energy Sciences (FES), High-Energy Physics (HEP) and Nuclear Physics (NP) - to dramatically accelerate progress in scientific computing that delivers breakthrough scientific results through partnerships comprised of applied mathematicians, computer scientists, and scientists from other disciplines.
Researchers within PAR engage in computer science research covering Performance Modeling, Machine Learning, Communication Runtimes as well as performance optimization of various SciDAC applications.
Researchers
- Leonid Oliker (PI and RAPIDS Deputy Director)
- Aydin Buluç
- Nan Ding
- Costin Iancu
- Khaled Ibrahim
- Oguz Selvitopi
- Hongzhan Shan
- Samuel Williams
Projects
- RAPIDS CS/Data Institute
- Roofline, a visually-intuitive performance model for multicore, manycore, and accelerated systems
- Catalysis BES Partnership
- Center for Tokamak Transient Simulation (CTTS) FES Partnership
- Integrated Simulation of Energetic Particles (ISEP) FES Partnership
Publications
2022
K. Ibrahim, L. Oliker,, "Preprocessing Pipeline Optimization for Scientific Deep-Learning Workloads", IPDPS 22, June 3, 2022,
- Download File: SciML-optimization-12.pdf (pdf: 17 MB)
2021
Nan Ding, Yang Liu, Samuel Williams, Xiaoye S. Li, "A Message-Driven, Multi-GPU Parallel Sparse Triangular Solver", SIAM Conference on Applied and Computational Discrete Algorithms (ACDA21), July 19, 2021,
- Download File: Multi-GPU-SpTRSV-ACDA21-.pdf (pdf: 897 KB)
Charlene Yang, Yunsong Wang, Thorsten Kurth, Steven Farrell, Samuel Williams, "Hierarchical Roofline Performance Analysis for Deep Learning Applications", Intelligent Computing, LNNS, July 15, 2021, doi: 10.1007/978-3-030-80126-7
Khaled Ibrahim, Roofline on GPUs (advanced topics), ECP Annual Meeting, April 2021,
- Download File: ECP21-Roofline-6-advanced.pdf (pdf: 15 MB)
Samuel Williams, Roofline Analysis on NVIDIA GPUs, ECP Annual Meeting, April 2021,
- Download File: ECP21-Roofline-2-NVIDIA.pdf (pdf: 14 MB)
Samuel Williams, Introduction to the Roofline Model, ECP Annual Meeting, April 2021,
- Download File: ECP21-Roofline-1-intro.pdf (pdf: 22 MB)
2020
Yunsong Wang, Charlene Yang, Steven Farrell, Yan Zhang, Thorsten Kurth, Samuel Williams, "Time-Based Roofline for Deep Learning Performance Analysis", Deep Learning on Supercomputing (DLonSC), November 2020,
- Download File: DLonSC20-TimeRoofline-final.pdf (pdf: 534 KB)
Samuel Williams, Introduction to the Roofline Model, Supercomputing (SC), November 2020,
- Download File: 2020.11.09-1005-tut108-Tutorial-Williams-Samuel.pdf (pdf: 25 MB)
Samuel Williams, The Roofline Model: A Bridge between Computer Science, Applied Math, and Computational Science, SciDAC Meeting, July 2020,
- Download File: SciDAC20-Roofline-SWWilliams.pdf (pdf: 13 MB)
Samuel Williams, Introduction to the Roofline Model, NERSC NVIDIA Roofline Hackathon, July 2020,
- Download File: NVIDIA-Roofline-intro.pdf (pdf: 33 MB)
Jonathan R Madsen, Muaaz G Awan, Hugo Brunie, Jack Deslippe, Rahul Gayatri, Leonid Oliker, Yunsong Wang, Charlene Yang, Samuel Williams, "TiMemory: Modular Performance Analysis for HPC", International Supercomputing Conference (ISC), June 2020, doi: 10.1007/978-3-030-50743-5_22
Samuel Williams, Charlene Yang, Yunsong Wang, Roofline Performance Modeling for HPC and Deep Learning Applications, NVIDIA GPU Technology Conference (GTC), March 2020,
- Download File: S21565-Roofline-1-Intro.pdf (pdf: 22 MB)
Nan Ding, Samuel Williams, Yang Liu, Xiaoye S. Li, "Leveraging One-Sided Communication for Sparse Triangular Solvers", 2020 SIAM Conference on Parallel Processing for Scientific Computing, February 14, 2020,
- Download File: One-side-SPTRS-SIAM-PP20-.pdf (pdf: 2.9 MB)
Jack Deslippe, Guiding Optimization with the Roofline Model, ECP Annual Meeting, February 2020,
- Download File: ECP20-Roofline-5-CaseStudies-Conclusions.pdf (pdf: 62 MB)
Charlene Yang, Hierarchical Roofline Analysis on CPUs, ECP Annual Meeting, February 2020,
- Download File: ECP20-Roofline-4-cpu.pdf (pdf: 26 MB)
Samuel Williams, Roofline on GPUs (Advanced Topics), ECP Annual Meeting, February 2020,
- Download File: ECP20-Roofline-3-advanced-gpu.pdf (pdf: 18 MB)
Charlene Yang, Hierarchical Roofline Analysis on GPUs, ECP Annual Meeting, February 2020,
- Download File: ECP20-Roofline-2-gpu.pdf (pdf: 38 MB)
Samuel Williams, Introduction to the Roofline Model, ECP Annual Meeting, February 2020,
- Download File: ECP20-Roofline-1-intro.pdf (pdf: 24 MB)
2019
Nan Ding, Samuel Williams, "An Instruction Roofline Model for GPUs", Performance Modeling, Benchmarking, and Simulation (PMBS), BEST PAPER AWARD, November 18, 2019,
- Download File: InstructionRooflineModel-PMBS19-.pdf (pdf: 970 KB)
Nan Ding, Samuel Williams, An Instruction Roofline Model for GPUs, Performance Modeling, Benchmarking, and Simulation (PMBS), BEST PAPER AWARD, November 18, 2019,
- Download File: PMBS19-InstructionRoofline-1-NanDing.pdf (pdf: 6.3 MB)
Khaled Ibrahim, Samuel Williams, Leonid Oliker, "Performance Analysis of GPU Programming Models using the Roofline Scaling Trajectories", International Symposium on Benchmarking, Measuring and Optimizing (Bench), BEST PAPER AWARD, November 2019,
Nan Ding, Samuel Williams, Sherry Li, Yang Liu, "Leveraging One-Sided Communication for Sparse Triangular Solvers", SciDAC19, July 18, 2019,
- Download File: SciDAC19-Poster-SpTRSV-NanDing.pdf (pdf: 774 KB)
Samuel Williams, Charlene Yang, Khaled Ibrahim, Thorsten Kurth, Nan Ding, Jack Deslippe, Leonid Oliker, "Performance Analysis using the Roofline Model", SciDAC PI Meeting, July 2019,
- Download File: SciDAC19-Poster-Roofline-SWWilliams.pdf (pdf: 4.9 MB)
Charlene Yang, Thorsten Kurth, Samuel Williams, "Hierarchical Roofline Analysis for GPUs: Accelerating Performance Optimization for the NERSC-9 Perlmutter System", Cray User Group (CUG), May 2019,
- Download File: cug19-roofline-final.pdf (pdf: 493 KB)
Charlene Yang, Samuel Williams, Performance Analysis of GPU-Accelerated Applications using the Roofline Model, GPU Technology Conference (GTC), March 2019,
- Download File: GTC19-Roofline.pdf (pdf: 73 MB)
Samuel Williams, Performance Modeling and Analysis, CS267 Lecture, University of California at Berkeley, February 14, 2019,
- Download File: CS267-2019-Roofline-SWWilliams.pptx (pptx: 15 MB)
- Download File: CS267-2019-Roofline-SWWilliams.pdf (pdf: 35 MB)
Charlene Yang, Performance Analysis with Roofline on GPUs, Roofline Tutorial, ECP Annual Meeting, January 2019,
- Download File: ECP19-Roofline-2-gpu.pdf (pdf: 6.8 MB)
Samuel Williams, Roofline on CPU-based Systems, Roofline Tutorial, ECP Annual Meeting, January 2019,
- Download File: ECP19-Roofline-3-cpu.pdf (pdf: 26 MB)
Samuel Williams, Introduction to the Roofline Model, Roofline Tutorial, ECP Annual Meeting, January 2019,
- Download File: ECP19-Roofline-1-intro.pdf (pdf: 9.9 MB)
2018
Charlene Yang, Rahulkumar Gayatri, Thorsten Kurth, Protonu Basu, Zahra Ronaghi, Adedoyin Adetokunbo, Brian Friesen, Brandon Cook, Douglas Doerfler, Leonid Oliker, Jack Deslippe, Samuel Williams, "An Empirical Roofline Methodology for Quantitatively Assessing Performance Portability", International Workshop on Performance, Portability and Productivity in HPC (P3HPC), November 2018,
- Download File: p3hpc-roofline-final.pdf (pdf: 372 KB)
Samuel Williams, Introduction to the Roofline Model, Supercomputing, November 2018,
- Download File: SC18-Roofline-1-intro.pdf (pdf: 18 MB)
Hongzhang Shan, Samuel Williams, Calvin W. Johnson, "Improving MPI Reduction Performance for Manycore Architectures with OpenMP and Data Compression", Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems (PMBS), November 2018,
- Download File: pmbs18-reduce-final.pdf (pdf: 572 KB)
Samuel Williams, Roofline on Manycore and Accelerated Systems, ModSim, August 2018,
- Download File: ModSim18-SWWilliams.pdf (pdf: 15 MB)
Samuel Williams, Parallelism and Performance, MolSSI Summer School, August 2018,
- Download File: MolSSI18-SWWilliams.pdf (pdf: 17 MB)
Khaled Ibrahim, Samuel Williams, Leonid Oliker, "Roofline Scaling Trajectories: A Method for Parallel Application and Architectural Performance Analysis", HPCS Special Session on High Performance Computing Benchmarking and Optimization (HPBench), July 2018,
- Download File: hpbench18-roofline.pdf (pdf: 2.4 MB)
Tuomas Koskela, Zakhar Matveev, Charlene Yang, Adetokunbo Adedoyin, Roman Belenov, Philippe Thierry, Zhengji Zhao, Rahulkumar Gayatri, Hongzhang Shan, Leonid Oliker, Jack Deslippe, Ron Green, and Samuel Williams, "A Novel Multi-Level Integrated Roofline Model Approach for Performance Characterization", ISC, June 2018,
- Download File: ISC18-RooflineAdvisor-final.pdf (pdf: 966 KB)
Charlene Yang, Brian Friesen, Thorsten Kurth, Brandon Cook, Samuel Williams, "Toward Automated Application Profiling on Cray Systems", Cray User Group (CUG), May 2018,
- Download File: CUG18-profiling.pdf (pdf: 184 KB)
Samuel Williams, Introduction to the Roofline Model, ECP Annual Meeting, February 8, 2018,
- Download File: ECP18-Roofline-1-intro.pdf (pdf: 9.1 MB)
Protonu Basu, Using Empirical Roofline Toolkit and Nvidia nvprof, ECP Annual Meeting, February 8, 2018,
- Download File: ECP18-Roofline-4-NVProf.pdf (pdf: 1.4 MB)
Samuel Williams, Advisor Hand-On: Stencil Example, ECP Annual Meeting, February 8, 2018,
- Download File: ECP18-Roofline-6-stencil.pdf (pdf: 3.3 MB)
Charlene Yang, Intel Advisor on Cori, ECP Annual Meeting, February 8, 2018,
- Download File: ECP18-Roofline-5-Advisor.pdf (pdf: 2.7 MB)
Charlene Yang, LIKWID at NERSC, ECP Annual Meeting, February 8, 2018,
- Download File: ECP18-Roofline-3-LIKWID.pdf (pdf: 4.8 MB)
Jack Deslippe, Guiding Optimization on KNL with the Roofline Model, ECP Annual Meeting, February 8, 2018,
- Download File: ECP18-Roofline-2-NESAP.pdf (pdf: 7.1 MB)
Samuel Williams, Performance Modeling and Analysis, CS267 lecture, University of California at Berkeley, January 30, 2018,
- Download File: CS267-Roofline-SWWilliams.pdf (pdf: 18 MB)
- Download File: CS267-Roofline-SWWilliams.pptx (pptx: 17 MB)