Drawing

Correctness 2025: 9th International Workshop on Software Correctness for HPC Applications

November 17, 2025 (full day, 9:00am - 5:30pm CST)

America’s Center

St. Louis, Missouri, USA

Held in conjunction with SC25: The International Conference for High Performance Computing, Networking, Storage and Analysis
In cooperation with
IEEE CS

Ensuring correctness in high-performance computing (HPC) applications is one of the fundamental challenges that the HPC community faces today. While significant advances in verification, testing, and debugging have been made to isolate software errors (or defects) in the context of non-HPC software, several factors make achieving correctness in HPC applications and systems much more challenging than in general systems software—growing heterogeneity (architectures with CPUs, GPUs, and special purpose accelerators), massive scale computations (very high degree of concurrency), use of combined parallel programing models (e.g., MPI+X), new scalable numerical algorithms (e.g., to leverage reduced precision in floating-point arithmetic), and aggressive compiler optimizations/transformations are some of the challenges that make correctness harder in HPC. The following reports lay out the key challenges and research areas of HPC correctness: (1) DOE Report of the HPC Correctness Summit, (2) DOE/NSF Workshop on Correctness in Scientific Computing.

As the complexity of future architectures, algorithms, and applications in HPC increases, the ability to fully exploit exascale systems will be limited without correctness. With the continuous use of HPC software to advance scientific and technological capabilities, novel techniques and practical tools for software correctness in HPC are invaluable.

The goal of the Correctness Workshop is to bring together researchers and developers to present and discuss novel ideas to address the problem of correctness in HPC. The workshop will feature contributed papers and invited talks in this area.

Workshop Topics

Topics of interest include, but are not limited to:

Correctness in Scientific Applications and Algorithms

Tools for Debugging, Testing, and Correctness Checking

Programing Models and Runtime Systems Correctness

Other Areas

Submissions and Format

Authors are invited to submit manuscripts in English structured as technical or experience papers in any of these categories: (a) regular papers: with a length of at least 7 pages, not exceeding 8 pages of content, including everything except references; (b) short papers: with a length of 5 pages including references.

Submissions must use the ACM proceedings template (Latex users, please use the “sigconf” option).

Submitted papers will be peer-reviewed by the Program Committee and accepted papers will be published by ACM.

Submitted papers must represent original unpublished research that is not currently under review for any other venue. Papers not following these guidelines will be rejected without review. Submissions received after the due date, exceeding length limit, or not appropriately structured may also not be considered. At least one author of an accepted paper must register for and attend the workshop. Authors may contact the workshop organizers for more information. Papers should be submitted electronically at: https://submissions.supercomputing.org/.

SC Reproducibility Initiative

We encourage authors to submit an optional artifact description (AD) appendix along with their paper, describing the details of their software environments and computational experiments to the extent that an independent person could replicate their results. The AD appendix is not included in the 8-page limit of the paper and should not exceed 2 pages of content. For more details of the SC Reproducibility Initiative please see: https://sc24.supercomputing.org/program/papers/reproducibility-initiative/.

Proceedings

The proceedings will be archived in ACM.

Important Dates

All time zones are AOE.

Workshop Date

Organizers

Ignacio Laguna, LLNL
Cindy Rubio-González, UC Davis

Program Committee

Alper Altuntas, National Center for Atmospheric Research, USA
Allison H. Baker, National Center for Atmospheric Research, USA
John Baugh, North Carolina State University, USA
Patrick Carribault, CEA-DAM, France
Ganesh Gopalakrishnan, University of Utah, USA
Jan Hueckelheim, Argonne National Laboratory, USA
Alexander Hück, Technical University Darmstadt, Germany
Joachim Jenke, RWTH Aachen University, Germany
Michael O. Lam, James Madison University, USA
Jackson Mayo, Sandia National Laboratories, USA
Erdal Mutlu, Pacific Northwest National Laboratory, USA
Pavel Panchekha, University of Utah, USA
Samuel Pollard, Sandia National Laboratories, USA
Balthasar Reuter, European Centre for Medium-Range Weather Forecasts, UK
Matt Sottile, Lawrence Livermore National Laboratory, USA
Mohit Tekriwal, Lawrence Livermore National Laboratory, USA
Lechen Yu, Microsoft, USA

Venue

Program


Workshop Introduction

9:00am - 9:05am: Opening Remarks, Ignacio Laguna (LLNL), Cindy Rubio-González (UC Davis)

Invited Talk

9:05am - 10:00am: Featured Speaker: Prof. Dr. Matthias Müller (RWTH Aachen University): "Runtime Correctness Checking with MUST and Assisting Tools"

Break

10:00am - 10:30am: Break

Correctness in Parallel Code (MPI, OpenMP, and Beyond) (Chair: Cindy Rubio-González)

10:30am - 10:55am: Paper 1: "Using Code Coverage to Assess Feature Gaps in MPI Correctness Tool Classification Tests", Alexander Hück, Simon Schwitanski, Tim Jammer, Joachim Jenke, Yussur Mustafa Oraji, Christian Bischof
10:55am - 11:20am: Paper 2: "Coupling Static and Dynamic MPI Correctness Tools to Optimize Accuracy and Overhead", Yussur Mustafa Oraji, Simon Schwitanski, Semih Burak, Christian Bischof, Matthias Müller
11:20am - 11:45am: Paper 3: "Data Race Detection through Vibe Translation", Jan Hueckelheim, Vimarsh Sathia, Siyuan Brant Qian
11:45am - 12:10pm: Paper 4: "Differential Testing for Sequential to Parallel Transformations", Jobayer Ahmmed, Quazi I. Mahmud, Junhyung Shim, Liyi Li, Ali Jannesari, Myra B. Cohen
12:10pm - 12:30pm: Paper 5 (Short paper): "Extending MPI Correctness Benchmarking to the Fortran Language", Yussur Mustafa Oraji, Alexander Hück, Christian Bischof

Lunch Break

12:30pm - 2:00pm: Lunch Break

Invited Talk

2:00pm - 3:00pm: Featured Speaker: Prof. Ali Jannesari (Iowa State University): "Correct and Efficient HPC Code Generation with LLMs: Challenges and Opportunities"

Break

3:00pm - 3:30am: Break

Numerical Correctness (Chair: Ignacio Laguna)

3:30pm - 3:55pm: Paper 6: "Towards an Automated Workflow for Floating-Point Analysis of GPU Kernels", Esteban M. Rangel, S. John Pennycook
3:55pm - 4:20pm: Paper 7: "LLM4FP: LLM-Based Program Generation for Triggering Floating-Point Inconsistencies Across Compilers", Yutong Wang, Cindy Rubio-González
4:20pm - 4:45pm: Paper 8: "Exploring Reduced Precision for Deep Learning Activation Functions", Epifanio Sarinana, Christoph Lauter, Shirley Moore

Lightning Talks

4:45pm - 5:25pm: Emerging Tools Lightning Talks Session: featuring short presentations about emerging correctness tools.
• "Scabbard: LLVM Instrumentation-aided Race Checking in CPU/GPU Unified Memory for AMD GPUs", Andrew Osterhout (Univ. of Utah)
• "Scalable formal verification of scientific computing libraries", Mohit K. Tekriwal (LLNL)
• "Data Race Detection by Concentrating on Instrumentation", Tim Jammer (TU Darmstadt)
• "Using FloatGuard to detect floating point exceptions in AMD GPU programs", Dolores Miao (UC Davis)

Best Paper Presentation Award

5:25pm - 5:30pm: Best Paper Presentation Award
5:30pm: Adjourn

Best Paper Presentation Award

Like in previous years, we will have the Best Paper Presentation Award. The goal is to reward high-quality presentations, motivating speakers at the workshop to deliver their best work. We believe that advancing the field of Correctness in HPC requires more engagement and collaboration between the research, development, and applications communities, and better presentations will lead to more engaging and informative sessions. Higher quality presentations will also help us to present the benefits of Correctness methods to our sponsors.

A high-quality presentation should present clearly the correctness problem being addressed and its impact to scientific / HPC applications, and it should be easy to follow even for attendees that are not familiar with traditional correctness methods (formal methods, verification, testing, debugging, among others). Overall the presentation should make such methods and results more accessible to the general audience of the workshop and the SC community.

Only regular papers are eligible for the Best Paper Presentation Award (short papers are not eligible).

Winner

The winner of the Best Paper Presentation Award is the paper “Data Race Detection through Vibe Translation”, co-authored by Jan Hueckelheim, Vimarsh Sathia, and Siyuan Brant Qian. Congratulations!

Award

Contact Information

Please address workshop questions to Ignacio Laguna (ilaguna@llnl.gov) and/or Cindy Rubio-González (crubio@ucdavis.edu).

Previous Workshops