Page has been updated with the topics and bibliography for SoSe-2026

High Performance Computing (HPC) refers to the use of large cluster computers to solve scientific and technical problems unsolvable on small-scale systems, and doing it so that the hardware resources are efficiently employed. HPC systems are designed to achieve the maximum computing performance at the lowest possible power consumption. They are parallel computers made of hundreds to thousands of compute nodes connected to each other via a high-speed network. Operating HPC systems requires specific software distributions, programming models, and tools. Applications must be parallelized, meaning they must be programmed so that the problem to be solved is split into many individual operations that can be executed in parallel.

This seminar addresses important topics and challenges on today’s HPC. It is designed to cover a wide range of areas allowing to get a glimpse of the latest developments in specific areas of HPC.

All the above dates are strict. Missing any of those leads to expulsion from the seminar or failure (score 5.0).

• Application period will be open according to the timetable above
• Application is done by writing an email to the lecturer, which must contain all below information:
  • your name,
  • your email address (@uni-bonn.de),
  • your matriculation number,
  • and your desired subjects: rank 3 or more subjects, indicating for each one the letter (A, B, C…) and the topic name from the list above.
• Please note, that the number of participants is limited and only the first 10 applications will be considered.
  • You will receive a feedback mail in all cases.
• Subject assignment will be done at the preliminary discussion.
  • The preliminary discussion is mandatory.
  • Absence will lead to exclusion from the seminar.
• Basis registration according to official deadline for Seminars
• Submissions after the given deadlines will not be accepted.

The topics below are concrete examples from a variety of current HPC topics. Based on reading the references provided for each topic, and the related ones (papers citing them or cited by them), you should be able to write a focused seminar report: shortly describe the general overview (“background” section of your report) and then focus on a specific research (e.g. a specific publication) within the given topic.

A selection of scientific publications / subjects is given via this website. The subject will be assigned at the preliminary discussion (see section Dates).

During the semester each participant will:

• Create a written report in 3 steps: concept/structure, full version, final version including rebuttal.
• Participate in the double-blind peer review process.
• Create presentation slides (structure, final version) and present them on the final seminar day.

Two intermediate meetings are organized: 1st to discuss the paper concept, 2nd to discuss the outcome of the review process. Further than that there are no group meetings and most communication is done via email. The tutor (Prof. Suarez) will be available for any organizational or content-related questions. Feel free to drop an email anytime, also if if you'd like to setup a meeting.

The course is organized in following steps:

1. step: concept: a first skeleton/concept of the written report must be created and uploaded to EasyChair. This should contain the projected structure of the report as well as a basic description of the contents of each section. Furthermore, it should contain the used literature. To avoid misconceptions and unnecessary work, the conception should be discussed with the tutor before the actual work on the written report is started (a meeting takes place for this).

2. step: full report: after receiving feedback on the concept, the full paper is written and uploaded to EasyChair. The written report must span 8-10 pages (excluding table of contents and bibliography) and must be created using LaTeX ( Report_Template.zip). Generally, it is necessary to make a selection and prioritization of topics discussed in the source literature. The content of the written report should match the later presentation, although a different depth, ordering, and prioritization is possible. It is advantageous to incorporate other scientific sources. A scientific complete reference to all used sources is mandatory. It is expected to critically review the subject and literature at hand. A complete and successful written report is necessary to continue with the seminar. Simple rephrasing will be considered unsuccessful.

3. step: peer-review. Each participant can report conflicts of interests and bid via EasyChair on the papers that she/he is most interested on. Then, two papers are assigned to each participant for review in a double-blind fashion. The reviews of the two papers must be uploaded via EasyBuild. Each participant receives at the end of this process two reviews for her/his paper from two different colleagues, and writes a rebuttal.

• NOTE: For you, the peer-review process contributes to your score in this course based on only two aspects: 1) The quality of the 2 reviews that you provided, and 2) The quality of the rebuttal that you have done to the reviews that you received. For the avoidance of doubt: whether the reviews that you receive from your colleagues are positive or negative has NO impact on your score.

4. step: final report submission: you complete your report by making any changes on the report that are necessary to address the reviews that you received, and include the rebuttal as an Annex to the report. The final report is uploaded to EasyChair.

• Only this final version of the report is graded.
• Presentation slides will not be accepted for review by the tutors if the written report is unsuccessful.

5. step: slides preparation: The projected structure of the presentation slides should be submitted to the tutor in advance to the complete version for discussion. It is possible that the tutor will request further changes to the presentation slides after the submission of the complete slides. Be prepared to incorporate these changes before the seminar takes place.

6. step: presentation: Finally, the slides are presented in a seminar day with participation of all students. All participants will present their subject in a 30 minute presentation during the seminar. After each presentation, there is a 15 minute time slot to discuss the presentation and the subject.

• Attendance to all presentations is mandatory.

NOTE that: Submissions after the given deadlines will not be accepted.

To write your report, please use the following LaTeX template: Report_Template.zip

• Layout and formal requirements: citation style and appropriate citation usage, correct mathematical notion, grammatical correctness, spelling, punctuation, formatting, optical appearance.
• Style and structure: spelling style, well defined technical terms, well structured, concise content representation, correct usage of LaTeX environments and theorems.
• Content: adequate selection and prioritization of the content, usage of additional literature, content related correctness, mathematical correctness, correct definitions / theorems / proofs, suitable self-provided examples, precise phrasing, critical evaluation and discussion of the content.
• Independent work style: preparation of good questions for meetings with the tutor, performing literature search for open questions and a deep understanding of the content, justified prioritization and content selection. Attention: Questions and discussions with the tutor are recommended and welcome. They will not lead to lesser grades. On the contrary, they will typically enhance the overall quality of the submissions. An independent work style means, that you think over your problem on your own in advance to such discussions and that you do not rely on your tutor to make trivial corrections.
• Bibliography: for correct bibliographic referencing, see more information in this Bibliography Guideline

• Review Feedback: thoroughness of the review, structure and content, respectful wording, accurate feedback, objective and reasoned observation, clear recommendations for improvement
• Rebuttal: respectful feedback to reviewers, accurate reply to their comments, comprehensive integration of improvements on the manuscript.

• Content: structure, adequate selection and prioritization of the content, correctness, self-prepared examples, graphics, critical evaluation and discussion
• Presentation: presentations style (free, smooth, adequate and precise phrasing, understandability), reasonable and supportive presentation slides / examples / graphics, that help the audience to understand the problems / definitions / evaluations, timing.
• Some general guidelines: for further information, see this Presentation Guideline

These are the possible sources on the topics of the Seminar. In order to get an overview of the topic that you selected, it is a good approach to start by the given paper(s) and look further into other papers that have cited it, and on its own references (especially those given as related work). If you cannot get access to the papers via the UniBonn library license, please contact the people holding this course (mails at the top of this page).

A – Performance modelling

• [01] Ayesha Afzal, Georg Hager, Gerhard Wellein. Analytic roofline modeling and energy analysis of the LULESH proxy application on multi-core clusters, The International Journal of High Performance Computing Applications, (2025), https://journals.sagepub.com/doi/pdf/10.1177/10943420251363711

• [02] C. Gavoille, H. Taboada, J. Domke, B. Goglin and E. Jeannot, Performance Projection for Design-Space Exploration on future HPC Architectures, 2025 IEEE International Parallel and Distributed Processing Symposium (IPDPS), Milano, Italy, (2025), doi: 10.1109/IPDPS64566.2025.00031 https://ieeexplore.ieee.org/document/11078498

B – Memory optimisations

• [03] Sergey Malkovsky, Aleksei Sorokin, Sergey Korolev, Analysis of the impact of NUMA node configuration on the performance of offloading computations to GPUs, Parallel Computing, Volume 127, (2026), https://doi.org/10.1016/j.parco.2025.103182

• [04] Sergej Breiter, James D. Trotter, Karl Fürlinger, Cache partitioning for sparse matrix–vector multiplication on the A64FX, Parallel Computing, Volume 127, (2026), https://doi.org/10.1016/j.parco.2025.103169

• [05] N. Fujita, T. Boku, T. Yoshida, T. Shirai and M. Tsuji, GPU-CPU Shared Memory Performance Analysis on NVIDIA GH200, 2025 IEEE International Conference on Cluster Computing Workshops (CLUSTER Workshops), Edinburgh, United Kingdom, (2025), doi: 10.1109/CLUSTERWorkshops65972.2025.11164213 https://ieeexplore.ieee.org/document/11164213

C – Application efficiency and performance

• [06] Radita Liem and Dlyaver Djebarov. 2026. Quantifying the Energy Cost of Performance Inefficiency in HPC Applications. In Proceedings of the Supercomputing Asia and International Conference on High Performance Computing in Asia Pacific Region Workshops (SCA/HPCAsiaWS '26), (2026). Association for Computing Machinery, New York, NY, USA, 418–427. https://doi.org/10.1145/3784828.3785251

D – CPU architecture

• [07] Jan Laukemann, Georg Hager, Gerhard Wellein, Microarchitectural comparison, in-core modeling, and memory hierarchy analysis of state-of-the-art CPUs: Grace, Sapphire Rapids, and Genoa, Parallel Computing, Volume 127, (2026), https://doi.org/10.1016/j.parco.2026.103183

• [08] Schätzle, F. Falquez, C.; Ho, N.; Zambanini, A ; Boom, J. ; Suarez, E. Modeling Chiplet-to-Chiplet (C2C) Communication for Chiplet-based Co-Design. ISC 2025, (2025). https://ieeexplore.ieee.org/document/11018303

E – GPU architecture

• [09] Rodrigo Huerta, Mojtaba Abaie Shoushtary, José-Lorenzo Cruz, and Antonio Gonzalez. 2025. Dissecting and Modeling the Architecture of Modern GPU Cores. In Proceedings of the 58th IEEE/ACM International Symposium on Microarchitecture (MICRO '25), (2025). Association for Computing Machinery, New York, NY, USA, 369–384. https://doi.org/10.1145/3725843.3756041

• [10] W. Luo et al., Benchmarking and Dissecting the Nvidia Hopper GPU Architecture, in 2024 IEEE International Parallel and Distributed Processing Symposium (IPDPS), San Francisco, CA, USA, (2024), doi: 10.1109/IPDPS57955.2024.00064 https://ieeexplore.ieee.org/document/10579250

F – CPU efficiency trends

• [11] Ayesha Afzal, Georg Hager, and Gerhard Wellein. 2023. SPEChpc 2021 Benchmarks on Ice Lake and Sapphire Rapids Infiniband Clusters: A Performance and Energy Case Study. In Proceedings of the SC '23 Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis (SC-W '23). Association for Computing Machinery, New York, NY, USA, 1245–1254, (2023). https://doi.org/10.1145/3624062.3624197

• [12] H. Tröpgen, R. Schöne, T. Ilsche and D. Hackenberg, 16 Years of SPEC Power: An Analysis of x86 Energy Efficiency Trends, 2024 IEEE International Conference on Cluster Computing Workshops (CLUSTER Workshops), Kobe, Japan, 2024, pp. 76-80, (2024), doi: 10.1109/CLUSTERWorkshops61563.2024.00020 https://ieeexplore.ieee.org/document/10740865

G – Sustainability in HPC

• [13] Yankai Jiang, Raghavendra Kanakagiri, Rohan Basu Roy, and Devesh Tiwari. ThirstyFLOPS: Water Footprint Modeling and Analysis Toward Sustainable HPC Systems. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC '25). Association for Computing Machinery, New York, NY, USA, 855–869, (2025). https://doi.org/10.1145/3712285.3759804

• [14] Alok Kamatar, Maxime Gonthier, Valerie Hayot-Sasson, André Bauer, Marcin Copik, Raul Castro Fernandez, Torsten Hoefler, Kyle Chard, and Ian Foster. 2025. Core Hours and Carbon Credits: Incentivizing Sustainability in HPC. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC '25). Association for Computing Machinery, New York, NY, USA, 870–887, (2025). https://doi.org/10.1145/3712285.3759858

H – Reduced precision

• [15] Aditya Kashi, Nicholson Koukpaizan, Hao Lu, Michael Matheson, Sarp Oral, and Feiyi Wang. 2025. Scaling the memory wall using mixed-precision - HPG-MxP on an exascale machine. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC '25). Association for Computing Machinery, New York, NY, USA, 281–297, (2025). https://doi.org/10.1145/3712285.3759877

• [16] Faveo Hoerold, Ivan R. Ivanov, Akash Dhruv, William S. Moses, Anshu Dubey, Mohamed Wahib, and Jens Domke. 2025. RAPTOR: Practical Numerical Profiling of Scientific Applications. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC '25). Association for Computing Machinery, New York, NY, USA, 661–680, (2025). https://doi.org/10.1145/3712285.3759810

I – Artificial Intelligence applications in HPC

• [17] Yueming Yuan, Ahan Gupta, Jianping Li, Sajal Dash, Feiyi Wang, and Minjia Zhang. 2025. X-MoE: Enabling Scalable Training for Emerging Mixture-of-Experts Architectures on HPC Platforms. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC '25). Association for Computing Machinery, New York, NY, USA, 1315–1331, (2025). https://doi.org/10.1145/3712285.3759886

• [18] Xiao Wang, et. al, ORBIT-2: Scaling Exascale Vision Foundation Models for Weather and Climate Downscaling. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC '25). Association for Computing Machinery, New York, NY, USA, 86–98, (2025). https://doi.org/10.1145/3712285.3771989

• [19] J. Kwack et al., AI and HPC Applications on Leadership Computing Platforms: Performance and Scalability Studies, 2025 IEEE International Parallel and Distributed Processing Symposium (IPDPS), Milano, Italy, (2025), doi: 10.1109/IPDPS64566.2025.00027. https://ieeexplore.ieee.org/document/11078548

J – Reproducibility in HPC

• [20] Valérie Hayot-Sasson, Nathaniel Hudson, André Bauer, Maxime Gonthier, Ian Foster, and Kyle Chard Addressing Reproducibility Challenges in HPC with Continuous Integration. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC '25). Association for Computing Machinery, New York, NY, USA, 437–457, (2025). https://doi.org/10.1145/3712285.3759874

• [21] Olga Pearce, Gregory Becker, Stephanie Brink, Nathan Hanford, Dewi Yokelson, August Knox, and Barry Rountree. 2025. HPC Benchmarking: Repeat, Replicate, Reproduce. In Proceedings of the 3rd ACM Conference on Reproducibility and Replicability (ACM REP '25). Association for Computing Machinery, New York, NY, USA, 85–95, (2025). https://doi.org/10.1145/3736731.3746150