User Tools

Site Tools


[SoSe 2023] Seminar High Performance Computing

Lecturer Prof. Dr. Estela Suarez
Module (BASIS) MA-INF-1322
eCampus eCampus_MA-INF-1322
Type of Lecture Seminar
Credits 4 CP
Research Area High Performance Computing
Language English
Max. Number of Participants 10

Note: This is the description of a past course. Look for the latest issue for the current course

On the Topic

High Performance Computing (HPC) refers to the use of large cluster computers to solve scientific and technical problems unsolvable on small-scale systems, and doing it so that the hardware resources are efficiently employed. HPC systems are designed to achieve the maximum computing performance at the lowest possible power consumption. They are parallel computers made of hundreds to thousands of compute nodes connected to each other via a high-speed network. Operating HPC systems requires specific software distributions, programming models, and tools. Applications must be parallelized, meaning they must be programmed so that the problem to be solved is split into many individual operations that can be executed in parallel. This seminar addresses important topics and challenges on today’s HPC. It is designed to cover a wide range of areas allowing for a general overview on each of the aspects, as well as for a deep-dive into specific solutions within any of the proposed topics.


Event Date
Application open (via Email) 01.03.2023
Term of application (via Email) 03.04.2023
Preliminary discussion and subject assignment 05.04.2023 at 10:00-12:00
Seminar-Room 2.050
Deadline written report (concept) 28.04.2023
Deadline application finalization (in BASIS) May 2023
Meet to discuss concept 05.05.2023 at 10:00
Seminar-Room 2.050
Deadline written report (first complete submission)
Upload your report to EasyChair
26.05.2023 at 23:59 (CEST)
Bidding via EasyChair 27.05.2023 at 23:59 (CEST)
via Zoom
(link: see slides on eCampus)
Review Assignments via EasyChair
You'll receive an automatic Email.
Login to EasyChair, download papers, and read them
Deadline to review 2 papers from colleagues
Upload your review to EasyChair
Meet to discuss review 05.06.2023 at 9:00
via Zoom (link, see slides on eCampus)
Deadline written report (final version) 16.06.2023
Deadline presentation slides (structure) 23.06.2023
Deadline presentation slides (full version) 03.07.2023
Presentations 07.07.2023
Seminar-Room 0.016


The topics below are formulated in a general manner. There are two possible ways of approaching them, which lead to two different kinds of seminar report:

  • Review paper: Provide a general overview of the topic and research at relatively high level
  • Focus paper: shortly describe the general overview (“background” section of your report) and then focus on a specific research (e.g. a specific publication) within the given topic.
# Topics (some specific aspects as suggestions) Refs
A HPC computer architectures (basic principles, system-level approaches, homogeneous clusters, heterogeneous systems, modular systems) [01], [02], [03], [04]
B Memory and storage hierarchies (cache levels, memory technologies, storage systems) [05], [06], [07]
C Network interconnect (principles, intra-node and system-wide approaches, topologies, technologies) [08], [09], [10], [11]
D Resource management and job scheduling (principles of multi-user environment, standard approaches, advanced features (e.g. malleability, dynamic resource allocation) [12], [13], [14]
E Programming models for parallel computing (shared memory approaches, distributed memory approaches, hardware-specific, high-level programming models, performance portability) [15], [16], [17]
F Scalability (principles, Amdahl’s and Gustafsons law) [18], [19], [20]
G Energy efficiency and power consumption (challenges, trends, measurement/monitoring techniques) [21], [22], [23]
H Performance prediction and measurement (principles, metrics, classifications, roofline, analysis and modelling tools) [02], [24], [25], [26], [27], [28], [29], [30]
I Co-design (how application requirements are fed into system/component design, principles, approaches, examples) [31], [32]
J Exascale (trends and challenges) [33], [34], [35], [36], [37]

Application Process

  • Application period will be open according to the timetable above
  • Application is done by writing an email to Prof. Dr. Estela Suarez, which must contain
    • your name,
    • your email address (,
    • your matriculation number,
    • and your desired subjects (rank 3 or more subjects).
  • Please note, that the number of participants is limited to 10 and only the first 10 applications will be considered.
    • You will receive a feedback mail in all cases.
  • Subject assignment will be done at the preliminary discussion.
    • The preliminary discussion is mandatory
    • Absence will lead to exclusion from the seminar.
    • Details about the technical process will be given in confirmation mail.
  • Basis registration according to official deadline for Seminars


A selection of scientific publications / subjects is available above. The subject will be assigned at the preliminary discussion (see section Dates).

During the semester the participants will create their written report and presentation slides. During this period there will be no regular meetings with the other participants. The tutor Prof. Dr. Estela Suarez will be available for any organizational or content-related questions. Feel free to drop an email anytime, also if if you'd like to setup a meeting.

First step: a concept about the written report must be created. This should contain the projected structure of the report as well as a basic description of the contents of each section. Furthermore, it should contain the used literature. To avoid misconceptions and unnecessary work, the conception should be discussed with the tutor before the actual work on the written report is started.

The written report must span 8-10 pages (excluding table of contents and bibliography) and must be created using LaTeX ( Generally, it is necessary to make a selection and prioritization of topics discussed in the source literature. The content of the written report should match the later presentation, although a different depth, ordering, and prioritization is possible. It is advantageous to incorporate other scientific sources. A scientific complete reference to all used sources is mandatory. It is expected to critically review the subject and literature at hand. A complete and successful written report is necessary to continue with the seminar. Simple rephrasing will be considered unsuccessful.

  • Submissions after the given deadlines will not be accepted.
  • Presentation slides will not be accepted for review by the tutors if the written report is unsuccessful.

The tutor will review the written report after the first submission. All participants have the possibility to incorporate desired changes and suggestions from the review and submit a final version afterwards. Only the final version will be subject to grading. Both submissions are mandatory. The projected structure of the presentation slides should be submitted to the tutor in advance to the complete version for discussion. It is possible that the tutor will request further changes to the presentation slides after the submission of the complete slides. Be prepared to incorporate these changes before the seminar takes place.

All participants will present their subject in a 30 minute presentation during the seminar. After each presentation, there is a 15 minute time slot to discuss the presentation and the subject.

  • Attendance to all presentations is mandatory.

Report Template

To write your report, please use the following LaTeX template:

Criteria for Grading

Criteria for the Written Composition

  • Layout and formal requirements: citation style and appropriate citation usage, correct mathematical notion, grammatical correctness, spelling, punctuation, formatting, optical appearance.
  • Style and structure: spelling style, well defined technical terms, well structured, concise content representation, correct usage of LaTeX environments and theorems.
  • Content: adequate selection and prioritization of the content, usage of additional literature, content related correctness, mathematical correctness, correct definitions / theorems / proofs, suitable self-provided examples, precise phrasing, critical evaluation and discussion of the content.
  • Independent work style: preparation of good questions for meetings with the tutor, performing literature search for open questions and a deep understanding of the content, justified prioritization and content selection. Attention: Questions and discussions with the tutor are recommended and welcome. They will not lead to lesser grades. On the contrary, they will typically enhance the overall quality of the submissions. An independent work style means, that you think over your problem on your own in advance to such discussions and that you do not rely on your tutor to make trivial corrections.
  • Bibliography: for correct bibliographic referencing, see more information in this Bibliography Guideline

Criteria for the Presentation

  • Content: structure, adequate selection and prioritization of the content, correctness, self-prepared examples, graphics, critical evaluation and discussion
  • Presentation: presentations style (free, smooth, adequate and precise phrasing, understandability), reasonable and supportive presentation slides / examples / graphics, that help the audience to understand the problems / definitions / evaluations, timing.
  • Some general guidelines: for further information, see this Presentation Guideline


These are just some possible sources on the topics of the Seminar. In order to get an overview of the topic that you selected, it is a good approach to start by one of the related references and look further into papers that have cited it, and on its own references (especially those given as related work). If you cannot get access to the papers via the UniBonn library licence, please contact Prof. Dr. Estela Suarez.

A - Computer Architectures

  • [01] D. Pleiter, Parallel Computer Architectures. Lecture Notes of the 45th IFF Spring School “Computing Solids - Models, ab initio methods and supercomputing” (Forschungszentrum Jülich, 2014)
  • [02] J. Hofmann, G. Hager, G. Wellein, D. Fey, An Analysis of Core- and Chip-Level Architectural Features in Four Generations of Intel Server Processors, Lecture Notes in Computer Science book series (LNTCS, volume 10266),
  • [03] E. Suarez, N. Eicker, Th. Lippert, Modular Supercomputing Architecture: from Idea to Production, Contemporary High Performance Computing: From Petascale toward Exascale, Volume 3 FL, USA : CRC Press 3, : 3rd, 223-251 (2019),
  • [04] C. Engelmann, H. Ong, S.L. Scott, Middleware in Modern High Performance Computing System Architectures. In: Shi, Y., van Albada, G.D., Dongarra, J., Sloot, P.M.A. (eds) Computational Science – ICCS 2007. ICCS 2007. Lecture Notes in Computer Science, vol 4488. Springer, Berlin, Heidelberg. (2007).,

B – Memory and storage hierarchies

  • [05] J. Lüttgau, M. Kuhn, K., Duwe, Y. Alforov, E. Betke, J. Kunkel, T. Ludwig, Survey of Storage Systems for High-Performance Computing. Supercomputing Frontiers and Innovations, 5(1), 31–58 (2018).
  • [06] A. Suresh, P. Cicotti and L. Carrington, Evaluation of emerging memory technologies for HPC, data intensive applications, 2014 IEEE International Conference on Cluster Computing (CLUSTER), pp. 239-247, 2014. doi: 10.1109/CLUSTER.2014.6968745.
  • [07] S. Narasimhamurthy, N. Danilov, S. Wu, G. Umanesan, S. Wei-der Chien, S. Rivas-Gomez, I. Bo Peng, E. Laure, S. de Witt, D. Pleiter, S. Markidis, The SAGE Project: a Storage Centric Approach for Exascale Computing, In Proceedings of the 15th ACM International Conference on Computing Frontiers (CF '18). Association for Computing Machinery, New York, NY, USA, 287–292. (2018).,

C – Network and interconnect

D – Resource management and job scheduling

  • [12] S. Perarnau, J. A. Zounmevo, M. Dreher, B. C. V. Essen, R. Gioiosa, K. Iskra, M. B. Gokhale, K. Yoshii, and P. Beckman. 2017. Argo NodeOS: Toward unified resource management for exascale. In Proceedings of the 2017 IEEE International Parallel and Distributed Processing Symposium (IPDPS). 153–162. DOI:
  • [13] S. Prabhakaran, M. Neumann, S. Rinke, F. Wolf, A. Gupta and L. V. Kale, A Batch System with Efficient Adaptive Scheduling for Malleable and Evolving Applications, 2015 IEEE International Parallel and Distributed Processing Symposium, pp. 429-438, (2015). doi: 10.1109/IPDPS.2015.34
  • [14] D. H. Ahn et al., Flux: Overcoming Scheduling Challenges for Exascale Workflows, 2018 IEEE/ACM Workflows in Support of Large-Scale Science (WORKS), Dallas, TX, USA, 2018, pp. 10-19, doi: 10.1109/WORKS.2018.00007.,,

E - Programming models for parallel computing

  • [15] T. Sterling, M. Anderson, M. Brodowicz, A Survey: Runtime Software Systems for High Performance Computing. Supercomputing Frontiers and Innovations, 4(1), 48–68, (2017).
  • [16] W. Gropp and M. Snir, Programming for Exascale Computers, in Computing in Science & Engineering, vol. 15, no. 6, pp. 27-35, (2013). doi: 10.1109/MCSE.2013.96.
  • [17] J. Diaz, C. Muñoz-Caro and A. Niño, A Survey of Parallel Programming Models and Tools in the Multi and Many-Core Era, in IEEE Transactions on Parallel and Distributed Systems, vol. 23, no. 8, pp. 1369-1386, (2012). doi: 10.1109/TPDS.2011.308.

F – Scalability

G - Energy efficiency and power consumption

  • [21] P. Czarnul, J. Proficz, and A. Krzywaniak, Energy-aware high-performance computing: survey of state-of-the-art tools, techniques, and environments. Scientific Programming 2019, (2019).
  • [22] H. Shoukourian, T. Wilde, A. Auweter, A. Bode, Predicting the Energy and Power Consumption of Strong and Weak Scaling HPC Applications. Supercomputing Frontiers and Innovations, 1(2), 20–41, (2014).
  • [23] A. Netti, M. Müller, A. Auweter, C. Guillen, M. Ott, D. Tafani, M. Schulz, From facility to application sensor data: modular, continuous and holistic monitoring with DCDB. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC '19). Association for Computing Machinery, New York, NY, USA, Article 64, 1–27, 2019.,

H – Performance prediction and measurement

  • [24] G. Hager, J. Treibig, J. Habich, and G. Wellein, Exploring performance and power properties of modern multicore chips via simple machine models. Concurrency and Computation: Practice & Experience. Vol 28, Issue 2, pp 189–210, (2016).
  • [25] T. Hoefler and R. Belli, Scientific Benchmarking of Parallel Computing Systems, pp. 73:1–73:12, ACM, Nov. 2015. Proceedings of SC15:
  • [26] U. Lopez-Novoa, A. Mendiburu and J. Miguel-Alonso, A Survey of Performance Modeling and Simulation Techniques for Accelerator-Based Computing, in IEEE Transactions on Parallel and Distributed Systems, vol. 26, no. 1, pp. 272-281, (2015), doi: 10.1109/TPDS.2014.2308216.
  • [27] J. Dongarra, M.A. Heroux, and P. Luszczek, High-performance conjugate-gradient benchmark: A new metric for ranking high-performance computing systems. The International Journal of High Performance Computing Applications, 30(1):3–10, (2016).
  • [28] P.F. Baumeister, T. Hater, J. Kraus, D. Pleiter, P. Wahl, A Performance Model for GPU-Accelerated FDTD Applications, 2015 IEEE 22nd International Conference on High Performance Computing (HiPC) - ISBN 978-1-4673-8488-9, (2015), [10.1109/HiPC.2015.24] doi:10.1109/HiPC.2015.24,
  • [29] S. Williams, A. Waterman, and D. Patterson. 2009. Roofline: an insightful visual performance model for multicore architectures. Commun. ACM 52, 4 (April 2009), 65–76.;
  • [30] A. Ilic, F. Pratas, and L. Sousa, Cache-aware Roofline model: Upgrading the loft, INESC-ID/IST, Technical University of Lisbon, Portugal,

I – Codesign

  • [31] J. Shalf, D. Quinlan, C. Janssen. Rethinking Hardware-Software Codesign for Exascale Systems, Computer, Vol. 44, Issue 11, November 2011 pp 22–30,
  • [32] D. Unat, C. Chan, W. Zhang, S. Williams, J. Bachan, J. Bell, J. Shalf, ExaSAT: An exascale co-design tool for performance modeling. The International Journal of High Performance Computing Applications 29, 2 (May 2015), 209–232, (2015). DOI:

J – Exascale

teaching/ss23/hpc-seminar.txt · Last modified: 2024/01/14 15:57 by estela.suarez

Page Tools