Machine learning using PyTorch on DelftBlue 4 December 2024

This course introduces machine learning on the DelftBlue supercomputer, blending theory with hands-on practice. Participants will learn to manage dependencies, handle large datasets, optimize GPU performance, and scale deep learning models using PyTorch.

At the end of the day, you should be able to

• Understand the basic setup of a supercomputer and identify bottlenecks in ML applications.
• Run PyTorch examples on CPUs and GPUs on DelftBlue, assessing performance and resource requirements.
• Optimize workflows to efficiently utilize a single GPU, including LLM examples.
• Scale a deep learning workflow for distributed training across GPUs.

Prerequisites

• Python
• Command line and DelftBlue basics
• Experience with machine learning workflows (e.g., PyTorch)