Three weeks, 15 days, a lecture and exercises every day. The three-week course takes place from 9:00-17:00 at the University IT and Data Center (Hochschulrechenzentrum HRZ). The course structure is 90 minutes of lecture 90 min exercises, followed by 4 hrs of programming under guidance from the tutors.

Members of the University of Bonn can register via ecampus.

Three weeks, 15 days, a lecture and exercises every day. The three-week course takes place from 9:00-17:00 at the University IT and Data Center (Hochschulrechenzentrum HRZ). The course structure is 90 minutes of lecture 90 min exercises, followed by 4 hrs of programming under guidance from the tutors.

Prerequisites: Programming in Python. If you are not yet familiar with python, please consult https://docs.python.org/3/tutorial/ before the first session.

• Day 1: Introduction
  • What is machine learning, and what can it do for us?
  • recording, slides
• Day 2: Optimization
  • The derivative, gradients, optimization via gradient descent.
  • recording, exercise, slides
• Day 3: Linear Algebra:
  • Matrix multiplication, singular value decomposition, Linear Regression.
  • recording, exercise, slides
• Day 4: Statistics
  • mean and variance, correlation, gaussians.
  • recording, exercise, slides

• Day 5: Machine learning basics
  • Overfitting and underfitting, classification, regression, k-nearest neighbours.
  • recording, exercise, slides
• Day 6: Support vector machines
  • Linear separable, non-linear separable, kernel trick.
  • recording, exercise, slides
• Day 7: Decision trees and random forests:
  • Decision trees, bias and variance problem, bagging, random forests.
  • recording, exercise, slides
• Day 8: Clustering and density estimation
  • K-means clustering, Gaussian mixture models, Expectation-Maximization.
  • recording, exercise, slides
• Day 9: Principal component analysis (PCA)
  • PCA for dimensionality reduction and other applications.
  • recording, exercise, slides

• Day 10: Introduction to the HPC Systems at Uni Bonn.

• Day 11: Fully connected networks:
  • The MNIST-data set, artificial neurons, forward and backward pass.
  • recording, exercise, slides
• Day 12: Convolutional neural networks:
  • The convolution operation and convolutional neural networks.
  • recording, exercise, slides
• Day 13: Segmentation and optimization for deep learning:
  • gradient descent with momentum, Adam, early stopping, regularization.
  • recording, exercise, slides
• Day 14: Interpretability:
  • visualization of linear classifiers, saliency maps, integrated gradients
  • recording, exercise, slides
• Day 15: Sequence models:
  • Transformers, Long-Short-Term-Memory, text-based language models.
  • recording(update coming soon), exercise, slides

See you during the course,

Your lecturers, Elena and Moritz.

We thank the state of North Rhine-Westphalia and the Federal Ministry of Education and Research for supporting this project.