Lecture materials

Formalities

• HeiCo course page

Lecture 1

• Lecture 1
• Exercise 1

Lecture 2

• Lecture 2
• Exercise 2
• Pure Python Neural Network

Lecture 3

• Exercise 3
• Lecture 3

Lecture 4

• Exercise 4
• Lecture 4

Lecture 5

• Project work: Part 1 (Exercise 5)
• Lecture 5

Reading

Papers

Horowitz: Computing’s Energy Problem (And What We Can Do About It)
Vaswani et al.: Attention Is All You Need
Horowitz: Computing’s energy problem (and what we can do about it)

Textbooks

Goodfellow et al.: Deep Learning
Goodfellow et al.: Deep Learning (Downloadable version)
Tunstall, Lewis: Natural Language Processing with Transformers (EN)
Tunstall, Lewis: Natural Language Processing with Transformers (DE)
Alammar, Grootendorst: Hands-On Large Language Models
Hwu et al.: Programming Massively Parallel Processors

Other

Deep Learning Cheat Sheet