Portfolio ↗

Kernels & Compilers

CUDA, Triton, fusion, tiling, torch.compile, CUDA graphs and roofline-guided optimisation.

20concepts
140flashcards
159minutes of reading
Start with What a CUDA Kernel Is Drill the deck
All levels beginner intermediate advanced
  1. 01 What a CUDA Kernel Is A CUDA kernel is a C++ function that runs simultaneously on thousands of GPU threads, each identified by a coordinate in a structured grid, and understanding this execution model is the prerequisite for reasoning about throughput in any deep-learning workload. beginner 7m 7 cards