GPU architectures are increasingly important in machine learning. This interactive notebook helps beginners learn GPU programming using NUMBA to map Python code to CUDA kernels. The post features exercises that teach you to build GPU kernels, and it's suggested to use Google Colab for these tasks. It steps through multiple coding examples and common pitfalls to help develop a solid understanding of GPU programming techniques.
Table of contents
Puzzle 1: MapPuzzle 2 - ZipPuzzle 3 - GuardsPuzzle 4 - Map 2DPuzzle 5 - BroadcastPuzzle 6 - BlocksPuzzle 7 - Blocks 2DPuzzle 8 - SharedPuzzle 9 - PoolingPuzzle 10 - Dot ProductPuzzle 11 - 1D ConvolutionPuzzle 12 - Prefix SumPuzzle 13 - Axis SumPuzzle 14 - Matrix Multiply!Sort: