tinygrad is a minimalist neural network framework that decomposes all operations into three types: ElementwiseOps, ReduceOps, and MovementOps. It supports full forward and backward passes with autodiff, compiles custom kernels per operation, uses lazy tensors for aggressive fusion, and has a PyTorch-compatible API. The tiny

5m read timeFrom tinygrad.org
Post cover image
Table of contents
tinygradWork at tiny corptinybox (now shipping)FAQ

Sort: