Differentiable programming is an approach that leverages techniques such as automatic differentiation for solving optimization problems across various fields, including machine learning and computer graphics. The post explores concepts of differentiation, gradient descent, and specific techniques like forward-mode and backward-mode autodiff. Additionally, it discusses the challenges and advanced methods in automatic differentiation and culminates with a practical example of using differentiable programming for image deblurring.

26m read timeFrom thenumb.at
Post cover image
Table of contents
DifferentiationOptimizationNumericalSymbolicForward ModeBackward Mode

Sort: