The Most Important Algorithm in Machine Learning
In this video we will talk about backpropagation – an algorithm powering the entire field of machine learning and try to derive it from first principles. OUTLINE:00:00 Introduction01:28 Historical background02:50 Curve Fitting problem06:26 Random vs guided adjustments09:43 Derivatives14:34 Gradient Descent16:23 Higher dimensions21:36 Chain Rule Intuition27:01 Computational Graph and Autodiff36:24 Summary38:16 Shortform39:20 Outro Jürgen Schmidhuber’s blog…