Back To MATH7501 Home

Unit 10: Partial derivatives and gradient descent
Unit Outline:
10.1: Vector operations (in 2 and n dimensions)
Course Reader:
Vectors, what even are they? (3Blue1Brown):
Adding vectors (Khan Academy):
Combined vector operations example (Khan Academy):
Abstract vector spaces (3Blue1Brown):
10.2: Dot product and norm
Course Reader:
Vector dot product and vector length (Khan Academy):
An Introduction to the Dot Product (PatrickJMT):
Proving vector dot product properties (Khan Academy):
Dot products and duality (3Blue1Brown):
10.3: Application: partial derivatives and tangent planes
Course Reader:
Partial derivatives, introduction (Khan Academy - Grant Sanderson):
Formal definition of partial derivatives (Khan Academy - Grant Sanderson):
What is a tangent plane (Khan Academy - Grant Sanderson):
Chain rule for partial derivatives of multivariable functions (KristaKing):
10.4: Gradients
Course Reader:
Gradient (Khan Academy - Grant Sanderson):
Gradient and graphs (Khan Academy - Grant Sanderson):
But what *is* a Neural Network? (3Blue1Brown):
Gradient descent, how neural networks learn (3Blue1Brown):
What is backpropagation really doing? (3Blue1Brown):
Backpropagation calculus (3Blue1Brown):