Taylor Series

Basic Univariate Differentiation Rules

Partial Differentiation and Gradients

Multivariate Differentiation Rules

Identities for Computing Gradients

Backpropagation and Automatic Differentiation

Higher-Order Derivatives