Differentiation
Differentiation¶
All the lesson for this sub-topic focus on obtaining and using derivative (gradient) information for your optimization process. Gradient-based optimization is generally much more efficient than gradient-free methods, hence our focus on efficiently computing derivatives.
This section is rapidly being updated and new topics will be added in the coming weeks.