4.6. Examples

This section collects several examples on how to solve an optimization problem with gradient descent.

• Optimization of a convex function of one variable.

• Optimization of a convex function of many variables.

• Optimization of a nonconvex function of one variable.

• Optimization of a nonconvex function of many variables.

• Optimization of a function subject to a simple equality constraint.