Learning path

Full curriculum

Full curriculum

Unit content

Convex optimization and global optimality

A convex optimization problem minimizes a convex objective over a convex feasible set.

Its defining advantage is that every local minimum is global. Suppose $x_$ were a local minimum but another feasible point $y$ had $f(y)<f(x_)$. Convexity would make every point sufficiently close to $x_*$ on the segment toward $y$ feasible and give it a lower objective value, contradicting local optimality.

A convex problem can have several global minimizers. If the objective is strictly convex on a convex feasible set, however, it can have at most one minimizer.

Convexity does not automatically make a problem computationally cheap, but it removes deceptive local minima and gives optimization algorithms unusually strong global guarantees.

Linear programs, linear least-squares problems and many regularized objectives are important examples of convex optimization.