Link Search Menu Expand Document


Welcome to the - an attempt to build an intuitive systematic review of optimization theory, methods, and applications.

The site contains the following parts:

The site has a simple built-in search 🔍. You can use it to find anything you want.

Rules of formatting and contributing could be found on the readme page on the github repo.


  • This site is aimed at researchers and enthusiasts with some prior expertise in the field (not just the Wikipedia clone).
  • The fundamental primitive structure of this site is the page.
  • The page should consists of short self-sufficient material about the topic.
  • If the page is based on paper, bibtex label should be added at the beginning.
  • The general structure of the site is flexible and should be improved over the time iteratively.

Notations and terms

These notations will be used by default (unless otherwise specified)

  • \(\theta\) – optimizing variable
  • \(\mathbb{R}^p\) – \(p\)-dimensional Euclidian space
  • \(\theta^*\) – global optimizer of the problem
  • \(\| \cdot \|\) – norm of the vector(matrix) (if nothing specified, we often use Euclidian (Frobenius) norm)
  • \(\| \cdot \|_*\) – dual norm (norm in dual space) (if nothing specified, we often use Euclidian (Frobenius) norm)