ISBN: 1-886529-31-0, 978-1-886529-31-1
Publication: June, 2009, 256 pages, hardcover
Table of Contents:
- Basic Concepts of Convex Analysis
- Convex Sets and Functions
- Convex Functions
- Closedness and Semicontinuity
- Operations with Convex Functions
- Characterizations of Differentiable Convex Functions
- Convex and Affine Hulls
- Relative Interior and Closure
- Calculus of Relative Interiors and Closures
- Continuity of Convex Functions
- Closures of Functions
- Recession Cones
- Directions of Recession of a Convex Function
- Nonemptiness of Intersections of Closed Sets
- Closedness Under Linear Transformations
- Hyperplanes
- Hyperplane Separation
- Proper Hyperplane Separation
- Nonvertical Hyperplane Separation
- Conjugate Functions
- Summary
- Convex Sets and Functions
- Basic Concepts of Polyhedral Convexity
- Extreme Points
- Polar Cones
- Polyhedral Sets and Functions
- Polyhedral Cones and Farkas' Lemma
- Structure of Polyhedral Sets
- Polyhedral Functions
- Polyhedral Aspects of Optimization
- Basic Concepts of Convex Optimization
- Constrained Optimization
- Existence of Optimal Solutions
- Partial Minimization of Convex Functions
- Saddle Point and Minimax Theory
- Geometric Duality Framework
- Min Common/Max Crossing Duality
- Some Special Cases
- Connection to Conjugate Convex Functions
- General Optimization Duality
- Optimization with Inequality Constraints
- Augmented Lagrangian Duality
- Minimax Problems
- Strong Duality Theorem
- Existence of Dual Optimal Solutions
- Duality and Polyhedral Convexity
- Summary
- Duality and Optimization
- Nonlinear Farkas' Lemma
- Linear Programming Duality
- Convex Programming Duality
- Strong Duality Theorem - Inequality Constraints
- Optimality Conditions
- Partially Polyhedral Constraints
- Duality and Existence of Optimal Primal Solutions
- Fenchel Duality
- Conic Duality
- Subgradients and Optimality Conditions
- Subgradients of Conjugate Functions
- Subdifferential Calculus
- Optimality Conditions
- Directional Derivatives
- Minimax Theory
- Minimax Duality Theorems
- Saddle Point Theorems
- Theorems of the Alternative
- Nonconvex Problems
- Duality Gap in Separable Problems
- Duality Gap in Minimax Problems
- References
- Index
An insightful, concise, and rigorous treatment of the basic theory of convex sets and functions in finite dimensions, and the analytical/geometrical foundations of convex optimization and duality theory.
Convexity theory is first developed in a simple accessible manner, using easily visualized proofs. Then the focus shifts to a transparent geometrical line of analysis to develop the fundamental duality between descriptions of convex functions in terms of points, and in terms of hyperplanes. Finally, convexity theory and abstract duality are applied to problems of constrained optimization, Fenchel and conic duality, and game theory to develop the sharpest possible duality results within a highly visual geometric framework.
The book may be used as a text for a theoretical convex optimization course; the author has taught several variants of such a course at MIT and elsewhere over the last ten years. It may also be used as a supplementary source for nonlinear programming classes, and as a theoretical foundation for classes focused on convex optimization models (rather than theory). It is an excellent supplement to several of our books: Convex Optimization Algorithms (Athena Scientific, 2009),Nonlinear Programming (Athena Scientific, 1999), Network Optimization (Athena Scientific, 1998), Introduction to Linear Optimization (Athena Scientific, 1997), and Network Flows and Monotropic Optimization (Athena Scientific, 1998).
From the review by Panos Pardalos (Optimization Methods and Sofware, 2010): (Full Review)
"The textbook, Convex Optimization Theory (Athena) by Dimitri Bertsekas, provides a concise, well-organized, and rigorous development of convex analysis and convex optimization theory. Several texts have appeared recently on these subjects ... The text by Bertsekas is by far the most geometrically oriented of these books. It relies on visualization to explain complex concepts at an intuitive level and to guide mathematical proofs. Nearly, all the analysis in the book is geometrically motivated, and the emphasis is on rigorous, polished, and economical arguments, which tend to reinforce the geometric intuition."
From the review by Giorgio Giorgi (Mathematical Reviews, 2012): (Full Review)
"This is another useful contribution to convex analysis and optimization by D. P. Bertsekas, a prolific author who is able to put together a rigorous treatment of the subjects and a skillful didactic presentation. .... Unlike some other books on the same subject (for example the famous book by R. T. Rockafellar ... which does not contain a single figure), the book of Bertsekas abounds in geometrical illustrations of the properties and visual treatments of the problems. ... Some results stem directly from the author's research. Some of the more standard results are not usually found in other conventional textbooks on convexity."
From the review by Wolfgang Weil (Zentralblatt, 2013): (Full Review)
"The major aim of the book is to present the basic material in convex analysis and duality theory with an eye towards optimization problems. Convex sets and functions in finite dimensions are treated in great detail including topological properties, conjugate functions, hyperplane separation and polyhedral convexity. The duality theory developed then is not based on the conjugacy framework but on the closely connected, more geometrical concept of min common/max crossing pairs of points, which the author has invented. ... The concepts and proofs are explained in great clarity and are illustrated by various figures."
Among its features, the book:
- develops rigorously and comprehensively the theory of convex sets and functions, in the classical tradition of Fenchel and Rockafellar
- provides a geometric, highly visual treatment of convex optimization problems, including duality, existence of solutions, and optimality conditions
- includes an insightful and comprehensive presentation of minimax theory and zero sum games, and its connection with duality
- contains many examples and illustrations in the text, and exercises with complete solutions posted on the internet (see below)
- connects with a supplementary freely downloadable, periodically updated chapter on convex optimization algorithms, including novel incremental subgradient methods, proximal and bundle methods, some of Nesterov's optimal complexity algorithms, and a unified framework for inner and outer polyhedral approximation
- is structured to be used conveniently either as a standalone text for a theoretically-oriented class on convex analysis and optimization, or as a theoretical supplement to either an applications/convex optimization models class or a nonlinear programming class
Dimitri P. Bertsekas is McAfee Professor of Engineering at the Massachusetts Institute of Technology and a member of the prestigious United States National Academy of Engineering. He is the recipient of the 2001 A. R. Raggazini ACC education award, the 2009 INFORMS expository writing award, the 2014 Kachiyan Prize, the 2014 AACC Bellman Heritage Award, and the 2015 SIAM/MOS George B. Dantsig Prize.