The open archive for STFC research publications

Full Record Details

Persistent URL http://purl.org/net/epubs/work/42069
Record Status Checked
Record Id 42069
Title Adaptive cubic overestimation methods for unconstrained optimization
Abstract An Adaptive Cubic Overestimiation (ACO) algorithm for unconstrained optimization, generalizing a method due to Nesterov & Polyak (Math. Programming 108, 2006, pp177-205), is proposed. At each iteration of Nesterov & Polyak's approach, the global minimizer of a local cubic overestimator of the objective function is determined, and this ensures a significant improvement in the objectice so long as the Hessian of the objective is LIPSchitz continuous and its Lipschitz constants somewhat limit the applicability of such an approach, particularly for large-scale problems. However the promised powerful worst-case theoretical guarantees prompt us to investigate variants in which estimates of the required Lipschitz constant are refined and in which computationally-variable approximations to the global model-minimizer are sought.We show that the excellent global and local convergence properties and worst-case iteration complexity bounds obtained by Nesterov & Polyak are retained, and sometimes extended to a wider class of problems, by our ACO approach. Numerical experiments with small-scale test problems from the CUTEr set show superior performance of the ACO algorithms when compared to a trust-region implementation.
Organisation CSE , STFC
Funding Information
Related Research Object(s):
Language English (EN)
Type Details URI(s) Local file(s) Year
Report RAL Technical Reports RAL-TR-2007-007. 2007. RALTR2007007.pdf 2007
Journal Article Math Program 127, no. 2 (2009): 245-295. doi:10.1007/s10107-009-0286-5 2009