Geometry of sample sets in derivative-free optimization: Polynomial regression and underdetermined interpolation

Abstract

In recent years there has been a considerable amount of work on the development of numerical methods for derivative-free optimization problems. Some of this work relies on the management of the geometry of sets of sampling points for function evaluation and model building. In this paper we continue the work developed in Math. Program., 111, 141-172) for complete or determined interpolation models (when the number of interpolation points equals the number of basis elements), considering now the cases where the number of points is higher (regression models) and lower (underdetermined models) than the number of basis components. We show that the regression and underdetermined models essentially have similar properties to the interpolation model in that the mechanisms and concepts which control the quality of the sample sets, and hence of the approximation error bounds, of the interpolation models can be extended to the over- and underdetermined cases. We also discuss the trade-offs between using a fully determined interpolation model and the over- or underdetermined ones.