Publication
IEEE Trans. Inf. Theory
Paper

Convergence and consistency of regularized boosting with weakly dependent observations

View publication

Abstract

This paper studies the statistical convergence and consistency of regularized boosting methods, where the samples need not be independent and identically distributed but can come from stationary weakly dependent sequences. Consistency is proven for the composite classifiers that result from a regularization achieved by restricting the 1-norm of the base classifiers' weights. The less restrictive nature of sampling considered here is manifested in the consistency result through a generalized condition on the growth of the regularization parameter. The weaker the sample dependence, the faster the regularization parameter is allowed to grow with increasing sample size. A consistency result is also provided for data-dependent choices of the regularization parameter. © 1963-2012 IEEE.

Date

Publication

IEEE Trans. Inf. Theory

Authors

Topics

Share