Sparse PCA: Optimal Rates and Adaptive Estimation

Abstract

[evdate 2013-12-19] HKUST International Forum on Probability and Statistics. Talk no. 21.

Title from slide title.

The Second HKUST International Forum on Probability and Statistics (2013), held 19 December, 2013, at the Hong Kong University of Science and Technology. Co-sponsored by the HKUST Jockey Club Institute for Advanced Study and the Center for Statistical Science.

'Joint work with Zongming Ma & Yihong Wu.'

Abstract: Principal component analysis (PCA) is one of the most commonly used statistical procedures with a wide range of applications. The talk considers both minimax and adaptive estimation of the principal subspace in the high dimensional setting. The optimal rates of convergence are established for estimating the principal subspace which are sharp with respect to all the parameters, thus providing a complete characterization of the difficulty of the estimation problem in term of the convergence rate. Then introduce an adaptive procedure for estimating the principal subspace which is fully data driven and can be computed efficiently. It is shown that the estimator attains the optimal rates of convergence simultaneously over a large collection of the parameter spaces. A key idea in our construction is a reduction scheme which reduces the sparse PCA problem to a high-dimensional multivariate regression problem. This method is potentially also useful for other related problems.

Duration: 33 min.