Analytic and Bootstrap-after-Cross-Validation Methods for Selecting Penalty Parameters of High-Dimensional M-Estimators
81 Pages Posted: 13 May 2021 Last revised: 12 Jan 2022
Date Written: January 11, 2022
We develop two new methods for selecting the penalty parameter for the L1-penalized high-dimensional M-estimator, which we refer to as the analytic and bootstrap-after-cross-validation methods. For both methods, we derive nonasymptotic error bounds for the corresponding L1-penalized M-estimator and show that the bounds converge to zero under mild conditions, thus providing a theoretical justification for these methods. We demonstrate via simulations that the finite-sample performance of our methods is much better than that of previously available and theoretically justified methods.
Keywords: penalty parameter selection, penalized M-estimation, high-dimensional models, sparsity, cross-validation, bootstrap,
Suggested Citation: Suggested Citation