article Open AccessTop 1% cited
Simultaneous analysis of Lasso and Dantzig selector
The Annals of Statistics · 2009 · Vol. 37(4)
Peter J. Bickel✉(University of California, Berkeley)Ya’acov Ritov(Hebrew University of Jerusalem)Alexandre B. Tsybakov(Sorbonne Université)
Abstract
We show that, under a sparsity scenario, the Lasso estimator and the Dantzig selector exhibit similar behavior. For both methods, we derive, in parallel, oracle inequalities for the prediction risk in the general nonparametric regression model, as well as bounds on the ℓp estimation loss for 1≤p≤2 in the linear model when the number of variables can be much larger than the sample size.
Statistical Methods and InferenceAdvanced Causal Inference TechniquesStatistical Methods and Bayesian InferenceMathematicsLasso (programming language)EstimatorApplied mathematicsLinear regressionNonparametric regressionRegression analysisGeneralized linear modelStatisticsLinear model
Funding
- National Science Foundation
- Agence Nationale de la Recherche
- Israel Science Foundation
- France-Berkeley Fund
Citations
2,504
FWCI
116.68
field-weighted impact
References
39
Percentile
100%
vs. same field & year
Citations per year
Cited by
On asymptotically optimal confidence regions and tests for high-dimensional models
The Annals of Statistics · 2014 · 785 citations
Stability Selection
Journal of the Royal Statistical Society Series B (Statistical Methodology) · 2010 · 2,054 citations
Large Covariance Estimation by Thresholding Principal Orthogonal Complements
Journal of the Royal Statistical Society Series B (Statistical Methodology) · 2013 · 903 citations
Covariate Balancing Propensity Score
Journal of the Royal Statistical Society Series B (Statistical Methodology) · 2013 · 1,286 citations
Inference on Treatment Effects after Selection among High-Dimensional Controls
The Review of Economic Studies · 2013 · 1,449 citations
Sure Independence Screening for Ultrahigh Dimensional Feature Space
Journal of the Royal Statistical Society Series B (Statistical Methodology) · 2008 · 2,758 citations
Confidence Intervals for Low Dimensional Parameters in High Dimensional Linear Models
Journal of the Royal Statistical Society Series B (Statistical Methodology) · 2013 · 1,013 citations
Regression Shrinkage and Selection via The Lasso: A Retrospective
Journal of the Royal Statistical Society Series B (Statistical Methodology) · 2011 · 3,604 citations
References
Asymptotics for lasso-type estimators
The Annals of Statistics · 2000 · 1,317 citations
High-dimensional graphs and variable selection with the Lasso
The Annals of Statistics · 2006 · 2,433 citations
Least angle regression
The Annals of Statistics · 2004 · 9,400 citations
Stable recovery of sparse overcomplete representations in the presence of noise
IEEE Transactions on Information Theory · 2005 · 2,215 citations
The Group Lasso for Logistic Regression
Journal of the Royal Statistical Society Series B (Statistical Methodology) · 2008 · 1,692 citations
Regression Shrinkage and Selection Via the Lasso
Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1996 · 50,746 citations
Citation Network
How this paper connects to the literature. Drag to explore, click any node to open that paper.
