We prove that L2-Boosting lacks a theoretical property which is central to the behaviour of l1-penalized methods such as basis pursuit and the Lasso: Whereas l1-penalized methods are guaranteed to recover the sparse parameter vector in a high-dimensional linear model under an appropriate restricted nullspace property, …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
7 results for “L2-boosting”
Study on L2-boosting behavior as learning rate approaches zero.
problem Understanding the asymptotic behavior of L2-boosting algorithms with vanishing learning rates.
method Analyzes L2-boosting for regression with linear base learners, proving a deterministic limit and characterizing it as a solution to a linear differential equation.
result Proves the existence of a unique solution to the limit problem and analyzes the training and test error.
Diffusion-weighted magnetic resonance imaging (DWI) and fiber tractography are the only methods to measure the structure of the white matter in the living human brain. The diffusion signal has been modelled as the combined contribution from many individual fascicles of nerve fibers passing through each location in the …
Early stopping for kernel boosting algorithms: A general analysis with localized complexitiesstat.ML
Early stopping of iterative algorithms is a widely-used form of regularization in statistics, commonly used in conjunction with boosting and related gradient-type algorithms. Although consistency results have been established in some settings, such estimators are less well-understood than their analogues based on penal…
Kernel-based L2-boosting with structure constraints improves regression efficiency.
problem Developing efficient kernel methods for regression.
method Kernel-based re-scaled boosting with truncation (KReBooT).
result KReBooT achieves near overfitting resistance and sparse estimates.
EarlyStopping package helps prevent overfitting in iterative learning procedures.
problem Preventing overfitting in iterative learning procedures.
method Early stopping implemented in a Python package.
result Demonstrates how to use the EarlyStopping package to explore implicit regularization.
PILOT is a fast algorithm for linear model trees that outperforms existing methods.
problem Fitting linear model trees to large datasets efficiently and accurately.
method Greedy training with boosting and model selection rule.
result PILOT outperforms standard decision trees and other linear model trees on various datasets.