A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
New algorithms for sampling and optimization without tuning.
New algorithms optimize without tuning, matching tuned SGD performance.
Tuning-free OR-PCA improves scalability for large datasets.
A tuning-free method recovers jointly sparse signals in MMV using implicit regularization.
Robust biclustering method tackles heavy-tailed data issues.
Heterogeneity is often natural in many contemporary applications involving massive data. While posing new challenges to effective learning, it can play a crucial role in powering meaningful scientific discoveries through the understanding of important differences among subpopulations of interest. In this paper, we expl…
New method for NMF without tuning parameter.
Improved ridge estimators avoid tuning parameters for high-dimensional data.
In this paper, we address the challenging problem of selecting tuning parameters for high-dimensional sparse regression. We propose a simple and computationally efficient method, called path thresholding (PaTh), that transforms any tuning parameter-dependent sparse regression algorithm into an asymptotically tuning-fre…
New algorithms learn latent variable models without tuning, outperforming existing methods.
Orthogonal matching pursuit (OMP) is a widely used compressive sensing (CS) algorithm for recovering sparse signals in noisy linear regression models. The performance of OMP depends on its stopping criteria (SC). SC for OMP discussed in literature typically assumes knowledge of either the sparsity of the signal to be e…
New algorithms eliminate stepsize tuning for bilevel optimization problems.
Paper develops robust methods for large-scale testing without tuning parameters.
Introduces PPMM algorithm for nonconvex robust regression problems.
The variance reduction class of algorithms including the representative ones, SVRG and SARAH, have well documented merits for empirical risk minimization problems. However, they require grid search to tune parameters (step size and the number of iterations per inner loop) for optimal performance. This work introduces `…
New algorithm reduces adaptation lag in online model selection.
We address the problem of prediction of multivariate data process using an underlying graph model. We develop a method that learns a sparse partial correlation graph in a tuning-free and computationally efficient manner. Specifically, the graph structure is learned recursively without the need for cross-validation or p…
We address the issue of estimating the topology and dynamics of sparse linear dynamic networks in a hyperparameter-free setting. We propose a method to estimate the network dynamics in a computationally efficient and parameter tuning-free iterative framework known as SPICE (Sparse Iterative Covariance Estimation). The …
We develop a novel method for counterfactual analysis based on observational data using prediction intervals for units under different exposures. Unlike methods that target heterogeneous or conditional average treatment effects of an exposure, the proposed approach aims to take into account the irreducible dispersions …
Proposes a method to quantify uncertainty in PFNs.
Variable selection is of significant importance for classification and regression tasks in machine learning and statistical applications where both predictability and explainability are needed. In this paper, a Copula Entropy (CE) based method for variable selection which use CE based ranks to select variables is propo…
Penalized (or regularized) regression, as represented by Lasso and its variants, has become a standard technique for analyzing high-dimensional data when the number of variables substantially exceeds the sample size. The performance of penalized regression relies crucially on the choice of the tuning parameter, which d…
We introduce algorithms that achieve state-of-the-art \emph{dynamic regret} bounds for non-stationary linear stochastic bandit setting. It captures natural applications such as dynamic pricing and ads allocation in a changing environment. We show how the difficulty posed by the non-stationarity can be overcome by a nov…
Paper develops efficient AltMin algorithm for SRPCP robust matrix recovery.
Following the very recent line of work on the ``generalized min-max'' (GMM) kernel, this study proposes the ``generalized intersection'' (GInt) kernel and the related ``normalized generalized min-max'' (NGMM) kernel. In computer vision, the (histogram) intersection kernel has been popular, and the GInt kernel generaliz…
New variational flows improve Monte Carlo and normalization tasks.
Lasso is a seminal contribution to high-dimensional statistics, but it hinges on a tuning parameter that is difficult to calibrate in practice. A partial remedy for this problem is Square-Root Lasso, because it inherently calibrates to the noise variance. However, Square-Root Lasso still requires the calibration of a t…
Many scientific and engineering applications feature nonsmooth convex minimization problems over convex sets. In this paper, we address an important instance of this broad class where we assume that the nonsmooth objective is equipped with a tractable proximity operator and that the convex constraint set affords a self…
Proposes a tuning-free dynamic pricing method for linear valuation models.
In representation learning and non-linear dimension reduction, there is a huge interest to learn the 'disentangled' latent variables, where each sub-coordinate almost uniquely controls a facet of the observed data. While many regularization approaches have been proposed on variational autoencoders, heuristic tuning is …
AdaSVRG combines adaptive gradient with SVRG for robust optimization.
In this paper, we propose a new method for estimation and constructing confidence intervals for low-dimensional components in a high-dimensional model. The proposed estimator, called Constrained Lasso (CLasso) estimator, is obtained by simultaneously solving two estimating equations---one imposing a zero-bias constrain…
Improves robustness of high-dimensional regression with rank objective and group lasso regularization.
New method estimates precision matrices without models, achieving dense, consistent, and model-free properties.
Flexible Bayesian approach for generalized linear models, especially for sparse logistic regression.
New method tunes SMC samplers efficiently without high costs.
New estimators for intrinsic dimension and Wasserstein distance improve OT accuracy.
RAHMC improves sampling from multimodal distributions using dissipative dynamics.
A new method improves network modeling by mixing multiple models.
BASS efficiently learns time-varying graphs with low complexity and automatic tuning.
BBVI relies on adaptive stochastic optimization algorithms for posterior approximation, but these require extensive tuning.
ELS framework improves safety alignment by dynamically steering LLMs towards helpful responses.
The recently proposed "generalized min-max" (GMM) kernel can be efficiently linearized, with direct applications in large-scale statistical learning and fast near neighbor search. The linearized GMM kernel was extensively compared in with linearized radial basis function (RBF) kernel. On a large number of classificatio…
The method of "random Fourier features (RFF)" has become a popular tool for approximating the "radial basis function (RBF)" kernel. The variance of RFF is actually large. Interestingly, the variance can be substantially reduced by a simple normalization step as we theoretically demonstrate. We name the improved scheme …
STEEL tackles batch RL with singularity, improving policy optimization.
In this paper, we compare 5 different nonlinear kernels: min-max, RBF, fRBF (folded RBF), acos, and acos-, on a wide range of publicly available datasets. The proposed fRBF kernel performs very similarly to the RBF kernel. Both RBF and fRBF kernels require an important tuning parameter (). Interestingly, for a …
Algorithm identifies correct hypothesis from alternatives in bandit problems.
New empirical process bounds reveal trade-off between dependence and complexity in nonparametric learning.