A new method for learning function parameters in operators using data-adaptive RKHS.
problem Learning function parameters in operators with robustness to noise and numerical error.
method Data Adaptive RKHS Tikhonov Regularization (DARTR) method.
result DARTR leads to an accurate estimator robust to noise and numerical error, converging at a consistent rate as data refines.
Method preserves quantiles to ensure fairness in data adaptation.
problem Ensuring fairness in classification and regression models.
method Quantile preservation in causal structural equation models.
result Fairness guarantees for classifiers trained on adapted data.
A new data-adaptive prior stabilizes kernel learning in operators.
problem Learning kernels in operators from data is ill-posed due to nonlocal dependence.
method Introduces a data-adaptive prior to stabilize the Bayesian posterior mean.
result The data-adaptive prior achieves a stable posterior with small noise limits.
This paper improves OMP-based sparse subspace clustering with data-adaptive capability.
problem Existing OMP-based approaches lack data adaptiveness, leading to inaccurate data representation.
method Develops a parameter selection process to adjust OMP parameters based on data distribution and introduces a new SEA ratio metric.
result Proposed approach achieves better clustering accuracy, SEA ratio, and representation quality compared to other OMP-based methods.
Proposes a new method for learning flexible nonparametric kernels.
problem Improving model flexibility in margin-based kernel methods.
method Data-adaptive non-parametric kernel learning framework with two constraints.
result Enhanced model flexibility and improved performance on benchmark data sets.
Generative models learn better with data-adaptive noise.
problem Learning heavy-tailed distributions in flow-based models.
method Data-adaptive latent noise using 1D quantile functions optimized via Wasserstein distance.
result Flexibility and effectiveness in learning heavy-tailed and compactly supported distributions.
MVTV improves interpretability in low-dimensional regression.
problem Estimating regression functions with few features and high interpretability needs.
method MVTV divides space into blocks, fits values jointly, and optimizes automatically.
result MVTV outperforms CART and CRISP in both complexity and human interpretability studies.
New method for valid inference from ML-predicted data.
problem Invalid scientific conclusions from ML-predicted outcomes.
method Assumption-Lean and Data-Adaptive Post-Prediction Inference (PSPA)
result Valid and powerful inference based on ML-predicted data.
DFIV uses deep features for IV regression, achieving optimal rates.
problem Optimal IV regression with deep features for complex target functions.
method Two-stage approach: deep feature learning followed by IV regression.
result DFIV achieves minimax optimal learning rate under certain conditions.
Proposes a robust Q-learning method to improve treatment strategy estimation.
problem Misspecification of working models in Q-learning leads to confounding and efficiency loss.
method Uses data-adaptive techniques to estimate nuisance parameters robustly.
result Asymptotic behavior of robust Q-learning estimators is studied and shown to be useful.
Paper presents a new doubly robust estimator for survival analysis with improved consistency.
problem Consistency of doubly robust estimators in high dimensions with flexible data-adaptive methods.
method Data-adaptive regression estimators, Gaussianization, cross-fitting.
result The estimator converges at n1/2 rate for a large class of data-adaptive nuisance estimators. X-VAE uses data-adaptive Gaussian priors to improve latent space modeling.
problem Limitations of standard Gaussian priors in complex datasets.
method Data-adaptive Gaussian prior derived from pretrained autoencoder latent codes.
result Improved latent space modeling and generation quality.
Algorithm calculates distances between US counties based on people living there.
problem Defining a network graph for large, non-i.i.d. data sets.
method Co-clustering diffusion metric and data adaptive transportation cost.
result Approximate Earth Mover's Distance for US county comparisons.
New algorithms for model selection in linear contextual bandits without feature diversity conditions.
problem Model selection in linear contextual bandits without feature diversity conditions.
method Data-adaptive algorithms that provide model selection guarantees without feature diversity conditions.
result O(d^α T^{1-α}) model selection guarantees with no feature diversity conditions.
Proposes a new method for kernel density estimation using stagewise minimization and a simple dictionary.
problem Kernel density estimation with data-adaptive weighting parameters and sparse representation.
method Stagewise minimization algorithm based on U-divergence and a simple dictionary. result Develops non-asymptotic error bound for the proposed estimator.
Oblique BART improves tree-based predictions.
problem Axis-aligned decision rules in BART can be suboptimal.
method Developed an oblique version of BART using data-adaptive hyperplane partitions.
result Oblique BART outperformed axis-aligned BART and other tree methods on benchmarks.
Enhances patient failure prediction using dynamic survival models.
problem Lack of precise individual level prediction in conventional models.
method Developed counterfactual dynamic survival model (CDSM).
result Inflection point of estimated survival curves predicts patient failure time.
TSCI estimates treatment effects using machine learning and data-adaptive methods for invalid instruments.
problem Estimating treatment effects with invalid instruments.
method Two-stage algorithm: first stage uses machine learning for nonlinearities, second stage selects and projects out instrument violations.
result Effective treatment effect estimation even with invalid instruments.
DALTON improves ODE parameter estimation by learning from noisy data.
problem High sensitivity to parameters in ODEs produces unreliable parameter estimates.
method Data-adaptive probabilistic likelihood approximation for ODEs.
result DALTON produces more accurate parameter estimates than existing methods.
Proposes a new method for estimating non-pathwise differentiable functional parameters.
problem Estimating dose-response curves for continuous exposure.
method Targeted Highly Adaptive Lasso (HAL) for non-pathwise differentiable functional parameters.
result The Targeted HAL-MLE achieves dimension-free rates up to log(n) factors and outperforms other methods in simulations.
AdaDPSyn generates synthetic examples to protect private data in ICL.
problem Protecting private data in in-context learning with large language models.
method Data-adaptive differentially private algorithm that dynamically adjusts noise level based on data properties.
result AdaDPSyn outperforms existing methods in preserving high ICL accuracy while maintaining differential privacy.
New adaptive strategy for active learning with smooth boundaries.
problem Adaptive active learning in multivariate classification with unknown distributional parameters.
method Combining insights from recent works, reduction to univariate-adaptive strategies.
result Near-optimal rates achieved without prior knowledge of distributional parameters.
HS-MoE selects sparse experts using adaptive priors and data-adaptive gating.
problem Sparse expert selection in mixture-of-experts architectures.
method Combines horseshoe prior with input-dependent gating for data-adaptive sparsity.
result Data-adaptive sparsity in expert usage.
Linear regression is arguably the most prominent among statistical inference methods, popular both for its simplicity as well as its broad applicability. On par with data-intensive applications, the sheer size of linear regression problems creates an ever growing demand for quick and cost efficient solvers. Fortunately…
Method learns SDEs from one trajectory using GP priors and randomized cross-validation.
problem Learning SDEs from a single trajectory.
method Combining CGC and data-adapted kernels learned via randomized cross-validation.
result Efficacy, robustness, and scope of the method demonstrated in numerical experiments.
ICT improves semi-supervised learning by making predictions consistent at data interpolations.
problem Improving semi-supervised learning performance with limited labeled data.
method ICT encourages consistent predictions at data interpolations, reducing overfitting.
result ICT achieves state-of-the-art performance on CIFAR-10 and SVHN datasets.
DoubleAdapt improves stock trend forecasting by adapting models to evolving data.
problem Incremental learning for stock trend forecasting is challenging due to distribution shifts.
method DoubleAdapt framework with two adapters for data and model adaptation.
result DoubleAdapt achieves state-of-the-art predictive performance on real-world stock datasets.
FONT clusters patients across health systems with privacy and efficiency.
problem Challenges in multi-site cluster analysis due to data-sharing restrictions.
method Federated One-shot Ensemble Clustering (FONT) algorithm that requires only a single round of communication and exchanges only fitted model parameters and class labels.
result FONT improves consistency of patient clusters across sites compared to locally fitted clusters.
Develops an anomaly detection system using synthetic data.
problem Automatic anomaly detection for meteorological time-series.
method Constructs an ensemble of anomaly detectors using synthetic data and adaptive threshold selection.
result Demonstrates the efficiency of the method in a real-world application.
Gradient descent reshapes the function space of neural networks.
problem Understanding how feature learning affects the function space of neural networks.
method Characterized the evolution of the feature space during training using a two-layer neural network.
result Gradient descent induces a data-adaptive deformation that selectively enhances signal-aligned directions.
Iterative shrinkage/thresholding algorithm (ISTA) is a well-studied method for finding sparse solutions to ill-posed inverse problems. In this letter, we present a data-driven scheme for learning optimal thresholding functions for ISTA. The proposed scheme is obtained by relating iterations of ISTA to layers of a simpl…
Proposes new methods for inference in GLMs without assuming model correctness.
problem Inference for GLMs assumes model correctness, leading to uncertainty and bias.
method Develops nonparametric estimands and uses influence curves with flexible procedures.
result Inference for GLM parameters is improved without model correctness assumptions.
New insights on bias in multi-armed bandits under conditional sampling.
problem Understanding bias in multi-armed bandits under conditional sampling.
method Characterized the sign of conditional bias of monotone functions of rewards.
result Sign of conditional bias can differ from marginal bias, depending on conditioning events.
Study identifies unique minimizers for interaction kernels in particle systems.
problem Identifying unique interaction kernels in mean-field equations of interacting particles.
method Data-adaptive L2 spaces, RKHS analysis, regularization. result Characterization of identifiability in both finite and infinite particle systems.
Improved forecasting for irregularly-sampled time series using kernel flows.
problem Forecasting dynamical systems from irregularly-sampled time series data.
method Directly approximating the vector field using time differences in data-adapted kernels.
result Significant improvement in forecasting accuracy compared to classical methods.
Novel method for time-series prediction with tighter confidence intervals.
problem Improving prediction intervals for time-series data.
method Kernel-based Optimally Weighted Conformal Prediction Intervals (KOWCPI) using adaptive weights.
result KOWCPI achieves narrower confidence intervals with guaranteed coverage.
Improves numerical solution of ill-conditioned linear systems for machine learning.
problem Wastefulness and instability in solving ill-conditioned linear systems.
method autonugget combines Richardson extrapolation to determine the solution of the ill-conditioned system, improving accuracy over a single nugget.
result Improves accuracy of numerical solution of ill-conditioned linear systems.
HAR regression improves performance on small datasets.
problem Small datasets with complex functions.
method Data-adaptive kernel ridge regression using tensor-product spline basis.
result Achieves n−1/3 convergence rate for right-continuous functions. ADML combines debiased learning with data-driven model selection for efficient inference.
problem Debiased machine learning estimators can be unstable and biased in nonparametric models.
method Data-driven model selection techniques combined with debiased machine learning.
result ADML estimators yield superefficient inference for pathwise differentiable parameters.
Current statistical inference problems in areas like astronomy, genomics, and marketing routinely involve the simultaneous testing of thousands -- even millions -- of null hypotheses. For high-dimensional multivariate distributions, these hypotheses may concern a wide range of parameters, with complex and unknown depen…
This work proves convergence of adaptive resampling for random Fourier features.
problem Sampling Fourier frequencies well for high-dimensional data.
method Data adaptive resampling of Fourier frequencies, asymptotically optimal.
result Proves convergence of adaptive resampling method for regression and classification problems.
Paper proposes a new method for imputing missing biomedical data.
problem Missing values in biomedical data.
method Monte Carlo Dropout within Autoencoders.
result The method improves imputation error and predictive similarity.
Method selects the best deep learner for time-series prediction using Bayesian networks.
problem Selecting the most effective deep learning model for time-series prediction.
method Bayesian network selects deep learners based on input variables and cluster training data.
result Threshold value determines which deep learners predict time-series data robustly.
Flexible method for estimating frequencies in large datasets using sketching.
problem Estimating frequencies in very large datasets efficiently and accurately.
method Data-adaptive conformal inference method based on a smaller sketch of data.
result Proves validity of frequentist confidence intervals under data exchangeability.
We consider the problem of estimating a regression function in the common situation where the number of features is small, where interpretability of the model is a high priority, and where simple linear or additive models fail to provide adequate performance. To address this problem, we present GapTV, an approach that …
Efficiently constructs prediction bands with minimal assumptions.
problem Uncertainty quantification for nonparametric, heteroscedastic data.
method Semi-definite programming for data-adaptive prediction bands.
result Strong non-asymptotic coverage properties with minimal distributional assumptions.
Statistical machine learning plays an important role in modern statistics and computer science. One main goal of statistical machine learning is to provide universally consistent algorithms, i.e., the estimator converges in probability or in some stronger sense to the Bayes risk or to the Bayes decision function. Kerne…
We analyze the consistency of decision trees and random forests in regression.
problem Consistency of decision trees and random forests in regression.
method Elementary proofs following classical arguments for smoothing methods.
result Establish weak and almost sure convergence of honest trees and forest averages to the true regression function.