arXiv research

Novel confidence intervals improve convergence rates for sparse kernel-based models.

Origin-destination (OD) matrices are often used in urban planning, where a city is partitioned into regions and an element (i, j) in an OD matrix records the cost (e.g., travel time, fuel consumption, or travel speed) from region i to region j. In this paper, we partition a day into multiple intervals, e.g., 96 15-min …

Conformal prediction improves prediction intervals for PCEs, especially in sparse cases.

Post-processes deep networks with StoNet to quantify uncertainty.

Proposes sparsified intervals for high-dimensional regression coefficients.

In this article the package High-dimensional Metrics (\texttt{hdm}) is introduced. It is a collection of statistical methods for estimation and quantification of uncertainty in high-dimensional approximately sparse models. It focuses on providing confidence intervals and significance testing for (possibly many) low-dim…

The paper improves ranking by integrating covariates and sparse intrinsic scores.

Functional brain networks are well described and estimated from data with Gaussian Graphical Models (GGMs), e.g. using sparse inverse covariance estimators. Comparing functional connectivity of subjects in two populations calls for comparing these estimated GGMs. Our goal is to identify differences in GGMs known to hav…

The package High-dimensional Metrics (\Rpackage{hdm}) is an evolving collection of statistical methods for estimation and quantification of uncertainty in high-dimensional approximately sparse models. It focuses on providing confidence intervals and significance testing for (possibly many) low-dimensional subcomponents…

Confidence intervals based on penalized maximum likelihood estimators such as the LASSO, adaptive LASSO, and hard-thresholding are analyzed. In the known-variance case, the finite-sample coverage properties of such intervals are determined and it is shown that symmetric intervals are the shortest. The length of the sho…

Proposes a method for forecasting large-scale interval-valued time series.

Random Forests provide interpretable prediction intervals with theoretical guarantees.

Introduces neural network for interval-censored survival analysis.

Study improves confidence measures in medical imaging pipelines by addressing bias.

Conformal predictors, introduced by Vovk et al. (2005), serve to build prediction intervals by exploiting a notion of conformity of the new data point with previously observed data. In the present paper, we propose a novel method for constructing prediction intervals for the response variable in multivariate linear mod…

Most of the existing methods for sparse signal recovery assume a static system: the unknown signal is a finite-length vector for which a fixed set of linear measurements and a sparse representation basis are available and an L1-norm minimization program is solved for the reconstruction. However, the same representation…

The group of $\mathcal C^1$-diffeomorphisms of any sparse Cantor subset of a manifold is countable and discrete (possibly trivial). Thompson's groups come out of this construction when we consider central ternary Cantor subsets of an interval. Brin's higher dimensional generalizations $nV$ of Thompson's group $V$ arise…

We develop a novel method for counterfactual analysis based on observational data using prediction intervals for units under different exposures. Unlike methods that target heterogeneous or conditional average treatment effects of an exposure, the proposed approach aims to take into account the irreducible dispersions …

Proposes two-stage robust and sparse distributed inference for large-scale data.

Efficiently estimates Cox model coefficients without sharing data.

New estimators improve Rasch model item parameter estimation for sparse data.

Bayesian framework predicts aerodynamic uncertainty from sparse measurements.

In this study, we analyzed the activity of monkey V1 neurons responding to grating stimuli of different orientations using inference methods for a time-dependent Ising model. The method provides optimal estimation of time-dependent neural interactions with credible intervals according to the sequential Bayes estimation…

Proposes an efficient method for sparse index tracking with $\ell_0$-norm constraints.

The paper proposes a method to infer Q-values online with Q-Learning.

Paper extends sparse alternatives to softmax for continuous domains, enabling efficient attention mechanisms.

In modeling multivariate time series, it is important to allow time-varying smoothness in the mean and covariance process. In particular, there may be certain time intervals exhibiting rapid changes and others in which changes are slow. If such time-varying smoothness is not accounted for, one can obtain misleading inf…

Proposes a method to achieve quantile fairness in predictions.

Adaptive sparse GP model for non-stationary data.

Optimal multitask learning method for sparse heterogeneous datasets.

New method predicts aphasia severity with narrower uncertainty intervals.

Hypothesis testing in the linear regression model is a fundamental statistical problem. We consider linear regression in the high-dimensional regime where the number of parameters exceeds the number of samples ($p> n$). In order to make informative inference, we assume that the model is approximately sparse, that is th…

Unified framework for fair decision-making across diverse groups.

Develops a new method for uncertainty quantification in high-dimensional learning.

We address challenges in estimating parameters from adaptively collected data.

Batteryless or so called passive wearables are providing new and innovative methods for human activity recognition (HAR), especially in healthcare applications for older people. Passive sensors are low cost, lightweight, unobtrusive and desirably disposable; attractive attributes for healthcare applications in hospital…

We study parameter estimation and asymptotic inference for sparse nonlinear regression. More specifically, we assume the data are given by $y = f( x^\top β^* ) + ε$, where $f$ is nonlinear. To recover $β^*$, we propose an $\ell_1$-regularized least-squares estimator. Unlike classical linear regression, the correspondin…

We present a frame-invariant method for detecting coherent structures from Lagrangian flow trajectories that can be sparse in number, as is the case in many fluid mechanics applications of practical interest. The method, based on principles used in graph coloring and spectral graph drawing algorithms, examines a measur…

Low-rank framework for task-specific LLM ranking from sparse comparisons.

This paper develops sparse alternatives to continuous distributions, including new types of Gaussians and attention mechanisms.

New bootstraps improve speed and accuracy for graph count functionals.

Enhances VAR model estimation using transfer learning.

The stochastic gradient descent (SGD) algorithm has been widely used in statistical estimation for large-scale data due to its computational and memory efficiency. While most existing works focus on the convergence of the objective function or the error of the obtained solution, we investigate the problem of statistica…

Although a majority of the theoretical literature in high-dimensional statistics has focused on settings which involve fully-observed data, settings with missing values and corruptions are common in practice. We consider the problems of estimation and of constructing component-wise confidence intervals in a sparse high…

EPICSCORE improves conformal scores by explicitly accounting for epistemic uncertainty.

Motivation: Recent advances in technology for brain imaging and high-throughput genotyping have motivated studies examining the influence of genetic variation on brain structure. Wang et al. (Bioinformatics, 2012) have developed an approach for the analysis of imaging genomic studies using penalized multi-task regressi…

Having a regression model, we are interested in finding two-sided intervals that are guaranteed to contain at least a desired proportion of the conditional distribution of the response variable given a specific combination of predictors. We name such intervals predictive intervals. This work presents a new method to fi…

Graph neural networks learn PDEs from sparse, irregular data.