E&E uses contrastive learning to speed up SBI for high-dimensional systems.
problem Challenges in training high-dimensional emulators for complex systems.
method Contrastive learning for low-dimensional latent embedding and fast emulator.
result Superior performance in non-identifiable parameter estimation tasks.
IBPF algorithm tackles high-dimensional parameter learning for complex systems.
problem Learning high-dimensional parameters in complex, partially observed, and nonlinear systems.
method Iterated Block Particle Filter (IBPF) for graphical state space models.
result IBPF algorithm consistently beats the curse of dimensionality across various experiments.
Penalized (or regularized) regression, as represented by Lasso and its variants, has become a standard technique for analyzing high-dimensional data when the number of variables substantially exceeds the sample size. The performance of penalized regression relies crucially on the choice of the tuning parameter, which d…
Paper efficiently infers differential parameters in time-varying models using time score matching.
problem Efficiently inferring differential parameters in time-varying probabilistic models.
method Directly estimates the differential parameter using time score matching and proves consistency of the method.
result Consistent estimation of parameter derivatives in high-dimensional settings.
Improved ridge estimators avoid tuning parameters for high-dimensional data.
problem Difficulty in calibrating tuning parameters for ridge estimators.
method Developed modified ridge estimators that eliminate tuning parameters.
result Modified ridge estimators outperform standard methods in prediction accuracy.
A privacy-preserving algorithm for high-dimensional bandits.
problem High-dimensional stochastic contextual linear bandits with sparse parameters under privacy constraints.
method PrivateLASSO algorithm based on sparse hard-thresholding and episodic thresholding.
result Minimax private lower bounds and utility guarantees for PrivateLASSO.
In this article the package High-dimensional Metrics (\texttt{hdm}) is introduced. It is a collection of statistical methods for estimation and quantification of uncertainty in high-dimensional approximately sparse models. It focuses on providing confidence intervals and significance testing for (possibly many) low-dim…
SGE-Kriging reduces high-dimensional surrogate modelling costs.
problem High-dimensional function approximation for expensive models.
method Splitting training data into slices, using sliced likelihood function, and learning hyper-parameters from sensitivity indices.
result SGE-Kriging achieves comparable accuracy to standard GE-Kriging but with lower training costs.
We provide a general theory of the expectation-maximization (EM) algorithm for inferring high dimensional latent variable models. In particular, we make two contributions: (i) For parameter estimation, we propose a novel high dimensional EM algorithm which naturally incorporates sparsity structure into parameter estima…
A scalable method for accurate inference of low-dimensional parameters in high-dimensional linear regression.
problem Statistical inference for low-dimensional parameters in high-dimensional linear regression models.
method Mean-field variational Bayes approach, focusing on nuisance parameters and conditional distributions.
result Competitive numerical performance and theoretical guarantees for estimation and uncertainty quantification.
Paper analyzes adaptive Lasso for high-dimensional diffusion processes, improving support recovery and bias.
problem Support recovery for high-dimensional diffusion processes under sparsity constraints.
method Adaptive Lasso estimator for d-dimensional ergodic diffusion process, focusing on linear models.
result Adaptive Lasso achieves support recovery and asymptotic normality for drift parameter under certain conditions.
We present a new method for high-dimensional linear regression when a scale parameter of the additive errors is unknown. The proposed estimator is based on a penalized Huber M-estimator, for which theoretical results on estimation error have recently been proposed in high-dimensional statistics literature. However, t…
Two-parameter models can learn high-dimensional targets via gradient flow.
problem Learning high-dimensional targets with limited parameters.
method Gradient flow approach for W<d models. result Two-parameter models can learn targets with arbitrarily high success probability.
The package High-dimensional Metrics (\Rpackage{hdm}) is an evolving collection of statistical methods for estimation and quantification of uncertainty in high-dimensional approximately sparse models. It focuses on providing confidence intervals and significance testing for (possibly many) low-dimensional subcomponents…
Estimates high-dimensional posterior densities by marginal distributions and neural networks.
problem High-dimensional probability density estimation for inference is difficult.
method Direct estimation of lower-dimensional marginal distributions, using Moment Networks for fast computation of moments.
result Demonstrates estimation of gravitational wave time series and applications in cosmology.
Estimates CATEs using high-dimensional linear regression models.
problem Estimating individualized causal effects (CATEs) in two treatments.
method Proposes a Lasso regression method for consistently estimating CATEs under high-dimensional and non-sparse parameters, leveraging the assumption of implicit sparsity.
result The proposed method is consistent for estimating CATEs.
Paper tackles high-dimensional quantile regression with distribution shift using transfer learning.
problem Efficiency of knowledge transfer is severely impacted by distribution shift in high-dimensional regression.
method Proposes a novel transferable set and framework for three types of distribution shift: parameter, covariate, and residual.
result Establishes estimation error bounds and source detection consistency for the proposed method.
High-dimensional predictive models, those with more measurements than observations, require regularization to be well defined, perform well empirically, and possess theoretical guarantees. The amount of regularization, often determined by tuning parameters, is integral to achieving good performance. One can choose the …
Scalable approach for high-dimensional dynamical systems with noise filtering and parameter estimation.
problem Noise filtering and parameter estimation for high-dimensional dynamical systems.
method Flexible latent factor model with orthogonal factor loading matrix and closed-form parameter estimation.
result Substantial acceleration and higher accuracy compared to alternatives.
Proposes an EM algorithm for high-dimensional Markov-switching VAR models.
problem Estimating regime shifts in high-dimensional time series data.
method Approximate EM algorithm for Markov-switching VAR models.
result Established consistency of the proposed EM algorithm in high dimensions.
Our article considers a Gaussian variational approximation of the posterior density in a high-dimensional state space model. The variational parameters to be optimized are the mean vector and the covariance matrix of the approximation. The number of parameters in the covariance matrix grows as the square of the number …
Unified framework for high-dimensional bandit problems with low-dimensional structures.
problem Stochastic high-dimensional bandit problems with low-dimensional structures.
method Proposed a simple unified algorithm and a general analysis framework for the regret upper bound.
result Unified algorithm achieves comparable regret bounds in various high-dimensional bandit problems.
Estimates change point in high dimensional time series models.
problem Change point estimation in high dimensional time series.
method Plug-in least squares estimator with sufficient conditions for adaptivity.
result Optimal rate of convergence Op(ξ−2) in integer scale. Optimizes parameters in high-dimensional spaces for practical applications.
problem Tuning parameters for complex systems like electron accelerators.
method Bayesian optimization techniques applied to high-dimensional problems.
result Novel algorithm BORING for parameter optimization.
New method for efficient inference over complex parameter spaces.
problem Challenges in Bayesian inference for high-dimensional, intractable likelihoods.
method Arbitrary Marginal Neural Ratio Estimation (AMNRE) for simulation-based inference.
result Efficient inference over arbitrary subsets of parameters without numerical integration.
New method uses sparse deep neural networks for high-dimensional regression with improved parameter estimation.
problem Improving parameter estimation in high-dimensional sparse regression models.
method Proposes nonparametric estimation of partial derivatives in sparse deep neural networks.
result Established convergence rate of nonparametric estimation of partial derivatives as O(n−1/4). The paper provides guarantees for high-dimensional DML estimators in observational studies.
problem Estimating treatment effects in observational settings with many covariates.
method Debiased machine learning (DML) with finite-sample guarantees.
result Bounding the deviation of finite-sample distribution from asymptotic Gaussian approximation.
PROBE algorithm efficiently solves sparse high-dimensional linear regression.
problem Sparse high-dimensional linear regression models with complex parameter spaces.
method Partitioned empirical Bayes ECM algorithm for computationally efficient MAP estimation.
result PROBE algorithm provides robust and efficient coordinate-wise optimization.
In this paper, we address the challenging problem of selecting tuning parameters for high-dimensional sparse regression. We propose a simple and computationally efficient method, called path thresholding (PaTh), that transforms any tuning parameter-dependent sparse regression algorithm into an asymptotically tuning-fre…
Improved global minimum-variance portfolios using cross-validation for high-dimensional covariance estimation.
problem Ill-conditioned sample covariance matrix in high-dimensional data leads to suboptimal portfolios.
method Cross-validation technique to select tuning parameters for efficient covariance matrix estimation methods.
result Data-driven tuning parameters improve out-of-sample performance of global minimum-variance portfolios.
Paper proposes a new sparsity scheme for high-dimensional VAR models.
problem Estimation of high-dimensional VAR models with sparsity assumptions.
method Regularized estimation procedures for sparse VAR models.
result Threholding extends consistency properties of regularized estimators.
We propose a minimum distance estimation method for robust regression in sparse high-dimensional settings. The traditional likelihood-based estimators lack resilience against outliers, a critical issue when dealing with high-dimensional noisy data. Our method, Minimum Distance Lasso (MD-Lasso), combines minimum distanc…
Efficient Bayesian LMM framework for high-dimensional longitudinal data.
problem Scalability and dependence in high-dimensional longitudinal data.
method Partitioned empirical Bayes ECM algorithm for scalable MAP estimation.
result Identification of genes and clinical factors associated with a lupus biomarker.
A new method for Bayesian inference tackles high-dimensional problems.
problem Bayesian inference in high-dimensional settings with kernel density estimation issues.
method Projected Wasserstein gradient descent (pWGD) method to overcome curse of dimensionality.
result pWGD method effectively addresses high-dimensional Bayesian inference problems.
Method detects effects of synthesis parameters on plutonium oxide microstructure.
problem Detecting effects of synthesis parameters on material microstructure.
method Copula theory, high dimensional distribution distances, and permutational statistics.
result Effects of strike order and oxalic acid feed on plutonium oxide microstructure detected.
Bayesian method uses data spectra to estimate non-sparse high-dimensional models.
problem Handling many parameters in high-dimensional Bayesian statistics.
method Data-adaptive Gaussian prior aligned with leading eigenvectors of sample covariance.
result Posterior contraction rates reveal the effect of spectral mass on prediction error.
Paper proposes tensor-based method for semiconductor manufacturing process control.
problem Challenges of traditional process control methods in high-dimensional image-based overlay errors.
method Builds a high-dimensional process model, proposes tensor-on-vector regression algorithms, designs EWMA controller for tensor data.
result The method reduces overlay errors using limited control recipes and is superior especially when disturbances are not stable.
We propose a likelihood ratio based inferential framework for high dimensional semiparametric generalized linear models. This framework addresses a variety of challenging problems in high dimensional data analysis, including incomplete data, selection bias, and heterogeneous multitask learning. Our work has three main …
We prove that L2-Boosting lacks a theoretical property which is central to the behaviour of l1-penalized methods such as basis pursuit and the Lasso: Whereas l1-penalized methods are guaranteed to recover the sparse parameter vector in a high-dimensional linear model under an appropriate restricted nullspace property, …
FsNet selects features for high-dimensional biological data efficiently.
problem Efficient feature selection for high-dimensional biological data.
method FsNet combines selection and reconstruction layers with tiny networks for weight prediction.
result FsNet outperforms standard DNNs on high-dimensional biological datasets.
New method speeds up Bayesian inference for complex simulators.
problem Challenges in Bayesian inference for complex stochastic simulators with intractable likelihood functions.
method Optimization Monte Carlo framework reformulated as deterministic optimization problems with gradient-based methods.
result Accurate posterior inference with reduced runtimes compared to existing methods.
A new method reduces high-dimensional data's impact on CWMs using TSNE.
problem High-dimensional data hampers CWMs' accuracy and speed.
method TSNE for dimensionality reduction, parsimonious technique, expectation maximization.
result TSNE enhances CWMs' performance in high-dimensional space.
New method for estimating and testing impulse responses in high-dimensional VAR systems.
problem Statistical inference for impulse responses in sparse, high-dimensional vector autoregressions.
method Local projection equations and de-sparsified estimators combined with a non-regularized contemporaneous impact matrix.
result Valid inference procedures for structural impulse responses in high-dimensional systems.
Bayesian model tackles high-dimensional inverse problems efficiently.
problem Estimating spatially-varying parameters in expensive models.
method Multiscale Bayesian inference with deep generative models and MCMC.
result Efficient estimation of global and local parameter features.
Paper supports robust estimation in regression with heavy-tailed errors.
problem Support estimation in high-dimensional heteroscedastic mean regression.
method Use of Huber loss function and adaptive LASSO penalty for robust estimation.
result Sign-consistency and optimal rates of convergence in ℓ∞ norm. As machine learning systems get widely adopted for high-stake decisions, quantifying uncertainty over predictions becomes crucial. While modern neural networks are making remarkable gains in terms of predictive accuracy, characterizing uncertainty over the parameters of these models is challenging because of the high d…
We consider learning high-dimensional multi-response linear models with structured parameters. By exploiting the noise correlations among responses, we propose an alternating estimation (AltEst) procedure to estimate the model parameters based on the generalized Dantzig selector. Under suitable sample size and resampli…
We study the parameter estimation problem for a varying index coefficient model in high dimensions. Unlike the most existing works that iteratively estimate the parameters and link functions, based on the generalized Stein's identity, we propose computationally efficient estimators for the high-dimensional parameters w…