Study of Langevin algorithm in noisy high-dimensional inference.
problem Analyzing the Langevin algorithm's performance in noisy high-dimensional inference.
method Analytic study of Langevin algorithm's performances using the spiked matrix-tensor model.
result The algorithmic threshold of the Langevin algorithm is sub-optimal compared to AMP.
This paper presents a unified geometric framework for the statistical analysis of a general ill-posed linear inverse model which includes as special cases noisy compressed sensing, sign vector recovery, trace regression, orthogonal matrix estimation, and noisy matrix completion. We propose computationally feasible conv…
Proposes a method to compare noisy high-dimensional datasets with low-dimensional manifolds.
problem Comparing distributions on manifolds in noisy high-dimensional datasets.
method Linking low-rank structure to manifold geometry, developing a scale-invariant distance measure.
result Superior robustness and statistical power compared to existing methods.
GEnBP combines EnKF and GaBP for efficient high-dimensional inference.
problem Efficient inference in high-dimensional models.
method Gaussian Ensemble Belief Propagation algorithm combining EnKF and GaBP.
result GEnBP outperforms existing methods in accuracy and efficiency.
New method uses noisy function evaluations for sampling Langevin diffusions.
problem Difficulty in obtaining gradient evaluations for Langevin diffusions.
method Stochastic zeroth-order discretizations of Langevin diffusions using Gaussian Stein's identities.
result Comprehensive sample complexity analysis for both overdamped and underdamped Langevin diffusions.
Efficiently estimates privacy-revealing data distributions using graphical models.
problem Estimating answers to new queries from noisy measurements of a high-dimensional distribution.
method Uses graphical models to solve the estimation problem efficiently, especially for low-dimensional marginals.
result Significantly more efficient than existing techniques and improves accuracy and scalability.
Sparse group Lasso optimizes sparse and grouped parameters in high-dimensional data.
problem Simultaneously sparse and grouped parameters in high-dimensional linear regression.
method Sparse group Lasso, debiased sparse group Lasso, statistical inference.
result Matching upper and lower bounds on sample complexity and estimation error.
Deep learning for stochastic systems with multi-fidelity data.
problem Predicting stochastic, high-dimensional, and multi-fidelity systems with uncertainty.
method Probabilistic deep learning with variational inference for implicit distributions.
result Effective surrogate models for stochastic systems with quantified uncertainty.
Efficiently infers coupled hidden Markov models with noisy discrete observations.
problem Intractable inference for coupled continuous-time Markov chains with discrete observations.
method Latent Interacting Particle Systems, look-ahead functions, twisted Sequential Monte Carlo sampling.
result Demonstrated effectiveness on latent SIRS model and wildfire spread dynamics.
Study improves Gaussian Process Latent Variable Model for noisy longitudinal data.
problem Noisy and incomplete longitudinal data makes learning representations difficult.
method Augment variational approximation with systematic samples of unseen observations.
result Demonstrates improved learning of Gaussian Process Dynamical Systems in noisy data.
DeepRec uses deep learning to recover signals from one-bit measurements.
problem Signal recovery from one-bit noisy measurements.
method Deep unfolding of inference optimization into deep neural network layers.
result DeepRec improves accuracy and computational efficiency.
Recent progress in variational inference has paid much attention to the flexibility of variational posteriors. One promising direction is to use implicit distributions, i.e., distributions without tractable densities as the variational posterior. However, existing methods on implicit posteriors still face challenges of…
To model modern large-scale datasets, we need efficient algorithms to infer a set of P unknown model parameters from N noisy measurements. What are fundamental limits on the accuracy of parameter inference, given finite signal-to-noise ratios, limited measurements, prior information, and computational tractability …
We propose a novel Bayesian approach to solve stochastic optimization problems that involve finding extrema of noisy, nonlinear functions. Previous work has focused on representing possible functions explicitly, which leads to a two-step procedure of first, doing inference over the function space and second, finding th…
The paper improves matrix completion with auxiliary covariates using LS estimation.
problem Matrix completion with noisy data and auxiliary covariates.
method Iterative least squares estimation with statistical properties derived.
result Asymptotic normal distributions of estimators for low-rank matrix and coefficient matrix.
BaGGLS models biological interactions using Bayesian shrinkage for interpretability.
problem Interpreting complex interactions in high-dimensional biological data.
method Bayesian group global-local shrinkage prior with variational approximation.
result BaGGLS outperforms other methods in interaction detection and scalability.
Regularization helps improve classification of noisy high-dimensional data.
problem Classifying high-dimensional noisy Gaussian mixture with limited oracle knowledge.
method Analysis of regularized convex classifiers including ridge, hinge, and logistic regression.
result Regularization can reach Bayes-optimal performance under certain conditions.
Unified framework for simulation-based inference learns a single model for multiple tasks.
problem Simulation-based inference for multiple tasks with limited model retraining.
method Unified flow-matching generative model with query-aware masking distribution.
result Competitive performance on various inference tasks and real-world problems.
Polynomial-time algorithm for inferring high-dimensional linear regression from a single sample.
problem Inferring an unknown feature vector from linear measurements in high dimensions without sparsity assumptions.
method Combining PSLQ integer relation detection and LLL lattice basis reduction algorithms.
result Polynomial-time recovery of β∗ from linear measurements Y=Xβ∗, even with one sample. This study optimizes multi-modal learning thresholds and algorithms in high dimensions.
problem Optimizing multi-modal learning performance in high-dimensional data.
method Analytical quantification and derivation of AMP algorithm with state evolution analysis.
result Bayes-optimal performance and recovery thresholds derived for multi-modal data.
Method learns low-dim. state vars from noisy high-dim. data.
problem Discovering dynamical models from noisy high-dimensional data.
method Stochastic Variational Deep Kernel Learning with encoder and latent model.
result Effective denoising, compact state representation, and uncertainty quantification.
The paper tackles noisy labels in high-dimensional data, showing low-dimensional intuitions fail and proposing an optimized method.
problem Noisy labels in high-dimensional data classification.
method Linear classifier with a label noisiness aware loss function, using random matrix theory and Gaussian mixture data model.
result The performance of the linear classifier in high-dimension converges to a limit involving scalar statistics of the data, and the optimal classifier in low-dimension fails.
We present a novel view of nonlinear manifold learning using derivative-free optimization techniques. Specifically, we propose an extension of the classical multi-dimensional scaling (MDS) method, where instead of performing gradient descent, we sample and evaluate possible "moves" in a sphere of fixed radius for each …
Framework uses diffusion models to infer material properties from noisy mechanical measurements.
problem Inference of spatially varying material properties from noisy mechanical responses.
method Conditional score-based diffusion models approximating the score function of a conditional distribution.
result Framework can efficiently solve large-scale physics-based inverse problems.
When recovering an unknown signal from noisy measurements, the computational difficulty of performing optimal Bayesian MMSE (minimum mean squared error) inference often necessitates the use of maximum a posteriori (MAP) inference, a special case of regularized M-estimation, as a surrogate. However, MAP is suboptimal in…
GANs used as priors for Bayesian inference of high-dimensional fields.
problem Bayesian inference challenges with high-dimensional, complex priors.
method GANs learn field distribution, used as prior in Bayesian update.
result GAN-prior approach addresses high-dimensional, complex priors.
Proposes ACP for efficient inference in noisy-or models.
problem Efficient inference in noisy-or models.
method Hybrid approach combining classical and modern variational inference.
result ACP outperforms or matches other approaches in noisy-or models.
VBMC+VIQR outperforms noisy models in Bayesian inference.
problem Bayesian inference with noisy likelihoods in complex models.
method Gaussian process surrogates, expected information gain, variational interquantile range.
result VBMC+VIQR achieves state-of-the-art performance in noisy inference benchmarks.
We propose a new inferential framework for constructing confidence regions and testing hypotheses in statistical models specified by a system of high dimensional estimating equations. We construct an influence function by projecting the fitted estimating equations to a sparse direction obtained by solving a large-scale…
DIVI clusters noisy high-dimensional data with stable feature gating.
problem Challenging clustering in high-dimensional noisy data.
method Data-informed variational clustering framework combining global feature gating and adaptive structure growth.
result DIVI performs competitively under severe feature noise and remains computationally feasible.
Robustly infers manifold density and geometry under high-dimensional noise.
problem Inaccurate kernel density estimation under high-dimensional noise.
method Doubly stochastic normalization of Gaussian kernel.
result Robust tools for density estimation, noise magnitude estimation, and distance approximation.
The abundance of data produced daily from large variety of sources has boosted the need of novel approaches on causal inference analysis from observational data. Observational data often contain noisy or missing entries. Moreover, causal inference studies may require unobserved high-level information which needs to be …
DAISI improves data assimilation for complex systems with noisy observations.
problem Limited accuracy of classical DA methods in complex, nonlinear systems.
method Generative models with inverse sampling for flexible probabilistic inference.
result DAISI achieves accurate filtering results in challenging nonlinear systems.
New method infers co-expression networks robustly from multiple studies.
problem Challenges in inferring co-expression networks from transcriptome data.
method Robust method based on multivariate t-distribution with shared precision matrix.
result Identifies co-expression matrix up to scaling factor.
New method finds minimum in noisy data, useful for model selection.
problem Finding the index of the minimum value in noisy observations.
method Developed an asymptotically normal test statistic integrating cross-validation and differential privacy.
result Achieves a favorable bias-variance trade-off in practical scenarios.
Parallel Gaussian process surrogate for noisy likelihood evaluations in Bayesian inference.
problem Bayesian inference with limited noisy log-likelihood evaluations from complex models.
method Hierarchical Gaussian process surrogate model for log-likelihood, batch-sequential design strategies.
result Robust, highly parallelizable, and sample-efficient method.
Develops methods for statistical inference on matrix linear forms from noisy data.
problem Statistical inference on linear forms of a large matrix from noisy observations.
method Double-sample debiasing and low-rank projection for constructing asymptotically normal estimators.
result Asymptotically normal estimators of linear forms allow for confidence intervals and hypothesis testing.
Improved neural network inference with eigenvalue correction.
problem Inference of flexible variational posteriors is computationally expensive.
method Eigenvalue correction to matrix-variate Gaussian posterior.
result Empirically, the method outperforms existing algorithms.
Valid causal inference in observational studies often requires controlling for confounders. However, in practice measurements of confounders may be noisy, and can lead to biased estimates of causal effects. We show that we can reduce the bias caused by measurement noise using a large number of noisy measurements of the…
The paper sets sample complexity bounds for learning high-dimensional simplices in noisy data.
problem Learning high-dimensional simplices from noisy data.
method Sample compression techniques and Fourier-based method for noisy observations.
result Established sample complexity bounds for simplex learning in noisy regimes.
Develops interpretable model for latent stochastic systems from noisy data.
problem Learning interpretable models of latent stochastic dynamical systems from noisy data.
method Semi-parametric model using Gaussian process for drift, inference of latent paths with sparse variational description.
result Flexible nonparametric model of dynamics with interpretable portraits.
Bayesian PINNs solve noisy PDE problems with physics constraints.
problem Uncertainty quantification in noisy PDE problems.
method Bayesian framework combining PINNs and HMC/VI for posterior estimation.
result HMC outperforms VI for noisy data.
Paper finds sample complexity for learning high-dimensional simplices from noisy data.
problem Learning high-dimensional simplices from noisy samples.
method Combines sample compression, high-dimensional geometry, and Fourier analysis.
result Proves sample complexity bound for achieving a simplex within a certain distance from the true simplex.
Improves classification accuracy with noisy labels using generative classifiers.
problem Handling noisy labels in large-scale datasets.
method Robust Generative Classifier (RoG) on top of pre-trained DNNs.
result Significantly improves classification accuracy with no re-training of the deep model.
Transfer knowledge from multiple sources to improve matrix completion.
problem Matrix completion with noisy data.
method Aggregating singular subspaces information from multiple sources to solve a two-way PCA problem and transform into a low-dimensional linear regression.
result Guaranteed statistical efficiency in transforming the high-dimensional target matrix completion problem.
ConvMMD improves inference in noisy data.
problem Inference degradation due to measurement error in noisy data.
method Convolutional Maximum Mean Discrepancy (convMMD) for inference with noisy, heteroscedastic observations.
result Established consistency and asymptotic normality of the convMMD-based estimator.
Bayesian method combines data assimilation, machine learning, and EM for chaotic dynamics.
problem Reconstructing high-dimensional chaotic dynamics from noisy, partial observations over long time series.
method Bayesian inference using expectation-maximization and coordinate descent.
result Successfully tested on two chaotic models, estimating model, state trajectory, and model error statistics.
Many models for sparse regression typically assume that the covariates are known completely, and without noise. Particularly in high-dimensional applications, this is often not the case. This paper develops efficient OMP-like algorithms to deal with precisely this setting. Our algorithms are as efficient as OMP, and im…