Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

149297446594 · Jun 202019922001200920172026
48 results for Gaussian estimates

Independent component analysis (ICA) decomposes multivariate data into mutually independent components (ICs). The ICA model is subject to a constraint that at most one of these components is Gaussian, which is required for model identifiability. Linear non-Gaussian component analysis (LNGCA) generalizes the ICA model t…

2017-12-23abs ↗pdf ↗

GGMPs improve non-Gaussian conditional density estimation.

problem Multimodality, heteroscedasticity, and strong non-Gaussianity in conditional density estimation.
method GGMP combines local Gaussian mixture fitting, cross-input component alignment, and per-component heteroscedastic GP training.
result GGMPs improve distributional approximation on synthetic and real-world datasets.

New algorithm estimates Gaussian means and covariances efficiently and privately.

problem Estimating Gaussian parameters privately and efficiently.
method Differentially private preconditioner to transform arbitrary Gaussian samples.
result First polynomial-time, sample-efficient estimator for arbitrary Gaussian distributions.

Using integration by parts on Gaussian space we construct a Stein Unbiased Risk Estimator (SURE) for the drift of Gaussian processes using their local and occupation times. By almost-sure minimization of the SURE risk of shrinkage estimators we derive an estimation and de-noising procedure for an input signal perturbed…

2008-09-09abs ↗pdf ↗

We tackle the problem of estimating a location parameter with differential privacy guarantees and sub-Gaussian deviations. Recent work in statistics has focused on the study of estimators that achieve sub-Gaussian type deviations even for heavy tailed data. We revisit some of these estimators through the lens of differ…

2019-06-27abs ↗pdf ↗

We study the problem of using i.i.d. samples from an unknown multivariate probability distribution pp to estimate the mutual information of pp. This problem has recently received attention in two settings: (1) where pp is assumed to be Gaussian and (2) where pp is assumed only to lie in a large nonparametric smooth…

2017-02-24abs ↗pdf ↗

Maximum likelihood estimation fails to be well-posed in Gaussian process regression.

problem Establishing well-posedness of maximum likelihood estimation in Gaussian process regression.
method Analyzing the conditions under which maximum likelihood estimation is not Lipschitz in the data with respect to the Hellinger distance.
result Maximum likelihood estimation is not well-posed in the noiseless data setting for any Gaussian process with a stationary covariance function whose lengthscale parameter is estimated using maximum likelihood.

Lower bounds on private estimation of Gaussian covariance matrices.

problem Private estimation of Gaussian covariance matrices under various parameter regimes.
method Stein-Haff identity and fingerprinting lemma extensions.
result Lower bounds match existing upper bounds in the widest known parameters.

PACE-GGM uses Gaussian mechanism for private covariance estimation.

problem Private estimation of covariance matrices in high dimensions.
method Data-adaptive selection of entries, Gaussian mechanism, maximum-entropy reconstruction.
result Consistent improvements in estimation error compared to Gaussian mechanism and baselines.

Algorithm estimates mixtures of arbitrary Gaussians robustly in presence of corruptions.

problem Estimating mixtures of arbitrary Gaussians in the presence of a constant fraction of arbitrary corruptions.
method Polynomial-time algorithm using partial clustering and tensor decomposition.
result Resolves the main open problem in several previous works on algorithmic robust statistics.

The paper strengthens the classical result of MLE convergence to a Gaussian distribution.

problem The classical result of MLE convergence to a Gaussian distribution.
method Sub-Gaussian concentration and entropic normality of the normalized MLE.
result Entropic central limit theorem for a smoothed version of the estimator.

Study uniform rates for estimating Gaussian mixtures without separation assumption.

problem Estimating parameters in two-component Gaussian mixtures without separation.
method Uniform convergence rates derived using minimax lower bounds and careful analysis of polynomial equalities.
result Phase transition in optimal estimation rate based on mixture balance.

Robust estimators for Gaussian sparse tasks with optimal error under contamination.

problem Robust mean estimation, PCA, and linear regression in the presence of Huber contamination.
method Novel multidimensional filtering method for sparse regime.
result Optimal error guarantees within constant factors for Gaussian robust kk-sparse mean estimation.

Improved estimator for least squares using random projections achieves smaller error.

problem Improving the accuracy of least squares solutions for large-scale problems.
method James-Stein estimator applied to Gaussian sketching of least squares problems.
result Upper and lower bounds match when SNR is small and data matrix is well-conditioned.

Estimates causal effects in Gaussian Linear SCMs with finite data.

problem Estimating causal effects from observational data with latent confounders.
method Centralized Gaussian Linear SCMs (CGL-SCMs) and EM-based estimation algorithm.
result Learned CGL-SCM parameters accurately recover causal distributions from finite observational samples.

The study examines the universality of Gaussian data in high-dimensional generalized linear estimation.

problem Understanding when Gaussian data suffices for high-dimensional generalized linear estimation.
method Sharp asymptotic expressions for test and training errors in high-dimensional Gaussian mixture data with labels from a single-index model.
result The universality of Gaussian data in error estimation depends on the alignment between target weights and mixture cluster means and covariances.

This paper presents a method for efficient density estimation in nonlinear systems.

problem Accurate representation of non-Gaussian distributions in nonlinear dynamical systems is challenging.
method Uses Seminonparametric (SNP) densities with probabilists' Hermite polynomial basis and Monte Carlo approximation for maximum likelihood estimation.
result Demonstrates that the method can accurately capture non-Gaussian density structure and compute quantiles using fewer samples than raw Monte Carlo.

Estimates network structure from Gaussian Graphical Models and Gaussian Free Fields.

problem Estimating the structure of a weighted network from repeated measurements of a Gaussian Graphical Model.
method Proposes a novel estimator based on Fourier analytic properties of the Gaussian distribution.
result Demonstrates the effectiveness of the estimator with recovery guarantees and bounds on sample complexity.

Solves challenges in estimating parameters of softmax gating Gaussian mixture models.

problem Identifiability issues and complex interactions in Gaussian mixture of experts.
method Proposes novel Voronoi loss functions and establishes convergence rates of MLE.
result Connects convergence rate of MLE to a solvability problem of polynomial equations.

Optimal Gaussian noise mechanisms achieve nearly optimal error in unbiased mean estimation.

problem Efficiently estimating the mean of high-dimensional data while preserving privacy.
method Differential privacy mechanisms with Gaussian noise, focusing on optimal covariance.
result Gaussian noise mechanisms achieve nearly optimal error among all private unbiased mean estimation mechanisms.

New Stein identity for q-Gaussians reduces gradient variance in machine learning.

problem Improving gradient estimators for non-Gaussian distributions.
method Deriving a new Stein identity for bounded-support q-Gaussians and simplifying previous results.
result Gradient estimators for q-Gaussians have nearly identical forms to Gaussian ones, reducing variance.

We study a basic private estimation problem: each of nn users draws a single i.i.d. sample from an unknown Gaussian distribution, and the goal is to estimate the mean of this Gaussian distribution while satisfying local differential privacy for each user. Informally, local differential privacy requires that each data …

2018-11-20abs ↗pdf ↗

This work shows that Gaussian is the only prior for optimal linear estimation in L1L^1 loss.

problem Optimal linear estimation of a random variable from noisy observations under L1L^1 fidelity criterion.
method Analyzes the conditions under which the conditional median is a linear estimator and identifies the Gaussian distribution as the only prior that induces linearity.
result Gaussian is the only prior distribution that induces linearity in the conditional median for L1L^1 loss.

We consider robust covariance estimation with group symmetry constraints. Non-Gaussian covariance estimation, e.g., Tyler scatter estimator and Multivariate Generalized Gaussian distribution methods, usually involve non-convex minimization problems. Recently, it was shown that the underlying principle behind their succ…

2013-06-18abs ↗pdf ↗

Method estimates multiple related Gaussian distributions using Laplacian regularization.

problem Jointly estimate multiple related zero-mean Gaussian distributions.
method Laplacian regularized stratified model fitting with hyper-parameters to encourage covariance closeness.
result The method performs well, especially in low data regimes, as demonstrated in finance, radar, and weather.

Gradient boosting can be seen as Gaussian process inference.

problem Improving uncertainty estimates in out-of-domain detection.
method Gradient boosting reformulated as a kernel method converging to Gaussian process inference.
result Gradient boosting can provide better uncertainty estimates through Monte-Carlo estimation of posterior variance.

Paper uses GMM and MAF for probabilistic classification, outperforming simpler models.

problem Classifying data with complex distributions.
method Density estimation using Gaussian Mixture Model and Masked Autoregressive Flow.
result Proposed classifiers outperform simpler models like linear discriminant analysis.

Optimizes sliding window approach for tracking Gaussian densities.

problem Improving tracking performance of Gaussian density estimation.
method Theoretical analysis of sliding window Gaussian Kernel Density Estimators.
result Empirical evidence shows improved tracking performance with optimal weight sequence.

Extends ESGVI for UWB localization with skewed noise, improving state estimation accuracy.

problem Improving state estimation accuracy in UWB localization with skewed noise.
method Generalizes ESGVI to matrix Lie groups and introduces non-Gaussian factors.
result Improved accuracy in UWB localization with NLOS and multipath effects.

ICA accurately estimates treatment effects even with confounders.

problem Estimating treatment effects in the presence of confounding variables.
method Uses Independent Component Analysis (ICA) to identify latent sources and estimate mixing coefficients.
result Linear ICA can consistently estimate multiple treatment effects, even with Gaussian confounders, and is more sample-efficient than Orthogonal Machine Learning (OML).

The paper improves boundary detection and density estimation on noisy data.

problem Detecting boundary points and estimating density on noisy data from compact manifolds.
method Doubly stochastic scaling of the Gaussian heat kernel via Sinkhorn iterations.
result The new estimates of boundary points and density outperform standard methods, especially under noise.