New algorithm for estimating MLR parameters with non-Gaussian noise.
problem Estimating MLR parameters with non-Gaussian noise.
method Combining ADMM with EM algorithm idea.
result Our method outperforms EM algorithm in non-Gaussian noise case.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “Gaussian case”
Paper extends FOFC algorithm to work with mixed data types.
problem Designing causal discovery algorithms for mixed data types.
method Proves tetrad constraint can be entailed for mixed data types and applies FOFC algorithm.
result FOFC algorithm can work on mixed data types.
Proves a special case of the Gaussian kinematic formula using large sphere limits.
problem Proving a special case of the Gaussian kinematic formula.
method Viewing the GKF as the limit of spherical kinematic formulas for large dimension spheres.
result Proves a special case of the Gaussian kinematic formula.
While Gaussian probability densities are omnipresent in applied mathematics, Gaussian cumulative probabilities are hard to calculate in any but the univariate case. We study the utility of Expectation Propagation (EP) as an approximate integration method for this problem. For rectangular integration regions, the approx…
The paper reviews identifiability in linear and nonlinear models, from Gaussian to non-Gaussian.
problem Identifiability issues in latent-variable and structural-equation models, especially in nonlinear cases.
method Review of identifiability theory for linear and nonlinear models, including factor analysis and structural equation models.
result Even nonparametric nonlinear models can be estimated with additional assumptions.
We establish the Gaussian Multi-Bubble Conjecture: the least Gaussian-weighted perimeter way to decompose into cells of prescribed (positive) Gaussian measure when , is to use a "simplicial cluster", obtained from the Voronoi cells of equidistant points. Moreover, we prove that…
Extracts invariant features to predict Y without confounding by Z, using conditional independence and optimal transport.
problem Extracting invariant features to predict Y without confounding by Z, a response variable influenced by unknown confounders Z.
method Develops a methodology penalizing statistical dependence between feature and confounders conditioned on Y, using the Optimal Transport Barycenter Problem.
result The method extracts invariant features in the Gaussian case, equivalent to penalizing dependence between feature and conditional random variable Z_Y.
This note proves a Gaussian version of a Pólya-Szegö conjecture using rearrangement techniques.
problem Finding the domain with the minimum Gaussian principal frequency when the Gaussian torsional rigidity is fixed.
method Adapted Kohler-Jobin rearrangement technique to the Gauss space, considering a modified torsional rigidity and rearranging layers to half-spaces.
result The Gaussian principal frequency is minimized for the half-space when the Gaussian torsional rigidity is fixed.
HMC improves Gaussian sampling efficiency with long, random steps.
problem Efficiently sampling from high-dimensional Gaussian distributions.
method Hamiltonian Monte Carlo with long and random integration times.
result HMC achieves -closeness in total variation distance with gradient queries.
Maximum likelihood estimation fails to be well-posed in Gaussian process regression.
problem Establishing well-posedness of maximum likelihood estimation in Gaussian process regression.
method Analyzing the conditions under which maximum likelihood estimation is not Lipschitz in the data with respect to the Hellinger distance.
result Maximum likelihood estimation is not well-posed in the noiseless data setting for any Gaussian process with a stationary covariance function whose lengthscale parameter is estimated using maximum likelihood.
Gaussian-SVGD dynamics converge to Gaussian distributions under certain conditions.
problem Understanding the theoretical properties of SVGD, especially for Gaussian targets.
method Detailed theoretical study of Gaussian-SVGD dynamics, considering both mean-field PDE and discrete particle systems.
result Gaussian-SVGD dynamics converge linearly to the Gaussian distribution closest to the target in KL divergence.
Bayesian Optimization using Gaussian Processes is a popular approach to deal with the optimization of expensive black-box functions. However, because of the a priori on the stationarity of the covariance matrix of classic Gaussian Processes, this method may not be adapted for non-stationary functions involved in the op…
This work studies Gaussian geometry under entropy-regularized 2-Wasserstein distance.
problem Understanding Gaussian distributions in uncertainty quantification and diffusivity.
method Entropy-regularized 2-Wasserstein distance, closed-form solutions, fixed-point characterization.
result Closed-form expressions for the 2-Sinkhorn divergence and fixed-point barycenter.
This paper improves active learning for Gaussian process regression to handle distributional uncertainty.
problem Active learning for Gaussian process regression does not guarantee accurate predictions for target distributions.
method Proposes two methods to reduce worst-case expected error for Gaussian process regression.
result Shows an upper bound of the worst-case expected squared error, suggesting finite data labels can achieve arbitrarily small error.
New methods reduce computational cost for Gaussian Markov Random Fields with sparse constraints.
problem Inference and simulation of GMRFs are computationally prohibitive with many constraints.
method Proposes a basis transformation into blocks of constrained and non-constrained subspaces.
result Significantly outperforms existing alternatives in computational cost.
The paper solves a geometric problem using curvature flow and variational methods.
problem The -Gaussian Minkowski problem in the Euclidean space.
method Gauss curvature flow and Aleksandrov's variational method with Lagrange multipliers.
result The flow converges to a smooth solution of the -Gaussian Minkowski problem.
We study the problem of using i.i.d. samples from an unknown multivariate probability distribution to estimate the mutual information of . This problem has recently received attention in two settings: (1) where is assumed to be Gaussian and (2) where is assumed only to lie in a large nonparametric smooth…
Random linear mappings are widely used in modern signal processing, compressed sensing and machine learning. These mappings may be used to embed the data into a significantly lower dimension while at the same time preserving useful information. This is done by approximately preserving the distances between data points,…
Square-root natural-gradient improves variational inference convergence.
problem Challenges in establishing theoretical convergence guarantees for natural-gradient descent.
method Square-root parameterization for Gaussian covariance.
result Establishes novel convergence guarantees for natural-gradient Gaussian inference.
This paper is a step-by-step tutorial for fitting a mixture distribution to data. It merely assumes the reader has the background of calculus and linear algebra. Other required background is briefly reviewed before explaining the main algorithm. In explaining the main algorithm, first, fitting a mixture of two distribu…
Enhances multi-fidelity modeling with DGPs for different input domains.
problem Improving prediction accuracy with multi-fidelity models using different input domains.
method Extends Deep Gaussian Processes (DGPs) to handle different input domains for high and low-fidelity models.
result Demonstrates improved performance on real-world physical problems.
In the framework of the supervised learning of a real function defined on a space X , the so called Kriging method stands on a real Gaussian field defined on X. The Euclidean case is well known and has been widely studied. In this paper, we explore the less classical case where X is the non commutative finite group of …
FPI methods compute barycenters of Gaussian sets for various dissimilarity measures.
problem Efficiently compute barycenters of Gaussian sets for multiple dissimilarity measures.
method Fixed-Point Iterations (FPI) for several dissimilarity measures.
result FPI provides a useful toolbox for fusion/reduction of Gaussian sets.
New bounds for private learning of high-dimensional Gaussian distributions.
problem Learning high-dimensional Gaussian distributions under differential privacy constraints.
method Analytic tools for constructing global covers from local covers, modified hypothesis selection techniques.
result Near-optimal sample complexity bounds for general Gaussians, conjectured to be near-optimal in the general case.
Extends Gaussian process theory to Banach spaces.
problem Extending Gaussian process theory to Banach spaces.
method Investigates the connection between Gaussian processes and Gaussian random elements in reproducing kernel Banach spaces.
result Characterizes positive definite functions that arise from covariance operators in Banach space setting.
Gaussian Process (GP) regression models typically assume that residuals are Gaussian and have the same variance for all observations. However, applications with input-dependent noise (heteroscedastic residuals) frequently arise in practice, as do applications in which the residuals do not have a Gaussian distribution. …
Entropic optimal transport beyond product reference couplings: the Gaussian case on Euclidean spacemath.ST
This work extends entropic optimal transport to non-product reference couplings, focusing on Gaussian cases.
problem Finding a diffuse coupling between two measures with non-product reference couplings.
method Reduction of the entropic optimal transport problem to a matrix optimization problem.
result Complete description of the solution for non-product reference couplings, including primal and dual variables.
This note explains when neural networks can be seen as Gaussian processes.
problem Understanding the relationship between neural networks and Gaussian processes.
method Formulating a Gaussian process regression based on neural network outputs and analyzing the resulting posterior mean functions.
result The posterior mean functions of neural networks follow a Gaussian process in certain cases, providing an interpretation of reproducing kernel Hilbert spaces.
Optimizes arm selection with side information in Gaussian bandits.
problem Optimizing arm selection with side information in Gaussian bandits.
method Constructs an LP-based asymptotic instance-dependent lower bound on the regret and develops the first known asymptotically optimal algorithm.
result First known asymptotically optimal algorithm for Gaussian bandits with side information.
Gaussian processes are ubiquitous in nature and engineering. A case in point is a class of neural networks in the infinite-width limit, whose priors correspond to Gaussian processes. Here we perturbatively extend this correspondence to finite-width neural networks, yielding non-Gaussian processes as priors. The methodo…
This thesis tackles Gaussian Process challenges in low dimensions.
problem Constructing models for large datasets and selecting optimal models.
method Samplet-based approach to efficiently construct and train Gaussian Processes.
result Reduces cubic computational complexity to log-linear scale.
Transformers interpret as probabilistic mixtures, offering new insights.
problem Understanding Transformers from a probabilistic perspective.
method Modeling Transformers as mixtures of Gaussian models.
result Transformers can be seen as maximum posterior probability estimators.
Study non-Gaussian measures' concentration properties in metric spaces.
problem Concentration properties for non-linear Gaussian functionals with non-Gaussian tails.
method Prove generalised Transportation-Cost Inequalities (TCIs) for specific functionals.
result Extended TCIs for rough volatility and Parabolic Anderson Model.
The paper analyzes and mitigates biases in scalable Gaussian Process methods.
problem Modeling biases in scalable Gaussian Process methods.
method Randomized truncation estimators to eliminate bias in exchange for increased variance.
result Randomized truncation estimators meaningfully outperform biased counterparts with minimal additional computation.
The Gaussian curvature is a fundamental geometric quantity discovered by Gauss in the case of surfaces embedded in . One can naturally extend the definition of the Gaussian curvature to arbitrary submanifolds of so that the extrinsic interpretation of , the Theorema Egregium and the …
Improves graph-based active learning for non-Gaussian models.
problem Efficiently selecting data points for labeling in graph-based semi-supervised learning.
method Approximates non-Gaussian distributions, introduces rank-one update and model change acquisition function.
result Enhanced active learning for graph-based SSL under non-Gaussian models.
The paper connects Riemannian Gaussian distributions to random matrix theory and diffusion kernels.
problem Analyzing Riemannian Gaussian distributions on symmetric spaces.
method Analytical computation of marginals using orthogonal and skew orthogonal polynomials, and diffusion kernels.
result Riemannian Gaussian distributions are random matrix types, and their probability density functions can be computed analytically.
New Gaussian min-max theorem extends classical results to non-i.i.d. Gaussian matrices.
problem Extending classical Gaussian min-max theorems to non-i.i.d. Gaussian matrices.
method Identifying a new pair of Gaussian processes that satisfy comparison inequalities.
result New Gaussian min-max and convex Gaussian min-max theorems with applications in multi-source Gaussian regression and binary classification.
New method for Bayesian neural networks with unbounded weights.
problem Posterior inference for Bayesian neural networks with unbounded weights.
method Conditionally Gaussian representation for efficient posterior inference.
result Interpretable and computationally efficient procedure for posterior inference.
Numerical Gaussian Processes for Time-dependent and Non-linear Partial Differential Equationsstat.ML
We introduce the concept of numerical Gaussian processes, which we define as Gaussian processes with covariance functions resulting from temporal discretization of time-dependent partial differential equations. Numerical Gaussian processes, by construction, are designed to deal with cases where: (1) all we observe are …
New method splits unknown covariance Gaussians into independent parts.
problem Splitting multivariate Gaussian data with unknown covariance.
method Developed a general algorithm for decomposing unknown covariance Gaussians.
result Demonstrated decomposition for single multivariate Gaussian with unknown covariance.
We study the regular conditional law of mixed Gaussian Volterra processes under the influence of model disturbances. More precisely, we study prediction of Gaussian Volterra processes driven by a Brownian motion in a case where the Brownian motion is not observable, but only a noisy version is observed. As an applicati…
Paper proves convergence rates for Gaussian kernel ridge regression.
problem Understanding convergence rates for Gaussian kernel ridge regression.
method Establishes polynomial convergence rates for KRR with fixed hyperparameters.
result First polynomial convergence rates for Gaussian kernel ridge regression.
Gaussian Universality in Neural Network Dynamics with Generalized Structured Input Distributionsstat.ML
Deep learning models converge to Gaussian dynamics with mixed structured inputs.
problem Understanding neural network dynamics with complex input distributions.
method Extended hidden manifold model to Gaussian mixtures, analyzed via SGD.
result Learning dynamics with mixed inputs converge to Gaussian behavior.
The problem of prescribing Gaussian curvature on Riemann surface with conical singularity is considered. Let be a closed Riemann surface with a divisor , and , where is a Hölder continuous function satisfying , , and . If the Eule…
The paper improves sparse Gaussian processes by optimizing predictive loss.
problem Optimizing predictive loss in sparse Gaussian processes.
method Direct loss minimization (DLM) for log-loss and square loss, with product sampling (uPS) and biased Monte Carlo (bMC) for non-conjugate cases.
result DLM shows significant performance improvement in both log-loss and square loss cases.
Algorithm learns mixtures of Gaussians efficiently using diffusion models.
problem Learning mixtures of Gaussians with identity covariance.
method Analytic approach using diffusion models to learn score functions.
result Quasi-polynomial time and sample complexity for learning mixtures.
Wide deep neural networks with Gaussian weights approximate Gaussian processes closely.
problem Understanding the approximation of deep neural networks with Gaussian weights to Gaussian processes.
method Established novel rates for the Gaussian approximation of random deep neural networks with Gaussian parameters and Lipschitz activation functions in the wide limit.
result The distance between the network output and the Gaussian approximation scales inversely with the width of the network.