Estimates Gaussian mixtures from weighted samples efficiently.
problem Estimating Gaussian mixtures from weighted samples with correct weight treatment.
method Density interpretation and expectation-maximization method considering weights.
result Correctly estimates Gaussian mixtures with weighted samples.
A new method for computing image curvature efficiently and accurately.
problem Low performance, low accuracy, and requirement of second order differentiability in conventional computation schemes.
method Proposes a novel discrete computation scheme for weighted Gaussian curvature.
result More accurate, computationally more efficient, and does not require second order differentiability.
Study Gaussian approximation for deep neural networks with random weights.
problem Understanding the distribution of deep neural networks with random weights.
method Established Gaussian approximation bounds in Wasserstein-1 norm.
result Convergence rates of order n−(1/6)L−1+ε for deep networks with proportional layer widths. New insights on how weight structure affects generalization in deep Gaussian feature models.
problem Understanding how weight structure impacts generalization in deep learning models.
method Using the replica trick from statistical physics to derive learning curves for models with structured Gaussian features.
result Allowing correlations between the rows of the first layer of features can aid generalization, while structure in later layers is generally detrimental.
Optimizes sliding window approach for tracking Gaussian densities.
problem Improving tracking performance of Gaussian density estimation.
method Theoretical analysis of sliding window Gaussian Kernel Density Estimators.
result Empirical evidence shows improved tracking performance with optimal weight sequence.
The paper studies hypersurfaces with constant weighted mean curvature in Gaussian space.
problem Characterizing hypersurfaces with specific properties of their Gauss map.
method Analyzing the Gauss map and its image in the Gaussian space.
result Hypersurfaces with certain properties of their Gauss map are either hyperplanes or generalized cylinders.
The paper proves lower bounds for Gaussian-weighted curvature integrals of self-shrinkers.
problem Proving lower bounds for Gaussian-weighted \(L^2\)-curvature integrals of self-shrinkers.
method Combining normal coordinate functions with weighted Poincaré inequalities and first-eigenvalue estimates.
result Explicit lower bounds in terms of entropy for closed self-shrinkers, leading to curvature gaps.
New method for Bayesian neural networks with unbounded weights.
problem Posterior inference for Bayesian neural networks with unbounded weights.
method Conditionally Gaussian representation for efficient posterior inference.
result Interpretable and computationally efficient procedure for posterior inference.
Wide deep neural networks with Gaussian weights approximate Gaussian processes closely.
problem Understanding the approximation of deep neural networks with Gaussian weights to Gaussian processes.
method Established novel rates for the Gaussian approximation of random deep neural networks with Gaussian parameters and Lipschitz activation functions in the wide limit.
result The distance between the network output and the Gaussian approximation scales inversely with the width of the network.
WE constructs GP kernels for mixed inputs using weighted EDMs.
problem Limitation of standard GP models in handling categorical variables.
method WEGP constructs kernel function using weighted EDMs for categorical inputs.
result WEGP improves GP model accuracy in both synthetic and real-world optimization problems.
Deep Gaussian processes (DGPs) can model complex marginal densities as well as complex mappings. Non-Gaussian marginals are essential for modelling real-world data, and can be generated from the DGP by incorporating uncorrelated variables to the model. Previous work on DGP models has introduced noise additively and use…
The paper proves cohomology vanishing for a specific type of minimal submanifolds in a weighted Euclidean ball.
problem Proving cohomology vanishing for free boundary f-minimal submanifolds in Gaussian-weighted Euclidean balls. method The proof uses a weighted Hardy inequality, cancellation in the weighted Weitzenböck curvature operator, and a boundary reduction.
result The space of tangential f-harmonic p-forms vanishes, leading to Hp(M;R)=0. The paper proves a distribution claim for neural network Jacobians.
problem Distribution of singular values in deep neural networks.
method Free probability and random matrix theory techniques.
result Singular value distribution matches for specific cases.
The paper studies heat kernels on weighted Riemannian manifolds with curvature bounds.
problem Estimating heat kernels on weighted Riemannian manifolds with lower Ricci curvature bounds.
method Establishing parabolic Harnack inequalities, proving Gaussian bounds for heat kernels, and constructing Li-Yau-type gradient estimates.
result Gaussian upper and lower bounds for the heat kernel, Liouville theorem, uniqueness property, and eigenvalue bounds.
Study of deep neural networks with dependent weights leading to new model limits and properties.
problem Characterizing deep neural networks with dependent weights in the infinite-width limit.
method Modeling weights as a mixture of Gaussian distributions and analyzing the infinite-width limit.
result Characterization of neural network layers by scalar parameters and Lévy measures, leading to new model limits.
A new statistical model uses Orlicz-Sobolev spaces with Gaussian weight.
problem Statistical modeling of infinite-dimensional probability measures.
method Affine statistical bundle on Gaussian Orlicz-Sobolev space.
result Provides tools for solving infinite-dimensional evolution problems.
The paper studies deep neural networks with Gaussian weights and finds their asymptotic behavior.
problem Understanding the behavior of deep neural networks with large width.
method Function-space perspective, Gaussian process analysis, weak convergence in large-width limit.
result Deep neural networks with large width converge to a continuous Gaussian process.
Paper explores exact recovery of communities in weighted graphs using Gaussian and exponential distributions.
problem Exact recovery of communities in weighted graphs with Gaussian and exponential distributions.
method Introduces a new semi-metric to describe conditions for exact recovery and analyzes conditions for both complete and incomplete graphs.
result Necessary and sufficient conditions for exact recovery are asymptotically tight and applicable to both complete and incomplete graphs.
We consider a Gaussian process formulation of the multiple kernel learning problem. The goal is to select the convex combination of kernel matrices that best explains the data and by doing so improve the generalisation on unseen data. Sparsity in the kernel weights is obtained by adopting a hierarchical Bayesian approa…
Study connects Gaussian processes and regularization for sequence-function mappings.
problem Understanding and interpreting sequence-function maps in biology.
method Relates Gaussian process priors, regularization, and gauge fixing in overparameterized weight space.
result Established the relationship between regularized regression and Gaussian processes in function space.
This paper extends the Gaussian process interpretation of deep networks to more varied weight distributions.
problem Understanding the impact of different weight initialization schemes on deep learning dynamics.
method Extending the Gaussian process interpretation to PSEUDO-IID weight distributions, including sparse and low-rank networks.
result PSEUDO-IID initialized networks are effectively equivalent up to variance, enabling tractable posterior distributions.
The paper integrates behavioral distortions into portfolio optimization using implied probability weighting functions.
problem Behavioral distortions in probability weighting affect portfolio optimization under different return distributions.
method Developed a unified framework to extract probability weighting functions from optimal portfolios modeled under Gaussian and NIG distributions.
result Increasing tail fatness amplifies behavioral distortions, and shifts in risk-free rates alter the curvature of these distortions.
Polynomial growth bounds for eigenfunctions on non-compact spaces.
problem Growth of eigenfunctions on non-compact spaces with Gaussian weight.
method Analyzing non-compact manifolds with Gaussian weight and drift Laplacian.
result Showed same polynomial growth bounds as Euclidean space for general tensors.
New algorithm for learning mixtures with mostly uniform weights, improving on previous bounds.
problem Learning mixtures of Gaussians with uniform weights and mostly uniform component weights.
method Statistical Query (SQ) lower bound and quasi-polynomial upper bound for testing.
result Quasi-polynomial upper bound for testing mixtures with mostly uniform weights.
Deep neural networks' infinite-width behavior approximated by Gaussian models.
problem Understanding the behavior of deep neural networks in the limit of infinite width.
method Using the Lindeberg exchange principle to approximate weights by Gaussian random variables.
result Quantitative bounds on the 2-Wasserstein distance between deep neural networks and Gaussian limits.
Study on MC dropout in wide neural networks and its convergence to Gaussian processes.
problem Understanding the behavior of Monte Carlo dropout in wide neural networks.
method Rigorously studied the limiting distribution of wide untrained NNs under dropout, proving convergence to Gaussian processes. Investigated correlations and non-Gaussian behavior in finite width NNs.
result Wide untrained neural networks under dropout converge to Gaussian processes for fixed sets of weights and biases.
In a recently published paper [1], it is shown that deep neural networks (DNNs) with random Gaussian weights preserve the metric structure of the data, with the property that the distance shrinks more when the angle between the two data points is smaller. We agree that the random projection setup considered in [1] pres…
The paper provides precise estimates for isoperimetric inequalities on weighted manifolds.
problem Quantitative isoperimetric inequalities on weighted Riemannian manifolds.
method Analyzes L1, Lp, and W2 estimates for the push-forward of measures. result Close approximation of the guiding function's push-forward to Gaussian measure.
Bayesian neural networks with dependent weights converge to Gaussian mixtures.
problem Limitations of standard Gaussian priors in neural networks.
method Posterior analysis with Gaussian likelihood for networks with dependent weights.
result Posterior distribution identified in the wide-width limit, ensuring invertibility of random covariance matrix.
The paper analyzes SBL pruning criteria under weakened assumptions.
problem Sparse Bayesian learning hyperparameter divergence and pruning.
method Analyzing marginal likelihood function under weakened Gaussian assumptions.
result Conditions for finite vs infinite hyperparameters lead to F-SBL pruning.
DGMM improves Gaussian mixture modeling efficiency and stability.
problem Efficiently estimating Gaussian mixtures in high dimensions.
method Diagonally-weighted generalized method of moments (DGMM).
result DGMM achieves smaller estimation errors with shorter runtime.
Study learns Gaussian mixtures from censored data.
problem Learning Gaussian mixtures with incomplete data.
method Proposes an algorithm to estimate weights and means with minimal samples.
result Achieves accurate estimation with very few samples.
New method for initializing RBM weights without datasets.
problem No dataset-free weight-initialization for RBMs.
method Statistical mechanical analysis to derive Gaussian distribution with optimized standard deviation.
result Optimal weight initialization improves learning efficiency in RBMs.
Large deviation principle for deep neural networks with ReLU activation.
problem Understanding the behavior of deep neural networks with ReLU activation.
method Proving a large deviation principle for networks with Gaussian weights and ReLU activation functions.
result Simplified expressions and power-series expansions for the ReLU case.
Gaussian process regression helps approximate Bayesian inverse problems efficiently.
problem Computational intractability of Bayesian posterior distributions in inverse problems.
method Gaussian process regression to build a surrogate model for the likelihood.
result Error between true and approximate posterior can be bounded by weighted L2-norm error between true and approximate likelihood. Learning probability distributions on the weights of neural networks (NNs) has recently proven beneficial in many applications. Bayesian methods, such as Stein variational gradient descent (SVGD), offer an elegant framework to reason about NN model uncertainty. However, by assuming independent Gaussian priors for the i…
GACTGAN synthesizes tabular data better with less computational overhead.
problem Synthesizing mixed tabular data while balancing risk and utility.
method Integrates Bayesian posterior approximation with Stochastic Weight Averaging-Gaussian (SWAG) in CTGAN.
result GACTGAN produces better synthetic data with reduced privacy risk.
Econometric framework integrates heavy-tailed distributions with behavioral probability weighting for better asset pricing.
problem Underestimation of Value-at-Risk by traditional models in asset pricing.
method Developed an econometric framework combining heavy-tailed Student's t distributions with behavioral probability weighting. result Student's t specifications outperform Gaussian models in 88.4% of cases, reducing underestimation of Value-at-Risk by 16.5 percentage points. Estimates network structure from Gaussian Graphical Models and Gaussian Free Fields.
problem Estimating the structure of a weighted network from repeated measurements of a Gaussian Graphical Model.
method Proposes a novel estimator based on Fourier analytic properties of the Gaussian distribution.
result Demonstrates the effectiveness of the estimator with recovery guarantees and bounds on sample complexity.
Algorithm distinguishes Gaussian mixtures from pure Gaussians in quasi-polynomial time.
problem Distinguishing mixtures of Gaussian components from pure Gaussians, especially when components are well-separated.
method Sum-of-Squares method, quasi-polynomial time algorithm, bipartitioning sample to separate components.
result Algorithm can reliably distinguish between mixtures and pure Gaussians in quasi-polynomial time.
Improved kernel ridge regression for large datasets using weighted random binning.
problem Efficiently approximating kernel matrices for large-scale datasets.
method Introduced weighted random binning features for locality sensitive hashing.
result Weighted random binning features generate Gaussian processes of any desired smoothness.
Method identifies change points in high-dimensional models using sample weights.
problem Identifying change points in high-dimensional generalized linear models.
method Sample-weighted empirical risk minimization (Weighted ERM).
result Weighted ERM yields precise asymptotic performance characterization for Gaussian designs.
Probabilistic neural networks are typically modeled with independent weight priors, which do not capture weight correlations in the prior and do not provide a parsimonious interface to express properties in function space. A desirable class of priors would represent weights compactly, capture correlations between weigh…
New sampling-based approach for filtering problems using multiplicative Gaussian functions.
problem Approximate inference in filtering problems.
method Approximates distribution with a weighted sum of continuous functions using sampling for multiplications.
result Preliminary experiments show potential of the new method compared to particle filters.
Diffusion models optimize objectives similar to ELBO with Gaussian noise augmentation.
problem Optimizing diffusion models for high perceptual quality.
method Showed diffusion objectives are weighted ELBOs over noise levels, with Gaussian noise augmentation.
result Diffusion objectives equate to ELBO with Gaussian noise augmentation under monotonic weighting.
Let Ω be an open half-space or slab in Rn+1 endowed with a perturbation of the Gaussian measure of the form f(p):=exp(ω(p)−c∣p∣2), where c>0 and ω is a smooth concave function depending only on the signed distance from the linear hyperplane parallel to ∂Ω. In this work we follow a varia…
Study extends eigenvalue formulas to weighted manifolds and proves global rigidity theorems.
problem Eigenvalue formulas and rigidity theorems for weighted manifolds.
method Extends variational formulae to weighted manifolds, proving global rigidity theorems.
result Global rigidity theorems for critical domains in Gaussian half-space.
An interesting approach to analyzing neural networks that has received renewed attention is to examine the equivalent kernel of the neural network. This is based on the fact that a fully connected feedforward network with one hidden layer, a certain weight distribution, an activation function, and an infinite number of…