Algorithm samples composite logconcave densities efficiently.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
A scalable method for estimating spatial data using VREML.
RBM models reveal how hidden unit tail behavior affects pattern reconstruction.
A Gaussian restricted Boltzmann machine (GRBM) is a Boltzmann machine defined on a bipartite graph and is an extension of usual restricted Boltzmann machines. A GRBM consists of two different layers: a visible layer composed of continuous visible variables and a hidden layer composed of discrete hidden variables. In th…
New theory allows ICA without assuming non-Gaussian sources.
New algorithms sample convex bodies using Markov chains and restricted Gaussian oracles.
Proves existence and uniqueness of solutions to the Lp Gaussian Minkowski problem.
The paper examines utility maximization in markets with hidden Gaussian drift, finding restrictions on model parameters.
This paper presents a novel approach to speaker subspace modelling based on Gaussian-Binary Restricted Boltzmann Machines (GRBM). The proposed model is based on the idea of shared factors as in the Probabilistic Linear Discriminant Analysis (PLDA). GRBM hidden layer is divided into speaker and channel factors, herein t…
New GL-GP models learn covariance respecting domain geometry.
Given a Gaussian Markov random field, we consider the problem of selecting a subset of variables to observe which minimizes the total expected squared prediction error of the unobserved variables. We first show that finding an exact solution is NP-hard even for a restricted class of Gaussian Markov random fields, calle…
We present a theoretical analysis of Gaussian-binary restricted Boltzmann machines (GRBMs) from the perspective of density models. The key aspect of this analysis is to show that GRBMs can be formulated as a constrained mixture of Gaussians, which gives a much better insight into the model's capabilities and limitation…
Sum-of-norms clustering is a method for assigning points in to clusters, , using convex optimization. Recently, Panahi et al.\ proved that sum-of-norms clustering is guaranteed to recover a mixture of Gaussians under the restriction that the number of samples is not too large. The pu…
We show that the two-stage adaptive Lasso procedure (Zou, 2006) is consistent for high-dimensional model selection in linear and Gaussian graphical models. Our conditions for consistency cover more general situations than those accomplished in previous work: we prove that restricted eigenvalue conditions (Bickel et al.…
Filtering is a general name for inferring the states of a dynamical system given observations. The most common filtering approach is Gaussian Filtering (GF) where the distribution of the inferred states is a Gaussian whose mean is an affine function of the observations. There are two restrictions in this model: Gaussia…
The space of Gaussian measures on a Euclidean space is geodesically convex in the -Wasserstein space. This space is a finite dimensional manifold since Gaussian measures are parameterized by means and covariance matrices. By restricting to the space of Gaussian measures inside the -Wasserstein space, we manag…
Paper introduces LODE-GPs for modeling data following linear ODEs.
We introduce time-inhomogeneous stochastic volatility models, in which the volatility is described by a nonnegative function of a Volterra type continuous Gaussian process that may have very rough sample paths. The main results obtained in the paper are sample path and small-noise large deviation principles for the log…
New method uses KL-divergence to create non-informative priors for multivariate Gaussian.
New method improves Gaussian process regression on complex, sparse point clouds.
Existing methods for structure discovery in time series data construct interpretable, compositional kernels for Gaussian process regression models. While the learned Gaussian process model provides posterior mean and variance estimates, typically the structure is learned via a greedy optimization procedure. This restri…
New bounds for kernel regression under non-Gaussian noise.
Gaussian process (GP) modulated Cox processes are widely used to model point patterns. Existing approaches require a mapping (link function) between the unconstrained GP and the positive intensity function. This commonly yields solutions that do not have a closed form or that are restricted to specific covariance funct…
Bayesian model selection improves multivariate causal discovery without restrictive assumptions.
Improves interpretability of anomaly scores in GBRBM-based detection.
New method for initializing RBM weights without datasets.
Gaussian processes are conditioned on various types of data.
The paper solves curvature prescription on a disk with negative Gaussian curvature.
CRBMs improve financial regime detection with PCD and free energy analysis.
Projection pursuit model improves Gaussian process regression for high-dimensional data.
Gaussian process models are flexible, Bayesian non-parametric approaches to regression. Properties of multivariate Gaussians mean that they can be combined linearly in the manner of additive models and via a link function (like in generalized linear models) to handle non-Gaussian data. However, the link function formal…
This work studies Gaussian geometry under entropy-regularized 2-Wasserstein distance.
New bounds for private learning of high-dimensional Gaussian distributions.
In previous work, theoretical analysis based on the tensor Restricted Isometry Property (t-RIP) established the robust recovery guarantees of a low-tubal-rank tensor. The obtained sufficient conditions depend strongly on the assumption that the linear measurement maps satisfy the t-RIP. In this paper, by exploiting the…
A new method for efficient Gaussian process inference using sparse approximations.
Stein's method (Stein, 1973; 1981) is a powerful tool for statistical applications and has significantly impacted machine learning. Stein's lemma plays an essential role in Stein's method. Previous applications of Stein's lemma either required strong technical assumptions or were limited to Gaussian distributions with …
Data-driven models are subject to model errors due to limited and noisy training data. Key to the application of such models in safety-critical domains is the quantification of their model error. Gaussian processes provide such a measure and uniform error bounds have been derived, which allow safe control based on thes…
ITSPACE improves covariance alignment faster than other methods.
New findings show Gaussian universality breaks down in high-dimensional linear factor mixtures.
Ordinal data is omnipresent in almost all multiuser-generated feedback - questionnaires, preferences etc. This paper investigates modelling of ordinal data with Gaussian restricted Boltzmann machines (RBMs). In particular, we present the model architecture, learning and inference procedures for both vector-variate and …
The minimum error entropy (MEE) criterion has been verified as a powerful approach for non-Gaussian signal processing and robust machine learning. However, the implementation of MEE on robust classification is rather a vacancy in the literature. The original MEE only focuses on minimizing the Renyi's quadratic entropy …
The exploration-exploitation trade-off is among the central challenges of reinforcement learning. The optimal Bayesian solution is intractable in general. This paper studies to what extent analytic statements about optimal learning are possible if all beliefs are Gaussian processes. A first order approximation of learn…
Stochastic gradient descent based algorithms are typically used as the general optimization tools for most deep learning models. A Restricted Boltzmann Machine (RBM) is a probabilistic generative model that can be stacked to construct deep architectures. For RBM with Bernoulli inputs, non-Euclidean algorithm such as st…
Novel deep Gaussian process improves predictive uncertainty.
Paper presents a new framework for covariance matrix estimation with geometric insights.
Restricted Boltzmann Machines are described by the Gibbs measure of a bipartite spin glass, which in turn corresponds to the one of a generalised Hopfield network. This equivalence allows us to characterise the state of these systems in terms of retrieval capabilities, both at low and high load. We study the paramagnet…
New approach to quantum knot invariants using perturbed Gaussian generating functions.
New algorithms sample structured logconcave families with improved efficiency.