arXiv research

Improved Gaussian Process regression using TQFF over RFF and Gaussian QFF.

In this study, a numerical quadrature for the generalized inverse Gaussian distribution is derived from the Gauss-Hermite quadrature by exploiting its relationship with the normal distribution. The proposed quadrature is not Gaussian, but it exactly integrates the polynomials of both positive and negative orders. Using…

A new type of quadrature is developed. The Gaussian quadrature, for a given measure, finds optimal values of a function's argument (nodes) and the corresponding weights. In contrast, the Lebesgue quadrature developed in this paper, finds optimal values of function (value-nodes) and the corresponding weights. The Gaussi…

Bayesian quadrature uses probabilistic models for estimating intractable integrals.

A new method calculates accurate SABR model option prices and deltas.

Computation of moments of transformed random variables is a problem appearing in many engineering applications. The current methods for moment transformation are mostly based on the classical quadrature rules which cannot account for the approximation errors. Our aim is to design a method for moment transformation for …

Efficiently marginalizes over Gaussian Process kernels for better model flexibility and uncertainty.

New Fourier features improve high-precision approximation in large-scale problems.

This article is concerned with Gaussian process quadratures, which are numerical integration methods based on Gaussian process regression methods, and sigma-point methods, which are used in advanced non-linear Kalman filtering and smoothing algorithms. We show that many sigma-point methods can be interpreted as Gaussia…

Several numerical approximation strategies for the expectation-propagation algorithm are studied in the context of large-scale learning: the Laplace method, a faster variant of it, Gaussian quadrature, and a deterministic version of variational sampling (i.e., combining quadrature with variational approximation). Exper…

BayesSum improves Bayesian quadrature for discrete domains, requiring fewer samples.

Adaptive quadrature improves Bayesian inference through active learning.

The aim of this article is to design a moment transformation for Student- t distributed random variables, which is able to account for the error in the numerically computed mean. We employ Student-t process quadrature, an instance of Bayesian quadrature, which allows us to treat the integral itself as a random variable…

Post-process Bayesian inference speeds up posterior approximation.

Unified quadrature framework for large-scale kernel machines.

SLEIPNIR improves Gaussian process regression with derivatives, scaling up efficiently and accurately.

The paper improves error bounds for Bayesian quadrature in noisy settings.

Paper proposes no-regret algorithms for private GP bandit optimization.

Efficiently calculates privacy guarantees for 2020 Census data.

An exciting branch of machine learning research focuses on methods for learning, optimizing, and integrating unknown functions that are difficult or costly to evaluate. A popular Bayesian approach to this problem uses a Gaussian process (GP) to construct a posterior distribution over the function of interest given a se…

Efficient method for pricing Bermudan moving average options using GPR-GHQ.

Paper proposes efficient AL algorithms for optimizing product performance under environmental variability.

New filters improve radar target inference in complex scenarios.

This paper extends static hedging for European options over multiple maturities.

Clinical patient records are an example of high-dimensional data that is typically collected from disparate sources and comprises of multiple likelihoods with noisy as well as missing values. In this work, we propose an unsupervised generative model that can learn a low-dimensional representation among the observations…

New quadrature method using randomly pivoted Cholesky outperforms existing techniques.

We propose an active learning method for discovering low-dimensional structure in high-dimensional Gaussian process (GP) tasks. Such problems are increasingly frequent and important, but have hitherto presented severe practical difficulties. We further introduce a novel technique for approximately marginalizing GP hype…

We consider probabilistic multinomial probit classification using Gaussian process (GP) priors. The challenges with the multiclass GP classification are the integration over the non-Gaussian posterior distribution, and the increase of the number of unknown latent variables as the number of target classes grows. Expecta…

There is resurging interest, in statistics and machine learning, in solvers for ordinary differential equations (ODEs) that return probability measures instead of point estimates. Recently, Conrad et al. introduced a sampling-based class of methods that are 'well-calibrated' in a specific sense. But the computational c…

Gaussian Process Latent Variable Model (GPLVM) is a flexible framework to handle uncertain inputs in Gaussian Processes (GPs) and incorporate GPs as components of larger graphical models. Nonetheless, the standard GPLVM variational inference approach is tractable only for a narrow family of kernel functions. The most p…

ProEval efficiently estimates AI performance and discovers failures using pre-trained Gaussian Processes.

SOBER optimizes and quadrates efficiently in parallel for diverse tasks.

This paper presents a convergence analysis of kernel-based quadrature rules in misspecified settings, focusing on deterministic quadrature in Sobolev spaces. In particular, we deal with misspecified settings where a test integrand is less smooth than a Sobolev RKHS based on which a quadrature rule is constructed. We pr…

We study quadrature rules for functions from an RKHS, using nodes sampled from a determinantal point process (DPP). DPPs are parametrized by a kernel, and we use a truncated and saturated version of the RKHS kernel. This link between the two kernels, along with DPP machinery, leads to relatively tight bounds on the qua…

Bayesian quadrature improves integration efficiency with invariant priors.

Herding and kernel herding are deterministic methods of choosing samples which summarise a probability distribution. A related task is choosing samples for estimating integrals using Bayesian quadrature. We show that the criterion minimised when selecting samples in kernel herding is equivalent to the posterior varianc…

Herding and kernel herding are deterministic methods of choosing samples which summarise a probability distribution. A related task is choosing samples for estimating integrals using Bayesian quadrature. We show that the criterion minimised when selecting samples in kernel herding is equivalent to the posterior varianc…

Improved kernel quadrature with convex weights using subsampling.

The sigma-point filters, such as the UKF, which exploit numerical quadrature to obtain an additional order of accuracy in the moment transformation step, are popular alternatives to the ubiquitous EKF. The classical quadrature rules used in the sigma-point filters are motivated via polynomial approximation of the integ…

Problems of interpolation, classification, and clustering are considered. In the tenets of Radon--Nikodym approach $\langle f(\mathbf{x})ψ^2 \rangle / \langleψ^2\rangle$, where the $ψ(\mathbf{x})$ is a linear function on input attributes, all the answers are obtained from a generalized eigenproblem $|f|ψ^{[i]}\rangle =…

Adaptive Bayesian quadrature (ABQ) is a powerful approach to numerical integration that empirically compares favorably with Monte Carlo integration on problems of medium dimensionality (where non-adaptive quadrature is not competitive). Its key ingredient is an acquisition function that changes as a function of previou…

This work introduces a fixed-point optimization for variational inference.

This paper introduces repulsive Monte Carlo methods for computing the sliced Wasserstein distance.

Bayesian neural networks speed up numerical integration.

Novel approach for estimating conditional expectations using Bayesian quadrature.

Improved Nyström approximation for kernel quadrature with theoretical guarantees.

Parallelized Bayesian quadrature improves sample efficiency and inference.

DBQPG improves policy gradient estimation with fewer samples.