Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

164328491655 · Jun 202019922001200920172026
48 results for approximate Stein classes

Paper proposes approximate Stein classes for efficient truncated density estimation.

problem Difficulties in estimating truncated density models due to intractable normalising constants and boundary conditions.
method Adapts score matching to solve the problem, introduces approximate Stein classes and a novel discrepancy measure, TKSD.
result TKSD does not require a fixed weighting function and can be evaluated using only boundary samples, leading to improved accuracy.

Stein's method for measuring convergence to a continuous target distribution relies on an operator characterizing the target and Stein factor bounds on the solutions of an associated differential equation. While such operators and bounds are readily available for a diversity of univariate targets, few multivariate targ…

2016-11-21abs ↗pdf ↗

An important task in machine learning and statistics is the approximation of a probability measure by an empirical measure supported on a discrete point set. Stein Points are a class of algorithms for this task, which proceed by sequentially minimising a Stein discrepancy between the empirical measure and the target an…

2019-05-09abs ↗pdf ↗

Study approximates weak error for specific stochastic models with rough and Gaussian mean-reverting volatility.

problem Approximating weak error for specific stochastic models with rough and Gaussian mean-reverting volatility.
method Used Euler type scheme with integrated kernels to study weak convergence rate.
result Obtained weak convergence rate of min(3α1,1)\min(3α-1,1) for discretised rough Ornstein-Uhlenbeck process and stochastic rough volatility model.

Improved neural network ensembles using Stein Variational Newton updates.

problem Lack of efficient second-order information in current ensemble methods.
method Proposes a novel approximate Bayesian inference method integrating Stein Variational Newton updates with scalable Hessian approximations.
result Significantly faster convergence and more accurate posterior distribution approximations.

An important task in computational statistics and machine learning is to approximate a posterior distribution p(x)p(x) with an empirical measure supported on a set of representative points {xi}i=1n\{x_i\}_{i=1}^n. This paper focuses on methods where the selection of points is essentially deterministic, with an emphasis on achi…

2018-03-27abs ↗pdf ↗

AgraSSt assesses graph generators using Stein operators and kernel discrepancies.

problem Assessing the quality of graph generators that are implicit or not in explicit form.
method AgraSSt uses Stein operators and kernel discrepancies to assess graph generators, providing interpretable criticisms.
result Theoretical guarantees and empirical validation for various graph models.

Computable Stein discrepancies have been deployed for a variety of applications, ranging from sampler selection in posterior inference to approximate Bayesian inference to goodness-of-fit testing. Existing convergence-determining Stein discrepancies admit strong theoretical guarantees but suffer from a computational co…

2018-06-20abs ↗pdf ↗

Stein transport improves Bayesian inference with faster convergence and reduced variance.

problem Efficiently approximating posterior distributions in Bayesian inference.
method A novel Bayesian inference method using Stein transport, which pushes particles along a curve of tempered distributions.
result Stein transport reaches posterior approximations faster and more accurately than Stein variational gradient descent (SVGD).

Improving scalability and stability of Stein discrepancies for scalable goodness-of-fit testing

problem Improving scalability and stability of Stein discrepancies for scalable goodness-of-fit testing
method Reformulating Stein discrepancy construction as an explicit SNR^2 maximisation problem
result Avoiding exponential SNR^2 collapse and achieving stable SNR^2

SRF improves kernel approximation and GP regression performance.

problem Efficient kernel approximation and Bayesian kernel learning in large-scale regression problems.
method Stein variational gradient descent to generate high-quality random features and approximate spectral measure posteriors.
result SRF outperforms traditional approaches in kernel approximation and GP regression.

The paper analyzes rates for a modified gradient descent method using Stein variational gradients.

problem Improving the accuracy of gradient descent methods for complex target distributions.
method Derives finite-particle rates for regularized Stein variational gradient descent (R-SVGD).
result Establishes explicit non-asymptotic bounds for time-averaged empirical measures.

New open books solve a long-standing surface mapping class group question.

problem Understanding the mapping class group of surfaces with boundary.
method Constructing non-positive open books with once-punctured torus pages.
result Monoid of positive monodromies equals the monoid of monodromies supporting Stein-fillable contact structures if and only if the surface is planar.

Improved sampling method using regularized Stein Variational Gradient Flow.

problem Improving the accuracy of sampling methods in machine learning.
method Proposed Regularized Stein Variational Gradient Flow to interpolate between SVGD and Wasserstein Gradient Flow.
result Established theoretical properties and provided preliminary numerical evidence of improved performance.

Approximate Markov chain Monte Carlo (MCMC) offers the promise of more rapid sampling at the cost of more biased inference. Since standard MCMC diagnostics fail to detect these biases, researchers have developed computable Stein discrepancy measures that provably determine the convergence of a sample to its target dist…

2017-03-06abs ↗pdf ↗

Stein variational gradient descent (SVGD) is a deterministic sampling algorithm that iteratively transports a set of particles to approximate given distributions, based on an efficient gradient-based update that guarantees to optimally decrease the KL divergence within a function space. This paper develops the first th…

2017-04-25abs ↗pdf ↗

CSD improves goodness-of-fit testing for higher-order dependence.

problem Insensitivity of standard KSDs to higher-order dependence features like tail dependence.
method Introduces Copula-Stein Discrepancy (CSD) that targets dependence geometry directly on copula density.
result CSD is sensitive to differences in tail dependence coefficients and metrizes weak convergence of copula distributions.

We characterize the closed, oriented, Seifert fibered 3-manifolds which are oriented boundaries of Stein manifolds. We also show that for this class of 3-manifolds the existence of Stein fillings is equivalent to the existence of symplectic fillings.

2010-07-18abs ↗pdf ↗

New method uses multiple kernels to improve SVGD performance.

problem Sub-optimal performance of single kernel in SVGD.
method Combines multiple kernels to approximate optimal kernel, using Kernelized Stein Discrepancy (KSD) and constructing Multiple Kernel SVGD (MK-SVGD).
result Consistently matches or outperforms competing methods in experiments.

A new method improves inference for complex Bayesian models.

problem Bayesian inference for doubly intractable distributions is computationally challenging.
method Monte Carlo Stein variational gradient descent (MC-SVGD) approach.
result The method achieves substantial computational gains over existing algorithms.

We give an algorithm which produces infinitely many pairwise exotic Stein fillings of the same contact 3-manifolds, applying positive allowable Lefschetz fibrations over the disk. As a corollary, for a large class of Stein fillings, we realize the topological invariants (i.e. fundamental group, homology group, homology…

2014-05-31abs ↗pdf ↗

SDG uses optimal control to improve classifier guidance in low-density regions.

problem Inefficient guidance in low-density regions of posterior distributions.
method Integrates stochastic optimal control with Stein variational inference to compute the steepest descent direction.
result SDG improves guidance in low-density regions, outperforming standard methods.

A new framework improves kernel Stein discrepancy tests for validating distributions.

problem Improving goodness-of-fit testing for non-normal distributions.
method Introducing Sf-KSD, a unifying framework for studying Stein operators in KSD-based tests.
result Sf-KSD guides the development of new tests and outperforms existing methods.

SVGD algorithm converges at rate 1/sqrt(log log n) for sub-Gaussian distributions.

problem Approximating a probability distribution with particles.
method Stein variational gradient descent (SVGD) with finite particles and sub-Gaussian target distribution.
result SVGD achieves a convergence rate of 1/sqrt(log log n) for sub-Gaussian distributions.

The purpose of this paper is to synthesize the approaches taken by Chatterjee-Meckes and Reinert-Röllin in adapting Stein's method of exchangeable pairs for multivariate normal approximation. The more general linear regression condition of Reinert-Röllin allows for wider applicability of the method, while the method of…

2009-02-02abs ↗pdf ↗

New algorithm tunes SGMCMC hyperparameters for scalable Bayesian inference.

problem Tuning hyperparameters for SGMCMC is challenging due to lack of principled methods.
method Proposes a bandit-based algorithm using Stein discrepancies to tune hyperparameters.
result The method effectively tunes SGMCMC hyperparameters for various applications.

Paper analyzes SVGD algorithm for non-asymptotic convergence.

problem Optimizing a set of particles to approximate a target probability distribution.
method Finite time analysis of SVGD algorithm, providing descent lemma and convergence rates.
result SVGD algorithm decreases the objective at each iteration and converges to the target distribution.

We develop Riemannian Stein Variational Gradient Descent (RSVGD), a Bayesian inference method that generalizes Stein Variational Gradient Descent (SVGD) to Riemann manifold. The benefits are two-folds: (i) for inference tasks in Euclidean spaces, RSVGD has the advantage over SVGD of utilizing information geometry, and …

2017-11-30abs ↗pdf ↗

New Stein identity for q-Gaussians reduces gradient variance in machine learning.

problem Improving gradient estimators for non-Gaussian distributions.
method Deriving a new Stein identity for bounded-support q-Gaussians and simplifying previous results.
result Gradient estimators for q-Gaussians have nearly identical forms to Gaussian ones, reducing variance.

Bayesian inference problems require sampling or approximating high-dimensional probability distributions. The focus of this paper is on the recently introduced Stein variational gradient descent methodology, a class of algorithms that rely on iterated steepest descent steps with respect to a reproducing kernel Hilbert …

2019-12-02abs ↗pdf ↗

New Stein fillings found for rational surface singularities.

problem Exploring Stein fillings of rational surface singularities.
method Using planar open books and Lefschetz fibrations, describe Stein fillings via symplectic disk arrangements.
result Many rational singularities admit Stein fillings not diffeomorphic to Milnor fibers.

We introduce a new generalization of Gompf nuclei and give applications. We construct infinitely many exotic smooth structures for a large class of compact 4-manifolds with boundary, regarding topological invariants. We prove that a large class of closed 3-manifolds (including disjoint unions of Stein fillable 3-manifo…

2011-11-02abs ↗pdf ↗

Stein variational gradient descent (SVGD) is a non-parametric inference algorithm that evolves a set of particles to fit a given distribution of interest. We analyze the non-asymptotic properties of SVGD, showing that there exists a set of functions, which we call the Stein matching set, whose expectations are exactly …

2018-10-27abs ↗pdf ↗

Stein importance sampling is a widely applicable technique based on kernelized Stein discrepancy, which corrects the output of approximate sampling algorithms by reweighting the empirical distribution of the samples. A general analysis of this technique is conducted for the previously unconsidered setting where samples…

2020-01-25abs ↗pdf ↗

In this article, we prove a generalization of a theorem of Lisca-Matic to Stein cobordisms and develop a method for distinguishing certain Stein cobordisms using rotation numbers. Using these results along with standard techniques from convex surface theory and classifications of tight contact structures on certain 3-m…

2017-10-18abs ↗pdf ↗

In this article, using combinatorial techniques of mapping class groups, we show that a Stein fillable integral homology 33-sphere supported by an open book decomposition with page a 44-holed sphere admits a unique Stein filling up to diffeomorphism. Furthermore, according to a property of deforming symplectic fillin…

2014-07-20abs ↗pdf ↗