Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

98197295393 · Jun 202019922001200920172026
48 results for Inducing Points

The paper introduces a method to probabilistically select inducing points in sparse Gaussian processes.

problem The challenge is selecting the optimal number of inducing points in sparse Gaussian processes.
method A point process prior is applied to the inducing points, and the posterior is approximated using stochastic variational inference.
result The model learns which and how many inducing points to use, leading to fewer inducing points being preferred as they become less informative.

A new method selects inducing points to optimize high-throughput Bayesian optimisation.

problem Current inducing point selection methods sacrifice high-fidelity modeling of promising regions.
method Information-theoretic criterion to select inducing points maximizing global and maximum value uncertainties.
result Surrogate models support high-precision high-throughput Bayesian optimisation.

Local GP approach improves simulation efficiency for large datasets.

problem High computational cost of traditional Gaussian processes for large-scale simulations.
method Hybridizes global and local GP approximations with strategic placement of inducing points.
result Local inducing points enhance accuracy and computational efficiency.

Study investigates induced geometry on surfaces in 3D contact manifolds.

problem Understanding the metric structure on surfaces embedded in 3D contact sub-Riemannian manifolds.
method Defined a coefficient to characterize characteristic points and identified global conditions for finite induced distance.
result Proved induced distance finite for certain surfaces with isolated characteristic points.

Global inducing points improve Bayesian neural network performance.

problem Improving Bayesian neural network performance.
method Adapting correlated approximate posterior to all layers in a Bayesian neural network and deep Gaussian processes using learned global inducing points.
result State-of-the-art performance on CIFAR-10 (86.7%) without data augmentation or tempering.

HIP-GP improves GP inference for inter-domain observations with millions of inducing points.

problem Inference for Gaussian Processes across different domains.
method Hierarchical inducing point Gaussian process with grid structure and stationary kernel assumption.
result Improved approximation accuracy through increased number of inducing points.

Sparse Gaussian Processes improve scalability by learning inducing points from data.

problem Scaling issues in Gaussian Processes due to cubic computational cost.
method Amortized learning of inducing points and variational posterior parameters using neural networks.
result Significant reduction in the number of inducing points, improving scalability.

New method optimizes Gaussian process allocation for BO.

problem Existing methods for inducing point allocation in BO hinder performance.
method Proposes a new allocation strategy using quality-diversity decomposition.
result Demonstrates improved BO performance through local high-fidelity modeling.

New method DDVI improves posterior inference for deep Gaussian processes.

problem Inference of inducing points in DGPs is challenging and biased.
method DDVI uses denoising diffusion SDE and score matching for posterior approximation.
result Empirically shows DDVI outperforms baseline methods in inducing point inference.

Kernel methods on discrete domains have shown great promise for many challenging data types, for instance, biological sequence data and molecular structure data. Scalable kernel methods like Support Vector Machines may offer good predictive performances but do not intrinsically provide uncertainty estimates. In contras…

2018-10-24abs ↗pdf ↗

Proposes FIPO-BC for efficient online calibration of complex models.

problem Efficiently calibrating computationally expensive models with large datasets.
method Fixed inducing points online Bayesian calibration (FIPO-BC) algorithm.
result FIPO-BC is at least ten times faster than standard methods and enables online updates.

Learning new representations of input observations in machine learning is often tackled using a factorization of the data. For many such problems, including sparse coding and matrix completion, learning these factorizations can be difficult, in terms of efficiency and to guarantee that the solution is a global minimum.…

2016-04-17abs ↗pdf ↗

New algorithms improve GP inference without approximations, achieving better results.

problem Inexact stochastic optimization methods in Gaussian Processes leading to biased results.
method Exact stochastic inference for GPs with finite dimensional RKHS, extending to infinite dimensions.
result Achieves better experimental results than existing methods in constrained resource settings.

Paper tightens variational GP approximations for large datasets.

problem Scaling Gaussian processes to large datasets.
method Relaxing the standard assumption about inducing points' posterior matching the prior, leading to a tighter variational approximation.
result The proposed approximation consistently matches or outperforms standard sparse variational GPs while maintaining computational cost.

We present Blitzkriging, a new approach to fast inference for Gaussian processes, applicable to regression, optimisation and classification. State-of-the-art (stochastic) inference for Gaussian processes on very large datasets scales cubically in the number of 'inducing inputs', variables introduced to factorise the mo…

2015-10-27abs ↗pdf ↗

ASkotch solves large-scale KRR faster and better than existing methods.

problem Challenges in scaling full Kernel Ridge Regression (KRR) to large datasets.
method ASkotch: A scalable, accelerated, iterative method for full KRR.
result ASkotch provides better solutions faster than state-of-the-art solvers for full and inducing points KRR.

We find a new relation among right-handed Dehn twists in the mapping class group of a kk-holed torus for 4k94 \leq k \leq 9. This relation induces an elliptic Lefschetz pencil structure on the four-manifold \cp $#(9-k)$ \cpb with kk base points and twelve singular fibers. By blowing up the base points we get an el…

2006-04-24abs ↗pdf ↗

The paper proposes a method to detect credit card fraud using sparse Gaussian approximations.

problem Detecting credit card fraud in financial institutions.
method Sparse Gaussian classification method with pseudo or inducing inputs and different kernels and inducing points.
result The RBF kernel with a higher number of inducing points achieved the best accuracy.

We establish a product formula for Gromov-Witten invariants for closed, connected, relatively semi-positive Hamiltonian fibrations over any symplectic base. Furthermore, we show that the fibration projection induces a locally trivial (orbi-)fibration map from the moduli space of pseudo-holomorphic maps with marked poin…

2009-04-09abs ↗pdf ↗

Sparse GPs improved with nearest neighbor inducing variables.

problem Sparse GPs struggle with large numbers of inducing variables.
method Introduced a hierarchical prior for inducing variables and used nearest neighbor information for sparsity.
result Significant computational gains compared to standard sparse GPs.

We introduce a representation theory for risk operations on locally compact groups in a partition of unity on a topological manifold for Markowitz-Tversky-Kahneman (MTK) reference points. We identify (1) risk torsion induced by the flip rate for risk averse and risk seeking behaviour, and (2) a structure constant or co…

2012-06-12abs ↗pdf ↗

Gaussian processes (GPs) are flexible models that can capture complex structure in large-scale dataset due to their non-parametric nature. However, the usage of GPs in real-world application is limited due to their high computational cost at inference time. In this paper, we introduce a new framework, \textit{kernel di…

2018-01-31abs ↗pdf ↗

This paper analyzes error in SKI for Gaussian Processes, providing conditions for linear time inference.

problem Lack of rigorous theoretical error analysis for SKI.
method Proved error bounds for SKI Gram matrix, examined error effects, provided practical guidelines.
result Identified two dimensionality regimes for SKI's scalability-accuracy trade-offs.

This paper constructs a family of coordinate systems about a point on a quaternionic contact manifold, called quaternionic contact pseudohermitian normal coordinates. Once defined, conformal variations of the quaternionic contact structure induce changes on the coordinates which are studied in an effort to simplify the…

2008-07-02abs ↗pdf ↗

The fine curve graph is hyperbolic and contains all countable graphs as induced subgraphs.

problem Characterizing the structure and properties of fine curve graphs.
method Analyzing the hyperbolicity and induced subgraph properties of fine curve graphs and their direct limits.
result The finitary curve graph has diameter 2, contains every countable graph as an induced subgraph, and has the homeomorphism group of the surface as its automorphism group.

CDP reduces point cloud dimensions by preserving detour-induced local non-convexity.

problem Preserving local non-convexity in point cloud dimensionality reduction.
method CDP builds a k-NN graph, identifies admissible pairs, aggregates normalized directions, and uses top-k eigenvectors for projection.
result CDP provides verifiable guarantees on post-projection distortion and direction energy.

On the space of positive 3-forms on a seven-manifold, we study a natural functional whose critical points induce metrics with holonomy contained in G2G_2. We prove short-time existence and uniqueness for its negative gradient flow. Furthermore, we show that the flow exists for all times and converges modulo diffeomorph…

2009-12-02abs ↗pdf ↗

Gaussian process classification is a popular method with a number of appealing properties. We show how to scale the model within a variational inducing point framework, outperforming the state of the art on benchmark datasets. Importantly, the variational formulation can be exploited to allow classification in problems…

2014-11-07abs ↗pdf ↗