Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

23456890 · Jun 202019922001200920172026
48 results for hierarchical GPs

HIP-GP improves GP inference for inter-domain observations with millions of inducing points.

problem Inference for Gaussian Processes across different domains.
method Hierarchical inducing point Gaussian process with grid structure and stationary kernel assumption.
result Improved approximation accuracy through increased number of inducing points.

Bayesian estimators for causal inference using hierarchical Gaussian Processes.

problem Estimating causal effects in sharp and fuzzy RD/RK designs.
method Hierarchical Gaussian Process models for regression and classification.
result Hierarchical GP models improve precision and coverage of RD/RK estimations.

Proposes GPHMEs using Gaussian processes for hierarchical expert models.

problem Hierarchical mixtures of experts with complex gating functions.
method Gaussian process-gated hierarchical mixtures of experts (GPHMEs) with non-linear gating and expert functions.
result Outperforms tree-based HMEs and achieves good performance with reduced complexity.

We propose a multiresolution Gaussian process to capture long-range, non-Markovian dependencies while allowing for abrupt changes. The multiresolution GP hierarchically couples a collection of smooth GPs, each defined over an element of a random nested partition. Long-range dependencies are captured by the top-level GP…

2012-09-05abs ↗pdf ↗

The study optimizes Gaussian process approximations for finite-rank models.

problem Posterior behavior of finite-rank approximations differs from parent GP priors.
method Locally supported basis expansions with dependent Gaussian coefficients.
result Finite-rank expansions inherit the same posterior contraction rate as parent GP priors.

Bayesian framework reduces high-dimensional GP modeling costs.

problem Challenges in fitting Gaussian processes to high-dimensional inputs.
method Hierarchical Bayesian model with orthonormal projection matrix, incorporating Deep Gaussian Processes.
result Improves predictive performance and uncertainty quantification.

MPHD transfers knowledge across different domains for Bayesian optimization.

problem Optimizing functions with unknown or diverse domains.
method MPHD uses neural nets to map domain-specific contexts to GP specifications, enabling transfer learning across heterogeneous search spaces.
result MPHD improves black-box function optimization performance on diverse domains.

The paper predicts an Efficient Market Property for the equity market, where stocks, when denominated in units of the growth optimal portfolio (GP), have zero instantaneous expected returns. Well-diversified equity portfolios are shown to approximate the GP, which explains the well-observed good performance of equally …

2017-06-21abs ↗pdf ↗

In this paper a new Bayesian model for sparse linear regression with a spatio-temporal structure is proposed. It incorporates the structural assumptions based on a hierarchical Gaussian process prior for spike and slab coefficients. We design an inference algorithm based on Expectation Propagation and evaluate the mode…

2017-04-27abs ↗pdf ↗

Unified view on GP transfer learning for Bayesian optimization.

problem Improving data efficiency in Bayesian optimization with scarce data.
method Unified hierarchical GP models for transfer learning, including a novel boosted GP transfer model.
result Unified analysis and comparison of transfer learning methods for GP models.

Deep Gaussian Processes (DGPs) were proposed as an expressive Bayesian model capable of a mathematically grounded estimation of uncertainty. The expressivity of DPGs results from not only the compositional character but the distribution propagation within the hierarchy. Recently, [1] pointed out that the hierarchical s…

2020-02-07abs ↗pdf ↗

Wide neural networks can degrade performance, contrary to conventional wisdom.

problem Understanding the limitations of increasing network width in neural networks.
method Using Deep Gaussian Processes to decouple capacity and width, analyzing their effects on representational power and non-Gaussianity.
result Wide neural networks can become less adaptable and more Gaussian, leading to performance degradation.

MTL-NAS combines NAS with GP-MTL for task-agnostic multi-task learning.

problem Designing architectures for diverse tasks with varying priors.
method Disentangled GP-MTL networks, hierarchical feature sharing, and gradient-based search.
result General-purpose model trained once can adapt to multiple tasks.

Gaussian processes (GP) are powerful tools for probabilistic modeling purposes. They can be used to define prior distributions over latent functions in hierarchical Bayesian models. The prior over functions is defined implicitly by the mean and covariance function, which determine the smoothness and variability of the …

2012-06-25abs ↗pdf ↗

Sparse GPs improved with nearest neighbor inducing variables.

problem Sparse GPs struggle with large numbers of inducing variables.
method Introduced a hierarchical prior for inducing variables and used nearest neighbor information for sparsity.
result Significant computational gains compared to standard sparse GPs.

This paper reviews recent advances in Gaussian process regression methods.

problem Handling uncertainties and scalability in large-scale systems with sparse data.
method Factorised Gaussian process methods, including hierarchical off-diagonal low-rank approximation and GP with Kronecker structures.
result These methods provide scalable solutions with inherent uncertainty assessment.

Combines physics-based ML with hierarchical Bayesian techniques for better model performance.

problem Lack of physical knowledge in black-box machine learning models.
method Embeds physics-based models into Gaussian Process mean function and uses kernel machines to characterize discrepancies.
result Improved model performance under blind conditions through integration of physics-based knowledge.

Deep Gaussian Processes (DGP) are hierarchical generalizations of Gaussian Processes (GP) that have proven to work effectively on a multiple supervised regression tasks. They combine the well calibrated uncertainty estimates of GPs with the great flexibility of multilayer models. In DGPs, given the inputs, the outputs …

2018-01-09abs ↗pdf ↗

Many real-world regression problems demand a measure of the uncertainty associated with each prediction. Standard decision forests deliver efficient state-of-the-art predictive performance, but high-quality uncertainty estimates are lacking. Gaussian processes (GPs) deliver uncertainty estimates, but scaling GPs to lar…

2015-06-11abs ↗pdf ↗

We introduce a Gaussian process model of functions which are additive. An additive function is one which decomposes into a sum of low-dimensional functions, each depending on only a subset of the input variables. Additive GPs generalize both Generalized Additive Models, and the standard GP models which use squared-expo…

2011-12-19abs ↗pdf ↗

New models improve stock and wind speed forecasting.

problem Lack of posterior distribution in stochastic volatility models.
method Re-cast stochastic volatility models as hierarchical Gaussian processes with specialized covariance functions.
result Volt and Magpie models significantly outperform baselines in forecasting.

This work evaluates uncertainty in deep Gaussian processes.

problem Uncertainty quantification in deep Gaussian processes.
method Hierarchical deep Gaussian processes (DGPs) and Deep Sigma Point Processes (DSPPs) evaluated on regression and classification tasks.
result DSPPs provide strong in-distribution calibration but are less robust under distribution shift compared to ensembles.

The paper develops a state-space approach to deep Gaussian processes for efficient state estimation.

problem Efficient regression and state estimation for deep Gaussian processes.
method Hierarchical transformed Gaussian process priors, state-space representation, linear stochastic differential equations, sequential methods.
result The state-space approach enables efficient state estimation and regression for deep Gaussian processes.

A new model combines deep learning and Gaussian Processes with hyperdata learning.

problem Combining deep learning and Gaussian Processes for expressive and robust learning.
method Conditional Deep Gaussian Process (DGP) with hyperdata learning and approximate inference.
result Conditional DGP offers better expressiveness and robustness compared to existing methods.

A large GPS dataset reveals that a single route often covers 60% of travel observations.

problem Limited insights from small GPS datasets on route choice behavior.
method Evaluation of path generation algorithms including link penalty, link elimination, simulation, and via-node methods.
result Modified link penalty method achieves 97% coverage, significantly higher than previous studies.

Deep Gaussian processes reduce uncertainty in porous media flow modeling.

problem Uncertainty quantification in flow through heterogeneous porous media.
method Multi-layer hierarchical Gaussian process with variational approximation.
result Automatic selection of hidden layer dimensions and uncertainty propagation.

Uncertainty quantification has been a core of the statistical machine learning, but its computational bottleneck has been a serious challenge for both Bayesians and frequentists. We propose a model-based framework in quantifying uncertainty, called predictive-matching Generative Parameter Sampler (GPS). This procedure …

2019-05-28abs ↗pdf ↗

Paper uses Gaussian processes to handle shared latent confounders in causal inference.

problem Bias in causal effect estimates due to shared latent confounders.
method Hierarchical Bayesian model, Gaussian processes with structured latent confounders (GP-SLC), Monte Carlo inference algorithm.
result GP-SLC provides accurate estimates of individual treatment effects with minimal assumptions.

Gaussian Processes (GPs) are widely used tools in statistics, machine learning, robotics, computer vision, and scientific computation. However, despite their popularity, they can be difficult to apply; all but the simplest classification or regression applications require specification and inference over complex covari…

2015-12-17abs ↗pdf ↗

Efficiently clusters data with weak assumptions, robust to contamination.

problem General-shaped clustering under weak parametric assumptions with data contamination.
method Two-step hybrid robust clustering algorithm combining trimmed k-means and hierarchical agglomeration.
result Outperforms state-of-the-art methods in various applications.

The paper extends NSGPs with L1L^1-regularization for sparsity and solves the resulting R-NSGP regression problem.

problem Sparsity in non-stationary temporal data.
method Developed an ADMM-based method for solving the regularized NSGP regression problem.
result The proposed methods induce sparsity in the parameters of NSGPs.

Capsule Networks attempt to represent patterns in images in a way that preserves hierarchical spatial relationships. Additionally, research has demonstrated that these techniques may be robust against adversarial perturbations. We present an improvement to training capsule networks with added robustness via non-paramet…

2019-06-07abs ↗pdf ↗

DeepICMGP surrogate models multiple outputs efficiently.

problem Challenges in modeling dependencies between multiple outputs using traditional multi-output GPs.
method Introduces hierarchical coregionalization structures across layers in DGPs.
result Demonstrates competitive performance and active learning strategies.

The paper provides theoretical guarantees for transformation-based models in variational inference.

problem Theoretical justification for transformation-based models in variational inference.
method Theoretical analysis of non-linear latent variable models and Gaussian process priors.
result Theoretical guarantees for implicit variational inference, achieving optimal risk bounds and approximating the true posterior.

Deep Transformed Gaussian Processes extend TGPs with variational inference for scalable multi-layer modeling.

problem Flexible modeling of complex data distributions.
method DTGPs are a multi-layer model of TGPs using variational inference for scalability.
result DTGPs achieve good scalability and performance in multiple regression datasets.

In this paper, the problem of estimating the level set of a black-box function from noisy and expensive evaluation queries is considered. A new algorithm for this problem in the Bayesian framework with a Gaussian Process (GP) prior is proposed. The proposed algorithm employs a hierarchical sequence of partitions to exp…

2019-02-26abs ↗pdf ↗

Develops scalable model for learning velocity fields in complex traffic scenarios.

problem Learning heterogeneous and dynamic velocity fields in complex traffic scenarios.
method Nonparametric Bayesian modeling with hierarchical Dirichlet process and infinite hidden Markov model, Gaussian process prior, and scalable approximate inference.
result Demonstrates effective scalability and applicability to real-world traffic data.