Efficiently trains deep Gaussian processes with sparse approximations.
problem High computational complexity in training and inference for DGP models.
method Tensor Markov Gaussian Processes (TMGP) and hierarchical expansion to create DTMGP model.
result DTMGP model achieves superior computational efficiency compared to existing DGP models.
Improved MUSE boosts performance and reduces error in Bayesian inference.
problem Hierarchical Bayesian inference problems
method Implicit differentiation applied to MUSE algorithm
result Significant speedup and improved accuracy compared to Hamiltonian Monte Carlo
We introduce the Hierarchically Interacting Particle Neural Network (HIP-NN) to model molecular properties from datasets of quantum calculations. Inspired by a many-body expansion, HIP-NN decomposes properties, such as energy, as a sum over hierarchical terms. These terms are generated from a neural network--a composit…
In the genus expansion of the HOMFLY polynomials their representation dependence is naturally captured by symmetric group characters. This immediately implies that the Ooguri-Vafa partition function (OVPF) is a Hurwitz tau-function. In the planar limit involving factorizable special polynomials, it is actually a trivia…
Paper tackles RL for power grid topology optimization.
problem Managing large action spaces in growing power networks.
method Hierarchical multi-agent reinforcement learning (MARL) framework.
result MARL framework outperforms single-agent RL methods.
PVI seeks a posterior that makes predictions closer to true data, not approximating the Bayesian posterior.
problem Finding meaningful posterior distributions under model misspecification.
method Predictive variational inference (PVI) seeks an optimal posterior density for close predictive matching to true data.
result PVI learns a posterior that is not the same as the Bayesian posterior, but is closer to the true data generating process.
Residual networks' depth is mathematically equivalent to expanding an implicit ensemble size.
problem Understanding why deep residual networks are effective.
method Formal analysis of residual networks as ensembles of shallow models.
result Increasing network depth is equivalent to expanding the size of an implicit ensemble, revealing a hierarchical structure.
Kernel density estimation (KDE) is a popular statistical technique for estimating the underlying density distribution with minimal assumptions. Although they can be shown to achieve asymptotic estimation optimality for any input distribution, cross-validating for an optimal parameter requires significant computation do…
We provide faster algorithms for the problem of Gaussian summation, which occurs in many machine learning methods. We develop two new extensions - an O(Dp) Taylor expansion for the Gaussian kernel with rigorous error bounds and a new error control scheme integrating any arbitrary approximation method - within the best …
Efficiently price high-dimensional Bermudan options using tensor compression.
problem High-dimensional option pricing with computational complexity.
method Hierarchical tensor compression for Monte Carlo and dual martingale methods.
result Tensor compression alleviates the curse of dimensionality for Bermudan option pricing.
The study optimizes Gaussian process approximations for finite-rank models.
problem Posterior behavior of finite-rank approximations differs from parent GP priors.
method Locally supported basis expansions with dependent Gaussian coefficients.
result Finite-rank expansions inherit the same posterior contraction rate as parent GP priors.
This article describes an implementation of a nonparametric Bayesian approach to solving binary classification problems on graphs. We consider a hierarchical Bayesian approach with a prior that is constructed by truncating a series expansion of the soft label function using the graph Laplacian eigenfunctions as basis f…
New method estimates SDE parameters efficiently using WCE and SGD.
problem Parameter estimation for stochastic differential equations.
method Wiener Chaos Expansion and Stochastic Gradient Descent.
result Accurate parameter recovery from noisy observations.
Three-layer networks learn complex hierarchical polynomials of multiple nonlinear features.
problem Understanding how neural networks learn hierarchical features of multiple nonlinear inputs.
method Examine a broad class of functions using three-layer neural networks, showing complete recovery and efficient learning.
result Three-layer neural networks trained via gradient descent can learn hierarchical polynomials of multiple nonlinear features efficiently.
Recently, graph neural networks have been adopted in a wide variety of applications ranging from relational representations to modeling irregular data domains such as point clouds and social graphs. However, the space of graph neural network architectures remains highly fragmented impeding the development of optimized …
Improved HGF networks avoid negative precision errors in volatility updates.
problem Negative posterior precision errors in volatility-coupled nodes of HGF networks.
method Introduced a modified quadratic approximation to variational energy.
result Robust update equations across parameter space that track posterior faithfully.
Improved MCMC sampling for expensive, irregular likelihoods.
problem Bayesian inference challenges with irregular, expensive likelihoods.
method Adapt subset samplers, introduce data-driven proxies, adaptive controller.
result Improved HINTS algorithm achieves best sampling error in fixed budget.
Unified framework for imputation and prediction in healthcare time series.
problem Time misalignment and data sparsity in healthcare time series.
method MAGIC (Multi-tAsk Gaussian Process for Imputation and Classification) using hierarchical multi-task Gaussian process and functional logistic regression.
result Superior predictive accuracy compared to existing methods in two healthcare applications.
Develops a new feature theory for robust machine learning.
problem Creating robust machine learning features from training data.
method Stochastic tensor space feature theory with Karhunen-Loeve expansion and hierarchical subspaces.
result Dramatic increases in accuracy for predicting Alzheimer's disease stages.
Rescaling expansiveness proven for k*-expansive vector fields.
problem Proving rescaling expansiveness for k*-expansive vector fields.
method Introducing and exploring singular-expansive flows.
result Rescaling expansiveness established for k*-expansive vector fields.
Develops state-space deep Gaussian processes for irregular signals.
problem Solving deep Gaussian process regression problems for irregular signals/functions.
method Represent DGPs as SDEs, solve using state-space filtering and smoothing methods.
result Rich class of priors compatible with irregular signals/functions.
The paper derives expansions for Green's operators and resolvents using Hadamard methods.
problem Analyzing normally hyperbolic operators and their Green's functions.
method Hadamard expansions for powers of Green's operators and resolvents.
result Derives expansions involving Hadamard coefficients for advanced/retarded Green's operators.
Develops a martingale expansion for stochastic volatility models.
problem Approximating marginal distributions of stochastic volatility models.
method Martingale expansion framework for continuous stochastic volatility models.
result First-order perturbation expansions for small volatility-of-volatility and fast mean-reversion models.
Taylor expansions improve reinforcement learning policies.
problem Improving reinforcement learning policy optimization.
method Taylor expansion policy optimization.
result Taylor expansions enhance performance of distributed algorithms.
Analytic torsion expansions for symmetric and complex homogeneous spaces.
problem Calculating the full asymptotic expansion of analytic torsion for various spaces.
method Explicit calculation and comparison with existing results.
result Explicit full asymptotic expansions for symmetric and complex homogeneous spaces.
Proved cyclotomic expansion for double twist knots' HOMFLY-PT invariants.
problem Proving cyclotomic expansion for colored HOMFLY-PT invariants of double twist knots.
method Cyclotomic expansion formula for double twist knots.
result Confirmed cyclotomic expansion conjecture for SU(N)-invariants.
Study of hypersurfaces with specific expansion properties.
problem Existence and properties of hypersurfaces with prescribed null expansion.
method Adapted Eichmair's Perron approach for existence.
result Topology theorem for hypersurfaces with prescribed null expansion.
A new hypergraph expansion method treats vertices and hyperedges equally, improving node classification.
problem Information loss in hypergraph expansions on either vertex or hyperedge level.
method Proposes a new hypergraph formulation named line expansion (LE) that treats vertices and hyperedges symmetrically.
result The proposed line expansion method outperforms state-of-the-art baselines on five hypergraph datasets.
Novel approach constructs differential causal networks from EEG data.
problem Difficulty in modeling interactions of thousands of neurons in group comparisons.
method Hierarchical differential dynamic causal nets based on Chen-Fliess expansions.
result Evidence of network functional disruptions in epileptic brains.
Paper introduces hierarchical softmax for global hierarchical classification tasks.
problem Improving classification accuracy in tasks with class hierarchies.
method Global hierarchical neural networks using hierarchical softmax.
result Hierarchical softmax outperforms regular softmax in multiple datasets.
The paper calculates asymptotic expansions for specific types of oscillatory integrals.
problem Analyzing oscillatory integrals with complex phase functions.
method Using asymptotic expansions of simpler phase functions to derive results for more complex cases.
result Explicit computation of coefficients in asymptotic expansions for certain integrals.
Dropout increases the generalization of neural networks by expanding the weight space.
problem Understanding and improving the generalization of neural networks.
method Introducing weight expansion and showing that dropout leads to it.
result Dropout increases the generalization of neural networks by expanding the weight space.
New derivation of knot invariants from universal invariant.
problem Deriving knot invariants from universal invariant.
method Using Hopf algebra D and a Mathematica implementation to compute ZD(K). result Derivation of large-color expansion from universal invariant.
This work explores functional expansions to handle path dependence in various fields.
problem Path dependence and infinite-dimensional problems in non-Markovian systems.
method Generalizes Wiener series and functional Taylor expansion to handle static and dynamic functionals.
result Elegant separation of functionals from future trajectories in dynamic cases.
In the planar limit of the 't Hooft expansion, the Wilson-loop average in 3d Chern-Simons theory (i.e. the HOMFLY polynomial) depends in a very simple way on representation (the Young diagram), so that the (knot-dependent) Ooguri-Vafa partition function becomes a trivial KP tau-function. We study higher genus correctio…
This study compares hierarchical and non-hierarchical models for open-domain multi-turn dialog generation.
problem Which kind of models (hierarchical or non-hierarchical) is better for open-domain multi-turn dialog generation?
method Systematically compared nearly all representative hierarchical and non-hierarchical models over the same experimental settings.
result Nearly all hierarchical models are worse than non-hierarchical models in open-domain multi-turn dialog generation, except for HRAN.
Paper calculates third coefficient in Kaehler-Einstein metric expansion.
problem Understanding Kaehler-Einstein metrics and their epsilon functions.
method Computes the third coefficient in the TYCZ-expansion of the epsilon function.
result Discovers the vanishing of the third coefficient's significance.
We survey agglomerative hierarchical clustering algorithms and discuss efficient implementations that are available in R and other software environments. We look at hierarchical self-organizing maps, and mixture models. We review grid-based clustering, focusing on hierarchical density-based approaches. Finally we descr…
We describe the first known mean-field study of landing probabilities for random walks on hypergraphs. In particular, we examine clique-expansion and tensor methods and evaluate their mean-field characteristics over a class of random hypergraph models for the purpose of seed-set community expansion. We describe paramet…
Study on heat trace expansion for thermoelastic Dirichlet-to-Neumann map.
problem Asymptotic expansion of heat trace for thermoelastic Dirichlet-to-Neumann map.
method Provided a method to obtain all coefficients of the asymptotic expansion.
result Explicitly gave the first two coefficients involving volume and total mean curvature of the boundary.
The paper proposes and proves asymptotic expansions for quantum invariants.
problem Quantum invariants and their expansions under varying metrics.
method Asymptotic expansion conjectures for relative Reshetikhin-Turaev, Turaev-Viro invariants and quantum 6j-symbols.
result Proved asymptotic expansions for special cases, showing geometric dependence on metrics.
Compactness proven for isospectral Birkhoff billiard tables.
problem Proving compactness of isospectral Birkhoff billiard tables.
method Derived a hierarchical structure for integral invariants and used interpolating Hamiltonian.
result Compactness of equivalence classes of marked length isospectral Birkhoff billiard tables.
New method models portfolios with leptokurtic risk factors using Gram-Charlier expansions.
problem Modeling portfolios with excess kurtosis.
method GC-like expansions of the hyperbolic-secant law to account for leptokurtosis.
result Portfolio distribution with risk factors modeled as GC-like expansions of the HS law.
Develops AMITE for analyzing neural network nonlinearities.
problem Addressing difficulties in verification, explainability, and security in neural network analysis.
method Analytically modified integral transform expansion (AMITE) for neural network nonlinearities.
result First to provide six mutually exclusive desired expansion properties.
We survey recent results about the asymptotic expansion of Toeplitz operators and their kernels, as well as Berezin-Toeplitz quantization. We deal in particular with calculation of the first coefficients of these expansions.
Paper presents new expansions for option pricing with cash dividends.
problem No exact formula for European options with cash dividends.
method Uses Etore and Gobet's technique for piecewise lognormal process with jumps.
result Provides more robust first, second, and third-order expansions.
Paper proposes a Renyi entropy-based method for tuning hierarchical topic models.
problem Tuning hierarchical topic models, especially determining the number of topics at each level, is challenging.
method The paper introduces a Renyi entropy-based metric for quality assessment and a practical tuning concept.
result The proposed method can estimate the number of topics for two hierarchical levels in hARTM model.
The validity of an approximation formula for European option prices under a general stochastic volatility model is proved in the light of the Edgeworth expansion for ergodic diffusions. The asymptotic expansion is around the Black-Scholes price and is uniform in bounded payoff func- tions. The result provides a validat…