Improves hyperparameter learning in GP models with non-conjugate likelihoods.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Gaussian Process Factor Analysis (GPFA) has been broadly applied to the problem of identifying smooth, low-dimensional temporal structure underlying large-scale neural recordings. However, spike trains are non-Gaussian, which motivates combining GPFA with discrete observation models for binned spike count data. The dra…
Latent Gaussian models (LGMs) are widely used in statistics and machine learning. Bayesian inference in non-conjugate LGMs is difficult due to intractable integrals involving the Gaussian prior and non-conjugate likelihoods. Algorithms based on variational Gaussian (VG) approximations are widely employed since they str…
The paper provides guarantees for a tangent transform algorithm in logistic regression models.
This paper proposes a method to approximate non-Gaussian likelihoods in Gaussian Processes.
Exploratory cancer drug studies test multiple tumor cell lines against multiple candidate drugs. The goal in each paired (cell line, drug) experiment is to map out the dose-response curve of the cell line as the dose level of the drug increases. We propose Bayesian Tensor Filtering (BTF), a hierarchical Bayesian model …
Combines VI and EP for better Gaussian process hyperparameter learning.
Mean-field variational inference is a method for approximate Bayesian posterior inference. It approximates a full posterior distribution with a factorized set of distributions by maximizing a lower bound on the marginal likelihood. This requires the ability to integrate a sum of terms in the log joint likelihood using …
We show that if a link has a closed -braid representative admitting non-degenerate exchange move, an exchange move that does not obviously preserve the conjugacy class, has infinitely many non-conjugate closed -braid representatives.
The natural gradient method has been used effectively in conjugate Gaussian process models, but the non-conjugate case has been largely unexplored. We examine how natural gradients can be used in non-conjugate stochastic settings, together with hyperparameter learning. We conclude that the natural gradient can signific…
New method speeds up inference for non-conjugate Gaussian processes.
Improves understanding of stochastic NGVI convergence rates.
Hierarchical beta process has found interesting applications in recent years. In this paper we present a modified hierarchical beta process prior with applications to hierarchical modeling of multiple data sources. The novel use of the prior over a hierarchical factor model allows factors to be shared across different …
cvHM framework speeds up GP inference for neural spike train analysis.
A new GP model uses spherical harmonics for faster inference.
Inference of latent feature models in the Bayesian nonparametric setting is generally difficult, especially in high dimensional settings, because it usually requires proposing features from some prior distribution. In special cases, where the integration is tractable, we can sample new feature assignments according to …
In a recent preprint Yael Karshon showed that there exist non-conjugate tori in a group of symplectomorphisms of a Hirzebruch surface. She counted them in terms of the cohomology class of the symplectic structure. We show that a similar phenomenon exists in the contactomorphism groups of pre-quantum circle bundles over…
Paper extends multi-task Gaussian Cox processes for heterogeneous tasks.
Making inferences from data streams is a pervasive problem in many modern data analysis applications. But it requires to address the problem of continuous model updating and adapt to changes or drifts in the underlying data generating distribution. In this paper, we approach these problems from a Bayesian perspective c…
Efficient Bayesian variable selection for binomial and negative binomial data.
Thompson sampling has impressive empirical performance for many multi-armed bandit problems. But current algorithms for Thompson sampling only work for the case of conjugate priors since these algorithms require to infer the posterior, which is often computationally intractable when the prior is not conjugate. In this …
Bayesian method tackles variable selection in high-dimensional data.
Unified approach to Bayesian inference with guarantees on covariance matrices.
A conjugate Bayesian method detects change points in Hawkes processes efficiently.
BONG optimizes Bayesian inference online with natural gradient descent.
We prove that under fairly general conditions an iterated exchange move gives infinitely many non-conjugate braids. As a consequence, every knot has infinitely many conjugacy classes of n-braid representations if and only if it has one admitting an exchange move.
New methods accelerate NCGP inference by trading computation for uncertainty.
This work brings together two powerful concepts in Gaussian processes: the variational approach to sparse approximation and the spectral representation of Gaussian processes. This gives rise to an approximation that inherits the benefits of the variational approach but with the representational power and computational …
Study on Metropolis-within-Gibbs schemes for high-dimensional Bayesian models.
We show that any two non-conjugate points on a forward or backward complete connected Finsler manifold can be joined by infinitely many geodesics which are not covered by finitely many closed ones, provided that the Betti numbers of the based loop space grow unbounded.
We prove the Morse relations for the set of all geodesics connecting two non-conjugate points on a class of globally hyperbolic Lorentzian manifolds. We overcome the difficulties coming from the fact that the Morse index of every geodesic is infinite, and from the lack of the Palais-Smale condition, by using the Morse …
Proposes a non-conjugate model selection method for chain event graphs.
The stochastic variational inference (SVI) paradigm, which combines variational inference, natural gradients, and stochastic updates, was recently proposed for large-scale data analysis in conjugate Bayesian models and demonstrated to be effective in several problems. This paper studies a family of Bayesian latent vari…
This is an addendum to arXiv: 0810.5376. We show, using our methods and an auxiliary result of Bestvina-Bromberg-Fujiwara, that a finitely generated group with infinitely many pairwise non-conjugate homomorphisms to a mapping class group virtually acts non-trivially on an -tree, and, if it is finitely presented, it…
The Hodge series of a finite matrix group is the generating function for invariant exterior forms of specified order and degree. Lauret, Miatello, and Rossetti gave examples of pairs of non-conjugate cyclic groups having the same Hodge series; the corresponding space forms are isospectral for the Laplacian on p-forms f…
We obtain infinitely many (non-conjugate) representations of 3-manifold fundamental groups into a lattice in the holomorphic isometry group of complex hyperbolic space. The lattice is an orbifold fundamental group of a branched covering of the projective plane along an arrangement of hyperplanes constructed by Hirzebru…
New subgroups of mapping class groups constructed for infinite-type surfaces.
Uncountably many fibrations found on genus 2 handlebody.
We obtain a result about the existence of only a finite number of geodesics between two fixed non-conjugate points in a Finsler manifold endowed with a convex function. We apply it to Randers and Zermelo metrics. As a by-product, we also get a result about the finiteness of the number of lightlike and timelike geodesic…
We use some Lie group theory and Budney's unitarization of the Lawrence-Krammer representation, to prove that for generic parameters of definite form the image of the representation (also on certain types of subgroups) is dense in the unitary group. This implies that, except possibly for closures of full-twist braids, …
We develop methods for efficient amortized approximate Bayesian inference over posterior distributions of probabilistic clustering models, such as Dirichlet process mixture models. The approach is based on mapping distributed, symmetry-invariant representations of cluster arrangements into conditional probabilities. Th…
It has been known since the time of Nielsen that the mapping class group of a surface of genus and one puncture acts faithfully by homeomorphisms on the circle. In this note, we show that this standard representation of the mapping class group is not rigid, precisely, if is a…
The paper analyzes symmetries of Vaidya-Bonner geodesics.
We prove a generalized version of the Morse index theorem for geodesics endowed with a non positive definite metric tensor (semi-Riemannian manifolds). We apply the result to obtain lower estimates on the number of geodesics joining two fixed non conjugate points in certain classes of manifolds. More specifically, we c…
The paper disproves a conjecture about isomorphic subgroups in finite groups.
In this note, we give an explicit counterexample to the simple loop conjecture for representations of surface groups into PSL(2,R). Specifically, we show that for any surface with negative Euler characteristic and genus at least 1, there are uncountably many non-conjugate, non-injective homomorphisms of its fundamental…
Improves SVGP methods for faster and more accurate Gaussian process inference.
We describe a simple fundamental domain for the holonomy group of the boundary unipotent spherical CR uniformization of the figure eight knot complement, and deduce that small deformations of that holonomy group (such that the boundary holonomy remains parabolic) also give a uniformization of the figure eight knot comp…