Efficient Thompson sampling for non-conjugate priors.
problem Thompson sampling's computational intractability with non-conjugate priors.
method Reformulate Thompson sampling as an optimization problem and use Gumbel-Max trick.
result Proposes an efficient algorithm for non-conjugate priors.
Bayesian model updates data streams with hierarchical priors.
problem Continuous model updating and adapt to changes in data distribution.
method Non-conjugate hierarchical priors and variational inference.
result Validated on real data sets, demonstrating adaptability.
Latent Gaussian models (LGMs) are widely used in statistics and machine learning. Bayesian inference in non-conjugate LGMs is difficult due to intractable integrals involving the Gaussian prior and non-conjugate likelihoods. Algorithms based on variational Gaussian (VG) approximations are widely employed since they str…
We develop a fast inference method for non-conjugate Gaussian process models on spike count data.
problem Non-Gaussian spike count data complicates Gaussian Process Factor Analysis.
method We introduce Polynomial Approximate Log-Likelihood (PAL) estimators for non-conjugate GPFA models.
result PAL estimators achieve fast and accurate extraction of latent structure from spike train data.
Proposes a non-conjugate model selection method for chain event graphs.
problem Existing model selection algorithms for chain event graphs rely on conjugate priors, which is unrealistic for many real-world applications.
method Proposes a mixture modelling approach to model selection in chain event graphs that does not rely on conjugacy.
result The proposed method is more scalable and robust than existing algorithms.
Natural gradients boost performance in non-conjugate Gaussian process models.
problem Improving inference in non-conjugate Gaussian process models.
method Use of natural gradients in non-conjugate stochastic settings with hyperparameter learning.
result Natural gradients significantly improve performance, especially for ill-conditioned posteriors.
New move proves infinitely many non-conjugate braids for certain links.
problem Proving infinitely many non-conjugate braids for certain link types.
method Introducing a non-degenerate exchange move.
result Links have infinitely many non-conjugate braids after applying the move.
Hierarchical beta process has found interesting applications in recent years. In this paper we present a modified hierarchical beta process prior with applications to hierarchical modeling of multiple data sources. The novel use of the prior over a hierarchical factor model allows factors to be shared across different …
The stochastic variational inference (SVI) paradigm, which combines variational inference, natural gradients, and stochastic updates, was recently proposed for large-scale data analysis in conjugate Bayesian models and demonstrated to be effective in several problems. This paper studies a family of Bayesian latent vari…
Bayesian model for cancer drug studies maps dose-response curves.
problem Mapping dose-response curves in cancer drug studies.
method Bayesian Tensor Filtering (BTF) with low-dimensional embeddings and structured shrinkage priors.
result BTF outperforms state-of-the-art methods in cancer drug studies.
Bayesian tree ensemble model for estimating treatment effects in high-dimensional survival data.
problem Estimating heterogeneous treatment effects in censored survival data with many covariates.
method Developed a Bayesian tree ensemble model with a horseshoe prior for adaptive shrinkage.
result Accurately estimates treatment effects in high-dimensional covariate spaces and non-linear functions.
New method speeds up inference for non-conjugate Gaussian processes.
problem Inference for non-conjugate Gaussian processes is slow and unreliable.
method Automated augmented conjugate inference method that constructs auxiliary variables to make the model conditionally conjugate.
result Our method is up to two orders of magnitude faster and more robust than existing methods.
Inference of latent feature models in the Bayesian nonparametric setting is generally difficult, especially in high dimensional settings, because it usually requires proposing features from some prior distribution. In special cases, where the integration is tractable, we can sample new feature assignments according to …
In a recent preprint Yael Karshon showed that there exist non-conjugate tori in a group of symplectomorphisms of a Hirzebruch surface. She counted them in terms of the cohomology class of the symplectic structure. We show that a similar phenomenon exists in the contactomorphism groups of pre-quantum circle bundles over…
BONG optimizes Bayesian inference online with natural gradient descent.
problem Sequential Bayesian inference in online settings.
method Bayesian online natural gradient (BONG) approach based on variational Bayes.
result BONG outperforms other online VB methods in non-conjugate settings.
The paper provides guarantees for a tangent transform algorithm in logistic regression models.
problem Finding theoretical guarantees for statistical optimality and algorithmic convergence in non-conjugate models.
method Exploiting convex duality and minorizing the marginal likelihood, the paper derives non-asymptotic upper bounds and convergence guarantees for a tangent transform algorithm in logistic regression models.
result The tangent transform algorithm is shown to be locally asymptotically stable without assumptions on the data-generating process.
Paper extends multi-task Gaussian Cox processes for heterogeneous tasks.
problem Modeling multiple heterogeneous correlated tasks jointly.
method Data augmentation and mean-field approximation for non-conjugate Bayesian inference.
result Demonstrates improved performance and inference on synthetic and real data.
Efficient Bayesian variable selection for binomial and negative binomial data.
problem Computational challenges in Bayesian variable selection for complex models.
method Tempered Gibbs Sampling and MCMC scheme.
result Demonstrated effectiveness on cancer data with thousands of covariates.
New methods accelerate NCGP inference by trading computation for uncertainty.
problem Prohibitively expensive exact inference in NCGPs for large datasets.
method Iterative methods explicitly modeling approximation error, leveraging parallel computing.
result Significant acceleration of posterior inference compared to baselines.
We prove that under fairly general conditions an iterated exchange move gives infinitely many non-conjugate braids. As a consequence, every knot has infinitely many conjugacy classes of n-braid representations if and only if it has one admitting an exchange move.
Bayesian method tackles variable selection in high-dimensional data.
problem Challenges in Bayesian variable selection with large P.
method Efficient MCMC scheme with sublinear cost per iteration, extended to generalized linear models.
result Demonstrated effectiveness on cancer and maize genomic data.
Unified approach to Bayesian inference with guarantees on covariance matrices.
problem Approximate Bayesian inference with PSD guarantees.
method Bayes-Newton methods extending Newton's method for optimisation.
result Novel algorithms with PSD covariance matrices.
Study on Metropolis-within-Gibbs schemes for high-dimensional Bayesian models.
problem Improving the scalability of MCMC methods for complex Bayesian models.
method Relating convergence properties to conditional conductance for non-conjugate hierarchical models.
result Established dimension-free convergence results for Metropolis-within-Gibbs schemes.
Graph Gaussian processes use Matérn models for better function learning.
problem Lack of Gaussian process models for graph input spaces.
method Stochastic partial differential equation characterization of Matérn Gaussian processes.
result Graph Matérn Gaussian processes inherit properties of Euclidean and Riemannian models and can be trained efficiently.
Improves hyperparameter learning in GP models with non-conjugate likelihoods.
problem Hyperparameter learning entangled with approximate inference in GP models.
method Hybrid training procedure combining VI for inference and EP-like marginal likelihood approximation for hyperparameter learning.
result Empirically demonstrates the effectiveness of the proposed training procedure across various data sets.
We show that any two non-conjugate points on a forward or backward complete connected Finsler manifold can be joined by infinitely many geodesics which are not covered by finitely many closed ones, provided that the Betti numbers of the based loop space grow unbounded.
A conjugate Bayesian method detects change points in Hawkes processes efficiently.
problem Non-conjugacy between Hawkes process likelihood and prior causes inefficiency in change point detection.
method Data augmentation to propose a conjugate Bayesian two-step change point detection method.
result The conjugate method is more accurate and efficient than non-conjugate methods.
We prove the Morse relations for the set of all geodesics connecting two non-conjugate points on a class of globally hyperbolic Lorentzian manifolds. We overcome the difficulties coming from the fact that the Morse index of every geodesic is infinite, and from the lack of the Palais-Smale condition, by using the Morse …
Variational inference simplifies Bayesian model approximations.
problem Approximating complex Bayesian posterior distributions.
method Solving optimization problems to approximate posterior distributions with simpler variational distributions.
result Variational inference has been successfully applied in various models and large-scale applications.
This paper proposes a method to approximate non-Gaussian likelihoods in Gaussian Processes.
problem Approximating non-Gaussian likelihoods in Gaussian Processes.
method Proposes a piece-wise constant approximation for the inverse-link function.
result Yields a closed form solution for the SVGP lower bound.
SING improves state inference in latent SDE models for better drift function estimation.
problem Intractable posterior inference in latent SDE models.
method Natural gradient variational inference.
result SING provides faster and more reliable inference in latent SDE models.
This is an addendum to arXiv: 0810.5376. We show, using our methods and an auxiliary result of Bestvina-Bromberg-Fujiwara, that a finitely generated group with infinitely many pairwise non-conjugate homomorphisms to a mapping class group virtually acts non-trivially on an R-tree, and, if it is finitely presented, it…
cvHM framework speeds up GP inference for neural spike train analysis.
problem Scalability issue in approximate inference for latent GP models.
method cvHM framework using Hida-Matérn kernels and conjugate computation variational inference (CVI).
result Linear time inference for latent neural trajectories.
Ensemble++ uses shared-factor ensembles to scale Thompson Sampling for linear and nonlinear bandits.
problem Computational challenges in Thompson Sampling for large-scale or non-conjugate settings.
method Ensemble++ with shared-factor architecture and random linear combinations.
result Ensemble++ achieves comparable regret to exact Thompson Sampling with significantly smaller ensemble sizes.
The Hodge series of a finite matrix group is the generating function for invariant exterior forms of specified order and degree. Lauret, Miatello, and Rossetti gave examples of pairs of non-conjugate cyclic groups having the same Hodge series; the corresponding space forms are isospectral for the Laplacian on p-forms f…
New subgroups of mapping class groups constructed for infinite-type surfaces.
problem Constructing new subgroups of mapping class groups for infinite-type surfaces.
method Utilization of special homeomorphisms called shift maps and multipush maps.
result Countably (and uncountably in certain cases) many non-conjugate embeddings of subgroups into mapping class groups.
Uncountably many fibrations found on genus 2 handlebody.
problem Finding fibrations on specific 3-manifolds.
method Constructing fibrations with Cantor tree fibers.
result Uncountably many fibrations with non-conjugate monodromies.
We obtain a result about the existence of only a finite number of geodesics between two fixed non-conjugate points in a Finsler manifold endowed with a convex function. We apply it to Randers and Zermelo metrics. As a by-product, we also get a result about the finiteness of the number of lightlike and timelike geodesic…
We use some Lie group theory and Budney's unitarization of the Lawrence-Krammer representation, to prove that for generic parameters of definite form the image of the representation (also on certain types of subgroups) is dense in the unitary group. This implies that, except possibly for closures of full-twist braids, …
It has been known since the time of Nielsen that the mapping class group Modg,1 of a surface of genus g and one puncture acts faithfully by homeomorphisms on the circle. In this note, we show that this standard representation of the mapping class group is not rigid, precisely, if G<Modg,1 is a…
New representations of 3-manifold groups into complex hyperbolic space found.
problem Finding representations of 3-manifold groups into complex hyperbolic spaces.
method Using Lefschetz fibrations and orbifold fundamental groups of branched coverings of the projective plane.
result Infinitely many non-conjugate representations discovered.
The paper analyzes symmetries of Vaidya-Bonner geodesics.
problem Investigating invariance properties of Vaidya-Bonner geodesics.
method Classification of Lie point symmetries and Noether symmetries, determination of optimal system of subalgebras.
result Determination of optimal system of subalgebras for Vaidya-Bonner geodesics.
Efficiently infers cluster assignments in probabilistic models.
problem Efficiently inferring cluster assignments in probabilistic models.
method Amortized approximate Bayesian inference mapping cluster representations into conditional probabilities.
result Parallelizable, yields iid samples with similar computational cost to Gibbs sampling.
We prove a generalized version of the Morse index theorem for geodesics endowed with a non positive definite metric tensor (semi-Riemannian manifolds). We apply the result to obtain lower estimates on the number of geodesics joining two fixed non conjugate points in certain classes of manifolds. More specifically, we c…
The paper disproves a conjecture about isomorphic subgroups in finite groups.
problem The existence of non-isomorphic subgroups that are isomorphic in extensions of finite groups.
method Constructing extensions of finite groups to show non-isomorphic pre-images of subgroups.
result Subgroups of finite groups that are isomorphic in extensions are not conjugate.
In this note, we give an explicit counterexample to the simple loop conjecture for representations of surface groups into PSL(2,R). Specifically, we show that for any surface with negative Euler characteristic and genus at least 1, there are uncountably many non-conjugate, non-injective homomorphisms of its fundamental…
Improves SVGP methods for faster and more accurate Gaussian process inference.
problem Efficient non-conjugate Gaussian process inference.
method Dual parameterization of SVGP methods using site parameters.
result Faster and more accurate inference with tighter evidence lower bound.
We describe a simple fundamental domain for the holonomy group of the boundary unipotent spherical CR uniformization of the figure eight knot complement, and deduce that small deformations of that holonomy group (such that the boundary holonomy remains parabolic) also give a uniformization of the figure eight knot comp…