New method clusters multimodal data with consistency.
problem Multimodal clustering with unaligned data.
method Conjugate mixture models and EM algorithm.
result Consistent multimodal clustering achieved.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “conjugate mixture models”
Proposes a non-conjugate model selection method for chain event graphs.
problem Existing model selection algorithms for chain event graphs rely on conjugate priors, which is unrealistic for many real-world applications.
method Proposes a mixture modelling approach to model selection in chain event graphs that does not rely on conjugacy.
result The proposed method is more scalable and robust than existing algorithms.
We develop methods for efficient amortized approximate Bayesian inference over posterior distributions of probabilistic clustering models, such as Dirichlet process mixture models. The approach is based on mapping distributed, symmetry-invariant representations of cluster arrangements into conditional probabilities. Th…
The speed of convergence of the Expectation Maximization (EM) algorithm for Gaussian mixture model fitting is known to be dependent on the amount of overlap among the mixture components. In this paper, we study the impact of mixing coefficients on the convergence of EM. We show that when the mixture components exhibit …
This paper introduces constrained mixtures for continuous distributions, characterized by a mixture of distributions where each distribution has a shape similar to the base distribution and disjoint domains. This new concept is used to create generalized asymmetric versions of the Laplace and normal distributions, whic…
New method selects FMM components via variational Bayes.
problem Selecting the correct number of components in finite mixture models.
method Variational Bayes with mean-field approximation.
result Consistency of model selection based on ELBO maximization.
DEQs and explicit networks are nearly equivalent for Gaussian mixtures.
problem Understanding the equivalence between DEQs and explicit neural networks.
method Random matrix theory and analysis of kernel matrices.
result A shallow explicit network can mimic the kernel of a DEQ.
LDF combines neural networks with probabilistic models for data fusion.
problem Combining limited primary data with readily available auxiliary data.
method Neural networks as conjugate mappings of auxiliary data for posterior analysis.
result Efficient inference and compact latent variable posterior distributions.
Improved SVI with adjustable annealing for better optimization.
problem Improving optimization in stochastic variational inference.
method Tuneable stochastic annealing in SVI with adjustable batch size.
result Approximation to maximum entropy stochastic gradient at desired variance level.
Bayesian model uses simple functions to forecast macroeconomic data.
problem Forecasting large datasets in macroeconomics with complex nonlinear relationships.
method Sum of simple two-component location mixtures, logistic function threshold, conjugate priors.
result Accurate point and density forecasts in US macroeconomic aggregates.
We develop a sequential low-complexity inference procedure for Dirichlet process mixtures of Gaussians for online clustering and parameter estimation when the number of clusters are unknown a-priori. We present an easily computable, closed form parametric expression for the conditional likelihood, in which hyperparamet…
FABLE incorporates instance features into PWS label models for improved performance.
problem Lack of instance features in existing label models limits their performance.
method FABLE uses a mixture of Bayesian label models and a Gaussian Process classifier to incorporate instance features.
result FABLE achieves the highest averaged performance across nine baselines on benchmark datasets.
Flexible mean field variational inference using mixtures of non-overlapping exponential familiesmath.ST
Improves variational inference for sparse models using mixtures of exponential families.
problem Intractability of posterior distributions in Bayesian sparse models.
method Flexible mean field variational inference using mixtures of non-overlapping exponential families.
result Mixtures of exponential families with non-overlapping support form an exponential family, enabling analytical updates.
New method speeds up inference for non-conjugate Gaussian processes.
problem Inference for non-conjugate Gaussian processes is slow and unreliable.
method Automated augmented conjugate inference method that constructs auxiliary variables to make the model conditionally conjugate.
result Our method is up to two orders of magnitude faster and more robust than existing methods.
Exploratory cancer drug studies test multiple tumor cell lines against multiple candidate drugs. The goal in each paired (cell line, drug) experiment is to map out the dose-response curve of the cell line as the dose level of the drug increases. We propose Bayesian Tensor Filtering (BTF), a hierarchical Bayesian model …
We use the theory of normal variance-mean mixtures to derive a data augmentation scheme for models that include gamma functions. Our methodology applies to many situations in statistics and machine learning, including Multinomial-Dirichlet distributions, Negative binomial regression, Poisson-Gamma hierarchical models, …
The paper tackles efficient computation of optimal transport by approximating conjugates with amortized optimization.
problem Efficient computation of convex conjugates in optimal transport is challenging and limits the quality of transport maps.
method The approach combines amortized approximations of conjugates with a fine-tuning solver to improve transport map quality.
result The method significantly improves the quality of transport maps for the Wasserstein-2 benchmark and models many 2D couplings and flows.
Develops Bayesian inference methods for gamma models.
problem Challenges in inference for models with gamma functions.
method Data augmentation scheme using Exponential Reciprocal Gamma distributions.
result Scalable EM and MCMC algorithms developed.
Conjugate Projective Limitsmath.ST
We characterize conjugate nonparametric Bayesian models as projective limits of conjugate, finite-dimensional Bayesian models. In particular, we identify a large class of nonparametric models representable as infinite-dimensional analogues of exponential family distributions and their canonical conjugate priors. This c…
Method proposed for pricing insurance products covering both foreseeable and unforeseeable risks.
problem Pricing insurance products that include unforeseeable risks.
method Mixed Poisson process with Bayesian setup and linear exponential family distributions.
result Bayesian premiums are more reactive to claim trends than traditional ones.
This paper addresses the mapping problem. Using a conjugate prior form, we derive the exact theoretical batch multi-object posterior density of the map given a set of measurements. The landmarks in the map are modeled as extended objects, and the measurements are described as a Poisson process, conditioned on the map. …
Making inferences from data streams is a pervasive problem in many modern data analysis applications. But it requires to address the problem of continuous model updating and adapt to changes or drifts in the underlying data generating distribution. In this paper, we approach these problems from a Bayesian perspective c…
Asymptotically Hyperbolic Manifolds with Boundary Conjugate Points but no Interior Conjugate Pointsmath.DG
We construct non-trapping asymptotically hyperbolic manifolds with boundary conjugate points but no interior conjugate points.
A condition for a statistical manifold to have an equiaffine structure is studied. The facts that dual flatness and conjugate symmetry of a statistical manifold are sufficient conditions for a statistical manifold to have an equiaffine structure were obtained in [2] and [3]. In this paper, a fact that a statistical man…
Estimates geodesics on surfaces without conjugate points.
problem Counting geodesics on surfaces without conjugate points.
method Margulis-type asymptotic estimates.
result Asymptotic estimates for geodesics on surfaces.
Natural Gradients in Practice: Non-Conjugate Variational Inference in Gaussian Process Modelsstat.ML
The natural gradient method has been used effectively in conjugate Gaussian process models, but the non-conjugate case has been largely unexplored. We examine how natural gradients can be used in non-conjugate stochastic settings, together with hyperparameter learning. We conclude that the natural gradient can signific…
Extends likelihood ratio exponential families to analyze various optimization methods.
problem Analyzing optimization methods like rate-distortion and information bottleneck.
method Linking geometric mixture paths to exponential families and using hypothesis testing.
result Provides a common mathematical framework for understanding these methods.
Study finds conjugate points in geodesics of Kolmogorov flows on torus.
problem Characterizing pairs of integers (m,n) for which geodesics have conjugate points.
method Analysis of geodesics in the group of volume-preserving diffeomorphisms of a torus using stream functions.
result Existence of conjugate points for all pairs of strictly positive integers (m,n).
We introduce a multiple conjugation biquandle, and show that it is the universal algebra to define a semi-arc coloring invariant for handlebody-links. A multiple conjugation biquandle is a generalization of a multiple conjugation quandle. We extend the notion of -parallel biquandle operations for any integer , an…
The paper studies Jacobi fields and conjugate points in projective sprays.
problem Investigating Jacobi fields and conjugate points in projective sprays.
method Proved that conjugate points are preserved under projective changes and established conditions for the existence of conjugate points.
result Conditions for the existence of conjugate points in projectively deformed sprays.
Paper describes how to extend multiple conjugation quandles using maps.
problem Understanding affine extensions of multiple conjugation quandles.
method Introduces augmented MCQ Alexander pairs for affine extensions.
result Affine extensions of multiple conjugation quandles can be described by quadruples of maps.
Enhances robustness of MOGP regression for multiple correlated outputs.
problem Model misspecification and outliers in MOGP regression.
method Extends RCGP framework to multi-output setting.
result Provable robust MOGP with joint correlation capture.
Improved Gaussian process regression with tighter log marginal likelihood bounds.
problem Improving predictive performance in Gaussian process regression models.
method Lower bound on log marginal likelihood using conjugate gradients.
result Improved predictive performance compared to other conjugate gradient based approaches.
For a surface group, a new bound is given for conjugator length function.
problem Finding an explicit bound for the conjugator length function of a surface group.
method Detailed analysis of conjugation reductions.
result An explicit bound for the conjugator length function of a surface group.
The study examines Hopfian properties of conjugation quandles and their underlying groups.
problem Understanding the relationship between Hopfian properties of conjugation quandles and their underlying groups.
method Examined Hopfian and residual finiteness properties of conjugation quandles of specific groups.
result Conjugation quandles of Baumslag-Solitar groups are infinitely generated and not necessarily Hopfian.
Upper bound for conjugate radius in open manifolds with scalar curvature and spectrum constraints.
problem Bounding the conjugate radius of open manifolds with specific curvature and spectrum conditions.
method Established an upper bound using scalar curvature and bottom-of-spectrum constraints.
result For certain conditions, the conjugate radius is no more than π.
We present a general method for deriving collapsed variational inference algo- rithms for probabilistic models in the conjugate exponential family. Our method unifies many existing approaches to collapsed variational inference. Our collapsed variational inference leads to a new lower bound on the marginal likelihood. W…
The questions when two Morse function on closed manifolds are conjugated is investigated. Using the handle decompositions of manifolds the condition of conjugation is formulated. For each Morse function on 3-manifold the ordered generalized Heegaard diagram is built. The criteria of Morse function conjugation are given…
Enhances mixture models with classifier-defined weights.
problem Density evaluation and sampling in mixture models.
method Introduces Classifier Weighted Mixtures (CWM) with functional weights.
result Improves expressivity in variational estimation without increasing complexity.
Study conjugate locus in convex 3-manifolds using Jacobi fields.
problem Understanding conjugate points in convex 3-manifolds.
method Use Jacobi fields to define coordinate systems and classify singularities.
result Developed a novel method for determining conjugate points in 3D manifolds.
Paper finds new criteria for conjugate points in fluid flows.
problem Finding conjugate points in steady 2D Euler flows.
method Develops a new sufficient criterion for conjugate points, applies to any rotational cell, and uses a general construction of steady fluid surfaces.
result Improves on existing criteria and captures all known conjugate points in rotational cells.
Develops multi-modal neural network models for improved prediction and uncertainty quantification.
problem Improving prediction accuracy and uncertainty quantification for multi-modal data.
method Multi-modal Bayesian neural network models with conjugate last-layer estimation using SVI.
result Improved prediction accuracy and uncertainty quantification compared to uni-modal models.
Study analyzes Lévy process structure on manifolds with conjugate points.
problem Microlocal analysis of Lévy processes on manifolds with conjugate points.
method Microlocal analysis, pseudodifferential operators, Fourier integral operators.
result Generator can be expressed as sum of pseudodifferential and Fourier integral operators.
We study the geodesic X-ray transform on compact Riemannian surfaces with conjugate points. Regardless of the type of the conjugate points, we show that we cannot recover the singularities and therefore, this transform is always unstable (ill-posed). We describe the microlocal kernel of and relate it to the con…
Optimal mixtures of generative models outperform individual models on image datasets.
problem Selecting the best single model from a group of trained generative models.
method Formulated a quadratic optimization problem and proposed the Mixture-UCB algorithm for efficient selection.
result Mixture of generative models achieves better evaluation scores than individual models on benchmark datasets.
In this paper, we establish upper bounds on the length of the shortest conjugator between pairs of infinite order elements in a wide class of groups. We obtain a general result which applies to all hierarchically hyperbolic groups, a class which includes mapping class groups, right-angled Artin groups, Burger--Mozes-ty…
Identifies conjugate points in spherical harmonics solutions of quasi-geostrophic equations.
problem Locating conjugate points in spherical harmonics solutions.
method Utilizing structure constants and quasi-geostrophic equations on the sphere, identifying conjugate points.
result Existence and location of conjugate points along spherical harmonics solutions.
New bounds on sample size for identifying mixture models with grouped samples.
problem Identifying mixture models with minimal sample size.
method Generalized identifiability bounds for mixture models with grouped samples.
result Identifiability with samples per group, with no improvement possible.