A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Proposes Dirichlet Simplex Nest for probabilistic modeling of various data types.
New distribution on simplex for auto-encoding tasks.
Novel simplex-valued distribution improves on existing models.
We develop a nested hierarchical Dirichlet process (nHDP) for hierarchical topic modeling. The nHDP is a generalization of the nested Chinese restaurant process (nCRP) that allows each word to follow its own path to a topic node according to a document-specific distribution on a shared tree. This alleviates the rigid, …
Dirichlet Process(DP) is a Bayesian non-parametric prior for infinite mixture modeling, where the number of mixture components grows with the number of data items. The Hierarchical Dirichlet Process (HDP), is an extension of DP for grouped data, often used for non-parametric topic modeling, where each group is a mixtur…
We develop a nested hierarchical Dirichlet process (nHDP) for hierarchical topic modeling. The nHDP is a generalization of the nested Chinese restaurant process (nCRP) that allows each word to follow its own path to a topic node according to a document-specific distribution on a shared tree. This alleviates the rigid, …
We present a Bayesian nonparametric framework for multilevel clustering which utilizes group-level context information to simultaneously discover low-dimensional structures of the group contents and partitions groups into clusters. Using the Dirichlet process as the building block, our model constructs a product base-m…
It is challenging to develop stochastic gradient based scalable inference for deep discrete latent variable models (LVMs), due to the difficulties in not only computing the gradients, but also adapting the step sizes to different latent factors and hidden layers. For the Poisson gamma belief network (PGBN), a recently …
Model clusters networks and their communities simultaneously.
Stochastic gradient Markov chain Monte Carlo (SGMCMC) has become a popular method for scalable Bayesian inference. These methods are based on sampling a discrete-time approximation to a continuous time process, such as the Langevin diffusion. When applied to distributions defined on a constrained space the time-discret…
The Dirichlet mechanism protects privacy while minimizing KL divergence.
Recent advances in topic models have explored complicated structured distributions to represent topic correlation. For example, the pachinko allocation model (PAM) captures arbitrary, nested, and possibly sparse correlations between topics using a directed acyclic graph (DAG). While PAM provides more flexibility and gr…
The paper improves interpolation in generative models by using specific base distributions.
The latent Dirichlet allocation (LDA) model is a widely-used latent variable model in machine learning for text analysis. Inference for this model typically involves a single-site collapsed Gibbs sampling step for latent variables associated with observations. The efficiency of the sampling is critical to the success o…
Tree structures are ubiquitous in data across many domains, and many datasets are naturally modelled by unobserved tree structures. In this paper, first we review the theory of random fragmentation processes [Bertoin, 2006], and a number of existing methods for modelling trees, including the popular nested Chinese rest…
Datasets containing large samples of time-to-event data arising from several small heterogeneous groups are commonly encountered in statistics. This presents problems as they cannot be pooled directly due to their heterogeneity or analyzed individually because of their small sample size. Bayesian nonparametric modellin…
Paper calculates the exact error of LDA models.
Driven by the multi-level structure of human intracranial electroencephalogram (iEEG) recordings of epileptic seizures, we introduce a new variant of a hierarchical Dirichlet Process---the multi-level clustering hierarchical Dirichlet Process (MLC-HDP)---that simultaneously clusters datasets on multiple levels. Our sei…
We propose a new topic modeling procedure that takes advantage of the fact that the Latent Dirichlet Allocation (LDA) log likelihood function is asymptotically equivalent to the logarithm of the volume of the topic simplex. This allows topic modeling to be reformulated as finding the probability simplex that minimizes …
Researchers study the normalizing constant of a continuous categorical distribution.
New models for analyzing microbiome data with interactions.
We propose a family of multivariate Gaussian process models for correlated outputs, based on assuming that the likelihood function takes the generic form of the multivariate exponential family distribution (EFD). We denote this model as a multivariate generalized Gaussian process model, and derive Taylor and Laplace al…
New method attaches uncertainty to deep neural network predictions.
A tree-based dictionary learning model is developed for joint analysis of imagery and associated text. The dictionary learning may be applied directly to the imagery from patches, or to general feature vectors extracted from patches or superpixels (using any existing method for image feature extraction). Each image is …
New models predict future events with uncertainty.
Bayesian ARMA model with directional shifts captures structural breaks in compositional time series.
A new embedding method for high-dimensional data.
The paper triangulates Heisenberg groups with horizontal and straight simplexes.
New methods for predicting compositional data using conformal prediction.
Study classifies submanifolds in probability simplex.
Study of zonal spherical functions on partial flag manifolds using Jacobi polynomials.
Study optimal transport on simplex boundary, proving transport map and potential regularity.
Paper analyzes Bezier simplex fitting risks and optimal sampling.
A new method uses a product of experts with Dirichlet variables to approximate complex distributions.
We compute the expected value of the Kullback-Leibler divergence to various fundamental statistical models with respect to canonical priors on the probability simplex. We obtain closed formulas for the expected model approximation errors, depending on the dimension of the models and the cardinalities of their sample sp…
We consider the problem of analyzing the heterogeneity of clustering distributions for multiple groups of observed data, each of which is indexed by a covariate value, and inferring global clusters arising from observations aggregated over the covariate domain. We propose a novel Bayesian nonparametric method reposing …
Latent Dirichlet allocation (LDA) is useful in document analysis, image processing, and many information systems; however, its generalization performance has been left unknown because it is a singular learning machine to which regular statistical theory can not be applied. Stochastic matrix factorization (SMF) is a res…
PRISM identifies simplex vertices from noisy data.
A new optimization method for probability simplex problems.
We establish the second part of Milnor's conjecture on the volume of simplexes in hyperbolic and spherical spaces. A characterization of the closure of the space of the angle Gram matrices of simplexes is also obtained.
Study cobordisms of nested manifolds and their invariants.
A hyperbolic 3-simplex reflection group is a Coxeter group arising as a lattice in the isometry group of hyperbolic 3-space, with fundamental domain a geodesic simplex (possibly with some ideal vertices). The classification of these groups is known, and there are exactly 9 cocompact examples, and 23 non-cocompact examp…
We introduce the non-pure versions of simplicial balls and spheres with minimum number of vertices. These are a special type of non-homogeneous balls and spheres (NH-balls and NH-spheres) satisfying a minimality condition on the number of maximal simplices. The main result is that minimal NH-balls and NH-spheres are pr…
In 1973, J. Cheeger and J. Simons raised the following question that still remains open and is known as the Rational Simplex Problem: Given a geodesic simplex in the spherical 3-space so that all of its interior dihedral angles are rational multiples of , is it true that its volume is a rational multiple of the volu…
Paper calculates Gromov-Hausdorff distance between simplexes and 2-distance spaces.
A method for diffusion on probability simplex for generative models.
Quantum algorithm speeds up nested expectation estimation by nearly quadratically.
This paper focuses on the problem of hierarchical non-overlapping clustering of a dataset. In such a clustering, each data item is associated with exactly one leaf node and each internal node is associated with all the data items stored in the sub-tree beneath it, so that each level of the hierarchy corresponds to a pa…