Efficient nonparametric Bayesian topic model for social media text.
problem Text analytics for social media data.
method Hierarchical Pitman-Yor processes for topic modeling.
result Nonparametric model outperforms existing parametric models.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,291 papers · 148 categories
Trend · papers per month
48 results for “Bayesian nonparametric topic models”
CATVI improves variational inference for Bayesian nonparametric models by reducing divergence and improving prediction accuracy.
problem Limitations of current variational inference methods in characterizing latent correlations and inferring true posterior dimensions.
method CATVI integrates conditional and adaptive truncation into variational inference, maximizing nonparametric evidence lower bound and using Monte Carlo integration.
result CATVI outperforms traditional methods in Bayesian nonparametric topic models, reducing perplexity and improving topic-word clustering.
The study assesses sensitivity to prior choices in Bayesian nonparametric models.
problem Difficulty in specifying priors for Bayesian nonparametric models.
method Utilizes variational Bayesian methods to assess sensitivity to concentration parameter and stick-breaking distribution.
result Demonstrates how to evaluate sensitivity to prior choices in Dirichlet process mixtures and related models.
Using nonparametric methods has been increasingly explored in Bayesian hierarchical modeling as a way to increase model flexibility. Although the field shows a lot of promise, inference in many models, including Hierachical Dirichlet Processes (HDP), remain prohibitively slow. One promising path forward is to exploit t…
Bayesian nonparametric model learns new categories without predefined limits.
problem Learning new categories unseen in labeled training data.
method Hierarchical Dirichlet process and latent Dirichlet allocation for automatic category inference.
result Nonparametric approach yields comparable performance to parametric methods with pre-specified new categories.
The nested Chinese restaurant process and Bayesian nonparametric inference of topic hierarchiesstat.ML
We present the nested Chinese restaurant process (nCRP), a stochastic process which assigns probability distributions to infinitely-deep, infinitely-branching trees. We show how this stochastic process can be used as a prior distribution in a Bayesian nonparametric model of document collections. Specifically, we presen…
Survey of Bayesian nonparametric space partition models and their applications.
problem Partitioning high-dimensional spaces into homogeneous regions.
method Various strategies for generating partitions in a D-dimensional space.
result Review of current progress in BNSP research.
Recent advances in topic models have explored complicated structured distributions to represent topic correlation. For example, the pachinko allocation model (PAM) captures arbitrary, nested, and possibly sparse correlations between topics using a directed acyclic graph (DAG). While PAM provides more flexibility and gr…
New models discover new topics over time in topic modeling.
problem Discovering new topics over time in topic modeling.
method Nonparametric Bayesian models and Hungarian matching algorithm.
result Significantly faster than existing methods, discovering new topics in large datasets.
Novel hybrid model combines image feature discovery and topic modeling for marine robot mission data.
problem Insufficient analysis of robot mission data due to data complexity and lack of suitable models.
method Convolutional autoencoders for feature discovery in images and Bayesian nonparametric topic models for thematic structure.
result Hybrid model outperforms state-of-the-art approaches in unsupervised seafloor terrain characterization.
Aggregates models from different datasets using shared latent structures.
problem Aggregating models from heterogeneous datasets with shared latent structures.
method Bayesian nonparametrics for identifying correspondences among local model parameterizations.
result Framework successfully aggregates various model types across different applications.
Modeling true and false news diffusion in social networks using homogeneity.
problem Difficulties in distinguishing true from false news in social networks.
method Proposes a Bayesian nonparametric model that incorporates homogeneity of news stories to predict their genuineness.
result Homogeneity values of news stories strongly correlate with their genuineness and content.
A novel dynamic Bayesian nonparametric topic model for anomaly detection in video is proposed in this paper. Batch and online Gibbs samplers are developed for inference. The paper introduces a new abnormality measure for decision making. The proposed method is evaluated on both synthetic and real data. The comparison w…
A new model for time-dependent data with dependencies over time.
problem Modeling data with time-dependent features and dependencies.
method Introducing a new probabilistic model based on Poisson random fields and Indian buffet processes.
result Developed a nonparametric focused topic model for time-stamped text documents.
We develop stochastic variational inference, a scalable algorithm for approximating posterior distributions. We develop this technique for a large class of probabilistic models and we demonstrate it with two probabilistic topic models, latent Dirichlet allocation and the hierarchical Dirichlet process topic model. Usin…
The question of how to determine the number of independent latent factors (topics) in mixture models such as Latent Dirichlet Allocation (LDA) is of great practical importance. In most applications, the exact number of topics is unknown, and depends on the application and the size of the data set. Bayesian nonparametri…
Scalable algorithm for extracting topic hierarchies from large text corpora.
problem Efficient inference for hierarchical topic models on large datasets.
method Partially collapsed Gibbs sampling (PCGS) algorithm combined with efficient distributed implementation.
result 111 times more efficient than previous implementation for hLDA.
Kernel Bayesian inference is a principled approach to nonparametric inference in probabilistic graphical models, where probabilistic relationships between variables are learned from data in a nonparametric manner. Various algorithms of kernel Bayesian inference have been developed by combining kernelized basic probabil…
Community detection has been an active research area for decades. Among all probabilistic models, Stochastic Block Model has been the most popular one. This paper introduces a novel probabilistic model: RW-HDP, based on random walks and Hierarchical Dirichlet Process, for community extraction. In RW-HDP, random walks c…
Proposes CHDP for modeling cooperative hierarchical structures with Dirichlet processes.
problem Lack of flexible topic modeling for cooperative hierarchical structures.
method Introduces Cooperative Hierarchical Dirichlet Processes (CHDP) with superposition and maximization measures.
result Demonstrates improved modeling of cooperative hierarchical structures with CHDP.
New algorithms for topic modeling using conic geometry.
problem Unknown number of topics in nonparametric topic modeling.
method Analysis of topic simplex's concentration and angular geometry.
result Accuracy comparable to Gibbs sampler, fast compared to state-of-the-art techniques.
We present the discrete infinite logistic normal distribution (DILN), a Bayesian nonparametric prior for mixed membership models. DILN is a generalization of the hierarchical Dirichlet process (HDP) that models correlation structure between the weights of the atoms at the group level. We derive a representation of DILN…
Model simplifies economic structure analysis of countries.
problem Understanding sparse and complex economic structures of countries.
method Sparse Three-parameter Restricted Indian Buffet Process for non-negative doubly sparse matrix factorization.
result Better capture of underlying sparsity structure of economic data.
Bayesian nonparametrics adapt model complexity to diverse datasets.
problem Complex challenges across statistics, computer science, and engineering.
method Flexible Bayesian nonparametric models that adapt model complexity.
result Bayesian nonparametrics offer innovative solutions to multi-object tracking.
This paper proposes a nonparametric Bayesian method for exploratory data analysis and feature construction in continuous time series. Our method focuses on understanding shared features in a set of time series that exhibit significant individual variability. Our method builds on the framework of latent Diricihlet alloc…
Estimates nonparametric densities from mixed samples.
problem Unmixing convex combinations of nonparametric densities from observed groups.
method Proposes an estimator using topic modeling and U-statistics.
result Rate-optimal estimator for nonparametric density estimation.
Improved bibliographic model for author, topic, and document clustering.
problem Modeling research publications using authors, categorical labels, and citation networks.
method Citation Network Topic Model (CNTM) combining Poisson mixed-topic and author-topic models with a novel inference algorithm.
result Improved performance in model fitting and document clustering compared to baselines.
A Bayesian Nonparametric Perspective on Mahalanobis Distance for Out of Distribution Detectionstat.ML
Bayesian nonparametric models improve OOD detection, especially with complex covariance structures.
problem Improving out-of-distribution detection methods, especially in complex scenarios.
method Proposes Bayesian nonparametric mixture models with hierarchical priors that generalize the Mahalanobis distance score.
result Bayesian nonparametric methods outperform existing OOD methods, especially in complex scenarios.
Bayesian method models dynamic text networks and topics.
problem Discovering community structure and topics in evolving text networks.
method Bayesian approach combining network and topic modeling.
result Complex community structure identified, dependent on blogger interests.
Bayesian neural networks with nonparametric noise models for system identification.
problem Estimating parameters and noise processes in stochastic dynamic systems.
method Bayesian nonparametric approach using neural networks and Gibbs sampler.
result The method converges to full nonparametric Bayesian regression model.
Traditional Relational Topic Models provide a way to discover the hidden topics from a document network. Many theoretical and practical tasks, such as dimensional reduction, document clustering, link prediction, benefit from this revealed knowledge. However, existing relational topic models are based on an assumption t…
Enhances topic-metadata relationship modeling using Bayesian methods.
problem Estimating relationships between latent topics and metadata in topic modeling.
method Proposes modifications to the method of composition, using Beta regression and a fully Bayesian approach.
result Improves quantification of uncertainty in topic-metadata relationships.
We describe a nonparametric topic model for labeled data. The model uses a mixture of random measures (MRM) as a base distribution of the Dirichlet process (DP) of the HDP framework, so we call it the DP-MRM. To model labeled data, we define a DP distributed random measure for each label, and the resulting model genera…
Bayesian nonparametric approach for scalable learning without assuming model truth.
problem Bayesian learning's assumption of model truth is problematic in complex data environments.
method Nonparametric Bayesian learning using Monte Carlo sampling.
result Proves better scalability and accuracy compared to parametric models.
Bayesian nonparametric modeling for predicting dynamic dependencies in multiple object trackingcs.LG
Bayesian methods improve tracking multiple objects through dynamic dependencies.
problem Tracking multiple objects with time-varying cardinality and unordered measurements.
method Employing Bayesian nonparametric models, specifically dependent Dirichlet and Pitman-Yor processes, for state estimation and Monte Carlo sampling for trajectory learning.
result The proposed methods outperform existing algorithms in estimating the time-varying number of objects and identifying object associations.
ICP models flexible DAG structures using Bayesian nonparametrics.
problem Learning the structure of complex neural networks.
method Bayesian nonparametric prior on DAGs and orders controlled by a latent Beta Process.
result ICP supports every possible DAG structure.
This paper reviews recent advances in Bayesian nonparametric techniques for constructing and performing inference in infinite hidden Markov models. We focus on variants of Bayesian nonparametric hidden Markov models that enhance a posteriori state-persistence in particular. This paper also introduces a new Bayesian non…
Unsupervised estimation of latent variable models is a fundamental problem central to numerous applications of machine learning and statistics. This work presents a principled approach for estimating broad classes of such models, including probabilistic topic models and latent linear Bayesian networks, using only secon…
Metalearned neural circuit performs inference over open classes.
problem Nonparametric Bayesian models' practical barriers in real-world applications.
method Extract inductive bias from nonparametric Bayesian model and transfer to neural network.
result Metalearned neural circuit achieves comparable or better performance than particle filter-based methods.
Modeling driver behavior using GPS data and HDP split-merge sampling.
problem Understanding individual driver behaviors and road network from GPS data.
method Hidden Markov Model (HMM) and Hierarchical Dirichlet Process (HDP) with split-merge sampling.
result Data-driven predictions about destinations and road conditions.
Inference in popular nonparametric Bayesian models typically relies on sampling or other approximations. This paper presents a general methodology for constructing novel tractable nonparametric Bayesian methods by applying the kernel trick to inference in a parametric Bayesian model. For example, Gaussian process regre…
Many data are naturally modeled by an unobserved hierarchical structure. In this paper we propose a flexible nonparametric prior over unknown data hierarchies. The approach uses nested stick-breaking processes to allow for trees of unbounded width and depth, where data can live at any node and are infinitely exchangeab…
We present a max-margin nonparametric latent feature model, which unites the ideas of max-margin learning and Bayesian nonparametrics to discover discriminative latent features for link prediction and automatically infer the unknown latent social dimension. By minimizing a hinge-loss using the linear expectation operat…
LLMs encode latent topic distributions, suggesting Bayesian inference.
problem Capturing topic structure from large language models.
method Connecting LLM optimization to implicit Bayesian inference and de Finetti's theorem.
result LLMs recover latent topic distributions, matching LDA-generated topics.
Link prediction is a fundamental task in statistical network analysis. Recent advances have been made on learning flexible nonparametric Bayesian latent feature models for link prediction. In this paper, we present a max-margin learning method for such nonparametric latent feature relational models. Our approach attemp…
Bayesian methods model diverse groups with censored data.
problem Pooling and analyzing small heterogeneous groups of time-to-event data.
method Three Bayesian nonparametric methods: Dirichlet process, hierarchical Dirichlet process, and nested Dirichlet process.
result Model accuracy comparison on simulated and real-world datasets.
New method tackles model uncertainty in stochastic control using Bayesian nonparametrics.
problem Model uncertainty in stochastic control problems.
method Nonparametric Bayesian approach with Dirichlet process for unknown distributions, online learning, and Gaussian process surrogates.
result Demonstrates financial advantages of nonparametric Bayesian over parametric methods.
Traditional topic models do not account for semantic regularities in language. Recent distributional representations of words exhibit semantic consistency over directional metrics such as cosine similarity. However, neither categorical nor Gaussian observational distributions used in existing topic models are appropria…