New model clusters online learning activity patterns.
problem Understanding and clustering online learning activity patterns.
method Hierarchical Dirichlet Hawkes process (HDHP) for continuous-time grouped streaming data.
result HDHP can recover meaningful learning patterns and track user interests over time.
Proposes a new model for clustering event sequences.
problem Clustering asynchronous event sequences with diverse triggering patterns.
method Dirichlet mixture model of Hawkes processes with variational Bayesian inference.
result Automatic learning of the number of clusters and robustness to misspecification.
Proposes CHDP for modeling cooperative hierarchical structures with Dirichlet processes.
problem Lack of flexible topic modeling for cooperative hierarchical structures.
method Introduces Cooperative Hierarchical Dirichlet Processes (CHDP) with superposition and maximization measures.
result Demonstrates improved modeling of cooperative hierarchical structures with CHDP.
Modeling multiple Hawkes processes with shared dynamics using graphons.
problem Modeling multiple multivariate point processes with shared dynamics.
method Leverage graphons to model an uncountable event type space, learn graphon-based Hawkes process model by minimizing hierarchical optimal transport distance.
result Infer underlying relations and simulate event sequences with similar dynamics.
We propose the supervised hierarchical Dirichlet process (sHDP), a nonparametric generative model for the joint distribution of a group of observations and a response variable directly associated with that whole group. We compare the sHDP with another leading method for regression on grouped data, the supervised latent…
Posterior regularization enhances Bayesian hierarchical mixture clustering by improving node separation.
problem High nodal variance in BHMC trees, leading to weak separation between nodes at higher levels.
method Employing Posterior Regularization to impose max-margin constraints on nodes at every level.
result Improves cluster separation in BHMC models, enhancing overall model performance.
Driven by the multi-level structure of human intracranial electroencephalogram (iEEG) recordings of epileptic seizures, we introduce a new variant of a hierarchical Dirichlet Process---the multi-level clustering hierarchical Dirichlet Process (MLC-HDP)---that simultaneously clusters datasets on multiple levels. Our sei…
Tree structures are ubiquitous in data across many domains, and many datasets are naturally modelled by unobserved tree structures. In this paper, first we review the theory of random fragmentation processes [Bertoin, 2006], and a number of existing methods for modelling trees, including the popular nested Chinese rest…
HIRM models noisy, sparse, heterogeneous relational data using hierarchical clustering and Dirichlet processes.
problem Modeling noisy, sparse, and heterogeneous relational data.
method Hierarchical Chinese restaurant process and Dirichlet process mixture for clustering and modeling relation values.
result HIRM generalizes standard models and discovers relational structure in real-world datasets.
Proposes an exact slice sampler for HDP and its mixture models.
problem Challenges in sampling from Hierarchical Dirichlet Process (HDP) models.
method Bayesian variable augmentation to address hierarchical nature of HDPs, resulting in a full factorization of the joint distribution suitable for slice sampling.
result Fast mixing and natural truncation of infinite measures without ad-hoc modifications.
Bayesian nonparametric method for hierarchical clustering.
problem Hierarchical non-overlapping clustering of a dataset.
method Combining nCRP and HDP for complex latent mixture features.
result Solid empirical results compared to existing algorithms.
This paper proposes a novel dynamic Hierarchical Dirichlet Process topic model that considers the dependence between successive observations. Conventional posterior inference algorithms for this kind of models require processing of the whole data through several passes. It is computationally intractable for massive or …
Paper proposes a new method for predicting DER adoption with hierarchical guarantees.
problem Accurately predicting DER adoption in electric grids with uncertainty and spatial disparity.
method Multivariate Hawkes process for modeling DER adoption dynamics and split conformal prediction algorithm for hierarchical validity.
result Empirical evaluation shows superior predictive accuracy and uncertainty calibration compared to existing methods.
Bayesian approach models earthquake clustering with spatial mainshocks and aftershocks.
problem Estimating uncertainty in earthquake clustering models due to complex likelihood functions.
method Nonparametric Dirichlet process mixture prior for spatial mainshocks and an auxiliary latent variable routine for efficient inference.
result Efficient Bayesian forecasting of spatial earthquake occurrences with uncertainty quantification.
HARMLESS meta-learning method models short event sequences with relational information.
problem Learning heterogeneous point process models from short event sequence data.
method Hierarchical Bayesian mixture Hawkes process model with stochastic variational meta expectation maximization.
result HARMLESS outperforms existing methods in predicting future events.
Spectral methods improve efficiency in nonparametric model inference.
problem Efficient inference for nonparametric models like IBP and HDP.
method Spectral methods for Indian Buffet Process and Hierarchical Dirichlet Process.
result Spectral methods provide computationally and statistically efficient inference.
Bayesian methods model diverse groups with censored data.
problem Pooling and analyzing small heterogeneous groups of time-to-event data.
method Three Bayesian nonparametric methods: Dirichlet process, hierarchical Dirichlet process, and nested Dirichlet process.
result Model accuracy comparison on simulated and real-world datasets.
We develop a nested hierarchical Dirichlet process (nHDP) for hierarchical topic modeling. The nHDP is a generalization of the nested Chinese restaurant process (nCRP) that allows each word to follow its own path to a topic node according to a document-specific distribution on a shared tree. This alleviates the rigid, …
A new model separates persistence and transition priors in HDP-HMM.
problem Limitation of sticky HDP-HMM in expressing different persistence strengths.
method Developed a disentangled sticky HDP-HMM (DS-HDP-HMM) with novel Gibbs sampling algorithms.
result DS-HDP-HMM outperforms sticky HDP-HMM and HDP-HMM on synthetic and real data.
The hierarchical Dirichlet process (HDP) has become an important Bayesian nonparametric model for grouped data, such as document collections. The HDP is used to construct a flexible mixed-membership model where the number of components is determined by the data. As for most Bayesian nonparametric models, exact posterio…
Unified framework for DRO and DTA using Bayesian nonparametrics.
problem Combining DRO and DTA under ambiguity.
method Unified framework using DP and HDPs, with outlier robustness.
result Favorable performance in prediction accuracy and stability.
Develops a more flexible HDP-HMM for temporal data segmentation.
problem Limited expressiveness of sticky HDP-HMM due to stationary self-persistence probability.
method Introduces recurrent sticky HDP-HMM with a novel Gibbs sampling strategy.
result RS-HDP-HMM outperforms other models in segmentation tasks.
Efficiently trains HDP topic models on large datasets using a sparse data-parallel sampler.
problem Scaling non-parametric topic models to large datasets.
method Data-parallel training with a doubly sparse sampler for HDP topic models.
result Trains HDP topic models on a 8m document, 768m token PubMed corpus in under 4 days.
Proposes a nonparametric tensor factorization for sparse data.
problem Handling sparse tensor data with structural and interpretability benefits.
method Hierarchical Gamma processes and Poisson random measures for tensor-valued process, Dirichlet processes for sampling entry indices, Gaussian processes for values.
result Demonstrates superior performance on benchmark datasets.
Discriminative classifier for compositional data using hierarchical mixture of Generalized Dirichlet models.
problem Classifying compositional data, especially in spam detection and color space identification.
method Hierarchical mixture of discriminative Generalized Dirichlet classifiers, using variational approximation for parameter learning.
result First time a variational upper-bound for Generalized Dirichlet mixture is proposed in literature.
Nonparametric mixture models based on the Dirichlet process are an elegant alternative to finite models when the number of underlying components is unknown, but inference in such models can be slow. Existing attempts to parallelize inference in such models have relied on introducing approximations, which can lead to in…
Enhances topic models to better handle polysemous words.
problem Lack of polysemy handling in Gaussian latent Dirichlet allocation.
method Introduces a hierarchical structure to capture polysemy in Gaussian latent Dirichlet allocation.
result Significantly improves polysemy detection and provides more parsimonious topic representations.
We develop a nested hierarchical Dirichlet process (nHDP) for hierarchical topic modeling. The nHDP is a generalization of the nested Chinese restaurant process (nCRP) that allows each word to follow its own path to a topic node according to a document-specific distribution on a shared tree. This alleviates the rigid, …
A new method uses online mixtures of tasks to improve meta-learning efficiency.
problem Difficulty in meta-learning when tasks are dissimilar or change over time.
method Proposes a Dirichlet process mixture of hierarchical Bayesian models for task-dependent hyperparameter selection.
result Better handles latent distribution shift on evolving few-shot learning benchmarks.
Community detection has been an active research area for decades. Among all probabilistic models, Stochastic Block Model has been the most popular one. This paper introduces a novel probabilistic model: RW-HDP, based on random walks and Hierarchical Dirichlet Process, for community extraction. In RW-HDP, random walks c…
Proposes a new model for clustering passenger trips considering hierarchical and multi-dimensional data.
problem Clustering passenger trips with hierarchical and multi-dimensional data, especially in large-scale transportation systems.
method Tensor Dirichlet Process Multinomial Mixture (Tensor-DPMM) model, incorporating Dirichlet Process for automatic cluster number determination and tensor representation for multi-mode data.
result Automatic determination of the number of clusters and improved clustering quality.
In this note we provide detailed derivations of two versions of small-variance asymptotics for hierarchical Dirichlet process (HDP) mixture models and the HDP hidden Markov model (HDP-HMM, a.k.a. the infinite HMM). We include derivations for the probabilities of certain CRP and CRF partitions, which are of more general…
Improved Bayesian network classifiers using HDPs for better parameter estimation.
problem Inaccurate parameter estimation in Bayesian network classifiers limits their performance.
method Hierarchical Dirichlet Processes (HDPs) for accurate parameter estimation.
result HDPs improve BNCs' performance, matching or outperforming Random Forest on categorical datasets.
Methodology for estimating marked Hawkes processes with neural networks.
problem Estimating conditional intensity of marked Hawkes processes.
method Proposes two models: Shallow Neural Hawkes with marks and Neural Network for Non-Linear Hawkes with Marks.
result Validation on synthetic datasets and real-world cryptocurrency order book data.
A new method for efficient BNC parameter estimation outperforms HDP smoothing.
problem Efficiently estimating parameters for Bayesian network classifiers to match or exceed random forest performance.
method Uses log-linear regression to approximate hierarchical Dirichlet process (HDP) smoothing, making the approach simpler and faster.
result Our method outperforms HDP smoothing while being orders of magnitude faster and competitive with random forests.
We develop dependent hierarchical normalized random measures and apply them to dynamic topic modeling. The dependency arises via superposition, subsampling and point transition on the underlying Poisson processes of these measures. The measures used include normalised generalised Gamma processes that demonstrate power …
Time-varying mixture densities occur in many scenarios, for example, the distributions of keywords that appear in publications may evolve from year to year, video frame features associated with multiple targets may evolve in a sequence. Any models that realistically cater to this phenomenon must exhibit two important p…
New model uses variance-Hawkes process to fit energy market returns.
problem Modeling clustering effects in financial markets.
method Defining and fitting a variance-Hawkes process to energy market returns.
result Demonstrated that variance-Hawkes process can capture clustering effects.
Bayesian nonparametric model learns new categories without predefined limits.
problem Learning new categories unseen in labeled training data.
method Hierarchical Dirichlet process and latent Dirichlet allocation for automatic category inference.
result Nonparametric approach yields comparable performance to parametric methods with pre-specified new categories.
New model for fair clustering ensures balanced representation of protected attributes.
problem Ensuring fair representation in clustering for protected attributes.
method Model-based formulation of fair clustering, balancing protected attributes across clusters.
result Demonstrates improved fairness in clustering through a new model.
New method simplifies Bayesian inference for multi-Dirichlet priors.
problem Inference for models with hierarchical Multi-Dirichlet priors is tricky.
method Auxiliary variable scheme simplifies joint distribution of model parameters.
result Efficient inference schemes derived using the auxiliary variable scheme.
The Dirichlet process and its extension, the Pitman-Yor process, are stochastic processes that take probability distributions as a parameter. These processes can be stacked up to form a hierarchical nonparametric Bayesian model. In this article, we present efficient methods for the use of these processes in this hierar…
Enhances HDP-HMM for state transitions between similar states.
problem Improving state transition probabilities between related states.
method Defines a similarity function and scales transition probabilities by it, using a Markov Jump Process with conditional conjugacy.
result Achieves favorable comparisons to existing models on various tasks.
The study examines Hawkes processes and their long-term behavior.
problem Understanding the long-term behavior of Hawkes processes.
method Proving functional limit theorems under various conditions on the dispersion of child events.
result Functional limit theorems hold for Hawkes processes with different levels of child event dispersion.
The Hawkes process is a simple point process, whose intensity function depends on the entire past history and is self-exciting and has the clustering property. The Hawkes process is in general non-Markovian. The linear Hawkes process has immigration-birth representation. Based on that, Fierro et al. recently introduced…
There is much interest in the Hierarchical Dirichlet Process Hidden Markov Model (HDP-HMM) as a natural Bayesian nonparametric extension of the traditional HMM. However, in many settings the HDP-HMM's strict Markovian constraints are undesirable, particularly if we wish to learn or encode non-geometric state durations.…
Develops scalable model for learning velocity fields in complex traffic scenarios.
problem Learning heterogeneous and dynamic velocity fields in complex traffic scenarios.
method Nonparametric Bayesian modeling with hierarchical Dirichlet process and infinite hidden Markov model, Gaussian process prior, and scalable approximate inference.
result Demonstrates effective scalability and applicability to real-world traffic data.
UNMIX identifies hidden buyers in darknet markets by clustering anonymized IDs.
problem Identifying hidden buyers in darknet markets where IDs are anonymized.
method UNMIX, a hidden buyer identification model using Dirichlet Hawkes Process.
result UNMIX successfully groups transactions from one hidden buyer into one cluster.