Self-supervised learning excels in topic modeling by being less model-specific.
problem How self-supervised learning discovers useful representations in topic models.
method Applying self-supervised learning objectives to topic model-generated data.
result Self-supervised learning objectives can recover useful posterior information for topic models, outperforming misspecified models.
Supervised topic models utilize document's side information for discovering predictive low dimensional representations of documents. Existing models apply the likelihood-based estimation. In this paper, we present a general framework of max-margin supervised topic models for both continuous and categorical response var…
Improved neural topic model for semi-supervised learning.
problem Representing textual data in an interpretable manner with limited labeled data.
method Label-Indexed Neural Topic Model (LI-NTM) that combines deep generative models with semi-supervised learning.
result LI-NTM outperforms existing models in document reconstruction and classifier performance.
Supervised topic models improve clinical diagnostics by interpreting cooccurence patterns in count data.
problem Standard supervised Latent Dirichlet Allocation (sLDA) struggles with documents having many more words than labels and lacks effective use of supervised labels.
method Investigates penalized optimization methods to train interpretable sLDA models using recognition networks for faster inference.
result Preliminary results show improved predictions on heldout data for predicting anti-depressant medication success based on patient history.
Proposes supervised topic models for classification and regression from crowds.
problem Ambiguity and noise in annotation tasks, especially with large volumes of documents.
method Develops two supervised topic models and an efficient stochastic variational inference algorithm.
result Empirically demonstrates superior performance over state-of-the-art approaches.
Proposes a new training framework for better interpretable latent models.
problem Lack of balance between generative explanations and label predictions in semi-supervised models.
method Prediction-constrained training objective integrating supervisory signals and stochastic gradient descent.
result Improved prediction quality and interpretable topics compared to previous models.
Paper proposes GSSNMF for legal document classification and topic modeling.
problem Lack of methods that can both classify and model topics with guidance.
method Guided Semi-Supervised Non-negative Matrix Factorization (GSSNMF).
result Improves both classification accuracy and topic coherence.
Predicts EHR features that improve prediction, learning coherent topics.
problem Balancing prediction quality and coherence in EHR topic models.
method Prediction-focused topic model that uses supervisory signal to retain relevant features.
result Prediction-focused topic models learn more coherent topics while maintaining competitive predictions.
Predictive topic models retain only relevant terms for better prediction and topic coherence.
problem Misspecification of topic models leads to poor prediction and topic coherence.
method Uses supervisory signal to select vocabulary terms improving prediction performance.
result Prediction-focused topic models learn more coherent topics while maintaining competitive predictions.
CorEx learns topics without assumptions, incorporating human input.
problem Complexity and detailed assumptions in topic modeling.
method Information-theoretic framework, anchor words for minimal human input.
result Topics comparable to LDA with minimal human intervention.
Neural model predicts survival outcomes and reveals feature relationships.
problem Predicting time-to-event outcomes and understanding feature relationships in clinical data.
method Survival and topic modeling combined in a neural network framework.
result Neural survival-supervised topic models achieve competitive accuracy with interpretability.
TS-NMF improves topic models by incorporating user-provided labels.
problem Lack of interpretability in unsupervised topic models.
method Semi-supervised non-negative matrix factorization (TS-NMF) with user-provided labeled examples.
result TS-NMF achieves higher Jaccard similarity scores than unsupervised methods at low supervision rates.
Paper proposes a semi-supervised learning approach for automated topic detection in support and feedback data.
problem Manual analysis of large textual feedback and support data is time-consuming and labor-intensive.
method Combines BERT-based multiclassification with a novel PSHTI model for automated topic and sub-topic inference.
result Automated system for better understanding user voice and engagement patterns in enterprise data.
Contrastive learning helps linear models understand document topics.
problem Document classification with limited labeled data.
method Contrastive learning applied to document topic modeling.
result Linear models can recover topic posterior information from contrastive learning representations.
New method predicts ICU stay for pancreatitis patients.
problem Predicting ICU stay for pancreatitis patients.
method Survival-supervised topic modeling with elastic-net regularized Cox model and anchor words.
result Our method is as accurate as best baselines but more interpretable.
Topic modeling based on latent Dirichlet allocation (LDA) has been a framework of choice to perform scene recognition and annotation. Recently, a new type of topic model called the Document Neural Autoregressive Distribution Estimator (DocNADE) was proposed and demonstrated state-of-the-art performance for document mod…
We present sparse topical coding (STC), a non-probabilistic formulation of topic models for discovering latent representations of large collections of data. Unlike probabilistic topic models, STC relaxes the normalization constraint of admixture proportions and the constraint of defining a normalized likelihood functio…
Max-margin learning is a powerful approach to building classifiers and structured output predictors. Recent work on max-margin supervised topic models has successfully integrated it with Bayesian topic models to discover discriminative latent semantic structures and make accurate predictions for unseen testing data. Ho…
Bayesian Topic Regression models causal inference with text and numerical data.
problem Causal inference using observational text data with both text and numerical confounders.
method Combines supervised Bayesian topic model with Bayesian regression framework, respecting the Frisch-Waugh-Lovell theorem.
result Joint approach recovers ground truth with lower bias than benchmarks, superior prediction results compared to separate approaches.
HiGitClass automatically classifies GitHub repositories using keywords.
problem Automatic classification of unlabeled GitHub repositories.
method Keyword-driven hierarchical classification with three modules.
result HiGitClass outperforms existing methods in repository classification.
Proposes a new model to predict antidepressants from EHRs, improving accuracy and interpretability.
problem Improving prediction accuracy and interpretability in topic models for clinical data.
method Prediction-constrained latent Dirichlet allocation framework balancing generative likelihood and prediction accuracy.
result Improved prediction of depression medications from EHRs compared to previous methods.
Develops a flexible deep autoencoding topic model with scalable hybrid Bayesian inference.
problem Flexible and interpretable document analysis models.
method DATM with hybrid Bayesian inference, including topic-layer-adaptive stochastic gradient Riemannian MCMC and Weibull variational encoder.
result Demonstrates scalability and efficacy on big corpora in unsupervised and supervised learning tasks.
Paper extends topic models using neighborhood aggregation for better performance.
problem Extending topic models with pre-trained word embeddings and nonlinear output functions.
method Network view of topic models, neighborhood aggregation algorithm.
result Approach outperforms state-of-the-art supervised Latent Dirichlet Allocation.
Two computational models analyze political topics in social media tweets.
problem Measuring political attention in social media is labor-intensive and restrictive.
method Two computational models: supervised classifier and unsupervised topic model.
result Models provide different benefits: supervised classifier reduces labor, unsupervised model uncovers political and non-political uses.
Supervised topic models simultaneously model the latent topic structure of large collections of documents and a response variable associated with each document. Existing inference methods are based on variational approximation or Monte Carlo sampling, which often suffers from the local minimum defect. Spectral methods …
Better stock market predictions can be made by simpler topic models.
problem Improving stock market prediction accuracy using news articles.
method Empirical and theoretical analysis of supervised and plain LDA models, with a focus on Gibbs sampling and random search.
result Simpler topic models (plain LDA) outperform more complex models (sLDA) in out-of-sample performance.
Proposes a new deep topic model using MBN and Lasso.
problem Difficult optimization problem in topic modeling.
method Multilayer bootstrap network (MBN) for dimension reduction, supervised Lasso for topic word discovery.
result Effectiveness demonstrated on 20-newsgroups and TDT2 corpora.
Generating user interpretable multi-class predictions in data rich environments with many classes and explanatory covariates is a daunting task. We introduce Diagonal Orthant Latent Dirichlet Allocation (DOLDA), a supervised topic model for multi-class classification that can handle both many classes as well as many co…
A new parallel MCMC algorithm improves topic modeling without communication.
problem Quasi-ergodicity problem in topic modeling due to multimodal topic distributions.
method Developed an embarrassingly parallel MCMC algorithm for sLDA by switching topic combination and labeling prediction.
result Out-of-sample prediction performance is comparable to non-parallel sLDA but computation time is significantly reduced.
News explains most overnight stock market gains.
problem Understanding why overnight stock market gains are common.
method Supervised topic analysis of 2.4 million news articles.
result Time variation in news topics and their responses explain overnight returns.
Bibliographic analysis considers the author's research areas, the citation network and the paper content among other things. In this paper, we combine these three in a topic model that produces a bibliographic model of authors, topics and documents, using a nonparametric extension of a combination of the Poisson mixed-…
Hybrid approach combines topic and graph embeddings for legal document clustering.
problem Challenges in classifying legal texts due to domain-specific language and limited labeled data.
method Combines unsupervised topic and graph embeddings with a supervised model.
result Improves clustering quality over text-only or graph-only embeddings.
Supervised topic models with a logistic likelihood have two issues that potentially limit their practical use: 1) response variables are usually over-weighted by document word counts; and 2) existing variational inference methods make strict mean-field assumptions. We address these issues by: 1) introducing a regulariz…
New hierarchical tensor decomposition model for complex data.
problem Lack of natural generalization of hierarchical NMF to tensors.
method Proposes a new hierarchical nonnegative tensor decomposition (HNTF) model.
result Model more naturally illuminates topic hierarchy.
New learning algorithms for dynamic topic modeling in video analysis.
problem Efficiently processing large volumes of video data for autonomous decisions.
method Two novel learning algorithms based on expectation maximisation and variational Bayes inference.
result Comparison of learning algorithms on real video data.
This paper presents a new semi-supervised framework with convolutional neural networks (CNNs) for text categorization. Unlike the previous approaches that rely on word embeddings, our method learns embeddings of small text regions from unlabeled data for integration into a supervised CNN. The proposed scheme for embedd…
Corrected moment-based methods improve inference in topic model regression.
problem Inferential difficulties in topic model plug-in workflow for regression.
method Corrected spectral moment methods for LDA, response-weighted word moments.
result Direct identification of regression coefficients without estimating topic shares.
LR-Robot automates SLRs with AI, expert oversight, and multidimensional analysis.
problem Efficient but contextually limited outputs from existing SLR frameworks.
method Human-in-the-loop process, structured knowledge sources, retrieval-augmented generation.
result Empirical demonstration of AI-driven literature synthesis in option pricing.
TopicRNN integrates RNNs and latent topics for better semantic dependency capture.
problem Capturing long-range semantic dependencies in sequential data.
method End-to-end learned RNN with latent topics.
result TopicRNN outperforms existing contextual RNN baselines in word prediction and sentiment analysis.
Proposes a semi-supervised approach to predict user-level sentiments in social media.
problem Detect and analyze sentiment in social media, especially user-level sentiments.
method Semi-supervised approach using a heterogeneous graph built from social networks, incorporating user influences and multiple types of links.
result Predicts user-level sentiments for specific topics more effectively than previous supervised learning approaches.
Two deep learning models improve indoor location prediction from WiFi fingerprints.
problem Indoor location prediction from WiFi fingerprints.
method Convolutional mixture density recurrent neural network and VAE-based semi-supervised learning model.
result Proposed models outperform existing methods in real-world datasets.
In retrospective assessments, internet news reports have been shown to capture early reports of unknown infectious disease transmission prior to official laboratory confirmation. In general, media interest and reporting peaks and wanes during the course of an outbreak. In this study, we quantify the extent to which med…
Semi-supervised learning is an important and active topic of research in pattern recognition. For classification using linear discriminant analysis specifically, several semi-supervised variants have been proposed. Using any one of these methods is not guaranteed to outperform the supervised classifier which does not t…
Systems rank PubMed abstracts and sentences for RDoC criteria, achieving high mAP and MAA.
problem Lack of RDoC labeled datasets and complex labelling process hinder full use of RDoC framework.
method Attention-based neural topic models, supervised and unsupervised sentence ranking models, BM25, BoW, TF-IDF.
result Best systems achieved 1st rank with 0.86 mAP and 0.58 MAA.
The paper discusses how to improve machine learning models using partial differential equations.
problem Improving the performance and generalization of machine learning models.
method The paper reframes implicit regularization techniques in deep learning as explicit gradient regularization using partial differential equations.
result Explicit regularization using PDEs can lead to better model performance and generalization.
Modeling true and false news diffusion in social networks using homogeneity.
problem Difficulties in distinguishing true from false news in social networks.
method Proposes a Bayesian nonparametric model that incorporates homogeneity of news stories to predict their genuineness.
result Homogeneity values of news stories strongly correlate with their genuineness and content.
A new method for functional data classification using supervised manifold learning.
problem Improving classification of functional data.
method Supervised manifold learning approach considering label information.
result The proposed method achieves highly competitive performance compared to existing methods.
We introduce supervised latent Dirichlet allocation (sLDA), a statistical model of labelled documents. The model accommodates a variety of response types. We derive an approximate maximum-likelihood procedure for parameter estimation, which relies on variational methods to handle intractable posterior expectations. Pre…