Paper introduces hierarchical softmax for global hierarchical classification tasks.
problem Improving classification accuracy in tasks with class hierarchies.
method Global hierarchical neural networks using hierarchical softmax.
result Hierarchical softmax outperforms regular softmax in multiple datasets.
The paper develops a decision support system for hierarchical text classification of conference proceedings.
problem Classifying documents with a fixed hierarchical structure of topics.
method Developed a weighted hierarchical similarity function to calculate topic relevance, using entropy of words to estimate weights.
result The weighted hierarchical similarity function improves ranking accuracy compared to other methods.
Efficiently predicts paths in hierarchical text classification using unlabeled data.
problem Costly labeling of documents in hierarchical text classification.
method Path cost-sensitive learning algorithm using generative model and path constraints.
result Significantly reduces computational cost and improves efficiency.
HAXMLNet tackles extreme multi-label text classification with hierarchical attention.
problem Tagging each text with relevant labels from an extreme-scale label set.
method Proposes a hierarchical structure with multi-label attention for efficient and effective XMTC.
result HAXMLNet achieves competitive performance compared to state-of-the-art methods.
Proposes a novel framework for multi-label text classification.
problem Lack of coherent consideration of non-consecutive and long-distance semantics and hierarchical relations among labels.
method Hierarchical taxonomy-aware and attentional graph capsule recurrent CNNs framework.
result Significantly improves multi-label text classification performance.
Several real problems ranging from text classification to computational biology are characterized by hierarchical multi-label classification tasks. Most of the methods presented in literature focused on tree-structured taxonomies, but only few on taxonomies structured according to a Directed Acyclic Graph (DAG). In thi…
Paper proposes HGAT for detecting fake news on HIN.
problem Viral spread of fake news causing social harm.
method Hierarchical Graph Attention Network (HGAT) for node representation learning in HIN.
result HGAT outperforms text-based and network-based models.
HCC extends conformal prediction to handle class hierarchies, improving prediction reliability.
problem Uncertainty quantification in classification models with class hierarchy considerations.
method Formulates HCC as a constrained optimization problem, ensuring coverage guarantees with a smaller subset of candidate solutions.
result HCC produces more reliable prediction sets by leveraging class hierarchy information.
Much of human knowledge sits in large databases of unstructured text. Leveraging this knowledge requires algorithms that extract and record metadata on unstructured text documents. Assigning topics to documents will enable intelligent search, statistical characterization, and meaningful classification. Latent Dirichlet…
Proposes EM-HRNN model for better hierarchical language representation.
problem Learning hierarchical representations in natural language processing.
method Introduces latent indicator layer and EM algorithm for training.
result EM-HRNN model outperforms other RNN-based models in document classification.
Large-scale classification of data where classes are structurally organized in a hierarchy is an important area of research. Top-down approaches that exploit the hierarchy during the learning and prediction phase are efficient for large scale hierarchical classification. However, accuracy of top-down approaches is poor…
Many challenges in natural language processing require generating text, including language translation, dialogue generation, and speech recognition. For all of these problems, text generation becomes more difficult as the text becomes longer. Current language models often struggle to keep track of coherence for long pi…
APo-VAE generates text in hyperbolic space for better hierarchical representation.
problem Lack of hierarchical structure in Euclidean embeddings for natural language.
method Adversarial Poincare Variational Autoencoder (APo-VAE) in hyperbolic latent space.
result APo-VAE outperforms Euclidean VAEs in capturing latent language hierarchies.
Improved text summarization using neural semantic encoders with hierarchical structure.
problem Capturing long-term dependencies in text summarization.
method Proposed a novel hierarchical Neural Semantic Encoder (NSE) model augmented with lemma and PoS tags.
result Significantly outperformed state-of-the-art models in ROUGE metric.
Paper introduces a new text clustering model using Beta-Liouville priors.
problem Clustering short text data.
method Develops a hierarchical mixture model with Beta-Liouville priors for short text clustering.
result The Beta-Liouville distribution offers a more flexible correlation structure for short text clustering.
O-GANs improve fashion image generation by conditioning on a hierarchical ontology.
problem Challenges in training GANs to generate images from text descriptions.
method Ontology Generative Adversarial Networks (O-GANs) that condition on a hierarchical fashion ontology.
result O-GANs achieve better image quality and conditioning results compared to standard GANs.
Recent work in learning ontologies (hierarchical and partially-ordered structures) has leveraged the intrinsic geometry of spaces of learned representations to make predictions that automatically obey complex structural constraints. We explore two extensions of one such model, the order-embedding model for hierarchical…
The cooperative hierarchical structure is a common and significant data structure observed in, or adopted by, many research areas, such as: text mining (author-paper-word) and multi-label classification (label-instance-feature). Renowned Bayesian approaches for cooperative hierarchical structure modeling are mostly bas…
Large-scale Hierarchical Classification (HC) involves datasets consisting of thousands of classes and millions of training instances with high-dimensional features posing several big data challenges. Feature selection that aims to select the subset of discriminant features is an effective strategy to deal with large-sc…
Develops a deep model for joint image-text learning.
problem Bidirectional joint image-text modeling.
method Variational hetero-encoder randomized GAN (VHE-GAN).
result Achieves state-of-the-art performance in image-text learning and generation.
Diffusion models reveal latent hierarchical structure in data.
problem Quantitative measurement of data's hierarchical structure.
method Forward-backward experiments in diffusion models.
result Changes in latent variables manifest as correlated chunks in data.
The Dirichlet process and its extension, the Pitman-Yor process, are stochastic processes that take probability distributions as a parameter. These processes can be stacked up to form a hierarchical nonparametric Bayesian model. In this article, we present efficient methods for the use of these processes in this hierar…
In this paper, we compare various methods to compress a text using a neural model. We find that extracting tokens as latent variables significantly outperforms the state-of-the-art discrete latent variable models such as VQ-VAE. Furthermore, we compare various extractive compression schemes. There are two best-performi…
HRT uses bi-level reinforcement learning to optimize stock selection and execution in multi-asset equity markets.
problem Optimizing automated equity trading decisions under risk, turnover, and transaction costs.
method Hierarchical Reinforced Trader (HRT) framework that separates selection and execution decisions.
result HRT outperforms other methods in learning-based return-risk-cost trade-offs, improving Sharpe ratio and reducing turnover.
BBM models short texts using biterms to improve coherence.
problem Challenges in analyzing short texts from social media.
method Bag of Biterms (BoB) for document representation and simple statistical models.
result BBM enhances coherence and performance over traditional models.
W-RNN improves text classification by extracting serialized text semantics.
problem Semantic constraint in sparse representation classification methods.
method Weighted RNN using word vectors and recurrent neural networks.
result W-RNN outperforms other methods in precision, recall, F1, and loss values.
This thesis evaluates text-based vs audio-based classification of mental health interviews.
problem Classifying psychiatric illness using text-based methods.
method Design and evaluate a text classification network on mental health interviews, using belabBERT.
result Text-based classification is a strong alternative to audio-based methods.
Survey of text classification algorithms for complex documents.
problem Understanding and classifying complex texts using machine learning.
method Discusses various text feature extractions, dimensionality reduction methods, and classification algorithms.
result Overview of text classification techniques and their limitations.
Deep learning models outperform classical methods in text classification.
problem Improving text classification accuracy using deep learning.
method Comprehensive review of deep learning models and datasets for text classification.
result Deep learning models outperform classical methods on various text classification tasks.
This paper converts NACE classification into embeddings to preserve hierarchical structure.
problem Preserving hierarchical structure in NACE classification while reducing dimensions.
method Custom metrics for hierarchical structure retention; state-of-the-art models and dimensionality reduction.
result The proposed approach effectively preserves hierarchical structures in NACE classification.
A deep learning approach classifies medical images hierarchically.
problem Limitations of traditional supervised classifiers in medical image classification.
method Hierarchical Medical Image Classification (HMIC) using deep learning models.
result HMIC achieved better performance in classifying medical images hierarchically.
Survey of deep learning for Hindi text classification.
problem Limited research on morphologically rich, low-resource Hindi text classification.
method Comparison of CNN, LSTM, Transformer, BERT, and LASER for Hindi text classification.
result Multilingual pre-trained sentence embeddings outperform traditional architectures for Hindi text classification.
Proposes a new RNN for language generation capturing long-range dependencies.
problem Capturing long-range word dependencies and sentence order in text corpora.
method Recurrent Hierarchical Topic-Guided RNN with dynamic deep topic model.
result Outperforms larger-context RNN-based language models and learns interpretable topics.
Hierarchical beta process has found interesting applications in recent years. In this paper we present a modified hierarchical beta process prior with applications to hierarchical modeling of multiple data sources. The novel use of the prior over a hierarchical factor model allows factors to be shared across different …
In classification problems, especially those that categorize data into a large number of classes, the classes often naturally follow a hierarchical structure. That is, some classes are likely to share similar structures and features. Those characteristics can be captured by considering a hierarchical relationship among…
Hierarchical NMF organizes COVID-19 literature into a searchable tree.
problem Organizing and searching for relevant COVID-19 research.
method Hierarchical nonnegative matrix factorization.
result Identified 8 major and 52 subtopics related to COVID-19.
We consider multi-class classification where the predictor has a hierarchical structure that allows for a very large number of labels both at train and test time. The predictive power of such models can heavily depend on the structure of the tree, and although past work showed how to learn the tree structure, it expect…
C-HMCNN(h) improves HMC classification by leveraging class hierarchy.
problem Hierarchical multi-label classification with class hierarchy constraints.
method Exploits class hierarchy to produce coherent predictions for multi-label classification.
result C-HMCNN(h) outperforms state-of-the-art models in HMC classification.
Paper proposes a Renyi entropy-based method for tuning hierarchical topic models.
problem Tuning hierarchical topic models, especially determining the number of topics at each level, is challenging.
method The paper introduces a Renyi entropy-based metric for quality assessment and a practical tuning concept.
result The proposed method can estimate the number of topics for two hierarchical levels in hARTM model.
Paper tackles product categorization with structured and unstructured attributes for large-scale eCommerce.
problem Challenges in categorizing products with thousands of classes and millions of products.
method Compares hierarchical and flat models, uses Deep Learning for feature extraction, combines structured and unstructured attributes.
result Flat models perform better in specific cases, and the proposed approach handles faulty attribute names and values.
Deep Mixtures of Unigrams improve clustering of high-dimensional sparse text data.
problem Challenging unsupervised classification of very short documents with many terms.
method Developed a deep version of mixtures of Unigrams in a Bayesian framework.
result Deep Mixtures of Unigrams outperform traditional methods in classification accuracy.
Deep learning improves cancer report classification accuracy.
problem Automatically assigning ICD-O3 codes to cancer reports.
method State-of-the-art deep learning techniques, including hierarchical and flat models, with attention mechanisms.
result Best model achieves 90.3% accuracy on topography site assignment and 84.8% on morphology type assignment.
A graph model improves short text classification by integrating sentence relationships.
problem Sparse features in short text classification due to limited text length.
method PathWalk model combining graph networks and short sentences.
result PathWalk achieves state-of-the-art results on four datasets.
Deep learning models based on CNNs are predominantly used in image classification tasks. Such approaches, assuming independence of object categories, normally use a CNN as a feature learner and apply a flat classifier on top of it. Object classes in many settings have hierarchical relations, and classifiers exploiting …
Developed text classification system for Azerbaijani language.
problem Text clustering problem in Azerbaijani language.
method Machine learning and embedding techniques.
result System successfully categorizes news, product reviews, and more.
MaskGAN fills in text blanks more flexibly and effectively.
problem Handling complex manipulations on given tokens in conditional text generation.
method Decomposed conditional text generation into make-a-blank and fill-in-the-blank tasks, and used hierarchical multi-agent reinforcement learning.
result The model produces realistic texts without compromising quality and diversity.
New algorithms for hierarchical classification using conformal prediction.
problem Valid prediction sets in hierarchical classification tasks.
method Extended split conformal prediction framework with two inference algorithms.
result Empirical evaluations show effectiveness in achieving nominal coverage.
The joint optimization of representation learning and clustering in the embedding space has experienced a breakthrough in recent years. In spite of the advance, clustering with representation learning has been limited to flat-level categories, which often involves cohesive clustering with a focus on instance relations.…