Tag2Vec learns tag representations in hybrid networks with semantic and hierarchical information.
problem Lack of semantic and hierarchical information in tag networks.
method Tag2Vec model that combines nodes and tags into hybrid networks, using parameterized random walks and hyperbolic Skip-gram model.
result Tag2Vec outperforms other models in learning rich semantic tag representations.
Researchers analyze tagging patterns on Stack Exchange communities.
problem Understanding the structure and evolution of tags in Q&A platforms.
method Empirical analysis and development of a generative model for tag co-occurrence.
result The model can reproduce statistical properties of co-tagging graphs.
Study interprets deep learning for LHC jet tagging.
problem Understanding deep learning models in LHC jet tagging.
method Recursive neural networks, comparative study of jet tagging tasks.
result Interesting observations on the latent space of jet tagging models.
In this paper, a new deep reinforcement learning based augmented general sequence tagging system is proposed. The new system contains two parts: a deep neural network (DNN) based sequence tagging model and a deep reinforcement learning (DRL) based augmented tagger. The augmented tagger helps improve system performance …
Paper proposes a new method for better POS tagging adaptation.
problem Difficulty of pre-trained units learning target-specific patterns.
method Augment target-network with normalised, weighted, and randomly initialized units.
result Achieves state-of-the-art performances on POS tagging.
GTI network learns linguistic features for multi-task sequence tagging.
problem Improving neural model performance on multi-task sequence tagging without explicit features.
method GTI network with neural gate modules to learn relations between tasks.
result GTI network outperforms baselines on chunking and NER tasks.
This paper creates a tagging system for paintings using historical descriptions.
problem Tagging accuracy for paintings over time with varying expert descriptions.
method A neural network with frequent itemsets as tags, followed by clustering.
result Improved tagging accuracy for paintings over time.
Paper introduces a noisy-labeled audio tagging challenge.
problem Acoustic mismatch and noisy labels in audio tagging.
method Large dataset with minimal supervision, convolutional neural network baseline.
result Demonstrates effectiveness of minimal supervision in noisy conditions.
Method learns audio embeddings with contextualized tags.
problem Align audio and tags for cross-modal tasks.
method Audio autoencoder, word embeddings, multi-head self-attention, contrastive loss.
result Multi-head self-attention improves audio representations.
New neural network layer handles OOV words in NLP tasks without pre-training.
problem Handling out-of-vocabulary words in natural language processing.
method Contextual-compositional neural network layer that attends to character sequence and context.
result Improves performance on 23 languages in joint tagging tasks.
Improved POS tagging for Twitter data with limited annotations.
problem Low-quality user-generated text for POS tagging.
method Domain adaptation using neural networks with feature embeddings and pre-trained embeddings.
result 90% tagging accuracy on German Tweets.
In this paper we consider two sequence tagging tasks for medieval Latin: part-of-speech tagging and lemmatization. These are both basic, yet foundational preprocessing steps in applications such as text re-use detection. Nevertheless, they are generally complicated by the considerable orthographic variation which is ty…
Community detection in graphs has been extensively studied both in theory and in applications. However, detecting communities in hypergraphs is more challenging. In this paper, we propose a tensor decomposition approach for guaranteed learning of communities in a special class of hypergraphs modeling social tagging sys…
In this paper we show that reporting a single performance score is insufficient to compare non-deterministic approaches. We demonstrate for common sequence tagging tasks that the seed value for the random number generator can result in statistically significant (p < 10^-4) differences for state-of-the-art systems. For …
CrossFilter tackles noisy labels in audio tagging.
problem Noisy labels in large audio datasets.
method CrossFilter framework using multiple representations and multi-task learning.
result Improves audio tagging performance on FSDKaggle2018 and FSDKaggle2019 datasets.
New method uses artificial data to improve biomedical text tagging.
problem Lack of labeled data for biomedical tasks.
method Fine-tuning a pre-trained encoder with additional artificial labeled instances.
result Achieved state-of-the-art performance in PICO annotation.
CDSA uses self-attention to impute missing values in multivariate, geo-tagged time series data.
problem Missing values in multivariate, geo-tagged time series data.
method Cross-Dimensional Self-Attention (CDSA) for sequence modeling across time, location, and sensor measurements.
result CDSA outperforms state-of-the-art methods in imputation and forecasting on real-world datasets.
Feature learning and deep learning have drawn great attention in recent years as a way of transforming input data into more effective representations using learning algorithms. Such interest has grown in the area of music information retrieval (MIR) as well, particularly in music audio classification tasks such as auto…
Paper proposes set-valued prediction for historical POS tagging.
problem Difficult POS tagging in historical corpora due to lack of native speakers and sparse data.
method Set-valued prediction approach to allow uncertainty in tagging.
result Set-valued prediction improves POS tagging precision and robustness.
This paper automates tagging programming challenge descriptions.
problem Tagging programming challenge descriptions is tedious for creators.
method Used machine and deep learning methods for automation.
result Deep learning methods outperform traditional IR approaches.
Forward Automatic Differentiation (AD) is a technique for augmenting programs to compute derivatives. The essence of Forward AD is to attach perturbations to each number, and propagate these through the computation. When derivatives are nested, the distinct derivative calculations, and their associated perturbations, m…
New HMC method handles features in POS tagging, outperforming MEMM.
problem HMC struggles with arbitrary features in POS tagging.
method Introduced Entropic Forward-Backward (EFB) probabilities to compute HMC restorations.
result EFB-based HMC outperforms MEMM in POS tagging.
The paper extends influence functions to sequence tagging tasks for better model interpretability.
problem Lack of interpretability methods for sequence tagging models.
method Define and compute influence of training instance segments on test segment predictions.
result The segment influence method tracks with true influence and identifies annotation errors.
This paper describes Task 2 of the DCASE 2018 Challenge, titled "General-purpose audio tagging of Freesound content with AudioSet labels". This task was hosted on the Kaggle platform as "Freesound General-Purpose Audio Tagging Challenge". The goal of the task is to build an audio tagging system that can recognize the c…
Proposes COALA method for learning audio representations aligned with tags.
problem Lack of annotated data for high-performance audio representation learning.
method Aligns latent representations of audio and tags using a contrastive loss.
result Audio embedding model captures both acoustic and semantic characteristics.
Quantum GNNs outperform classical GNNs in jet tagging.
problem Classifying partons initiating jets from high-energy particle collisions.
method Comparison of classical and quantum GNNs and their equivariant counterparts.
result Quantum GNNs outperformed classical GNNs in binary classification tasks.
To date, there have been massive Semi-Structured Documents (SSDs) during the evolution of the Internet. These SSDs contain both unstructured features (e.g., plain text) and metadata (e.g., tags). Most previous works focused on modeling the unstructured text, and recently, some other methods have been proposed to model …
Deep learning classifies animal behavior from wearable accelerometers.
problem Classifying animal behavior from accelerometer data.
method End-to-end deep neural network with IIR and FIR filters.
result Outperforms state-of-the-art algorithms in real-time classification.
Recent literature on deep neural networks for tagging of highly energetic jets resulting from top quark decays has focused on image based techniques or multivariate approaches using high-level jet substructure variables. Here, a sequential approach to this task is taken by using an ordered sequence of jet constituents …
New method predicts target genres from source genres, unifying music tag systems.
problem Automatic genre inference fails to handle music genre diversity and subjectivity.
method Knowledge-based, statistical, and hybrid translation models.
result Hybrid translation model is most effective for multilabel classification.
HAXMLNet tackles extreme multi-label text classification with hierarchical attention.
problem Tagging each text with relevant labels from an extreme-scale label set.
method Proposes a hierarchical structure with multi-label attention for efficient and effective XMTC.
result HAXMLNet achieves competitive performance compared to state-of-the-art methods.
We study the cluster categories arising from marked surfaces (with punctures and non-empty boundaries). By constructing skewed-gentle algebras, we show that there is a bijection between tagged curves and string objects. Applications include interpreting dimensions of Ext1 as intersection numbers of ta…
ECN framework improves training on noisy structured labels.
problem Structured errors in fine-grained annotations lead to biased models.
method Error-Correcting Networks (ECN) framework.
result ECN improves fine-grained annotation prediction.
Quantum analysis tags news for sentiment and entities.
problem Identifying bias in news reporting.
method Continuous data collection, NER and sentiment analysis.
result A corpus of tagged news articles for public use.
MuLan links music audio to natural language tags.
problem Traditional music tagging systems use rigid attributes; MuLan aims to link audio directly to natural language.
method Joint audio-text embedding model trained on 44 million music recordings and text annotations.
result MuLan's embeddings enable zero-shot functionalities and transfer learning.
Identifying the flavour of neutral B mesons production is one of the most important components needed in the study of time-dependent CP violation. The harsh environment of the Large Hadron Collider makes it particularly hard to succeed in this task. We present an inclusive flavour-tagging algorithm as an upgrade of…
We describe a strategy for constructing a neural network jet substructure tagger which powerfully discriminates boosted decay signals while remaining largely uncorrelated with the jet mass. This reduces the impact of systematic uncertainties in background modeling while enhancing signal purity, resulting in improved di…
New loss function improves classification accuracy.
problem Negative expected accuracy as an alternative to cross entropy for classification.
method Empirical investigation using modified leaky version of expected accuracy.
result Comparable or better accuracy compared to cross entropy, robust to label noise.
Enhances multi-tag classification using low-dimensional vector representations and virtual data.
problem Improving the performance of multi-tag classifiers.
method Embedding raw data into a low-dimensional feature space, then generating virtual data from linear operations on these vectors, to train multi-tag classifiers.
result Significant improvement in F1 scores (up to 224%) compared to training directly with raw data.
New method tags malware for better understanding and identification.
problem Lack of detailed descriptions and relationships between malware samples.
method Deep learning model generates human-interpretable descriptions and similarity index.
result Correctly identifies more than 95% of eleven tag descriptions with a low false positive rate.
Fine-grained event tagging system for SEC 8-K filings improves precision to 96%.
problem Coarse SEC item codes mislabel routine and significant events.
method Two-stage system tagging 8-K disclosures against a 119-event taxonomy.
result LLM judge finds precision rises to 96% with quality scores.
New method aggregates nodes in sparse graphical models.
problem Estimating edge-sparse graphical models.
method Tree-aggregated graphical lasso (tag-lasso) method.
result Aggregates nodes in a data-driven fashion using a tree.
New algorithm estimates task affinities without repeated training, improving model performance and efficiency.
problem Efficiently estimating task affinities among multiple tasks for model training.
method Grad-TAG algorithm: trains a base model for all tasks and uses gradient-based linearization to estimate task affinities.
result Estimates task affinities with high accuracy and low computational cost.
A multi-task learning model for slot tagging in biomedical domains.
problem Limited labeled data, memory constraints, and domain-specific slot types.
method Multi-task learning using deep bidirectional transformers.
result Outperforms previous state-of-the-art systems in efficiency and effectiveness.
Deep neural network predicts semantic labels for source code.
problem Difficulty in labeling and understanding new programming languages and functionalities.
method Language-agnostic deep convolutional neural network trained on Stack Overflow code snippets.
result Mean area under ROC of 0.957 and top-1 accuracy of 86.6% on Github code documents.
State-of-the-art sequence labeling systems traditionally require large amounts of task-specific knowledge in the form of hand-crafted features and data pre-processing. In this paper, we introduce a novel neutral network architecture that benefits from both word- and character-level representations automatically, by usi…
In this paper, we explore the ways to improve POS-tagging using various types of auxiliary losses and different word representations. As a baseline, we utilized a BiLSTM tagger, which is able to achieve state-of-the-art results on the sequence labelling tasks. We developed a new method for character-level word represen…
Twitmo analyzes geo-tagged Twitter data for topic modeling and visualization.
problem Analyzing public discourse on Twitter for various topics, parties, or individuals.
method Collects and preprocesses geo-tagged Tweets, applies LDA, CTM, STM, and visualizes results.
result Automatic pooling of Tweets into pseudo-documents improves topic coherence.