GTI network learns linguistic features for multi-task sequence tagging.
problem Improving neural model performance on multi-task sequence tagging without explicit features.
method GTI network with neural gate modules to learn relations between tasks.
result GTI network outperforms baselines on chunking and NER tasks.
Paper proposes set-valued prediction for historical POS tagging.
problem Difficult POS tagging in historical corpora due to lack of native speakers and sparse data.
method Set-valued prediction approach to allow uncertainty in tagging.
result Set-valued prediction improves POS tagging precision and robustness.
This paper maps the large-scale variation of the Spanish language by employing a corpus based on geographically tagged Twitter messages. Lexical dialects are extracted from an analysis of variants of tens of concepts. The resulting maps show linguistic variation on an unprecedented scale across the globe. We discuss th…
PARSEC compresses text for sentiment analysis with minimal loss in accuracy.
problem Compressing text data for sentiment analysis without losing accuracy.
method Uses Parts-of-Speech tags to compress text intelligently.
result Accurate compression is possible with minimal loss in sentiment classification accuracy.
We describe a unified and coherent syntactic framework for supporting a semantically-informed syntactic approach to statistical machine translation. Semantically enriched syntactic tags assigned to the target-language training texts improved translation quality. The resulting system significantly outperformed a linguis…
Investigates neural TTS systems for Japanese and English.
problem Improving neural TTS systems for high-quality speech synthesis.
method Comparative study of neural sequence-to-sequence TTS vs. DNN pipeline TTS, varying model architecture, parameter size, and language.
result A neural sequence-to-sequence TTS system requires sufficient model parameters and a powerful encoder for high-quality speech synthesis.
We explore training an automatic modality tagger. Modality is the attitude that a speaker might have toward an event or state. One of the main hurdles for training a linguistic tagger is gathering training data. This is particularly problematic for training a tagger for modality because modality triggers are sparse for…
Tag2Vec learns tag representations in hybrid networks with semantic and hierarchical information.
problem Lack of semantic and hierarchical information in tag networks.
method Tag2Vec model that combines nodes and tags into hybrid networks, using parameterized random walks and hyperbolic Skip-gram model.
result Tag2Vec outperforms other models in learning rich semantic tag representations.
Researchers analyze tagging patterns on Stack Exchange communities.
problem Understanding the structure and evolution of tags in Q&A platforms.
method Empirical analysis and development of a generative model for tag co-occurrence.
result The model can reproduce statistical properties of co-tagging graphs.
Computational model uncovers linguistic universals.
problem Manual processing of linguistic typology by linguists is time-consuming and leaves key universals unexplored.
method Presented a computational model to identify known and new linguistic universals.
result The model successfully identifies known universals and uncovers new ones.
A new deep learning system improves tagging accuracy on various tasks.
problem Improving tagging accuracy on diverse sequence tagging tasks.
method Combines DNN and DRL for augmented tagging, evaluated on ATIS and CoNLL-2003 datasets.
result Outperforms state-of-the-art models by 1.9% on ATIS and 1.4% on CoNLL-2003 datasets.
ATD measures language distance using neural models, recovering linguistic groupings.
problem Lack of a unified quantitative measure for cross-linguistic distance.
method Pretrained multilingual language models, attention mechanisms, optimal transport.
result ATD quantifies representational distance between languages, recovering linguistic groupings.
This paper describes the resource- and system-building efforts of an eight-week Johns Hopkins University Human Language Technology Center of Excellence Summer Camp for Applied Language Exploration (SCALE-2009) on Semantically-Informed Machine Translation (SIMT). We describe a new modality/negation (MN) annotation schem…
Task describes tagging audio clips from 41 categories.
problem Tagging audio clips from diverse categories.
method Baseline system using AudioSet labels.
result Demonstrates feasibility of general-purpose audio tagging.
Financial statements contain quantitative information and manager's subjective evaluation of firm's financial status. Using information released in U.S. 10-K filings. Both qualitative and quantitative appraisals are crucial for quality financial decisions. To extract such opinioned statements from the reports, we built…
This paper automates tagging programming challenge descriptions.
problem Tagging programming challenge descriptions is tedious for creators.
method Used machine and deep learning methods for automation.
result Deep learning methods outperform traditional IR approaches.
Forward Automatic Differentiation (AD) is a technique for augmenting programs to compute derivatives. The essence of Forward AD is to attach perturbations to each number, and propagate these through the computation. When derivatives are nested, the distinct derivative calculations, and their associated perturbations, m…
The paper extends influence functions to sequence tagging tasks for better model interpretability.
problem Lack of interpretability methods for sequence tagging models.
method Define and compute influence of training instance segments on test segment predictions.
result The segment influence method tracks with true influence and identifies annotation errors.
Study shows adding noise to training data improves speech synthesis system's performance under noisy test conditions.
problem Impact of noisy linguistic features on neural network-based speech synthesis systems.
method Comparison of systems using ideal and corrupted linguistic features in training and test sets.
result Adding noise to training data can regularize the model and improve performance under noisy test conditions.
Improved text summarization using neural semantic encoders with hierarchical structure.
problem Capturing long-term dependencies in text summarization.
method Proposed a novel hierarchical Neural Semantic Encoder (NSE) model augmented with lemma and PoS tags.
result Significantly outperformed state-of-the-art models in ROUGE metric.
Model tags biomedical texts with tree-structured tags.
problem Tagging unstructured texts with an arbitrary number of terms from an ontology.
method Neural tree decoding approach starting from the root node of an ontology.
result Outperforms state-of-the-art approaches on MeSH term assignment.
Method learns audio embeddings with contextualized tags.
problem Align audio and tags for cross-modal tasks.
method Audio autoencoder, word embeddings, multi-head self-attention, contrastive loss.
result Multi-head self-attention improves audio representations.
Paper introduces a noisy-labeled audio tagging challenge.
problem Acoustic mismatch and noisy labels in audio tagging.
method Large dataset with minimal supervision, convolutional neural network baseline.
result Demonstrates effectiveness of minimal supervision in noisy conditions.
To date, there have been massive Semi-Structured Documents (SSDs) during the evolution of the Internet. These SSDs contain both unstructured features (e.g., plain text) and metadata (e.g., tags). Most previous works focused on modeling the unstructured text, and recently, some other methods have been proposed to model …
A new method extracts linguistic objects from text using CNNs.
problem Lack of interpretability in deep learning models for text.
method Weighted extension of Text Deconvolution Saliency (wTDS) measure.
result Extracts interpretable linguistic objects from text.
New method predicts target genres from source genres, unifying music tag systems.
problem Automatic genre inference fails to handle music genre diversity and subjectivity.
method Knowledge-based, statistical, and hybrid translation models.
result Hybrid translation model is most effective for multilabel classification.
In this paper we consider two sequence tagging tasks for medieval Latin: part-of-speech tagging and lemmatization. These are both basic, yet foundational preprocessing steps in applications such as text re-use detection. Nevertheless, they are generally complicated by the considerable orthographic variation which is ty…
We study the cluster categories arising from marked surfaces (with punctures and non-empty boundaries). By constructing skewed-gentle algebras, we show that there is a bijection between tagged curves and string objects. Applications include interpreting dimensions of Ext1 as intersection numbers of ta…
Proposes a method to interpret linguistic data models using parse trees and least-squares scores.
problem Interpreting trained classification models in linguistic data sets.
method Assigns least-squares based importance scores to words in a sentence using syntactic constituency structure and relates them to the Banzhaf value in coalitional game theory.
result Demonstrates the effectiveness of the proposed method in aiding interpretability and diagnostics for language models.
Quantum analysis tags news for sentiment and entities.
problem Identifying bias in news reporting.
method Continuous data collection, NER and sentiment analysis.
result A corpus of tagged news articles for public use.
The paper analyzes how CNNs interpret NLP tasks and identify linguistic features.
problem Understanding how CNNs capture linguistic features in NLP tasks.
method Visualization techniques and error analysis to interpret CNNs.
result Identified how CNNs capture different linguistic features and their impact on model performance.
This paper creates a tagging system for paintings using historical descriptions.
problem Tagging accuracy for paintings over time with varying expert descriptions.
method A neural network with frequent itemsets as tags, followed by clustering.
result Improved tagging accuracy for paintings over time.
MuLan links music audio to natural language tags.
problem Traditional music tagging systems use rigid attributes; MuLan aims to link audio directly to natural language.
method Joint audio-text embedding model trained on 44 million music recordings and text annotations.
result MuLan's embeddings enable zero-shot functionalities and transfer learning.
System detects financial opportunities in tweets with high precision.
problem Detecting valuable financial insights in micro-blogging data.
method Stacked Machine Learning classification system with NLP features.
result System achieves precision up to 83% in detecting financial opportunities.
Identifying the flavour of neutral B mesons production is one of the most important components needed in the study of time-dependent CP violation. The harsh environment of the Large Hadron Collider makes it particularly hard to succeed in this task. We present an inclusive flavour-tagging algorithm as an upgrade of…
Paper proposes a new method for better POS tagging adaptation.
problem Difficulty of pre-trained units learning target-specific patterns.
method Augment target-network with normalised, weighted, and randomly initialized units.
result Achieves state-of-the-art performances on POS tagging.
The starting point of this article is the question "How to retrieve fingerprints of rhythm in written texts?" We address this problem in the case of Brazilian and European Portuguese. These two dialects of Modern Portuguese share the same lexicon and most of the sentences they produce are superficially identical. Yet t…
New method tags malware for better understanding and identification.
problem Lack of detailed descriptions and relationships between malware samples.
method Deep learning model generates human-interpretable descriptions and similarity index.
result Correctly identifies more than 95% of eleven tag descriptions with a low false positive rate.
Community detection in graphs has been extensively studied both in theory and in applications. However, detecting communities in hypergraphs is more challenging. In this paper, we propose a tensor decomposition approach for guaranteed learning of communities in a special class of hypergraphs modeling social tagging sys…
Study interprets deep learning for LHC jet tagging.
problem Understanding deep learning models in LHC jet tagging.
method Recursive neural networks, comparative study of jet tagging tasks.
result Interesting observations on the latent space of jet tagging models.
Study investigates how simple speech sounds can form abstract categories.
problem How do abstract categories like phonemes emerge from speech exposure?
method Used modeling techniques to test Memory-Based Learning and Error-Correction Learning.
result Error-Correction Learning models can learn abstractions, identifying phone inventory and grouping.
Fine-grained event tagging system for SEC 8-K filings improves precision to 96%.
problem Coarse SEC item codes mislabel routine and significant events.
method Two-stage system tagging 8-K disclosures against a 119-event taxonomy.
result LLM judge finds precision rises to 96% with quality scores.
Study shows how socioeconomic status influences language use on Twitter.
problem Global variability of linguistic patterns due to socioeconomic factors.
method Multivariate analysis of French Twitter corpus and socioeconomic data.
result People with higher socioeconomic status use more standard language.
Linguistic calibration improves long-form text confidence.
problem LMs hallucinate, leading to suboptimal decisions.
method Defining linguistic calibration, training framework, reinforcement learning.
result Llama 2 7B is significantly more calibrated than baselines.
Feature learning and deep learning have drawn great attention in recent years as a way of transforming input data into more effective representations using learning algorithms. Such interest has grown in the area of music information retrieval (MIR) as well, particularly in music audio classification tasks such as auto…
Improved POS tagging for Twitter data with limited annotations.
problem Low-quality user-generated text for POS tagging.
method Domain adaptation using neural networks with feature embeddings and pre-trained embeddings.
result 90% tagging accuracy on German Tweets.
CrossFilter tackles noisy labels in audio tagging.
problem Noisy labels in large audio datasets.
method CrossFilter framework using multiple representations and multi-task learning.
result Improves audio tagging performance on FSDKaggle2018 and FSDKaggle2019 datasets.
A multi-task learning model for slot tagging in biomedical domains.
problem Limited labeled data, memory constraints, and domain-specific slot types.
method Multi-task learning using deep bidirectional transformers.
result Outperforms previous state-of-the-art systems in efficiency and effectiveness.