Models improve syntactic clustering by adding more translation and part-of-speech decoders.
problem Improving syntactic saliency in hidden sentence representations.
method Training multi-task autoencoders on linguistic tasks and analyzing the learned hidden representations.
result The representation space becomes less entangled with more decoders, leading to better syntactic clustering.
PARSEC compresses text for sentiment analysis with minimal loss in accuracy.
problem Compressing text data for sentiment analysis without losing accuracy.
method Uses Parts-of-Speech tags to compress text intelligently.
result Accurate compression is possible with minimal loss in sentiment classification accuracy.
The paper improves part-of-speech tagging with multi-task learning and character-level word representations.
problem Improving part-of-speech tagging accuracy.
method Developed a new character-level word representation using feedforward neural network, pretraining with existing word vectors, and an additional prediction of neighbour labels as an auxiliary loss.
result The methods significantly improved POS tagging performance on English and Russian languages.
Greek POS Tagger and Entity Recognizer built using spaCy.
problem Developing a machine learning model for Greek language POS tagging and named entity recognition.
method Machine learning approach with spaCy platform, focusing on morphological features and token classification.
result The Greek spaCy platform improved performance in part-of-speech tagging and named entity recognition.
ICP improves text infilling and POS tagging with valid confidence sets.
problem Statistical reliability of machine learning predictions.
method Inductive conformal prediction algorithms for text infilling and POS tagging.
result Valid set-valued predictions with small size for real-world applications.
New HMC method handles features in POS tagging, outperforming MEMM.
problem HMC struggles with arbitrary features in POS tagging.
method Introduced Entropic Forward-Backward (EFB) probabilities to compute HMC restorations.
result EFB-based HMC outperforms MEMM in POS tagging.
dHMM improves sequential labeling by encouraging diversity.
problem Improving performance of HMM in real-world sequential labeling tasks.
method dHMM incorporates a diversity-encouraging prior over state-transition probabilities.
result dHMM outperforms state-of-the-art methods on benchmark datasets for PoS tagging and OCR.
Improved POS tagging for Twitter data with limited annotations.
problem Low-quality user-generated text for POS tagging.
method Domain adaptation using neural networks with feature embeddings and pre-trained embeddings.
result 90% tagging accuracy on German Tweets.
Paper proposes set-valued prediction for historical POS tagging.
problem Difficult POS tagging in historical corpora due to lack of native speakers and sparse data.
method Set-valued prediction approach to allow uncertainty in tagging.
result Set-valued prediction improves POS tagging precision and robustness.
Part-of-speech (POS) tagging is a fundamental component for performing natural language tasks such as parsing, information extraction, and question answering. When POS taggers are trained in one domain and applied in significantly different domains, their performance can degrade dramatically. We present a methodology f…
Improved text summarization using neural semantic encoders with hierarchical structure.
problem Capturing long-term dependencies in text summarization.
method Proposed a novel hierarchical Neural Semantic Encoder (NSE) model augmented with lemma and PoS tags.
result Significantly outperformed state-of-the-art models in ROUGE metric.
A deep learning approach generates math word problems in multiple languages.
problem Template-based mechanisms for generating mathematical word problems lack customizability and creativity.
method Character Level Long Short Term Memory Network (LSTM) and POS tags are used to generate and resolve constraints in generated problems.
result The approach generates accurate math word problems in English and Sinhala with over 90% accuracy.
Paper proposes a new method for better POS tagging adaptation.
problem Difficulty of pre-trained units learning target-specific patterns.
method Augment target-network with normalised, weighted, and randomly initialized units.
result Achieves state-of-the-art performances on POS tagging.
This research investigates the Statistical Machine Translation approaches to translate speech in real time automatically. Such systems can be used in a pipeline with speech recognition and synthesis software in order to produce a real-time voice communication system between foreigners. We obtained three main data sets …
State-of-the-art sequence labeling systems traditionally require large amounts of task-specific knowledge in the form of hand-crafted features and data pre-processing. In this paper, we introduce a novel neutral network architecture that benefits from both word- and character-level representations automatically, by usi…
Analyzes attention structure in GPT-2 model, revealing specific patterns.
problem Understanding attention mechanisms in Transformer models.
method Visualized and analyzed attention for GPT-2 model, examining interactions over a corpus.
result Attention targets different parts of speech at varying depths, aligning with dependency relations in middle layers.
TAWT improves cross-task learning efficiency and guarantees.
problem Improving cross-task learning efficiency and theoretical understanding.
method Target-Aware Weighted Training (TAWT) minimizing representation-based task distance.
result TAWT achieves non-asymptotic learning-theoretic guarantees and is effective in NLP tasks.
Hungarian text processing improved with efficient, accurate NLP pipelines.
problem Improving text processing for Hungarian language.
method Implemented in spaCy framework, focusing on efficiency and accuracy.
result Near state-of-the-art performance in all text preprocessing steps.
Improved neural NER by optimizing large corpora for German.
problem Low-resource language named entity recognition.
method Optimized large corpora, lemmatization, part-of-speech tagging, and detailed optimization.
result Up to 11% improvement in F-score on German NER tasks.
In this paper we consider two sequence tagging tasks for medieval Latin: part-of-speech tagging and lemmatization. These are both basic, yet foundational preprocessing steps in applications such as text re-use detection. Nevertheless, they are generally complicated by the considerable orthographic variation which is ty…
Deep learning model improves Vietnamese NER accuracy.
problem Vietnamese named entity recognition (NER) accuracy.
method Combining Bi-LSTM and CRF with word embeddings and semantic features.
result Achieved state-of-the-art NER results on VLSP2016 dataset.
The paper extends influence functions to sequence tagging tasks for better model interpretability.
problem Lack of interpretability methods for sequence tagging models.
method Define and compute influence of training instance segments on test segment predictions.
result The segment influence method tracks with true influence and identifies annotation errors.
Method estimates dataset utility via minimal program length proxy.
problem Determining if data labels are generated by useful subroutines.
method Rissanen Data Analysis (RDA) estimates minimum description length (MDL) as a proxy.
result Method reveals dataset characteristics and utility in various NLP settings.
New neural network layer handles OOV words in NLP tasks without pre-training.
problem Handling out-of-vocabulary words in natural language processing.
method Contextual-compositional neural network layer that attends to character sequence and context.
result Improves performance on 23 languages in joint tagging tasks.
TX-Ray analyzes and quantifies model knowledge transfer in NLP.
problem Insufficient methods for explaining and quantifying model knowledge transfer in NLP.
method Modified computer vision explainability principle to NLP, visualizing feature preference distributions.
result TX-Ray reveals how self-supervised models learn linguistic abstractions and improves generalization.
Seq-CVAE learns a latent space for each word position to capture sentence intention.
problem Capturing diversity in image captioning models.
method Seq-CVAE learns a sequential latent space for each word position, mimicking future sentence summaries.
result Significantly improves diversity metrics on MSCOCO dataset compared to baselines.
Syntax-enhanced models boost machine translation and NLP performance.
problem Limited training data and complex models struggle in NLP tasks.
method Syntax information was explicitly fed into Transformer and BERT models.
result Syntax-infused models achieved significant BLEU improvements.
A method for authorship attribution based on function word adjacency networks (WANs) is introduced. Function words are parts of speech that express grammatical relationships between other words but do not carry lexical meaning on their own. In the WANs in this paper, nodes are function words and directed edges stand in…
Compact model uses RBMs for sequence classification with fewer parameters.
problem Sequence classification with dynamic models and complex neural networks.
method Rolling RBMs over time for representation learning and temporal inference.
result Outperforms state-of-the-art models in melody and character recognition.
LanguaShrink compresses prompts using psycholinguistic principles to reduce costs.
problem Reducing computational cost and efficiency in large language model inference.
method Leverages psycholinguistic principles and the Ebbinghaus memory curve to compress prompts.
result Achieves up to 26 times compression while maintaining semantic similarity.
GTI network learns linguistic features for multi-task sequence tagging.
problem Improving neural model performance on multi-task sequence tagging without explicit features.
method GTI network with neural gate modules to learn relations between tasks.
result GTI network outperforms baselines on chunking and NER tasks.
Unified architecture for multi-modal multi-task learning using transformer.
problem Training multiple tasks concurrently with varying modalities.
method Spatio-temporal cache mechanism for multi-modal learning.
result Training multiple tasks together reduces model size by about three times.
End-to-end TTS learns context features from text input.
problem Lack of understanding of context features learned by end-to-end TTS.
method Evaluated encoder outputs against context criteria derived from parametric TTS.
result Encoder outputs reflect linguistic and phonetic context features.
Inference network approximates structured argmax inference for structured prediction.
problem Efficient inference for complex structured prediction problems.
method Trains a neural network to approximate structured argmax inference, using large-margin training criteria.
result Significant speed-ups and improved accuracy compared to gradient descent methods.
J-K fold CV improves NLP model parameter tuning by reducing variance.
problem Stable performance estimates are crucial for effective NLP model parameter tuning.
method Proposes J-K fold CV for NLP model parameter tuning, advocating lower K and increased J.
result Tuned parameters are less sensitive to data partitioning, improving reproducibility.
Privacy-preserving syntactic parsing using obfuscation.
problem Preserving privacy while parsing encrypted natural language data.
method Introducing a neural model that obfuscates words in natural language texts, preserving syntactic relationships.
result The obfuscated text leads to better performance on syntactic parsers compared to a random substitution baseline.
A new multi-layer attention mechanism improves speech keyword recognition accuracy.
problem Inaccurate attention weights in LSTM networks for speech keyword recognition.
method Introducing information from layers prior to feature extraction into attention weights calculations.
result The proposed multi-layer attention mechanism leads to more accurate attention weights and improved keyword spotting performance.
Estimating the difficulty level of math word problems is an important task for many educational applications. Identification of relevant and irrelevant sentences in math word problems is an important step for calculating the difficulty levels of such problems. This paper addresses a novel application of text categoriza…
GIRNet tackles multi-tasking with mixed domain sequences, improving sentiment and tagging tasks.
problem Labeling sequences with mixed domain data and position-specific inference.
method Unified position-sensitive multi-task RNN architecture with gated state sequences from auxiliary data.
result GIRNet achieves new state-of-the-art performance in sentiment classification, POS tagging, and target position-sensitive annotation.
Neural network framework for language recognition considers sequence information and improves accuracy.
problem Challenging task of automatic language identification in noisy conditions.
method Proposes a neural network framework with bidirectional LSTM and attention modeling for relevance weighting.
result Significant improvements over conventional methods in noisy conditions and multi-speaker speech.
Generative model improves image realism with word phrase attention.
problem Natural language often involves complex foreground objects and variable background.
method Introduced region-phrase attention between true-grid regions and word phrases.
result Generated more realistic images compared to state-of-the-art algorithms.
Investigates neural TTS systems for Japanese and English.
problem Improving neural TTS systems for high-quality speech synthesis.
method Comparative study of neural sequence-to-sequence TTS vs. DNN pipeline TTS, varying model architecture, parameter size, and language.
result A neural sequence-to-sequence TTS system requires sufficient model parameters and a powerful encoder for high-quality speech synthesis.