Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,786 papers · 148 categories

Trend · papers per month

0.3%0.5%0.8%0.4% · Apr 202019922001200920172026
48 results for cross-lingual NER

Improves cross-lingual NER by projecting entities from one language to another.

problem Limited annotated corpora for named entity recognition in many languages.
method Uses machine translation twice: first for sentences, then for entities; matches based on ortho- and phonetic similarity; identifies matches using distributional statistics.
result Improves cross-lingual NER by an average of 4.1 points on 5 diverse languages.

\emph{Sentiment Quantification} (i.e., the task of estimating the relative frequency of sentiment-related classes -- such as \textsf{Positive} and \textsf{Negative} -- in a set of unlabelled documents) is an important topic in sentiment analysis, as the study of sentiment-related quantities and trends across a populati…

2019-04-16abs ↗pdf ↗

Paper explores zero-shot cross-lingual reading comprehension using pre-trained multi-lingual model.

problem Lack of training data for every language in reading comprehension tasks.
method Systematic exploration of zero-shot cross-lingual transfer learning with a multi-lingual language representation model.
result Zero-shot cross-lingual transfer learning is feasible and translating source data into target language is not necessary.

Paper develops a new unsupervised scoring function for cross-lingual document alignment.

problem Aligning documents across different languages for NLP tasks.
method Uses cross-lingual sentence embeddings to compute semantic distances and guides document alignment.
result The proposed scoring function outperforms current methods by 7-22% on various language pairs.

FGN improves Chinese NER by integrating glyph information and interactive context.

problem Chinese named entity recognition is challenging due to the complexity of characters and their glyphs.
method FGN uses a novel CGS-CNN structure to capture glyph and interactive information, and a sliding window method to fuse BERT and glyph representations.
result FGN achieves state-of-the-art performance on four NER datasets, improving over previous methods.

Develops a cross-lingual hate speech detection model using pre-trained Transformers.

problem Detecting hate speech in low-resource languages.
method Utilizes frozen Transformer language models and AXEL attention-based classification block for zero-shot and few-shot learning.
result Demonstrates highly competitive results on English and Spanish subsets of the HatEval challenge.

BERT model improves cross-lingual document retrieval.

problem Improving cross-lingual information retrieval between English queries and foreign documents.
method Introduced a deep relevance matching model based on BERT, trained with weak supervision using CLIR data.
result Model outperforms competitive baseline approaches in retrieving Lithuanian documents against short English queries.

Paper reproduces and enhances a method for cross-lingual word embeddings.

problem Creating robust cross-lingual mappings of word embeddings without supervision.
method Reproduces and enhances a self-learning method with grid search for hyperparameters.
result Model's robustness is demonstrated across four new languages.

Paper refines cross-lingual word embeddings using Manhattan norm.

problem Sensitivity of 2\ell_{2} norm loss function to outliers in CLWEs.
method Post-processing step using 1\ell_{1} norm to improve CLWEs.
result The 1\ell_{1} refinement substantially outperforms state-of-the-art baselines.

Study shows partially-typed NER datasets can match fully-typed ones in model performance.

problem Leveraging multiple partially-typed NER datasets for training models without fully-typed annotations.
method Systematic analysis and controlled experiments comparing partially-typed and fully-typed datasets.
result Models trained with partially-typed annotations can achieve similar performance to those trained with fully-typed annotations.

LPL optimizes embeddings to align local neighborhoods, improving cross-lingual word alignment.

problem Aligning embeddings across different datasets and languages.
method Locality Preserving Loss (LPL) optimizes model to project embeddings while maintaining local neighborhoods and aligning them.
result LPL-based alignment leads to better and consistent accuracy, especially in small training set settings.

Paper fine-tunes LLaMA-3-8B for financial NER using instruction and LoRA.

problem LLMs struggle with financial NER, especially differentiating entities and amounts.
method Instruction fine-tuning combined with LoRA for parameter-efficient learning.
result Micro-F1 score of 0.894 on financial NER tasks, outperforming other models.

Paper presents a method to train NER models without labelled data using weak supervision.

problem Dealing with NER performance drop in new domains without labelled data.
method Weak supervision through automatic annotation and hidden Markov model integration.
result Improvement of about 7 percentage points in entity-level F1F_1 scores.

The paper introduces uncertainty quantification for NER models.

problem Current NER models lack uncertainty measures, leading to downstream errors.
method Full-Sequence and Subsequence Conformal Prediction framework.
result The method provides formal guarantees about the reliability of model predictions.

State-of-the-art named entity recognition (NER) systems have been improving continuously using neural architectures over the past several years. However, many tasks including NER require large sets of annotated data to achieve such performance. In particular, we focus on NER from clinical notes, which is one of the mos…

2018-12-13abs ↗pdf ↗

Recent approaches based on artificial neural networks (ANNs) have shown promising results for named-entity recognition (NER). In order to achieve high performances, ANNs need to be trained on a large labeled dataset. However, labels might be difficult to obtain for the dataset on which the user wants to perform NER: la…

2017-05-17abs ↗pdf ↗

Improved NER performance on imbalanced data.

problem Highly unbalanced training data in NER tasks.
method Adapted a neural architecture with CRF and BI-LSTM layers, using pre-trained embeddings. Introduced a two-class split to optimize performance.
result Significant improvement in performance for weak classes with minimal training data.

Simple framework decouples word alignment and multilingual embedding mapping.

problem Learning multilingual embeddings without supervision.
method Two-stage approach: 1) unsupervised word alignment, 2) mapping embeddings to shared space.
result Robust performance across various multilingual tasks, including distant languages.

Proposes a method to improve deep active learning for NER tasks.

problem Weaknesses of existing deep active learning algorithms in practice.
method Estimates error decay curves of feature-defined subsets to improve sampling efficiency and robustness.
result Significantly outperforms diversification-based methods for black-box NER taggers and makes sampling more robust to labeling noise.

NERS improves RL by sampling diverse transitions considering local and global contexts.

problem Sampling biases in experience replay lead to redundant transitions.
method Neural Experience Replay Sampler (NERS) that considers both local and global contexts.
result NERS significantly improves RL performance by sampling diverse and meaningful transitions.

State-of-the-art sequence labeling systems traditionally require large amounts of task-specific knowledge in the form of hand-crafted features and data pre-processing. In this paper, we introduce a novel neutral network architecture that benefits from both word- and character-level representations automatically, by usi…

2016-03-04abs ↗pdf ↗

A framework for multi-label sentiment analysis in 100 languages with dynamic weighting.

problem Cross-lingual sentiment analysis in multi-label settings with label imbalance.
method Dynamic weighting method, focal loss adaptation, optimal class-specific thresholds.
result State-of-the-art performance in 7 out of 9 metrics across 3 languages.

The work investigates deep generative models, which allow us to use training data from one domain to build a model for another domain. We propose the Variational Bi-domain Triplet Autoencoder (VBTA) that learns a joint distribution of objects from different domains. We extend the VBTAs objective function by the relativ…

2018-06-22abs ↗pdf ↗

For many natural language processing (NLP) tasks the amount of annotated data is limited. This urges a need to apply semi-supervised learning techniques, such as transfer learning or meta-learning. In this work we tackle Named Entity Recognition (NER) task using Prototypical Network - a metric learning technique. It le…

2018-12-14abs ↗pdf ↗