Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

0.3%0.5%0.8%0.5% · Feb 200919922001200920182026
48 results for bilingual lexicon

Simple framework decouples word alignment and multilingual embedding mapping.

problem Learning multilingual embeddings without supervision.
method Two-stage approach: 1) unsupervised word alignment, 2) mapping embeddings to shared space.
result Robust performance across various multilingual tasks, including distant languages.

Geometric approach learns bilingual mappings from monolingual embeddings.

problem Bilingual lexicon induction and cross-lingual word similarity.
method Decouples learning into rotations and a metric, modeled as optimization on Riemannian manifolds.
result Outperforms previous approaches on bilingual lexicon induction and cross-lingual word similarity tasks.

Paper refines cross-lingual word embeddings using Manhattan norm.

problem Sensitivity of 2\ell_{2} norm loss function to outliers in CLWEs.
method Post-processing step using 1\ell_{1} norm to improve CLWEs.
result The 1\ell_{1} refinement substantially outperforms state-of-the-art baselines.

This paper discusses the effect of hubness in zero-shot learning, when ridge regression is used to find a mapping between the example space to the label space. Contrary to the existing approach, which attempts to find a mapping from the example space to the label space, we show that mapping labels into the example spac…

2015-07-03abs ↗pdf ↗

Geometric approach for unsupervised word embedding alignment.

problem Learning alignment between word embeddings of source and target languages.
method Formulates alignment as domain adaptation on the manifold of doubly stochastic matrices, employing Riemannian conjugate gradient algorithm.
result Empirically outperforms state-of-the-art methods on bilingual lexicon induction tasks.

We consider the task of aligning two sets of points in high dimension, which has many applications in natural language processing and computer vision. As an example, it was recently shown that it is possible to infer a bilingual lexicon, without supervised data, by aligning word embeddings trained on monolingual data. …

2018-05-29abs ↗pdf ↗

In lexicon-based classification, documents are assigned labels by comparing the number of words that appear from two opposed lexicons, such as positive and negative sentiment. Creating such words lists is often easier than labeling instances, and they can be debugged by non-experts if classification performance is unsa…

2016-11-21abs ↗pdf ↗

Neural approach for Chinese word segmentation using lexicon and unlabeled data.

problem Efficiently segment Chinese words with limited labeled data.
method Posterior regularization algorithm with indirect supervision from lexicon and unlabeled data.
result Validation of approach on multiple benchmark datasets in in-domain and cross-domain scenarios.

Unsupervised machine translation---i.e., not assuming any cross-lingual supervision signal, whether a dictionary, translations, or comparable corpora---seems impossible, but nevertheless, Lample et al. (2018) recently proposed a fully unsupervised machine translation (MT) model. The model relies heavily on an adversari…

2018-05-09abs ↗pdf ↗

Our research extends the Bilingual Evaluation Understudy (BLEU) evaluation technique for statistical machine translation to make it more adjustable and robust. We intend to adapt it to resemble human evaluation more. We perform experiments to evaluate the performance of our technique against the primary existing evalua…

2015-09-30abs ↗pdf ↗

The paper predicts TSE stocks using social media sentiment and volume.

problem Predicting Tehran Stock Exchange (TSE) variables using social media data.
method Hybrid sentiment analysis combining lexicon-based and learning-based methods; built a sentiment lexicon for Persian language.
result Sentiment and volume of online comments are useful for predicting TSE stocks.

Paper introduces methods to integrate external knowledge into RNNs using attention mechanisms.

problem Incorporating external knowledge into RNNs for improved performance.
method Proposes three methods: attentional concatenation, feature-based gating, and affine transformation.
result Attentional feature-based gating consistently improves performance across tasks.

This paper describes the resource- and system-building efforts of an eight-week Johns Hopkins University Human Language Technology Center of Excellence Summer Camp for Applied Language Exploration (SCALE-2009) on Semantically-Informed Machine Translation (SIMT). We describe a new modality/negation (MN) annotation schem…

2015-02-05abs ↗pdf ↗

Cross-language learning allows us to use training data from one language to build models for a different language. Many approaches to bilingual learning require that we have word-level alignment of sentences from parallel corpora. In this work we explore the use of autoencoder-based methods for cross-language learning …

2014-02-06abs ↗pdf ↗

Hybrid engine analyzes news sentiment for markets in real-time.

problem Real-time market analysis of news sentiment.
method Three-way ensemble learning combining financial lexicon, adaptive TF-IDF clustering, and auto-calibrated weighting.
result Adaptive statistical clustering learner improves adaptability to market changes.

FinLlama uses a fine-tuned Llama 2 model for financial sentiment analysis.

problem Accurate financial sentiment analysis for better trading decisions.
method Fine-tuning Llama 2 7B model on financial sentiment data, using a generator-classifier scheme.
result FinLlama provides nuanced insights into financial news articles, enhancing portfolio management.

Improved unsupervised word translation using adversarial autoencoder with cycle consistency and input reconstruction.

problem Challenging language pairs and lack of parallel data for unsupervised word translation.
method Adversarial autoencoder with cycle consistency and input reconstruction regularization.
result More stable and better performance than recent approaches.

Proposes using Wasserstein barycenter for better multilingual alignment.

problem Finding word-to-word translations between multiple languages without parallel data.
method Uses Wasserstein barycenter as a more informative pivot language, minimizing pairwise transportation costs.
result Demonstrates state-of-the-art performances on standard benchmarks.

Transformers trained with three normalization changes outperform state-of-the-art on low-resource translation tasks.

problem Improving the training of Transformers, especially on low-resource datasets.
method Three normalization changes: PreNorm, ScaleNorm, and FixNorm.
result Significant improvements in BLEU scores on low-resource translation tasks.

REALFIN benchmarks financial reasoning by removing implicit assumptions, revealing model weaknesses.

problem Models struggle when implicit assumptions are missing, leading to incorrect answers.
method Developed a bilingual benchmark that systematically removes essential premises from financial questions.
result General-purpose models over-commit, while finance-specialized models fail to identify missing premises.

MGLM models all possible language channel factorizations for improved multilingual generation.

problem Generating multilingual text with flexibility and quality.
method Generative joint distribution model over language channels, marginalizing all possible factorizations.
result MGLM outperforms traditional models in multilingual generation tasks.

Neural network detects sex trafficking ads from escort websites.

problem Manual identification of sex trafficking ads from escort websites is inefficient and resource-intensive.
method Ordinal regression neural network with a modified cost function and deep learning enhancements.
result Significantly improved detection accuracy on Trafficking-10K dataset.

Improved ASR for English-isiZulu code-switched speech with semi-supervised training.

problem Improving ASR for code-switched speech between English and isiZulu.
method Semi-supervised training using automatic transcription of multilingual speech data.
result Semi-supervised training achieved significant WER reduction in ASR performance.

The study detects deceptive language in business communication using AI.

problem Deceptive language in business communication.
method Combining classical rhetoric, communication psychology, and linguistic theory with computational textual analysis and transformer models.
result Detection accuracies of over 99% achieved in controlled settings.

The paper improves ESG taxonomy and classifies sentences as sustainable or unsustainable.

problem Improving ESG taxonomy and classifying sentences based on ESG factors.
method For ESG taxonomy, used Sentence-BERT models. For sentence classification, combined RoBERTa with a multi-layer perceptron.
result Significant performance improvement and high accuracy in classifying sentences.

In this work, a novel solution to the speaker identification problem is proposed through minimization of statistical divergences between the probability distribution (g). of feature vectors from the test utterance and the probability distributions of the feature vector corresponding to the speaker classes. This approac…

2015-12-16abs ↗pdf ↗

A new Twitter sentiment model predicts stock market trends with high accuracy.

problem Real-time prediction of future stock market prices.
method Baseline correlation approach using polynomial regression, classification, and lexicon-based sentiment analysis.
result Predicts stock market trends with 67.22% accuracy, up to 15 time samples in advance.