Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,786 papers · 148 categories

Trend · papers per month

1122 · Nov 201819922001200920172026
9 results for ELMo

Paper tackles Arabic question similarity, outperforming state-of-the-art.

problem Detecting semantically similar questions in Arabic is challenging.
method Utilizes contextualized word representations (ELMo embeddings) trained on MSA and dialectic sentences, combined with a pairwise similarity layer.
result Achieves 93% F1-score on Modern Standard Arabic benchmark and 82% on dialectical benchmark.

Paper shows pretrained models can categorize Thai social media content effectively.

problem Lack of labeled data for Thai social media content classification.
method Pretrained language models on a large noisy Thai social media corpus, fine-tuned for downstream tasks.
result State-of-the-art results achieved on Thai social text categorization tasks.

In this paper, we compare various methods to compress a text using a neural model. We find that extracting tokens as latent variables significantly outperforms the state-of-the-art discrete latent variable models such as VQ-VAE. Furthermore, we compare various extractive compression schemes. There are two best-performi…

2018-11-14abs ↗pdf ↗

DSE learns sentence embeddings from cross-attention models to speed up sentence-pair similarity computation.

problem Computing sentence-pair similarity is computationally expensive when candidate sentences are large.
method Distilled Sentence Embedding (DSE) based on knowledge distillation from cross-attentive models.
result DSE significantly outperforms ELMO variants and other sentence embedding methods, accelerating computation by several orders of magnitude.