Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

176352528704 · Jun 202019922001200920172026
48 results for open text dataset

Improved text summarization using belief propagation on weighted bipartite graphs.

problem Text summarization from a graph theory perspective.
method Generalized belief propagation algorithm for weighted bipartite graphs.
result Our algorithm outperforms greedy methods in text summarization tasks.

ZeroSCROLLS benchmarks zero-shot natural language understanding over long texts.

problem Evaluate natural language understanding models over long texts without training data.
method Adapt six tasks from SCROLLS benchmark and add four new datasets, including novel aggregation tasks.
result Claude outperforms ChatGPT, and GPT-4 achieves highest average score.

Adaptive contrastive search improves text generation quality and diversity.

problem Decoding high-quality text from language model outputs.
method Adaptive contrastive search incorporating uncertainty-guided degeneration penalty.
result Enhanced text generation quality and diversity across different models and datasets.

Paper introduces a specialized text classification system for French Open Banking transactions.

problem Classifying specialized banking text data with high accuracy and efficiency.
method Data collection, labeling, preprocessing, modeling, and evaluation stages with language-specific techniques.
result Enhanced performance and efficiency compared to generic approaches.

MoleculeSTM learns from molecule structures and texts for better drug design.

problem Lack of integration between chemical structures and textual knowledge in AI drug discovery.
method Jointly learns chemical structures and texts via contrastive learning, using a large dataset.
result MoleculeSTM achieves state-of-the-art performance in zero-shot tasks like structure-text retrieval and molecule editing.

FinGPT democratizes financial data for LLMs, enabling innovation.

problem Limited financial text datasets and disparities between general and financial text data.
method Automates collection and curation of real-time financial data from diverse Internet sources, fine-tuning with RLSP and LoRA.
result Democratizes access to financial data for LLMs, enabling innovation.

In the past few years, neural abstractive text summarization with sequence-to-sequence (seq2seq) models have gained a lot of popularity. Many interesting techniques have been proposed to improve seq2seq models, making them capable of handling different challenges, such as saliency, fluency and human readability, and ge…

2018-12-05abs ↗pdf ↗

Inductive transfer learning has greatly impacted computer vision, but existing approaches in NLP still require task-specific modifications and training from scratch. We propose Universal Language Model Fine-tuning (ULMFiT), an effective transfer learning method that can be applied to any task in NLP, and introduce tech…

2018-01-18abs ↗pdf ↗

Study examines how decoding algorithms affect fairness in language generation models.

problem Impact of decoding algorithms on fairness in open-ended language generation.
method Systematic analysis of top-pp, top-kk, and temperature decoding algorithms.
result Decoding algorithms significantly impact fairness across demographic groups.

Unified pipeline predicts equipment anomalies with high precision and reduced false positives.

problem Predicting equipment anomalies before failures using small models.
method Triplet Feature Fusion combining statistical, time-series, and text embeddings.
result Achieves high precision and reduced false positives.

Text embedding representing natural language documents in a semantic vector space can be used for document retrieval using nearest neighbor lookup. In order to study the feasibility of neural models specialized for retrieval in a semantically meaningful way, we suggest the use of the Stanford Question Answering Dataset…

2018-10-24abs ↗pdf ↗

Humor is a unique and creative communicative behavior displayed during social interactions. It is produced in a multimodal manner, through the usage of words (text), gestures (vision) and prosodic cues (acoustic). Understanding humor from these three modalities falls within boundaries of multimodal language; a recent r…

2019-04-14abs ↗pdf ↗

New text-to-image diffusion models improve scene understanding for AI agents.

problem Fine-grained scene understanding for AI agents from text and images.
method Pre-trained text-to-image diffusion models optimized for generating images from text prompts.
result Policies learned with Stable Control Representations outperform state-of-the-art approaches on various control tasks.

This research discovers model architecture and training dataset characteristics through strategic input probing.

problem Discovering model architecture and training dataset characteristics in black box models.
method Structured input probes and model outputs are used to train a deep classifier for image and text classification.
result The approach successfully distinguishes between different image and text datasets and architectures.

Generative model evaluates text emotion intensity, outperforming classification.

problem Limitations of discrete emotion classification in applied domains.
method Fine-tuning generative language models to output continuous emotion intensity scores.
result Generative model outperforms classification baselines and reveals generalization capabilities.

Mitigates bias in text classification by weighting instances.

problem Unintended biases in text classification datasets based on demographic terms.
method Instance weighting to recover non-discrimination distribution.
result Effective mitigation of unintended biases without sacrificing generalization.

MaskGAN fills in text blanks more flexibly and effectively.

problem Handling complex manipulations on given tokens in conditional text generation.
method Decomposed conditional text generation into make-a-blank and fill-in-the-blank tasks, and used hierarchical multi-agent reinforcement learning.
result The model produces realistic texts without compromising quality and diversity.

Study shows density of mapping classes on infinite-type surfaces using quasi-conformal maps.

problem Approximating mapping classes on infinite-type surfaces with quasi-conformal maps.
method Using hyperbolic structures and quasi-conformal homeomorphisms.
result Density of mapping classes on infinite-type surfaces can be achieved using quasi-conformal maps.

Self-supervised learning helps train deep features without needing lots of labeled data.

problem Annotation bottleneck in deep learning.
method Four main families of self-supervised approaches applied to various data modalities.
result Self-supervised methods can now rival fully supervised pre-training across multiple data types.

Deep neural networks are data hungry models and thus face difficulties when attempting to train on small text datasets. Transfer learning is a potential solution but their effectiveness in the text domain is not as explored as in areas such as image analysis. In this paper, we study the problem of transfer learning for…

2018-10-15abs ↗pdf ↗

This paper has two purposes. First it partially extends the result in the author's previous work concerning the asymptotic expansion of the Tian-Yau metrics, by considering a slightly larger class of quasi-projective manifolds. This text is also intended to provide a quick introductory reference to the study of Ricci-f…

2012-05-04abs ↗pdf ↗

We present RUSLAN -- a new open Russian spoken language corpus for the text-to-speech task. RUSLAN contains 22200 audio samples with text annotations -- more than 31 hours of high-quality speech of one person -- being the largest annotated Russian corpus in terms of speech duration for a single speaker. We trained an e…

2019-06-26abs ↗pdf ↗

Open-domain dialog generation is a challenging problem; maximum likelihood training can lead to repetitive outputs, models have difficulty tracking long-term conversational goals, and training on standard movie or online datasets may lead to the generation of inappropriate, biased, or offensive text. Reinforcement Lear…

2019-09-17abs ↗pdf ↗

Estimates watermarked content proportions in mixed-source texts.

problem Optimally estimating the proportion of watermarked content in texts with mixed sources.
method Casting the problem as estimating a proportion parameter in a mixture model based on pivotal statistics.
result Proposes efficient estimators for watermark proportion and shows their accuracy through evaluations.

Dataset distillation is a method for reducing dataset sizes by learning a small number of synthetic samples containing all the information of a large dataset. This has several benefits like speeding up model training, reducing energy consumption, and reducing required storage space. Currently, each synthetic sample is …

2019-10-06abs ↗pdf ↗

Representing entities and relations in an embedding space is a well-studied approach for machine learning on relational data. Existing approaches, however, primarily focus on simple link structure between a finite set of entities, ignoring the variety of data types that are often used in knowledge bases, such as text, …

2018-09-05abs ↗pdf ↗

Today, the dominant paradigm for training neural networks involves minimizing task loss on a large dataset. Using world knowledge to inform a model, and yet retain the ability to perform end-to-end training remains an open question. In this paper, we present a novel framework for introducing declarative knowledge to ne…

2019-06-14abs ↗pdf ↗

Text to Image Synthesis refers to the process of automatic generation of a photo-realistic image starting from a given text and is revolutionizing many real-world applications. In order to perform such process it is necessary to exploit datasets containing captioned images, meaning that each image is associated with on…

2019-10-09abs ↗pdf ↗

Text clustering method replaces centroids with summaries for interpretability and scalability.

problem Efficiently clustering text data while maintaining interpretability and scalability.
method k-NLPmeans and k-LLMmeans, which periodically replace numeric centroids with textual summaries.
result Consistently outperforms classical baselines and recent LLM-based clustering methods.

Paper defends LSTM-based text classification models from backdoor attacks.

problem Backdoor attacks in LSTM models cause misclassification of spam or malicious speech.
method Backdoor Keyword Identification (BKI) to identify and exclude poisoned samples.
result BKI method effectively mitigates backdoor attacks in various text classification datasets.