Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

83166249332 · Jun 202019922001200920172026
48 results for question-answering systems

Enhanced ontology learning from text improves question-answering systems.

problem Improving ontology learning from unstructured text for better question-answering systems.
method Heuristically modified FP-Tree with DFA for concept extraction and frequent pattern mining for ontology learning.
result Our approach significantly improves question-answering system performance, answering 80% of questions compared to 28.4% with Text2Onto.

Study evaluates how well question-answering models generalize to new data types.

problem Generalization of question-answering models to new data types.
method Constructed new test sets from different domains and evaluated models' performance.
result Models show significant performance drops when tested on new data types.

Hybrid QC system for Bengali questions using smart data balancing.

problem Classifying factoid questions in Bengali.
method Two-stage approach with 1D CNN for coarse classification and SGD for fine classification.
result Effectiveness of smart data balancing technique in improving classification accuracy.

Introduces Relational Privacy (RP) to control relation memorization in question answering models.

problem Relation memorization in question answering models can lead to privacy issues.
method Formalizes Relational Privacy (RP) and Differential Relational Privacy (DrP), providing bounds on relation memorization.
result DrP allows effective learning of general properties of underlying concepts while preventing relation memorization.

Paper introduces RiskEmbed, a finetuned model for financial risk management.

problem Improving retrieval accuracy in financial question-answering systems.
method Curated dataset and finetuned BERT model for financial domain.
result RiskEmbed significantly outperforms general-purpose and financial embedding models.

Benchmark evaluates AI-generated financial QA hallucinations, highlighting system vulnerabilities.

problem Ensuring factual accuracy of AI-generated financial QA outputs.
method Developed a benchmark dataset and evaluated six detection methods under clean and noisy conditions.
result LLM-based judges and embedding methods perform best, but degrade under noisy conditions.

SpanishTinyRoBERTa distills large Spanish models into efficient question-answering models.

problem Efficient Spanish question-answering models for resource-constrained environments.
method Knowledge distillation from large Spanish language models onto a smaller model.
result SpanishTinyRoBERTa achieves comparable performance to large models with faster inference.

Text embedding representing natural language documents in a semantic vector space can be used for document retrieval using nearest neighbor lookup. In order to study the feasibility of neural models specialized for retrieval in a semantically meaningful way, we suggest the use of the Stanford Question Answering Dataset…

2018-10-24abs ↗pdf ↗

Automated system extracts medication regimens from medical conversations.

problem Extract relevant medication information from medical conversations.
method QA task approach, combined QA and Information Extraction, data augmentation, public embeddings, pretraining.
result Improved accuracy in extracting dosage and frequency from 54.28 and 37.13 to 89.57 and 45.94.

Word embeddings have been shown to be useful across state-of-the-art systems in many natural language processing tasks, ranging from question answering systems to dependency parsing. (Herbelot and Vecchi, 2015) explored word embeddings and their utility for modeling language semantics. In particular, they presented an …

2016-07-11abs ↗pdf ↗

Ranking is a key aspect of many applications, such as information retrieval, question answering, ad placement and recommender systems. Learning to rank has the goal of estimating a ranking model automatically from training data. In practical settings, the task often reduces to estimating a rank functional of an object …

2014-07-23abs ↗pdf ↗

A novel method for visual question answering using scene graphs and reinforcement learning.

problem Answering free-form questions about images with deep linguistic and visual understanding.
method Context-driven, sequential reasoning based on scene graphs and reinforcement learning.
result Our method almost reaches human performance on the GQA dataset.

There has been a rapid progress in the task of Visual Question Answering with improved model architectures. Unfortunately, these models are usually computationally intensive due to their sheer size which poses a serious challenge for deployment. We aim to tackle this issue for the specific task of Visual Question Answe…

2019-09-19abs ↗pdf ↗

In an end-to-end dialog system, the aim of dialog state tracking is to accurately estimate a compact representation of the current dialog status from a sequence of noisy observations produced by the speech recognition and the natural language understanding modules. This paper introduces a novel method of dialog state t…

2016-06-13abs ↗pdf ↗

Paper analyzes biases in video QA datasets, showing models can answer 37-48% questions correctly without multimodal context.

problem Question answering biases in video QA datasets can lead to model overfitting and poor generalization.
method Analyzed popular video question answering datasets, conducted ablation studies on biases from annotators and question types.
result Pretrained language models can answer 37-48% questions correctly without multimodal context, far exceeding random guess baseline.

ForecastQA creates a new QA task for event forecasting from text data.

problem Forecasting future events from unstructured text data.
method Formulated a restricted-domain, multiple-choice QA task for event forecasting.
result Best model achieves 60.1% accuracy, lagging behind human performance by about 19%

Question-answering (QA) data often encodes essential information in many facets. This paper studies a natural question: Can we get supervision from QA data for other tasks (typically, non-QA ones)? For example, {\em can we use QAMR (Michael et al., 2017) to improve named entity recognition?} We suggest that simply furt…

2019-09-01abs ↗pdf ↗

Knowledge graph based simple question answering (KBSQA) is a major area of research within question answering. Although only dealing with simple questions, i.e., questions that can be answered through a single knowledge base (KB) fact, this task is neither simple nor close to being solved. Targeting on the two main ste…

2019-04-04abs ↗pdf ↗

This work uses conformal prediction to quantify uncertainty in large language models for multiple-choice questions.

problem Ensuring robustness and reliability of large language models in high-stakes applications.
method Conformal prediction applied to multi-choice question answering.
result Uncertainty estimates from conformal prediction are closely related to prediction accuracy.

FinanceBench benchmarks LLMs on financial QA, revealing limitations.

problem Evaluating LLMs' performance on financial question answering.
method Developed a comprehensive test suite (FinanceBench) with 10,231 questions, tested 16 models, and manually reviewed answers.
result Existing LLMs have significant limitations for financial QA, especially GPT-4-Turbo.

Model improves BERT for answering multiple-choice questions in large texts.

problem Improving machine comprehension of large text corpora for question answering.
method Developed a model using BERT with a semantic similarity attention layer to extract key sentences.
result Outperforms leading models in MovieQA challenge with 87.79% test accuracy.

Two solutions for multi-modal record linkage using Deep Learning inspired by Visual Question Answering.

problem Matching records from multiple sources representing the same entity.
method Two fusion modules: Recurrent Neural Network + Convolutional Neural Network and Stacked Attention Network. A Siamese Neural Network computes similarity.
result Recurrent Neural Network + Convolutional Neural Network fusion module outperforms a simple model.

Machine Reading Comprehension (MRC) is an important topic in the domain of automated question answering and in natural language processing more generally. Since the release of the SQuAD 1.1 and SQuAD 2 datasets, progress in the field has been particularly significant, with current state-of-the-art models now exhibiting…

2019-06-24abs ↗pdf ↗