Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

3672107143 · Jun 202019922001200920172026
48 results for question answering

Paper analyzes biases in video QA datasets, showing models can answer 37-48% questions correctly without multimodal context.

problem Question answering biases in video QA datasets can lead to model overfitting and poor generalization.
method Analyzed popular video question answering datasets, conducted ablation studies on biases from annotators and question types.
result Pretrained language models can answer 37-48% questions correctly without multimodal context, far exceeding random guess baseline.

A novel method for visual question answering using scene graphs and reinforcement learning.

problem Answering free-form questions about images with deep linguistic and visual understanding.
method Context-driven, sequential reasoning based on scene graphs and reinforcement learning.
result Our method almost reaches human performance on the GQA dataset.

We introduce the new task of Acoustic Question Answering (AQA) to promote research in acoustic reasoning. The AQA task consists of analyzing an acoustic scene composed by a combination of elementary sounds and answering questions that relate the position and properties of these sounds. The kind of relational questions …

2019-02-28abs ↗pdf ↗

AI tested on 10 math questions from research.

problem Assessing AI's ability to solve research-level math problems.
method Shared 10 math questions not previously publicly available.
result Answers to questions are known to authors but encrypted.

FinanceBench benchmarks LLMs on financial QA, revealing limitations.

problem Evaluating LLMs' performance on financial question answering.
method Developed a comprehensive test suite (FinanceBench) with 10,231 questions, tested 16 models, and manually reviewed answers.
result Existing LLMs have significant limitations for financial QA, especially GPT-4-Turbo.

Model improves BERT for answering multiple-choice questions in large texts.

problem Improving machine comprehension of large text corpora for question answering.
method Developed a model using BERT with a semantic similarity attention layer to extract key sentences.
result Outperforms leading models in MovieQA challenge with 87.79% test accuracy.

Introduces Relational Privacy (RP) to control relation memorization in question answering models.

problem Relation memorization in question answering models can lead to privacy issues.
method Formalizes Relational Privacy (RP) and Differential Relational Privacy (DrP), providing bounds on relation memorization.
result DrP allows effective learning of general properties of underlying concepts while preventing relation memorization.

Question-answering (QA) is certainly the best known and probably also one of the most complex problem within Natural Language Processing (NLP) and artificial intelligence (AI). Since the complete solution to the problem of finding a generic answer still seems far away, the wisest thing to do is to break down the proble…

2020-01-25abs ↗pdf ↗

The emergence of structured databases for Question Answering (QA) systems has led to developing methods, in which the problem of learning the correct answer efficiently is based on a linking task between the constituents of the question and the corresponding entries in the database. As a result, parsing the questions i…

2019-09-27abs ↗pdf ↗

The rate at which medical questions are asked online far exceeds the capacity of qualified people to answer them, and many of these questions are not unique. Identifying same-question pairs could enable questions to be answered more effectively. While many research efforts have focused on the problem of general questio…

2019-10-09abs ↗pdf ↗

Study evaluates how well question-answering models generalize to new data types.

problem Generalization of question-answering models to new data types.
method Constructed new test sets from different domains and evaluated models' performance.
result Models show significant performance drops when tested on new data types.

Knowledge graph based simple question answering (KBSQA) is a major area of research within question answering. Although only dealing with simple questions, i.e., questions that can be answered through a single knowledge base (KB) fact, this task is neither simple nor close to being solved. Targeting on the two main ste…

2019-04-04abs ↗pdf ↗

This paper is concerned with the Smith question which reads as follows. Is it true that for a finite group acting smoothly on a sphere with exactly two fixed points, the tangent spaces at the fixed points have always isomorphic group module structures defined by differentiation of the action? We show that one can answe…

2020-02-11abs ↗pdf ↗

SpanishTinyRoBERTa distills large Spanish models into efficient question-answering models.

problem Efficient Spanish question-answering models for resource-constrained environments.
method Knowledge distillation from large Spanish language models onto a smaller model.
result SpanishTinyRoBERTa achieves comparable performance to large models with faster inference.

Machine Reading Comprehension (MRC) is an important topic in the domain of automated question answering and in natural language processing more generally. Since the release of the SQuAD 1.1 and SQuAD 2 datasets, progress in the field has been particularly significant, with current state-of-the-art models now exhibiting…

2019-06-24abs ↗pdf ↗

Study on cohomological dimension of surface terms, answering Farb's question.

problem Determining the cohomological dimension of specific surface terms.
method Analyzing the Johnson filtration of closed, orientable surfaces of genus g2g \geq 2.
result The kkth term of the Johnson filtration has cohomological dimension 2g32g - 3 for all k3k \geq 3 and g2g \geq 2.

Study on choosing points on cubic curves, answering some questions about their flexibility.

problem Determining if algebraic structures can continuously choose points on cubic plane curves.
method Analyzing the flex points and sextatic points of cubic plane curves.
result Affirmative answer for n=9n=9 and 18, negative for infinitely many nn.

We present a novel method for obtaining high-quality, domain-targeted multiple choice questions from crowd workers. Generating these questions can be difficult without trading away originality, relevance or diversity in the answer options. Our method addresses these problems by leveraging a large corpus of domain-speci…

2017-07-19abs ↗pdf ↗

Recent advances in neural variational inference have spawned a renaissance in deep latent variable models. In this paper we introduce a generic variational inference framework for generative and conditional models of text. While traditional variational methods derive an analytic approximation for the intractable distri…

2015-11-19abs ↗pdf ↗

Study jigsaw constructions of hyperbolic lattices and answer questions on arithmeticity and pseudomodularity.

problem Constructing and analyzing non-commensurable, non-uniform, non-arithmetic lattices in hyperbolic geometry.
method Hyperbolic jigsaw construction and recursive formulas for tessellations.
result Demonstration of recursive formula for tessellation of hyperbolic plane, generalizing Farey addition.

Question-answering (QA) data often encodes essential information in many facets. This paper studies a natural question: Can we get supervision from QA data for other tasks (typically, non-QA ones)? For example, {\em can we use QAMR (Michael et al., 2017) to improve named entity recognition?} We suggest that simply furt…

2019-09-01abs ↗pdf ↗

There has been a rapid progress in the task of Visual Question Answering with improved model architectures. Unfortunately, these models are usually computationally intensive due to their sheer size which poses a serious challenge for deployment. We aim to tackle this issue for the specific task of Visual Question Answe…

2019-09-19abs ↗pdf ↗

This study analyzes financial equity research reports to identify frequently asked questions and automates 80% of them.

problem Insufficient empirical analysis of questions answered in financial equity research reports.
method Analyzed 72 financial equity research reports, classifying sentences into 169 unique question archetypes. Used public corporate reports to classify questions' potential for automation.
result Approximately 80% of financial equity research reports can be automated, with 78.7% of questions automatable.

This work uses conformal prediction to quantify uncertainty in large language models for multiple-choice questions.

problem Ensuring robustness and reliability of large language models in high-stakes applications.
method Conformal prediction applied to multi-choice question answering.
result Uncertainty estimates from conformal prediction are closely related to prediction accuracy.