Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,982 papers · 148 categories

Trend · papers per month

131263394525 · Jun 202019922001200920172026
48 results for Machine Reading Comprehension

Paper explores zero-shot cross-lingual reading comprehension using pre-trained multi-lingual model.

problem Lack of training data for every language in reading comprehension tasks.
method Systematic exploration of zero-shot cross-lingual transfer learning with a multi-lingual language representation model.
result Zero-shot cross-lingual transfer learning is feasible and translating source data into target language is not necessary.

QAInfomax improves reading comprehension by maximizing mutual information, achieving state-of-the-art performance.

problem Distractor sentences in question answering datasets are hard to distinguish from relevant ones.
method QAInfomax regularizes reading comprehension models to learn mutual information among passages, questions, and answers.
result QAInfomax achieves state-of-the-art performance on Adversarial-SQuAD dataset.

Interactive machine comprehension models learn through seeking relevant information.

problem Existing MRC models struggle with real-world applications due to static datasets.
method Reframe MRC datasets as interactive, partially observable environments.
result Interactive models can seek relevant information through sequential decision making.

Recurrent neural networks (RNNs) can model natural language by sequentially 'reading' input tokens and outputting a distributed representation of each token. Due to the sequential nature of RNNs, inference time is linearly dependent on the input length, and all inputs are read regardless of their importance. Efforts to…

2019-03-20abs ↗pdf ↗

Neural models often incorrectly predict the same answer to subtly changed questions, even when they should not.

problem Neural models' oversensitivity to adversarial question changes.
method Formulated a noisy adversarial attack to identify and exploit undersensitivity, tested with data augmentation and adversarial training.
result Undersensitivity can be exploited to mislead models, and addressing it improves model performance and robustness.

Many Machine Reading and Natural Language Understanding tasks require reading supporting text in order to answer questions. For example, in Question Answering, the supporting text can be newswire or Wikipedia articles; in Natural Language Inference, premises can be seen as the supporting text and hypotheses as question…

2018-06-20abs ↗pdf ↗

Paper uses ensemble learning for IoT cybersecurity anomaly detection.

problem Anomaly detection in IoT data is challenging due to heterogeneous device types.
method Bayesian hyperparameter optimisation for ensemble learning.
result Ensemble learning with Bayesian optimisation improves anomaly detection accuracy.

These lecture notes in the De Rham-Hodge theory are designed for a 1-semester undergraduate course (in mathematics, physics, engineering, chemistry or biology). This landmark theory of the 20th Century mathematics gives a rigorous foundation to modern field and gauge theories in physics, engineering and physiology. The…

2008-07-31abs ↗pdf ↗

These lecture notes in Lie Groups are designed for a 1--semester third year or graduate course in mathematics, physics, engineering, chemistry or biology. This landmark theory of the 20th Century mathematics and physics gives a rigorous foundation to modern dynamics, as well as field and gauge theories in physics, engi…

2011-04-06abs ↗pdf ↗

Metagenomics characterizes the taxonomic diversity of microbial communities by sequencing DNA directly from an environmental sample. One of the main challenges in metagenomics data analysis is the binning step, where each sequenced read is assigned to a taxonomic clade. Due to the large volume of metagenomics datasets,…

2015-05-26abs ↗pdf ↗

We present a case-study demonstrating the usefulness of Bayesian hierarchical mixture modelling for investigating cognitive processes. In sentence comprehension, it is widely assumed that the distance between linguistic co-dependents affects the latency of dependency resolution: the longer the distance, the longer the …

2017-02-02abs ↗pdf ↗

Neural network optimizes learning sequence for reading words.

problem Children struggle with learning to read words due to inconsistent spelling-sound correspondences.
method Used a neural network to structure learning trials to optimize generalization accuracy.
result Significant improvement in generalization accuracy compared to random or frequency-based sequences.

Recent advances in high-throughput cDNA sequencing (RNA-Seq) technology have revolutionized transcriptome studies. A major motivation for RNA-Seq is to map the structure of expressed transcripts at nucleotide resolution. With accurate computational tools for transcript reconstruction, this technology may also become us…

2013-09-20abs ↗pdf ↗

Semi-supervised deep learning detects problematic reads for genome assembly.

problem De novo genome assembly is hindered by specific types of reads.
method Analysis of coverage graphs converted to 1D-signals using semi-supervised deep learning models.
result Semi-supervised deep learning models can detect problematic reads with minimal labeled data.

Recent empirical results on long-term dependency tasks have shown that neural networks augmented with an external memory can learn the long-term dependency tasks more easily and achieve better generalization than vanilla recurrent neural networks (RNN). We suggest that memory augmented neural networks can reduce the ef…

2017-01-30abs ↗pdf ↗

In an end-to-end dialog system, the aim of dialog state tracking is to accurately estimate a compact representation of the current dialog status from a sequence of noisy observations produced by the speech recognition and the natural language understanding modules. This paper introduces a novel method of dialog state t…

2016-06-13abs ↗pdf ↗

The ability to use a 2D map to navigate a complex 3D environment is quite remarkable, and even difficult for many humans. Localization and navigation is also an important problem in domains such as robotics, and has recently become a focus of the deep reinforcement learning community. In this paper we teach a reinforce…

2017-11-20abs ↗pdf ↗

Interpretable machine learning tackles the important problem that humans cannot understand the behaviors of complex machine learning models and how these models arrive at a particular decision. Although many approaches have been proposed, a comprehensive understanding of the achievements and challenges is still lacking…

2018-07-31abs ↗pdf ↗

Multi-hop inference is necessary for machine learning systems to successfully solve tasks such as Recognising Textual Entailment and Machine Reading. In this work, we demonstrate the effectiveness of adaptive computation for learning the number of inference steps required for examples of different complexity and that l…

2016-10-24abs ↗pdf ↗

Dead-Direction Signatures (DDS) provide a cheap, closed-form spectral reading of a network's singular complexity.

problem Estimating the complexity of deep networks through their loss singularities.
method DDS replaces the SGLD posterior chain with spectral linear algebra.
result DDS observables rank-track the network's singular complexity at the framework-predicted sign.

Paper compares ML models for a wall-following robot, achieving high accuracy.

problem Improving prediction accuracy of a wall-following robot's direction.
method Trained various machine learning models on a dataset of ultrasound sensor readings.
result Presented machine learning models with higher accuracy than previous work.

Recurrent Neural Networks (RNN) are a type of statistical model designed to handle sequential data. The model reads a sequence one symbol at a time. Each symbol is processed based on information collected from the previous symbols. With existing RNN architectures, each symbol is processed using only information from th…

2017-03-03abs ↗pdf ↗

A novel observer-based method detects and recovers anomalies in CAV sensor readings.

problem Improving safety and security in connected and automated vehicles.
method Combines model-based signal filtering and anomaly detection methods using AEKF and OCSVM.
result The proposed method achieves better anomaly detection performance compared to traditional methods.

META2^\mathbf{2} improves taxonomic classification and abundance estimation in metagenomics with deep learning and memory efficiency.

problem Memory constraints and inefficiencies in taxonomic classification and abundance estimation for metagenomics.
method Developed a novel memory-efficient read classification technique combining deep learning and locality-sensitive hashing, and formulated abundance estimation as a Multiple Instance Learning problem.
result Our approach outperforms conventional methods in both single-read taxonomic classification and abundance estimation, especially when memory is limited.

Shannon's mathematical theory of communication defines fundamental limits on how much information can be transmitted between the different components of any man-made or biological system. This paper is an informal but rigorous introduction to the main ideas implicit in Shannon's theory. An annotated reading list is pro…

2018-02-16abs ↗pdf ↗