Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

3875113150 · Jun 202019922001200920172026
48 results for associative recall

Transformers can store facts efficiently using associative memories.

problem Understanding how transformers store and recall factual information.
method Proved linear scaling of storage capacities for linear and MLP associative memories, introduced a synthetic task, and analyzed gradient flow.
result Shallow transformers can achieve near optimal storage capacity for factual recall tasks using associative memories.

LLMs can be tricked into recalling facts based on context clues.

problem Manipulation of LLMs' factual recall through context changes.
method Mathematical exploration of transformers' associative memory properties.
result Transformers use self-attention and value matrix for associative memory.

Unified framework for sequence models using test-time regression.

problem Designing efficient sequence models with associative memory.
method Formalizing associative recall as regression over input tokens, deriving various sequence models.
result Clarifies the effectiveness of query-key normalization in softmax attention and offers new generalizations.

Transformers recall from long distributions with statistical guarantees.

problem Designing Transformers that can recall from arbitrarily long, distributional contexts.
method Recast associative memory as probability measures, decomposing the task into recall and prediction.
result A shallow measure-theoretic Transformer learns the recall-and-predict map under spectral assumptions.

KATA improves associative recall by optimizing feature maps derived from nonnegative attention weights.

problem Linear attention's poor performance on associative recall tasks.
method Formulates attention recall as a spherical-packing problem and introduces Kernelized Linear Attention Activations (KATA).
result KATA features offer a favorable capacity-interference tradeoff, enabling efficient associative recall.

An associative memory is a framework of content-addressable memory that stores a collection of message vectors (or a dataset) over a neural network while enabling a neurally feasible mechanism to recover any message in the dataset from its noisy version. Designing an associative memory requires addressing two main task…

2016-11-29abs ↗pdf ↗

Paper proposes a human-algorithm approach to reduce medical device recall risk and workload.

problem High recall rate and regulatory workload in FDA's 510(k) pathway.
method Developed machine learning models to estimate recall risk and proposed a data-driven clearance policy.
result Conservative evaluation of policy shows a 32.9% improvement in recall rate and 40.5% reduction in workload.

In this paper we study unitary braid group representations associated with Majorana Fermions. Majorana Fermions are represented by Majorana operators, elements of a Clifford algebra. The paper recalls and proves a general result about braid group representations associated with Clifford algebras, and compares this resu…

2017-10-12abs ↗pdf ↗

Sharp limits found for storing and retrieving input-output associations in linear associative memories.

problem Understanding the fundamental limits of storing and retrieving input-output associations in neural networks.
method Study of a minimal linear associative memory model, introducing a decoupled model and using statistical physics to characterize storage capacity.
result Linear associative memory can store up to 1/2 log(p) associations, providing a sharp statistical-physics characterization.

This paper introduces a new method to train normalizing flows using precision-recall divergences.

problem Training generative models with mode dropping and low-quality samples.
method Introduces PR-divergences and proposes a novel generative model to minimize precision-recall trade-offs.
result Normalizing flows can be trained to achieve specific precision-recall trade-offs using PR-divergences.

The Levine-Tristram signature associates to each oriented link LL in S3S^3 a function σL ⁣:S1Z.σ_L \colon S^1 \to \mathbb{Z}. This invariant can be defined in a variety of ways, and its numerous applications include the study of unlinking numbers and link concordance. In this survey, we recall the three and four dimensional …

2019-03-11abs ↗pdf ↗

We recall the definitions of two independently defined elliptic versions of the Kashiwara-Vergne Lie algebra krv\frak{krv}, namely the Lie algebra krv(1,1)\frak{krv}^{(1,1)} constructed by A.Alekseev, N.Kawazumi, Y.Kuno and F.Naef arising from the study of graded formality isomorphisms associated to topological fundamental gr…

2018-09-25abs ↗pdf ↗

The study formalizes temporal precision and recall for anomaly detection in sequences.

problem Insufficient understanding of precision and recall in sequential anomaly detection.
method Formalized temporal precision and recall measures, developed time-tolerant confusion matrices, and demonstrated statistical significance.
result Precision and recall may overestimate performance with temporal tolerance.

In this paper we consider the Poisson algebraic structure associated with a classical rr-matrix, i.e. with a solution of the modified classical Yang--Baxter equation. In Section 1 we recall the concept and basic facts of the rr-matrix type Poisson orbits. Then we describe the rr-matrix Poisson pencil (i.e the pair o…

1998-12-25abs ↗pdf ↗

Recurrent correlation neural networks (RCNNs), introduced by Chiueh and Goodman as an improved version of the bipolar correlation-based Hopfield neural network, can be used to implement high-capacity associative memories. In this paper, we extend the bipolar RCNNs for processing hypercomplex-valued data. Precisely, we …

2020-01-31abs ↗pdf ↗

In predictive maintenance, model performance is usually assessed by means of precision, recall, and F1-score. However, employing the model with best performance, e.g. highest F1-score, does not necessarily result in minimum maintenance cost, but can instead lead to additional expenses. Thus, we propose to perform model…

2018-09-28abs ↗pdf ↗

LLMs can memorize economic data and recall exact values before their training cutoff.

problem Evaluating the trustworthiness of LLMs' economic forecasts during their training period.
method Demonstrated through counterfactual forecasting and analysis of LLMs' recall ability.
result LLMs have memorized economic and financial data, leading to recall-level accuracy before their knowledge cutoff.

Paper tackles imbalanced binary classification by optimizing precision and recall directly.

problem Imbalanced binary classification where standard accuracy is misleading.
method Exact constrained reformulations for precision and recall optimization.
result ERO framework outperforms state-of-the-art methods on multiple datasets.

RAGuard improves safety in LLMs for offshore wind maintenance.

problem Conventional LLMs fail with specialised or unexpected scenarios in offshore wind maintenance.
method Integrates safety-critical documents alongside technical manuals in RAG framework.
result RAGuard increases safety recall from almost 0% to over 50% while maintaining technical recall above 60%.

Framework for precise recall control in spatial conflation tasks.

problem Precise recall control in large-scale spatial conflation tasks to avoid downstream analytics failures and excessive manual review.
method End-to-end framework using equigrid bounding-box filter, CSR representation, neural ranker, and inverse-variance weighted ensemble of threshold estimators.
result Achieves exact recall with sub-percent variance over tens of millions of geometry pairs, runs on a single TPU v3 core.

A new method for generating replay samples on the fly, optimizing for not forgetting.

problem Addressing the issue of forgetting in neural networks.
method Generates auxiliary samples on the fly using the model's implicit memory, specialized to each real training batch.
result Optimizing for not forgetting leads to more efficient and scalable generation of specialized samples.

Generative diffusion models mimic biological memory networks, encoding associative dynamics in deep neural weights.

problem Understanding long-term memory mechanisms in neuroscience and AI.
method Interpreting generative diffusion models as energy-based models and comparing them to Hopfield networks.
result Generative diffusion models can encode associative dynamics of Hopfield networks in deep neural weights.

The paper critiques and expands on common evaluation metrics in machine learning.

problem The common evaluation metrics like Precision, Recall, F-Measure, and Rand Accuracy are biased and misleading.
method The paper introduces new measures like Informedness, Markedness, and Correlation to better reflect the quality of predictions.
result A system that performs worse in terms of Informedness can appear better using common measures like Precision and Recall.

In a series of papers the authors associated to an L2L^2-acyclic group ΓΓ an invariant P(Γ)\mathcal{P}(Γ) that is a formal difference of polytopes in the vector space H1(Γ;R)H_1(Γ;\Bbb{R}). This invariant is in particular defined for most 3-manifold groups, for most 2-generator 1-relator groups and for all free-by-cyclic gro…

2016-11-06abs ↗pdf ↗

The aim of this paper is fourfold. Firstly, we introduce and study the f-ultra-harmonic maps. Secondly, we recall the geometric dynamics generated by a first order normal PDE system and we give original results regarding the geometric dynamics generated by other first order PDE systems. Thirdly, we determine the Gauss …

2011-10-13abs ↗pdf ↗

New findings show tool-augmented models can recall unlimited facts, outperforming purely memorized models.

problem Limitations of purely memorized models in recalling large amounts of factual information.
method Demonstrated the benefits of in-tool learning (external retrieval) over in-weight learning (memorization) for factual recall.
result Proved that tool-use enables unbounded factual recall via a simple and efficient circuit construction.

We prove a Theorem on homotheties between two given tangent sphere bundles SrMS_rM of a Riemannian manifold M,gM,g of dim3\dim\geq 3, assuming different variable radius functions rr and weighted Sasaki metrics induced by the conformal class of gg. New examples are shown of manifolds with constant positive or with constan…

2010-12-19abs ↗pdf ↗

We study a monetary version of the Keen model by merging two alternative extensions, namely the addition of a dynamic price level and the introduction of speculation. We recall and study old and new equilibria, together with their local stability analysis. This includes a state of recession associated with a deflationa…

2014-12-23abs ↗pdf ↗

The optimal ranking score between precision and recall is rarely F1 and can be found using specific methods.

problem Finding a meaningful and optimal compromise between precision and recall scores.
method Established a shortest path between precision- and recall-induced rankings, framed the problem as an optimization problem, and provided theoretical tools to find the optimal β.
result F1 and its skew-insensitive version are not optimal tradeoffs between precision and recall scores.

DIAL learns embeddings to maximize recall and accuracy for entity resolution.

problem Low resource settings for entity resolution with large Cartesian product search space.
method DIAL uses an Index-By-Committee framework with pre-trained transformer language models to jointly learn embeddings for recall and accuracy.
result DIAL achieves high precision, recall, and efficiency on benchmark datasets.

We prove an extension of Basmajian's identity to nn-Hitchin representations of compact bordered surfaces. For n=3n=3, we show that this identity has a geometric interpretation for convex real projective structures analogous to Basmajian's original result. As part of our proof, we demonstrate that, with respect to the L…

2015-04-02abs ↗pdf ↗