Transformers can store facts efficiently using associative memories.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
LLMs can be tricked into recalling facts based on context clues.
Unified framework for sequence models using test-time regression.
Transformers recall from long distributions with statistical guarantees.
KATA improves associative recall by optimizing feature maps derived from nonnegative attention weights.
An associative memory is a framework of content-addressable memory that stores a collection of message vectors (or a dataset) over a neural network while enabling a neurally feasible mechanism to recover any message in the dataset from its noisy version. Designing an associative memory requires addressing two main task…
We recall the construction of non-formal deformation quantization of the Poincare Group ISO(1,1) on its coadjoint orbit and exhibit the associated non-formal star-exponentials.
Paper proposes a human-algorithm approach to reduce medical device recall risk and workload.
Evaluation often aims to reduce the correctness or error characteristics of a system down to a single number, but that always involves trade-offs. Another way of dealing with this is to quote two numbers, such as Recall and Precision, or Sensitivity and Specificity. But it can also be useful to see more than this, and …
In this paper we study unitary braid group representations associated with Majorana Fermions. Majorana Fermions are represented by Majorana operators, elements of a Clifford algebra. The paper recalls and proves a general result about braid group representations associated with Clifford algebras, and compares this resu…
Recall assistance methods are among the key aspects that improve the accuracy of online dietary assessment surveys. These methods still mainly rely on experience of trained interviewers with nutritional background, but data driven approaches could improve cost-efficiency and scalability of automated dietary assessment.…
Sharp limits found for storing and retrieving input-output associations in linear associative memories.
New algorithm reduces online learning regret for bounded recall games.
This paper introduces a new method to train normalizing flows using precision-recall divergences.
We recall a construction of Mackaay, Pan and Tubbenhauer of the algebras which allow to understand the homology for links in a local way (i.e. for tangles). Then, by studying the combinatorics of the Kuperberg bracket, we give a large family of non-elliptic webs whose associated projective -modules ar…
The study examines how class imbalance affects precision-recall curves.
The Levine-Tristram signature associates to each oriented link in a function This invariant can be defined in a variety of ways, and its numerous applications include the study of unlinking numbers and link concordance. In this survey, we recall the three and four dimensional …
We recall the definitions of two independently defined elliptic versions of the Kashiwara-Vergne Lie algebra , namely the Lie algebra constructed by A.Alekseev, N.Kawazumi, Y.Kuno and F.Naef arising from the study of graded formality isomorphisms associated to topological fundamental gr…
The study formalizes temporal precision and recall for anomaly detection in sequences.
For information retrieval and binary classification, we show that precision at the top (or precision at k) and recall at the top (or recall at k) are maximised by thresholding the posterior probability of the positive class. This finding is a consequence of a result on constrained minimisation of the cost-sensitive exp…
Unified and extended precision-recall metrics for generative models.
In this paper we consider the Poisson algebraic structure associated with a classical -matrix, i.e. with a solution of the modified classical Yang--Baxter equation. In Section 1 we recall the concept and basic facts of the -matrix type Poisson orbits. Then we describe the -matrix Poisson pencil (i.e the pair o…
Recurrent correlation neural networks (RCNNs), introduced by Chiueh and Goodman as an improved version of the bipolar correlation-based Hopfield neural network, can be used to implement high-capacity associative memories. In this paper, we extend the bipolar RCNNs for processing hypercomplex-valued data. Precisely, we …
In predictive maintenance, model performance is usually assessed by means of precision, recall, and F1-score. However, employing the model with best performance, e.g. highest F1-score, does not necessarily result in minimum maintenance cost, but can instead lead to additional expenses. Thus, we propose to perform model…
Recalls intrinsically harmonic forms and open problems.
LLMs can memorize economic data and recall exact values before their training cutoff.
Paper tackles imbalanced binary classification by optimizing precision and recall directly.
In this article we revisit the definition of Precision-Recall (PR) curves for generative models proposed by Sajjadi et al. (arXiv:1806.00035). Rather than providing a scalar for generative quality, PR curves distinguish mode-collapse (poor recall) and bad quality (poor precision). We first generalize their formulation …
RAGuard improves safety in LLMs for offshore wind maintenance.
Framework for precise recall control in spatial conflation tasks.
A new method for generating replay samples on the fly, optimizing for not forgetting.
In this paper, we have proposed a brain signal classification method, which uses eigenvalues of the covariance matrix as features to classify images (topomaps) created from the brain signals. The signals are recorded during the answering of 2D and 3D questions. The system is used to classify the correct and incorrect a…
Proposes a new tree-based algorithm for class-imbalanced data.
Generative diffusion models mimic biological memory networks, encoding associative dynamics in deep neural weights.
The paper critiques and expands on common evaluation metrics in machine learning.
In a series of papers the authors associated to an -acyclic group an invariant that is a formal difference of polytopes in the vector space . This invariant is in particular defined for most 3-manifold groups, for most 2-generator 1-relator groups and for all free-by-cyclic gro…
Most approaches to machine learning from electronic health data can only predict a single endpoint. Here, we present an alternative that uses unsupervised deep learning to simulate detailed patient trajectories. We use data comprising 18-month trajectories of 44 clinical variables from 1908 patients with Mild Cognitive…
The aim of this paper is fourfold. Firstly, we introduce and study the f-ultra-harmonic maps. Secondly, we recall the geometric dynamics generated by a first order normal PDE system and we give original results regarding the geometric dynamics generated by other first order PDE systems. Thirdly, we determine the Gauss …
Interpreting neural network decisions and the information learned in intermediate layers is still a challenge due to the opaque internal state and shared non-linear interactions. Although (Kim et al, 2017) proposed to interpret intermediate layers by quantifying its ability to distinguish a user-defined concept (from r…
New findings show tool-augmented models can recall unlimited facts, outperforming purely memorized models.
We prove a Theorem on homotheties between two given tangent sphere bundles of a Riemannian manifold of , assuming different variable radius functions and weighted Sasaki metrics induced by the conformal class of . New examples are shown of manifolds with constant positive or with constan…
We study a monetary version of the Keen model by merging two alternative extensions, namely the addition of a dynamic price level and the introduction of speculation. We recall and study old and new equilibria, together with their local stability analysis. This includes a state of recession associated with a deflationa…
The optimal ranking score between precision and recall is rarely F1 and can be found using specific methods.
We study the effectiveness of several techniques to personalize end-to-end speech models and improve the recognition of proper names relevant to the user. These techniques differ in the amounts of user effort required to provide supervision, and are evaluated on how they impact speech recognition performance. We propos…
Recalls and refines the concept of algebraically rectifiable curves.
DIAL learns embeddings to maximize recall and accuracy for entity resolution.
Let be an open subset of a Stein manifold and let be its boundary. It is well known that inherits a natural contact structure. In this paper we consider a family of variational functionals defined by the sum of two terms: a Dirichlet-type energy associated with a sub-Riemannian structure…
We prove an extension of Basmajian's identity to -Hitchin representations of compact bordered surfaces. For , we show that this identity has a geometric interpretation for convex real projective structures analogous to Basmajian's original result. As part of our proof, we demonstrate that, with respect to the L…