A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
The brain optimizes memory by forgetting what's predictable, improving generalization.
Technological progress is leading to proliferation and diversification of trading venues, thus increasing the relevance of the long-standing question of market fragmentation versus consolidation. To address this issue quantitatively, we analyse systems of adaptive traders that choose where to trade based on their previ…
We discuss memory models which are based on tensor decompositions using latent representations of entities and events. We show how episodic memory and semantic memory can be realized and discuss how new memory traces can be generated from sensory input: Existing memories are the basis for perception and new memories ar…
Proposes a CL technique to improve accuracy and reduce forgetting.
Our research is focused on understanding and applying biological memory transfers to new AI systems that can fundamentally improve their performance, throughout their fielded lifetime experience. We leverage current understanding of biological memory transfer to arrive at AI algorithms for memory consolidation and repl…
Analyzes self-attention in recurrent networks, proving it mitigates vanishing gradients.
TMNs model brain memory systems for continual learning.
Artificial neural networks face the well-known problem of catastrophic forgetting. What's worse, the degradation of previously learned skills becomes more severe as the task sequence increases, known as the long-term catastrophic forgetting. It is due to two facts: first, as the model learns more tasks, the intersectio…
New method improves ABI for sequential data, reducing forgetting and improving accuracy.
SPARC improves continual learning with minimal memory and computational overhead.
Sequential learning of tasks using gradient descent leads to an unremitting decline in the accuracy of tasks for which training data is no longer available, termed catastrophic forgetting. Generative models have been explored as a means to approximate the distribution of old tasks and bypass storage of real data. Here …
PARMESAN learns from memory without parameters for fast, efficient continual learning.
Online reinforcement learning agents are currently able to process an increasing amount of data by converting it into a higher order value functions. This expansion of the information collected from the environment increases the agent's state space enabling it to scale up to a more complex problems but also increases t…
This research proposes a CL model for RNNs to handle sequential data without forgetting.
Personalized predictive medicine necessitates the modeling of patient illness and care processes, which inherently have long-term temporal dependencies. Healthcare observations, recorded in electronic medical records, are episodic and irregular in time. We introduce DeepCare, an end-to-end deep dynamic neural network t…
Unified framework for adaptive learning systems using consolidation and expansion operations.
EVCL combines VCL and EWC to prevent forgetting new tasks.
EWC helps prevent forgetting in neural networks by adjusting weights dynamically.
A model retains learned knowledge for longer by adding a plastic component to neural networks.
Intelligence emerges from stabilizing invariant cycles in memory.
A federated model learns shared archetypes from heterogeneous clients in continual learning.
Algorithm improves model performance on shifted concepts without retraining.
Collecting the large datasets needed to train deep neural networks can be very difficult, particularly for the many applications for which sharing and pooling data is complicated by practical, ethical, or legal concerns. However, it may be the case that derivative datasets or predictive models developed within individu…
Sequential learning of multiple tasks in artificial neural networks using gradient descent leads to catastrophic forgetting, whereby previously learned knowledge is erased during learning of new, disjoint knowledge. Here, we propose a new approach to sequential learning which leverages the recent discovery of adversari…
Study evaluates CL methods in RNNs, highlighting differences from feedforward networks.
Paper tackles catastrophic forgetting in sequential learning.
Humans and animals have the ability to continually acquire, fine-tune, and transfer knowledge and skills throughout their lifespan. This ability, referred to as lifelong learning, is mediated by a rich set of neurocognitive mechanisms that together contribute to the development and specialization of our sensorimotor sk…
Dual representations for robust risk measures and uncertainty sets.
Elastic weight consolidation (EWC, Kirkpatrick et al, 2017) is a novel algorithm designed to safeguard against catastrophic forgetting in neural networks. EWC can be seen as an approximation to Laplace propagation (Eskin et al, 2004), and this view is consistent with the motivation given by Kirkpatrick et al (2017). In…
FedFMC improves federated learning on non-iid data without sharing data or increasing communication costs.
Paper uses AI to predict stock market volatility with neural networks and genetic algorithms.
Class incremental learning refers to a special multi-class classification task, in which the number of classes is not fixed but is increasing with the continual arrival of new data. Existing researches mainly focused on solving catastrophic forgetting problem in class incremental learning. To this end, however, these m…
Blog post discusses various implementations of Fisher Information for EWC in continual learning.
This paper consists of two parts. The first part is devoted to empirical analysis of consolidated order book (COB) for the index RTS futures. In the second part we consider Poissonian multi--agent model of the COB. By varying parameters of different groups of agents submitting orders to the book we are able to model va…
Convolutional neural networks (CNNs) have been successfully employed in recent years for the detection of radiological abnormalities in medical images such as plain x-rays. To date, most studies use CNNs on individual examinations in isolation and discard previously available clinical information. In this study we set …
We propose a method for tackling catastrophic forgetting in deep reinforcement learning that is \textit{agnostic} to the timescale of changes in the distribution of experiences, does not require knowledge of task boundaries, and can adapt in \textit{continuously} changing environments. In our \textit{policy consolidati…
The majority of ML research concerns slow, statistical learning of i.i.d. samples from large, labelled datasets. Animals do not learn this way. An enviable characteristic of animal learning is `episodic' learning - the ability to memorise a specific experience as a composition of existing concepts, after just one exper…
Model shows how multiple markets can coexist or fragment based on trader behavior.
Proposes a framework for semi-supervised continual learning from sequentially arriving data.
Humans do not acquire perceptual abilities in the way we train machines. While machine learning algorithms typically operate on large collections of randomly-chosen, explicitly-labeled examples, human acquisition relies more heavily on multimodal unsupervised learning (as infants) and active learning (as children). Wit…
Sleep-based regularization stabilizes STDP in recurrent neural networks.
We propose a network independent, hand-held system to translate and disambiguate foreign restaurant menu items in real-time. The system is based on the use of a portable multimedia device, such as a smartphones or a PDA. An accurate and fast translation is obtained using a Machine Translation engine and a context-speci…
The 2008 financial crisis revealed banking consolidation paradoxically increased systemic fragility and global financial contagion with negligible spatial decay.
Both the scientific community and the popular press have paid much attention to the speed of the Securities Information Processor, the data feed consolidating all trades and quotes across the US stock market. Rather than the speed of the Securities Information Processor, or SIP, we focus here on its accuracy. Relying o…
This paper investigates the relevance of the No-Ponzi game condition for public debt (i.e. the public debt growth rate has to be lower than the real interest rate, a necessary assumption for Ricardian equivalence) and of the transversality condition for the GDP growth rate (i.e. the GDP growth rate has to be lower than…
Under Solvency II the computation of capital requirements is based on value at risk (V@R). V@R is a quantile-based risk measure and neglects extreme risks in the tail. V@R belongs to the family of distortion risk measures. A serious deficiency of V@R is that firms can hide their total downside risk in corporate network…
Paper benchmarks CF mitigation in federated time series forecasting.
Unified understanding of three continual learning regularisation methods.