A simple approach improves performance on both past and future tasks in lifelong learning.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Framework for lifelong learning using eigentasks to avoid forgetting and transfer knowledge.
Develops hyperparameter transfer methods for Dense Associative Memories.
Enhances PCE surrogates using transfer learning for expensive simulations.
Current reinforcement learning (RL) methods can successfully learn single tasks but often generalize poorly to modest perturbations in task domain or training procedure. In this work, we present a decoupled learning strategy for RL that creates a shared representation space where knowledge can be robustly transferred. …
End-to-end optimization has achieved state-of-the-art performance on many specific problems, but there is no straight-forward way to combine pretrained models for new problems. Here, we explore improving modularity by learning a post-hoc interface between two existing models to solve a new task. Specifically, we take i…
Enhances investment performance by leveraging cross-market information.
Transferring knowledge across many streaming processes remains an uncharted territory in the existing literature and features unique characteristics: no labelled instance of the target domain, covariate shift of source and target domain, different period of drifts in the source and target domains. Autonomous transfer l…
Forward hedging reshapes incentive provision in firms.
A new method estimates generative model mappings using kernel transfer operators, reducing costs and improving performance.
New method creates powerful, transferable adversarial attacks for deep learning networks.
The growing use of Machine Learning has produced significant advances in many fields. For image-based tasks, however, the use of deep learning remains challenging in small datasets. In this article, we review, evaluate and compare the current state-of-the-art techniques in training neural networks to elucidate which te…
Extended flatness approach for discrete-time systems considers forward and backward shifts.
The introduction of deep learning and transfer learning techniques in fields such as computer vision allowed a leap forward in the accuracy of image classification tasks. Currently there is only limited use of such techniques in neuroscience. The challenge of using deep learning methods to successfully train models in …
Recently, there has been great interest in the field of audio style transfer, where a stylized audio is generated by imposing the style of a reference audio on the content of a target audio. We improve on the current approaches which use neural networks to extract the content and the style of the audio signal and propo…
Humans can learn a variety of concepts and skills incrementally over the course of their lives while exhibiting many desirable properties, such as continual learning without forgetting, forward transfer and backward transfer of knowledge, and learning a new concept or task with only a few examples. Several lines of mac…
Transfer learning methods for reinforcement learning (RL) domains facilitate the acquisition of new skills using previously acquired knowledge. The vast majority of existing approaches assume that the agents have the same design, e.g. same shape and action spaces. In this paper we address the problem of transferring pr…
Injecting human knowledge is an effective way to accelerate reinforcement learning (RL). However, these methods are underexplored. This paper presents our discovery that an abstract forward model (thought-game (TG)) combined with transfer learning (TL) is an effective way. We take StarCraft II as our study environment.…
Training generative adversarial networks (GANs) on high quality (HQ) images involves important computing resources. This requirement represents a bottleneck for the development of applications of GANs. We propose a transfer learning technique for GANs that significantly reduces training time. Our approach consists of f…
Geotechnics adopts data-driven methods from materials informatics.
Deep learning benchmarks ECG analysis with strong performance.
Paper introduces a new value function for state transitions and optimal policy learning.
Unified framework predicts S&P500 index direction using transfer learning and causal graph.
Proposes a new method to learn representations directly optimized for a task.
This paper presents a novel Inter Catchment Wastewater Transfer (ICWT) method for mitigating sewer overflow. The ICWT aims at balancing the spatial mismatch of sewer flow and treatment capacity of Wastewater Treatment Plant (WWTP), through collaborative operation of sewer system facilities. Using a hydraulic model, the…
Generative AI improves surrogate models by blending LF and HF data.
New method discovers concepts in hidden feature layers using sparse subspace clustering.
Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which only a few labeled samples are available. As deep neural networks (DNNs) tend to…
We investigate the existence of affine realizations for Lévy driven interest rate term structure models under the real-world probability measure, which so far has only been studied under an assumed risk-neutral probability measure. For models driven by Wiener processes, all results obtained under the risk-neutral appro…
A hybrid physics-ML model predicts FO water flux with high accuracy and uncertainty quantification.
New optimizers control network width scaling, improving stability and transfer across different model sizes.
Improves memory efficiency for meta-learning with large images.
Artificial neural networks suffer from catastrophic forgetting when they are sequentially trained on multiple tasks. To overcome this problem, we present a novel approach based on task-conditioned hypernetworks, i.e., networks that generate the weights of a target model based on task identity. Continual learning (CL) i…
We consider the problem of building a state representation model in a continual fashion. As the environment changes, the aim is to efficiently compress the sensory state's information without losing past knowledge. The learned features are then fed to a Reinforcement Learning algorithm to learn a policy. We propose to …
In the continual learning setting, tasks are encountered sequentially. The goal is to learn whilst i) avoiding catastrophic forgetting, ii) efficiently using model capacity, and iii) employing forward and backward transfer learning. In this paper, we explore how the Variational Continual Learning (VCL) framework achiev…
A novel ABC method for high-dimensional inverse problems using generative modeling and subset simulation.
Survey of methods to train deep architectures without E2EBP.
In this paper we apply change of numeraire techniques to the optimal transport approach for computing model-free prices of derivatives in a two periods model. In particular, we consider the optimal transport plan constructed in \cite{HobsonKlimmek2013} as well as the one introduced in \cite{BeiglJuil} and further studi…
Discrete-time systems can be characterized by simple flat coordinates and their shifts.
Publicly pretraining models on Web data may undermine differential privacy.
Transfer learning improves portfolio optimization by identifying transfer risk.
Survey on reducing deep neural network training complexity.
Paper analyzes transfer risk in transfer learning for finance.
This paper explores the connection between adversarial and knowledge transferability.
Mathematical framework for transfer learning feasibility and transfer risk.
It has been suggested that adversarial examples cause deep learning models to make incorrect predictions with high confidence. In this work, we take the opposite stance: an overly confident model is more likely to be vulnerable to adversarial examples. This work is one of the most proactive approaches taken to date, as…
Transfer learning borrows knowledge from a source domain to facilitate learning in a target domain. Two primary issues to be addressed in transfer learning are what and how to transfer. For a pair of domains, adopting different transfer learning algorithms results in different knowledge transferred between them. To dis…
New method for dynamic valuation in markets with random endowments.