Improves LSTM performance by initializing states via manifold learning.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
The past few decades has seen increased interest in the application of social robots to interventions for Autism Spectrum Disorder as behavioural coaches [4]. We consider that robots embedded in therapies could also provide quantitative diagnostic information by observing patient behaviours. The social nature of ASD sy…
Feedback improves ESN performance by 30-60% across various tasks.
Temporal abstraction refers to the ability of an agent to use behaviours of controllers which act for a limited, variable amount of time. The options framework describes such behaviours as consisting of a subset of states in which they can initiate, an internal policy and a stochastic termination condition. However, mu…
Relates two types of skein algebras using explicit correspondences.
Algorithm improves model performance on shifted concepts without retraining.
We consider the machine teaching problem in a classroom-like setting wherein the teacher has to deliver the same examples to a diverse group of students. Their diversity stems from differences in their initial internal states as well as their learning rates. We prove that a teacher with full knowledge about the learnin…
Given a smooth non-trapping compact manifold with strictly con- vex boundary, we consider an inverse problem of reconstructing the manifold from the scattering data initiated from internal sources. This data consist of the exit directions of geodesics that are emaneted from interior points of the manifold. We show that…
Reinforcement learning methods require careful design involving a reward function to obtain the desired action policy for a given task. In the absence of hand-crafted reward functions, prior work on the topic has proposed several methods for reward estimation by using expert state trajectories and action pairs. However…
Trade finance history traced from medieval origins to modern markets.
During the development of autonomous systems such as driverless cars, it is important to characterize the scenarios that are most likely to result in failure. Adaptive Stress Testing (AST) provides a way to search for the most-likely failure scenario as a Markov decision process (MDP). Our previous work used a deep rei…
State construction is important for learning in partially observable environments. A general purpose strategy for state construction is to learn the state update using a Recurrent Neural Network (RNN), which updates the internal state using the current internal state and the most recent observation. This internal state…
We develop an axiomatic theory of balance functions (future value functions) in the theory of interest that is derived from financial considerations and which applies to general regulated payment streams, including continuous payment streams. Balance functions exist and are unique up to an initial choice of deposit and…
Examines international taxation's impact on Georgian businesses.
Bayesian filtering approach identifies nonlinear restoring forces in dynamic systems.
Study examines grain futures connectedness during Russia-Ukraine conflict.
In complex tasks, such as those with large combinatorial action spaces, random exploration may be too inefficient to achieve meaningful learning progress. In this work, we use a curriculum of progressively growing action spaces to accelerate learning. We assume the environment is out of our control, but that the agent …
Recurrent neural networks (RNNs) are a vital modeling technique that rely on internal states learned indirectly by optimization of a supervised, unsupervised, or reinforcement training loss. RNNs are used to model dynamic processes that are characterized by underlying latent states whose form is often unknown, precludi…
We introduce defects, with internal gauge symmetries, on a knot and Seifert surface to a knot into the combinatorial construction of finite gauge-group Dijkgraaf-Witten theory. The appropriate initial data for the construction are certain three object categories, with coefficients satisfying a partially degenerate cocy…
Paper introduces OMD for ordered state transitions in SSMs.
The search for universal laws that help establish a relationship between dynamics and computation is driven by recent expansionist initiatives in biologically inspired computing. A general setting to understand both such dynamics and computation is a driven dynamical system that responds to a temporal input. Surprising…
The paper analyzes trade dynamics among G7 countries, revealing unequal exchange and degenerate equilibrium states.
Paper proves Jeffrey's update rule minimizes relative entropy.
This work proposes a novel neural network architecture, called the Dynamically Controlled Recurrent Neural Network (DCRNN), specifically designed to model dynamical systems that are governed by ordinary differential equations (ODEs). The current state vectors of these types of dynamical systems only depend on their sta…
The Basel II Accords have sparked increased interest in the development of approaches based on internal ratings systems and have initiated the elaboration of models for remote ratings forecasts based on external ones as part of Risk Management and Early Warning Systems. This article evaluates the peculiarities of curre…
The interpretation of deep learning models is a challenge due to their size, complexity, and often opaque internal state. In addition, many systems, such as image classifiers, operate on low-level features rather than high-level concepts. To address these challenges, we introduce Concept Activation Vectors (CAVs), whic…
Unfulfilled expectations from macro-economic initiatives during the Great Recession and the massive shift into globalization echo today with political upheaval, anti-establishment propaganda, and looming trade/currency wars that threaten domestic and international value chains. Once stable entities like the EU now look…
Echo state networks with random weights can approximate any continuous system.
This paper studies four trading algorithms of a professional trader at a multilateral trading facility, observing a realistic two-sided limit order book whose dynamics are driven by the order book events. The identity of the trader can be either internalizing or regular, either a hedge fund or a brokery agency. The spe…
LLMs struggle with zero-shot annotation tasks due to model-internalized priors.
While the authors of Batch Normalization (BN) identify and address an important problem involved in training deep networks-- Internal Covariate Shift-- the current solution has certain drawbacks. Specifically, BN depends on batch statistics for layerwise input normalization during training which makes the estimates of …
We present a broad agenda for meaningful banking regulation reform aiming the creation of evolutive competitive environment to maximize the effectiveness of international financial system through the introduction of fair competition process among the banks in free market capitalism. We assume that the international fin…
Bayesian model detects internal bleeding in ICU patients.
Researchers develop methods to learn neuron dynamics from colored noise.
Every year at the United Nations, member states deliver statements during the General Debate discussing major issues in world politics. These speeches provide invaluable information on governments' perspectives and preferences on a wide range of issues, but have largely been overlooked in the study of international pol…
A common assumption about neural networks is that they can learn an appropriate internal representations on their own, see e.g. end-to-end learning. In this work we challenge this assumption. We consider two simple tasks and show that the state-of-the-art training algorithm fails, although the model itself is able to r…
The main purpose of this study is to introduce a semi-classical model describing betting scenarios in which, at variance with conventional approaches, the payoff of the gambler is encoded into the internal degrees of freedom of a quantum memory element. In our scheme, we assume that the invested capital is explicitly a…
Decadal climate predictions, which are initialized with observed conditions, are characterized by two main sources of uncertainties--internal and model variabilities. Using an ensemble of climate model simulations from the CMIP5 decadal experiments, we quantified the total uncertainty associated with these predictions …
Machine learning is usually defined in behaviourist terms, where external validation is the primary mechanism of learning. In this paper, I argue for a more holistic interpretation in which finding more probable, efficient and abstract representations is as central to learning as performance. In other words, machine le…
New method shows hidden state can significantly improve differential privacy in SGD.
Complex behaviors are often driven by an internal model, which integrates sensory information over time and facilitates long-term planning. Inferring an agent's internal model is a crucial ingredient in social interactions (theory of mind), for imitation learning, and for interpreting neural activities of behaving agen…
Improved learning to reweight using deep interactions between student and teacher models.
Paper proposes ARPHMM for fault detection and prognosis in aero-engines.
Optimizes retirement income with MBGs and neural networks for longevity risk.
Helps visually impaired users make better decisions by adjusting their observations.
A new method generates natural-looking adversarial examples by bounding internal activation values.
Improves state space models' resistance to noise.
Study improves seasonal forecasts using deep learning.