A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Exogenous state variables and rewards can slow down reinforcement learning by injecting uncontrolled variation into the reward signal. We formalize exogenous state variables and rewards and identify conditions under which an MDP with exogenous state can be decomposed into an exogenous Markov Reward Process involving on…
The paper tackles reinforcement learning with exogenous variables and rewards.
problem Exogenous state variables and rewards slow reinforcement learning by introducing uncontrolled variation.
method Formalizes exogenous state variables and rewards, decomposes MDP into exogenous and endogenous components, and introduces algorithms to discover these components.
result Optimal policies for the endogenous MDP are also optimal for the original MDP, but the endogenous MDP is easier to solve due to reduced variance.
In stochastic control problems delicate issues arise when the controlled system can jump due to both exogenous shocks and endogenous controls. Here one has to specify what the controller knows when about the exogenous shocks and how and when she can act on this information. We propose to use Meyer-σ-fields as a flexi…
Reinforcement learning (RL) constitutes a promising solution for alleviating the problem of traffic congestion. In particular, deep RL algorithms have been shown to produce adaptive traffic signal controllers that outperform conventional systems. However, in order to be reliable in highly dynamic urban areas, such cont…
This paper improves parameter estimation for autonomous systems with unmodeled dynamics.
problem Accurate parameter estimation for risk-aware autonomous systems with unmodeled dynamics.
method Spectral lines-based approach for estimating parameters of dynamic models, allowing deterministic unmodeled dynamics.
result The proposed method leads to non-asymptotic bounds on parameter estimation error, robust to unmodeled dynamics, and matches existing literature in ideal conditions.
This paper relaxes the common prior assumption in the public and private information game of Morris and Shin (2000, 2004). For the generalized game, where the agent's prior expectations are heterogenous, it derives a sharp condition for the emergence of unique/multiple equilibria. This condition indicates that unique e…
A growing part of the behavioral finance literature has addressed some of the stylized facts of financial time series as macroscopic patterns emerging from herding interactions among groups of agents with heterogeneous trading strategies and a limited rationality. We extend a stochastic herding formalism introduced for…
Signals coming from multivariate higher order conditional moments as well as the information contained in exogenous covariates, can be effectively exploited by rational investors to allocate their wealth among different risky investment opportunities. This paper proposes a new flexible dynamic copula model being able t…
Demand response is designed to motivate electricity customers to modify their loads at critical time periods. The accurate estimation of impact of demand response signals to customers' consumption is central to any successful program. In practice, learning these response is nontrivial because operators can only send a …
We address microscopic, agent based, and macroscopic, stochastic, modeling of the financial markets combining it with the exogenous noise. The interplay between the endogenous dynamics of agents and the exogenous noise is the primary mechanism responsible for the observed long-range dependence and statistical propertie…
This paper extends a Kyle model to include price-responsive traders, revealing new dynamics and equilibria.
problem Real-world market dynamics involve price-responsive traders, affecting market equilibrium and insider profits.
method Developed a continuous-time Kyle model with two types of price-responsive traders (momentum and contrarian), leading to a forward-backward Riccati system for equilibrium.
result The model shows that feedback effects can lead to multiple equilibria and amplify price informativeness.
We focus on the influence of external sources of information upon financial markets. In particular, we develop a stochastic agent-based market model characterized by a certain herding behavior as well as allowing traders to be influenced by an external dynamic signal of information. This signal can be interpreted as a …
What is the role of social interactions in the creation of price bubbles? Answering this question requires obtaining collective behavioural traces generated by the activity of a large number of actors. Digital currencies offer a unique possibility to measure socio-economic signals from such digital traces. Here, we foc…
Time series prediction has been studied in a variety of domains. However, it is still challenging to predict future series given historical observations and past exogenous data. Existing methods either fail to consider the interactions among different components of exogenous variables which may affect the prediction ac…
The paper analyzes binary option markets with exogenous information and price sensitivity.
problem Analyzing binary option markets with exogenous information and price sensitivity.
method Derive and analyze a continuous model of binary option markets with exogenous information, using Filippov surfaces and general assumptions on purchasing rules.
result Price always converges when exogenous information is constant, and price sensitivity affects price lag vs. information.
Systems with long-range persistence and memory are shown to exhibit different precursory as well as recovery patterns in response to shocks of exogeneous versus endogeneous origins. By endogeneous, we envision either fluctuations resulting from an underlying chaotic dynamics or from a stochastic forcing origin which ma…
We consider the problem of identifying the causal direction between two discrete random variables using observational data. Unlike previous work, we keep the most general functional model but make an assumption on the unobserved exogenous variable: Inspired by Occam's razor, we assume that the exogenous variable is sim…
Study finds macroeconomic indicators predict health workforce and infrastructure measures.
problem Evaluating the predictive value of macroeconomic indicators for public health targets.
method Examined multiple forecasting approaches including neural networks, generalized additive models, random forests, and time series models with exogenous indicators.
result Macroeconomic indicators provide consistent and reproducible predictive signals for health workforce and infrastructure measures, but less so for other targets.
Many statistical methods have been proposed to estimate causal models in classical situations with fewer variables than observations (p<n, p: the number of variables and n: the number of observations). However, modern datasets including gene expression data need high-dimensional causal modeling in challenging situation…
We reverse engineer dynamics of financial contagion to find the scenario of smallest exogenous shock that, should it occur, would lead to a given final systemic loss. This reverse stress test can be used to identify the potential triggers of systemic events, and it removes the arbitrariness in the selection of shock sc…
This study defines a multivariate Self--Exciting Threshold Autoregressive with eXogenous input (MSETARX) models and present an estimation procedure for the parameters. The conditions for stationarity of the nonlinear MSETARX models is provided. In particular, the efficiency of an adaptive parameter estimation algorithm…
We present a simple model of a non-equilibrium self-organizing market where asset prices are partially driven by investment decisions of a bounded-rational agent. The agent acts in a stochastic market environment driven by various exogenous "alpha" signals, agent's own actions (via market impact), and noise. Unlike tra…
Incomplete financial markets are considered, defined by a multi-dimensional non-homogeneous diffusion process, being the direct sum of an Itô process (the price process), and another non-homogeneous diffusion process (the exogenous process, representing exogenous stochastic sources). The drift and the diffusion matrix …