Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

21426384 · Jun 202019922001200920172026
48 results for Endogenous Rewards

The paper tackles reinforcement learning with exogenous variables and rewards.

problem Exogenous state variables and rewards slow reinforcement learning by introducing uncontrolled variation.
method Formalizes exogenous state variables and rewards, decomposes MDP into exogenous and endogenous components, and introduces algorithms to discover these components.
result Optimal policies for the endogenous MDP are also optimal for the original MDP, but the endogenous MDP is easier to solve due to reduced variance.

The paper explores how mining costs, rewards, and blockchain security are interconnected.

problem Understanding the interdependencies between mining costs, mining rewards, and blockchain security.
method Theoretical derivation and empirical analysis using daily crypto market data and autoregressive distributed lag approach.
result Cryptocurrency price and mining rewards are intrinsically linked to blockchain security outcomes.

We study Exo-MDPs to reduce sample complexity in reinforcement learning.

problem Reducing sample complexity in reinforcement learning for structured MDPs.
method Introducing Exo-MDPs and proving structural equivalence to linear mixture MDPs, establishing regret bounds.
result Proved O(H3/2dK)O(H^{3/2}d\sqrt{K}) regret bound for Exo-MDPs, matching lower bounds.

Paper develops a new RL method for MDPs with uncertainty, achieving better regret bounds.

problem Online reinforcement learning in environments with both endogenous and exogenous uncertainty.
method Developed a VB-UCRL algorithm that restarts based on variation schedules.
result Established a regret bound of saving at most S\sqrt{S} or S16T112S^{\frac{1}{6}}T^{\frac{1}{12}}.

Existence of incomplete Radner equilibrium with endogenous noise tracker.

problem Existence of incomplete Radner equilibrium in a model with endogenous noise tracker.
method Proved existence through a coupled system of ODEs, reduced to two coupled ODEs.
result Endogenous noise tracker leads to higher aggregate welfare for large stock supply.

New findings allow infinite mean intensity Hawkes processes to be stable.

problem Stability condition for Hawkes processes with infinite mean intensity.
method Analysis of Quadratic Hawkes processes with infinite mean intensity.
result Quadratic Hawkes processes are always stationary with infinite mean intensity when total endogeneity ratio exceeds unity.

Systems with long-range persistence and memory are shown to exhibit different precursory as well as recovery patterns in response to shocks of exogeneous versus endogeneous origins. By endogeneous, we envision either fluctuations resulting from an underlying chaotic dynamics or from a stochastic forcing origin which ma…

2002-06-05abs ↗pdf ↗

This paper models financial contagion with endogenously determined market liquidity.

problem Financial contagion and its impact on market liquidity during price drops.
method Developed a joint clearing system for interbank payments, asset prices, and market liquidity, with endogenous market capacity.
result Endogenous market liquidity significantly affects system risk during financial contagion.

Endogenous business cycles explain higher comovement across countries.

problem Standard models struggle to explain high comovement in business cycles across countries.
method Developed a demand-driven reduced-form model with strategic complementarities and international trade linkages.
result Combining endogenous business cycles with exogenous shocks matches empirical comovement levels.

Study classifies stock price jumps as exogenous or endogenous using news data.

problem Differentiating between exogenous and endogenous price jumps.
method Synchronized news data with order book data to analyze stock price movements.
result Exogenous jumps are abrupt and follow a decaying power-law, while endogenous jumps are progressively accelerating.

New method tackles endogeneity in online learning with improved regret bounds.

problem Endogeneity in real data due to omitted variables, strategic behaviors, etc.
method O2SLS (Online Two-Stage Least Squares) for Instrumental Variable (IV) regression.
result O2SLS achieves identification and oracle regret bounds for stochastic online learning.

Finance is about how the continuous stream of news gets incorporated into prices. But not all news have the same impact. Can one distinguish the effects of the Sept. 11, 2001 attack or of the coup against Gorbachev on Aug., 19, 1991 from financial crashes such as Oct. 1987 as well as smaller volatility bursts? Using a …

2002-04-30abs ↗pdf ↗

A new boosting method corrects endogeneity bias in instrumental variable regression.

problem Endogeneity bias in instrumental variable regression.
method Causal Gradient Boosting (boostIV) that builds on gradient boosting algorithm.
result boostIV is consistent and performs well in finite samples compared to other methods.

Paper proposes a new model to assess risks in energy storage systems considering both exogenous and endogenous uncertainties.

problem Current risk assessment ignores the stochastic nature of energy storage availability.
method Data-driven unified model with exogenous and endogenous uncertainty description for four types of generic energy storage.
result Comparative results show more severe risks for endogenous uncertainty, suggesting new strategies for system operators.

Most real life systems have a random component: the multitude of endogenous and exogenous factors influencing them result in stochastic fluctuations of the parameters determining their dynamics. These empirical systems are in many cases subject to noise of multiplicative nature. The special properties of multiplicative…

2008-07-11abs ↗pdf ↗

We consider un-discounted reinforcement learning (RL) in Markov decision processes (MDPs) under temporal drifts, ie, both the reward and state transition distributions are allowed to evolve over time, as long as their respective total variations, quantified by suitable metrics, do not exceed certain variation budgets. …

2019-06-07abs ↗pdf ↗

We developed a novel statistical method to identify structural differences between networks characterized by structural equation models. We propose to reparameterize the model to separate the differential structures from common structures, and then design an algorithm with calibration and construction stages to identif…

2018-07-26abs ↗pdf ↗

We present a model that investigates the spontaneous emergence of randomness in equity market microstructure. The phase space analysis of our model exposes an endogenous source of fluctuation in price and volume. We formulate a control problem for maximizing price regularity and stability while minimizing entanglement …

2004-06-03abs ↗pdf ↗

The CAPM's market returns are endogenously determined, affecting all assets' expected returns.

problem The standard CAPM's market return assumption is not endogenously consistent.
method Demonstrates the impact of endogenously determined market returns on asset returns and the range of feasible market returns.
result Expected returns are influenced by all assets' risks, and market returns are limited by asset distribution.

Study reveals 2020 stock crashes were mostly endogenous, not exogenous.

problem Identifying the cause of the 2020 global stock market crash.
method Applied log-periodic power law singularity (LPPLS) methodology to analyze stock market indexes.
result The 2020 stock market crashes were mostly endogenous, driven by systemic instability.

Paper develops a new estimator for panel data with endogenous treatments, improving causal inference.

problem Challenges in causal inference for static panel data with endogenous treatments and confounding variables.
method Develops Double Machine Learning (DML) estimator for static panel models with endogenous treatments (panel IV DML). Introduces weak-identification diagnostics.
result Panel IV DML estimator improves estimation accuracy and delivers more reliable inference under weak identification.

New learning methods for open systems with variable agents.

problem Learning in open systems with dynamic agent arrivals and departures.
method Formulated a unified open-system bandit problem with general dynamics, introducing new concepts like pre-training degree and stability.
result Certified global-UCB learning methodologies with provable guarantees, revealing dependencies between entry uncertainty, stability, and agent patterns.

Survival strategies in a market with self-determined prices are closely tied to log-optimal investment.

problem Survival of wealth in a market with endogenous prices.
method Assume only one's actions affect prices, use log-optimal strategy, disregard actual prices.
result Survival strategies are asymptotically close to log-optimal strategies.

We perform an extended analysis of the distribution of drawdowns in the two leading exchange markets (US dollar against the Deutsmark and against the Yen), in the major world stock markets, in the U.S. and Japanese bond market and in the gold market, by introducing the concept of ``coarse-grained drawdowns,'' which all…

2002-10-23abs ↗pdf ↗

Proposes a new method to estimate optimal treatment regimes in the presence of endogeneity.

problem Estimating optimal treatment regimes under endogeneity in observational studies or randomized trials.
method Semiparametric instrumental variable approach with binary instrumental variable.
result Identification and estimation of optimal treatment regimes under endogeneity without direct compliance information.

DynForest predicts event probabilities from longitudinal data, handling endogenous predictors.

problem Predicting individual risk using longitudinal patient history.
method Random survival forests with time-fixed features from longitudinal predictors.
result DynForest provides accurate individual event probability predictions.

The study examines pricing American options with both exogenous and endogenous transaction costs.

problem Pricing American options with transaction costs and liquidity risks.
method Modeling liquidity risks as a mean-reverting process and transaction costs as proportional to trading amount. Two nonlinear PDEs are used to characterize option values. Numerical solution via ADI method and model calibration using maximum likelihood estimation.
result The model incorporating liquidity risks significantly outperforms the Leland model.

The study shows how probability weighting can lead to betting in a risk-averse economy.

problem Understanding how probability weighting affects economic behavior and risk aversion.
method Examining a von Neumann-Morgenstern economy with an RDU agent to model probability weighting effects.
result Probability weighting can lead to endogenous betting in an economy with common beliefs.

This paper theoretically explains and validates a deep neural network approach to IV estimation.

problem Endogeneity issues in empirical applications, especially in the presence of omitted variables, measurement error, or simultaneous causality.
method A two-stage estimator using deep neural networks in a linear instrumental variables model, with a latent structural assumption on the reduced form equation.
result The second-stage estimator achieves the semiparametric efficiency bound, with a smaller estimation error and requiring weaker conditions on the smoothness of optimal instruments.