Exogenous state variables and rewards can slow down reinforcement learning by injecting uncontrolled variation into the reward signal. We formalize exogenous state variables and rewards and identify conditions under which an MDP with exogenous state can be decomposed into an exogenous Markov Reward Process involving on…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Exogenous Variables”
The paper tackles reinforcement learning with exogenous variables and rewards.
problem Exogenous state variables and rewards slow reinforcement learning by introducing uncontrolled variation.
method Formalizes exogenous state variables and rewards, decomposes MDP into exogenous and endogenous components, and introduces algorithms to discover these components.
result Optimal policies for the endogenous MDP are also optimal for the original MDP, but the endogenous MDP is easier to solve due to reduced variance.
New method learns exogenous variable distributions for better causal optimization.
problem Maximizing target variables in structural causal models.
method Learn exogenous variable distributions to improve surrogate models' fidelity.
result Improves approximation of structural causal models and broader application scenarios.
We consider the problem of identifying the causal direction between two discrete random variables using observational data. Unlike previous work, we keep the most general functional model but make an assumption on the unobserved exogenous variable: Inspired by Occam's razor, we assume that the exogenous variable is sim…
Many statistical methods have been proposed to estimate causal models in classical situations with fewer variables than observations (p<n, p: the number of variables and n: the number of observations). However, modern datasets including gene expression data need high-dimensional causal modeling in challenging situation…
Time series prediction has been studied in a variety of domains. However, it is still challenging to predict future series given historical observations and past exogenous data. Existing methods either fail to consider the interactions among different components of exogenous variables which may affect the prediction ac…
Improved electricity price forecasting with NBEATSx model.
problem Forecasting electricity prices with limited data.
method Extended NBEATS model to include exogenous variables.
result Significantly improved forecast accuracy (up to 5%) compared to existing methods.
New approach uses 'forward-looking' counterfactuals for treatment choice.
problem Using traditional 'retrospective' counterfactuals in treatment choice leads to counterintuitive results.
method Introduces 'counterfactual treatment choice' for forward-looking counterfactuals.
result Mismatches between interventional and forward-looking counterfactuals can lead to counterintuitive results.
HL algorithms improve resource allocation in cloud environments.
problem Sequential decision-making under uncertainty with exogenous variables.
method HL algorithms leverage exogenous variable samples to infer counterfactual consequences.
result HL algorithms outperform classic methods and reinforcement learning in resource allocation.
Paper proves causal direction can be inferred from data with limited randomness.
problem Inferring causal direction from observational data with limited randomness.
method Entropy measurement and structural causal models.
result Causal direction is identifiable for most causal models with limited entropy.
In this paper, we propose multi-variable LSTM capable of accurate forecasting and variable importance interpretation for time series with exogenous variables. Current attention mechanism in recurrent neural networks mostly focuses on the temporal aspect of data and falls short of characterizing variable importance. To …
In this paper, we propose an interpretable LSTM recurrent neural network, i.e., multi-variable LSTM for time series with exogenous variables. Currently, widely used attention mechanism in recurrent neural networks mostly focuses on the temporal aspect of data and falls short of characterizing variable importance. To th…
Deep state space model forecasts time series with uncertainty.
problem Probabilistic forecasting for risk management.
method Parameterized deep networks for non-linear models, recurrent neural nets for dependency, ARD network for exogenous variables.
result Accurate and sharp probabilistic forecasts with realistic uncertainty growth.
Method identifies unknown intervention targets in structural causal models from diverse data.
problem Identifying unknown intervention targets in structural causal models from heterogeneous data.
method Two-phase approach: first recovers exogenous noises, second matches with endogenous variables.
result Proposed method uniquely identifies intervention targets under causal sufficiency assumption.
We developed a novel statistical method to identify structural differences between networks characterized by structural equation models. We propose to reparameterize the model to separate the differential structures from common structures, and then design an algorithm with calibration and construction stages to identif…
Identifies patient-specific root causes of disease using structural equation models.
problem Detecting significant variables in complex diseases that differ between patients.
method Defining patient-specific root causes as exogenous errors in a structural equation model, quantifying predictivity using Shapley values, and developing a fast algorithm called Root Causal Inference.
result Significant improvements in accuracy by uncovering root causes with large effect sizes at the individual level but clinically insignificant effect sizes at the group level.
Optimizes PnL using linear signals in quantitative finance.
problem Maximizing profit and loss in financial trading.
method Unsupervised machine learning approach that maximizes Sharpe Ratio through linear relationships and parameter optimization.
result Empirical validation and effectiveness of the model on U.S. Treasury ETF.
New approach reveals causal and probabilistic relationships from equations.
problem Understanding causal and probabilistic relationships from sets of equations.
method Simon's causal ordering algorithm and Markov ordering graph construction.
result Implied conditional independences and causal relations without solving equations.
Stochastic Online Instrumental Variable Regression: Regrets for Endogeneity and Bandit Feedbackcs.LG
New method tackles endogeneity in online learning with improved regret bounds.
problem Endogeneity in real data due to omitted variables, strategic behaviors, etc.
method O2SLS (Online Two-Stage Least Squares) for Instrumental Variable (IV) regression.
result O2SLS achieves identification and oracle regret bounds for stochastic online learning.
Paper proposes a new MAR model for global economic forecasting.
problem Joint modeling of economic and financial variables across countries.
method Sparse matrix autoregressive model with trade network integration.
result Sparse component differentiates systematic and idiosyncratic cross-predictability.
EXOC framework uses auxiliary variables for counterfactual fairness in machine learning.
problem Balancing fairness and predictive accuracy in models with sensitive attributes.
method EXOC framework uses auxiliary variables to define an auxiliary node and a control node for counterfactual fairness.
result EXOC framework outperforms state-of-the-art approaches in achieving counterfactual fairness.
The increasing complexity of mobility plus the growing population in cities, together with the importance of privacy when sharing data from vehicles or any device, makes traffic forecasting that uses data from infrastructure and citizens an open and challenging task. In this paper, we introduce a novel approach to deal…
In situations like tax declarations or analyzes of household budgets we would like to automatically evaluate credibility of exogenous variable (declared income) based on some available (endogenous) variables - we want to build a model and train it on provided data sample to predict (conditional) probability distributio…
Short-Term Stock Price Forecasting using exogenous variables and Machine Learning Algorithmsq-fin.TR
This study compares machine learning models for short-term stock price forecasting.
problem Accurate short-term stock price prediction in the NYSE.
method Compared four machine learning models (XGBoost, Random Forest, Multi-layer Perceptron, Support Vector Regression) on NYSE stocks.
result XGBoost model outperformed others with highest accuracy.
Improved online penalty selection for time series models.
problem Efficiently selecting penalty parameters for lasso in time series models.
method Enhanced autoregressive model with online penalty selection.
result Significantly improved computational performance and forecast accuracy.
We study large-scale spatial systems that contain exogenous variables, e.g. environmental factors that are significant predictors in spatial processes. Building predictive models for such processes is challenging because the large numbers of observations present makes it inefficient to apply full Kriging. In order to r…
How does dynamic price information flow among Northern European electricity spot prices and prices of major electricity generation fuel sources? We use time series models combined with new advances in causal inference to answer these questions. Applying our methods to weekly Nordic and German electricity prices, and oi…
How news affect the trading behavior of different categories of investors in a financial marketq-fin.ST
We investigate the trading behavior of a large set of single investors trading the highly liquid Nokia stock over the period 2003-2008 with the aim of determining the relative role of endogenous and exogenous factors that may affect their behavior. As endogenous factors we consider returns and volatility, whereas the e…
We address microscopic, agent based, and macroscopic, stochastic, modeling of the financial markets combining it with the exogenous noise. The interplay between the endogenous dynamics of agents and the exogenous noise is the primary mechanism responsible for the observed long-range dependence and statistical propertie…
Robustly detects and attributes climate change impacts under interventions.
problem Detect and attribute climate change impacts from observations robustly.
method Supervised learning with anchor regression for robust predictions under interventions.
result CO2 forcing can be robustly predicted from temperature patterns under strong solar forcing interventions.
For recurrent neural networks trained on time series with target and exogenous variables, in addition to accurate prediction, it is also desired to provide interpretable insights into the data. In this paper, we explore the structure of LSTM recurrent neural networks to learn variable-wise hidden states, with the aim t…
Paper harmonizes medical data using flow-based causal inference.
problem Heterogeneity in medical data from different sites and protocols.
method Flow-based normalizing method for counterfactual inference on structural causal models.
result Better cross-domain generalization compared to state-of-the-art algorithms.
Generates counterfactuals in target domain from source domain observations.
problem Cross-domain learning with domain shifts and lack of parallel datasets.
method Unsupervised, Neural Causal Models, Joint Causal Graphs, Effect-Intrinsic vs Domain-Intrinsic Variables.
result Framework generates counterfactuals that closely match ground truth.
We study the asymptotic properties of the adaptive Lasso in cointegration regressions in the case where all covariates are weakly exogenous. We assume the number of candidate I(1) variables is sub-linear with respect to the sample size (but possibly larger) and the number of candidate I(0) variables is polynomial with …
Paper proposes a method to estimate counterfactual outcomes without a known SCM.
problem Estimating counterfactual outcomes without a known structural causal model.
method Introduces rank preservation assumption and a novel ideal loss for unbiased learning of counterfactual outcomes.
result The proposed method is effective and unbiased, as shown by theoretical analysis and experiments.
Study classifies stock price jumps as exogenous or endogenous using news data.
problem Differentiating between exogenous and endogenous price jumps.
method Synchronized news data with order book data to analyze stock price movements.
result Exogenous jumps are abrupt and follow a decaying power-law, while endogenous jumps are progressively accelerating.
Tensor Decompositions for Identifying Directed Graph Topologies and Tracking Dynamic Networksstat.ML
Directed networks are pervasive both in nature and engineered systems, often underlying the complex behavior observed in biological systems, microblogs and social interactions over the web, as well as global financial markets. Since their structures are often unobservable, in order to facilitate network analytics, one …
ddml aids causal inference in econometrics with machine learning.
problem Estimation of causal effects with endogenous variables and unknown functional forms.
method Double/Debiased Machine Learning (DDML) in Stata.
result Monte Carlo evidence supports using DDML with stacking for causal inference.
New method identifies extreme risk propagation in financial networks.
problem Understanding extreme risk in financial networks.
method Max-linear structural equation model, hard-thresholding, Hamming distance.
result Sparse DAG for extreme risk propagation estimated.
New approach to counterfactual reasoning in AI and psychology.
problem Challenges to conventional counterfactual reasoning in AI and psychology.
method Formalizes a backtracking approach to counterfactuals within the SCM framework.
result First general account and algorithmisation of backtracking counterfactuals.
We study Exo-MDPs to reduce sample complexity in reinforcement learning.
problem Reducing sample complexity in reinforcement learning for structured MDPs.
method Introducing Exo-MDPs and proving structural equivalence to linear mixture MDPs, establishing regret bounds.
result Proved regret bound for Exo-MDPs, matching lower bounds.
New method warns of counterfactual non-identifiability in DSCMs.
problem Counterfactual inference from observational data is non-identifiable even without unobserved confounding.
method Prove counterfactual identifiability for monotonic generation mechanisms, provide impossibility result for general mechanisms, propose method for estimating worst-case errors.
result Non-identifiability of counterfactual inference from observational data, even in absence of unobserved confounding.
This paper uses NARX neural networks for macroeconomic forecasting and goal setting.
problem Improving accuracy in macroeconomic forecasting and goal setting.
method Literature review and construction of specific NARX neural networks for macroeconomic indicators.
result NARX neural networks can be trained to make accurate predictions for macroeconomic indicators and national goals.
We propose a heterogeneous simultaneous graphical dynamic linear model (H-SGDLM), which extends the standard SGDLM framework to incorporate a heterogeneous autoregressive realised volatility (HAR-RV) model. This novel approach creates a GPU-scalable multivariate volatility estimator, which decomposes multiple time seri…
The Vector AutoRegressive (VAR) model is fundamental to the study of multivariate time series. Although VAR models are intensively investigated by many researchers, practitioners often show more interest in analyzing VARX models that incorporate the impact of unmodeled exogenous variables (X) into the VAR. However, sin…
We study causal inference in a multi-environment setting, in which the functional relations for producing the variables from their direct causes remain the same across environments, while the distribution of exogenous noises may vary. We introduce the idea of using the invariance of the functional relations of the vari…
The paper analyzes binary option markets with exogenous information and price sensitivity.
problem Analyzing binary option markets with exogenous information and price sensitivity.
method Derive and analyze a continuous model of binary option markets with exogenous information, using Filippov surfaces and general assumptions on purchasing rules.
result Price always converges when exogenous information is constant, and price sensitivity affects price lag vs. information.
Enhances random forest performance with exogenous randomness.
problem Improving random forest performance through exogenous randomness.
method Developed non-asymptotic MSE expansions for individual trees and forests, identified two types of randomness, and conducted simulations.
result Exogenous randomness, particularly feature subsampling, reduces both bias and variance of random forests.