Method selects valid IVs from a large set using clustering and test of overidentifying restrictions.
problem Selecting valid instrumental variables from a large set of candidates.
method Agglomerative hierarchical clustering combined with a test of overidentifying restrictions.
result Achieves oracle properties when the largest group of IVs is valid.
SPACR trains uncertainty-aware regressors directly within a single pass, improving efficiency and validity.
problem Training uncertainty-aware regressors while maintaining efficiency and validity.
method Joint optimization of efficiency and validity during training.
result SPACR consistently provides tighter intervals and better coverage-efficiency trade-offs compared to standard CP and DOICR.
Proposes a new test for validating multivariate dynamic regression models.
problem Inadequate exogeneity conditions for conventional model specification tests in dynamic systems.
method Develops a generalized Durbin estimator for multiple-equation systems with dynamic dependencies, and constructs Wald tests.
result Bootstrap-based Wald tests improve finite-sample size control and validate the null hypothesis in multifactor models.
This paper optimizes brokerage contracts for multiple clients trading a single asset.
problem Optimizing brokerage contracts for multiple clients trading a single asset.
method Endogenously determines clients' reservation values and strategically chooses clients. Characterizes optimal portfolios computationally.
result Characterizes optimal portfolios of clients and their profits, showing dependence on price impact coefficients.
Model shows how banks' fears of future defaults can cause immediate financial stress.
problem How banks' future default worries cause immediate financial stress.
method Dynamic interbank model with endogenous distress contagion, mark-to-market valuation adjustment, forward-backward approach.
result Distress contagion acts as a stochastic volatility term leading to clustering and down-market spikes.
ddml aids causal inference in econometrics with machine learning.
problem Estimation of causal effects with endogenous variables and unknown functional forms.
method Double/Debiased Machine Learning (DDML) in Stata.
result Monte Carlo evidence supports using DDML with stacking for causal inference.
We present the first tree-based regressor whose convergence rate depends only on the intrinsic dimension of the data, namely its Assouad dimension. The regressor uses the RPtree partitioning procedure, a simple randomized variant of k-d trees.
Endogenous randomness emerges from adversarial market learning.
problem Market randomness
method Deterministic adversarial market model
result Out-of-sample profitability collapses to zero.
Dynamic regressor selection (DRS) systems work by selecting the most competent regressors from an ensemble to estimate the target value of a given test pattern. This competence is usually quantified using the performance of the regressors in local regions of the feature space around the test pattern. However, choosing …
For an investor with constant absolute risk aversion and a long horizon, who trades in a market with constant investment opportunities and small proportional transaction costs, we obtain explicitly the optimal investment policy, its implied welfare, liquidity premium, and trading volume. We identify these quantities as…
The paper tackles reinforcement learning with exogenous variables and rewards.
problem Exogenous state variables and rewards slow reinforcement learning by introducing uncontrolled variation.
method Formalizes exogenous state variables and rewards, decomposes MDP into exogenous and endogenous components, and introduces algorithms to discover these components.
result Optimal policies for the endogenous MDP are also optimal for the original MDP, but the endogenous MDP is easier to solve due to reduced variance.
A method to identify new classes of price jumps in financial markets.
problem Separating endogenous and exogenous causes of price jumps.
method Wavelet-based representation of jump time-series.
result Identification of new classes of jumps and investigation of co-jumps.
We introduce a new learned descriptor for audio signals which is efficient for event representation. The entries of the descriptor are produced by evaluating a set of regressors on the input signal. The regressors are class-specific and trained using the random regression forests framework. Given an input signal, each …
High-precision machine learning reduces particle physics simulations by orders of magnitude.
problem Reducing computational burden in particle physics simulations.
method Developed optimal training strategies and tuned machine learning regressors, including Deep Neural Networks with skip connections and boosted decision trees.
result Significantly reduced computational time by factors of 10^3 to 10^6 over first-principles simulations.
Existence of incomplete Radner equilibrium with endogenous noise tracker.
problem Existence of incomplete Radner equilibrium in a model with endogenous noise tracker.
method Proved existence through a coupled system of ODEs, reduced to two coupled ODEs.
result Endogenous noise tracker leads to higher aggregate welfare for large stock supply.
Study shows k-NN regressor consistency in complex survey designs.
problem Lack of consistency results for k-NN regressor in complex survey data. method Analysis of regularity conditions on sampling design and data distribution.
result Consistency of k-NN regressor under complex survey designs. New TSER algorithms outperform existing methods in time series extrinsic regression.
problem Improving time series extrinsic regression models.
method Extended TSER archive, introduced two new algorithms (FreshPRINCE and DrCIF), compared with rotation forest.
result DrCIF and FreshPRINCE models significantly outperform existing methods.
A large number and diversity of techniques have been offered in the literature in recent years for solving multi-label classification tasks, including classifier chains where predictions are cascaded to other models as additional features. The idea of extending this chaining methodology to multi-output regression has a…
Transformers can handle endogeneity in linear regression using IV methods.
problem Endogeneity in in-context linear regression models.
method Transformer architecture with gradient-based bi-level optimization and in-context pretraining.
result Transformers provide more robust predictions and estimates than 2SLS in endogenous scenarios.
Kernel method improves instrumental variable regression rates.
problem Nonparametric instrumental variable regression with weak instruments.
method Kernel-based two-stage least-squares method, strong L2 convergence analysis. result Minimax optimal rates for instrumental regression under standard assumptions.
The study evaluates nine machine learning regressors for predicting NASDAQ stock opening prices.
problem Predicting stock market opening prices for profitable trading strategies.
method Nine different machine learning regressors were applied to NASDAQ stock market data.
result The study found that certain regressors outperform others in predicting stock opening prices.
We focus in this paper on high-dimensional regression problems where each regressor can be associated to a location in a physical space, or more generally a generic geometric space. Such problems often employ sparse priors, which promote models using a small subset of regressors. To increase statistical power, the so-c…
Density-Regression improves deep uncertainty estimation with faster inference.
problem Efficient uncertainty estimation under distribution shifts with modern deep models.
method Leverages density function for fast inference and distance-aware feature space.
result Density-Regression achieves competitive uncertainty estimation performance.
Easy conditions found for simplifying complex systems.
problem Linearizing complex two-input systems.
method Endogenous dynamic feedback with a dimension of at most two.
result Necessary and sufficient conditions for linearizability.
New findings allow infinite mean intensity Hawkes processes to be stable.
problem Stability condition for Hawkes processes with infinite mean intensity.
method Analysis of Quadratic Hawkes processes with infinite mean intensity.
result Quadratic Hawkes processes are always stationary with infinite mean intensity when total endogeneity ratio exceeds unity.
Paper introduces ℓ-DER for regression tasks using morphological operators and convex-concave procedure.
problem Developing a universal approximator for regression tasks.
method Introduces ℓ-DER model, trains it using a convex-concave procedure (CCP) to minimize least-squares. result Outperforms other hybrid morphological models and state-of-the-art approaches.
Autonomy and adaptation of machines requires that they be able to measure their own errors. We consider the advantages and limitations of such an approach when a machine has to measure the error in a regression task. How can a machine measure the error of regression sub-components when it does not have the ground truth…
Most real life systems have a random component: the multitude of endogenous and exogenous factors influencing them result in stochastic fluctuations of the parameters determining their dynamics. These empirical systems are in many cases subject to noise of multiplicative nature. The special properties of multiplicative…
Systems with long-range persistence and memory are shown to exhibit different precursory as well as recovery patterns in response to shocks of exogeneous versus endogeneous origins. By endogeneous, we envision either fluctuations resulting from an underlying chaotic dynamics or from a stochastic forcing origin which ma…
This paper models financial contagion with endogenously determined market liquidity.
problem Financial contagion and its impact on market liquidity during price drops.
method Developed a joint clearing system for interbank payments, asset prices, and market liquidity, with endogenous market capacity.
result Endogenous market liquidity significantly affects system risk during financial contagion.
Endogenous business cycles explain higher comovement across countries.
problem Standard models struggle to explain high comovement in business cycles across countries.
method Developed a demand-driven reduced-form model with strategic complementarities and international trade linkages.
result Combining endogenous business cycles with exogenous shocks matches empirical comovement levels.
Study classifies stock price jumps as exogenous or endogenous using news data.
problem Differentiating between exogenous and endogenous price jumps.
method Synchronized news data with order book data to analyze stock price movements.
result Exogenous jumps are abrupt and follow a decaying power-law, while endogenous jumps are progressively accelerating.
In this article we consider the volatility inference in the presence of both market microstructure noise and endogenous time. Estimators of the integrated volatility in such a setting are proposed, and their asymptotic properties are studied. Our proposed estimator is compared with the existing popular volatility estim…
The dual crises of the sub-prime mortgage crisis and the global financial crisis has prompted a call for explanations of non-equilibrium market dynamics. Recently a promising approach has been the use of agent based models (ABMs) to simulate aggregate market dynamics. A key aspect of these models is the endogenous emer…
This paper relaxes the common prior assumption in the public and private information game of Morris and Shin (2000, 2004). For the generalized game, where the agent's prior expectations are heterogenous, it derives a sharp condition for the emergence of unique/multiple equilibria. This condition indicates that unique e…
New method tackles endogeneity in online learning with improved regret bounds.
problem Endogeneity in real data due to omitted variables, strategic behaviors, etc.
method O2SLS (Online Two-Stage Least Squares) for Instrumental Variable (IV) regression.
result O2SLS achieves identification and oracle regret bounds for stochastic online learning.
Test for linearizing 2-input systems with 2D feedback.
problem Linearizability of two-input systems by feedback.
method Algorithmic test for 2D endogenous feedback.
result Systematic derivation of flat outputs.
Paper corrects bias in online learning algorithms with endogenous data.
problem Dynamic selection problems in online learning algorithms with endogenous data.
method Instrumental-variable-based algorithm to correct bias, proving central limit theorem.
result Obtains true parameter values and low regret levels.
Finance is about how the continuous stream of news gets incorporated into prices. But not all news have the same impact. Can one distinguish the effects of the Sept. 11, 2001 attack or of the coup against Gorbachev on Aug., 19, 1991 from financial crashes such as Oct. 1987 as well as smaller volatility bursts? Using a …
ABIDES-MARL uses MARL to study market behavior in a realistic financial simulation.
problem Understanding equilibrium behavior in complex financial market games.
method Combines MARL with a realistic LOB simulation to study market behavior.
result Validated approach by solving an extended Kyle model and showing how execution strategies shape market dynamics.
A new boosting method corrects endogeneity bias in instrumental variable regression.
problem Endogeneity bias in instrumental variable regression.
method Causal Gradient Boosting (boostIV) that builds on gradient boosting algorithm.
result boostIV is consistent and performs well in finite samples compared to other methods.
In this article, we present a discrete time modeling framework, in which the shape and dynamics of a Limit Order Book (LOB) arise endogenously from an equilibrium between multiple market participants (agents). We use the proposed modeling framework to analyze the effects of trading frequency on market liquidity in a ve…
Method estimates exogenous and endogenous factors from event times.
problem Estimating factors influencing event occurrence.
method Combines inhomogeneous Poisson and Hawkes processes, fits using free energy minimization.
result Four regimes identified based on factor detection.
A method estimates causal parameters using a latent variable recovery.
problem Estimating causal parameters in contexts with multiple causes and unobserved confounding.
method Substitute adjustment via recovery of latent variables.
result Substitute adjustment estimates adjusted regression parameters under certain conditions.
Method identifies unknown intervention targets in structural causal models from diverse data.
problem Identifying unknown intervention targets in structural causal models from heterogeneous data.
method Two-phase approach: first recovers exogenous noises, second matches with endogenous variables.
result Proposed method uniquely identifies intervention targets under causal sufficiency assumption.
Paper proposes EILLS for invariant linear regression across environments.
problem Estimating true parameter and important variable set in multi-environment settings.
method Environment invariant linear least squares (EILLS) objective function.
result EILLS estimator achieves variable selection consistency and efficient estimation.
A new method selects features for ERGMs to improve network modeling.
problem ERGM degeneracy creates unrealistic network structures.
method Stochastic step-wise feature selection to overcome computational burden and improve network accommodation.
result Enhanced ERGM modeling with more accurate interpretations.
Paper proposes a new model to assess risks in energy storage systems considering both exogenous and endogenous uncertainties.
problem Current risk assessment ignores the stochastic nature of energy storage availability.
method Data-driven unified model with exogenous and endogenous uncertainty description for four types of generic energy storage.
result Comparative results show more severe risks for endogenous uncertainty, suggesting new strategies for system operators.