Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

4997146194 · May 202619922001200920172026
48 results for counterfactual risk

Proposes a method to generate counterfactuals for ensemble models using entropic risk measures.

problem Finding a single counterfactual explanation for an ensemble of models.
method Incorporates entropic risk measure into a constrained optimization to generate counterfactuals valid for an adjustable fraction of models.
result Entropic risk measure allows generation of counterfactuals valid for all models in the ensemble under a limiting case.

This manuscript introduces the idea of using Distributionally Robust Optimization (DRO) for the Counterfactual Risk Minimization (CRM) problem. Tapping into a rich existing literature, we show that DRO is a principled tool for counterfactual decision making. We also show that well-established solutions to the CRM probl…

2019-06-14abs ↗pdf ↗

Counterfactual explanations can be obtained by identifying the smallest change made to a feature vector to qualitatively influence a prediction; for example, from 'loan rejected' to 'awarded' or from 'high risk of cardiovascular disease' to 'low risk'. Previous approaches often emphasized that counterfactuals should be…

2019-10-21abs ↗pdf ↗

Counterfactual learning from observational data involves learning a classifier on an entire population based on data that is observed conditioned on a selection policy. This work considers this problem in an active setting, where the learner additionally has access to unlabeled examples and can choose to get a subset o…

2019-05-29abs ↗pdf ↗

Proposes a framework to explain KS deterioration in credit risk models.

problem Inconsistent and ad hoc diagnosis of KS decline in credit risk models.
method Counterfactual diagnostic framework attributing KS decline to sampling variability, portfolio composition, covariate shift, and residual deterioration.
result The proposed approach provides more interpretable and governance-relevant explanations than threshold-based review alone.

New method debiases counterfactual distributions using observational data.

problem Estimating counterfactual distributions under interventions without relying on observational data.
method Flow-matching approach to learn counterfactual distributions from observational data.
result Deconfounding flows outperform existing debiased counterfactual distribution estimators.

A new framework for robust and coherent counterfactual transports.

problem Estimating joint distributions over counterfactual outcomes in personalized decision-making and treatment risk assessment.
method Counterfactual cocycles that use algebraic structure to provide coherence and identifiability guarantees, bridging the gap between bijective SCMs and OT methods.
result Counterfactual cocycles provide state-of-the-art performance and noise-robustness across synthetic benchmarks and a real-world study.

The use of machine learning systems to support decision making in healthcare raises questions as to what extent these systems may introduce or exacerbate disparities in care for historically underrepresented and mistreated groups, due to biases implicitly embedded in observational data in electronic health records. To …

2019-07-14abs ↗pdf ↗

Counterfactual post-hoc interpretability approaches have been proven to be useful tools to generate explanations for the predictions of a trained blackbox classifier. However, the assumptions they make about the data and the classifier make them unreliable in many contexts. In this paper, we discuss three desirable pro…

2019-06-11abs ↗pdf ↗

We present a Bayesian view of counterfactual risk minimization (CRM) for offline learning from logged bandit feedback. Using PAC-Bayesian analysis, we derive a new generalization bound for the truncated inverse propensity score estimator. We apply the bound to a class of Bayesian policies, which motivates a novel, pote…

2018-06-29abs ↗pdf ↗

Develops optimal decision-making framework for uncertain counterfactuals.

problem Ensuring reliability of predictions in high-stakes decisions.
method Policy-Coupled Risk-Averse Conformal Prediction (PC-RACP).
result Optimal prediction sets for counterfactual decisions with valid coverage.

Algorithmic risk assessments are increasingly used to help humans make decisions in high-stakes settings, such as medicine, criminal justice and education. In each of these cases, the purpose of the risk assessment tool is to inform actions, such as medical treatments or release conditions, often with the aim of reduci…

2019-08-30abs ↗pdf ↗

We develop a learning principle and an efficient algorithm for batch learning from logged bandit feedback. This learning setting is ubiquitous in online systems (e.g., ad placement, web search, recommendation), where an algorithm makes a prediction (e.g., ad ranking) for a given input (e.g., query) and observes bandit …

2015-02-09abs ↗pdf ↗

New method improves counterfactual distribution learning for high-dimensional outcomes.

problem Counterfactual distribution learning for high-dimensional outcomes with concentrated structure.
method Geometry-adaptive diffusion-guided smoothing estimators combining causal nuisance adjustment and local outcome geometry.
result Geometry-adaptive methods show steeper error decay in semi-synthetic experiments.

A new method uses counterfactual learning to improve recommendation system evaluation.

problem Inconsistent results in recommender systems due to exposure mechanisms.
method Proposes a minimax empirical risk formulation with an adversarial game to account for exposure.
result Shows improved learning bounds and effectiveness over various recommendation settings.

A method removes treatment-covariate dependence for counterfactual prediction without adversarial training.

problem Counterfactual prediction under assignment bias.
method Information-theoretic approach learning a stochastic representation Z to minimize mutual information with outcomes.
result The method performs favorably in likelihood, counterfactual error, and policy evaluation compared to adversarial baselines.

Model improves CVR estimation in recommender systems by mitigating bias and overlooking causal relationships.

problem Data sparsity and sample selection bias in CVR estimation.
method Entire Space Counterfactual Multitask Model (ESCM2^2) incorporating counterfactual risk minimizer.
result Significantly enhances recommendation performance by effectively mitigating bias and overlooking causal relationships.

GANICE improves GAN-based causal inference by minimizing averaged Wasserstein risk.

problem Estimating interventional outcome distributions and quantiles in causal inference.
method GANICE uses extended Wasserstein distance and a cellwise critic to minimize averaged Wasserstein risk.
result GANICE achieves minimax optimality and consistently outperforms existing methods.

A new runtime for AI agents calculates risks in real-time.

problem Managing risks and liabilities in autonomous AI actions.
method A time-consistent counterfactual actuarial layer with explicit underwriting boundaries.
result Establishes a well-defined toll and guarantees executed-action budgets.

Proposes TNCM-VAE for generating causal financial time series.

problem Lack of causal reasoning in market generators.
method Combines VAE with structural causal models, enforcing causal constraints through DAGs and using causal Wasserstein distance.
result Superior performance in counterfactual probability estimation, L1 distances as low as 0.03-0.10.

Unified framework for counterfactual survival analysis improves treatment effect estimation.

problem Limited methods for counterfactual inference with survival outcomes.
method Unified framework for survival outcomes, nonparametric hazard ratio metric.
result Significantly outperforms alternatives in survival-outcome prediction and treatment-effect estimation.

Paper detects biases in medical imaging ML models using counterfactual analysis.

problem Bias in medical imaging ML models negatively impacts generalization performance.
method Counterfactual invariance framework combining conditional latent diffusion models and statistical hypothesis testing.
result The method identifies and quantifies biases without direct access to counterfactual data.

New method for valid prediction intervals in counterfactual outcomes with runtime confounding.

problem Valid prediction intervals for counterfactual outcomes under runtime confounding.
method Debiased machine learning framework grounded in semiparametric efficiency theory.
result Prediction intervals achieve desired coverage rates with faster convergence compared to standard methods.

The paper tackles counterfactual learning for stochastic policies with continuous actions.

problem Learning stochastic policies with continuous actions from logged data.
method Introduces a joint kernel embedding of contexts and actions to model continuous actions, and uses proximal point algorithms and smooth estimators for optimization.
result Demonstrates the benefits of using proximal point algorithms and smooth estimators for counterfactual learning.

Comparing counterfactual distributions can provide more nuanced and valuable measures for causal effects, going beyond typical summary statistics such as averages. In this work, we consider characterizing causal effects via distributional distances, focusing on two kinds of target parameters. The first is the counterfa…

2018-06-08abs ↗pdf ↗

Paper addresses theoretical risks in neural MCCFR, proposing Robust Deep MCCFR for improved performance.

problem Theoretical risks in neural MCCFR, especially in large games.
method Adaptive framework with selective component deployment, including target networks, exploration, and variance-aware training.
result Robust Deep MCCFR achieves significant exploitability improvements in both Kuhn and Leduc Poker.

Decision-makers are faced with the challenge of estimating what is likely to happen when they take an action. For instance, if I choose not to treat this patient, are they likely to die? Practitioners commonly use supervised learning algorithms to fit predictive models that help decision-makers reason about likely futu…

2017-03-30abs ↗pdf ↗

Paper models treatment effects by clustering patients with distinct survival characteristics.

problem Estimating treatment efficacy in clinical settings with censored outcomes.
method Latent variable approach to model heterogeneous treatment effects.
result The latent structure can mediate base survival rates and reveal actionable phenotypes.

auton-survival simplifies survival analysis for healthcare data.

problem Handling censored time-to-event data in healthcare.
method Open-source package for survival regression, adjustment, counterfactual estimation, phenotyping, and treatment effects.
result Demonstrates auton-survival's ability to support complex health and epidemiological questions.

DeDUCE efficiently generates realistic counterfactuals for image classifiers.

problem Generating accurate counterfactual explanations for large image classifiers.
method Developed a new algorithm using spectral normalization to efficiently generate counterfactuals.
result Our algorithm consistently produces counterfactuals closer to the original inputs with comparable realism.

We establish a foundation for multivariate counterfactual identification using dynamic optimal transport.

problem Addressing the open question of counterfactual identification for high-dimensional multivariate outcomes from observational data.
method Establish a foundation for multivariate counterfactual identification using continuous-time flows, including non-Markovian settings, with tools from dynamic optimal transport.
result Characterise the conditions under which flow matching yields a unique, monotone, and rank-preserving counterfactual transport map, ensuring consistent inference.

Unified framework for automatic debiased machine learning for various statistical parameters.

problem Inference on smooth functionals of nonparametric M-estimands.
method Unified framework using gradient, Hessian, and linear approximation; solves two risk minimization problems.
result Efficient autoDML estimators with double robustness and robustness to misspecification.

New approach uses 'forward-looking' counterfactuals for treatment choice.

problem Using traditional 'retrospective' counterfactuals in treatment choice leads to counterintuitive results.
method Introduces 'counterfactual treatment choice' for forward-looking counterfactuals.
result Mismatches between interventional and forward-looking counterfactuals can lead to counterintuitive results.

The paper analyzes counterfactual invariance and its relation to conditional independence.

problem Understanding the relationship between counterfactual invariance and conditional independence.
method Theoretical analysis of existing definitions, graphical implications, and mathematical proofs.
result Counterfactual invariance implies conditional independence, but not the other way around.

New framework improves counterfactual predictions using causal inference.

problem Challenges in predicting counterfactual outcomes with limited covariates and high-dimensional outcomes.
method Variational Bayesian causal inference framework for counterfactual generative modeling.
result Framework encourages disentangled exogenous noise and correct identification of causal effects.

Counterfactual data augmentations may not ensure OOD robustness if performed by a context-guessing machine.

problem Deep learning models lack out-of-distribution robustness due to reliance on spurious features.
method Theoretical analysis and demonstration of counterfactual data augmentations performed by a context-guessing machine.
result Counterfactual data augmentations by a context-guessing machine do not lead to robust OOD classifiers.