Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

77154230307 · Jun 202019922001200920172026
48 results for counterfactual worlds

Counterfactual policy evaluation improves autonomous driving policies' generalization.

problem Learnt policies often fail to generalize and handle novel situations.
method Introduces counterfactual policy evaluation using counterfactual worlds.
result Significantly decreases collision-rate while maintaining high success-rate.

Proposes a method to create fair, robust predictors that remain consistent across different scenarios.

problem Creating fair and robust machine learning models that behave consistently across different scenarios.
method Graphical criteria and a model-agnostic framework called CIP based on HSCIC.
result Demonstrates the effectiveness of CIP in enforcing counterfactual invariance across various datasets.

Proposes a method to generate realistic counterfactuals by learning relationships.

problem Counterfactual explanations often ignore intrinsic relationships between data attributes.
method Uses a variational auto-encoder to learn relationships and perturb the latent space.
result The model preserves relationships and generates realistic counterfactuals.

Work proposes CLAIRE to achieve counterfactual fairness from observational data without causal models.

problem Achieving counterfactual fairness from observational data without prior causal models.
method Proposes CLAIRE, a representation learning framework based on counterfactual data augmentation and an invariant penalty.
result CLAIRE effectively mitigates biases from the sensitive attribute and improves counterfactual fairness and prediction performance.

Estimates counterfactual outcomes linking observed and unobserved data.

problem Estimating expected counterfactual outcomes for individuals.
method Introduces retrospective counterfactual estimators and prediction intervals linking observed and unobserved outcomes.
result Retrospective counterfactual estimators and prediction intervals asymptotically satisfy valid coverage under standard causal assumptions.

Introduces lookahead counterfactual fairness to account for downstream effects of ML predictions.

problem Downstream effects of ML predictions on individuals not considered by counterfactual fairness.
method Introduces lookahead counterfactual fairness (LCF), a new fairness notion that considers future status. Proposes an algorithm based on theoretical conditions.
result Proposes an algorithm to achieve lookahead counterfactual fairness and validates it on synthetic and real data.

We identify causal models with unobserved confounding using bijective generation mechanisms.

problem Identifying causal relationships with unobserved confounders.
method Establish counterfactual identifiability for BGMs and propose a learning method.
result Learned BGMs enable efficient counterfactual estimation.

Machine learning can impact people with legal or ethical consequences when it is used to automate decisions in areas such as insurance, lending, hiring, and predictive policing. In many of these scenarios, previous decisions have been made that are unfairly biased against certain subpopulations, for example those of a …

2017-03-20abs ↗pdf ↗

CVIB uses information theory to learn counterfactuals from MNAR data without RCTs.

problem Debiasing learning from missing-not-at-random (MNAR) data in recommendation systems.
method CVIB, a variational information bottleneck, separates task-aware mutual information into factual and counterfactual parts.
result CVIB significantly enhances both shallow and deep models in recommendation systems.

Study reveals gaps between simulated and real-world treatment effect evaluation metrics.

problem Evaluation of treatment effect estimation models differs between academic and practical settings.
method Comprehensive empirical study comparing semi-simulated benchmarks and real-world datasets.
result Counterfactual metrics do not reliably predict observable metrics, and rankings from simulated benchmarks do not generalize to real-world data.

EXOC framework uses auxiliary variables for counterfactual fairness in machine learning.

problem Balancing fairness and predictive accuracy in models with sensitive attributes.
method EXOC framework uses auxiliary variables to define an auxiliary node and a control node for counterfactual fairness.
result EXOC framework outperforms state-of-the-art approaches in achieving counterfactual fairness.

A new method generates counterfactual treatment outcomes for time-varying treatments.

problem Estimating counterfactual outcomes for time-varying treatments with high-dimensional outcomes.
method Conditional generative framework with inverse probability re-weighting.
result Our method outperforms state-of-the-art baselines in generating high-quality counterfactual samples.

Proposes a method to generate counterfactuals for ensemble models using entropic risk measures.

problem Finding a single counterfactual explanation for an ensemble of models.
method Incorporates entropic risk measure into a constrained optimization to generate counterfactuals valid for an adjustable fraction of models.
result Entropic risk measure allows generation of counterfactuals valid for all models in the ensemble under a limiting case.

Proposes a new method for estimating counterfactual treatment effects.

problem Uncertainty in identifying causal mechanisms from observational data.
method Introduces a parameterized family of causal mechanisms that generalize Gumbel-max, trained to minimize counterfactual effect variance.
result Trained mechanisms yield lower variance estimates of counterfactual treatment effects.

The paper connects counterfactual fairness to robust prediction and group fairness using causal context.

problem The challenge of ensuring fairness in AI systems when counterfactuals cannot be directly observed.
method Using causal context to bridge counterfactual fairness, robust prediction, and group fairness.
result Counterfactual fairness is equivalent to group fairness metrics in specific contexts.

Self-Distilled Disentanglement improves counterfactual predictions by separating variables.

problem Improving counterfactual predictions in the presence of confounders and unobserved variables.
method Self-Distilled Disentanglement framework based on information theory.
result Effective counterfactual inference in synthetic and real-world datasets.

Paper proposes a method to estimate counterfactual outcomes without a known SCM.

problem Estimating counterfactual outcomes without a known structural causal model.
method Introduces rank preservation assumption and a novel ideal loss for unbiased learning of counterfactual outcomes.
result The proposed method is effective and unbiased, as shown by theoretical analysis and experiments.

NCoRE learns counterfactual representations for combined treatments.

problem Estimating individual response to multiple simultaneous interventions.
method Neural conditional representation with modulators for cross-treatment interactions.
result NCoRE significantly outperforms existing methods in counterfactual treatment effect estimation.

Proposes minimal interventions over counterfactual explanations for algorithmic recourse.

problem Lack of actionable recommendations for algorithmic recourse.
method Causal reasoning to shift focus from explanations to recommendations.
result Minimal interventions provide more actionable recommendations for recourse.

A method removes treatment-covariate dependence for counterfactual prediction without adversarial training.

problem Counterfactual prediction under assignment bias.
method Information-theoretic approach learning a stochastic representation Z to minimize mutual information with outcomes.
result The method performs favorably in likelihood, counterfactual error, and policy evaluation compared to adversarial baselines.

Proposes a scalable method for counterfactual prediction using machine learning.

problem De-bias causal estimators with high-dimensional data in observational studies.
method Uses entropy balancing to learn weights minimizing Jensen-Shannon divergence, leading to robust counterfactual predictions.
result Consistent causal estimation if either propensity score or outcome model is correctly specified.

This paper introduces collective counterfactual explanations for groups of instances in classification models.

problem Understanding how classification models make decisions for groups of instances.
method Novel Mathematical Optimization models to find collective counterfactual explanations that minimize total perturbation cost.
result Detects critical features for entire dataset classification and handles outliers.

Method estimates multivariate counterfactual distributions efficiently and accurately.

problem Estimating multivariate counterfactual distributions in causal models with correlation structures.
method Proposes a method leveraging a one-dimensional subspace to capture correlation structures and efficiently estimate multivariate counterfactual distributions.
result Demonstrates superior performance over existing methods on synthetic and real-world data.

COMRECGC finds common recourse for global counterfactual explanations in GNNs.

problem Finding common recourse for global counterfactual explanations in GNNs.
method Formalized the common recourse explanation problem and designed COMRECGC algorithm.
result COMRECGC outperforms strong baselines on four real-world graph datasets.

A new method for generating counterfactual explanations in high-dimensional datasets.

problem Creating realistic counterfactual explanations in complex, high-dimensional data.
method A discretized approach using binary search and boundary approximation.
result Our method reduces the distance between counterfactuals by 5% to 50% in terms of the L2 norm.

Proposes a new method to measure and avoid harm in machine learning decisions.

problem Measuring and avoiding harm in machine learning algorithms.
method Formal definition of harm and benefit using causal models, counterfactual objective functions.
result Demonstrates that standard machine learning methods can lead to harmful policies under distributional shifts.

New research challenges the idea that counterfactual explanations should be sparse.

problem Predictive multiplicity leads to multiple models giving almost equal solutions.
method Derive a general upper bound for counterfactual costs under multiplicity and compare sparse vs. data support approaches.
result Data support methods are more robust to multiplicity but have higher counterfactual costs.

Develops a Causal Transformer for estimating counterfactual outcomes from longitudinal data.

problem Estimating counterfactual outcomes over time from observational data is challenging due to complex, long-range dependencies.
method Combines three transformer subnetworks with separate inputs for time-varying covariates, previous treatments, and previous outcomes into a joint network with in-between cross-attentions. Uses a custom, end-to-end training procedure with a counterfactual domain confusion loss to address confounding bias.
result Achieves superior performance over current baselines in synthetic and real-world datasets.

The paper introduces CPICFs for better counterfactual explanations in high-dimensional spaces.

problem Creating useful counterfactual explanations for complex machine learning models.
method Modeling individual knowledge and using conformal prediction intervals to identify informative counterfactuals.
result CPICFs provide more informative counterfactuals by considering individual knowledge and prediction uncertainty.

Paper introduces EnCounteR for estimating causal effects using encouragement data.

problem Challenges in estimating causal effects due to incomplete randomization and limited encouragement data.
method Introduces a generalized IV estimator, EnCounteR, leveraging both observational and encouragement data.
result Demonstrates superior performance of EnCounteR over existing methods.

We consider the problem of constructing diffusion operators high dimensional data XX to address counterfactual functions FF, such as individualized treatment effectiveness. We propose and construct a new diffusion metric KFK_F that captures both the local geometry of XX and the directions of variance of FF. The res…

2016-10-31abs ↗pdf ↗

Unified framework for counterfactual survival analysis improves treatment effect estimation.

problem Limited methods for counterfactual inference with survival outcomes.
method Unified framework for survival outcomes, nonparametric hazard ratio metric.
result Significantly outperforms alternatives in survival-outcome prediction and treatment-effect estimation.

A deep RL approach generates counterfactual instances efficiently.

problem Efficient generation of counterfactual instances for large datasets and diverse models.
method Deep reinforcement learning to optimize counterfactual instances in a single forward pass.
result Model-agnostic and scalable counterfactual generation.

Paper detects biases in medical imaging ML models using counterfactual analysis.

problem Bias in medical imaging ML models negatively impacts generalization performance.
method Counterfactual invariance framework combining conditional latent diffusion models and statistical hypothesis testing.
result The method identifies and quantifies biases without direct access to counterfactual data.

Paper addresses feasibility of counterfactual explanations in ML models, especially for critical domains.

problem Feasibility of counterfactual examples in ML models, especially in healthcare and finance.
method Uses partial structural causal models and modified variational autoencoder loss to generate counterfactuals that satisfy feasibility constraints.
result Generated counterfactuals better satisfy feasibility constraints than existing methods.

New model predicts energy prices under different scenarios.

problem Complex causal relationships in energy markets with continuous regime changes.
method Augmented Time Series Structural Causal Models (ATSCM) integrating neural causal discovery.
result Enables novel counterfactual queries in energy markets.

The paper tackles counterfactual learning for stochastic policies with continuous actions.

problem Learning stochastic policies with continuous actions from logged data.
method Introduces a joint kernel embedding of contexts and actions to model continuous actions, and uses proximal point algorithms and smooth estimators for optimization.
result Demonstrates the benefits of using proximal point algorithms and smooth estimators for counterfactual learning.

Comparing counterfactual distributions can provide more nuanced and valuable measures for causal effects, going beyond typical summary statistics such as averages. In this work, we consider characterizing causal effects via distributional distances, focusing on two kinds of target parameters. The first is the counterfa…

2018-06-08abs ↗pdf ↗

The paper proposes a method to generate diverse counterfactual explanations for anomaly detection in time series data.

problem Lack of helpful explanations for anomaly detection models in time series data.
method Model-agnostic algorithm that generates diverse counterfactual examples for anomaly detection models.
result The method produces counterfactual examples that are not considered anomalous by the detection model and satisfy validity, plausibility, and closeness criteria.