Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

135270405540 · Jun 202019922001200920172026
48 results for Causal prediction

Develops a new causal model for path-dependent link prediction.

problem Existing causal models assume fixed node factors, but real-world links can depend on existing ones.
method Introduces causal lifting and structural pairwise embeddings for path-dependent link prediction.
result Validated on three scenarios, demonstrating improved accuracy for causal link prediction.

The paper proposes a method to stabilize predictions by identifying causal variables using a seed variable.

problem Stable prediction across unknown test data with potential spurious correlations.
method Conditional independence test based algorithm using a seed variable to separate causal from non-causal variables.
result The algorithm precisely separates causal and non-causal variables for stable prediction across test data.

Review of methods enabling causal predictions under hypothetical interventions.

problem Need for predicting outcomes under hypothetical interventions in decision making.
method Systematic review of methods using causal inference for prediction models.
result Identified 13 methods for causal inference from observational data.

Applying machine learning in the health care domain has shown promising results in recent years. Interpretable outputs from learning algorithms are desirable for decision making by health care personnel. In this work, we explore the possibility of utilizing causal relationships to refine diagnostic prediction. We focus…

2017-11-29abs ↗pdf ↗

CD-RCA method identifies causal relationships in prediction errors without predefined graphs.

problem Challenges in diagnosing prediction errors due to lack of transparency in black-box models.
method Causal-Discovery-based Root-Cause Analysis (CD-RCA) method that estimates causal relationships without predefined causal graphs.
result CD-RCA outperforms heuristic attribution methods in identifying variable contributions to prediction errors.

New causal models perform poorly when evaluated on biased training sets.

problem Sample selection bias affects the evaluation of causal models' prediction performance.
method Re-evaluated prediction performance of causal models on a genetic perturbation data set, proposing a less-biased evaluation set.
result Causal models have similar or worse performance when evaluated on a less-biased set compared to standard association-based estimators.

In application domains such as healthcare, we want accurate predictive models that are also causally interpretable. In pursuit of such models, we propose a causal regularizer to steer predictive models towards causally-interpretable solutions and theoretically study its properties. In a large-scale analysis of Electron…

2017-02-08abs ↗pdf ↗

Autoregressive flow models can perform causal discovery and inference tasks.

problem Causal inference tasks such as causal discovery and interventional predictions.
method Using autoregressive flow models to estimate causal directions and make predictions.
result Autoregressive flows can accurately perform causal inference tasks without restrictive assumptions.

New methods predict language model out-of-distribution behaviors using causal mechanisms.

problem Predicting how language models behave on unseen data.
method Two methods: counterfactual simulation and value probing.
result Both methods achieve high AUC-ROC and outperform causal-agnostic approaches in out-of-distribution settings.

The interpretability of prediction mechanisms with respect to the underlying prediction problem is often unclear. While several studies have focused on developing prediction models with meaningful parameters, the causal relationships between the predictors and the actual prediction have not been considered. Here, we co…

2017-09-03abs ↗pdf ↗

We quantify causal bias in continuous treatment settings.

problem Identifying and quantifying causal bias in continuous treatment scenarios.
method Developed a novel characterization of causal bias in structural causal models, proving conditions for zero bias and efficient estimation.
result Causal bias can be estimated efficiently under certain structural equation restrictions, allowing for causal regularization of predictive models.

Proposes CAL to learn causal adjacency for better spatiotemporal prediction.

problem Suboptimal performance in spatiotemporal prediction due to out-of-distribution data.
method Causal Adjacency Learning (CAL) method to discover causal relations over graphs.
result Calculated causal adjacency matrix enhances prediction performance on out-of-distribution test data.

The paper investigates causal relationships in heart failure prediction using machine learning.

problem Understanding the causal relationships between clinical variables and heart failure.
method Proposes a new computational framework for causal structure discovery (CSD) of mixed-type clinical variables for binary disease outcomes.
result Feature importance from nonlinear classifiers strongly correlates with causal strength of variables, but not differentiating cause and effect.

Caus-Modens uses deep ensembles to better predict causal outcomes in hidden confounding scenarios.

problem Predicting causal outcomes in the presence of hidden confounders.
method Caus-Modens employs a modulated ensemble approach to improve prediction intervals for causal outcomes using sensitivity models.
result Caus-Modens provides tighter prediction intervals for causal outcomes compared to existing methods.

The paper develops a method to discover causal relations and predict material laws with uncertainty quantification.

problem Discovering causal relations and predicting material laws with uncertainty in civil engineering applications.
method The paper develops a causal discovery algorithm to infer causal relations among time-history data. It uses a deep neural network with dropout layers for uncertainty quantification and propagates predictions through a causal graph.
result The method accurately predicts material laws and quantifies uncertainty, as demonstrated in two numerical examples.

Predictive models can be used for causal inference with feature selection.

problem Limitations of predictive models in interpreting causal relationships.
method Constrained learning process by selecting features according to Pearl's backdoor adjustment criterion.
result Causal models provide near unbiased effect estimates and better generalization.

Causal autoregressive flows enable accurate causal inference and prediction.

problem Causal discovery and interventional predictions in machine learning.
method Autoregressive normalizing flows with fixed variable orderings.
result Causal models derived from autoregressive flows are identifiable and allow for accurate interventional and counterfactual predictions.

Optimization algorithm CoCo improves causal inference from diverse data.

problem Identifying true causal relationships from data with spurious associations.
method CoCo optimizes for causal inference using environments with invariant causal relationships.
result CoCo provides more accurate causal estimates and predictions.

We interpret black box predictive models using causal attribution.

problem Interpreting models trained using machine learning in high-stakes applications.
method Estimate causal effects of model inputs on output using observational data.
result Effective interpretation of black box predictive models via causal attribution.

The paper tackles stock prediction models by improving their generalizability to out-of-sample domains using causal representation learning.

problem Low signal-to-noise ratio and nonstationary nature of financial markets lead to poor performance of stock prediction models.
method The paper investigates Domain Generalization techniques, focusing on causal representation learning to improve model generalizability. It introduces a novel error bound and a causal discovery technique to mitigate spurious correlations.
result The proposed approach enhances the generalizability of stock prediction models, as demonstrated by numerical results.

CASTLE learns causal DAG to improve model generalization.

problem Improving model generalization to out-of-sample data.
method CASTLE learns causal relationships via adjacency matrix embedded in neural network input layers, reconstructing only causal features.
result CASTLE leads to better out-of-sample predictions compared to other regularizers.

Bayesian Hierarchical Invariant Prediction refines ICP for better scalability and prior integration.

problem Improving computational scalability and invariance testing for causal inference.
method Bayesian Hierarchical structure to test invariance under heterogeneous data.
result Demonstrated improved scalability and potential as an alternative to ICP.

This paper evaluates deferring systems using causal inference.

problem Evaluating the impact of deferring systems on model accuracy is challenging.
method The paper uses a causal inference framework to evaluate deferring systems, distinguishing between scenarios with and without access to human predictions.
result The approach allows identifying causal effects of deferring strategies on predictive accuracy.

Causality-aware methods outperform linear residualization in confounding adjustment for anticausal prediction.

problem Adjusting for confounding in anticausal prediction tasks.
method Causality-aware counterfactual confounding adjustment.
result Causality-aware methods asymptotically outperform linear residualization in predictive performance.

Paper proposes mechanism learning to reverse causal inference in ML.

problem Machine learning models learn associational, not causal, relationships.
method Causally weighted Gaussian mixture models (CW-GMMs).
result CW-GMMs can deconfound observational data for reverse causal inference.

Proposes a method to explain black-box models using causal learning.

problem Existing explainability methods focus on micro-level inputs, not interpretable features.
method Learns causal graphical representations to differentiate between causal and confounding influences.
result Graphs can differentiate between interpretable and confounding features.

Proposes DRIG for robust predictions using noise interventions.

problem Developing robust prediction models against distribution shifts.
method Distributional Robustness via Invariant Gradients (DRIG) exploiting general noise interventions.
result DRIG yields robust predictions among a data-dependent class of distribution shifts.

Integrating causal machine learning with inherently interpretable models for decision support.

problem Providing causal insights and decision support through machine learning models.
method Proposing an approach that integrates causal machine learning with inherently interpretable models.
result The proposed approach achieves competitive performance in prediction and what-if analysis while offering transparency on the system structure, causal relationships among variables, and functional forms connecting them.

Novel causal effect estimators and distributionally robust prediction methods.

problem Estimating causal effects and distributional robustness in statistical models.
method Developed novel estimators and proposed a general framework for distributional robustness.
result Mean squared error improvements in causal effect estimation compared to existing methods.

RealCause provides a realistic benchmark for causal inference.

problem Lack of a reliable benchmark for comparing causal effect estimators.
method Flexible generative models to create a benchmark that is both ground-truth and realistic.
result Evaluation of over 1500 causal estimators provides evidence for choosing hyperparameters using predictive metrics.

CTRF combines logged data and randomized experiments for robust prediction.

problem Robust prediction models to handle distributional shifts between training and testing data.
method CTRF uses existing training data and a small amount of randomized experiment data to train a robust model.
result CTRF produces robust predictions and outperforms baseline methods in the presence of feature shifts.

The paper proposes a SSL framework for complex causal models using unlabelled data.

problem Understanding how unlabelled data can improve SSL in complex causal models.
method The paper explores flexible causal graph structures and designs causal generative models to generate synthetic labelled data.
result The proposed method effectively improves predictive model accuracy using synthetic labelled data generated from unlabelled data.

Causal discovery predicts unobserved joint statistics from observed data.

problem Inferring properties of unobserved joint distributions from observed data.
method Infer causal models from observed data to predict statistical properties of unobserved sets.
result Sparse causal graphs can be more useful than dense ones in predicting unobserved joint distributions.

Invariant Causal Set Covering Machines avoid spurious associations.

problem Learning algorithms for rule-based models are vulnerable to spurious associations.
method Building on invariant causal prediction, propose Invariant Causal Set Covering Machines for conjunctions/disjunctions of binary-valued rules.
result The method can identify causal parents of a variable of interest in polynomial time.

Framework achieves fairness in predictions using partially known causal graph over clusters of variables.

problem Achieving fairness in algorithmic decisions when causal graph knowledge is limited.
method Leverages a causal graph over clusters of variables to train a prediction model, reducing interventional distribution discrepancies.
result Framework strikes a better balance between fairness and accuracy than existing approaches under limited causal graph knowledge.

Paper shows hard computational limits for invariant causal prediction.

problem Hard computational limits for invariant causal prediction.
method Distributionally robust estimator with ellipse-shaped uncertain set.
result Estimation error rate can be arbitrarily slow for computationally efficient algorithms.

Proposes CTSDG model for better vehicle intention prediction across domains.

problem Domain generalization for vehicle intention prediction in dynamic environments.
method Structural causal model with recurrent latent variable integration.
result Consistent improvement in prediction accuracy compared to state-of-the-art methods.

MSCT predicts post-crash traffic speed using causal inference.

problem Time-varying confounding bias in post-crash traffic prediction.
method Marginal Structural Causal Transformer (MSCT) incorporating Marginal Structural Models and balanced loss function.
result MSCT outperforms state-of-the-art models in multi-step-ahead prediction.