Paper develops a new inequality for non-causal machine learning.
problem Current concentration inequalities cannot be applied to non-causal machine learning.
method Develops a framework for non-causal random fields and proves a Hoeffding-type inequality.
result Obtains a Hoeffding-type concentration inequality for non-causal random fields.
The paper proposes a method to stabilize predictions by identifying causal variables using a seed variable.
problem Stable prediction across unknown test data with potential spurious correlations.
method Conditional independence test based algorithm using a seed variable to separate causal from non-causal variables.
result The algorithm precisely separates causal and non-causal variables for stable prediction across test data.
Paper estimates non-causal graphical models using covariance extension and transportation distance.
problem Estimating non-causal graphical models with smoothing relations.
method Proposes a covariance extension problem and uses transportation distance to minimize error with white noise.
result Solution is a double-sided autoregressive non-causal graphical model.
Proposes Causal Loss to improve machine learning models' causal inference.
problem Machine learning algorithms often fail to capture causal relationships when data is inconsistent.
method Introduces Causal Loss, a model-agnostic loss function that enhances interventional capabilities.
result Causal Loss improves non-causal associative models to have interventional capabilities.
In this paper, we aim to develop a unified view of causal and non-causal feature selection methods. The unified view will fill in the gap in the research of the relation between the two types of methods. Based on the Bayesian network framework and information theory, we first show that causal and non-causal feature sel…
Predictive models can be used for causal inference with feature selection.
problem Limitations of predictive models in interpreting causal relationships.
method Constrained learning process by selecting features according to Pearl's backdoor adjustment criterion.
result Causal models provide near unbiased effect estimates and better generalization.
New method tests Granger non-causality in panel data with cross-sectional dependencies.
problem Testing Granger non-causality in panel data with cross-sectional dependencies.
method Proposes a new approach to aggregate p-values from panel members to test Granger non-causality, showing lower FDR.
result Our approach discovers true causal relations in panel data, unlike state-of-the-art methods.
Casper uses causal graph neural networks to improve spatiotemporal time series imputation.
problem Imputing missing values in spatiotemporal time series with confounders and non-causal correlations.
method Casper introduces a novel Prompt Based Decoder (PBD) and Spatiotemporal Causal Attention (SCA) to block confounders and discover causal relationships.
result Casper outperforms baselines and effectively discovers causal relationships in spatiotemporal time series imputation.
New study finds best language model architecture and pretraining objective for zero-shot tasks.
problem Evaluating which language model architectures and pretraining objectives best enable zero-shot generalization.
method Compared three model architectures and two pretraining objectives across 170 billion tokens, with and without finetuning.
result Causal decoder-only models trained on autoregressive language modeling exhibit strongest zero-shot generalization.
New method allows real-time audio synthesis using non-causal convolutions.
problem Real-time audio synthesis limitations due to offline model constraints.
method Post-training reconfiguration of non-causal models for real-time buffer-based processing.
result Non-causal streaming models can be transformed from offline-trained models without quality loss.
Express improves causal attention guarantees for language models.
problem Improving causal attention guarantees for language models.
method Introducing Express, a tool for converting non-causal attention into causal with matching guarantees.
result Express improves causal attention guarantees to log^(3/2)(n)/s with minimal memory and compression overhead.
Causal predictors don't generalize better across domains than non-causal predictors.
problem How well do causal predictors generalize across different domains?
method 16 prediction tasks on tabular datasets, selecting causal features.
result Causal predictors do not outperform non-causal predictors in domain generalization.
Optimization algorithm CoCo improves causal inference from diverse data.
problem Identifying true causal relationships from data with spurious associations.
method CoCo optimizes for causal inference using environments with invariant causal relationships.
result CoCo provides more accurate causal estimates and predictions.
Paper proposes mechanism learning to reverse causal inference in ML.
problem Machine learning models learn associational, not causal, relationships.
method Causally weighted Gaussian mixture models (CW-GMMs).
result CW-GMMs can deconfound observational data for reverse causal inference.
This paper introduces a new task to better understand Transformers in quantitative contexts.
problem Understanding Transformers in high-stakes quantitative and scientific applications.
method Introduces a novel contextual counting task and analyzes it with causal and non-causal Transformer architectures.
result Causal attention is better suited for the contextual counting task, and no positional embeddings lead to the best accuracy.
New algorithm speeds up causal inference for large data.
problem Efficiently estimating causal effects from large data.
method Causal Bag of Little Bootstraps (cBLOBS).
result Significantly improved computational efficiency with consistent estimates.
A new method selects robust features for ML models using causal discovery.
problem Challenges in feature selection for ML models with limited domain knowledge.
method Multidata causal feature selection using PC1 or PCMCI algorithms.
result The method improves model performance and provides interpretable drivers.
Bayesian meta-learning improves health prediction models across similar diseases.
problem Inter- and intra-task variability in healthcare predictions due to disease heterogeneity and patient differences.
method Bayesian meta-learning approach that models task similarity to mitigate negative transfer and improve generalizability.
result Significant generalizability improvements in stroke prediction tasks using electronic health record data.
New clustering method considers causal fairness to avoid bias.
problem Clustering algorithms can unintentionally propagate unfair disparities.
method Integrates causal fairness metrics into clustering algorithms.
result Demonstrates efficacy on datasets with known unfair biases.
CDM and CEE differ; accurate CEE isn't needed for CDM.
problem Understanding the difference between CDM and CEE.
method Highlighting the distinctions and implications of CDM and CEE.
result Accurate CEE is not necessary for accurate CDM.
Behavioral cloning reduces policy learning to supervised learning by training a discriminative model to predict expert actions given observations. Such discriminative models are non-causal: the training procedure is unaware of the causal structure of the interaction between the expert and the environment. We point out …
New study finds targeting based on treatment effects outperforms risk-based targeting in social interventions.
problem Lack of accurate treatment effect estimates for machine learning-based targeting in social domains.
method Empirical assessment of targeting strategies using data from 5 real-world RCTs in various domains.
result Treatment effect-based targeting outperforms risk-based targeting, even with biased estimates.
We consider linear models where d potential causes X1,...,Xd are correlated with one target quantity Y and propose a method to infer whether the association is causal or whether it is an artifact caused by overfitting or hidden common causes. We employ the idea that in the former case the vector of regression c…
New method learns unbiased treatment representations from structured high-dimensional data.
problem Estimating causal effects from high-dimensional, structured treatments.
method Contrastive learning approach to learn unbiased treatment representations.
result The method identifies causal factors and discards non-causal ones, leading to unbiased causal effect estimates.
New methods calibrate causal estimates using standard predictive models.
problem Calibrating causal treatment effect estimates.
method Developed algorithms to transform causal estimation into standard calibration.
result General algorithms for causal calibration using standard predictive models.
Novel framework uses causality for financial forecasting.
problem Balancing invariance and prediction accuracy in financial time series.
method Causality-inspired models for forecasting asset returns.
result Efficacy in stable and accurate predictions, especially in turbulent markets.
CGRL improves graph neural networks' OOD generalization by blocking spurious correlations.
problem Graph Neural Networks struggle with out-of-distribution data due to learning spurious correlations.
method Formulates a causal graph, uses backdoor adjustment, and introduces a loss replacement strategy.
result Significantly improves OOD generalization of GNNs, stabilizing mutual information learning.
COTA learns abstraction maps from data without complete SCM knowledge.
problem Learning causally consistent representations at different resolutions.
method Multi-marginal Optimal Transport (OT) with do-calculus constraints and interventional cost.
result COTA outperforms non-causal and independent formulations on synthetic and real-world problems.
Enhances causal estimation using unlabeled offline ICU data.
problem Assessing unmeasured physiological variables in new ICU patients.
method Three-stage approach: non-causal and causal estimators, causal filter, and prediction for new patients.
result Enhanced causal estimation for new ICU patients using offline data.
Summary statistics of genome-wide association studies (GWAS) teach causal relationship between millions of genetic markers and tens and thousands of phenotypes. However, underlying biological mechanisms are yet to be elucidated. We can achieve necessary interpretation of GWAS in a causal mediation framework, looking to…
New model improves data augmentation for causal tasks.
problem Optimizing causal models robustly under Wasserstein distances.
method Proposes a new G-Causal Normalizing Flow architecture.
result Empirically outperforms standard generative models.
OSA overcomes instability in skipless Transformers.
problem Instability in skipless Transformers using Softmax Self-Attention.
method OSA parametrizes attention matrix to be orthogonal via skew-symmetric matrix exponential.
result OSA allows for training non-causal Transformers without skip connections and normalisation layers.
CausAdv detects adversarial examples using causal reasoning.
problem Vulnerability of CNNs to adversarial perturbations.
method Causal framework based on counterfactual reasoning.
result Adversarial examples exhibit different CI distributions compared to clean samples.
We present a Hawkes model approach to foreign exchange market in which the high frequency price dynamics is affected by a self exciting mechanism and an exogenous component, generated by the pre-announced arrival of macroeconomic news. By focusing on time windows around the news announcement, we find that the model is …
Unified approach to causal representation learning using invariance principles.
problem Identifying latent causal variables from high-dimensional observations.
method Guiding identification of causal variables with invariance principles rather than causal hierarchies.
result Unified method that mixes causal and non-causal assumptions improves treatment effect estimation.
Adversarial CBO optimizes under interventions by adversaries and non-stationarities.
problem Optimizing in the presence of adversaries and non-stationary factors.
method Formalizes CBO as ACBO, introduces CBO-MW algorithm combining online learning and causal modeling.
result First algorithm with bounded regret for ACBO, achieving superior performance in synthetic and real-world environments.
While most classical approaches to Granger causality detection repose upon linear time series assumptions, many interactions in neuroscience and economics applications are nonlinear. We develop an approach to nonlinear Granger causality detection using multilayer perceptrons where the input to the network is the past t…
New method improves domain generalization by matching object representations.
problem Existing domain generalization methods fail to generalize to unseen domains.
method Proposes matching-based algorithms to match object representations across domains.
result MatchDG algorithm matches ground-truth object representations and improves out-of-domain accuracy.
Real-time speech enhancement model removes various noises and reverb.
problem Real-time speech enhancement in noisy environments.
method Causal speech enhancement model using encoder-decoder architecture with skip-connections, optimized in time and frequency domains.
result The model matches state-of-the-art performance while working directly on raw waveform.
Traditional pairwise sequence alignment is based on matching individual samples from two sequences, under time monotonicity constraints. However, in many application settings matching subsequences (segments) instead of individual samples may bring in additional robustness to noise or local non-causal perturbations. Thi…
Unobserved confounding is a major hurdle for causal inference from observational data. Confounders---the variables that affect both the causes and the outcome---induce spurious non-causal correlations between the two. Wang & Blei (2018) lower this hurdle with "the blessings of multiple causes," where the correlation st…
Dynamic Structural Causal Models handle time-dependent systems with cycles and latent confounding.
problem Representing and analyzing systems of Stochastic Differential Equations (SDEs) with DSCMs.
method Define time-splitting and subsampling operations to analyze DSCMs of SDEs, and apply existing causal discovery algorithms to time-series data.
result DSCMs provide a graphical Markov property for SDEs and enable identification of time-dependent causal effects.
Develops a new method to discover causal relationships from nonstationary time series data.
problem Challenges in inferring causal relationships from observational data, especially for nonstationary time series.
method State-Dependent Causal Inference (SDCI) for conditionally stationary time series.
result SDCI can recover underlying causal dependencies with provable identifiability for state-dependent causal structures.
Method constructs prediction intervals for time-varying individual treatment effects.
problem Accurately quantify uncertainty of individual treatment effects across multiple decision points.
method Conformal inference techniques for time-varying ITEs with weaker assumptions.
result Guaranteed lower bound for coverage dependent on data non-exchangeability.
Many questions in Data Science are fundamentally causal in that our objective is to learn the effect of some exposure, randomized or not, on an outcome interest. Even studies that are seemingly non-causal, such as those with the goal of prediction or prevalence estimation, have causal elements, including differential c…
This work tackles OOD generalization by leveraging causal invariance without needing to recover causal features.
problem Learning models that perform well on out-of-distribution (OOD) data.
method Causal invariant transformations to modify non-causal features while preserving causal parts.
result Theoretical and practical methods to learn a minimax optimal model across domains using single domain data.
Recourse explanations can become invalid if collective actions change statistical data.
problem Recourse explanations may become invalid due to collective behavior changing data statistics.
method Formal characterization of conditions under which recourse explanations remain valid under performativity.
result Recourse actions may become invalid if they are influenced by or intervene on non-causal variables.
Method preserves quantiles to ensure fairness in data adaptation.
problem Ensuring fairness in classification and regression models.
method Quantile preservation in causal structural equation models.
result Fairness guarantees for classifiers trained on adapted data.