In application domains such as healthcare, we want accurate predictive models that are also causally interpretable. In pursuit of such models, we propose a causal regularizer to steer predictive models towards causally-interpretable solutions and theoretically study its properties. In a large-scale analysis of Electron…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “causal regularization”
CASTLE learns causal DAG to improve model generalization.
problem Improving model generalization to out-of-sample data.
method CASTLE learns causal relationships via adjacency matrix embedded in neural network input layers, reconstructing only causal features.
result CASTLE leads to better out-of-sample predictions compared to other regularizers.
Study interpolating estimators for causal learning from observational data.
problem Learning causal models from observational data in complex model classes.
method Investigate min-norm interpolators and ridge-regularized regressors in a linearly confounded model.
result Interpolators cannot be optimal for causal learning under the principle of independent causal mechanisms, requiring stronger regularization.
We quantify causal bias in continuous treatment settings.
problem Identifying and quantifying causal bias in continuous treatment scenarios.
method Developed a novel characterization of causal bias in structural causal models, proving conditions for zero bias and efficient estimation.
result Causal bias can be estimated efficiently under certain structural equation restrictions, allowing for causal regularization of predictive models.
Regularization methods can overregulate, suppressing causal features.
problem Mitigating shortcuts in models exploiting spurious correlations.
method Analysis of regularization methods and their effects on causal features.
result Regularization can overregulate, suppressing causal features.
Unified techniques improve stability and replicability in changing data.
problem Concept drift in data generating distribution.
method Removing hidden confounding and causal regularization.
result Improves stability, replicability, and robustness in heterogeneous data.
Counterexample disproves Borde-Sorkin conjecture on causal continuity of Morse spacetimes.
problem Disproving the Borde-Sorkin conjecture on causal continuity of Morse spacetimes.
method Provided a counterexample with low regularity causal structure and causal bubbling.
result Borde-Sorkin conjecture does not hold for Morse spacetimes with large anisotropy.
Consistent partial identification of causal effects proved for neural models.
problem Consistency of neural causal partial identification methods.
method Proving consistency for neural models with continuous and categorical variables, considering architecture design and Lipschitz regularization.
result Proven consistency of partial identification via neural causal models in a general setting.
A method identifies domain-general features using causal graph constraints and regularization.
problem Identifying domain-general features without prior knowledge of spurious features.
method Proposes a novel regularization framework based on causal graph constraints.
result Demonstrates effectiveness in both synthetic and real-world data, outperforming state-of-the-art methods.
This paper frames causal structure estimation as a machine learning task. The idea is to treat indicators of causal relationships between variables as `labels' and to exploit available data on the variables of interest to provide features for the labelling task. Background scientific knowledge or any available interven…
Geometric derivation of Einstein equations from causal fermion systems.
problem Deriving Einstein's equations from a new theoretical framework.
method Analysis of causal fermion systems and causal action principle.
result Einstein equations derived from causal action principle.
We show that many standard results of Lorentzian causality theory remain valid if the regularity of the metric is reduced to . Our approach is based on regularisations of the metric adapted to the causal structure.
Proves Gannon-Lee theorem for spacetimes.
problem Classical singularity theorems for spacetimes.
method Proves theorem for spacetimes, shows geodesic properties.
result Gannon-Lee theorem holds for spacetimes.
We demonstrate the breakdown of several fundamentals of Lorentzian causality theory in low regularity. Most notably, chronological futures (defined naturally using locally Lipschitz curves) may be non-open, and may differ from the corresponding sets defined via piecewise -curves. By refining the notion of a causal…
Proposes Causal Loss to improve machine learning models' causal inference.
problem Machine learning algorithms often fail to capture causal relationships when data is inconsistent.
method Introduces Causal Loss, a model-agnostic loss function that enhances interventional capabilities.
result Causal Loss improves non-causal associative models to have interventional capabilities.
Our goal is to estimate causal interactions in multivariate time series. Using vector autoregressive (VAR) models, these can be defined based on non-vanishing coefficients belonging to respective time-lagged instances. As in most cases a parsimonious causality structure is assumed, a promising approach to causal discov…
New framework IDOL identifies latent causal processes with instantaneous relations from time series data.
problem Identifying latent causal processes with instantaneous relations from time series data.
method Sparse influence constraint and variational inference architecture with sparsity regularization.
result Our method can identify latent causal processes with instantaneous relations.
A neural network finds causal relationships among latent variables.
problem Learning causal structure among latent variables in high-dimensional data.
method Redundant Input Neural Network (RINN) with modified architecture and regularized objective function.
result The RINN method successfully recovers latent causal structure between input and output variables.
The paper extends completeness notions to low-regularity spacetimes.
problem Defining completeness conditions for spacetimes with low-regularity metrics.
method Extending Beem's completeness notions to Lorentzian length spaces and proving relationships between them.
result Equivalence of completeness conditions for globally hyperbolic -spacetimes under certain conditions.
We propose a formulation of a Lorentzian quantum geometry based on the framework of causal fermion systems. After giving the general definition of causal fermion systems, we deduce space-time as a topological space with an underlying causal structure. Restricting attention to systems of spin dimension two, we derive th…
Proves globally hyperbolic spacetimes via null distance completeness.
problem No Hopf-Rinow Theorem in Lorentzian Geometry.
method Observation of null distances and their behavior with time functions.
result Proves globally hyperbolic spacetimes via null distance completeness.
Dynamic CBDT improves treatment effect estimation in clinical data.
problem Estimating heterogeneous treatment effects in observational data with high accuracy and interpretability.
method Dynamic Regularized Causal Boosted Decision Trees (CBDT) integrating variance regularization and calibration.
result Significantly improved estimation accuracy and reliable coverage of true treatment effects.
Building machine learning models that are fair with respect to an unprivileged group is a topical problem. Modern fairness-aware algorithms often ignore causal effects and enforce fairness through modifications applicable to only a subset of machine learning models. In this work, we propose a new definition of fairness…
In this paper, a sparse Markov decision process (MDP) with novel causal sparse Tsallis entropy regularization is proposed.The proposed policy regularization induces a sparse and multi-modal optimal policy distribution of a sparse MDP. The full mathematical analysis of the proposed sparse MDP is provided.We first analyz…
Tree-based regularization improves latent variable inference from related datasets.
problem Inferring latent variables from multiple related datasets in causal systems.
method Tree-Based Regularization (TBR) for sparse changes across environments.
result TBR identifies true latent variables up to simple transformations under sparse changes.
We extend the validity of the Penrose singularity theorem to spacetime metrics of regularity . The proof is based on regularisation techniques, combined with recent results in low regularity causality theory.
New method interprets deep learning for causal effects, separating prognostic and moderating covariates.
problem Estimating individual causal/treatment effects under confounders.
method Deep counterfactual learning architecture for estimating CATE with interpretable score functions.
result Demonstrated improved interpretability and quantification of uncertainty in CATE estimation.
New principle for disentangling latent factors using sparse regularization.
problem Disentangling latent factors from complex data.
method Sparse regularization of latent mechanisms to induce disentanglement.
result Recovery of latent variables up to permutation under certain conditions.
New method identifies causal variables from multi-node interventions, expanding on previous single-node approaches.
problem Inferring high-level causal variables from low-level observations under multiple interventions.
method Exploits variance trace of ground truth causal variables and regularizes for sparsity.
result First identifiability result for causal representation learning with multiple node interventions.
New relation between curvature bounds and spacetime inextendibility.
problem Inextendibility of spacetimes under low regularity conditions.
method Synthetic curvature and causal character analysis.
result Low-regularity spacetimes with unbounded curvature.
TRESNET estimates exposure shifts with neural networks, improving causal inference.
problem Estimating the effect of distribution shift in treatment variables.
method Targeted Regularization for Exposure Shifts with Neural Networks (TRESNET).
result TRESNET provides robustness and efficiency guarantees for SRF estimation.
New relation between curvature bounds and spacetime inextendibility.
problem Inextendibility of spacetimes under low regularity conditions.
method Synthetic curvature and causal character maximizers.
result Low-regularity inextendibility linked to unbounded curvature.
New method improves causal effect estimation by addressing imbalance in training data.
problem Imbalance between treatment and control groups in training data.
method Combines distributionally robust optimization and weight regularization.
result Consistent improvements over existing methods in experiments.
The paper proposes a probabilistic autoencoder for discovering causal directions between variables.
problem Finding the causal direction between two associated variables.
method Building an autoencoder of the joint distribution and maximizing its estimation capacity relative to marginal distributions.
result The higher estimation capacity is consistent with the unconstrained choice of a distribution representing the cause, while the lower capacity reflects the constraints imposed by the mechanism on the distribution of the effect.
New technique learns causally disentangled representations for better generation.
problem Learning disentangled representations for accurate generation.
method Causally Disentangled Generation (CDG) approach with supervised regularization.
result CDG is necessary and sufficient for accurate disentangled generation.
Many Experiments, Few Repetitions, Unpaired Data, and Sparse Effects: Is Causal Inference Possible?stat.ML
Study on estimating causal effects with limited data and multiple environments.
problem Estimating causal effects under hidden confounding with unpaired data and sparse effects.
method Instrumental variable (IV) regression with cross-fold sample splitting and -regularized estimation.
result Proposed GMM-type estimator is consistent as the number of environments grows.
Most of previous machine learning algorithms are proposed based on the i.i.d. hypothesis. However, this ideal assumption is often violated in real applications, where selection bias may arise between training and testing process. Moreover, in many scenarios, the testing data is not even available during the training pr…
The paper proposes a neural network method to estimate treatment effects by balancing treated and control distributions.
problem Estimating individual and average treatment effects from observational data.
method Balance regularization of multi-head neural network architectures to reduce confounding effects.
result The approach reduces bias-variance trade-off and improves treatment effect estimation.
Combines structured inference and targeted learning to tackle causal inference challenges.
problem Treatment assignment heterogeneity and lack of counterfactual data.
method Factorizes joint distribution into risk, confounding, instrumental, and miscellaneous factors; applies regularizer derived from influence curve.
result TVAE demonstrates competitive and state-of-the-art performance on benchmark datasets.
Develops a mathematical framework for causal fermion systems in infinite dimensions.
problem Analysis of causal fermion systems in infinite-dimensional settings.
method Introduces Banach manifold structure and expedient differential calculus.
result Establishes Hölder continuity of causal Lagrangian and integrated causal Lagrangian.
One of the most fundamental problems in causal inference is the estimation of a causal effect when variables are confounded. This is difficult in an observational study, because one has no direct evidence that all confounders have been adjusted for. We introduce a novel approach for estimating causal effects that explo…
Proposes a method to create robust linear models with noisy proxies of unobserved variables.
problem Learning robust linear models to handle interventions on unobserved variables with noisy proxies.
method Regularization term that balances in-distribution performance and robustness to interventions.
result Single proxy can create prediction optimal estimators under interventions of bounded strength.
Regularizes ML algorithms for robust multivariate analysis against distribution shifts.
problem Ensuring robustness of multivariate analysis algorithms against distribution shifts.
method Integrates a causal regularisation term into the loss function of multivariate analysis algorithms.
result Demonstrates improved out-of-distribution generalisation with reduced-rank regression and partial least squares.
Develops efficient projections for multivariate probability measures.
problem Estimating causal effects and optimal weights in multivariate data.
method Tangent Wasserstein projections using generalized geodesics.
result Provides a unique solution for causal inference and optimal weights.
We provide a detailed proof of Hawking's singularity theorem in the regularity class , i.e., for spacetime metrics possessing locally Lipschitz continuous first derivatives. The proof uses recent results in -causality theory and is based on regularisation techniques adapted to the causal structure.
The paper examines how timing of observations affects causal discovery methods.
problem The sensitivity of causal discovery methods to mismatched observation timing.
method Empirical and theoretical analysis of classical and recent causal discovery methods.
result Causal discovery methods are sensitive to sampling rate and window length.
New method improves domain generalization by aligning causal mechanisms across domains.
problem Improving model's ability to generalize across different distributions.
method Introduces invariance of average causal effect of features to labels, regularizing training approach.
result Demonstrates superior performance on benchmark datasets compared to state-of-the-art methods.
Asymptotically flat static causal fermion systems are introduced. Their total mass is defined as a limit of surface layer integrals which compare the measures describing the asymptotically flat spacetime and a vacuum spacetime near spatial infinity. Our definition does not involve any regularity assumptions; it even ap…