Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

15294458 · Jun 202019922001200920172026
48 results for non-linear confounding

Study evaluates machine learning for predicting treatment effects in observational studies.

problem Challenges in measuring treatment effects due to confounding bias in observational studies.
method Simulated two scenarios with and without confounding, using linear and non-linear relationships. Used machine learning models (linear regression, lasso regression, random forest) to predict counterfactuals and treatment effects.
result Machine learning models perform well under linearity but poorly under non-linearity, even in the presence of confounding.

Method learns causal effects from multiple interventions in presence of unobserved confounders.

problem Disentangling causal effects from sets of interventions in the presence of unobserved confounders.
method Non-linear structural causal models with additive, multivariate Gaussian noise; algorithm that learns causal model parameters by pooling data from different regimes and maximizing combined likelihood.
result Identification proofs demonstrate that causal effects of single interventions can be learned from sets of interventions, even with unobserved confounders.

This paper studies semiparametric contextual bandits, a generalization of the linear stochastic bandit problem where the reward for an action is modeled as a linear function of known action features confounded by an non-linear action-independent term. We design new algorithms that achieve O~(dT)\tilde{O}(d\sqrt{T}) regret …

2018-03-12abs ↗pdf ↗

Deep learning aids causal inference in complex settings.

problem Estimating heterogeneous treatment effects in non-linear, time-varying, and encoded confounders.
method Intuitive introduction to deep learning and causal inference, focusing on observational data.
result Maximizes accessibility to causal inference through deep learning.

Causal approaches to fairness have seen substantial recent interest, both from the machine learning community and from wider parties interested in ethical prediction algorithms. In no small part, this has been due to the fact that causal models allow one to simultaneously leverage data and expert knowledge to remove di…

2019-07-01abs ↗pdf ↗

Scalable GPLVM reduces complexity in scRNA-seq data, accounting for technical and biological confounders.

problem Complexity and confounders in scRNA-seq data hamper interpretation.
method Extended Gaussian process latent variable model (GPLVM) to handle large datasets.
result Framework reconstructs latent signatures and captures disease-specific gene expression.

I argue that regularizing terms in standard regression methods not only help against overfitting finite data, but sometimes also yield better causal models in the infinite sample regime. I first consider a multi-dimensional variable linearly influencing a target variable with some multi-dimensional unobserved common ca…

2019-06-28abs ↗pdf ↗

Extracts invariant features to predict Y without confounding by Z, using conditional independence and optimal transport.

problem Extracting invariant features to predict Y without confounding by Z, a response variable influenced by unknown confounders Z.
method Develops a methodology penalizing statistical dependence between feature and confounders conditioned on Y, using the Optimal Transport Barycenter Problem.
result The method extracts invariant features in the Gaussian case, equivalent to penalizing dependence between feature and conditional random variable Z_Y.

Study identifies parameters in causal models with latent confounding.

problem Parameter identification in linear non-Gaussian causal models with latent confounding.
method Graphical criterion for necessary and sufficient identifiability of direct causal effects, with polynomial-time algorithm.
result Developed a graphical criterion for identifying direct causal effects in latent variable models with arbitrary non-linear confounding.

Study improves sample complexity for distinguishing continuous distributions and causal relationships.

problem Distinguishing continuous distributions and causal relationships in the presence of unobserved confounding.
method Proposed an estimator of KL divergence based on von Mises expansion for closeness testing.
result Established sample complexity guarantees for causal discovery in non-linear models with continuous variables and unobserved confounding.

MOCA uses modular attention to estimate causal effects from complex data.

problem Estimating causal effects from observational data with complex, non-linear, and high-dimensional treatment and outcome mechanisms.
method MOCA is a transformer-based framework that separates treatment and outcome modeling through modular design and one-way attention mechanism, with cutting-feedback to prevent outcome influence on treatment representations.
result MOCA outperforms classical estimators and machine learning approaches across various simulated and real-world scenarios.

The paper proposes a method to precisely decompose confounders and estimate treatment effects.

problem Estimating treatment effects from observational data with confounder identification and balancing.
method Learning decomposed representations to identify and balance confounders and non-confounders.
result The method achieves more precise treatment effect estimation than existing methods.

A new method detects interactions in machine learning models.

problem Interpreting non-linear and interaction effects in machine learning models.
method Regional effect plots with implicit interaction detection.
result The method quantifies and interprets feature effects reliably, less confounded by interactions.

Causal inference from observational data requires assumptions. These assumptions range from measuring confounders to identifying instruments. Traditionally, causal inference assumptions have focused on estimation of effects for a single treatment. In this work, we construct techniques for estimation with multiple treat…

2018-05-21abs ↗pdf ↗

Detect hidden confounding in observational data using multiple environments.

problem Detect hidden confounding in observational data.
method Theoretical framework and simulation studies to test for hidden confounding.
result The proposed procedure correctly predicts hidden confounding, especially when bias is large.

Machine learning confound removal biases results, leading to misleading predictions.

problem Common confound removal methods in machine learning lead to misleading predictions.
method Featurewise removal of confound variance by linear regression before applying ML.
result This common deconfounding approach can leak information, amplifying null or moderate effects.

KRCD detects unobserved confounders in nonlinear observational data.

problem Detecting unobserved confounders in nonlinear observational studies.
method Kernel Regression Confounder Detection (KRCD) using reproducing kernel Hilbert spaces.
result KRCD outperforms existing methods and achieves superior computational efficiency.

Study identifies conditions for proxy adjustment in confounded binary treatment outcomes.

problem Average causal effect estimation with a non-differentially mismeasured binary confounder.
method Identifies conditions for proxy adjustment in the presence of a non-differentially mismeasured binary confounder.
result Adjusting for a non-differentially mismeasured binary proxy can improve estimation of the average causal effect.

New method estimates policy performance under unobserved confounding.

problem Estimating policy performance when decisions depend on unobserved variables.
method Developed worst-case bounds for robust OPE under unobserved confounding.
result Efficient procedure for computing worst-case bounds, proving statistical consistency.

Consistent estimator derived for confounding strength in observational data.

problem Estimating confounding strength in observational data is challenging due to unobserved confounders.
method Derived and adapted a consistent estimator using tools from random matrix theory.
result The original estimator is not consistent, but an adapted one is.

A new method uses randomized trials to estimate the strength of unobserved confounding.

problem Unobserved confounding compromises causal conclusions from non-randomized studies.
method Designs a statistical test to detect unobserved confounding strength and estimates a lower bound.
result Estimates an asymptotically valid lower bound on unobserved confounding strength.

Proposes tests to control confounding bias in predictive models.

problem Lack of non-parametric tests for confounding bias in predictive modeling.
method Partial and full confounder tests for probing null hypotheses of unconfounded and fully confounded models.
result Reveals previously unreported or hard-to-correct confounders in machine learning models.

New method tackles confounded bandit problems with dual instrumental variables.

problem Confounded contextual bandit problems where noise affects both contexts and rewards.
method Dual instrumental variable regression applied to reproducing kernel Hilbert spaces.
result Near-optimal convergence rate and computationally efficient algorithms proved.

New methods prioritize acquiring confounding features for efficient treatment effect estimation.

problem Efficient treatment effect estimation from observational data with missing confounding information.
method Proposes two acquisition strategies: covariate balancing and reducing factual outcome error.
result Our proposed methods, especially reducing factual outcome error, improve sample efficiency for treatment effect estimation.

Valid causal inference with unobserved confounding in high-dimensional settings.

problem Estimating causal effects with unobserved confounders in high-dimensional data.
method Proposes methods to estimate causal effects with valid confidence intervals in the presence of unobserved confounders and high-dimensional nuisance models.
result Valid semiparametric inference can be obtained with unobserved confounding, and uncertainty intervals are proposed.

Spectral deconfounding improves machine learning models by reducing hidden confounding effects.

problem Machine learning models can be misled by hidden confounders, leading to unreliable predictions.
method Develops a nonlinear spectral deconfounding framework for gradient boosting that modifies boosting dynamics to slow down in confounding-aligned directions.
result Spectrally deconfounded boosting improves estimation of the target function under hidden confounding and is more scalable.

We propose a method for inferring the existence of a latent common cause ('confounder') of two observed random variables. The method assumes that the two effects of the confounder are (possibly nonlinear) functions of the confounder plus independent, additive noise. We discuss under which conditions the model is identi…

2012-05-09abs ↗pdf ↗

Estimates causal effects with selection bias and confounding using regression.

problem Estimating causal effects in presence of selection bias and confounding.
method Two-step regression estimator (TSR) that corrects for selection bias and accounts for confounding.
result TSR estimator reduces variance and is validated in simulations.

Paper tackles backwards-compatible data adaptation for confounded covariate and label shifts.

problem Adapt covariates to predict labels confounded with covariate shifts.
method Proposes confounded shift framework based on minimizing divergence between source and target conditional distributions, conditioning on confounders.
result Demonstrates approach on synthetic and real datasets, achieving backwards-compatible data adaptation.

Deep CITs test conditional independence in images, improving brain MRI scan analysis.

problem Testing conditional independence in complex, high-dimensional variables like images.
method Combines embedding maps and nonparametric CITs for feature representations.
result Valid DNCITs for brain MRI scans and behavioral traits, confirming null results.