A new method detects unknown classes and adapts to extra dimensions in high-dimensional classification.
problem Handling unknown classes and extra variables in high-dimensional classification.
method Dimension-Adaptive Mixture Discriminant Analysis (D-AMDA) using an EM algorithm for model estimation.
result The method can adapt to unknown classes and extra dimensions in high-dimensional data.
The paper examines fairness issues in decision-making systems when protected class labels are unobserved.
problem Fairness assessment challenges when protected class labels are unavailable.
method Decomposes biases in estimating outcome disparity via threshold-based imputation and proposes a weighted estimator.
result Threshold-based imputation generally overestimates disparities, while the weighted estimator has a simpler negative bias.
Study tackles causal structure learning in linear models with unobserved variables and measurement error.
problem Challenges of unobserved common causes and measurement error in causal structure learning.
method Introduces LV-SEM-ME model with four types of variables and characterizes identifiability under separability condition.
result Establishes form of identification robustness for target effect in broader LV-SEM-ME model.
We identify causal models with unobserved confounding using bijective generation mechanisms.
problem Identifying causal relationships with unobserved confounders.
method Establish counterfactual identifiability for BGMs and propose a learning method.
result Learned BGMs enable efficient counterfactual estimation.
Introduces an unobservable intrinsic electricity price to link storage theory with risk premium.
problem Connecting storage theory with risk premium in electricity markets.
method Introduces an unobservable intrinsic electricity price and derives prices for various contracts.
result Finds an overall negative risk premium in empirical analysis.
GEEN uses deep learning to estimate unobserved variables from observed data.
problem Estimating unobserved variables in latent variable models.
method GEEN uses deep learning with Kullback-Leibler distance to map observed measurements to latent variable realizations.
result GEEN provides a method to identify and estimate latent variables in a class of models.
Causal discovery predicts unobserved joint statistics from observed data.
problem Inferring properties of unobserved joint distributions from observed data.
method Infer causal models from observed data to predict statistical properties of unobserved sets.
result Sparse causal graphs can be more useful than dense ones in predicting unobserved joint distributions.
Paper identifies unobserved variables from observable data.
problem Missing variables in empirical studies.
method Function mapping from observables to unobservables based on joint distribution.
result Uniqueness of latent values in each observation.
Single proxy variable helps estimate causal effects from confounders.
problem Estimating causal effects from treatment to outcome when unobserved confounders are present.
method Assumes a single, potentially multi-dimensional proxy variable of the unobserved confounder and a known mechanism generating the proxy from the confounder. Proves causal effects are identifiable under completeness assumption.
result Causal effects are identifiable under SPICE assumption.
Predicts accuracy of classifiers on unseen classes.
problem Unknown accuracy of classifiers on unseen classes.
method Defined rROC to estimate classifier accuracy on unseen classes.
result Robust algorithm CleaneX achieves better predictions.
KRCD detects unobserved confounders in nonlinear observational data.
problem Detecting unobserved confounders in nonlinear observational studies.
method Kernel Regression Confounder Detection (KRCD) using reproducing kernel Hilbert spaces.
result KRCD outperforms existing methods and achieves superior computational efficiency.
Valid causal inference with unobserved confounding in high-dimensional settings.
problem Estimating causal effects with unobserved confounders in high-dimensional data.
method Proposes methods to estimate causal effects with valid confidence intervals in the presence of unobserved confounders and high-dimensional nuisance models.
result Valid semiparametric inference can be obtained with unobserved confounding, and uncertainty intervals are proposed.
A new method uses randomized trials to estimate the strength of unobserved confounding.
problem Unobserved confounding compromises causal conclusions from non-randomized studies.
method Designs a statistical test to detect unobserved confounding strength and estimates a lower bound.
result Estimates an asymptotically valid lower bound on unobserved confounding strength.
NeuralCSA uses neural networks to analyze causal effects under unobserved confounding.
problem Challenges in causal inference from observational data due to unobserved confounding.
method Proposes a neural framework (NeuralCSA) for generalized causal sensitivity analysis.
result Demonstrates theoretical and empirical validity of NeuralCSA for causal inference.
Graphs help identify unobserved confounders in causal inference.
problem Unobserved confounders skew causal inference from observational data.
method Causal graphical view and probabilistic factor models.
result The deconfounder algorithm makes valid inferences of intervention distributions.
New method estimates treatment effects over time with unobserved confounders.
problem Estimating treatment effects from observational data with unobserved confounders.
method Sequential Deconfounder using Gaussian process latent variable model.
result Unbiased estimates of individualized treatment responses over time.
Spatial first differences used to estimate effects of unobservable geographic factors on agricultural productivity.
problem Estimating causal effects in the presence of unobservable heterogeneity.
method Developed a cross-sectional research design using spatial first differences (SFD) to identify causal effects.
result New estimates for the effects of time-invariant geographic factors on long-run agricultural productivities.
New method scores DAGs by identifying unobserved confounding.
problem Unobserved confounding complicates causal discovery.
method Score-based causal discovery algorithm that accounts for unobserved confounding.
result Sparse linear Gaussian DAGs can be recovered from observed data.
New method recovers predictions from unobservable source subpopulation in binary classification.
problem Challenging binary classification with unobservable subpopulation in source domain.
method Distribution matching method to estimate subpopulation proportions, rigorous derivation of prediction models.
result Our method outperforms naive benchmarks in synthetic and real-world datasets.
New method estimates policy performance under unobserved confounding.
problem Estimating policy performance when decisions depend on unobserved variables.
method Developed worst-case bounds for robust OPE under unobserved confounding.
result Efficient procedure for computing worst-case bounds, proving statistical consistency.
Adapts pretrained models to new classes without additional training.
problem Training models on limited labels and predicting new, unseen classes.
method Uses Fréchet mean instead of argmax for prediction, leveraging metric space distances.
result Improves model performance on unseen classes by up to 29.7% on ImageNet.
CDVAE estimates treatment effects over time by accounting for unobserved variables.
problem Estimating treatment effects over time in the presence of unobserved confounders.
method Causal Dynamic Variational Autoencoder (CDVAE) that addresses unconfoundedness and unobserved heterogeneity.
result CDVAE outperforms existing methods in estimating Conditional Average Treatment Effects (CATEs).
Paper tackles unobserved confounding in human-AI collaborations.
problem Unobserved confounding undermines human-AI collaboration effectiveness.
method Combines sensitivity analysis from causal inference with AI-driven statistical modeling.
result Enhances robustness and reliability of collaborative outcomes.
Proposes ρ-GNF for sensitivity analysis of unobserved confounding.
problem Sensitivity analysis of unobserved confounding in observational studies.
method Copulas and normalizing flows to estimate average causal effect (ACE) as a function of unobserved confounding strength.
result Develops ρcurve to provide bounds for ACE and identify confounding strength required to nullify ACE. Estimates individual causal effects in the presence of unobserved confounders.
problem Learning CATE under unconfoundedness violations.
method Develops a functional interval estimator that predicts bounds on individual causal effects.
result Sharp interval estimator converges to tightest bounds on CATE.
Use network embeddings to correct for unobserved confounding.
problem Causal inference in the presence of unobserved confounding.
method Use network embeddings to semi-supervised predict treatments and outcomes.
result Valid causal inferences under suitable conditions on predictive model quality.
Paper adapts DML for panel data, addressing unobserved heterogeneity.
problem Estimating causal effects with panel data and unobserved heterogeneity.
method Adapting double/debiased machine learning (DML) for panel data with predictive models based on correlated random effects.
result Predictive models based on correlated random effects within DML lead to accurate coefficient estimates.
New method removes hidden confounders for unbiased treatment effect estimation.
problem Bias in treatment effect estimation due to unobserved confounders.
method Proposes a new debiased estimation approach via SVD to handle heterogeneous confounding.
result Established rate of convergence for the estimator under different noise conditions.
The paper tackles robust domain generalization by accounting for unobserved confounders.
problem Learning robust, generalizable models from multiple datasets in the presence of unobserved confounders.
method Defines a new invariance property for causal solutions, connects it to distributionally robust optimization, and incorporates regularization to encourage partial equality of error derivatives.
result Demonstrates the empirical effectiveness of the approach on healthcare data from various modalities.
Improved method for unbiased causal discovery in presence of unobserved confounding.
problem Unbiased data synthesis for causal discovery algorithms in the presence of unobserved confounding.
method Explicit block-hierarchical ancestral sampling to address limitations of implicit parameterization.
result Our approach fully covers the space of causal models, including those generated by implicit parameterization.
Paper challenges recent methods for causal inference with multiple causes and unobserved confounders.
problem Causal inference with multiple causes and unobserved confounders.
method Analytical counterexamples and impossibility proofs.
result Nonparametric identification is impossible for causal inference with multiple causes and unobserved confounders.
New framework for estimating treatment effects in observational studies.
problem Estimating average treatment effects in the presence of unobserved confounders.
method Distributionally robust optimization, sensitivity models.
result Sharp bounds on average treatment effects under distributional assumptions.
New method identifies causal effects with categorical unobserved confounders.
problem Estimating causal effects in the presence of unobserved confounders.
method Mixture learning and tensor decomposition for consistent estimation.
result Causal effects are identifiable with categorical unobserved confounders under suitable conditions.
The paper shows how to audit fairness in decisions with hidden risk factors.
problem Estimating fairness in decisions influenced by hidden, unobservable risk factors.
method Derives unbiased estimates of risk using historical data and audits existing decision-making systems.
result One can compute meaningful bounds on treatment rates for high-risk individuals, even with hidden confounders.
Develops Austen plots for assessing bias from unobserved confounding in observational studies.
problem Bias in causal estimates due to unobserved confounding.
method Formalizes confounding strength, uses Austen plots to visualize and quantify bias.
result Allows domain experts to assess the plausibility of strong confounders.
New method for finding optimal treatment regimes in medical settings with time-varying unobserved factors.
problem Finding optimal treatment regimes in medical settings with time-varying unobserved factors.
method Extend Dynamic Treatment Regimes (DTRs) to Ambiguous Dynamic Treatment Regimes (ADTRs), connect to Ambiguous Partially Observable Mark Decision Processes (APOMDPs), and develop Reinforcement Learning methods.
result Established theoretical results for learning methods, including consistency and asymptotic normality.
Hedge funds have long been viewed as a veritable "black box" of investing since outsiders may never view the exact composition of portfolio holdings. Therefore, the ability to estimate an informative set of asset weights is highly desirable for analysis. We present a compositional state space model for estimation of an…
Motivated by modern applications in which one constructs graphical models based on a very large number of features, this paper introduces a new class of cluster-based graphical models, in which variable clustering is applied as an initial step for reducing the dimension of the feature space. We employ model assisted cl…
For later use in subsequent upcoming arxiv.org prepublications, basic foundational material on local, smooth or real analytic, CR-generic submanifolds of complex Euclidean spaces is developed from scratch, with strong emphasis on the interplay between extrinsic and intrinsic aspects, a constructive option that commands…
New bounds assess policy evaluation under unobserved confounders, showing model-based methods are more effective.
problem Policy evaluation under unobserved confounders in uncertain causal environments.
method Developed worst-case bounds for sensitivity to unobserved confounders, demonstrating model-based methods are more effective.
result Model-based approaches with robust MDPs provide sharper lower bounds for policy evaluation.
Proposes a method to assess unobserved confounding effects in causal inference.
problem Assessing unobserved confounding in causal inference studies.
method Copula-based normalizing flows with sensitivity parameter ρ. result Estimates average causal effect (ACE) as a function of unobserved confounding strength.
Intact-VAE estimates treatment effects with latent confounders.
problem Estimating treatment effects under unobserved confounding.
method Intact-VAE, a VAE variant, models latent confounders to identify treatment effects.
result Intact-VAE is a consistent estimator of treatment effects under certain settings.
Bayesian state estimation improves accuracy for unobservable power distribution systems.
problem State estimation for unobservable distribution systems.
method Deep learning approach with distribution learning, Monte Carlo training, and Bayesian bad-data detection.
result Deep learning outperforms existing benchmarks in state estimation accuracy.
Ancestral graph models, introduced by Richardson and Spirtes (2002), generalize both Markov random fields and Bayesian networks to a class of graphs with a global Markov property that is closed under conditioning and marginalization. By design, ancestral graphs encode precisely the conditional independence structures t…
Estimates Granger causality with unobserved confounders using deep latent-variable recurrent neural networks.
problem Non-linear Granger causality with unobserved confounders in observational studies.
method Generative model with latent variable, variational autoencoder, recurrent neural network.
result Estimated confounders improve performance in non-linear Granger causality with multiple proxies.
Optimal trading strategy with unobservable pricing errors for co-integrated assets.
problem Dynamic portfolio optimization of convergence trading with unobservable pricing errors.
method Modeling of convergence trading strategy with unobservable Markov-modulated pricing errors, extending Liu and Timmermann (2013) model.
result Characterization of optimal portfolio strategies in full and partial information settings.
This work restricts hidden cardinality in causal models to infer causal relations.
problem Causal relations between variables with a common unobserved cause cannot be directly inferred.
method Derive inequality constraints from d-separation in causal models with known cardinalities of unobserved variables.
result Inference of causal relations is possible with additional assumptions about cardinalities.
This work highlights problems with off-policy estimation in recommender systems due to unobserved confounders.
problem Evaluation of recommender systems under unobserved confounders.
method Policy-based estimators and characterisation of statistical bias due to confounding.
result Naive propensity estimation under confounding leads to severely biased metric estimates.