This paper introduces a new method to deceive causal structure learning by omitting data.
problem Deceiving causal structure learning algorithms with incompletely observed data.
method Adversarial missingness attack to bias the learned causal structures.
result Theoretical and practical attack mechanisms are developed for various SCMs.
Proposes a new model for handling missing data.
problem Nonignorable missingness in data.
method Variational autoencoder architecture with pattern-set mixtures.
result Achieves state-of-the-art imputation performance.
Bayes predictor remains robust to ignorable missingness shifts.
problem Challenges in prediction with missing covariates and shifts in missingness reasons.
method Bayesian approach and different prediction methods.
result Bayes predictor remains unchanged by ignorable shifts, but robust prediction requires disregarding missingness for non-ignorable shifts.
New method tackles MNAR missingness in domain adaptation.
problem Handling missingness in both source and target data.
method Reduces MNAR missingness to imputation problem, leveraging recent MNAR imputation methods.
result Developed a novel domain adaptation procedure for MNAR missingness shift.
ICYM2I corrects missingness bias in multimodal learning.
problem Missingness patterns between source and target environments affect multimodal learning performance.
method ICYM2I uses inverse probability weighting to correct missingness bias in predictive performance and information gain.
result ICYM2I improves multimodal learning performance by accounting for missingness.
New taxonomy for structured missingness in large-scale databases.
problem Handling missing values in structured data.
method Introducing a new taxonomy for Structured Missingness (SM) and embedding it within existing mechanisms.
result Demonstrated the impact of Structured Missingness on inference and prediction.
DRIO improves time series imputation by minimizing reconstruction error and distributional divergence.
problem Bias in imputation due to mismatch between observed and true data distributions.
method DRIO minimizes reconstruction error and worst-case divergence using Wasserstein ambiguity set.
result DRIO consistently provides robust imputation and improved forecasting.
GRU-D detects age-specific missing patterns in vital signs.
problem Temporal missingness in clinical time series data.
method Gated recurrent unit with decay mechanisms (GRU-D) trained on MIMIC-IV vital signs.
result GRU-D achieves AUROC 0.780 and AUPRC 0.810 on bootstrapped data.
New method corrects missing data bias in dimension reduction.
problem Missing data complicates high-dimensional data analysis.
method Developed a bias-corrected Gram matrix for heterogeneous missingness.
result Proposed method improves dimension reduction techniques significantly.
CACTI improves tabular data imputation by leveraging missingness patterns and contextual information.
problem Tabular data imputation with improved accuracy and robustness.
method Masked autoencoding approach with median truncated copy masking and contextual information.
result Average R2 gain of 7.8% over the next best method across various datasets and missingness conditions. Selective imputation improves treatment effect estimation from missing data.
problem Missing data complicates treatment effect estimation, especially with treatment variables.
method Introduced mixed confounded missingness (MCM) and selective imputation.
result Selective imputation provides unbiased treatment effect estimates.
New algorithms handle missing outcomes in MAB, reducing regret.
problem Missing outcomes in real-world MAB scenarios lead to biased estimates and linear regret.
method Introduced algorithms for MAR and MNAR missingness mechanisms in MAB.
result Significant improvements in decision-making by accounting for missingness.
We present a method for incorporating missing data in non-parametric statistical learning without the need for imputation. We focus on a tree-based method, Bayesian Additive Regression Trees (BART), enhanced with "Missingness Incorporated in Attributes," an approach recently proposed incorporating missingness into deci…
Handling missing data is one of the most fundamental problems in machine learning. Among many approaches, the simplest and most intuitive way is zero imputation, which treats the value of a missing entry simply as zero. However, many studies have experimentally confirmed that zero imputation results in suboptimal perfo…
Fairness audits fail under missing protected labels, especially at zero access.
problem Understanding the reliability of fairness audits with incomplete protected-label data.
method Introduced a seed-calibrated stress test to separate missingness effects from seed-to-seed movement.
result Missing protected labels do not significantly alter fairness mitigation methods, but they can lead to harmful intersectional outcomes.
The paper studies OPE with missing data, showing bias under nonignorable missingness and proposing a solution.
problem Estimating value of a target policy from logged data with missingness.
method Investigates OPE with monotone missingness, proposes an IPW value estimator, and conducts statistical inference.
result Value estimates remain unbiased under ignorable missingness but can be biased under nonignorable missingness.
MIRRAMS framework tackles robust tabular learning under unseen missingness shifts.
problem Challenges in achieving robust predictive performance due to shifts in missingness distribution between training and test inputs.
method Introduces MI robustness conditions and MIRRAMS framework to enforce these conditions without specific missingness assumptions.
result Consistently outperforms existing state-of-the-art baselines and maintains stable performance under diverse missingness conditions.
Structured missing data complicates machine learning, presenting new challenges.
problem Structured missingness in data hinders machine learning at scale.
method No specific method is proposed; challenges are outlined.
result Structured missingness poses fundamental hindrance to machine learning.
We propose a novel method for imputing missing data by adapting the well-known Generative Adversarial Nets (GAN) framework. Accordingly, we call our method Generative Adversarial Imputation Nets (GAIN). The generator (G) observes some components of a real data vector, imputes the missing components conditioned on what …
Simulation study evaluates tree-based imputation methods for multi-level data.
problem Ignoring dependencies in hierarchical data can compromise imputation accuracy.
method Chained Random Forests and Extreme Gradient Boosting (mixgb) adapted for multi-level data.
result Adapted boosting methods outperform traditional MICE for Level-1 variables at higher missingness rates.
Two methods use BART to model missing data in leaf photosynthetic trait data.
problem Handling missing data in multivariate outcomes with non-ignorable mechanisms.
method Bayesian Additive Regression Trees (BART) for joint modeling of data and missingness indicators.
result Both methods effectively recover various missingness mechanisms and outperform existing approaches.
SSLfmm package improves semi-supervised learning by incorporating informative missingness in finite mixture models.
problem Improving semi-supervised learning with informative missingness in datasets.
method Estimates Bayes' classifier under a finite mixture model with MCAR and MAR missingness mechanisms.
result The classifier trained on partially labelled data can achieve lower misclassification rates than supervised methods.
New method reduces bias in incomplete data using deliberate missingness.
problem Systematic gradient biases in incomplete data for stochastic learning.
method Richardson-SGD debiasing procedure with deliberate missingness.
result Reduces gradient bias from O(∥p∥) to O(∥p∥2). Develop conformal prediction for dyadic regression under complex missingness.
problem Conformal prediction for dyadic regression under complex missingness mechanisms.
method Developing general technical tools and conformal prediction procedures for dyadic regression under complex missingness.
result Establishing asymptotic validity of weighted conformal prediction under a nonparametric graphon model for missingness mechanism.
AdapDISCOM tackles high-dimensional multimodal data with missingness and errors, improving prediction and biomarker selection.
problem High-dimensional multimodal data with block-wise missingness and measurement errors.
method AdapDISCOM introduces modality-specific weighting schemes to address heterogeneity and error magnitudes.
result AdapDISCOM consistently outperforms existing methods under heterogeneous contamination and heavy-tailed distributions.
Semi-supervised learning benefits from informative missing labels, improving classifier performance.
problem Missing labels in semi-supervised learning can be informative, improving classifier performance.
method Formulates missingness as a mixture model problem and uses EM algorithm for fitting.
result Modelling informative missingness can yield a classifier with smaller expected error than a completely labelled sample.
Study linear regression with missing or corrupted data, showing error bounds.
problem Linear regression under missing or corrupted data.
method Information-theoretic lower bounds and efficient algorithms.
result Error bounds match in missing and corruption settings.
Algorithm identifies missing data distributions in graphical models.
problem Identifying missing data distributions in graphical models with interventionist perspective.
method Tree-based identification algorithm that tracks selection bias and admissible intervention strategies.
result Valid estimating equations for missingness mechanism and complete data distribution.
Deep learning for missing data with flexible modelling.
problem Missing data with missingness dependent on the missing values.
method Deep latent variable models with a neural network for missingness pattern modeling, importance-weighted variational inference, and stochastic gradients.
result Explicitly modelling missingness improves inference on various data sets.
A model combines GRU-D for missing data and Neural ODEs for time series continuity.
problem Challenges of informative missingness in multivariate time series data.
method Combines GRU-D for missing data imputation and Neural ODEs for temporal continuity.
result Demonstrates improved performance on a time series classification task.
Flexible model tackles high-dimensional, missing data, and stochastic processes.
problem High-dimensional longitudinal data with structured missingness and unknown measurement time points.
method Latent variable model using Gaussian processes and variational autoencoder.
result Competitive performance on simulated and real datasets.
Method completes mixed matrix from complex surveys with heterogeneous missingness.
problem Recovering a mixed dataframe matrix from complex survey sampling with different missingness patterns.
method Two-stage procedure: logistic regression for missingness modeling, and weighted log-likelihood maximization with low-rank constraint.
result The proposed method achieves sublinear convergence and shows superior performance compared to existing methods.
Estimates disease prevalence using non-ignorable missing data in health surveys.
problem Estimating disease prevalence in non-representative samples with non-ignorable missing data.
method Connects auxiliary proxy variable framework to label shift setting, uses high-dimensional covariates without generative models.
result Fails to account for non-ignorable missingness can lead to significant misestimations.
Missing data are a concern in many real world data sets and imputation methods are often needed to estimate the values of missing data, but data sets with excessive missingness and high dimensionality challenge most approaches to imputation. Here we show that appropriate feature selection can be an effective preprocess…
Paper proposes WGAIN for missing feature reconstruction.
problem Missing data in datasets.
method Wasserstein Generative Adversarial Imputation Network (WGAIN) compared to traditional methods.
result WGAIN outperforms traditional methods in imputing missing data.
Machine learning portfolios perform well with simple imputation of missing data.
problem Handling missing values in machine learning portfolios constructed from cross-sectional return predictors.
method Simple imputation with cross-sectional means compared to rigorous expectation-maximization methods.
result Simple imputation performs well due to the structure of missing data.
Novel imputation method for EHRs with structured and sporadic missingness.
problem Missing data in integrated EHR datasets for clinical applications.
method Macomss, a novel imputation framework for structurally and heterogeneously missing data.
result Macomss outperforms existing methods in imputation and downstream prediction accuracy.
A new method for semi-supervised learning with missing data using GMM and margin confidence.
problem Handling missing data in semi-supervised learning with classification uncertainty.
method Explicitly models missingness mechanism, uses margin confidence and Aranda Ordaz function, develops ECM algorithm.
result Effective reduction of bias and robustness in semi-supervised learning with substantial missing labels.
New method handles missing data using AI for efficient inference.
problem Parameter estimation and inference with blockwise missing data.
method Tractable solution using AI models and semiparametric theory.
result IBM(RAY) and IBM(Adaptive) estimators achieve efficiency gains.
We demonstrate a simple strategy to cope with missing data in sequential inputs, addressing the task of multilabel classification of diagnoses given clinical time series. Collected from the pediatric intensive care unit (PICU) at Children's Hospital Los Angeles, our data consists of multivariate time series of observat…
Study on estimating Gaussian mean with missing data in high dimensions.
problem Estimating Gaussian mean in high dimensions with missing data due to realizable contamination.
method Statistical Query model, Low-Degree Polynomials, PTF tests, and algorithms.
result Established information-computation gap and developed efficient algorithms.
There is an emerging trend in the reinforcement learning for healthcare literature. In order to prepare longitudinal, irregularly sampled, clinical datasets for reinforcement learning algorithms, many researchers will resample the time series data to short, regular intervals and use last-observation-carried-forward (LO…
Emputation learns imputation models guided by missingness assumptions.
problem Learning imputation models for missing data given observed data.
method Guided by specific missingness assumptions, Emputation trains a deep generative model to learn the extrapolation distribution of missing variables.
result The population minimizer of the emputation risk recovers the target extrapolation distribution under various identification assumptions.
New model handles missing data effectively in autoregressive models.
problem Handling missing data in autoregressive models.
method Reinterpret existing models through missing data lens, introduce principled framework for incomplete datasets, active information acquisition.
result MO-ARM consistently outperforms imputation baselines across real-world benchmarks.
Imputation-Powered Inference improves subpopulation efficiency in missing data settings.
problem Complex missing data patterns challenge standard inference methods.
method Imputation-Powered Inference (IPI) combines blackbox imputation with bias correction.
result IPI provides valid and efficient M-estimation under MCAR blockwise missingness.
Bayesian approach models nonignorable missing data using copulas and marginal quantiles.
problem Nonignorable missing data in lead exposure and test score analysis.
method Gaussian copula model with auxiliary marginal quantiles for missingness indicators and study variables.
result Efficient MCMC algorithm estimates copula correlation and marginal distributions consistently.
Study improves healthcare time series imputation by considering structured missingness.
problem Structured missingness in clinical data impacts time series imputation models.
method Analysis of different masking strategies on imputation methods using PhysioNet Challenge 2012 dataset.
result Masking choices significantly affect imputation accuracy and clinical prediction.
Most deep learning classification studies assume clean data. However, when dealing with the real world data, we encounter three problems such as 1) missing data, 2) class imbalance, and 3) missing label problems. These problems undermine the performance of a classifier. Various preprocessing techniques have been propos…