Proposes a new model for handling missing data.
problem Nonignorable missingness in data.
method Variational autoencoder architecture with pattern-set mixtures.
result Achieves state-of-the-art imputation performance.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “missingness patterns”
CACTI improves tabular data imputation by leveraging missingness patterns and contextual information.
problem Tabular data imputation with improved accuracy and robustness.
method Masked autoencoding approach with median truncated copy masking and contextual information.
result Average gain of 7.8% over the next best method across various datasets and missingness conditions.
GRU-D detects age-specific missing patterns in vital signs.
problem Temporal missingness in clinical time series data.
method Gated recurrent unit with decay mechanisms (GRU-D) trained on MIMIC-IV vital signs.
result GRU-D achieves AUROC 0.780 and AUPRC 0.810 on bootstrapped data.
A Unified Framework for Inference with General Missingness Patterns and Machine Learning Imputationstat.ME
Unified ML imputation framework for missing data.
problem Invalid inference with incomplete data and ML imputations.
method Stratified by missingness patterns, weights and aggregates complete case information.
result Valid statistical inference for general missingness patterns.
Deep learning for missing data with flexible modelling.
problem Missing data with missingness dependent on the missing values.
method Deep latent variable models with a neural network for missingness pattern modeling, importance-weighted variational inference, and stochastic gradients.
result Explicitly modelling missingness improves inference on various data sets.
We demonstrate a simple strategy to cope with missing data in sequential inputs, addressing the task of multilabel classification of diagnoses given clinical time series. Collected from the pediatric intensive care unit (PICU) at Children's Hospital Los Angeles, our data consists of multivariate time series of observat…
ICYM2I corrects missingness bias in multimodal learning.
problem Missingness patterns between source and target environments affect multimodal learning performance.
method ICYM2I uses inverse probability weighting to correct missingness bias in predictive performance and information gain.
result ICYM2I improves multimodal learning performance by accounting for missingness.
Study improves healthcare time series imputation by considering structured missingness.
problem Structured missingness in clinical data impacts time series imputation models.
method Analysis of different masking strategies on imputation methods using PhysioNet Challenge 2012 dataset.
result Masking choices significantly affect imputation accuracy and clinical prediction.
A new method for handling missing values in data.
problem Handling missing values in machine learning models.
method Sharing pattern submodels with sparsity-inducing regularization.
result Sharing pattern submodels provide robust predictions and maintain/improve pattern submodel performance.
Imputation-Powered Inferencestat.ME
Imputation-Powered Inference improves subpopulation efficiency in missing data settings.
problem Complex missing data patterns challenge standard inference methods.
method Imputation-Powered Inference (IPI) combines blackbox imputation with bias correction.
result IPI provides valid and efficient M-estimation under MCAR blockwise missingness.
Missing data is a significant problem impacting all domains. State-of-the-art framework for minimizing missing data bias is multiple imputation, for which the choice of an imputation model remains nontrivial. We propose a multiple imputation model based on overcomplete deep denoising autoencoders. Our proposed model is…
Flexible model tackles high-dimensional, missing data, and stochastic processes.
problem High-dimensional longitudinal data with structured missingness and unknown measurement time points.
method Latent variable model using Gaussian processes and variational autoencoder.
result Competitive performance on simulated and real datasets.
Study improves conformal prediction for missing covariate data.
problem Uncertainty quantification with missing covariate values.
method Generalized conformalized quantile regression framework, missing data augmentation.
result Improved prediction intervals valid conditionally to missing data patterns.
Novel imputation method for EHRs with structured and sporadic missingness.
problem Missing data in integrated EHR datasets for clinical applications.
method Macomss, a novel imputation framework for structurally and heterogeneously missing data.
result Macomss outperforms existing methods in imputation and downstream prediction accuracy.
Study improves feature acquisition for static settings in AFAPE.
problem Evaluate AFAPE performance in static feature settings.
method Derive and adapt IPW, DM, and DRL estimators for MAR and MNAR missingness.
result Improved data efficiency in synthetic and real-world experiments.
Proposes a proportional masking strategy for better tabular data imputation.
problem Heterogeneity of tabular data disrupts uniform random masking in MAEs.
method Computes missingness statistics, generates proportional masks, uses MLP token mixing.
result Proportional masking preserves missingness distribution, improves imputation performance.
Although data may be abundant, complete data is less so, due to missing columns or rows. This missingness undermines the performance of downstream data products that either omit incomplete cases or create derived completed data for subsequent processing. Appropriately managing missing data is required in order to fully…
Efficiently learns Gaussian distributions from censored data with known missingness patterns.
problem Learning high-dimensional Gaussian distributions from data with missing values.
method Developed algorithms for self-censoring and linear thresholding scenarios.
result Achieved efficient learning of Gaussian distributions up to a specified total variation distance.
In the traditional framework of spectral learning of stochastic time series models, model parameters are estimated based on trajectories of fully recorded observations. However, real-world time series data often contain missing values, and worse, the distributions of missingness events over time are often not independe…
Paper proposes a novel method to reduce mutual information for missing data imputation.
problem Missing data imputation in datasets with missingness patterns.
method Iterative minimization of KL divergence between imputed data and missingness mask, using rectified flow training objective.
result The proposed method achieves superior imputation performance on synthetic and real-world datasets.
NeuMiss networks tackle supervised learning with missing values, offering efficient and robust predictions.
problem Challenges in supervised learning with missing values, especially when the response is a linear function of the complete data.
method Derive analytical form of optimal predictor under linearity assumption and various missing data mechanisms. Propose NeuMiss networks using multiplication by missingness indicator.
result Upper bound on Bayes risk and good predictive accuracy with independent complexity of missing data patterns.
Time series cluster kernels to exploit informative missingness and incomplete label informationcs.LG
The time series cluster kernel (TCK) provides a powerful tool for analysing multivariate time series subject to missing data. TCK is designed using an ensemble learning approach in which Bayesian mixture models form the base models. Because of the Bayesian approach, TCK can naturally deal with missing values without re…
Generative Modeling under Non-Monotone MAR Missingness via Approximate Wasserstein Gradient Flowsstat.ML
FLOWGEM generates complete datasets from incomplete data with non-monotone MAR missingness.
problem Dealing with non-monotone Missing at Random (MAR) missingness in data.
method Iterative particle evolution of Wasserstein Gradient Flow, approximated by local linear estimators of density ratio.
result FLOWGEM achieves state-of-the-art performance across various settings, including non-monotone MAR mechanisms.
PAIN network improves imputation for mixed datasets.
problem Missing data in diverse scientific domains.
method Dynamic adaptive imputation using statistical methods, random forests, and autoencoders.
result PAIN outperforms traditional imputation methods in preserving data distributions.
Bayes predictor remains robust to ignorable missingness shifts.
problem Challenges in prediction with missing covariates and shifts in missingness reasons.
method Bayesian approach and different prediction methods.
result Bayes predictor remains unchanged by ignorable shifts, but robust prediction requires disregarding missingness for non-ignorable shifts.
New method tackles MNAR missingness in domain adaptation.
problem Handling missingness in both source and target data.
method Reduces MNAR missingness to imputation problem, leveraging recent MNAR imputation methods.
result Developed a novel domain adaptation procedure for MNAR missingness shift.
Tree-based LSTM improves sequential regression with missing data.
problem Regression for variable-length sequential data with missing samples.
method Tree architecture of LSTM networks, selecting LSTM networks based on presence-pattern of previous inputs.
result Significant performance improvements on financial and real-life datasets.
Matrix completion is often applied to data with entries missing not at random (MNAR). For example, consider a recommendation system where users tend to only reveal ratings for items they like. In this case, a matrix completion method that relies on entries being revealed at uniformly sampled row and column indices can …
Accurate prediction of disease trajectories is critical for early identification and timely treatment of patients at risk. Conventional methods in survival analysis are often constrained by strong parametric assumptions and limited in their ability to learn from high-dimensional data, while existing neural network mode…
PbP strategy improves logistic model prediction with missing values.
problem Predicting with missing inputs in logistic models.
method Pattern-by-Pattern (PbP) strategy for logistic models with missing values.
result PbP accurately approximates Bayes probabilities under GPMM across various missing data scenarios.
New taxonomy for structured missingness in large-scale databases.
problem Handling missing values in structured data.
method Introducing a new taxonomy for Structured Missingness (SM) and embedding it within existing mechanisms.
result Demonstrated the impact of Structured Missingness on inference and prediction.
New algorithms learn staged trees from incomplete data.
problem Handling missing data in staged tree learning.
method Characterized likelihood and pseudo-likelihoods for missing data, implemented structural expectation-maximization algorithm.
result It is feasible to account for different missingness patterns when learning staged trees.
VHGM-MAE generates synthetic humans from healthcare data.
problem Handling high-dimensional, sparse healthcare data with missing values.
method Masked autoencoder (MAE) tailored for healthcare data, addressing heterogeneity, missingness, and high-dimensionality.
result VHGM-MAE outperforms existing methods in missing value imputation and synthetic data generation.
New method corrects missing data bias in dimension reduction.
problem Missing data complicates high-dimensional data analysis.
method Developed a bias-corrected Gram matrix for heterogeneous missingness.
result Proposed method improves dimension reduction techniques significantly.
Selective imputation improves treatment effect estimation from missing data.
problem Missing data complicates treatment effect estimation, especially with treatment variables.
method Introduced mixed confounded missingness (MCM) and selective imputation.
result Selective imputation provides unbiased treatment effect estimates.
New algorithms handle missing outcomes in MAB, reducing regret.
problem Missing outcomes in real-world MAB scenarios lead to biased estimates and linear regret.
method Introduced algorithms for MAR and MNAR missingness mechanisms in MAB.
result Significant improvements in decision-making by accounting for missingness.
We present a method for incorporating missing data in non-parametric statistical learning without the need for imputation. We focus on a tree-based method, Bayesian Additive Regression Trees (BART), enhanced with "Missingness Incorporated in Attributes," an approach recently proposed incorporating missingness into deci…
New approach improves AI's handling of incomplete data.
problem Improving AI's ability to work with incomplete data.
method Proposes a new likelihood-free EM algorithm for faster, more efficient inference.
result More statistically efficient than masking approach and faster than conventional EM.
A large fraction of the electronic health records (EHRs) consists of clinical measurements collected over time, such as lab tests and vital signs, which provide important information about a patient's health status. These sequences of clinical measurements are naturally represented as time series, characterized by mult…
Fairness audits fail under missing protected labels, especially at zero access.
problem Understanding the reliability of fairness audits with incomplete protected-label data.
method Introduced a seed-calibrated stress test to separate missingness effects from seed-to-seed movement.
result Missing protected labels do not significantly alter fairness mitigation methods, but they can lead to harmful intersectional outcomes.
The paper studies OPE with missing data, showing bias under nonignorable missingness and proposing a solution.
problem Estimating value of a target policy from logged data with missingness.
method Investigates OPE with monotone missingness, proposes an IPW value estimator, and conducts statistical inference.
result Value estimates remain unbiased under ignorable missingness but can be biased under nonignorable missingness.
New DL model handles missing data in biomedical datasets.
problem Handling missing data in modern biomedical datasets.
method Proposed a new DL architecture, dlglm, for generalized linear models.
result Outperforms existing methods in MNAR missingness scenarios.
Multivariate time series data in practical applications, such as health care, geoscience, and biology, are characterized by a variety of missing values. In time series prediction and other related tasks, it has been noted that missing values and their missing patterns are often correlated with the target labels, a.k.a.…
MIRRAMS framework tackles robust tabular learning under unseen missingness shifts.
problem Challenges in achieving robust predictive performance due to shifts in missingness distribution between training and test inputs.
method Introduces MI robustness conditions and MIRRAMS framework to enforce these conditions without specific missingness assumptions.
result Consistently outperforms existing state-of-the-art baselines and maintains stable performance under diverse missingness conditions.
Structured missing data complicates machine learning, presenting new challenges.
problem Structured missingness in data hinders machine learning at scale.
method No specific method is proposed; challenges are outlined.
result Structured missingness poses fundamental hindrance to machine learning.
Simulation study evaluates tree-based imputation methods for multi-level data.
problem Ignoring dependencies in hierarchical data can compromise imputation accuracy.
method Chained Random Forests and Extreme Gradient Boosting (mixgb) adapted for multi-level data.
result Adapted boosting methods outperform traditional MICE for Level-1 variables at higher missingness rates.
Two methods use BART to model missing data in leaf photosynthetic trait data.
problem Handling missing data in multivariate outcomes with non-ignorable mechanisms.
method Bayesian Additive Regression Trees (BART) for joint modeling of data and missingness indicators.
result Both methods effectively recover various missingness mechanisms and outperform existing approaches.
SSLfmm package improves semi-supervised learning by incorporating informative missingness in finite mixture models.
problem Improving semi-supervised learning with informative missingness in datasets.
method Estimates Bayes' classifier under a finite mixture model with MCAR and MAR missingness mechanisms.
result The classifier trained on partially labelled data can achieve lower misclassification rates than supervised methods.