kNNSampler imputes missing values from their distributions using kNN.
problem Impute missing values from their distributions.
method Randomly samples from the observed responses of the k most similar units.
result Estimates the conditional distribution of missing values.
Paper presents a method for imputing and forecasting structural response from incomplete sensor data.
problem Missing sensor data in structural health monitoring (SHM).
method Incremental Bayesian tensor learning for spatiotemporal missing data reconstruction and forecasting.
result The proposed method achieves accurate and robust imputation and prediction even with high rates of missing data.
IRTCI uses IRT for categorical imputation, outperforming other methods in various datasets.
problem Missing data in datasets limits model testing and statistical inference.
method Item Response Theory for Categorical Imputation (IRTCI) based on IRT.
result IRTCI outperformed kNN, MICE, and Datawig in various datasets.
Improved quantile estimation using semi-supervised data.
problem Quantile estimation in high-dimensional settings with limited labeled data.
method Proposes semi-supervised estimators using a flexible imputation strategy and debiasing step.
result Improved estimation accuracy compared to supervised methods, robust to misspecification.
TabSODA improves imputation of surveys with skips and ordinal data.
problem Handling structural skips and ordinal responses in survey data.
method TabSODA uses an Elucidated Diffusion Model with skip pattern detection and ordinal awareness.
result TabSODA reduces ordinal missing-at-random (MACE) by up to 23.7% and improves categorical accuracy by up to 9%.
Deep learning models outperform MICE in large survey imputation but with hyperparameter tuning.
problem Comparing deep learning and MICE for missing data imputation in large surveys.
method Extensive simulation studies comparing four machine learning-based MI methods: MICE with classification trees, MICE with random forests, generative adversarial imputation networks, and multiple imputation using denoising autoencoders.
result MICE with classification trees consistently outperforms deep learning methods in terms of bias, mean squared error, and coverage.
LLMs generate answers under incomplete context, and their uncertainty should scale with missing information.
problem Evaluating the quality of LLM answers under incomplete context.
method A controlled framework with varying context availability, and two uncertainty measures (sampling-based confidence and response entropy) evaluated on SQuAD.
result Response entropy increases with context removal and explains more variance in accuracy than confidence, suggesting it is a more responsive uncertainty measure.
Online surveys have the potential to support adaptive questions, where later questions depend on earlier responses. Past work has taken a rule-based approach, uniformly across all respondents. We envision a richer interpretation of adaptive questions, which we call dynamic question ordering (DQO), where question order …
In the supervised high dimensional settings with a large number of variables and a low number of individuals, one objective is to select the relevant variables and thus to reduce the dimension. That subspace selection is often managed with supervised tools. However, some data can be missing, compromising the validity o…
Paper reinterprets marginal productivity theory using vectorial products, challenging traditional ethical interpretations.
problem Challenges traditional ethical interpretations of marginal productivity theory.
method Formulates marginal productivity theory using vectorial marginal products, contrasting with traditional scalar approach.
result Vectorial marginal products conflict with traditional distributive shares picture of property.
Proposes methods to correct bias and missing data in regression models.
problem Nonignorable selection bias and missing response in regression models.
method Imputation-based and importance weighted regression methods, including repeated regression and doubly robust combination.
result Repeated regression can effectively correct bias and outperforms weighted regression in extrapolation.
PbP strategy improves logistic model prediction with missing values.
problem Predicting with missing inputs in logistic models.
method Pattern-by-Pattern (PbP) strategy for logistic models with missing values.
result PbP accurately approximates Bayes probabilities under GPMM across various missing data scenarios.
Item Response Theory (IRT) is a ubiquitous model for understanding humans based on their responses to questions, used in fields as diverse as education, medicine and psychology. Large modern datasets offer opportunities to capture more nuances in human behavior, potentially improving test scoring and better informing p…
New method improves statistical inference using machine learning-imputed data.
problem Improving statistical inference with imputed data from machine learning.
method Two-phase sampling approach for Z-estimation with ML-imputed outcomes.
result Guaranteed efficiency matching or exceeding classical inference, regardless of prediction quality.
Theoretical analysis of MCR for improving imputation quality in partially observed data.
problem Improving model generalization in partially observed settings.
method Theoretical analysis of Measure Consistency Regularization (MCR) for neural network distance.
result MCR's generalization advantage is not always guaranteed and can be monitored through a duality gap.
Estimates price sensitivity from transaction data using a novel odds ratio method.
problem Estimate price sensitivity from transaction-level data with partially observed treatment assignments.
method Recursive partitioning procedure with adversarial imputation for robust estimation.
result Validated on synthetic data and applied to three case studies, demonstrating heterogeneity in treatment effects.
New algorithm speeds up IRT model fitting for large datasets.
problem Inefficient algorithms for fitting Item Response Theory models to large datasets.
method Stochastic Variational Inference for IRT models.
result Higher log likelihoods and accuracy in imputing missing data.
This study compares logistic regression and XGBoost for predicting credit risk.
problem Predicting credit risk in financial services.
method Advanced machine learning techniques (logistic regression and XGBoost) with data preprocessing.
result XGBoost outperforms logistic regression in predicting credit risk.
Study improves conformal prediction for missing covariate data.
problem Uncertainty quantification with missing covariate values.
method Generalized conformalized quantile regression framework, missing data augmentation.
result Improved prediction intervals valid conditionally to missing data patterns.
We propose a general, theoretically justified mechanism for processing missing data by neural networks. Our idea is to replace typical neuron's response in the first hidden layer by its expected value. This approach can be applied for various types of networks at minimal cost in their modification. Moreover, in contras…
MISTR improves HTE estimation in survival data with heavy censoring and instrumental variables.
problem Estimating HTE in survival data with censoring and unobserved confounders.
method MISTR uses recursively imputed survival trees to handle censoring and instrumental variables.
result MISTR outperforms existing methods under heavy censoring and instrumental variable settings.
A new imputation method MissARF uses adversarial random forests for fast and accurate missing value imputation.
problem Handling missing values in biostatistical analyses.
method Adversarial Random Forests (ARF) for density estimation and data synthesis.
result MissARF performs comparably to state-of-the-art methods in imputation quality and runtime.
Proposes CBMI for missing data imputation using labels and input.
problem Missing data in practical data science settings.
method CBMI: imputes labels and input simultaneously; IUL: stacks label into input.
result CBMI improves classification accuracy, especially for imbalanced and categorical data.
IGANI uses iterative GANs to improve traffic data imputation.
problem Imputation of traffic data in the absence of sensor data.
method Iterative Generative Adversarial Networks (IGANI) for unsupervised learning.
result IGANI produces more accurate imputation results compared to previous methods.
A new PCA-based imputation method for high-dimensional data.
problem Missing data in high-dimensional datasets.
method Principal Component Analysis Imputation (PCAI) framework.
result PCAI significantly speeds up imputation and maintains high accuracy.
Imputation for prediction often offers limited benefits, especially with powerful models.
problem The challenge of missing data in predictive models.
method Comparative analysis of imputation methods across various predictive models and datasets.
result Advanced imputation methods often offer limited benefits for powerful predictive models.
Framework for imputing time series data with uncertainty measures.
problem Handling missing values in time series data, especially in healthcare.
method Uncertainty-aware multivariate time series imputation framework.
result Selective imputation of less uncertain values improves downstream tasks.
CSDI improves time series imputation by 40-65% over existing methods.
problem Imputing missing values in time series data.
method Conditional Score-based Diffusion models conditioned on observed data.
result CSDI improves by 40-65% over existing probabilistic imputation methods on popular metrics.
MTSCI uses diffusion models to impute multivariate time series data with consistency.
problem Imputation of missing values in multivariate time series data.
method MTSCI employs a contrastive complementary mask and mixup mechanism to ensure intra-consistency and inter-consistency.
result MTSCI achieves state-of-the-art performance on multivariate time series imputation tasks.
Study examines parallel computing strategies for faster imputation of missing data.
problem Time-consuming iterative imputation methods for large datasets.
method Variable-wise and model-wise distributed parallel computing strategies in missForest.
result Variable-wise distributed strategy introduces additional biases in imputation results.
Study compares imputation methods' effects on IML confidence intervals.
problem Missing data impacts IML interpretation and confidence intervals.
method Compared single vs multiple imputation methods on IML confidence intervals.
result Multiple imputation provides closer coverage to nominal than single imputation.
New research shows imputation and regression together can predict better than separate steps.
problem Predicting with data missing values without strong assumptions.
method Proposes a joint imputation and regression approach using NeuMiss neural network.
result Joint imputation and regression outperforms separate imputation and regression methods.
The paper compares theoretical and empirical performance of imputation methods for missing data.
problem Missing data in real-world datasets.
method Contrast of theoretical and empirical imputation methods for prediction.
result Mean-imputation is asymptotically optimal for prediction, while mode-imputation is sub-optimal.
New criteria improve imputation model selection using MOO.
problem Selecting the best imputation model using prediction accuracy metrics.
method Introduced three modified MOO criteria based on rank transformation, energy distance, and likelihood principle.
result Demonstrated how MOO is related to missing-at-random assumption and derived statistical and computational learning theories.
New algorithm improves data imputation for complex multimodal data sets.
problem Artifacts in imputation methods for multimodal distributions.
method Combines kNN and KDE for probabilistic estimates. result Lower imputation errors and higher likelihood estimates.
GANs improve missing data imputation for ranking tasks.
problem Missing data in ranking datasets violates standard assumptions.
method Conditional Imputation GAN for Extended Missing At Random and Extended Always Missing At Random mechanisms.
result Optimal GAN imputation for EMAR and EAMAR mechanisms.
Improved time series classification with imputed data using label-guided forest-based methods.
problem Missing data in time series data.
method Label-guided imputation using forest-based proximity measures.
result Imputation leads to higher classification accuracies, even with imputed values differing from true values.
Autoencoder improves imputation across various missing data types.
problem Efficiently impute missing data in diverse datasets.
method Developed a deep autoencoder framework for consistent training and imputation.
result Autoencoder outperformed state-of-the-art methods in all experiments.
IFGAN uses feature-specific GANs for missing value imputation.
problem Missing value imputation in data mining.
method Feature-specific Generative Adversarial Networks (GAN).
result IFGAN outperforms state-of-the-art algorithms in various missing conditions.
Missing data imputation can help improve the performance of prediction models in situations where missing data hide useful information. This paper compares methods for imputing missing categorical data for supervised classification tasks. We experiment on two machine learning benchmark datasets with missing categorical…
Kernel ridge regression imputation with consistent variance estimation for handling missing data.
problem Handling missing data in statistical analysis.
method Kernel ridge regression imputation combined with entropy method for variance estimation.
result Root-n consistency of the imputation estimator in a Sobolev space setting.
New method for imputing missing data in multi-view data.
problem Large missing data sets in multi-view data.
method Stacked penalized logistic regression (StaPLR) in a dimension-reduced space.
result New method performs competitively with lower computational cost.
Paper introduces metrics to evaluate missing data imputation without ground truth.
problem Handling missing data in time series without ground truth.
method Introduces Wasserstein distance (WD) and Jensen-Shannon divergence (JSD) as metrics to evaluate imputation quality.
result WD and JSD are effective metrics for assessing missing data imputation quality.
This work proposes a non-iterative strategy for missing value imputations which is guided by similarity between observations, but instead of explicitly determining distances or nearest neighbors, it assigns observations to overlapping buckets through recursive semi-random hyperplane cuts, in which weighted averages are…
Paper proposes methods to handle missing data in online RL, improving efficiency and uncertainty capture.
problem Missing data in online RL poses challenges due to the need to impute and act at each time step.
method Proposes fully online imputation ensembles and multiple imputation pathways to balance uncertainty and efficiency.
result Preliminary evidence suggests multiple imputation pathways can be a useful framework for simple and efficient online missing data RL methods.
New online imputation method for mixed data improves accuracy and speed.
problem Missing value imputation in online settings for mixed data types.
method Online Gaussian copula model for imputation and change point detection.
result The model improves accuracy and speed, especially on large datasets.
Paper addresses high-dimensional linear regression with missing data, proposing efficient and nearly unbiased estimators.
problem High-dimensional linear regression with blockwise missing covariates and partially observed responses.
method Proposes a computationally efficient estimator and nearly unbiased debiased estimators using blockwise imputation and estimating equations.
result Asymptotically valid confidence intervals and statistical tests constructed based on debiased estimators.
LSSDM improves imputation of multivariate time series data.
problem Imputation of multivariate time series data without labels.
method LSSDM projects observed data into latent space, reconstructs missing values without labels, and uses a conditional diffusion model for precise imputation.
result LSSDM achieves superior imputation performance and uncertainty analysis.