Optimal algorithms for online convex optimization with missing sub-gradient observations.
problem Online convex optimization with noisy or missing sub-gradient observations.
method Adaptive algorithms using sub-gradient descent with minimax optimal regret guarantees.
result Achieves tight minimax optimal regret bounds with empirical property estimation.
kNNSampler imputes missing values from their distributions using kNN.
problem Impute missing values from their distributions.
method Randomly samples from the observed responses of the k most similar units.
result Estimates the conditional distribution of missing values.
Method infers dynamics from incomplete time series data.
problem Challenges in inferring stochastic dynamics from time series with missing data.
method Expectation Maximization (EM) algorithm that iterates between E-step and M-step.
result The EM algorithm effectively recovers missing data points and infers underlying network models from real neuronal activities.
This paper addresses missing covariates in stochastic linear bandits, providing a high-probability regret bound.
problem Effect of missing covariates on regret in stochastic linear bandit algorithms.
method Proposes an algorithm that provides a high-probability upper bound on regret in terms of covariate sampling probabilities.
result Regret degrades due to missingness by at most ζmin2, where ζmin is the minimum probability of observing covariates. AugMask trains diffusion models on incomplete tabular data by augmenting missing values and applying denoising supervision.
problem Training diffusion models on incomplete tabular data with missing values.
method AugMask uses stochastic augmentation and denoising supervision to adapt diffusion models to incomplete data.
result AugMask enables diffusion-based tabular generators to outperform specialized missing-aware baselines across various datasets and missingness regimes.
Proposes a method to fill in missing swaption volatility data using variational autoencoders.
problem Missing swaption volatility data due to market illiquidity.
method Variational autoencoders for learning latent volatility representations, Gibbs sampling for inference.
result Imputed missing volatilities are robust and close to SABR fits.
Gaussian Processes improve missing value imputation in datasets.
problem Handling missing values in large datasets.
method Sparse Gaussian Processes combined with stochastic variational inference.
result MGP significantly outperforms other imputation methods.
New method reduces bias in incomplete data using deliberate missingness.
problem Systematic gradient biases in incomplete data for stochastic learning.
method Richardson-SGD debiasing procedure with deliberate missingness.
result Reduces gradient bias from O(∥p∥) to O(∥p∥2). JRFs improve semi-supervised learning by balancing generation and classification.
problem Mode missing and mode covering issues in GANs and VAEs, and conflict between good classification and generation.
method Joint-stochastic-approximation random fields (JRFs) for deep undirected generative models.
result JRFs achieve good classification and generation results in SSL.
Random imputation is surprisingly effective for linear predictors in missing data scenarios.
problem The effectiveness of naive imputation in missing data scenarios for linear predictors.
method A unique random features model framework to study predictive performances.
result Naive imputation is negligible in bias for linear predictors under MCAR assumption.
In the traditional framework of spectral learning of stochastic time series models, model parameters are estimated based on trajectories of fully recorded observations. However, real-world time series data often contain missing values, and worse, the distributions of missingness events over time are often not independe…
The autoregressive (AR) model is a widely used model to understand time series data. Traditionally, the innovation noise of the AR is modeled as Gaussian. However, many time series applications, for example, financial time series data, are non-Gaussian, therefore, the AR model with more general heavy-tailed innovations…
When training a machine learning model with observational data, it is often encountered that some values are systemically missing. Learning from the incomplete data in which the missingness depends on some covariates may lead to biased estimation of parameters and even harm the fairness of decision outcome. This paper …
A novel sequence-to-sequence model predicts missing sensor data.
problem Missing sensor data in sequences.
method Formulated a novel sequence-to-sequence model using forward and backward RNNs.
result The model produces the lowest errors in 12% more cases than the current state-of-the-art.
The paper explores how missing data problems are related to causal inference.
problem Missing data in experiments makes causal inference difficult.
method The paper reinterprets missing data as a form of causal inference by considering counterfactual variables.
result Identification assumptions in missing data can be encoded using graphical models of counterfactual and observed variables.
A new algorithm CAP learns optimal policies from observational data with confounding bias and missing observations.
problem Offline contextual bandit with confounding bias and missing observations.
method CAP policy learning, forming reward function as solution of integral equation system, building confidence set, and greedily taking action with pessimism.
result Developed an upper bound to the suboptimality of CAP for the offline contextual bandit problem.
Algorithm learns graph ARMA processes for missing signal estimation.
problem Missing signal estimation in time-varying graph signals.
method Learning joint time-vertex power spectral density through convex relaxations.
result High accuracy in time-vertex signal estimation.
A new tensor completion method handles missing data with missing not at random entries.
problem Handling missing data in tensors where the probability of observation depends on other entries.
method Estimate propensities using convex relaxation, then use higher-order SVD with inverse propensities weights.
result Finite-sample error bounds on the completed tensor are provided.
New criteria improve imputation model selection using MOO.
problem Selecting the best imputation model using prediction accuracy metrics.
method Introduced three modified MOO criteria based on rank transformation, energy distance, and likelihood principle.
result Demonstrated how MOO is related to missing-at-random assumption and derived statistical and computational learning theories.
Paper tackles HMM learning with unknown missing observation locations.
problem Learning HMMs with missing data locations unknown.
method Proposes reconstruction algorithms without structural assumptions.
result Can reconstruct process dynamics as if missing locations were known.
A method for self-supervised representation learning in partially observable environments.
problem Sparse rewards and stochasticity in partially observable environments.
method World model in latent space for estimating missing information.
result Significant improvement in exploration compared to prior work.
Merlin improves robustness of MTSF models to missing data.
problem Suboptimal forecasting performance due to unfixed missing rates in MTSF models.
method Offline knowledge distillation and multi-view contrastive learning.
result Merlin enhances robustness of MTSF models while preserving accuracy.
Paper introduces a method to evaluate abstaining classifiers by considering missing predictions as counterfactuals.
problem Lack of a principled approach to evaluate and compare abstaining classifiers, especially when missing predictions are important.
method Develops a novel approach to treat abstentions as missing data, defining counterfactual scores and using causal inference methods to estimate them.
result Shows that under certain conditions, counterfactual scores can be identified and estimated efficiently, improving evaluation of abstaining classifiers.
Deep learning for missing data with flexible modelling.
problem Missing data with missingness dependent on the missing values.
method Deep latent variable models with a neural network for missingness pattern modeling, importance-weighted variational inference, and stochastic gradients.
result Explicitly modelling missingness improves inference on various data sets.
Matrix completion is a modern missing data problem where both the missing structure and the underlying parameter are high dimensional. Although missing structure is a key component to any missing data problems, existing matrix completion methods often assume a simple uniform missing mechanism. In this work, we study ma…
Develops multi-modal neural network models for improved prediction and uncertainty quantification.
problem Improving prediction accuracy and uncertainty quantification for multi-modal data.
method Multi-modal Bayesian neural network models with conjugate last-layer estimation using SVI.
result Improved prediction accuracy and uncertainty quantification compared to uni-modal models.
Deep model predicts wildfire data in incomplete regions.
problem Predicting distributions of wildfire frequency and size in missing data regions.
method Conditional Missing data Importance-Weighted Autoencoder (CMIWAE) model trained on incomplete data.
result Maximizes log-likelihood of observed wildfire information.
Noise in imputed values corrects biases in machine learning models.
problem Systematic biases in imputed values affect downstream analyses.
method Introducing noise to imputed values to correct biases.
result Noise-corrected imputation methods produce unbiased estimates.
New method detects concept drift in data streams with missing values.
problem Uncertainty introduced by missing values in concept drift detection.
method Fuzzy distance estimation and histogram bin allocation.
result Fuzzy set theory improves drift detection in data with missing values.
A probabilistic query may not be estimable from observed data corrupted by missing values if the data are not missing at random (MAR). It is therefore of theoretical interest and practical importance to determine in principle whether a probabilistic query is estimable from missing data or not when the data are not MAR.…
New Fourier transform method handles missing data and asynchronous observations.
problem Volatility inference with missing or asynchronous data.
method Spectral framework using Fourier transforms.
result Consistent volatility functional estimation with limit distributions.
In data-mining applications, we are frequently faced with a large fraction of missing entries in the data matrix, which is problematic for most discriminant machine learning algorithms. A solution that we explore in this paper is the use of a generative model (a mixture of Gaussians) to compute the conditional expectat…
Missing values widely exist in many real-world datasets, which hinders the performing of advanced data analytics. Properly filling these missing values is crucial but challenging, especially when the missing rate is high. Many approaches have been proposed for missing value imputation (MVI), but they are mostly heurist…
In this paper, we propose an online algorithm to compute matrix factorizations. Proposed algorithm updates the dictionary matrix and associated coefficients using a single observation at each time. The algorithm performs low-rank updates to dictionary matrix. We derive the algorithm by defining a simple objective funct…
Extends model-x framework to handle missing data.
problem Inability to control false selections in missing data settings.
method Posterior sampled imputation, univariate imputation, joint imputation and sampling knockoffs.
result Preserves theoretical guarantees of model-x framework in missing data setting.
New method uses MMD estimators to enforce model invariance with missing data.
problem Models trained on missing data can fail on related test distributions.
method Derives MMD estimators for enforcing model invariance under missing nuisances.
result Optimizing through MMD estimates achieves similar test performance to using full data.
A novel GAN approach for multiview learning with missing data.
problem Learning from multiview data with missing observations.
method Biconditional GAN with two generators and a discriminator for conditional generation of missing views.
result The discriminator achieves significant classification performance and generators learn missing views without external resources.
Paper tackles CATE estimation with missing treatment info.
problem Challenges in estimating CATE with missing treatment information.
method Developed MTRNet, a novel CATE estimation algorithm using domain adaptation.
result Improves CATE estimation over state-of-the-art methods.
New method for epidemic model inference using multinomial approximations.
problem Inference in stochastic epidemic models with partial observations.
method Recursive multinomial approximations to integrate over unobserved variables.
result Accuracy demonstrated through real and simulated data.
Paper proposes a method to classify EEG signals with missing data.
problem Handling missing data in electroencephalogram (EEG) signals for classification.
method Uses an expectation-maximization algorithm with observed-data likelihood to compute covariance matrices, compares to imputed data and Riemannian averages.
result The proposed method generally performs better than existing methods on real EEG data.
Paper proposes efficient algorithm for recovering sparsity pattern from deterministic missing data.
problem Recovering sparsity pattern from datasets with deterministic missing structure.
method Proposes an efficient algorithm for missing value imputation using topological property of censorship filter.
result Consistently recovers the sparsity pattern with high probability in polynomial time and logarithmic sample complexity.
Study shows linear predictors fail with missing data, but simpler approximations and neural networks can work.
problem Building predictors with missing data when the target is a linear function of observed data.
method Analyzed the Gaussian case and proposed a linear function of multiway interactions. Studied a simple approximation and proved generalization bounds. Showed multilayer perceptrons with ReLU activation can be consistent.
result Simple approximations and neural networks can be effective in handling missing data, especially with sufficient data.
Graphon estimation improved with extended NBS for missing subgraph data.
problem Estimating graphon from partially observed network data.
method Extended NBS algorithm applied to missing data.
result Extended NBS achieves smaller error rates than other methods.
Missing data are ubiquitous in many domains including healthcare. When these data entries are not missing completely at random, the (conditional) independence relations in the observed data may be different from those in the complete data generated by the underlying causal process. Consequently, simply applying existin…
Ultra-wideband (UWB) radar systems nowadays typical operate in the low frequency spectrum to achieve penetration capability. However, this spectrum is also shared by many others communication systems, which causes missing information in the frequency bands. To recover this missing spectral information, we propose a gen…
IFGAN uses feature-specific GANs for missing value imputation.
problem Missing value imputation in data mining.
method Feature-specific Generative Adversarial Networks (GAN).
result IFGAN outperforms state-of-the-art algorithms in various missing conditions.
GRAPE uses graph representation to handle missing data in feature imputation and label prediction.
problem Handling missing data in machine learning tasks.
method GRAPE uses a bipartite graph where observations and features are nodes, and observed feature values are edges. It formulates feature imputation as edge-level prediction and label prediction as node-level prediction, solving these with Graph Neural Networks.
result GRAPE achieves 20% lower mean absolute error for imputation and 10% lower for label prediction compared to state-of-the-art methods.
A fast Gibbs sampler for Bayesian HMMs with missing data.
problem Complexity and slow mixing in EM and Gibbs samplers for HMMs with missing observations.
method Proposes a collapsed Gibbs sampler that integrates missing observations and latent states, achieving high accuracy, large ESS, and reduced computational complexity.
result The proposed sampler is faster and more efficient than existing methods, especially with many missing entries.