Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

221442662883 · Jun 202019922001200920172026
48 results for imputation algorithms

Random forest (RF) missing data algorithms are an attractive approach for dealing with missing data. They have the desirable properties of being able to handle mixed types of missing data, they are adaptive to interactions and nonlinearity, and they have the potential to scale to big data settings. Currently there are …

2017-01-19abs ↗pdf ↗

New algorithms handle missing data to improve fairness in machine learning.

problem Missing values in data can lead to unfair outcomes in machine learning models.
method Developed scalable and adaptive algorithms to handle missing values while preserving predictive information.
result Our adaptive algorithms consistently achieve higher fairness and accuracy than standard impute-then-classify methods.

This paper evaluates how different imputation methods affect predictive models.

problem The impact of different imputation methods on predictive models' performance.
method Systematic evaluation of various imputation methods for different data sets and machine learning algorithms.
result Recommendation of a general method for empirical benchmarking of imputation methods.

Imputation of missing data is a common application in various classification problems where the feature training matrix has missingness. A widely used solution to this imputation problem is based on the lazy learning technique, kk-nearest neighbor (kNN) approach. However, most of the previous work on missing data does…

2020-02-25abs ↗pdf ↗

New online imputation method for mixed data improves accuracy and speed.

problem Missing value imputation in online settings for mixed data types.
method Online Gaussian copula model for imputation and change point detection.
result The model improves accuracy and speed, especially on large datasets.

Study finds unsupervised imputation before cross-validation can reduce computational costs without significantly degrading model performance.

problem High computational costs in pipeline modeling algorithms with imputation steps.
method Empirical assessment of unsupervised imputation before vs during cross-validation.
result Reduced variance of imputation before cross-validation leads to lower overall root mean squared error.

Imputation with missing-indicators improves machine learning performance, especially for categorical attributes.

problem Missing values in datasets can be lost through imputation, potentially reducing model performance.
method Combines missing-indicator approach with imputation strategies on real datasets.
result Missing-indicators generally increase classification performance, especially for categorical attributes.

This paper improves VAE-based imputation of FX implied volatilities, reducing errors and handling uncertainty.

problem Imputing missing implied volatilities for FX options.
method Modified VAE architecture and handling uncertainty.
result Significant performance improvements, nearly halving error in low missingness regimes.

Paper proposes a novel method to reduce mutual information for missing data imputation.

problem Missing data imputation in datasets with missingness patterns.
method Iterative minimization of KL divergence between imputed data and missingness mask, using rectified flow training objective.
result The proposed method achieves superior imputation performance on synthetic and real-world datasets.

Study examines how imputation accuracy affects prediction accuracy in regression problems with missing covariates.

problem Missing covariates in regression or classification problems.
method Simulation and empirical analysis using UCI datasets and statistical inference.
result Imputation accuracy impacts prediction accuracy, especially with Machine Learning methods.

Missing data is a common problem in real-world settings and particularly relevant in healthcare applications where researchers use Electronic Health Records (EHR) and results of observational studies to apply analytics methods. This issue becomes even more prominent for longitudinal data sets, where multiple instances …

2018-12-02abs ↗pdf ↗

Paper introduces detect-then-impute conformal prediction for cellwise outliers.

problem Uncertainty in prediction intervals for models with cellwise outliers.
method Detects outliers, imputes them, and constructs exchangeable features for conformal prediction.
result JDI-CP achieves a finite sample 12α1-2\alpha coverage guarantee.

DRIO improves time series imputation by minimizing reconstruction error and distributional divergence.

problem Bias in imputation due to mismatch between observed and true data distributions.
method DRIO minimizes reconstruction error and worst-case divergence using Wasserstein ambiguity set.
result DRIO consistently provides robust imputation and improved forecasting.

Many data mining and data analysis techniques operate on dense matrices or complete tables of data. Real-world data sets, however, often contain unknown values. Even many classification algorithms that are designed to operate with missing values still exhibit deteriorated accuracy. One approach to handling missing valu…

2013-12-19abs ↗pdf ↗

A new algorithm for missing data imputation with low RMSE and explainability.

problem Missing data in various domains, especially in critical applications requiring low RMSE and explainability.
method DIMV algorithm that uses conditional distribution of features based on fully observed features.
result DIMV provides low RMSE, scalability, and explainability for imputed values.

Deep learning models outperform MICE in large survey imputation but with hyperparameter tuning.

problem Comparing deep learning and MICE for missing data imputation in large surveys.
method Extensive simulation studies comparing four machine learning-based MI methods: MICE with classification trees, MICE with random forests, generative adversarial imputation networks, and multiple imputation using denoising autoencoders.
result MICE with classification trees consistently outperforms deep learning methods in terms of bias, mean squared error, and coverage.

A new method uses RF's out-of-bag errors for multiple imputation.

problem Missing data in biomedical studies and lack of prediction uncertainty.
method Constructs conditional distributions from the empirical distribution of out-of-bag prediction errors.
result Valid multiple imputation results achieved without parametric assumptions.

The paper addresses missing data imputation issues by correcting for distribution shift.

problem Missing data imputation and the resulting distribution shift between observed and full data.
method Formulates imputation as a risk minimization problem and proposes a novel algorithm to correct for distribution shift.
result The proposed algorithm consistently improves imputation accuracy, reducing RMSE and Wasserstein distance by 3% and 7%, respectively.

This paper proposes a probabilistic imputation method with uncertainty quantification.

problem Missing value imputation with uncertainty estimation for large datasets.
method Low Rank Gaussian Copula framework that augments PPCA with column-specific transformations.
result The method yields state-of-the-art imputation accuracy and well-calibrated uncertainty estimates.

Unified framework for imputation and prediction in healthcare time series.

problem Time misalignment and data sparsity in healthcare time series.
method MAGIC (Multi-tAsk Gaussian Process for Imputation and Classification) using hierarchical multi-task Gaussian process and functional logistic regression.
result Superior predictive accuracy compared to existing methods in two healthcare applications.

Standard methods for anomaly detection assume that all features are observed at both learning time and prediction time. Such methods cannot process data containing missing values. This paper studies five strategies for handling missing values in test queries: (a) mean imputation, (b) MAP imputation, (c) reduction (redu…

2018-09-05abs ↗pdf ↗

Modern data acquisition based on high-throughput technology is often facing the problem of missing data. Algorithms commonly used in the analysis of such large-scale data often depend on a complete set. Missing value imputation offers a solution to this problem. However, the majority of available imputation methods are…

2011-05-04abs ↗pdf ↗

A new model for imputing missing values in time series data across domains.

problem Imputing missing values in time series data across domains with domain shifts and high missing rates.
method A diffusion-based imputation model that integrates shared spectral components and domain-specific temporal structures, with cross-domain consistency alignment.
result Our model effectively handles missing values and domain shifts, outperforming existing methods.

PAIR-CI calibrates CI tests for causal discovery with incomplete data.

problem Miscalibration of CI tests when imputing incomplete data.
method Integrates multiple imputation directly into the inferential procedure via a paired permutation design.
result PAIR-CI reduces false positive rates to below 5% in simulations.

A new imputation method MissARF uses adversarial random forests for fast and accurate missing value imputation.

problem Handling missing values in biostatistical analyses.
method Adversarial Random Forests (ARF) for density estimation and data synthesis.
result MissARF performs comparably to state-of-the-art methods in imputation quality and runtime.

UnmaskingTrees improves tabular data imputation and generation using gradient-boosted decision trees.

problem Traditional methods outperform advanced deep learning techniques on tabular data imputation benchmarks.
method UnmaskingTrees employs gradient-boosted decision trees to incrementally unmask features for imputation and generation.
result UnmaskingTrees outperforms state-of-the-art methods on tabular imputation and generation benchmarks.

A new decision tree method tackles fairness in datasets with missing values.

problem Fairness concerns in machine learning models trained on data with missing values.
method An integrated approach based on decision trees that incorporates missing values directly and optimizes a fairness-regularized objective function.
result Our method outperforms existing fairness intervention methods applied to imputed datasets.

A novel time series imputation technique using tSMOTE for handling missing data.

problem Handling missing observations in irregular time series data.
method Time Sliced Synthetic Minority Oversampling Technique (tSMOTE) generalizing SMOTE for time series imputation.
result Improvement in classification accuracy for imputed data compared to standard imputation methods.