Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

2815628431,124 · Jun 202019922001200920172026
48 results for out-of-distribution data

Method enhances anomaly detection using contrastive learning and out-of-distribution data.

problem Improving anomaly detection in datasets with limited out-of-distribution data.
method Proposes a contrastive learning method that incorporates out-of-distribution data to enhance anomaly detection performance.
result The method significantly improves anomaly detection performance, even with limited out-of-distribution data.

Bayesian Gaussian Processes layer detects out-of-distribution data in medical imaging.

problem Detecting out-of-distribution data in medical imaging tasks.
method Parameter-efficient hierarchical convolutional Gaussian Processes in Wasserstein-2 space.
result Uncertainty estimates enable superior out-of-distribution detection compared to previous methods.

Deep learning models are known to be overconfident in their predictions on out of distribution inputs. This is a challenge when a model is trained on a particular input dataset, but receives out of sample data when deployed in practice. Recently, there has been work on building classifiers that are robust to out of dis…

2018-12-01abs ↗pdf ↗

Single deep model detects out-of-distribution data with single forward pass.

problem Detecting out-of-distribution data points in neural networks.
method Deterministic uncertainty quantification (DUQ) using gradient penalty for reliable detection.
result Single model outperforms or matches ensemble methods in out-of-distribution detection.

New framework detects out-of-distribution data by considering intrinsic ID attributes in outliers.

problem Deploying reliable machine learning systems requires effective out-of-distribution detection.
method Structured multi-view-based out-of-distribution detection learning (MVOL) framework.
result MVOL effectively utilizes both auxiliary OOD datasets and wild datasets with noisy in-distribution data.

Normalizing flows fail to detect OOD data due to learning local pixel correlations.

problem Detecting out-of-distribution data in machine learning systems.
method Investigated why normalizing flows fail to distinguish between in- and out-of-distribution data, and modified flow architecture to improve OOD detection.
result Modifying flow architecture can improve OOD detection by biasing the flow towards learning semantic structure of the target data.

Real-time detection of out-of-distribution data in CPS control systems.

problem Detecting out-of-distribution data in CPS control systems for safety.
method Inductive conformal prediction and anomaly detection using variational autoencoders and deep support vector data description.
result Efficient real-time detection with low false alarm rates and comparable execution time.

Study optimal ridge regularization for out-of-distribution prediction.

problem Optimal ridge regularization for predicting out-of-distribution data.
method Established conditions for optimal regularization under covariate and regression shifts, proving monotonic risk in data aspect ratio.
result Negative regularization can be optimal under shifts, even with isotropic or underparameterized training features.

Accuracy on in-distribution data correlates with out-of-distribution data when data is noisy or contains nuisance features.

problem Correlation between in-distribution and out-of-distribution accuracy in noisy or feature-rich data.
method Analyzes the impact of noise and nuisance features on model performance.
result Accuracy on in-distribution and out-of-distribution data can become negatively correlated in noisy or feature-rich data.

The paper shows strong correlation between in-distribution and out-of-distribution performance in various machine learning models.

problem Understanding reliability of machine learning systems in unseen environments.
method Empirical analysis of various models and distribution shifts on CIFAR-10, ImageNet, and other datasets.
result Out-of-distribution performance is strongly correlated with in-distribution performance across different models and distribution shifts.

Hierarchical VAEs detect out-of-distribution data by identifying low-level in-distribution features.

problem Out-of-distribution data often has in-distribution low-level features, leading to misleading likelihood estimates in deep generative models.
method Developed a fast, scalable, unsupervised likelihood-ratio score for out-of-distribution detection based on hierarchical variational autoencoders.
result Achieved state-of-the-art results on out-of-distribution detection across various data and model combinations.

Modern deep artificial neural networks have achieved great success in the domain of computer vision and beyond. However, their application to many real-world tasks is undermined by certain limitations, such as overconfident uncertainty estimates on out-of-distribution data or performance deterioration under data distri…

2019-10-07abs ↗pdf ↗

Graph convolution improves linear separability and generalizes to out-of-distribution data.

problem Improving linear separability in semi-supervised classification.
method Applying graph convolution to mixtures of Gaussians in a stochastic block model.
result Graph convolution extends the linear separability regime by a factor of 1/D1/\sqrt{D}.

SLUG method detects bias and out-of-distribution content in generative models.

problem Generative models can underrepresent certain groups and fail on out-of-distribution data.
method SLUG: A new uncertainty quantification method for VAEs combining Laplace approximations and stochastic trace estimators.
result SLUG's UQ score correlates with bias and out-of-distribution content.

Igeood detects out-of-distribution samples using information geometry.

problem Out-of-distribution (OOD) detection in machine learning systems.
method Igeood uses the Fisher-Rao geodesic distance to detect OOD samples from any pre-trained neural network.
result Igeood outperforms state-of-the-art methods on various network architectures and datasets.

Unified study of out-of-distribution generalization across 172 datasets.

problem Measuring and improving robustness of transfer learning models.
method Collect and fine-tune 31k models on 172 dataset pairs, varying architectures and settings.
result In- and out-of-distribution accuracies increase jointly but their relation is dataset-dependent.

Novel conformal methods test out-of-distribution data with labeled outliers.

problem Testing whether new data comes from the same distribution as a reference.
method Integrative conformal p-values re-weight standard p-values using dependent side information.
result The methods outperform standard conformal p-values in simulations and applications.

Counterfactual data augmentations may not ensure OOD robustness if performed by a context-guessing machine.

problem Deep learning models lack out-of-distribution robustness due to reliance on spurious features.
method Theoretical analysis and demonstration of counterfactual data augmentations performed by a context-guessing machine.
result Counterfactual data augmentations by a context-guessing machine do not lead to robust OOD classifiers.

This paper improves normalizing flows by combining MLE and sliced-Wasserstein distance for better data fidelity.

problem Normalizing flows struggle with generating realistic data and detecting out-of-distribution data.
method Proposes a hybrid objective function combining MLE and sliced-Wasserstein distance.
result Shows better generative abilities and lower likelihood of out-of-distribution data.

Sharp analysis of out-of-distribution error in overparameterized models with importance weights.

problem Understanding and quantifying the degradation of performance in overparameterized models when faced with underrepresented data.
method Sharp analysis of an overparameterized Gaussian mixture model with spurious features and cost-sensitive interpolating solutions incorporating importance weights.
result Characterization of a novel tradeoff between worst-case robustness and average accuracy as a function of importance weight magnitude.

A simple method flags images as out-of-distribution based on their distance to nearest neighbors.

problem Detecting images not aligned with a trained model's in-distribution data.
method Flag images as OOD if their average distance to K nearest neighbors is large in the classifier's representation space.
result Simple methods can outperform more complex ones when considering learned representations.

Proposes training neural networks to predict uncertainty for out-of-distribution inputs.

problem Poor uncertainty predictions for out-of-distribution inputs limit model robustness.
method Generates pseudo-inputs in low-density regions and trains a Bayesian framework.
result Yields robust and interpretable uncertainty predictions.

Bayesian layer improves image segmentation and out-of-distribution detection.

problem Outlier detection in image segmentation.
method Parameter-efficient hierarchical convolutional Gaussian Processes in Wasserstein-2 space.
result Uncertainty estimates improve out-of-distribution detection.

Simple methods combine statistical tests for out-of-distribution detection.

problem Detecting data points not following the training distribution.
method Combining classical parametric tests (Rao's score test) and a typicality test.
result Combining Fisher's method of test statistics improves out-of-distribution detection accuracy.

Paper aims to ensure reliable detection of out-of-distribution data with certifiable worst-case guarantees.

problem Deep neural networks are overconfident with OOD inputs, posing safety risks.
method Enforces low confidence and bounds in an ll_\infty-ball around OOD points using interval bound propagation (IBP).
result Certifiable worst-case guarantees for OOD detection are possible without significant loss in accuracy.

The effective application of neural networks in the real-world relies on proficiently detecting out-of-distribution examples. Contemporary methods seek to model the distribution of feature activations in the training data for adequately distinguishing abnormalities, and the state-of-the-art method uses Gaussian distrib…

2020-01-15abs ↗pdf ↗

Study on how kernel regression models generalize to out-of-distribution data.

problem Understanding generalization in machine learning models under distributional shifts.
method Replica method from statistical physics to derive analytical formula for generalization error.
result Identified overlap matrix as key determinant of generalization performance under distribution shift.

ProSub uses angles in feature space to classify data as in- or out-of-distribution.

problem Open-set semi-supervised learning with unknown classes.
method Probabilistic approach based on angles in feature space, estimating conditional distributions of scores.
result ProSub achieves state-of-the-art performance on benchmark problems.

EntProp increases entropy of clean samples to generate out-of-distribution data for better DNN performance.

problem Improving deep neural networks' accuracy and robustness to out-of-distribution data.
method High entropy propagation using data augmentation and free adversarial training.
result EntProp achieves higher standard accuracy and robustness with lower training cost.

Study compares data-driven vs model-based MRS quantification strategies, focusing on resilience to out-of-distribution effects.

problem Resilience to out-of-distribution effects in data-driven MRS quantification.
method Compared three data-driven strategies (supervised regression, self-supervised learning, test-time adaptation) against model-based fitting tools.
result Test-time adaptation proved most resilient to out-of-distribution effects, while self-supervised learning achieved intermediate performance.

Combining Bayesian deep learning and split conformal prediction affects out-of-distribution coverage.

problem Improving out-of-distribution coverage in multiclass image classification.
method Combining Bayesian deep learning with split conformal prediction methods.
result Combining methods can reduce out-of-distribution coverage in some cases.