Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

8162331 · Jun 202019922001200920172026
48 results for Out-Of-Distribution

Method enhances anomaly detection using contrastive learning and out-of-distribution data.

problem Improving anomaly detection in datasets with limited out-of-distribution data.
method Proposes a contrastive learning method that incorporates out-of-distribution data to enhance anomaly detection performance.
result The method significantly improves anomaly detection performance, even with limited out-of-distribution data.

Simple methods combine statistical tests for out-of-distribution detection.

problem Detecting data points not following the training distribution.
method Combining classical parametric tests (Rao's score test) and a typicality test.
result Combining Fisher's method of test statistics improves out-of-distribution detection accuracy.

Bayesian Gaussian Processes layer detects out-of-distribution data in medical imaging.

problem Detecting out-of-distribution data in medical imaging tasks.
method Parameter-efficient hierarchical convolutional Gaussian Processes in Wasserstein-2 space.
result Uncertainty estimates enable superior out-of-distribution detection compared to previous methods.

Combining Bayesian deep learning and split conformal prediction affects out-of-distribution coverage.

problem Improving out-of-distribution coverage in multiclass image classification.
method Combining Bayesian deep learning with split conformal prediction methods.
result Combining methods can reduce out-of-distribution coverage in some cases.

Single deep model detects out-of-distribution data with single forward pass.

problem Detecting out-of-distribution data points in neural networks.
method Deterministic uncertainty quantification (DUQ) using gradient penalty for reliable detection.
result Single model outperforms or matches ensemble methods in out-of-distribution detection.

Unified study of out-of-distribution generalization across 172 datasets.

problem Measuring and improving robustness of transfer learning models.
method Collect and fine-tune 31k models on 172 dataset pairs, varying architectures and settings.
result In- and out-of-distribution accuracies increase jointly but their relation is dataset-dependent.

Deep learning models are known to be overconfident in their predictions on out of distribution inputs. This is a challenge when a model is trained on a particular input dataset, but receives out of sample data when deployed in practice. Recently, there has been work on building classifiers that are robust to out of dis…

2018-12-01abs ↗pdf ↗

The paper shows strong correlation between in-distribution and out-of-distribution performance in various machine learning models.

problem Understanding reliability of machine learning systems in unseen environments.
method Empirical analysis of various models and distribution shifts on CIFAR-10, ImageNet, and other datasets.
result Out-of-distribution performance is strongly correlated with in-distribution performance across different models and distribution shifts.

SLUG method detects bias and out-of-distribution content in generative models.

problem Generative models can underrepresent certain groups and fail on out-of-distribution data.
method SLUG: A new uncertainty quantification method for VAEs combining Laplace approximations and stochastic trace estimators.
result SLUG's UQ score correlates with bias and out-of-distribution content.

New framework detects out-of-distribution data by considering intrinsic ID attributes in outliers.

problem Deploying reliable machine learning systems requires effective out-of-distribution detection.
method Structured multi-view-based out-of-distribution detection learning (MVOL) framework.
result MVOL effectively utilizes both auxiliary OOD datasets and wild datasets with noisy in-distribution data.

Study optimal ridge regularization for out-of-distribution prediction.

problem Optimal ridge regularization for predicting out-of-distribution data.
method Established conditions for optimal regularization under covariate and regression shifts, proving monotonic risk in data aspect ratio.
result Negative regularization can be optimal under shifts, even with isotropic or underparameterized training features.

A simple method flags images as out-of-distribution based on their distance to nearest neighbors.

problem Detecting images not aligned with a trained model's in-distribution data.
method Flag images as OOD if their average distance to K nearest neighbors is large in the classifier's representation space.
result Simple methods can outperform more complex ones when considering learned representations.

New methods predict language model out-of-distribution behaviors using causal mechanisms.

problem Predicting how language models behave on unseen data.
method Two methods: counterfactual simulation and value probing.
result Both methods achieve high AUC-ROC and outperform causal-agnostic approaches in out-of-distribution settings.

Igeood detects out-of-distribution samples using information geometry.

problem Out-of-distribution (OOD) detection in machine learning systems.
method Igeood uses the Fisher-Rao geodesic distance to detect OOD samples from any pre-trained neural network.
result Igeood outperforms state-of-the-art methods on various network architectures and datasets.

Bayesian layer improves image segmentation and out-of-distribution detection.

problem Outlier detection in image segmentation.
method Parameter-efficient hierarchical convolutional Gaussian Processes in Wasserstein-2 space.
result Uncertainty estimates improve out-of-distribution detection.

Normalizing flows fail to detect OOD data due to learning local pixel correlations.

problem Detecting out-of-distribution data in machine learning systems.
method Investigated why normalizing flows fail to distinguish between in- and out-of-distribution data, and modified flow architecture to improve OOD detection.
result Modifying flow architecture can improve OOD detection by biasing the flow towards learning semantic structure of the target data.

A new operator based on t-distributions improves NN classifiers' robustness to out-of-distribution samples.

problem NN classifiers assign extreme probabilities to out-of-distribution samples, leading to unreliable predictions.
method Derive a novel operator using t-distributions to model uncertainty more accurately.
result Classifiers using the new operator are more robust to out-of-distribution samples.

Modern deep artificial neural networks have achieved great success in the domain of computer vision and beyond. However, their application to many real-world tasks is undermined by certain limitations, such as overconfident uncertainty estimates on out-of-distribution data or performance deterioration under data distri…

2019-10-07abs ↗pdf ↗

Regularizes ML algorithms for robust multivariate analysis against distribution shifts.

problem Ensuring robustness of multivariate analysis algorithms against distribution shifts.
method Integrates a causal regularisation term into the loss function of multivariate analysis algorithms.
result Demonstrates improved out-of-distribution generalisation with reduced-rank regression and partial least squares.

Sharp analysis of out-of-distribution error in overparameterized models with importance weights.

problem Understanding and quantifying the degradation of performance in overparameterized models when faced with underrepresented data.
method Sharp analysis of an overparameterized Gaussian mixture model with spurious features and cost-sensitive interpolating solutions incorporating importance weights.
result Characterization of a novel tradeoff between worst-case robustness and average accuracy as a function of importance weight magnitude.

Hierarchical VAEs detect out-of-distribution data by identifying low-level in-distribution features.

problem Out-of-distribution data often has in-distribution low-level features, leading to misleading likelihood estimates in deep generative models.
method Developed a fast, scalable, unsupervised likelihood-ratio score for out-of-distribution detection based on hierarchical variational autoencoders.
result Achieved state-of-the-art results on out-of-distribution detection across various data and model combinations.

Proposes training neural networks to predict uncertainty for out-of-distribution inputs.

problem Poor uncertainty predictions for out-of-distribution inputs limit model robustness.
method Generates pseudo-inputs in low-density regions and trains a Bayesian framework.
result Yields robust and interpretable uncertainty predictions.

GCRL learns causal factors for motion forecasting, improving out-of-distribution prediction.

problem Sensitivity to out-of-distribution data in conventional supervised learning methods.
method Generative Causal Representation Learning (GCRL) leveraging causality for knowledge transfer.
result Significantly outperforms prior models on out-of-distribution prediction.

ACNML method improves uncertainty estimation for deep networks.

problem Uncertainty estimation and calibration for deep neural networks under distribution shift.
method Approximate Bayesian inference to approximate CNML distribution.
result ACNML compares favorably to prior techniques for uncertainty estimation.

Accuracy on in-distribution data correlates with out-of-distribution data when data is noisy or contains nuisance features.

problem Correlation between in-distribution and out-of-distribution accuracy in noisy or feature-rich data.
method Analyzes the impact of noise and nuisance features on model performance.
result Accuracy on in-distribution and out-of-distribution data can become negatively correlated in noisy or feature-rich data.

Study shows LLMs can extrapolate rules from out-of-distribution prompts.

problem Understanding LLMs' ability to generalize from unexpected inputs.
method Formal languages and rule-based scenarios to evaluate LLMs' OOD behavior.
result LLMs can extrapolate rules from out-of-distribution prompts, even in complex scenarios.

Improved VAE model enhances uncertainty estimation for out-of-distribution samples.

problem VAEs assign higher likelihood to out-of-distribution inputs.
method INCPVAE integrates noise contrastive prior into VAEs for reliable uncertainty estimation.
result INCPVAE outperforms standard VAEs in uncertainty estimation for OOD inputs.

Novel conformal methods test out-of-distribution data with labeled outliers.

problem Testing whether new data comes from the same distribution as a reference.
method Integrative conformal p-values re-weight standard p-values using dependent side information.
result The methods outperform standard conformal p-values in simulations and applications.

Graph convolution improves linear separability and generalizes to out-of-distribution data.

problem Improving linear separability in semi-supervised classification.
method Applying graph convolution to mixtures of Gaussians in a stochastic block model.
result Graph convolution extends the linear separability regime by a factor of 1/D1/\sqrt{D}.

Paper fine-tunes a simulation-driven estimator to reduce out-of-distribution errors.

problem Out-of-distribution errors in simulation-driven parameter estimators.
method Fine-tuning a Two-Stage estimator to improve accuracy for true parameters outside the sampled range.
result The fine-tuning approach reduces out-of-distribution errors and improves accuracy.

A new algorithm detects out-of-distribution samples by concentrating them in feature space.

problem Building safe AI systems requires effective out-of-distribution detection.
method The paper proposes a novel algorithm based on the observation that OoD samples concentrate in feature space.
result The algorithm achieves state-of-the-art performance on various OoD detection benchmarks.