Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

2805608391,119 · Jun 202019922001200920172026
48 results for OOD Data

LoD improves model safety by integrating unlabeled wild data, reducing OOD misclassification.

problem Improving model safety and reliability using unlabeled wild data containing both in-distribution and out-of-distribution samples.
method Intentionally label-noisifying unlabeled wild data to enable joint learning of labeled ID and OOD data, distinguishing losses between ID and OOD samples.
result LoD framework achieves superior OOD detection without requiring thresholds, improving model safety.

Paper investigates learnability of OOD detection under various conditions.

problem Learnability of OOD detection under different scenarios.
method Investigates PAC learning theory, proves impossibility theorems, and provides necessary and sufficient conditions.
result Some conditions for learnability of OOD detection may not hold in practical scenarios.

ATOM improves robust OOD detection by mining informative auxiliary examples.

problem Robust OOD detection in open-world settings is challenging due to adversarial inputs.
method ATOM combines adversarial training with outlier mining to improve robustness.
result ATOM achieves state-of-the-art performance in OOD detection, reducing FPR by up to 57.99%.

Study investigates OOD generalization methods for mechanics problems.

problem Real-world mechanics problems with unknown test environments and data distribution shifts.
method Investigates OOD generalization methods for regression problems in mechanics.
result OOD generalization methods perform better than traditional ML methods on mechanics-specific regression problems.

OOD-trained Bayesian neural networks perform similarly to frequentist methods in uncertainty quantification.

problem Bayesian neural networks struggle in out-of-distribution (OOD) detection tasks.
method Incorporated out-of-distribution data into Bayesian inference through four different methods.
result OOD-trained Bayesian neural networks are competitive with frequentist baselines.

Medix uses the median to detect outliers from unlabeled data for robust OOD detection.

problem Challenges in using unlabeled data for OOD detection due to mixed InD and OOD samples.
method Introduces Medix, a framework using the median operation to identify outliers from unlabeled data.
result Empirical results show Medix outperforms existing methods in open-world settings.

Enhances OOD detection using latent diffusion for more robust and efficient training.

problem Improving reliability of machine learning models in real-world scenarios.
method Proposes Outlier-Aware Learning (OAL) framework that generates synthetic OOD data in latent space and uses MICL and KD modules.
result Demonstrates superior performance on benchmark datasets.

Calibrated ensembles improve both ID and OOD accuracy in distribution shift.

problem Desired balance between in-distribution and out-of-distribution accuracy.
method Ensemble standard and robust models, calibrating on ID data only.
result ID-calibrated ensembles outperform state-of-the-art methods on multiple datasets.

Geometrically, high-likelihood regions in DGMs are unlikely to generate OOD data.

problem The paradox of high-likelihood OOD detection in deep generative models.
method Local intrinsic dimension estimation to identify high-likelihood regions that do not generate OOD data.
result A method pairing likelihoods and LID estimates for reliable OOD detection.

HOoD detects near-out-of-distribution groups in correlated biomedical assays.

problem Detecting near-out-of-distribution cases in biased or incomplete data.
method Projects correlated measurements through a trained model and uses permutation-based hypothesis tests.
result HOoD reliably identifies OoD groups, outperforming other detectors.

OOD detection methods often misidentify OOD points, leading to ineffective safety improvements.

problem Improving model safety through OOD detection methods often leads to incorrect identification of out-of-distribution points.
method Re-examine popular OOD detection procedures based on predictive uncertainty or features of supervised models trained on in-distribution data.
result Popular OOD detection methods incorrectly conflate high uncertainty and far feature-space distance with being out-of-distribution.

Out-of-domain (OOD) detection for low-resource text classification is a realistic but understudied task. The goal is to detect the OOD cases with limited in-domain (ID) training data, since we observe that training data is often insufficient in machine learning applications. In this work, we propose an OOD-resistant Pr…

2019-08-31abs ↗pdf ↗

Neural networks classify OOD images by their nearest neighbor in training data.

problem Understanding out-of-distribution prediction behavior of neural networks.
method Nearest category generalization (NCG) measure to assess OOD prediction accuracy.
result Adversarially robust networks have higher NCG accuracy than natural training, indicating local regularization impacts decision regions.

Unified framework for OOD detection and generalization using graph theory.

problem Challenges in out-of-distribution (OOD) generalization and detection in real-world machine learning models.
method Graph-theoretic framework to jointly tackle OOD generalization and detection.
result Empirical validation of theoretical underpinnings with competitive performance.

Paper introduces Influence Function to assess OOD generalization stability.

problem Assessing OOD generalization accuracy when target domains are unknown.
method Introduced Influence Function from robust statistics to monitor model stability.
result Accuracy on test domains and Influence Function variance can distinguish OOD algorithms and generalization quality.

Bayesian method detects outliers and uncertain points in data.

problem Detecting outliers and uncertain points in data using Bayesian methods.
method Generative model of data curation for aleatoric uncertainty, combining with epistemic uncertainty and outlier exposure.
result Principled Bayesian approach outperforms methods using aleatoric or epistemic uncertainty alone.

MADOD meta-learns invariant features for OOD detection across unseen domains.

problem Simultaneous covariate and semantic shifts in real-world machine learning applications.
method Meta-learning and G-invariance to learn robust, domain-invariant features.
result Superior performance in semantic OOD detection across unseen domains.

ProSub uses angles in feature space to classify data as in- or out-of-distribution.

problem Open-set semi-supervised learning with unknown classes.
method Probabilistic approach based on angles in feature space, estimating conditional distributions of scores.
result ProSub achieves state-of-the-art performance on benchmark problems.

This work proposes using Conformal Prediction to improve OOD detection scores and vice versa.

problem Improper evaluation of OOD detection scores due to finite sample size.
method Defining new conformal AUROC and FRP@TPR95 metrics and using OOD scores as non-conformity scores.
result Improved evaluation metrics and better interpretation of OOD scores.

Igeood detects out-of-distribution samples using information geometry.

problem Out-of-distribution (OOD) detection in machine learning systems.
method Igeood uses the Fisher-Rao geodesic distance to detect OOD samples from any pre-trained neural network.
result Igeood outperforms state-of-the-art methods on various network architectures and datasets.

PAIR optimizes machine learning models to generalize better to out-of-distribution data.

problem Optimization of machine learning models for out-of-distribution (OOD) generalization often leads to compromises that weaken robustness.
method Introduces a multi-objective optimization (MOO) perspective and a new optimization scheme called PAreto Invariant Risk Minimization (PAIR).
result PAIR improves robustness of OOD objectives by cooperatively optimizing with other objectives, yielding top OOD performances.

NADS improves OoD detection accuracy by 57%.

problem Uncertainty in machine learning models when encountering out-of-distribution data.
method NADS searches for a distribution of architectures that perform well on a given task, optimizing a stochastic OoD detection objective.
result NADS achieves up to 57% improvement in accuracy over state-of-the-art methods.

Machine learning models encounter Out-of-Distribution (OoD) errors when the data seen at test time are generated from a different stochastic generator than the one used to generate the training data. One proposal to scale OoD detection to high-dimensional data is to learn a tractable likelihood approximation of the tra…

2018-10-02abs ↗pdf ↗

Proposes Likelihood Regret for VAEs to improve OOD detection.

problem VAEs can assign high likelihoods to OOD samples, making traditional likelihood thresholds unreliable.
method Introduces Likelihood Regret, a new OOD score for VAEs.
result Empirical results show Likelihood Regret outperforms existing methods for VAEs.

Study shows latent space OOD detection isn't a reliable proxy for model performance.

problem Evaluating and interpreting deep learning systems on real-world data.
method Empirical investigation of latent space OOD detection and classification accuracy using SAR datasets.
result OOD detection cannot be used as a proxy measure for model performance.

Normalizing flows fail to detect OOD data due to learning local pixel correlations.

problem Detecting out-of-distribution data in machine learning systems.
method Investigated why normalizing flows fail to distinguish between in- and out-of-distribution data, and modified flow architecture to improve OOD detection.
result Modifying flow architecture can improve OOD detection by biasing the flow towards learning semantic structure of the target data.

PostNet predicts uncertainty without OOD data, improving OOD detection and calibration.

problem Accurate uncertainty estimation for safe systems.
method PostNet uses Normalizing Flows to learn individual posterior distributions over predicted probabilities.
result PostNet achieves state-of-the-art results in OOD detection and uncertainty calibration.

FeAT improves OOD generalization by learning richer features.

problem Improving feature learning for out-of-distribution (OOD) generalization.
method Feature Augmented Training (FeAT) iteratively augments and retains features from different subsets of training data.
result FeAT effectively learns richer features, boosting OOD performance.

SFP prunes ID features to improve OOD generalization without domain data.

problem Improving out-of-distribution (OOD) generalization in biased models.
method Spurious Feature-targeted model Pruning (SFP) framework.
result SFP achieves optimal OOD generalization by pruning ID features.

SSMBA generates synthetic data to improve robustness in natural language tasks.

problem Improving out-of-domain generalization of models trained on natural language data.
method SSMBA uses corruption and reconstruction functions to generate synthetic data points on the manifold assumption.
result SSMBA consistently outperforms existing methods on robustness benchmarks across multiple tasks and datasets.

A new OOD detector using an overlap index improves accuracy without high computational costs.

problem Effective OOD detection for machine learning models in open-world scenarios.
method Proposes an overlap index-based confidence score function for OOD detection.
result The proposed method achieves competitive accuracy with lower computational costs compared to state-of-the-art detectors.