PEOC uses policy entropy to detect untrained states in RL.
problem Detecting untrained states in reinforcement learning for safety.
method Policy entropy based one-class classifier.
result PEOC is highly competitive and reliable.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “Out-of-distribution classification”
The paper shows strong correlation between in-distribution and out-of-distribution performance in various machine learning models.
problem Understanding reliability of machine learning systems in unseen environments.
method Empirical analysis of various models and distribution shifts on CIFAR-10, ImageNet, and other datasets.
result Out-of-distribution performance is strongly correlated with in-distribution performance across different models and distribution shifts.
Combining Bayesian deep learning and split conformal prediction affects out-of-distribution coverage.
problem Improving out-of-distribution coverage in multiclass image classification.
method Combining Bayesian deep learning with split conformal prediction methods.
result Combining methods can reduce out-of-distribution coverage in some cases.
Graph convolution improves linear separability and generalizes to out-of-distribution data.
problem Improving linear separability in semi-supervised classification.
method Applying graph convolution to mixtures of Gaussians in a stochastic block model.
result Graph convolution extends the linear separability regime by a factor of .
A framework for detecting out-of-distribution data in RL using uncertainty-based classification.
problem Detecting out-of-distribution data in deep reinforcement learning systems.
method A one-class classification problem approach based on epistemic uncertainty reduction.
result The proposed UBOOD framework reliably detects out-of-distribution situations when combined with ensemble-based uncertainty estimators.
PFDL improves deep learning models' OOD generalization by decorrelating feature embeddings.
problem Out-of-distribution generalization in deep learning models.
method PFDL algorithm that optimizes feature decomposition network and image classification model.
result PFDL improves the accuracy of image classification models on OOD datasets.
Bayesian framework improves deep classifier reliability.
problem Overconfident models under dataset shift.
method Bayesian inference with out-of-distribution data augmentation.
result Reliable uncertainty estimates for deep classifiers.
Improved OOD detection using label smoothing and k-NN density estimates.
problem Detecting out-of-distribution examples in classification models.
method Label smoothing and k-NN density estimate on intermediate activations.
result Label smoothing improves OOD detection performance, both theoretically and empirically.
ProSub uses angles in feature space to classify data as in- or out-of-distribution.
problem Open-set semi-supervised learning with unknown classes.
method Probabilistic approach based on angles in feature space, estimating conditional distributions of scores.
result ProSub achieves state-of-the-art performance on benchmark problems.
The Monte Carlo dropout method has proved to be a scalable and easy-to-use approach for estimating the uncertainty of deep neural network predictions. This approach was recently applied to Fault Detection and Di-agnosis (FDD) applications to improve the classification performance on incipient faults. In this paper, we …
GIM uses neural networks with Gaussian distributions to detect out-of-distribution data.
problem Incorrect classification of out-of-distribution data by neural networks.
method GIM is a hybrid classifier based on neural networks with a new loss function that imposes Gaussian distributions on each class.
result GIM achieves state-of-the-art results on image recognition and sentiment analysis datasets.
A new loss function improves neural networks' out-of-distribution detection without side effects.
problem Neural networks struggle with out-of-distribution detection due to SoftMax loss issues.
method Proposes IsoMax loss replacing SoftMax loss, maintaining high entropy and fast inferences.
result Significantly improves neural networks' out-of-distribution detection performance.
The problem of detecting whether a test sample is from in-distribution (i.e., training distribution by a classifier) or out-of-distribution sufficiently different from it arises in many real-world machine learning applications. However, the state-of-art deep neural networks are known to be highly overconfident in their…
Paper tackles SCOD problem with optimal strategy and empirical validation.
problem Designing reliable prediction models abstaining from uncertain predictions.
method Bayes classifier for ID data and stochastic linear selector in 2D space.
result POSCOD method outperforms existing OOD methods.
DAEDL improves EDL's OOD detection and classification performance by integrating feature space density.
problem Limited OOD detection and classification performance of EDL.
method Integrates feature space density with EDL's output and uses a novel parameterization.
result Demonstrates state-of-the-art performance across uncertainty estimation and classification tasks.
p-DkNN uses deep representations to detect out-of-distribution data with statistical tests.
problem Lack of reliable confidence estimates in neural networks for safety-critical applications.
method Statistical testing of deep neural network's intermediate hidden representations.
result p-DkNN enables more accurate and reliable predictions by abstaining from incorrect predictions.
New method calibrates deep models for both in-distribution and out-of-distribution samples.
problem Ensuring calibration for deep models in safety-critical applications, especially in OOD regions.
method Geodesic distance and Gaussian kernel to calibrate deep models.
result Proposed KDF and KDN methods achieve well-calibrated posteriors for both in-distribution and out-of-distribution samples.
Novel neural network models quantify uncertainty for deep classifiers.
problem Deep networks' overconfidence and ignorance about uncertainty.
method Variational autoencoders and GANs generate out-of-distribution samples.
result Better uncertainty estimates for in- and out-of-distribution samples.
Soft labeling impacts OOD detection in neural networks.
problem Impact of soft labeling on OOD detection in deep neural networks.
method Empirical analysis of how soft labeling affects OOD detection performance.
result Soft labeling can either improve or deteriorate OOD detection performance.
We study the quantification of uncertainty of Convolutional Neural Networks (CNNs) based on gradient metrics. Unlike the classical softmax entropy, such metrics gather information from all layers of the CNN. We show for the EMNIST digits data set that for several such metrics we achieve the same meta classification acc…
The discriminative approach to classification using deep neural networks has become the de-facto standard in various fields. Complementing recent reservations about safety against adversarial examples, we show that conventional discriminative methods can easily be fooled to provide incorrect labels with very high confi…
Enhances autoencoders to represent transformations explicitly.
problem Lack of explicit representation of transformations in autoencoders.
method Extended variational autoencoders to include latent transformations, using hierarchical graphical models.
result Inferred latent transformations reflect interpretable properties in the observation space.
New findings link causal models to strategic classification, improving robustness and alignment.
problem Strategic adaptation by users in classification tasks.
method Causal models to bound worst-case out-of-distribution risk.
result Causal classification optimizes classification error after adaptation under certain noise conditions.
Combining training and post-training methods improves OOD detection accuracy.
problem Deep networks struggle with OOD detection.
method Divided OOD detection methods into training and post-training, then combined them.
result State-of-the-art results in OOD detection achieved.
A new metric predicts model performance on unseen data.
problem Predicting performance on out-of-distribution data without labels.
method Uses model predictions to pseudo-label data, trains a new model, and measures difference from in-distribution models.
result Empirically outperforms existing methods on image and text classification tasks.
Accuracy on the wrong line: On the pitfalls of noisy data for out-of-distribution generalisationcs.LG
Accuracy on in-distribution data correlates with out-of-distribution data when data is noisy or contains nuisance features.
problem Correlation between in-distribution and out-of-distribution accuracy in noisy or feature-rich data.
method Analyzes the impact of noise and nuisance features on model performance.
result Accuracy on in-distribution and out-of-distribution data can become negatively correlated in noisy or feature-rich data.
Generative classifier derived from any discriminative classifier rejects illegal inputs.
problem Detecting and rejecting illegal inputs like adversarial examples and out-of-distribution samples.
method SDIM-logit: learns generative classifier from logits of any discriminative classifier, imposing statistical constraints.
result SDIM-logit inherits performance of base classifier without loss and can reject illegal inputs.
Deep neural networks have achieved great success in classification tasks during the last years. However, one major problem to the path towards artificial intelligence is the inability of neural networks to accurately detect samples from novel class distributions and therefore, most of the existent classification algori…
Novel framework improves graph learning for out-of-distribution generalization.
problem Graph out-of-distribution generalization challenges in neural networks.
method Invariant Graph Learning based on Information bottleneck theory (InfoIGL).
result Achieves state-of-the-art performance in graph classification tasks under OOD generalization.
Study shows latent space OOD detection isn't a reliable proxy for model performance.
problem Evaluating and interpreting deep learning systems on real-world data.
method Empirical investigation of latent space OOD detection and classification accuracy using SAR datasets.
result OOD detection cannot be used as a proxy measure for model performance.
Mahalanobis distance detects anomalies well, but not for classification.
problem Detecting anomalies in neural classifier outputs.
method Analyzes Mahalanobis distance-based anomaly detection method, revealing its reliance on information not useful for classification.
result Combining Mahalanobis and ODIN methods improves anomaly detection performance and robustness.
Out-of-distribution (OOD) detection approaches usually present special requirements (e.g., hyperparameter validation, collection of outlier data) and produce side effects (e.g., classification accuracy drop, slower energy-inefficient inferences). We argue that these issues are a consequence of the SoftMax loss anisotro…
We present a simple case study, demonstrating that Variational Information Bottleneck (VIB) can improve a network's classification calibration as well as its ability to detect out-of-distribution data. Without explicitly being designed to do so, VIB gives two natural metrics for handling and quantifying uncertainty.
A new model classifies surface anomalies in 3D point cloud data.
problem Accurate classification of surface anomalies in manufacturing processes.
method Deep subspace learning approach for 3D point cloud data.
result The method effectively identifies new types of anomalies.
Score-based generative models achieve state-of-the-art classification accuracy on CIFAR-10.
problem Improving classification accuracy on natural image datasets.
method Score-based generative models applied to CIFAR-10.
result Score-based models achieve state-of-the-art classification accuracy on CIFAR-10.
Bayesian deep learning improves out-of-distribution detection but not always.
problem Improving the reliability of deep learning models in uncertain or novel data.
method Validation of likelihood-based Bayesian models for out-of-distribution detection.
result Bayesian deep learning models can marginally outperform conventional neural networks in certain conditions.
Discriminatively trained neural classifiers can be trusted, only when the input data comes from the training distribution (in-distribution). Therefore, detecting out-of-distribution (OOD) samples is very important to avoid classification errors. In the context of OOD detection for image classification, one of the recen…
A large body of recent work has investigated the phenomenon of evasion attacks using adversarial examples for deep learning systems, where the addition of norm-bounded perturbations to the test inputs leads to incorrect output classification. Previous work has investigated this phenomenon in closed-world systems where …
E-Stitchup augments pre-trained embeddings for better model performance and confidence calibration.
problem Improving classification accuracy and confidence calibration of models using pre-trained embeddings.
method Data augmentation methods inspired by Mixup combined with label softening.
result Significantly increased classification accuracy and reduced training time.
Personalized activity recognition improves performance for diverse users.
problem Poor performance of impersonal algorithms for individual users.
method Personalized activity recognition using deep embeddings from a fully convolutional neural network with triplet loss.
result Novel subject triplet loss provides the best performance overall.
Reverse KL-Divergence Training of Prior Networks: Improved Uncertainty and Adversarial Robustnessstat.ML
Ensemble approaches for uncertainty estimation have recently been applied to the tasks of misclassification detection, out-of-distribution input detection and adversarial attack detection. Prior Networks have been proposed as an approach to efficiently \emph{emulate} an ensemble of models for classification by paramete…
Training Normalizing Flows with the Information Bottleneck for Competitive Generative Classificationcs.LG
New method uses IB to train normalizing flows for better generative classification.
problem Training generative models with information theory for improved classification.
method Developed IB-INNs, a class of conditional normalizing flows trained with IB objective.
result IB-INNs offer improved uncertainty quantification and out-of-distribution detection compared to traditional generative classifiers.
Study evaluates scalability and real-world impact of disentangled representations.
problem Scalability and real-world impact of disentangled representations.
method New high-resolution dataset and architectures for disentangled representation learning.
result Disentanglement predicts out-of-distribution task performance.
Study identifies failure modes of machine learning models in out-of-distribution settings.
problem Machine learning models fail to generalize well to new, unseen data.
method Theoretical study of gradient-descent-trained linear classifiers on easy-to-learn tasks, followed by experiments on modern neural networks.
result Two failure modes of spurious correlations are uncovered: geometric and statistical.
Recent algorithms with state-of-the-art few-shot classification results start their procedure by computing data features output by a large pretrained model. In this paper we systematically investigate which models provide the best representations for a few-shot image classification task when pretrained on the Imagenet …
CGRL improves graph neural networks' OOD generalization by blocking spurious correlations.
problem Graph Neural Networks struggle with out-of-distribution data due to learning spurious correlations.
method Formulates a causal graph, uses backdoor adjustment, and introduces a loss replacement strategy.
result Significantly improves OOD generalization of GNNs, stabilizing mutual information learning.
Metric learning enhances combinatorial coverage metrics' ability to predict classification errors.
problem Dataset dependence of combinatorial coverage metrics in anticipating classification errors.
method Metric learning to improve latent space separation of data classes.
result Metric learning increases SDCCMs' ability to distinguish between correctly and incorrectly classified data.
ProHOC detects OOD samples in class hierarchies, predicting them to correct internal nodes.
problem Binary OOD detection ignores semantic relationships between OOD and ID classes.
method Probabilistic hierarchical model using multi-depth networks trained for ID classification.
result ProHOC effectively classifies OOD samples to their correct internal nodes in class hierarchies.