Random forest can be adapted for open-set recognition with improved performance.
problem Handling unknown classes in real-world classification tasks.
method Incorporating distance metric learning and distance-based open-set recognition into random forest.
result The proposed method outperforms state-of-the-art open-set recognition methods.
End-to-end open-set recognition using intra-class splitting.
problem Open-set recognition with limited known samples.
method Intra-class data splitting to model unknown classes.
result Outperformed baselines and improved state-of-the-art methods.
New analysis shows uncertainty-based methods alone aren't enough for open set recognition.
problem Overcoming the challenge of recognizing out-of-distribution data.
method Comparing predictive uncertainty with extreme value theory and generative models.
result Generative model-based open set recognition outperforms other methods.
CGDL improves open set recognition by learning conditional Gaussian distributions.
problem Handling unknown samples in real-world recognition tasks.
method Conditional Gaussian Distribution Learning (CGDL) with probabilistic ladder architecture.
result CGDL significantly outperforms baseline methods on standard image datasets.
Open set recognition problems exist in many domains. For example in security, new malware classes emerge regularly; therefore malware classification systems need to identify instances from unknown classes in addition to discriminating between known classes. In this paper we present a neural network based representation…
Proposes a new framework for open set recognition using conditional probabilistic generative models.
problem Unknown samples can mislead traditional deep neural networks during testing.
method Conditional Probabilistic Generative Models (CPGM) that combine generative models with discriminative information.
result Significantly outperforms baselines on multiple benchmark datasets.
In real-world recognition/classification tasks, limited by various objective factors, it is usually difficult to collect training samples to exhaust all classes when training a recognizer or classifier. A more realistic scenario is open set recognition (OSR), where incomplete knowledge of the world exists at training t…
Survey on deep learning for malware classification, including unknown threats.
problem Classifying and recognizing unknown malware variants.
method Review of deep learning techniques and OSR solutions.
result Deep learning can effectively classify known malware and recognize unknown threats.
A new method trains deep neural networks for open set domain adaptation without negative open set difference.
problem Training deep neural networks for open set domain adaptation without negative open set difference.
method Proposes a new upper bound of target-domain risk, including source-domain risk, ε-open set difference (Δε), distributional discrepancy, and constant. Uses gradient descent for source-domain risk and Δε, and adversarial training for distributional discrepancy. Trains DNNs via minimizing the new upper bound. result Shows state-of-the-art performance on benchmark datasets.
Unified approach to continual learning using generative replay and open set recognition.
problem Catastrophic interference and recognition of out-of-distribution data in deep neural networks.
method Probabilistic approach based on variational inference in a deep autoencoder model, using generative replay and open set recognition.
result The approach significantly alleviates catastrophic interference and distinguishes out-of-distribution data.
Improved deep learning for one-shot and open-set classification using alignment-based matching.
problem Limited data for one-shot classification and open-set recognition.
method Aligns images to reference images for classification, learns alignment mechanism.
result Significantly improved classification accuracy (e.g., 1.4% error rate in Omniglot, 46.5% in MiniImageNet).
GMVAE improves open-set classification by clustering latent representations.
problem Improving open-set classification accuracy and robustness.
method Cooperative learning of reconstruction and clustering in the latent space of a GMVAE.
result Achieved an average F1 improvement of 29.5% in open-set classification.
Despite significant progress in object categorization, in recent years, a number of important challenges remain, mainly, ability to learn from limited labeled data and ability to recognize object classes within large, potentially open, set of labels. Zero-shot learning is one way of addressing these challenges, but it …
The Familiarity Hypothesis explains deep open set methods' success in detecting novel objects.
problem Detecting novel objects in open set recognition problems.
method Logits-based detection of absence of familiar features.
result Familiarity-based detection fails in scenarios with both novel and familiar objects.
This work bridges continual learning, active learning, and open set recognition in deep neural networks.
problem Protecting previously acquired representations from catastrophic forgetting in deep neural networks.
method Surveying the literature and proposing a consolidated view to integrate open set recognition and active learning principles.
result Joint improvement in alleviating catastrophic forgetting, querying data, selecting task orders, and robust open world application.
Study tackles open-set camera model identification, improving over state-of-the-art.
problem Identifying camera models from unknown ones in open-set scenarios.
method Feature extraction algorithms and classifiers for open-set recognition, evaluating different training protocols.
result A simple open-set training protocol yields the best results, improving over state-of-the-art solutions.
In open set recognition (OSR), almost all existing methods are designed specially for recognizing individual instances, even these instances are collectively coming in batch. Recognizers in decision either reject or categorize them to some known class using empirically-set threshold. Thus the decision threshold plays a…
Paper proposes a loss extension for neural networks to improve OSR performance.
problem Open set recognition problem, distinguishing known and unknown classes.
method Introduces a loss function extension to find more discriminative polar representations.
result Significantly improves performance on datasets from different domains.
Often, when dealing with real-world recognition problems, we do not need, and often cannot have, knowledge of the entire set of possible classes that might appear during operational testing. In such cases, we need to think of robust classification methods able to deal with the "unknown" and properly reject samples belo…
This research generates synthetic data streams for handling concept drifts and novel classes.
problem Handling concept drifts and novel classes in dynamic data streams.
method Synthetic data stream generation for both concept drifts and novel classes.
result Demonstrates the effectiveness of unsupervised drift detectors in open set recognition.
End-to-end PGL framework tackles open-set domain shift.
problem Real-world domain shift with unknown additional classes.
method Episodic training in graph neural network with adversarial learning.
result Guarantees tighter upper bound of target error.
Research improves open-set learning by leveraging unlabelled data.
problem Learning between observed and unobserved novel categories.
method Unified policy of positive and unlabelled learning, semi-supervised learning, and open-set recognition.
result Achieves state-of-the-art results in open-set learning.
Plex improves model reliability across vision and language tasks.
problem Improving model reliability in diverse decision-making tasks involving uncertainty and adaptation.
method Developed ViT-Plex and T5-Plex pretrained model extensions to evaluate and improve reliability across 40 datasets.
result Plex greatly improves state-of-the-art across reliability tasks, simplifying evaluation and performance.
The novel unseen classes can be formulated as the extreme values of known classes. This inspired the recent works on open-set recognition \cite{Scheirer_2013_TPAMI,Scheirer_2014_TPAMIb,EVM}, which however can have no way of naming the novel unseen classes. To solve this problem, we propose the Extreme Value Learning (E…
This paper proposes a unified framework for recognizing seen and unseen classes using visual and semantic prototypes.
problem Class overfitting and misclassification of unseen classes in zero-shot learning.
method Decomposes G-ZSL into OSR and ZSL, introduces semantic side-information for OSR, and uses a VSG-CNN framework.
result Improves recognition performance and cognitive ability for unknown classes.
New method improves OSSL by learning from all unlabeled data.
problem Handling open-set semi-supervised learning with unknown classes.
method Self-supervision and energy-based score for all unlabeled data.
result State-of-the-art results on benchmark problems.
With the recent renaissance of deep convolution neural networks, encouraging breakthroughs have been achieved on the supervised recognition tasks, where each class has sufficient training data and fully annotated training data. However, to scale the recognition to a large number of classes with few or now training samp…
Active learning selects most informative unlabeled samples for labeling.
problem Efficiently label unlabeled data in applications with scarce labeled data.
method Formulated as open-set recognition, uses VNNs to identify uncertain samples.
result Achieved state-of-the-art results on MNIST, CIFAR-10, and CIFAR-100.
Study improves speaker verification accuracy using angular based embedding learning.
problem Improving discriminative power of embeddings for open-set speaker verification.
method Optimizes angular distance and adds margin penalty, applying various angular margin embedding strategies and proposing inter-class regularization.
result Achieved impressive results with 16.5% improvement in EER and 18.2% improvement in minimum detection cost function.
This paper reviews information theory in open-world machine learning.
problem Lack of a unified theoretical foundation for open-world machine learning.
method Synthesis of information theoretic approaches.
result Established a pathway toward provable and trustworthy open world intelligence.
New dataset and benchmarks for lifelong robotic vision tasks.
problem Challenges in applying computer vision to robots, especially lifelong learning.
method Provided a new lifelong robotic vision dataset and benchmarks.
result Demonstrated the complexity and bottlenecks in lifelong object recognition.
Paper tackles open set domain adaptation with theoretical bounds and algorithms.
problem Improving model performance on target domain with unknown classes.
method Theoretical investigation and regularization of open set difference, leading to DAOD algorithm.
result Proposed learning bound and algorithm show superior performance compared to existing methods.
Integrates multiple datasets to solve open set crowdsourcing problems.
problem Crowdsourcing with unknown label space and unfamiliar tasks.
method Integrates multiple crowdsourced datasets, weights them based on category correlation, and uses open set transfer learning.
result Proves OSCrowd solves open set crowdsourcing problems and outperforms related solutions.
Study on diagnosing unseen medical conditions using open-set learning.
problem Training models for unseen medical conditions is impractical.
method Frame diagnosis as an open-set learning problem, compare state-of-the-art approaches, and experiment with distributed training data.
result Explicitly modeling unseen conditions leads to consistent gains, but optimal training strategy varies.
Paper develops a deep neural network for open set incremental learning of new authors.
problem Classifying unseen examples from previously unseen classes.
method Deep neural network clustering and retraining for new classes.
result Incremental learning model that continuously learns new classes.
Study shows neural networks outperform traditional methods in speaker identification.
problem Open-set speaker identification with large populations.
method Discriminative neural networks compared to Gaussian mixture models.
result Multi-class neural networks outperform traditional methods for large speaker populations.
New bounds on inscribed triangles in arbitrary planar domains.
problem Finding inscribed triangles in arbitrary planar domains with specific angle constraints.
method Proving the existence of uniformly fat triangles and not-too-fat triangles in bounded open sets.
result Existence of a maximal number Θ (between 0 and 60) for inscribed triangles with angles ≥ Θ degrees.
In open set learning, a model must be able to generalize to novel classes when it encounters a sample that does not belong to any of the classes it has seen before. Open set learning poses a realistic learning scenario that is receiving growing attention. Existing studies on open set learning mainly focused on detectin…
Method transfers knowledge between partially labeled domains to classify all samples.
problem Weakly supervised open-set domain adaptation between partially labeled domains.
method Collaborative Distribution Alignment (CDA) method for bilaterally knowledge transfer and outlier identification.
result Achieves state-of-the-art performance on Office benchmark and person reidentification.
New method for estimating class proportions in open-set label shift data.
problem Estimating class proportions and distributions when test data includes novel classes.
method Semiparametric density ratio model framework with maximum empirical likelihood estimators and confidence intervals.
result Improved estimation accuracy and classification performance compared to existing methods.
Estimates open sets for fibrations, leading to volume vanishing results.
problem Estimating open sets for fibrations.
method Straightforward estimate for open sets with fundamental group constraints.
result Vanishing results for simplicial volume and minimal volume entropy for certain mapping tori.
FedOS tackles challenges in federated learning by using open-set learning.
problem Challenges in federated learning due to data locality and privacy constraints.
method Introduces open-set learning to stabilize training in federated learning.
result Demonstrates improved model performance through open-set learning.
Paper tackles open set domain adaptation by detecting unknown classes.
problem Adapting to target domains with unknown classes when label spaces partially overlap.
method Instance-level reweighting strategy combined with Extreme Value Theory for unknown class detection.
result Proposed method outperforms state-of-the-art models on conventional datasets.
Photo-identification (photo-id) of dolphin individuals is a commonly used technique in ecological sciences to monitor state and health of individuals, as well as to study the social structure and distribution of a population. Traditional photo-id involves a laborious manual process of matching each dolphin fin photogra…
The paper proves removable singularity for nonlocal minimal graphs.
problem Proving removable singularities for nonlocal minimal graphs.
method Analyzing (s,1)-capacity zero compact sets to ensure graphs are minimal in the entire domain. result Nonlocal minimal graphs are removable in the entire domain if they are minimal in a set of (s,1)-capacity zero. Paper develops a new method for open-set and imbalanced classification with valid prediction sets.
problem Tackles open-set and imbalanced classification with new prediction methods.
method Develops a new family of conformal p-values and a selective sample splitting algorithm.
result Valid prediction sets with valid coverage in open-set scenarios and informative predictions under extreme class imbalance.
The paper proves smoothness of stationary varifolds.
problem Understanding the smoothness of stationary varifolds.
method Analyzing m-dimensional integer rectifiable varifolds in open sets. result The support of stationary varifolds is C∞ rectifiable. Novikov's problem of semiclassical orbits of quasi-electrons in a normal metal leads to a correspondance between 3-ply periodic functions in R and fractals in R P^2. These fractals are the complement of infinitely many open sets labeled by integer 2-cycles of T^3. Here we present a characterization of the fractal point…