Prototype networks on hyperspheres improve classification and regression.
problem Improving classification and regression performance.
method Using hyperspherical prototypes for classification and regression, optimizing prototypes through data-independent margin separation.
result Hyperspherical prototype networks outperform other methods in classification, regression, and their combination.
We propose a novel architecture for k-shot classification on the Omniglot dataset. Building on prototypical networks, we extend their architecture to what we call Gaussian prototypical networks. Prototypical networks learn a map between images and embedding vectors, and use their clustering for classification. In our…
A new neural network method improves interpretability and detection of outliers.
problem Improving interpretability and detection of outliers in neural networks.
method Prototype-based learning (PbL) using a winner-take-all (WTA) network with two prototypes: positive and negative.
result The negative prototype is similar to the positive one, aligning with the BCM theory.
We propose prototypical networks for the problem of few-shot classification, where a classifier must generalize to new classes not seen in the training set, given only a small number of examples of each new class. Prototypical networks learn a metric space in which classification can be performed by computing distances…
Deep neural networks are widely used for classification. These deep models often suffer from a lack of interpretability -- they are particularly difficult to understand because of their non-linear nature. As a result, neural networks are often treated as "black box" models, and in the past, have been trained purely to …
Infinite mixture prototypes adapt to complex data for few-shot learning.
problem Few-shot learning with complex data distributions.
method Adaptive representation of classes by clusters, inferring cluster number.
result 25% absolute accuracy improvement on alphabets, state-of-the-art semi-supervised clustering.
Paper proposes integrating hierarchical class structure into prototypical network supervision.
problem Improving classification accuracy in tasks with hierarchical class structures.
method Integrates hierarchical class structure (metric) into prototypical network supervision.
result Consistent improvement of error rate weighted by the cost matrix compared to traditional methods.
Neural networks currently dominate the machine learning community and they do so for good reasons. Their accuracy on complex tasks such as image classification is unrivaled at the moment and with recent improvements they are reasonably easy to train. Nevertheless, neural networks are lacking robustness and interpretabi…
ProtoryNet interprets text sequences using prototype trajectories for better understanding.
problem Improving text classification interpretability and accuracy.
method ProtoryNet uses prototype trajectories to interpret text sequences, with prototype pruning for better interpretability.
result ProtoryNet outperforms baseline models and reduces performance gap compared to black-box models.
Prototypical Networks improve multi-label classification accuracy.
problem Multi-label classification with nonlinear label dependencies.
method Formulate multi-label learning as class distribution in a non-linear embedding space. For each label, positive and negative embeddings are compactly distributed. Labels are inferred by measuring the distance to prototype positive or negative embeddings.
result Extensive experiments show improved accuracy compared to state-of-the-art algorithms.
Improved few-shot learning with unlabeled data using random walks.
problem Few-shot learning with limited labeled data.
method Prototypical Random Walk Networks (PRWN) with semi-supervised loss.
result Significant performance improvements in most benchmarks.
Prototype model improves model auditing and understanding.
problem Auditing and understanding modern language models is expensive and approximate.
method Introduced a sparse, non-negative mixture of learned prototypes trained with clustering objectives.
result Prototype models either surpass or remain within 2.5 percentage points of dense baselines on downstream tasks.
DPTA improves CIL by adapting PTMs with dual prototypes.
problem Catastrophic forgetting in incremental learning with pre-trained models.
method Dual-Prototype Network with Task-wise Adaptation (DPTA).
result DPTA consistently outperforms recent methods by 1\%-5\% on multiple benchmarks.
New method trains prototypical few-shot models on single class.
problem Train few-shot models on single class with limited examples.
method Introduce 'null class' and use batch normalization; propose Gaussian layer for distance calculation.
result Achieved high accuracy on test sets (Omniglot: 98%, MiniImageNet: 80%).
One of the fundamental tasks in understanding genomics is the problem of predicting Transcription Factor Binding Sites (TFBSs). With more than hundreds of Transcription Factors (TFs) as labels, genomic-sequence based TFBS prediction is a challenging multi-label classification task. There are two major biological mechan…
The paper uses learned prototypes to explain deep learning models for time-series data.
problem Lack of explainable AI in deep learning models for high-risk decisions.
method Learned prototypes in latent space of deep learning models.
result Prototypes improve classification decisions and provide explainable insights.
HitNet uses a Hit-or-Miss layer to enhance feature interpretability in capsule networks.
problem Difficulty in interpreting complex neural network architectures.
method Replacing the last layer with a Hit-or-Miss layer that trains capsules to hit or miss a target capsule using centripetal loss.
result HitNet achieves better performance than initial CapsNet on various datasets and provides interpretable feature representations.
Paper introduces a novel framework for set input tasks in meta-learning.
problem Meta-learning problems with set inputs often require efficient summary networks.
method Prototype-oriented optimal transport (POT) framework to improve summary networks.
result Significantly improves summary statistics from sets in meta-learning.
Graph Prototypical Networks improve few-shot node classification on attributed networks.
problem Few-shot node classification in attributed networks with limited labeled instances.
method Graph Prototypical Networks (GPN) using meta-learning to extract meta-knowledge and identify informative labeled instances.
result GPN achieves superior performance in few-shot node classification.
When we are faced with challenging image classification tasks, we often explain our reasoning by dissecting the image, and pointing out prototypical aspects of one class or another. The mounting evidence for each of the classes helps us make our final decision. In this work, we introduce a deep network architecture -- …
ProtoNAM models tabular data with neural networks, making predictions transparent.
problem Tabular data analysis using neural networks lacks transparency and accuracy compared to tree-based methods.
method ProtoNAM introduces prototypes into neural networks to model tabular data while maintaining explainability.
result ProtoNAM outperforms existing NN-based GAMs and provides insights into learned feature patterns.
A new method improves few-shot learning by combining ProtoNet with LFD.
problem Few-shot learning struggles with high variance support sets.
method Combines ProtoNet with Local Fisher Discriminant Analysis.
result Superior classification accuracy on miniImageNet and tieredImageNet.
DDCL-INCRT learns its own structure during training, reducing unnecessary complexity.
problem Fixed-size neural network architectures require manual tuning, leading to overfitting.
method Combines DDCL (Deep Dual Competitive Learning) and INCRT (Incremental Transformer) to self-organize network structure.
result The network self-organizes into a hierarchy of heads, reducing unnecessary complexity.
SLEEPER combines deep learning with expert rules for accurate sleep staging.
problem Manual sleep staging is tedious and requires expert time.
method SLEEPER uses convolutional neural networks and expert rules to generate interpretable models.
result SLEEPER achieves comparable accuracy to human experts and deep neural networks.
PPN learns from weakly-labeled data to improve few-shot learning.
problem Few-shot learning with limited labeled data.
method Prototype Propagation Network (PPN) trained on few-shot tasks with coarse-label data.
result PPN significantly outperforms other methods on benchmarks.
A probabilistic method for deep embedding that improves classification accuracy and interpretability.
problem Improving classification accuracy and interpretability in deep learning.
method A probabilistic approach that treats embeddings as random variables, using a product distribution over labeled instances and marginalizing prototype proximity.
result Superior large- and open-set classification accuracy compared to state-of-the-art methods.
FiberNet integrates geometry into machine learning for clearer classification.
problem Lack of interpretability in traditional deep learning.
method Reformulates classification as geometric optimization on fiber bundles, introducing learnable Riemannian metrics and variational prototype optimization.
result Clear geometric interpretability and efficiency in classification.
New method improves few-shot learning with randomized SPSA.
problem Training classifiers on limited examples of new classes.
method Randomized stochastic approximation and prototypical networks.
result The proposed method outperforms original prototypical networks.
Prototype-based memory network learns visual categories from unlabeled data.
problem Learning from nonstationary, unlabeled data with sequential dependencies.
method Online prototype-based memory network with contrastive loss.
result Significantly better category recognition compared to state-of-the-art methods.
Designing a new drug is a lengthy and expensive process. As the space of potential molecules is very large (10^23-10^60), a common technique during drug discovery is to start from a molecule which already has some of the desired properties. An interdisciplinary team of scientists generates hypothesis about the required…
Prototypal analysis is introduced to overcome two shortcomings of archetypal analysis: its sensitivity to outliers and its non-locality, which reduces its applicability as a learning tool. Same as archetypal analysis, prototypal analysis finds prototypes through convex combination of the data points and approximates th…
Optimal prototypes found for challenging pathological geometries.
problem Finding optimal prototypes for pathological geometries is challenging.
method Analytical and heuristic algorithms for finding nearly-optimal prototypes.
result Optimal prototypes can be found analytically for challenging geometries.
Bayesian meta-learning on relation graphs improves few-shot relation extraction.
problem Predicting relations in sentences with limited labeled examples.
method Bayesian meta-learning on a global relation graph, using graph neural networks and Langevin dynamics.
result Framework effectively learns and generalizes to new relations.
We consider the problem of semi-supervised few-shot classification where a classifier needs to adapt to new tasks using a few labeled examples and (potentially many) unlabeled examples. We propose a clustering approach to the problem. The features extracted with Prototypical Networks are clustered using K-means with …
A new method explains Siamese neural networks using feature comparison and autoencoder.
problem Explaining the decision-making process of Siamese neural networks.
method Feature comparison at embedding level and autoencoder reconstruction.
result The method effectively explains Siamese neural networks using MNIST dataset.
Method generates prototypes from small datasets for efficient learning.
problem Efficiently learning from small datasets with soft labels.
method Modular method for generating soft-label prototypical lines and Hierarchical Soft-Label Prototype k-Nearest Neighbor algorithm.
result High classification accuracy with significantly fewer prototypes than classes.
New networks interpret kernel decompositions for signal analysis.
problem Mode decomposition in signal analysis.
method Programmable and interpretable regression networks using kernels and data.
result Near machine precision recovery of signal modes under regularity and separation assumptions.
Paper optimizes hyperspherical prototypes for better class separation.
problem Previous HPL approaches either lack principled optimisation or are limited to one latent dimension.
method Develops a principled optimisation procedure and uses linear block codes to create well-separated prototypes in various dimensions.
result Optimal prototype placement is characterized with achievable and converse bounds, showing near-optimality.
A neural network learns word-referent associations across various contexts.
problem Learning word-referent associations in different contexts.
method A biologically inspired multi-layered architecture that takes images and phonemes as input, builds representations, and adjusts prototypes based on current context.
result The model achieves up to 78% accuracy in ambiguous situations and mimics human learning patterns.
Paper proposes interpretable RL policies from a mixture of experts.
problem Making RL policies transparent and understandable in real-world applications.
method Policy iteration scheme with interpretable experts and prototypical states.
result Proposed algorithm learns policies comparable to neural networks but more interpretable.
Ensembles of decision trees perform well on many problems, but are not interpretable. In contrast to existing approaches in interpretability that focus on explaining relationships between features and predictions, we propose an alternative approach to interpret tree ensemble classifiers by surfacing representative poin…
Proposes a Manifold Graph for semi-supervised image classification.
problem Improving semi-supervised image classification with limited labeled data.
method Graph networks for feature extraction, graph connectivity, and feature propagation. Prototype Generator for unlabeled data representation.
result Achieves state-of-the-art performance with significantly fewer labeled data.
Meta-learning improves few-shot learning by propagating knowledge across related classes on a graph.
problem Few-shot learning suffers from insufficient training data.
method Developed a Gated Propagation Network (GPN) that learns to propagate messages between prototypes of different classes on a graph.
result GPN outperforms recent meta-learning methods on benchmark datasets.
TPM improves medical image segmentation by separating foreground and background.
problem Few-shot medical image segmentation challenges due to background variability.
method Tied Prototype Model (TPM) focusing on foreground, adapting thresholds, and using class priors.
result TPM leads to improved segmentation accuracy compared to ADNet.
ProSeNet provides interpretable deep sequence models with natural explanations.
problem Challenges in explaining deep neural network predictions for sequence modeling.
method Prototypes derived from case-based reasoning, with criteria for simplicity, diversity, and sparsity.
result Achieves accuracy on par with state-of-the-art models while providing interpretable explanations.
We present the Bayesian Case Model (BCM), a general framework for Bayesian case-based reasoning (CBR) and prototype classification and clustering. BCM brings the intuitive power of CBR to a Bayesian generative framework. The BCM learns prototypes, the "quintessential" observations that best represent clusters in a data…
Detects out-of-domain cases with limited training data.
problem Detecting out-of-domain cases with insufficient in-domain training data.
method Proposes an OOD-resistant Prototypical Network.
result Outperforms state-of-the-art methods in zero-shot OOD detection.
This paper proposes a unified framework for recognizing seen and unseen classes using visual and semantic prototypes.
problem Class overfitting and misclassification of unseen classes in zero-shot learning.
method Decomposes G-ZSL into OSR and ZSL, introduces semantic side-information for OSR, and uses a VSG-CNN framework.
result Improves recognition performance and cognitive ability for unknown classes.