Meta-learning improves feature extraction for few-shot tasks.
problem Understanding why meta-learning models perform better on few-shot classification.
method Developed hypotheses and a regularizer to improve standard training routines.
result Meta-learned models outperform classical training routines in few-shot classification.
TaskNorm improves meta-learning performance by rethinking batch normalization.
problem Challenges in batch normalization for meta-learning with deep networks.
method Developed TaskNorm, a novel approach to batch normalization for meta-learning.
result TaskNorm consistently improves meta-learning performance across various datasets and meta-learning approaches.
Proposes a method to evaluate meta-learning performance based on task similarity.
problem Meta-learning performance evaluation ignores task similarity, leading to biased results.
method Generative approach using Latent Dirichlet Allocation to analyze task similarity.
result The proposed method provides an insightful evaluation of meta-learning algorithms, matching common intuition.
Meta-GNN tackles few-shot node classification in graphs.
problem Few-shot learning in graph meta-learning.
method Meta-GNN learns prior knowledge from many similar few-shot learning tasks and applies it to new classes with few labeled samples.
result Meta-GNN improves node classification performance significantly on few-shot learning problems.
Bayesian online meta-learning framework tackles catastrophic forgetting in few-shot classification.
problem Catastrophic forgetting in few-shot classification problems.
method Bayesian online learning, meta-learning, Laplace approximation, variational inference.
result Framework effectively achieves goal of overcoming catastrophic forgetting in few-shot classification.
Bayesian meta-learning algorithm improves model calibration and accuracy.
problem Improving model calibration and accuracy in few-shot learning.
method Gradient-based variational inference to learn model parameter distributions.
result State-of-the-art calibration and classification results on few-shot benchmarks.
New PAC-Bayes meta-learning method improves few-shot learning accuracy and calibration.
problem Few-shot learning with limited data.
method PAC-Bayes framework extended to meta-learning, estimating task-specific posteriors.
result State-of-the-art calibration and classification results on benchmarks.
Meta learning can adapt fast but is vulnerable to adversarial attacks.
problem Vulnerability of meta learning to adversarial attacks.
method Formal definition of adversarial attacks unique to meta learning, proposing an attacking algorithm.
result Meta learning is vulnerable to adversarial attacks.
MOCA enables meta-learning without task segmentation for online learning.
problem Meta-learning without task segmentation for online learning.
method MOCA combines meta-learning with online changepoint analysis.
result MOCA enables efficient meta-learning in time-varying tasks.
MetaFun learns functional representations for meta-learning.
problem Few-shot classification on large-scale datasets.
method Functional encoder-decoder approach with iterative updates.
result State-of-the-art performance on miniImageNet and tieredImageNet.
Meta-learning model divides tasks into sub-problems for efficient adaptation.
problem Training models to quickly adapt to new tasks.
method Hierarchical Expert Networks with information-theoretic partitioning and specialized experts.
result Specialized experts lead to efficient adaptation to new tasks.
Regression networks improve few-shot classification with small data.
problem Generalizing to new classes with limited examples.
method Meta-learning classification by regressing closest approximations in class subspaces.
result Regression networks achieve excellent results in few-shot learning.
LST improves few-shot classification by leveraging unlabeled data and meta-learning.
problem Challenges of few-shot classification due to limited labeled data.
method Semi-supervised meta-learning method (LST) that uses unlabeled data and a soft weighting network (SWN).
result Significant improvements over state-of-the-art methods on ImageNet benchmarks.
Bayesian meta-learning improves few-shot learning with deep kernels.
problem Few-shot learning with small labeled datasets.
method Bayesian treatment of meta-learning using deep kernels.
result Deep Kernel Transfer (DKT) outperforms state-of-the-art algorithms.
Meta-learning improves few-shot time series classification.
problem Few labeled data for time series classification.
method Gradient-based meta-learning for residual neural networks.
result Meta-learning outperforms baselines on 41 datasets.
Torchmeta simplifies meta-learning evaluation across multiple datasets.
problem Inconsistent evaluation of meta-learning algorithms across different datasets.
method Introduces a library that provides data-loaders for standard benchmarks and simplifies model compatibility.
result Seamless and consistent evaluation of meta-learning algorithms on multiple datasets.
Meta-learning method improves PU classification performance.
problem Improving binary classifiers from PU data in unseen tasks.
method Adapts model to PU data using related tasks and neural networks.
result Proposed method outperforms existing methods on synthetic and real-world datasets.
Meta-learning improves few-shot land cover classification across diverse regions.
problem Capturing diversity in land cover classification across different geographic regions.
method Model-agnostic meta-learning (MAML) algorithm applied to classification and segmentation tasks.
result Few-shot model adaptation outperforms traditional methods in diverse land cover classification tasks.
CosML combines domain-specific meta-learners for cross-domain few-shot classification.
problem Generalizing to unseen domains while meta-learning on multiple seen domains.
method CosML trains domain-specific meta-learners and combines their meta-parameters in the parameter space.
result CosML outperforms state-of-the-art methods and achieves strong cross-domain generalization.
MetaTNE tackles few-shot novel labels in graphs, improving node classification.
problem Node classification on graphs with novel labels and limited training data.
method MetaTNE framework with structural, meta-learning, and optimization modules.
result MetaTNE significantly improves node classification over state-of-the-art methods.
ST-MAML tackles task ambiguity in meta-learning by encoding tasks with stochastic representations.
problem Handling tasks from multiple distributions is challenging for meta-learning due to task ambiguity.
method ST-MAML uses a stochastic neural network module to encode tasks and propagate task representations to revise input variable encoding.
result ST-MAML matches or outperforms state-of-the-art methods on various tasks.
Current deep learning based text classification methods are limited by their ability to achieve fast learning and generalization when the data is scarce. We address this problem by integrating a meta-learning procedure that uses the knowledge learned across many tasks as an inductive bias towards better natural languag…
Study improves peptide design efficiency using active and meta-learning.
problem Designing novel functional peptides is inefficient due to low throughput and lack of data.
method Investigated active learning and meta-learning for optimizing peptide design experiments.
result Meta-learning improved average accuracy, but neither method outperformed random choice.
Revises logistic-softmax likelihood for Bayesian meta-learning in few-shot classification.
problem Inherent uncertainty in logistic-softmax leads to suboptimal performance in meta-learning.
method Redesigns logistic-softmax likelihood with a temperature parameter for better control of prior confidence.
result Achieves well-calibrated uncertainty estimates and comparable/superior performance on benchmark datasets.
Meta-learning approaches have been proposed to tackle the few-shot learning problem.Typically, a meta-learner is trained on a variety of tasks in the hopes of being generalizable to new tasks. However, the generalizability on new tasks of a meta-learner could be fragile when it is over-trained on existing tasks during …
Meta-learning approach improves CNN architectures for concrete defect classification.
problem Challenging task of recognizing defects in concrete infrastructure.
method Two reinforcement learning based meta-learning approaches (MetaQNN and NAS) for finding suitable CNN architectures.
result Learned architectures have fewer parameters and better multi-target accuracy.
Meta-learning improves anomaly detection with few labeled instances.
problem High requirement of training data for neural network-based anomaly detection.
method Meta-learning framework with one-class classification and generalized eigenvalue problem.
result Meta-learning method achieves better performance than existing methods on various datasets.
Proposes a fair meta-learning framework for few-shot classification.
problem Fairness in few-shot learning.
method Primal-Dual subgradient approach for fair initialization.
result Significant improvements over prior work in fairness.
Method improves few-shot one-class classification.
problem Learning binary classifier with data from only one class.
method Modified MAML algorithm to learn initialization for few-shot OCC.
result Method leads to better results than classical approaches.
This work improves sample efficiency in meta-learning for nonlinear tasks.
problem Learning complex tasks efficiently with limited data.
method Subspace-based representations for nonlinear tasks.
result Subspace-based representations can be learned efficiently and improve future task performance.
Meta learning improves with contextualizers that adapt to examples.
problem Few shot classification with limited labeled data.
method Implement contextualizers as generalizable prototypes for gradient-based meta learning.
result Contextualizers significantly boost performance on various few shot learning datasets.
Meta-learning improves with explicit modeling of task covariate distributions.
problem Ignoring the relationship between task covariates and conditional distributions limits meta-learning performance.
method Introducing a hierarchical Bayesian model that leverages samples from the marginal task covariates to better infer optimal parameters.
result Our method outperforms initialization-based meta-learning on popular classification benchmarks.
Paper introduces a novel framework for set input tasks in meta-learning.
problem Meta-learning problems with set inputs often require efficient summary networks.
method Prototype-oriented optimal transport (POT) framework to improve summary networks.
result Significantly improves summary statistics from sets in meta-learning.
A new framework improves few-shot classification by learning to generalize to unseen classes.
problem Training metric-based meta-learning approaches for few-shot classification often fails to generalize to unseen classes.
method Proposes a bilevel optimization framework to explicitly constrain meta-training to reduce unseen classification error.
result Significantly improves performance on unseen classes compared to episodic training.
Meta-learning improves few-shot acoustic event detection.
problem Detecting new audio events with limited labeled data.
method Formulated few-shot AED problem; explored supervised and meta-learning approaches.
result Meta-learning achieves superior performance in few-shot AED.
A new meta-meta classification method tackles few-shot learning tasks.
problem Learning with limited data in small-data settings.
method Designing an ensemble of learners for a large set of problems, then learning how to combine them for a new problem.
result Meta-meta classification outperforms traditional meta-learning and ensembling approaches in one-shot learning tasks.
We propose a new splitting criterion for a meta-learning approach to multiclass classifier design that adaptively merges the classes into a tree-structured hierarchy of increasingly difficult binary classification problems. The classification tree is constructed from empirical estimates of the Henze-Penrose bounds on t…
New method for incremental meta-learning reduces forgetting and improves performance.
problem Incremental meta-learning for few-shot classification tasks.
method Indirect Discriminant Alignment (IDA) with incremental updates.
result Incremental learning reduces forgetting and improves performance.
Meta-learning is increasingly used to support the recommendation of machine learning algorithms and their configurations. Such recommendations are made based on meta-data, consisting of performance evaluations of algorithms on prior datasets, as well as characterizations of these datasets. These characterizations, also…
New algorithms improve multi-task learning across different environments.
problem Learning across multiple tasks and adapting to unseen environments.
method Learning common representations, dynamic feature weighting via attention mechanism.
result Significant performance improvement on new environments, 1.5x faster.
Meta-learning performance improved by keeping support sets fixed.
problem Effect of support set diversity on meta-learning performance.
method Fixed support sets across tasks in meta-learning.
result Not only does not reduce performance, but almost always improves it.
Meta-learning helps models learn quickly from few samples.
problem Deep learning requires many samples, which are hard to get.
method Meta-learning optimizes models to adapt quickly to new tasks.
result Meta-learning can improve model efficiency and adaptability.
Meta-learning strategy improves few-shot classification performance.
problem Few-shot classification with deep neural networks struggles when labeled samples are limited.
method Proposes an easy-to-hard expert meta-training strategy to arrange training tasks based on task hardness.
result Meta-learners achieve better results with the proposed expert training strategy.
Meta-learning improves few-shot learning by propagating knowledge across related classes on a graph.
problem Few-shot learning suffers from insufficient training data.
method Developed a Gated Propagation Network (GPN) that learns to propagate messages between prototypes of different classes on a graph.
result GPN outperforms recent meta-learning methods on benchmark datasets.
LSTMs show surprising few-shot learning ability, improving on MAML.
problem Few-shot learning with limited data.
method Revisited LSTM approach with Outer Product LSTM (OP-LSTM).
result OP-LSTM outperforms MAML on simple few-shot tasks, but not complex ones.
Meta-learning improved by using information theory to prioritize data-driven adaptation.
problem Challenges in meta-learning due to the need for mutually-exclusive tasks.
method Designing a meta-regularization objective using information theory.
result Successfully uses data from non-mutually-exclusive tasks to efficiently adapt to novel tasks.
A new method generates meta-tasks using generative models for unsupervised learning.
problem Creating synthetic meta-tasks for unsupervised learning.
method Generative models with latent space interpolation for sampling.
result The method outperforms or is competitive with baselines on few-shot classification tasks.
HSML tailors meta-learning knowledge to task clusters.
problem Handling task uncertainty and heterogeneity in meta-learning.
method Gradient-based HSML with hierarchical task clustering.
result HSML achieves state-of-the-art performance in few-shot learning.