Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

226452678904 · Jun 202019922001200920172026
48 results for Meta-Learning Algorithms

A new meta-learning framework that assigns weights to source tasks based on target samples.

problem Learning initialization for target tasks with limited labeled examples.
method A general framework that assigns weights to the loss of different source tasks, which can depend on the target samples. Provides upper bounds and develops a learning algorithm based on minimizing the error bound with respect to an empirical IPM.
result Empirically, the weighted meta-learning algorithm finds better initializations than uniformly-weighted meta-learning algorithms.

Meta-learning improves neural networks by adapting learning algorithms.

problem Conventional AI approaches solve tasks from scratch, but meta-learning aims to improve the learning algorithm.
method Meta-learning adapts a learning algorithm based on multiple learning episodes.
result Meta-learning can tackle deep learning challenges like data and computation bottlenecks.

Meta-learning balances task-specific modeling and optimization complexity.

problem Balancing accurate task-specific modeling with ease of optimization in meta-learning.
method Theoretical and empirical analysis of trade-off between modeling and optimization in meta-learning.
result Explicit bounds on modeling and optimization errors for non-convex and linear regression problems.

Meta-learning algorithms are studied for their data efficiency in personalized federated learning.

problem Data efficiency in meta-learning algorithms.
method Algorithmic stability techniques to derive bounds on transfer risk and a new evaluation framework.
result Different meta-learning methods require varying amounts of supervision for effective generalization.

The paper provides fast, sample-efficient algorithms for learning common features in multi-task linear regression.

problem Learning transferable features from multiple related tasks.
method Provably fast, sample-efficient algorithms for multi-task linear regression.
result Theoretical guarantees on sample complexity for learning common features.

Meta-learning enables a model to learn from very limited data to undertake a new task. In this paper, we study the general meta-learning with adversarial samples. We present a meta-learning algorithm, ADML (ADversarial Meta-Learner), which leverages clean and adversarial samples to optimize the initialization of a lear…

2018-06-08abs ↗pdf ↗

Meta-learning framework uses task similarity through nonparametric kernel regression.

problem Limited tasks and outliers/dissimilar tasks hinder meta-learning performance.
method Nonparametric kernel regression to quantify and use task similarity.
result Meta-learning algorithm outperforms existing methods in task-limited settings.

Meta-learning algorithms use past experience to learn to quickly solve new tasks. In the context of reinforcement learning, meta-learning algorithms acquire reinforcement learning procedures to solve new problems more efficiently by utilizing experience from prior tasks. The performance of meta-learning algorithms depe…

2018-06-12abs ↗pdf ↗

Self-referential meta learning avoids explicit optimization by modifying itself.

problem Dependency on human engineering in meta learning algorithms.
method Investigates self-referential meta learning systems that modify themselves without explicit optimization.
result Self-referential neural networks can improve their own modifications without explicit optimization.

Meta-learning is a promising strategy for learning to efficiently learn within new tasks, using data gathered from a distribution of tasks. However, the meta-learning literature thus far has focused on the task segmented setting, where at train-time, offline data is assumed to be split according to the underlying task,…

2019-12-18abs ↗pdf ↗

TaskNorm improves meta-learning performance by rethinking batch normalization.

problem Challenges in batch normalization for meta-learning with deep networks.
method Developed TaskNorm, a novel approach to batch normalization for meta-learning.
result TaskNorm consistently improves meta-learning performance across various datasets and meta-learning approaches.

Meta-learning bounds derived using PAC-Bayes theory for improved generalization.

problem Uncertainty in generalization performance for meta-learning with new tasks.
method PAC-Bayes relative entropy bounds and empirical risk minimization (ERM) method.
result Competitive generalization performance and rapid convergence with data-dependent prior.

New meta-learning framework for minimizing simple regret in bandits.

problem Minimizing simple regret in a sequence of bandit tasks with unknown distributions.
method Developed Bayesian and frequentist meta-learning algorithms for bandits, analyzing their meta simple regret.
result Bayesian algorithm achieves ildeO(m/n) ilde{O}(m / \sqrt{n}) meta simple regret, frequentist algorithm ildeO(mn+m/n) ilde{O}(\sqrt{m} n + m/ \sqrt{n}).

There is no free lunch, no single learning algorithm that will outperform other algorithms on all data. In practice different approaches are tried and the best algorithm selected. An alternative solution is to build new algorithms on demand by creating a framework that accommodates many algorithms. The best combination…

2018-06-16abs ↗pdf ↗

We extend first-order model agnostic meta-learning algorithms (including FOMAML and Reptile) to image segmentation, present a novel neural network architecture built for fast learning which we call EfficientLab, and leverage a formal definition of the test error of meta-learning algorithms to decrease error on out of d…

2019-12-13abs ↗pdf ↗

Algorithm reduces regret in non-stationary bandits and meta-learning with optimal arms.

problem Sequential decision-making with changing task boundaries and optimal arms.
method Reduction to bandit submodular maximization, meta-learning algorithms.
result Regret bounds for both non-stationary and bandit meta-learning problems.

Study MAML's generalization in varying tasks, proving bounds on error.

problem Bounding MAML's generalization error across tasks.
method Characterizes MAML's generalization error from two perspectives: recurring and unseen tasks.
result MAML's generalization error depends on the number of tasks and samples per task.

New algorithm for online meta-learning with task boundary detection.

problem Adapting to new tasks in a non-stationary environment.
method Two detection mechanisms for task switches and distribution shift; online model updates based on current data.
result Achieves sublinear task-averaged regret under mild conditions.

A meta-learning approach for efficient algorithm selection in budget-limited scenarios.

problem Efficiently selecting the best-performing machine learning algorithm with limited computational resources.
method A Markov Decision Process framework where an agent decides whether to train, wake up, or start new algorithms based on partial learning curves.
result Meta-learning from learning curves improves algorithm selection, especially when learning curves do not intersect frequently.

Meta-learning method for accurate classifier from noisy annotators' data.

problem Accurate learning from noisy labels provided by multiple annotators.
method Meta-learning neural network to embed examples in latent space and estimate annotators' abilities, then adapt classifiers using EM algorithm.
result Meta-learning method improves classifier performance with minimal labeled data.

The ability to learn new concepts with small amounts of data is a critical aspect of intelligence that has proven challenging for deep learning methods. Meta-learning has emerged as a promising technique for leveraging data from previous tasks to enable efficient learning of new tasks. However, most meta-learning algor…

2019-12-09abs ↗pdf ↗

New PAC-Bayesian bounds explain few-shot learning performance gaps.

problem Gap between PAC-Bayesian theory and practice in few-shot learning.
method Developed new PAC-Bayesian bounds for few-shot learning, derived MAML and Reptile from these bounds, and introduced a new PACMAML algorithm.
result PAC-Bayesian bounds explain performance of MAML and Reptile, and outperform existing algorithms.

The constant introduction of standardized benchmarks in the literature has helped accelerating the recent advances in meta-learning research. They offer a way to get a fair comparison between different algorithms, and the wide range of datasets available allows full control over the complexity of this evaluation. Howev…

2019-09-14abs ↗pdf ↗

Meta-learning improves performance in stochastic linear bandits.

problem Selecting a learning algorithm that performs well across multiple bandit tasks.
method Regularized OFUL algorithm with a bias vector, estimating bias within the learning-to-learn setting.
result Meta-learning strategies improve performance when the number of tasks grows and task variance is small.

Proposes a method to evaluate meta-learning performance based on task similarity.

problem Meta-learning performance evaluation ignores task similarity, leading to biased results.
method Generative approach using Latent Dirichlet Allocation to analyze task similarity.
result The proposed method provides an insightful evaluation of meta-learning algorithms, matching common intuition.

VMGP extends Gaussian processes for Bayesian meta-learning, improving uncertainty prediction.

problem Bayesian meta-learning for few-shot tasks with non-Gaussian uncertainty.
method VMGP (Variational Meta-Gaussian Processes) extends Gaussian processes to model non-Gaussian predictive posteriors.
result VMGP significantly outperforms existing Bayesian meta-learning methods on complex tasks.