Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

3577141,0701,427 · Jun 202019922001200920172026
48 results for meta models

Bayesian MAML outperforms MAML in meta learning tasks with theoretical guarantees.

problem Theoretical understanding of Bayesian MAML's superiority over MAML.
method Comparison of meta test risks between Bayesian MAML and MAML in meta linear regression.
result Bayesian MAML has provably lower meta test risks than MAML in both distribution agnostic and linear centroid cases.

Meta learning works well with overparameterized models, a phenomenon called 'benign overfitting'.

problem Understanding why overparameterized models perform well in few-shot learning.
method Analyzed the generalization performance of gradient-based meta learning with an overparameterized meta linear regression model.
result Demonstrated that overparameterized meta learning can still generalize well, a phenomenon called 'benign overfitting'.

Meta-learning balances task-specific modeling and optimization complexity.

problem Balancing accurate task-specific modeling with ease of optimization in meta-learning.
method Theoretical and empirical analysis of trade-off between modeling and optimization in meta-learning.
result Explicit bounds on modeling and optimization errors for non-convex and linear regression problems.

Learning to infer Bayesian posterior from a few-shot dataset is an important step towards robust meta-learning due to the model uncertainty inherent in the problem. In this paper, we propose a novel Bayesian model-agnostic meta-learning method. The proposed method combines scalable gradient-based meta-learning with non…

2018-06-11abs ↗pdf ↗

Existing meta-learning based few-shot learning (FSL) methods typically adopt an episodic training strategy whereby each episode contains a meta-task. Across episodes, these tasks are sampled randomly and their relationships are ignored. In this paper, we argue that the inter-meta-task relationships should be exploited …

2020-02-11abs ↗pdf ↗

When fitting Bayesian machine learning models on scarce data, the main challenge is to obtain suitable prior knowledge and encode it into the model. Recent advances in meta-learning offer powerful methods for extracting such prior knowledge from data acquired in related tasks. When it comes to meta-learning in Gaussian…

2019-01-23abs ↗pdf ↗

Majority of the modern meta-learning methods for few-shot classification tasks operate in two phases: a meta-training phase where the meta-learner learns a generic representation by solving multiple few-shot tasks sampled from a large dataset and a testing phase, where the meta-learner leverages its learnt internal rep…

2020-02-11abs ↗pdf ↗

A new method generates meta-tasks using generative models for unsupervised learning.

problem Creating synthetic meta-tasks for unsupervised learning.
method Generative models with latent space interpolation for sampling.
result The method outperforms or is competitive with baselines on few-shot classification tasks.

The goal of optimization-based meta-learning is to find a single initialization shared across a distribution of tasks to speed up the process of learning new tasks. Conditional meta-learning seeks task-specific initialization to better capture complex task distributions and improve performance. However, many existing c…

2020-02-20abs ↗pdf ↗

Meta-learning is a field that aims at discovering how different machine learning algorithms perform on a wide range of predictive tasks. Such knowledge speeds up the hyperparameter tuning or feature engineering. With the use of surrogate models various aspects of the predictive task such as meta-features, landmarker mo…

2020-02-11abs ↗pdf ↗

Meta-learning approaches have been proposed to tackle the few-shot learning problem.Typically, a meta-learner is trained on a variety of tasks in the hopes of being generalizable to new tasks. However, the generalizability on new tasks of a meta-learner could be fragile when it is over-trained on existing tasks during …

2018-05-20abs ↗pdf ↗

Meta-learning algorithms prepare quantum Gibbs states efficiently for NISQ devices.

problem Efficiently preparing quantum Gibbs states for NISQ devices.
method Meta-Variational Quantum Thermalizer (Meta-VQT) and Neural Network Meta-VQT (NN-Meta VQT) algorithms.
result Meta-learned parameters significantly outperform random initializations in optimization tasks.

Meta-SAGE improves deep RL scalability for CO tasks by adapting pre-trained models to larger-scale problems.

problem Improving scalability of deep reinforcement learning models for combinatorial optimization tasks.
method Meta-SAGE combines a scale meta-learner and scheduled adaptation with guided exploration to adjust model parameters for larger-scale problems.
result Meta-SAGE outperforms previous methods and significantly improves scalability in CO tasks.

Several multi-target regression methods were devel-oped in the last years aiming at improving predictive performanceby exploring inter-target correlation within the problem. However, none of these methods outperforms the others for all problems. This motivates the development of automatic approachesto recommend the mos…

2019-07-25abs ↗pdf ↗

Meta-learning has received a tremendous recent attention as a possible approach for mimicking human intelligence, i.e., acquiring new knowledge and skills with little or even no demonstration. Most of the existing meta-learning methods are proposed to tackle few-shot learning problems such as image and text, in rather …

2019-05-23abs ↗pdf ↗

In this paper we propose to solve an important problem in recommendation -- user cold start, based on meta leaning method. Previous meta learning approaches finetune all parameters for each new user, which is both computing and storage expensive. In contrast, we divide model parameters into fixed and adaptive parts and…

2019-12-04abs ↗pdf ↗

A tensor model for meta-learning adapts to task-specific features.

problem Learning shared representations for diverse tasks without task-specific observable information.
method Modeling meta-parameters as an order-3 tensor, estimating through tensor regression and method of moments.
result Tensor-based approach improves meta-learning performance with fewer samples.

Meta learning is a promising solution to few-shot learning problems. However, existing meta learning methods are restricted to the scenarios where training and application tasks share the same out-put structure. To obtain a meta model applicable to the tasks with new structures, it is required to collect new training d…

2019-04-19abs ↗pdf ↗

Gradient-based meta-learners such as Model-Agnostic Meta-Learning (MAML) have shown strong few-shot performance in supervised and reinforcement learning settings. However, specifically in the case of meta-reinforcement learning (meta-RL), we can show that gradient-based meta-learners are sensitive to task distributions…

2020-02-19abs ↗pdf ↗

Meta-learning improves with explicit modeling of task covariate distributions.

problem Ignoring the relationship between task covariates and conditional distributions limits meta-learning performance.
method Introducing a hierarchical Bayesian model that leverages samples from the marginal task covariates to better infer optimal parameters.
result Our method outperforms initialization-based meta-learning on popular classification benchmarks.

The capacity of meta-learning algorithms to quickly adapt to a variety of tasks, including ones they did not experience during meta-training, has been a key factor in the recent success of these methods on few-shot learning problems. This particular advantage of using meta-learning over standard supervised or reinforce…

2018-12-05abs ↗pdf ↗

Meta-learning framework uses task similarity through nonparametric kernel regression.

problem Limited tasks and outliers/dissimilar tasks hinder meta-learning performance.
method Nonparametric kernel regression to quantify and use task similarity.
result Meta-learning algorithm outperforms existing methods in task-limited settings.

In this work we study generalization of neural networks in gradient-based meta-learning by analyzing various properties of the objective landscapes. We experimentally demonstrate that as meta-training progresses, the meta-test solutions, obtained after adapting the meta-train solution of the model, to new tasks via few…

2019-07-16abs ↗pdf ↗

Few-shot classification is the task of predicting the category of an example from a set of few labeled examples. The number of labeled examples per category is called the number of shots (or shot number). Recent works tackle this task through meta-learning, where a meta-learner extracts information from observed tasks …

2019-09-25abs ↗pdf ↗

VMGP extends Gaussian processes for Bayesian meta-learning, improving uncertainty prediction.

problem Bayesian meta-learning for few-shot tasks with non-Gaussian uncertainty.
method VMGP (Variational Meta-Gaussian Processes) extends Gaussian processes to model non-Gaussian predictive posteriors.
result VMGP significantly outperforms existing Bayesian meta-learning methods on complex tasks.

ST-MAML tackles task ambiguity in meta-learning by encoding tasks with stochastic representations.

problem Handling tasks from multiple distributions is challenging for meta-learning due to task ambiguity.
method ST-MAML uses a stochastic neural network module to encode tasks and propagate task representations to revise input variable encoding.
result ST-MAML matches or outperforms state-of-the-art methods on various tasks.

Meta-learning improves Gaussian process uncertainty estimation.

problem Poor uncertainty estimation in Gaussian processes with deep kernels.
method Meta-learning to calibrate deep kernel GPs using task-specific uncalibrated and calibrated distributions.
result Improves uncertainty estimation performance with high regression performance.

A new meta-learning framework that assigns weights to source tasks based on target samples.

problem Learning initialization for target tasks with limited labeled examples.
method A general framework that assigns weights to the loss of different source tasks, which can depend on the target samples. Provides upper bounds and develops a learning algorithm based on minimizing the error bound with respect to an empirical IPM.
result Empirically, the weighted meta-learning algorithm finds better initializations than uniformly-weighted meta-learning algorithms.

Meta-learning enables a model to learn from very limited data to undertake a new task. In this paper, we study the general meta-learning with adversarial samples. We present a meta-learning algorithm, ADML (ADversarial Meta-Learner), which leverages clean and adversarial samples to optimize the initialization of a lear…

2018-06-08abs ↗pdf ↗