One-shot algorithm for feature-distributed kernel PCA reduces communication costs.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
FedFisher improves one-shot FL by using Fisher information.
The paper projects unknown manifolds onto hyperspheres for efficient function approximation.
CAOS aggregates multiple one-shot predictors for efficient uncertainty quantification.
Bayesian approach reduces FL communication cost by one-shot.
We develop DTs for PDE models using KL-NN and TL, analyzing TL's moment equations and one-shot learning for exactness.
Study investigates one-shot semi-supervised learning for image classification.
Highly Autonomous Driving (HAD) systems rely on deep neural networks for the visual perception of the driving environment. Such networks are trained on large manually annotated databases. In this work, a semi-parametric approach to one-shot learning is proposed, with the aim of bypassing the manual annotation step requ…
One-shot neural architecture search allows joint learning of weights and network architecture, reducing computational cost. We limit our search space to the depth of residual networks and formulate an analytically tractable variational objective that allows for obtaining an unbiased approximate posterior over depths in…
CGMMD generates conditional samples in one shot with MMD and nearest neighbors.
A practical one-shot federated learning algorithm for cross-silo setting.
New method for one-shot timbre transfer in music.
One-shot neural architecture search (NAS) has played a crucial role in making NAS methods computationally feasible in practice. Nevertheless, there is still a lack of understanding on how these weight-sharing algorithms exactly work due to the many factors controlling the dynamics of the process. In order to allow a sc…
New framework infers multiple classes per image for one-shot learning.
A method to reduce memory usage in NAS by pruning the search space.
Deep learning, even if it is very successful nowadays, traditionally needs very large amounts of labeled data to perform excellent on the classification task. In an attempt to solve this problem, the one-shot learning paradigm, which makes use of just one labeled sample per class and prior knowledge, becomes increasing…
SPECTRE uses spectral conditioning to generate larger graphs without mode collapse.
Despite the breakthroughs achieved by deep learning models in conventional supervised learning scenarios, their dependence on sufficient labeled training data in each class prevents effective applications of these deep models in situations where labeled training instances for a subset of novel classes are very sparse -…
FROST speeds up and stabilizes one-shot semi-supervised learning.
One-shot federated learning method for prediction sets.
We unify recent neural approaches to one-shot learning with older ideas of associative memory in a model for metalearning. Our model learns jointly to represent data and to bind class labels to representations in a single shot. It builds representations via slow weights, learned across tasks through SGD, while fast wei…
This study improves UAV identification using RF signals with one-shot generative methods.
Neural network models that are not conditioned on class identities were shown to facilitate knowledge transfer between classes and to be well-suited for one-shot learning tasks. Following this motivation, we further explore and establish such models and present a novel neural network architecture for the task of weakly…
Less-than-one-shot learning tackles few-shot learning with minimal data.
Bonsai-Net efficiently discovers state-of-the-art models with fewer parameters.
Learning from a few examples remains a key challenge in machine learning. Despite recent advances in important domains such as vision and language, the standard supervised deep learning paradigm does not offer a satisfactory solution for learning new concepts rapidly from little data. In this work, we employ ideas from…
Quantum federated learning improves with non-IID data using one-shot communication.
We present a novel Newton-type method for distributed optimization, which is particularly well suited for stochastic optimization and learning problems. For quadratic objectives, the method enjoys a linear rate of convergence which provably \emph{improves} with the data size, requiring an essentially constant number of…
Efficiently optimizes expensive functions with multi-step lookahead using one-shot optimization.
We devise a one-shot approach to distributed sparse regression in the high-dimensional setting. The key idea is to average "debiased" or "desparsified" lasso estimators. We show the approach converges at the same rate as the lasso as long as the dataset is not split across too many machines. We also extend the approach…
Humans have an impressive ability to reason about new concepts and experiences from just a single example. In particular, humans have an ability for one-shot generalization: an ability to encounter a new concept, understand its structure, and then be able to generate compelling alternative variations of the concept. We…
Designs efficient algorithms for online and sliding window models of subspace embeddings for all p.
Study efficient algorithms for one-shot federated conformal prediction.
GraphBSI generates graphs by refining a belief in continuous space, outperforming existing models.
Inferring new facts from existing knowledge graphs (KG) with explainable reasoning processes is a significant problem and has received much attention recently. However, few studies have focused on relation types unseen in the original KG, given only one or a few instances for training. To bridge this gap, we propose Co…
We present one-shot federated learning, where a central server learns a global model over a network of federated devices in a single round of communication. Our approach - drawing on ensemble learning and knowledge aggregation - achieves an average relative gain of 51.5% in AUC over local baselines and comes within 90.…
Paper tackles 1-bit compressed sensing, presenting efficient algorithm for sparse signal estimation.
In recent years there has been a sharp rise in networking applications, in which significant events need to be classified but only a few training instances are available. These are known as cases of one-shot learning. Examples include analyzing network traffic under zero-day attacks, and computer vision tasks by sensor…
Neural Architecture Search (NAS) has shown great potentials in finding better neural network designs. Sample-based NAS is the most reliable approach which aims at exploring the search space and evaluating the most promising architectures. However, it is computationally very costly. As a remedy, the one-shot approach ha…
BS-NAS broadens and shrinks search space for optimal neural architectures.
Deep learning for object classification relies heavily on convolutional models. While effective, CNNs are rarely interpretable after the fact. An attention mechanism can be used to highlight the area of the image that the model focuses on thus offering a narrow view into the mechanism of classification. We expand on th…
The ability to rank candidate architectures is the key to the performance of neural architecture search~(NAS). One-shot NAS is proposed to reduce the expense but shows inferior performance against conventional NAS and is not adequately stable. We investigate into this and find that the ranking correlation between archi…
Blending multiple convolutional kernels is proved advantageous in neural architecture design. However, current two-stage neural architecture search methods are mainly limited to single-path search spaces. How to efficiently search models of multi-path structures remains a difficult problem. In this paper, we are motiva…
Learning β for k-SAT with one sample is hard, especially for low degrees.
NAS-Navigator automates neural network architecture search with visual steering.
Method learns SDEs from one trajectory using GP priors and randomized cross-validation.
Study one-shot strategic classification under unknown costs, improving worst-case accuracy.
A new meta-meta classification method tackles few-shot learning tasks.