Zero-shot learning transfers knowledge from seen classes to novel unseen classes to reduce human labor of labelling data for building new classifiers. Much effort on zero-shot learning however has focused on the standard multi-class setting, the more challenging multi-label zero-shot problem has received limited attent…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “zero-shot transfer learning”
Paper explores zero-shot cross-lingual reading comprehension using pre-trained multi-lingual model.
problem Lack of training data for every language in reading comprehension tasks.
method Systematic exploration of zero-shot cross-lingual transfer learning with a multi-lingual language representation model.
result Zero-shot cross-lingual transfer learning is feasible and translating source data into target language is not necessary.
CLIP learns joint image-text representations for zero-shot learning.
problem Understanding and improving zero-shot transfer performance in CLIP.
method Formal study of transferrable representation learning and analysis of zero-shot transfer performance.
result Proposes a new CLIP-type approach that outperforms existing methods.
Paper proposes zero-shot transfer learning for semantic parsing.
problem Applying neural networks to tasks with little data remains challenging.
method Introduces a new method for learning shared space between domains based on domain label prediction.
result Method outperforms state-of-the-art techniques in zero-shot experimental setting.
Zero-shot contrastive loss improves text-guided image style transfer without extra training.
problem Stochastic nature of diffusion models leads to trade-offs between style transformation and content preservation.
method Proposes a zero-shot contrastive loss for diffusion models that doesn't require additional fine-tuning or auxiliary networks.
result Method outperforms existing methods while preserving content and requiring no additional training.
Two KG-based methods explain transfer learning in CNN and ZSL.
problem Uninterpretable transfer learning for non-ML experts.
method Knowledge Graph-based explanation for transferability and model justification.
result Rich, human-understandable explanations for transfer learning.
HGKT transfers knowledge from seen to unseen classes in GZSL without prior unseen class info.
problem Learning to classify unseen classes in GZSL.
method Structured heterogeneous graph with graph neural network for knowledge transfer.
result Achieves state-of-the-art results on public benchmark datasets.
Paper proposes operator deep Q-learning for quick reward adaptation.
problem Standard RL can only handle one reward function and struggles with unseen rewards.
method Develops operator neural networks to map reward functions to value functions.
result Operator deep Q-learning can quickly adapt to new reward functions.
TGG improves zero-shot and few-shot learning by explicitly modeling and utilizing seen-unseen domain relations.
problem Lack of data in unseen domains hinders generalization in zero-shot and few-shot learning.
method TGG generates explicit instance-level graphs to model and utilize seen-unseen domain relations, addressing domain shift.
result TGG outperforms existing methods in zero-shot, generalized zero-shot, and few-shot learning.
Despite the advancement of supervised image recognition algorithms, their dependence on the availability of labeled data and the rapid expansion of image categories raise the significant challenge of zero-shot learning. Zero-shot learning (ZSL) aims to transfer knowledge from labeled classes into unlabeled classes to r…
Few-shot NER classification with limited data.
problem Limited annotated data for Named Entity Recognition.
method Prototypical Network + Transfer Learning
result Well-performing classifiers trained on only 20 instances.
FedZKT enables resource-constrained devices to participate in federated learning with heterogeneous models.
problem Inequality in resource allocation hinders participation from resource-constrained devices in federated learning.
method Zero-shot knowledge transfer through a server-assigned distillation process.
result FedZKT effectively transfers knowledge across heterogeneous on-device models without requiring comparable local training efforts.
Paper proposes redundancy-free features for zero-shot object recognition.
problem Redundant visual features degrade zero-shot object recognition.
method Project original features into a new, statistically independent space.
result RFF-GZSL achieves competitive results on benchmark datasets.
AUTOVC converts voices without parallel data, achieving state-of-the-art results.
problem Non-parallel many-to-many voice conversion and zero-shot voice conversion.
method Only an autoencoder with a carefully designed bottleneck is used, training on a self-reconstruction loss.
result AUTOVC achieves state-of-the-art results in many-to-many voice conversion with non-parallel data and performs zero-shot voice conversion.
A new method transfers knowledge without data, matching teacher's predictions closely.
problem Lack of access to training data for knowledge transfer.
method Adversarial training to match teacher's predictions without data.
result Zero-shot student performs well on CIFAR10, improving state-of-the-art.
Agent learns reward function from demonstrations in contextual MDPs.
problem Learn reward function from demonstrations in unseen contexts.
method Formulated as convex optimization, proposed algorithm computes subgradients.
result Zero-shot transfer demonstrated in dynamic treatment regime.
Adaptive adjustment of semantic feature space improves zero-shot recognition.
problem Domain shift and hubness problems in zero-shot recognition.
method Adaptive adjustment of semantic feature space.
result Remarkable performance improvement compared to existing methods.
Two new techniques improve zero-shot HPO efficiency.
problem Efficiently selecting hyperparameters for new datasets.
method Surrogate model and multi-fidelity techniques.
result Significant improvement in accuracy compared to standard methods.
The paper proposes a uniformity regularization scheme to improve deep neural network transferability.
problem Improving deep neural network transferability and adaptation to new tasks.
method Introduces a uniformity regularization scheme to encourage high uniformity in embedding space.
result Uniformity regularization consistently offers benefits over baseline methods and achieves state-of-the-art performance in Deep Metric Learning and Meta-Learning.
MuLan links music audio to natural language tags.
problem Traditional music tagging systems use rigid attributes; MuLan aims to link audio directly to natural language.
method Joint audio-text embedding model trained on 44 million music recordings and text annotations.
result MuLan's embeddings enable zero-shot functionalities and transfer learning.
Using Task Descriptions in Lifelong Machine Learning for Improved Performance and Zero-Shot Transfercs.LG
Knowledge transfer between tasks can improve the performance of learned models, but requires an accurate estimate of the inter-task relationships to identify the relevant knowledge to transfer. These inter-task relationships are typically estimated based on training data for each task, which is inefficient in lifelong …
ZegOT uses optimal transport to zero-shot segment images with text prompts.
problem Zero-shot semantic segmentation with limited image-text alignment knowledge.
method ZegOT uses optimal transport to match multiple text prompts with frozen image embeddings.
result ZegOT achieves state-of-the-art performance in zero-shot semantic segmentation.
Improved zero-shot learning with graph-based regularization.
problem Transfer knowledge to unknown classes in zero-shot learning.
method Isoperimetric loss for learning map between visual and semantic embeddings, exploiting graph structure.
result Regularization alone outperforms state-of-the-art methods in zero-shot learning benchmarks.
Zero-shot KD for object detection without training data.
problem Challenges in using training data for knowledge distillation.
method Synthesizes pseudo-targets and samples using pretrained network.
result Achieves respectable mAP on object detection benchmarks.
MuJAM learns traffic signal control policies that generalize to unseen intersections and traffic conditions.
problem Lack of transferability in reinforcement learning methods for traffic signal control.
method Model-based graph reinforcement learning with explicit coordination and generalization to both cyclic and acyclic constraints.
result MuJAM outperforms existing methods in zero-shot and larger transfer settings.
Proposes AMS-SFE to improve zero-shot learning by aligning semantic feature spaces.
problem Domain shift problem in zero-shot learning due to disjoint seen and unseen data.
method Expands semantic features using an autoencoder and aligns them with visual feature manifold.
result Remarkable performance improvement over existing methods.
Zero-Shot Heterogeneous Transfer Learning from Recommender Systems to Cold-Start Search Retrievalcs.LG
Improves search performance by transferring knowledge from recommender system.
problem Cold start and feedback loop problems in search retrieval.
method Zero-Shot Heterogeneous Transfer Learning framework.
result Significant improvements in relevance and user interactions over production system.
Hierarchical decoupling improves sample efficiency for complex robots.
problem Learning long-range behaviors on complex robots.
method Two-part policy: low-level imitation and high-level transfer, with KL regularization.
result Hierarchical transfer significantly improves zero-shot high-level transfer and stabilizes learning.
Novel approach for sim-to-real transfer using MPC and task representations.
problem Difficulty of sim-to-real transfer systems producing generalizable policies.
method Model-predictive control (MPC) and task representation learning.
result Direct transfer of multi-skill policy to real robot for unseen tasks.
URL benchmark evaluates uncertainty quantification in pretrained models.
problem Need for reliable uncertainty estimates in transferable pretrained models.
method Proposes URL benchmark to measure transferability of representations and uncertainty estimates.
result Transferable uncertainty quantification remains challenging but not contradictory to traditional goals.
Agents learn to cooperate by exchanging messages in a shared graph model.
problem Creating effective multi-agent cooperation in unknown environments.
method Shared agent-entity graph, multi-agent reinforcement learning, invariant to team size and permutation.
result Decentralized multi-agent systems can quickly transfer learned policies to different team sizes.
Domain adaptation is an important open problem in deep reinforcement learning (RL). In many scenarios of interest data is hard to obtain, so agents may learn a source policy in a setting where data is readily available, with the hope that it generalises well to the target domain. We propose a new multi-stage RL agent, …
OTSeg uses multi-prompt Sinkhorn attention to improve zero-shot semantic segmentation.
problem Leveraging pre-trained CLIP knowledge to align text embeddings with pixel embeddings.
method OTSeg employs Multi-Prompts Sinkhorn (MPS) and Multi-Prompts Sinkhorn Attention (MPSA) to enhance semantic feature matching.
result OTSeg achieves state-of-the-art performance in zero-shot semantic segmentation tasks.
Transferable Boltzmann Generators learn to sample unseen molecules efficiently.
problem Generating equilibrium samples of molecular systems.
method Boltzmann Generators using normalizing flows to learn transformations.
result Transferable Boltzmann Generators can predict zero-shot Boltzmann distributions for unseen molecules.
Improved autoencoders guide latent sentence representations for better text generation and manipulation.
problem Current autoencoders struggle to maintain coherent latent spaces for meaningful text manipulations.
method Adversarial autoencoders with a denoising objective (DAAE) to guide latent space geometry.
result DAAE provides the best trade-off between generation quality and reconstruction capacity.
New landmark states improve transfer learning in multi-task RL.
problem Improving sample complexity and regret in new RL tasks.
method Topological landmark covering, landmark value functions, action pruning.
result Theoretical bounds on Q values at state-action pairs.
CLAREL improves zero-shot learning by using per-image semantic supervision and metric rescaling.
problem Fine-grained cross-modal representation learning for zero-shot classification.
method Instance-based deep metric learning in joint visual and textual space, using per-image semantic supervision and metric rescaling.
result CLAREL consistently outperforms existing approaches on fine-grained zero-shot learning datasets.
Many problems in image processing and computer vision (e.g. colorization, style transfer) can be posed as 'manipulating' an input image into a corresponding output image given a user-specified guiding signal. A holy-grail solution towards generic image manipulation should be able to efficiently alter an input image wit…
What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?cs.CL
New study finds best language model architecture and pretraining objective for zero-shot tasks.
problem Evaluating which language model architectures and pretraining objectives best enable zero-shot generalization.
method Compared three model architectures and two pretraining objectives across 170 billion tokens, with and without finetuning.
result Causal decoder-only models trained on autoregressive language modeling exhibit strongest zero-shot generalization.
New research shows LLMs can't be explained by statistical generalization alone.
problem Understanding why large language models (LLMs) perform well despite statistical generalization limitations.
method Examined the non-identifiability of AR probabilistic models and their implications for LLMs.
result Non-identifiability of LLMs leads to different behaviors and requires a separate theoretical explanation.
GCRL learns causal factors for motion forecasting, improving out-of-distribution prediction.
problem Sensitivity to out-of-distribution data in conventional supervised learning methods.
method Generative Causal Representation Learning (GCRL) leveraging causality for knowledge transfer.
result Significantly outperforms prior models on out-of-distribution prediction.
Paper proposes a method to adapt domains without target data using attribute information.
problem Domain adaptation without target data when prior attribute changes exist.
method Reweight source data with estimated sample-wise weights based on attribute prior.
result Method provides more precise transferability estimation than attribute-based reweighting.
Ground-A-Video edits videos without training, preserving intended changes.
problem Complex multi-attribute video editing with omitted or wrong changes.
method Grounding-guided video-to-video translation with Cross-Frame Gated Attention.
result Zero-shot multi-attribute video editing with improved accuracy and frame consistency.
Towards a General Time Series Forecasting Model with Unified Representation and Adaptive Transfercs.LG
Paper proposes a unified time series forecasting model with adaptive transfer.
problem General forecasting models for diverse time series data.
method Unified representations through Decomposed Frequency Learning and adaptive domain-specific features via Time Series Register.
result State-of-the-art forecasting performance on seven real-world benchmarks.
Study shows zero-shot super-resolution in neural operators is impossible in many cases.
problem Understanding the theoretical limits of zero-shot super-resolution in neural operators.
method Systematic theoretical study including information-theoretic and generalization bounds analysis.
result Zero-shot super-resolution is information-theoretically impossible in many settings.
NeuralPrefix fills in missing sensor data without additional training.
problem Data intermittency in real-world sensing.
method NeuralPrefix is a task-agnostic, zero-shot imputation framework.
result NeuralPrefix accurately recovers missing samples and generalizes to unseen datasets.
This research improves neural synthesizers for music sounds from speech data.
problem Applying speech synthesis techniques to musical instrument sounds.
method Comparison of three neural synthesizers in three scenarios: training, zero-shot learning, and fine-tuning.
result Neural synthesizers trained on speech data and fine-tuned on music data perform better.
Deep learning has improved performance on many natural language processing (NLP) tasks individually. However, general NLP models cannot emerge within a paradigm that focuses on the particularities of a single metric, dataset, and task. We introduce the Natural Language Decathlon (decaNLP), a challenge that spans ten ta…