Paper improves zero-shot classification by mining hard negative pairs.
problem Zero-Shot Classification (ZSC) problems.
method Metric learning with controlled negative pairs.
result Significant improvement in performance on ZSC datasets.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,341 papers · 148 categories
Trend · papers per month
48 results for “Zero-Shot Classification”
CLAREL improves zero-shot learning by using per-image semantic supervision and metric rescaling.
problem Fine-grained cross-modal representation learning for zero-shot classification.
method Instance-based deep metric learning in joint visual and textual space, using per-image semantic supervision and metric rescaling.
result CLAREL consistently outperforms existing approaches on fine-grained zero-shot learning datasets.
Zero-shot audio classification using class label embeddings.
problem Classifying audio without labeled data.
method Bilinear model with audio feature embeddings and class label embeddings.
result Achieved accuracy up to 39.7% for natural audio categories.
Aggregates diverse zero-shot LLM outputs for better corporate disclosure classification.
problem Combining varied zero-shot LLM predictions for improved stock return prediction.
method Multi-prompt framework with three fixed zero-shot LLM classifiers, logistic meta-classifier aggregation.
result Aggregated model outperforms single classifiers and baseline models, increasing balanced accuracy from 0.566 to 0.606.
Paper tackles multi-label zero-shot learning, improving label embedding projection for unseen classes.
problem Challenges in transferring knowledge from seen to unseen classes in multi-label zero-shot learning.
method Proposes a transfer-aware embedding projection approach to project label embeddings into a low-dimensional space for better inter-label relationships and explicit information transfer.
result Demonstrates the efficacy of the proposed approach through experiments on zero-shot multi-label image classification.
Generative model creates unseen class examples for zero-shot learning.
problem Training and test classes overlap, leading to biased predictions.
method Variational autoencoder with feedback-driven generator and discriminator.
result Model generates and uses unseen class examples to improve classification.
A Simple Zero-shot Prompt Weighting Technique to Improve Prompt Ensembling in Text-Image Modelscs.LG
Automates zero-shot classification by scoring and weighting prompts.
problem Improving zero-shot accuracy through prompt ensembling.
method Automatic prompt scoring and weighting method.
result Method outperforms existing techniques on various benchmarks.
BTZSC benchmarks zero-shot text classification across diverse models.
problem Systematically comparing zero-shot text classification across various models.
method Comprehensive benchmark of 22 datasets, comparing NLI cross-encoders, embedding models, rerankers, and instruction-tuned LLMs.
result Rerankers and instruction-tuned LLMs outperform NLI cross-encoders, with rerankers setting a new state-of-the-art.
Object recognition systems usually require fully complete manually labeled training data to train the classifier. In this paper, we study the problem of object recognition where the training samples are missing during the classifier learning stage, a task also known as zero-shot learning. We propose a novel zero-shot l…
Detects out-of-domain cases with limited training data.
problem Detecting out-of-domain cases with insufficient in-domain training data.
method Proposes an OOD-resistant Prototypical Network.
result Outperforms state-of-the-art methods in zero-shot OOD detection.
ZegOT uses optimal transport to zero-shot segment images with text prompts.
problem Zero-shot semantic segmentation with limited image-text alignment knowledge.
method ZegOT uses optimal transport to match multiple text prompts with frozen image embeddings.
result ZegOT achieves state-of-the-art performance in zero-shot semantic segmentation.
Paper proposes a progressive ensemble network for zero-shot image recognition.
problem Challenges of zero-shot learning due to lack of labeled data and expanding categories.
method Proposes a progressive ensemble network with multiple projected label embeddings.
result Demonstrates improved zero-shot image recognition performance on multiple datasets.
Paper proposes CCVAE for generalized zero-shot domain adaptation.
problem Adapting to unseen classes in target domain with limited labeled data.
method Coupled Conditional Variational Autoencoder (CCVAE).
result CCVAE generates synthetic target domain features for unseen classes.
Zero-shot understanding of accidents from surveillance videos using vision-language models
problem Accident understanding from surveillance videos
method Three-stage pipeline with vision-language similarity, metadata-driven multi-prompt reasoning, and entropy-gated pairwise adjudicator
result Substantial improvement in harmonic-mean score over baseline
Paper classifies multiple video sources in encrypted tunnels using NLP-inspired features.
problem Traffic classification in encrypted video streams.
method Deep learning with a novel NLP-inspired feature for multi-label classification.
result The method achieves high performance on binary and multilabel classification tasks.
OTSeg uses multi-prompt Sinkhorn attention to improve zero-shot semantic segmentation.
problem Leveraging pre-trained CLIP knowledge to align text embeddings with pixel embeddings.
method OTSeg employs Multi-Prompts Sinkhorn (MPS) and Multi-Prompts Sinkhorn Attention (MPSA) to enhance semantic feature matching.
result OTSeg achieves state-of-the-art performance in zero-shot semantic segmentation tasks.
Expands weak supervision by allowing partial labels from multiple noisy sources.
problem Creating models without labeled data using heuristic labelers.
method Probabilistic generative model estimating partial label accuracies.
result Improved model accuracy on various tasks (8.6% on text, comparable to zero-shot methods on images).
Dissertation tackles zero-shot anomaly detection, focusing on consistent anomalies and proposing CoDeGraph framework.
problem Consistent anomalies bias distance-based zero-shot anomaly detection methods.
method Formalized consistent anomalies, identified similarity scaling and neighbor-burnout phenomena, introduced CoDeGraph framework.
result CoDeGraph effectively suppresses consistent anomalies in zero-shot anomaly detection.
Cluster-based ZSL for multivariate data predicts unseen classes.
problem Predicting unseen classes in multivariate data without labeled training data.
method Cluster-based approach: classify data based on its distance from training clusters.
result The method outperforms existing ZSL methods for multivariate binary classification.
A new topology design improves zero-shot classification performance in contrastive learning.
problem Improving zero-shot classification performance in contrastive visual-textual alignment.
method Proposed an alternative topology design using multiple class tokens and an oblique manifold with negative inner product.
result Improves zero-shot classification performance by an average of 6.1%.
Paper proposes zero-shot transfer learning for semantic parsing.
problem Applying neural networks to tasks with little data remains challenging.
method Introduces a new method for learning shared space between domains based on domain label prediction.
result Method outperforms state-of-the-art techniques in zero-shot experimental setting.
Few-shot NER classification with limited data.
problem Limited annotated data for Named Entity Recognition.
method Prototypical Network + Transfer Learning
result Well-performing classifiers trained on only 20 instances.
pRSL combines probabilistic rules to improve multi-label classification.
problem Modeling the structure between multi-label classes for better performance.
method Uses probabilistic propositional logic rules and belief propagation to combine predictions from multiple classifiers.
result pRSL achieves state-of-the-art performance on various benchmark datasets.
Zero-shot KD for object detection without training data.
problem Challenges in using training data for knowledge distillation.
method Synthesizes pseudo-targets and samples using pretrained network.
result Achieves respectable mAP on object detection benchmarks.
Agents solving multi-task classification learn disentangled representations.
problem Creating interpretable world models from multi-task data.
method Optimal multi-task classification tasks, noise, evidence accumulation.
result Disentangled representations emerge in multi-task learning.
LETS-GZSL tackles GZSL for time series classification, achieving high accuracy.
problem Recognizing unseen classes from time series data when only seen examples are labeled.
method Embedding-based approach combined with attribute vectors.
result Achieves a harmonic mean of at least 55% on most UCR datasets.
GANs improve VSR accuracy by generating unseen classes.
problem Scarcity of training data for unseen classes in VSR.
method Generative Adversarial Networks (GANs) to generate new class samples.
result Accuracy increased by 27% for unseen classes.
Zero-shot anomaly detection method using batch normalization.
problem Adapting anomaly detectors to new normal data distributions without training data.
method Adaptive Centered Representations (ACR) with batch normalization.
result First zero-shot AD results for tabular data and image data.
POUF fine-tunes large models without labeled data.
problem Lack of labeled data for fine-tuning large pre-trained models.
method Prompt-oriented unsupervised fine-tuning.
result Consistent improvements across various tasks.
Develops a cross-lingual hate speech detection model using pre-trained Transformers.
problem Detecting hate speech in low-resource languages.
method Utilizes frozen Transformer language models and AXEL attention-based classification block for zero-shot and few-shot learning.
result Demonstrates highly competitive results on English and Spanish subsets of the HatEval challenge.
Paper tackles zero-shot translation by encouraging consistent agreement in models.
problem Challenges of generalizing multilingual translation without parallel data.
method Reformulated as probabilistic inference, introduced consistent agreement-based training.
result Agreement-based learning improves zero-shot translation by 2-3 BLEU points.
Hyper-Process Model: A Zero-Shot Learning algorithm for Regression Problems based on Shape Analysiscs.CV
A novel regression algorithm uses shape analysis to predict curves without training data.
problem Predicting curves without training data for regression problems.
method Shape analysis of trained models to generate new shapes for prediction.
result Successfully predicts curves based on shape analysis of existing models.
Paper proposes redundancy-free features for zero-shot object recognition.
problem Redundant visual features degrade zero-shot object recognition.
method Project original features into a new, statistically independent space.
result RFF-GZSL achieves competitive results on benchmark datasets.
Transformers fine-tuned on synthetic data boost tabular data classification performance.
problem Improving tabular data classification accuracy.
method Fine-tuning ICL-transformers on synthetic datasets with complex decision boundaries.
result Fine-tuned ICL-transformers outperform regular neural networks on real-world datasets.
Paper explores zero-shot cross-lingual reading comprehension using pre-trained multi-lingual model.
problem Lack of training data for every language in reading comprehension tasks.
method Systematic exploration of zero-shot cross-lingual transfer learning with a multi-lingual language representation model.
result Zero-shot cross-lingual transfer learning is feasible and translating source data into target language is not necessary.
Study shows zero-shot super-resolution in neural operators is impossible in many cases.
problem Understanding the theoretical limits of zero-shot super-resolution in neural operators.
method Systematic theoretical study including information-theoretic and generalization bounds analysis.
result Zero-shot super-resolution is information-theoretically impossible in many settings.
Adapts pretrained models to new classes without additional training.
problem Training models on limited labels and predicting new, unseen classes.
method Uses Fréchet mean instead of argmax for prediction, leveraging metric space distances.
result Improves model performance on unseen classes by up to 29.7% on ImageNet.
Paper tackles novel object recognition by improving hierarchical classification.
problem Challenges in recognizing novel object classes unseen during training.
method Proposes top-down and flatten methods for hierarchical novelty detection.
result Generates a hierarchical embedding leading to improved zero-shot learning performance.
This article reviews zero-shot recognition techniques for unseen categories.
problem Scaling recognition to many classes with few training samples.
method Comprehensive review of existing zero-shot recognition techniques.
result Highlighting limitations and future directions in zero-shot recognition.
Bayesian model adapts to changing classes in machine learning.
problem Non-stationary environments with incomplete class information.
method Doubly non-parametric Bayesian Gaussian mixture model.
result Model can grow to accommodate any number of classes.
Paper improves zero-shot protein stability prediction by clarifying free-energy foundations.
problem Improving zero-shot protein stability prediction using inverse folding models.
method Clarifying the free-energy foundations of inverse folding models and proposing better estimates of relative stability.
result Significant gains in zero-shot performance can be achieved with simple methods.
This study evaluates zero-shot LLMs in finance, finding ChatGPT performs well but fine-tuned models are better.
problem Evaluating zero-shot LLMs in financial tasks.
method Comparison of ChatGPT and fine-tuned models on annotated data.
result Fine-tuned models generally outperform zero-shot LLMs.
Study uses zero-shot models to forecast mortality rates globally.
problem Forecasting mortality rates without task-specific fine-tuning.
method Two state-of-the-art foundation models (TimesFM and CHRONOS) and traditional/machine learning methods were evaluated.
result CHRONOS outperformed traditional methods for shorter-term forecasts, but TimesFM consistently underperformed.
Paper tackles zero-shot activity recognition using video features and text embeddings.
problem Zero-shot activity recognition with videos.
method Auto-encoder model for multimodal joint embedding, 3D convolutional action recognition for visual features, GloVe word embeddings for textual features.
result Improved zero-shot recognition results with top-n accuracy and mean Nearest Neighbor Overlap.
Framework adapts to new tasks based on prior knowledge.
problem Models struggle to adapt to novel tasks without direct experience.
method Learned task representations and meta-mappings to transform them.
result Meta-mapping achieves 80-90% performance on novel tasks.
A new ZSL algorithm uses shared sparse representations for unseen classes.
problem Classifying images from unseen classes using only semantic information.
method Coupled dictionary learning to represent visual and semantic features in an intermediate space.
result The proposed method outperforms state-of-the-art ZSL algorithms on benchmark datasets.
NeuralPrefix fills in missing sensor data without additional training.
problem Data intermittency in real-world sensing.
method NeuralPrefix is a task-agnostic, zero-shot imputation framework.
result NeuralPrefix accurately recovers missing samples and generalizes to unseen datasets.
Generative framework tackles zero-shot learning with adversarial domain adaptation.
problem Domain shift between seen and unseen class distributions in zero-shot learning.
method End-to-end learning of seen and unseen class distributions, adversarial domain adaptation.
result Superior accuracies compared to state-of-the-art models on various benchmark datasets.