New method tackles semi-unsupervised learning with ultra-sparse labels.
problem Learning from datasets where some classes have no labelled examples.
method Combining clustering and semi-supervised learning with deep generative models.
result Effective learning possible even when half of ground truth classes are unlabelled.
The Lasso performs well in ultra-sparse linear models with finite support size.
problem Performance analysis of Lasso in ultra-sparse linear models.
method Novel application of replica method from statistical physics, rigorous analysis of average case performance.
result Average performance of Lasso assessed without scaling assumptions, offering sample complexity bounds.
This paper studies CSDL's reconstruction risk and finds it consistent in the ultra-sparse setting.
problem The statistical properties of convolutional sparse dictionary learning (CSDL).
method Identifies the minimax convergence rate of CSDL in terms of reconstruction risk, upper bounds the risk of an established CSDL estimator, and proves a matching lower bound.
result Consistency in reconstruction risk is possible precisely in the ultra-sparse setting.
The paper tackles matrix completion in ultra-sparse sampling, improving imputation accuracy.
problem Matrix completion in ultra-sparse sampling, where each row has only a few entries.
method Estimate row span of matrix or averaged second-moment matrix, normalize and impute missing entries.
result Gradient descent method normalizes and imputes missing entries, achieving low variance and unbiased estimation.
TRUST improves tree models' accuracy while maintaining interpretability.
problem Piecewise-constant regression trees lack in predictive accuracy compared to black-box models.
method Combines Random Forest accuracy with interpretability of shallow trees and sparsity of linear models, using LLMs for explanations.
result TRUST outperforms other interpretable models in predictive accuracy and matches Random Forest's accuracy.
GRASPEL learns large graphs from data efficiently.
problem Learning meaningful graphs from data for various applications.
method Highly scalable spectral approach using graph Laplacians and coarsening techniques.
result Ultra-sparse graphs with improved efficiency and accuracy in spectral clustering and t-SNE.
SOLAR improves search efficiency and accuracy with sparse, orthogonal embeddings.
problem Bottleneck of indexing large dense vectors and NNS for query efficiency and accuracy.
method Proposes SOLAR embeddings: sparse, orthogonal, learned, and random vectors across multiple GPUs.
result Successfully trains 500K dimensional SOLAR embeddings for 1.6M books and multi-label classification.
Develops a new point process model for detecting neural spike sequences.
problem Detecting sparse sequences of neural spikes in high-dimensional spike trains.
method A point process model that represents sequence occurrences as marked events in continuous time, with learnable time warping parameters.
result Demonstrates improved detection and modeling of neural spike sequences.
STR reparameterizes DNN weights with soft thresholds for better sparsity and accuracy.
problem Improving sparsity in DNNs for better accuracy and lower inference cost.
method Soft Threshold Reparameterization (STR) using the soft-threshold operator on DNN weights.
result STR achieves state-of-the-art accuracy and reduces FLOPs by up to 50%.
New method reduces spectral clustering complexity by sparsifying graphs.
problem Computational bottleneck in spectral clustering due to eigendeomposition of NN graph Laplacian matrices.
method Spectrum-preserving graph sparsification via low-stretch spanning trees and spectral off-tree embedding.
result Ultra-sparse NN graphs with preserved first few eigenvectors for scalable spectral clustering.
Proposes a new model for noisy labels considering multiple labelers and adversarial attacks.
problem Real-world noisy label models with multiple labelers and adversarial attacks.
method Labeler-dependent noise model with adversarial attack vectors.
result State-of-the-art approaches for learning from noisy labels are defeated by adversarial label attacks.
Label smoothing improves model performance even with noisy labels.
problem Mitigating label noise in deep learning models.
method Examined label smoothing as a technique to cope with label noise and compared it to loss-correction methods.
result Label smoothing is competitive with loss-correction techniques under label noise and beneficial for distillation from noisy data.
Paper proposes a method to recover accurate labels from partially valid data in multi-label learning.
problem Tackles noisy supervision in multi-label learning with partially valid labels.
method Develops a two-stage method that estimates label enrichment and ground-truth confidences.
result Demonstrates improved performance over state-of-the-art PML methods.
CbMLC improves multi-label classification with noisy labels.
problem Evaluating multi-label classifiers with noisy labels.
method Context-Based Multi-Label Classifier (CbMLC) that handles noisy labels without additional supervision.
result CbMLC yields substantial improvements over previous methods in noisy label settings.
LNEMLC embeds label network for multi-label classification.
problem Lack of effective adaptation and preservation of generalization abilities for unseen label combinations.
method LNEMLC embeds label network to extend input space for any base multi-label classifier.
result Statistically significant improvements over simple kNN baseline classifier.
Proposes ML-GCN for multi-label network node representation learning.
problem Complex multi-label networks with correlated labels.
method Two Siamese GCNs model node-label and label-label interactions, integrated under a unified objective function.
result Effective node representation learning with preserved label interactions.
Proposes MGPLL for PL learning with non-random noise.
problem Partial label learning with non-random label noise.
method Bi-directional mapping framework, conditional noise label generation, multi-class predictor, adversarial learning.
result Demonstrates state-of-the-art performance in partial label learning.
Logistic regression can handle noisy labels effectively when labels are imperfectly assigned by multiple experts.
problem Label noise in supervised classification due to manual labelling by multiple experts.
method Using approximate posterior probabilities of class membership from multiple experts to train logistic regression models.
result Logistic regression can be robust to label noise when classification difficulty is the only source of errors.
A new method learns label correlations for better multi-label predictions.
problem Label correlations not accurately characterized by existing approaches.
method Sparse reconstruction in the label space to learn correlations, then integrate into model training.
result Our approach outperforms state-of-the-art multi-label learning methods.
Paper tackles multi-label zero-shot learning, improving label embedding projection for unseen classes.
problem Challenges in transferring knowledge from seen to unseen classes in multi-label zero-shot learning.
method Proposes a transfer-aware embedding projection approach to project label embeddings into a low-dimensional space for better inter-label relationships and explicit information transfer.
result Demonstrates the efficacy of the proposed approach through experiments on zero-shot multi-label image classification.
FLAME auto-labels mobile data efficiently on diverse processors.
problem Accurately and efficiently labeling mobile data with unknown labels on heterogeneous processors.
method Self-adaptive auto-labeling system Flame that schedules and executes workloads on mobile processors.
result Flame achieves high labeling accuracy and performance on heterogeneous mobile processors.
PML-LFC improves PML by estimating label confidence from both feature and label spaces.
problem PML challenges in real-world scenarios where only some labels are relevant.
method PML-LFC estimates label confidence using feature and label space similarities, training a predictor with these values.
result PML-LFC achieves superior performance on synthetic and real-world datasets.
Proposes methods to improve multi-label learning by addressing local label imbalance.
problem Local label imbalance within minority class examples degrades multi-label learning performance.
method Introduces a measure to assess local label imbalance and two sampling approaches (MLSOL, MLUL) to address it.
result Experimental results show MLSOL and MLUL improve performance on multi-label datasets.
An active learner is given a hypothesis class, a large set of unlabeled examples and the ability to interactively query labels to an oracle of a subset of these examples; the goal of the learner is to learn a hypothesis in the class that fits the data well by making as few label queries as possible. This work addresses…
LaMP neural networks model label interactions for multi-label classification.
problem Efficiently modeling label interactions in multi-label classification.
method Label Message Passing (LaMP) Neural Networks, treating labels as nodes on a graph, compute hidden representations conditioned on input using attention-based message passing.
result Significantly outperforms state-of-the-art multi-label classification models on seven real-world datasets.
Paper tackles label insufficiency and inaccuracy in semi-supervised learning.
problem Label insufficiency and inaccuracy in semi-supervised learning.
method Graph-based propagation for label insufficiency and label filtering for inaccuracy.
result SIIS improves performance in the presence of label noise and scarcity.
An important problem in multi-label classification is to capture label patterns or underlying structures that have an impact on such patterns. This paper addresses one such problem, namely how to exploit hierarchical structures over labels. We present a novel method to learn vector representations of a label space give…
New algorithm for XMC from aggregated labels.
problem Finding relevant labels for inputs from a large label universe.
method Developed a scalable algorithm to impute individual labels from group labels.
result Advantages over existing approaches in XMC and MIML tasks.
Enhances labels from unlabeled data using sample correlations.
problem Lack of label distributions in real-world applications.
method Proposes LESC and gLESC methods to enhance label distributions.
result Improves performance of label enhancement through sample correlations.
A fast method reduces label space for online multi-label classification.
problem Challenging multi-label classification with many labels and latent dependencies.
method Linear label space dimension reduction and pseudo-label training.
result Effective in terms of running times and prediction performance.
Retraining with predicted labels improves model accuracy in noisy settings.
problem Improving model accuracy with noisy or corrupted labels.
method Retraining with predicted hard labels in a linearly separable binary classification setting.
result Retraining with predicted labels can increase model accuracy, as proven theoretically.
This paper uses Bayesian networks to analyze label correlations for improving multi-label classifier chains.
problem Improving multi-label classifier chain performance by discovering label correlations and determining the label order.
method Bayesian network (BN) to model label correlations, scoring function to evaluate BN structure, heuristic algorithm to optimize BN, topological sorting to derive label order.
result The proposed BNCC method enhances multi-label classifier chain performance through optimized label order and correlation analysis.
A new method reduces noise in multi-label data and reduces dimensionality.
problem Handling noisy multi-label data in semi-supervised settings.
method Semi-supervised and multi-label dimensionality reduction method using label propagation.
result NMLSDR outperforms state-of-the-art algorithms in reducing noise and dimensionality.
Proposes candidate labeling for more efficient use of crowdsourced labels.
problem Inefficiency of standard crowd learning where annotators provide single labels.
method Allows annotators to provide multiple labels per instance.
result Candidate labeling extracts more knowledge from labelers than standard approach.
This work analyzes two methods for combining multiple binary labels in bipartite ranking.
problem Combining multiple binary labels for optimal bipartite ranking.
method Loss aggregation vs. label aggregation approaches.
result Label aggregation is preferable to loss aggregation due to label dictatorship issues.
DM2L tackles missing labels in multi-label learning by modeling local and global rank structures.
problem Missing labels in multi-label learning.
method DM2L imposes local low-rank structures and global high-rank structures on predictions of instances from the same and different labels, respectively.
result DM2L outperforms state-of-the-art methods in multi-label learning with missing labels.
Paper proposes LAHA to improve XMTC by integrating document content and label correlation.
problem Challenges in tagging documents with most relevant labels from a large label set.
method Hybrid attention deep neural network model (LAHA) that combines multi-label self-attention and adaptive fusion strategies.
result LAHA outperforms state-of-the-art methods, especially on tail labels.
Label noise in adversarial training leads to robust overfitting, explained and mitigated.
problem Label noise in adversarial training causes robust overfitting.
method Proposed a method to automatically calibrate labels.
result Consistent performance improvements across various models and datasets.
Self-paced learning improves PLL by prioritizing training examples.
problem Learning from partially labeled data where each instance has multiple candidate labels.
method Integrates self-paced learning into PLL, ranking training examples and labels.
result The proposed SP-PLL algorithm outperforms baseline methods in partial label learning.
Meta Pseudo Labels boosts image classification accuracy to 90.2%.
problem Improving semi-supervised learning for image classification.
method Adapts a teacher network to generate better pseudo labels through student feedback.
result Achieves a new state-of-the-art top-1 accuracy of 90.2% on ImageNet.
BP pretreatment reduces multi-label classification time.
problem Efficiently annotate large label sets for extreme multi-label classification.
method Divide instances into clusters, attach most relevant labels, train on pairs of clusters.
result BP reduces prediction time significantly without sacrificing accuracy.
It is challenging to handle a large volume of labels in multi-label learning. However, existing approaches explicitly or implicitly assume that all the labels in the learning process are given, which could be easily violated in changing environments. In this paper, we define and study streaming label learning (SLL), i.…
We describe a nonparametric topic model for labeled data. The model uses a mixture of random measures (MRM) as a base distribution of the Dirichlet process (DP) of the HDP framework, so we call it the DP-MRM. To model labeled data, we define a DP distributed random measure for each label, and the resulting model genera…
BELA infers labels for unlabeled data at lower cost.
problem Efficiently labeling large unlabeled datasets.
method Supervised splitting with bias-reduction techniques.
result BELA outperforms existing adaptive labeling strategies.
This paper presents privileged multi-label learning (PrML) to explore and exploit the relationship between labels in multi-label learning problems. We suggest that for each individual label, it cannot only be implicitly connected with other labels via the low-rank constraint over label predictors, but also its performa…
Machine learning approaches to multi-label document classification have to date largely relied on discriminative modeling techniques such as support vector machines. A drawback of these approaches is that performance rapidly drops off as the total number of labels and the number of labels per document increase. This pr…
Multi-label classification has received considerable interest in recent years. Multi-label classifiers have to address many problems including: handling large-scale datasets with many instances and a large set of labels, compensating missing label assignments in the training set, considering correlations between labels…
Paper bridges ordinary-label and complementary-label learning frameworks.
problem Combining complementary-label learning with ordinary-label learning.
method Integrates loss functions for one-versus-all and pairwise classification.
result Derives classification risk and error bound for additivity and duality loss functions.