Proposes methods to improve multi-label learning by addressing local label imbalance.
problem Local label imbalance within minority class examples degrades multi-label learning performance.
method Introduces a measure to assess local label imbalance and two sampling approaches (MLSOL, MLUL) to address it.
result Experimental results show MLSOL and MLUL improve performance on multi-label datasets.
The study examines the generalization of Macro-AUC in multi-label learning, identifying label imbalance as a critical factor.
problem Theoretical understanding of Macro-AUC in multi-label learning is lacking.
method Characterization of generalization properties of learning algorithms based on surrogate losses w.r.t. Macro-AUC, identification of label imbalance as a critical factor.
result The widely-used univariate loss-based algorithm is more sensitive to label imbalance than pairwise and reweighted loss-based ones, implying worse performance.
Framework tackles class imbalance and noisy labels in active learning.
problem Class imbalance and noisy labels in real-world datasets.
method Uses foundation model priors to select informative samples for active learning.
result Substantial annotation savings (over 50%) with preserved performance and robustness.
Deep learning tackles label imbalance in high-frequency trading.
problem Label imbalance issue in high-frequency trading.
method Rigorous end-to-end deep learning framework with comprehensive label imbalance adjustment methods.
result Successfully predicted high-frequency returns in the Chinese future market.
Class imbalance is an intrinsic characteristic of multi-label data. Most of the labels in multi-label data sets are associated with a small number of training examples, much smaller compared to the size of the data set. Class imbalance poses a key challenge that plagues most multi-label learning methods. Ensemble of Cl…
Study characterizes and mitigates imbalances in neurosymbolic learning.
problem Characterizing and mitigating class-specific risks in neural classifiers.
method Theoretical analysis and practical techniques including estimating marginal gold labels and mitigating imbalances at training and testing time.
result Learning imbalances can be greatly impacted by the symbolic component σ, unlike in supervised and weakly supervised learning.
Paper connects sampling and labeling biases in large-output spaces.
problem Efficient training in large-output spaces with label imbalance.
method Unified approach to address sampling and labeling biases.
result Different negative sampling schemes trade-off performance on dominant and rare labels.
Class-imbalance is an inherent characteristic of multi-label data which affects the prediction accuracy of most multi-label learning methods. One efficient strategy to deal with this problem is to employ resampling techniques before training the classifier. Existing multilabel sampling methods alleviate the (global) im…
Study shows neural collapse is invariant to class imbalances under certain conditions.
problem Neural collapse properties are only valid for balanced data.
method Adopted UFM and introduced SELI for invariant characterization.
result Embeddings and classifiers always interpolate a simplex-encoded label matrix regardless of class imbalances.
Proposes a multimodal deep generative model for semi-supervised learning with class imbalance.
problem Class imbalance in semi-supervised learning with partial supervision.
method Separate encoders for each modality, sharing latent variables, and using Student's t-distributions for prior, encoder, and decoder.
result Outperforms baseline methods in generalization and classification performance for partially labeled multimodal data.
This paper tackles label-efficient evaluation in extreme class imbalance.
problem Challenges in obtaining a sufficient sample for accurate evaluation in tasks with extreme class imbalance.
method Develops a framework for online evaluation based on adaptive importance sampling.
result Establishes strong consistency and a central limit theorem for performance estimates.
Motivated by applications in protein function prediction, we consider a challenging supervised classification setting in which positive labels are scarce and there are no explicit negative labels. The learning algorithm must thus select which unlabeled examples to use as negative training points, possibly ending up wit…
Paper tackles class-imbalanced semi-supervised learning, improving performance.
problem Class imbalance in semi-supervised learning datasets.
method Proposes Suppressed Consistency Loss (SCL) to handle class imbalance.
result Method shows better performance in class-imbalanced semi-supervised learning environments.
Class imbalance is a pervasive issue among classification models including deep learning, whose capacity to extract task-specific features is affected in imbalanced settings. However, the challenges of handling imbalance among a large number of classes, commonly addressed by deep learning, have not received a significa…
This paper examines biases in foundation models under long-tailed data and proposes a method to mitigate parameter imbalance.
problem The bias introduced by imbalanced training data in foundation models affects long-tailed downstream tasks.
method The paper examines parameter imbalance and data imbalance, proposing a backdoor adjustment method to mitigate parameter imbalance.
result An average performance increase of about 1.67% on each dataset.
Paper introduces a new performance metric for class imbalance datasets.
problem Challenges in selecting and comparing models for imbalanced datasets.
method Proposes a new performance measure based on the harmonic mean of Recall and Selectivity normalized in class labels.
result The proposed measure is less sensitive to changes in the majority class and more sensitive to changes in the minority class.
New method removes pseudo-label bias for unsupervised domain adaptation.
problem Class imbalance and distribution shift between domains.
method Implicit class-conditioned domain alignment without explicit pseudo-label optimization.
result Effective in handling within-domain class imbalance and between-domain class distribution shift.
Self-supervised learning performs better than supervised learning on imbalanced datasets.
problem The performance gap between balanced and imbalanced pre-training with self-supervised learning is smaller than with supervised learning.
method Systematic investigation of self-supervised learning under dataset imbalance, including experiments and theoretical analyses.
result Self-supervised representations are more robust to class imbalance than supervised representations.
FedReLa: A novel data-level approach for imbalanced federated learning
problem Improving accuracy of federated learning models under class imbalance and data heterogeneity
method Re-labeling samples with a feature-dependent label re-allocator
result Significant improvements in accuracy for minority classes and overall accuracy on stepwise-imbalanced and long-tailed datasets
Study shows label noise impacts neural representations' information content, revealing double descent behavior.
problem Impact of label noise on neural network hidden representations.
method Information Imbalance proxy of conditional mutual information to compare hidden representations.
result Representations learned with noisy labels are more informative than those with clean labels in the underparameterized regime, and equally informative in the overparameterized regime.
Active learning method balances bias and variance under class imbalance.
problem Active learning under label shift when class proportions differ.
method Mediated Active Learning under Label Shift (MALLS) using a 'medial distribution'.
result MALLS reduces asymptotic sample complexity under arbitrary label shift.
Multi-label classification studies the task where each example belongs to multiple labels simultaneously. As a representative method, Ranking Support Vector Machine (Rank-SVM) aims to minimize the Ranking Loss and can also mitigate the negative influence of the class-imbalance issue. However, due to its stacking-style …
Discriminative neural networks address class imbalance in coronary heart disease risk analysis.
problem Class imbalance in medical test data, especially in binary classification problems.
method Use of discriminative neural networks and contrastive loss with a Siamese network structure.
result The method effectively handles class imbalance, improving predictive models for coronary heart disease risk.
Adaptive regularization tackles heteroskedastic and imbalanced datasets in deep learning.
problem Heteroskedastic and imbalanced datasets challenge deep learning due to varying label uncertainty and long-tailed label distributions.
method Data-dependent adaptive regularization that applies stronger regularization to higher-uncertainty, lower-density regions.
result Significant improvement in noise-robust deep learning over other methods on benchmark tasks.
DIGRAC clusters directed graphs using flow imbalance, outperforming existing methods.
problem Clustering directed networks without label supervision.
method DIGRAC uses a graph neural network with a novel imbalance loss for directed flow imbalance.
result DIGRAC outperforms 10 state-of-the-art methods on directed graph clustering.
Paper tackles gene mutation prediction for HCC using multi-instance multi-label learning.
problem Gene mutation prediction in hepatocellular carcinoma for personalized treatments.
method Multi-instance multi-label learning with oversampling for data imbalance.
result Proposed approach shows superiority in gene mutation prediction.
Unified framework suppresses model bias in semi-supervised learning with decoupled sampling control.
problem Class imbalance in semi-supervised learning, especially with distributional mismatches.
method Unified framework SC-SSL with decoupled sampling control, explicit expansion capability, and adaptive sampling probabilities.
result Consistent and state-of-the-art performance across various benchmark datasets and distribution settings.
Actively sampled data can have very different characteristics than passively sampled data. Therefore, it's promising to investigate using different inference procedures during AL than are used during passive learning (PL). This general idea is explored in detail for the focused case of AL with cost-weighted SVMs for im…
This paper tackles imbalanced classification with weakly supervised oversampling.
problem Imbalanced classification in high-dimensional datasets.
method Weakly supervised SMOTE, cost-sensitive NCA, bootstrap ensemble.
result Improved classification performance on synthetic and real-world datasets.
Study shows imbalanced labels can be beneficial but not always in class-imbalanced learning.
problem Challenges in class-imbalanced learning with heavy label bias.
method Systematic investigation of semi-supervised and self-supervised approaches to leverage imbalanced labels.
result Imbalanced labels are valuable in semi-supervised learning but not always in self-supervised learning.
Method detects anomalies on attributed graphs with few labeled instances.
problem Detecting anomalies on connected instances (attributed graphs) with limited labeled data.
method Embed nodes in latent space using GCNs, training to distinguish normal and anomalous nodes.
result Method outperforms existing methods on real-world attributed graph datasets.
Active learning tackles cold start and imbalanced data issues.
problem Cold start problem and imbalanced data in ML models.
method ODAL approach with 3-stage AL policies.
result ODAL can quickly reach high performance models with limited labels.
CBDA improves active learning for semantic segmentation, especially with imbalanced classes.
problem Class imbalance degrades performance in domain adaptive active learning.
method Class Balanced Dynamic Acquisition (CBDA) selects more balanced labels for active learning.
result CBDA increases minority class performance and outperforms baselines by 0.6-2.4 mIoU.
Self-training improves generalization by fitting to reliable pseudo-labels or gradually improving the classification plane.
problem Understanding how self-training improves generalization in high-dimensional Gaussian mixtures.
method Analyzing iterative self-training on binary Gaussian mixtures in the asymptotic limit.
result ST improves generalization by fitting to reliable pseudo-labels or gradually improving the classification plane.
The paper presents Imbalance-XGBoost, a Python package that combines the powerful XGBoost software with weighted and focal losses to tackle binary label-imbalanced classification tasks. Though a small-scale program in terms of size, the package is, to the best of the authors' knowledge, the first of its kind which prov…
Paper tackles noisy labels in deep learning networks.
problem Learning with noisy labels in deep neural networks.
method Sparse regularization strategy to approximate one-hot constraint.
result Improves performance of commonly-used loss functions in noisy labels and class imbalance.
We address the problem of severe class imbalance in unsupervised domain adaptation, when the class spaces in source and target domains diverge considerably. Till recently, domain adaptation methods assumed the aligned class spaces, such that reducing distribution divergence makes the transfer between domains easier. Su…
New approach predicts event probabilities for better event detection.
problem Class imbalance and inaccurate event detection in time series analysis.
method Regression-based approach to predict probability densities at event locations.
result Regression-based approaches outperform segmentation-based methods.
Deep learning algorithms can fare poorly when the training dataset suffers from heavy class-imbalance but the testing criterion requires good generalization on less frequent classes. We design two novel methods to improve performance in such scenarios. First, we propose a theoretically-principled label-distribution-awa…
The paper addresses classification imbalance by framing it as a transfer learning problem.
problem Classification imbalance where one class is much rarer than the other.
method The paper studies oversampling procedures to balance classes, focusing on SMOTE and bootstrapping.
result The excess risk decomposes into balanced training rate and transfer cost, with SMOTE having a higher transfer cost.
Paper tackles fault classification in time series data with deep neural networks.
problem Fault classification over a future horizon in multidimensional time series data with class imbalances.
method Proposes a multi-label recurrent neural network with a new cost function to address class imbalances.
result The proposed algorithm outperforms state-of-the-art techniques in F1-score, precision, and recall.
Machine learning models predict bluebottles' presence on beaches, addressing class imbalance and unreliable absence data.
problem Predicting bluebottles' presence on beaches with machine learning, tackling class imbalance and unreliable absence data.
method Used Multilayer Perceptron, Random Forest, and XGBoost models; employed data augmentation techniques like SMOTE, Random Undersampling, and Synthetic Negative Approach.
result Random Forests combined with Synthetic Negative Approach provided the best predictive model, identifying wind direction as a key factor.
A new method for deep learning imbalance or noise, ABSGD, improves efficiency and effectiveness.
problem Data imbalance or label noise in deep learning.
method A modification of momentum SGD with individual-level weights proportional to loss values.
result Guaranteed convergence to stationary points of DRO problems, capturing class diversity.
Transfer learning framework for fragility modeling under domain shift and class imbalance
problem Data gaps in structural fragility modeling
method Transfer learning
result Improves failure detection and predictive stability in low-data regimes
A new active learning method for skewed data sets.
problem Severe class imbalance and small initial training data in sequential active learning.
method HAL: a hybrid active learning algorithm balancing labeled and unlabeled data.
result HAL makes better choices for labeling points than strong baselines.
New metrics assess class overlap and imbalance in datasets.
problem Class overlap and imbalance make datasets hard to classify.
method Developed new metrics based on ball coverage by classes.
result Metrics correlate well with classifier performance.
Hierarchy Of Multi-label classifiers (HOMER) is a multi-label learning algorithm that breaks the initial learning task to several, easier sub-tasks by first constructing a hierarchy of labels from a given label set and secondly employing a given base multi-label classifier (MLC) to the resulting sub-problems. The prima…
Online Active Learning (OAL) aims to manage unlabeled datastream by selectively querying the label of data. OAL is applicable to many real-world problems, such as anomaly detection in health-care and finance. In these problems, there are two key challenges: the query budget is often limited; the ratio between classes i…