FAIR method uses adversarial training to learn fair instance weights.
problem Reduces bias in machine learning predictions through fair instance weighting.
method Adversarial training to learn instance weighting function ensuring fair predictions.
result Demonstrates better trade-off between accuracy and fairness compared to other models.
Adaptive weighting improves Deep Forest classifier's performance.
problem Improving Deep Forest classifier's efficiency and accuracy.
method Adaptive weighing of training instances at each cascade level, inspired by AdaBoost.
result The modified Deep Forest classifier performs better than the original.
Not all instances in a data set are equally beneficial for inducing a model of the data. Some instances (such as outliers or noise) can be detrimental. However, at least initially, the instances in a data set are generally considered equally in machine learning algorithms. Many current approaches for handling noisy and…
BetaDataWeighter learns weights for unlabelled data to improve self-supervised learning accuracy.
problem Improving unsupervised representations with domain shift between unlabelled and target data.
method Learning Bayesian instance weights for unlabelled data to prioritize useful instances.
result BetaDataWeighter achieves highest average accuracy and prunes up to 78% of images without significant loss in accuracy.
A new method improves adversarial robustness by optimizing importance weights.
problem Adversarial training's non-uniform robustness across different data points.
method Doubly-robust instance reweighted adversarial training using distributionally robust optimization.
result Improves robustness against attacks on the weakest data points.
Mitigates bias in text classification by weighting instances.
problem Unintended biases in text classification datasets based on demographic terms.
method Instance weighting to recover non-discrimination distribution.
result Effective mitigation of unintended biases without sacrificing generalization.
Vote-boosting is a sequential ensemble learning method in which the individual classifiers are built on different weighted versions of the training data. To build a new classifier, the weight of each training instance is determined in terms of the degree of disagreement among the current ensemble predictions for that i…
Method reweights instances and classes to improve robustness in noisy data.
problem Improving deep learning performance in the presence of label noise.
method Formulates constrained optimization problems to assign importance weights to instances and class labels.
result Significant performance gains observed in benchmark datasets with label noise.
A new hybrid method improves transfer learning performance.
problem Data scarcity in healthcare applications.
method Probabilistic weighting strategy to fuse source and target domain information.
result Our method outperforms existing instance-based transfer learning approaches.
G-FIGS uses instance weights to create interpretable models from diverse data.
problem Generalizing to diverse data distributions while maintaining interpretability.
method Estimates group membership probabilities, uses as instance weights in FIGS to grow decision trees.
result Achieves state-of-the-art prediction performance and maintains interpretability.
An intrinsic problem of classifiers based on machine learning (ML) methods is that their learning time grows as the size and complexity of the training dataset increases. For this reason, it is important to have efficient computational methods and algorithms that can be applied on large datasets, such that it is still …
Trained MLPs' weights are exchangeable, leading to stable kernel behavior.
problem Assumptions of IID parameters in trained models are violated.
method Showed weights in MLPs are exchangeable and identified kernel stability.
result Layer-wise kernel of fully-connected layers remains approximately constant during training.
Weighted SVM (or fuzzy SVM) is the most widely used SVM variant owning its effectiveness to the use of instance weights. Proper selection of the instance weights can lead to increased generalization performance. In this work, we extend the span error bound theory to weighted SVM and we introduce effective hyperparamete…
Paper tackles distribution changes in MIL without test data.
problem Real-world MIL data violates i.i.d. assumption.
method Proposes a framework connecting MIL to causal effect estimation.
result Validated approach on various datasets.
A new method generates MAX-2-SAT instances with adjustable hardness.
problem Creating hard MAX-SAT instances for evaluating MAX-SAT solvers.
method Inspired by frustrated-loop algorithm, extends to bipartite couplings, tuning hardness through frustration index.
result Generated instances can be tuned through a central parameter (frustration index), showing double phase transition behavior.
Adversarial weighting improves regression task adaptation.
problem Improving regression performance across domains with covariate shift.
method Adversarial network algorithm for instance weighting and task learning.
result The method enhances regression accuracy on target domains.
Survey on importance weighting in machine learning applications.
problem Distribution shift in supervised learning.
method Weighting objective function or probability distribution based on instance importance.
result Importance weighting can guarantee desirable statistical properties in distribution shift scenarios.
Multi-label classification is a type of supervised learning where an instance may belong to multiple labels simultaneously. Predicting each label independently has been criticized for not exploiting any correlation between labels. In this paper we propose a novel approach, Nearest Labelset using Double Distances (NLDD)…
New method learns various data manipulation schemes for model training.
problem Improving model training with data manipulation.
method Adapts RL reward learning algorithm for data manipulation learning.
result Significant improvement in classification performance.
Paper proposes a new meta-learning approach for correcting noisy labels.
problem Learning with noisy labels in machine learning models.
method Meta-learned instance re-weighting approach extended to label correction problem.
result Proposed MLC (Meta Label Correction) framework achieves large improvements over previous methods.
Imbalanced data sets containing much more background than signal instances are very common in particle physics, and will also be characteristic for the upcoming analyses of LHC data. Following up the work presented at ACAT 2008, we use the multivariate technique presented there (a rule growing algorithm with the meta-m…
ICE proposes a new loss function for deep metric learning.
problem Deep metric learning from instance-level matching distribution.
method Instance Cross Entropy (ICE) loss function.
result ICE outperforms existing methods on real-world benchmarks.
Study shows pre-trained models can handle long-tailed relations well, improving classifier performance.
problem Challenges in long-tailed relation classification due to class imbalance.
method Used instance-balanced sampling to pre-train models and then improved classifier performance through attentive relation routing.
result Robust classifier with attentive relation routing achieves better long-tailed classification ability.
Self-paced learning (SPL) mimics the cognitive process of humans, who generally learn from easy samples to hard ones. One key issue in SPL is the training process required for each instance weight depends on the other samples and thus cannot easily be run in a distributed manner in a large-scale dataset. In this paper,…
The lottery ticket hypothesis finds multiple winning sub-networks in neural networks.
problem Finding a single winning sub-network in neural networks.
method Analyzing neural networks trained in isolation and on different tasks.
result Neural networks contain multiple sub-networks that match the accuracy of the original network, not just one.
Paper develops a framework to optimize neural networks using weighted metrics.
problem Discrepancy between maximizing weighted classification scores and minimizing loss function.
method Formalizes weighted classification metrics and constructs corresponding losses.
result Framework includes well-established approaches like cost-sensitive learning and weighted cross entropy.
A new PLL method uses class activation values to improve robustness.
problem Weakly supervised learning with noisy data and adversarial perturbations.
method Subjective logic with class activation values for uncertainty representation and label weight re-distribution.
result More robust predictions under high noise levels, out-of-distribution examples, and adversarial perturbations.
Large-scale Hierarchical Classification (HC) involves datasets consisting of thousands of classes and millions of training instances with high-dimensional features posing several big data challenges. Feature selection that aims to select the subset of discriminant features is an effective strategy to deal with large-sc…
Proposes a method to improve transparency and robustness of deep learning models.
problem Lack of interpretability and robustness in deep learning models.
method A weighted sum of training instances with learned instance-embedding space weights.
result Improved transparency, controlled error rates, and robustness to out-of-domain data.
Differentiable model compression adds noise to parameters during training.
problem Model compression for efficient deployment.
method Adding pseudo quantization noise to model parameters during training.
result Compresses model by more than 8x on ImageNet with 0.3% accuracy loss.
DiwE uses regional distribution changes to create diverse ensemble classifiers for concept drift.
problem Handling concept drift in evolving data streams.
method DiwE measures diversity based on regional distribution disagreement and uses it to weight instances and select classifiers.
result DiwE outperforms other algorithms on various synthetic and real-world data stream benchmarks.
TREX explains tree ensembles by identifying key training examples.
problem Identifying which training examples most influence tree ensemble predictions.
method TREX builds a surrogate model using a kernel that captures tree ensemble structure, approximating the original model.
result TREX provides accurate and effective explanations for tree ensembles.
A study on optimizing data augmentation weights for improved test-time predictions.
problem Improving robustness of predictions during testing with data augmentation methods.
method A weighted Test-Time Augmentation (TTA) approach based on variational Bayesian framework to optimize weights.
result Optimizing weights suppresses unwanted data augmentations and improves prediction performance.
A new algorithm enhances minority class representation in imbalanced datasets.
problem Improving classification performance on imbalanced datasets.
method PO-QG algorithm using Proxima-Orion neighbors and q-Gaussian weighting.
result The PO-QG algorithm improves overall classification performance.
AVA combines feature attribution methods for better model explanations.
problem Improving feature attribution methods for machine learning models.
method AVA: Aggregate Valuation of Antecedents, fusing antecedent event influence and value attribution.
result AVA provides better local and global model explanations.
Deep learning relies on good initialization schemes and hyperparameter choices prior to training a neural network. Random weight initializations induce random network ensembles, which give rise to the trainability, training speed, and sometimes also generalization ability of an instance. In addition, such ensembles pro…
Proposes a new method to adapt to covariate shifts in supervised learning.
problem Covariate shift in training and testing samples with different marginal distributions.
method Minimax risk classification (MRC) approach that weights both training and testing samples.
result Significantly enhanced classification performance in synthetic and empirical experiments.
Self-paced learning and hard example mining re-weight training instances to improve learning accuracy. This paper presents two improved alternatives based on lightweight estimates of sample uncertainty in stochastic gradient descent (SGD): the variance in predicted probability of the correct class across iterations of …
Recent years have witnessed amazing outcomes from "Big Models" trained by "Big Data". Most popular algorithms for model training are iterative. Due to the surging volumes of data, we can usually afford to process only a fraction of the training data in each iteration. Typically, the data are either uniformly sampled or…
META-DES.H selects competent classifiers using meta-learning and dynamic weighting.
problem Selecting competent classifiers in dynamic ensemble selection.
method META-DES framework using meta-learning and dynamic weighting.
result Improvements in recognition accuracy on 30 datasets.
Human analysts that use anomaly detection systems in practice want to retain the use of simple and explainable global anomaly detectors. In this paper, we propose a novel human-in-the-loop learning algorithm called GLAD (GLocalized Anomaly Detection) that supports global anomaly detectors. GLAD automatically learns the…
Mitigates anomaly score imbalance in long-tailed distributions.
problem Class imbalance in normal data leads to skewed anomaly detection performance.
method Proposes an importance-weighted loss function to balance anomaly scores.
result Improves anomaly detection performance by 0.043 on real-world datasets.
The objective function of a matrix factorization model usually aims to minimize the average of a regression error contributed by each element. However, given the existence of stochastic noises, the implicit deviations of sample data from their true values are almost surely diverse, which makes each data point not equal…
A new technique updates weights multiple times for online learning, reducing mistakes to near zero.
problem Online learning with partial data and unknown future data points.
method Iterative weight updating for the same instance.
result Reduced mistake rate to near zero for various datasets and algorithms.
Cost-effective strategies for training machine learning models on volatile cloud instances.
problem Expensive distributed SGD training due to resource interruptions.
method Cost-effective strategies for exploiting volatile cloud instances (spot instances) in distributed SGD.
result Quantified the impact of instance preemption on SGD convergence and training time.
UCRL-WVTR tackles long-term reinforcement learning with general approximations, achieving horizon-free and instance-dependent regret bounds.
problem Long-term reinforcement learning with general function approximations.
method UCRL-WVTR proposes a novel algorithm, UCRL-WVTR, with weighted value-targeted regression and a high-order moment estimator.
result Achieves horizon-free and instance-dependent regret bounds matching minimax lower bounds up to logarithmic factors.
Boosting weak learners to strong ones from aggregate labels is possible for LLP but not for MIL.
problem Boosting weak learners to strong ones from aggregate labels in learning from label proportions (LLP).
method Using a weak learner on large enough bags to obtain a strong learner for small bags in polynomial time.
result Boosting is possible for LLP but not for MIL.
ICE improves classification performance by leveraging internal patterns among instances.
problem Inconsistent results for different MCS algorithms on specific problems.
method ICE groups training data into overlapping clusters, builds classifiers for each cluster, and predicts class labels by averaging predictions from top-performing models.
result ICE provides a stable improvement on a significant proportion of datasets over existing MCS methods.