Paper proposes a neural network approach for MIL, achieving comparable and sometimes superior performance.
problem Learning bag labels from unlabeled bags of instances.
method Neural networks with attention mechanism for permutation-invariant aggregation.
result Attention-based aggregation improves performance on various MIL datasets.
Labeling data for classification requires significant human effort. To reduce labeling cost, instead of labeling every instance, a group of instances (bag) is labeled by a single bag label. Computer algorithms are then used to infer the label for each instance in a bag, a process referred to as instance annotation. Thi…
A new approach to MI learning using bag-to-class divergence.
problem Sparse MI training sets and difficulty in classifying bags.
method Introducing bag-to-class divergence to MI learning, emphasizing hierarchical random vectors.
result Bag-to-class divergence is a more effective classifier for MI learning.
This paper introduces a novel, well-founded, betweenness measure, called the Bag-of-Paths (BoP) betweenness, as well as its extension, the BoP group betweenness, to tackle semisupervised classification problems on weighted directed graphs. The objective of semi-supervised classification is to assign a label to unlabele…
Algorithm learns from label proportions in unlabeled bags.
problem Learning from unlabeled bags with known label proportions.
method Differentiable loss functions for deep neural networks.
result Deep neural networks can accurately classify images from unlabeled bags.
Paper addresses instance-level label prediction in MIL, improving performance compared to existing methods.
problem Lack of instance-level label prediction in existing MIL approaches restricts their applicability.
method Proposes a novel algorithm with instance-level loss function, unbiasedly and consistently estimated.
result Empirically validated superior instance-level and bag-level performance compared to state-of-the-art methods.
New framework learns labels at both bag and graph levels.
problem Learning multi-label classifiers from multi-graph bags.
method Designing scoring functions and rank-loss objective for graph and bag levels; developing sub-gradient descent algorithm.
result Superior performance over state-of-the-art algorithms.
Multiple instance learning (MIL) is concerned with learning from sets (bags) of objects (instances), where the individual instance labels are ambiguous. In this setting, supervised learning cannot be applied directly. Often, specialized MIL methods learn by making additional assumptions about the relationship of the ba…
The paper compares aggregated data labels in curated and random bags for machine learning models.
problem Protecting user privacy in machine learning systems with aggregated data.
method Examined curated and random bags for training machine learning models and compared their performance.
result Gradient-based learning can be performed on aggregated data without performance degradation.
Efficient graph-based algorithm for learning from bagged data.
problem Learning from bagged data with label proportions.
method Graph-based algorithm encouraging local smoothness and exploiting global structure.
result Preserves the mass of each bag while recovering true labels.
In the supervised learning setting termed Multiple-Instance Learning (MIL), the examples are bags of instances, and the bag label is a function of the labels of its instances. Typically, this function is the Boolean OR. The learner observes a sample of bags and the bag labels, but not the instance labels that determine…
Boosting weak learners to strong ones from aggregate labels is possible for LLP but not for MIL.
problem Boosting weak learners to strong ones from aggregate labels in learning from label proportions (LLP).
method Using a weak learner on large enough bags to obtain a strong learner for small bags in polynomial time.
result Boosting is possible for LLP but not for MIL.
A new large-scale tabular benchmark for Learning from Label Proportions.
problem Lack of a large-scale open benchmark for tabular Learning from Label Proportions.
method Proposed LLP-Bench, a suite of 70 datasets (62 feature bag and 8 random bag) from real-world tabular data.
result Demonstrated the effectiveness of 9 SOTA and popular tabular LLP techniques on 62 feature bag datasets.
New method improves weakly-supervised action localization.
problem Locating action segments in videos with limited labels.
method Explicitly models key instance assignment as hidden variable using EM framework.
result Achieves state-of-the-art performance on THUMOS14 and ActivityNet1.2 benchmarks.
Learning from Label Proportions (LLP) is a learning setting, where the training data is provided in groups, or "bags", and only the proportion of each class in each bag is known. The task is to learn a model to predict the class labels of the individual instances. LLP has broad applications in political science, market…
Proposes a new method for MIR using kernel mean embeddings.
problem Multiple instance regression (MIR) where bags contain multiple instances with a single label.
method Computes kernel mean embeddings of predicted label distributions and learns a regressor from these embeddings.
result Better results than baseline instance-MIR across all datasets, state-of-the-art on two.
Paper proposes M3Lcmf for better M3L performance.
problem Complex objects with diverse instances and multiple labels.
method Collaborative matrix factorization with heterogeneous network.
result M3Lcmf outperforms other solutions in benchmark datasets.
M4L-JMF tackles multi-typed objects learning, improving on M3L.
problem Learning from multi-typed objects with diverse features and labels.
method Joint matrix factorization to encode and factorize multi-typed bags and their instances.
result M4L-JMF outperforms existing methods on benchmark datasets.
A new method for MIR in remote sensing without assuming a prime instance per bag.
problem Multiple Instance Regression in remote sensing with high variability.
method Treats each bag as a set of instances and learns to map each bag to its unique label using all instances.
result Outperforms previous state-of-the-art on three real-world datasets.
Graph neural networks improve MIL performance without losing interpretability.
problem Learning bag-level labels from bags of instances.
method Proposed a GNN-based algorithm treating bags as graphs to learn embeddings and predict labels.
result Achieves state-of-the-art performance on MIL datasets.
Paper proposes a new model using consistency regularization for learning from label proportions.
problem Learning from label proportions with weak labels on bags of instances.
method Consistency regularization applied to semi-supervised learning.
result LLP with consistency regularization achieves superior performance.
This work efficiently learns linear threshold functions from label proportions using Gaussian distributions.
problem Efficiently learning linear threshold functions from label proportions.
method Using Gaussian distributions, the algorithm estimates means and covariance matrices, and identifies a low error hypothesis LTF.
result It is possible to efficiently learn LTFs using LTFs when given access to random bags of label proportions.
A new method for deep multiple instance learning using self-attention.
problem Classifying bags of instances with dependencies.
method Introducing Self-Attention-based aggregation operation for bags of instances.
result SA-AbMILP outperforms other models in various datasets.
New method preserves privacy by aggregating feature-vectors with weighted sums, ensuring label differential privacy.
problem Ensuring privacy in training data aggregation for sensitive labels.
method Learning from bag aggregates (LBA) with weighted Gaussian sums, preserving label differential privacy (label-DP).
result Weighted LBA using iid Gaussian weights with m randomly sampled disjoint k-sized bags provides (ε,δ)-label-DP. Improves key instance detection in MIL models by using neural network inversion with sparseness constraint.
problem Limited key instance detection performance in attention-based deep MIL models due to skewed attention scores.
method Sparse network inversion with a sparseness constraint incorporated into neural network inversion, solved by proximal gradient method.
result Significantly improved key instance detection performance while maintaining bag-level prediction performance.
Multi-instance learning (MIL) has a wide range of applications due to its distinctive characteristics. Although many state-of-the-art algorithms have achieved decent performances, a plurality of existing methods solve the problem only in instance level rather than excavating relations among bags. In this paper, we prop…
New framework for weakly supervised learning from label proportions.
problem Lack of consistent learning procedure and theoretical training criterion for LLP.
method Pose LLP as mutual contamination models (MCMs) and establish unbiased losses and generalization error bounds.
result Established novel technical results for MCMs and proposed a new experimental setting.
BRDAD uses bagging and regularization to improve anomaly detection without labeled data.
problem Anomaly detection in unlabeled data with sensitivity to k-nearest neighbors. method Bagged regularized k-distances (BRDAD) for anomaly detection, converting to convex optimization. result BRDAD addresses sensitivity to hyperparameter choice and improves performance on large datasets.
Paper proposes a method to generate instance labels from weakly supervised data.
problem Weakly supervised instance labeling in medical image analysis.
method Uses multiple instance learning (MIL) and knowledge distillation to generate instance-level predictions.
result Significantly outperforms state-of-the-art MIL methods in instance-level prediction.
We are interested in estimating individual labels given only coarse, aggregated signal over the data points. In our setting, we receive sets ("bags") of unlabeled instances with constraints on label proportions. We relax the unrealistic assumption of known label proportions, made in previous work; instead, we assume on…
Easyllp simplifies LLP, achieving low task loss at individual instance level.
problem Weakly supervised classification with label proportions.
method Flexible debiasing approach based on aggregate labels, operating on arbitrary loss functions.
result Accurately estimates expected loss at individual level, with provable guarantees.
Proposes a stable classifier using inflated argmax for multiclass classification.
problem Inherent instability of taking the maximizer in multiclass classification.
method Bagging for stable continuous scores, inflated argmax for stable labels.
result Inflated argmax provides necessary protection against unstable classifiers without loss of accuracy.
Approach for training deep nets with unlabeled patches.
problem Training deep neural networks with detailed expert annotations.
method Cluster-based learning from weakly labeled bags in latent space.
result Improved performance on Camelyon dataset.
ML-KFHE improves multi-label classification performance using Kalman filter fusion.
problem Lack of effective multi-label ensemble classification methods.
method Exploits Kalman filter sensor fusion properties for multi-label classification.
result Significantly improved predictive performance on multi-label datasets.
Recently neural networks and multiple instance learning are both attractive topics in Artificial Intelligence related research fields. Deep neural networks have achieved great success in supervised learning problems, and multiple instance learning as a typical weakly-supervised learning method is effective for many app…
Paper proposes a transfer learning method for learning with label proportions that handles uncertain data.
problem Learning with label proportions (LLP) for uncertain data.
method Transfer learning approach to transfer knowledge from source to target tasks with uncertain data.
result The proposed TL-LLP method achieves better accuracy and is less sensitive to noise.
This work develops a generic framework, called the bag-of-paths (BoP), for link and network data analysis. The central idea is to assign a probability distribution on the set of all paths in a network. More precisely, a Gibbs-Boltzmann distribution is defined over a bag of paths in a network, that is, on a representati…
Feature learning and deep learning have drawn great attention in recent years as a way of transforming input data into more effective representations using learning algorithms. Such interest has grown in the area of music information retrieval (MIR) as well, particularly in music audio classification tasks such as auto…
New learning rules achieve optimal sample complexity for weakly supervised classification.
problem Learning from label proportions in weakly supervised settings.
method Debiased proportional square loss and EasyLLP learning rule.
result Achieves optimal sample complexity in both realizable and agnostic settings.
Class imbalance presents a major hurdle in the application of data mining methods. A common practice to deal with it is to create ensembles of classifiers that learn from resampled balanced data. For example, bagged decision trees combined with random undersampling (RUS) or the synthetic minority oversampling technique…
Proposes a novel Out-of-Bag anomaly detection method for ML systems.
problem Challenges of detecting data anomalies in real-world datasets.
method Model-based approach decomposing unsupervised problem into ensemble models using Out-of-Bag estimates.
result Demonstrates state-of-the-art performance and improved accuracy in ML systems.
BayesBag improves reproducibility of Bayesian inference under model misspecification.
problem Bayesian posteriors can be unreliable and inconsistent under model misspecification.
method Apply bagging to the Bayesian posterior to improve reproducibility.
result Bagged posteriors typically satisfy reproducibility criteria under misspecification.
BDMBC clusters data with varying densities using a new PLLS measure.
problem Finding clusters with varying densities in data.
method Bagged k-distance with PLLS for mode estimation. result BDMBC achieves optimal convergence rates for mode and level set estimation.
Deep learning model for demographic classification using label proportions.
problem Lack of annotated training data for deep learning.
method LLP setting with Batch Averager regularization and co-training algorithm.
result Deep LLP model outperforms baselines for demographic classification.
Deep-MIL models fail to respect key MIL assumption, leading to incorrect learning.
problem Deep-MIL models learn anti-correlated instances, violating the standard MIL assumption.
method Proposed algorithmic unit tests to identify violations of MIL assumptions.
result Five prominent deep-MIL models fail algorithmic unit tests, revealing incorrect learning.
Paper tackles distribution changes in MIL without test data.
problem Real-world MIL data violates i.i.d. assumption.
method Proposes a framework connecting MIL to causal effect estimation.
result Validated approach on various datasets.
Paper proposes an online transfer learning framework using online bagging.
problem Difficulty in obtaining sufficient labeled data in the target domain.
method Ensemble approach with online bagging for anytime transfer learning.
result Effectiveness of the proposed algorithms demonstrated on real data sets.
A method to improve clustering explainability using bagging and feature dropout.
problem Lack of explainability in clustering methods.
method Bagging and feature dropout to generate feature importance scores.
result Improved stability and robustness of cluster definition, especially in small-sample or noisy settings.