Paper proposes a new classifier for gender detection in mobile telematics.
problem Detecting gender through mobile telematics data.
method Choquet fuzzy integral vertical bagging classifier combining random forest and rough set theory.
result Choquet fuzzy integral vertical bagging classifier outperforms other classifiers.
Finding an optimal assignment between two sets of objects is a fundamental problem arising in many applications, including the matching of `bag-of-words' representations in natural language processing and computer vision. Solving the assignment problem typically requires cubic time and its pairwise computation is expen…
In multi-instance (MI) learning, each object (bag) consists of multiple feature vectors (instances), and is most commonly regarded as a set of points in a multidimensional space. A different viewpoint is that the instances are realisations of random vectors with corresponding probability distribution, and that a bag is…
Bagging stabilizes models without distributional assumptions.
problem Stability of machine learning models without distributional assumptions.
method Derives a finite-sample guarantee on bagging stability for any model.
result Guarantee applies to many bagging variants and is optimal.
Feature bagging improves stability through random feature subsampling.
problem Improving the stability of ensemble learning methods.
method Introducing feature instability (FI) and analyzing feature bagging in parametric and model-free settings.
result Feature bagging provides stronger stability than non-bagged methods, especially with aggressive subsampling.
The paper analyzes bagging in overparameterized learning, deriving risk properties and optimal subsample sizes.
problem Characterizing the risk of bagged predictors in overparameterized settings.
method General strategy using classical results on simple random sampling, specialized for ridge and ridgeless predictors.
result Derives exact asymptotic risk of bagged ridge and ridgeless predictors under various conditions.
Multi-instance learning (MIL) has a wide range of applications due to its distinctive characteristics. Although many state-of-the-art algorithms have achieved decent performances, a plurality of existing methods solve the problem only in instance level rather than excavating relations among bags. In this paper, we prop…
Bagging reduces MSE for unstable estimators like trees, but only if the distribution has high kurtosis.
problem Theoretical properties of bagging applied to statistical estimators.
method Theoretical analysis of MSE reduction for bagged estimators, focusing on variance estimation.
result Bagging reduces MSE for unstable estimators like trees, but only if the distribution has high kurtosis.
Multiple instance learning (MIL) is concerned with learning from sets (bags) of objects (instances), where the individual instance labels are ambiguous. In this setting, supervised learning cannot be applied directly. Often, specialized MIL methods learn by making additional assumptions about the relationship of the ba…
The paper compares aggregated data labels in curated and random bags for machine learning models.
problem Protecting user privacy in machine learning systems with aggregated data.
method Examined curated and random bags for training machine learning models and compared their performance.
result Gradient-based learning can be performed on aggregated data without performance degradation.
Bagging is a device intended for reducing the prediction error of learning algorithms. In its simplest form, bagging draws bootstrap samples from the training sample, applies the learning algorithm to each bootstrap sample, and then averages the resulting prediction rules. We extend the definition of bagging from stati…
A new large-scale tabular benchmark for Learning from Label Proportions.
problem Lack of a large-scale open benchmark for tabular Learning from Label Proportions.
method Proposed LLP-Bench, a suite of 70 datasets (62 feature bag and 8 random bag) from real-world tabular data.
result Demonstrated the effectiveness of 9 SOTA and popular tabular LLP techniques on 62 feature bag datasets.
Under-bagging k-NN improves performance on imbalanced classification.
problem Imbalanced classification problems where one class is significantly underrepresented.
method Proposes an under-bagging k-NN ensemble learning algorithm, analyzing convergence rates and efficiency. result Achieves optimal convergence rates under mild assumptions and reduces sub-sample size and k for highly imbalanced data. Improved Bayesian uncertainty quantification using variational bagging.
problem Inefficient and underestimating uncertainty in mean-field variational Bayes.
method Integrates bagging with variational Bayes for improved inference.
result Bagged variational posterior provides proper uncertainty quantification.
Graph neural networks improve MIL performance without losing interpretability.
problem Learning bag-level labels from bags of instances.
method Proposed a GNN-based algorithm treating bags as graphs to learn embeddings and predict labels.
result Achieves state-of-the-art performance on MIL datasets.
Develops RL algorithm for non-Markovian, non-stationary reward streams.
problem Maximizing rewards from non-Markovian, non-stationary reward streams.
method Uses causal DAG to construct Markov states, solves periodic MDP.
result Optimal state construction maximizes discounted rewards.
In the supervised learning setting termed Multiple-Instance Learning (MIL), the examples are bags of instances, and the bag label is a function of the labels of its instances. Typically, this function is the Boolean OR. The learner observes a sample of bags and the bag labels, but not the instance labels that determine…
A new method for MIR in remote sensing without assuming a prime instance per bag.
problem Multiple Instance Regression in remote sensing with high variability.
method Treats each bag as a set of instances and learns to map each bag to its unique label using all instances.
result Outperforms previous state-of-the-art on three real-world datasets.
In ensemble methods, the outputs of a collection of diverse classifiers are combined in the expectation that the global prediction be more accurate than the individual ones. Heterogeneous ensembles consist of predictors of different types, which are likely to have different biases. If these biases are complementary, th…
In multiple instance learning, objects are sets (bags) of feature vectors (instances) rather than individual feature vectors. In this paper we address the problem of how these bags can best be represented. Two standard approaches are to use (dis)similarities between bags and prototype bags, or between bags and prototyp…
Bagging stabilizes linear interpolators, improving their generalization performance.
problem Unstable linear interpolators fail on noisy data.
method Introduced multiplier-bootstrap-based bagged least square estimator.
result Bagging effectively mitigates variance, leading to bounded prediction risk.
Algorithm learns from label proportions in unlabeled bags.
problem Learning from unlabeled bags with known label proportions.
method Differentiable loss functions for deep neural networks.
result Deep neural networks can accurately classify images from unlabeled bags.
New method improves weakly-supervised action localization.
problem Locating action segments in videos with limited labels.
method Explicitly models key instance assignment as hidden variable using EM framework.
result Achieves state-of-the-art performance on THUMOS14 and ActivityNet1.2 benchmarks.
Bagging, a powerful ensemble method from machine learning, improves the performance of unstable predictors. Although the power of Bagging has been shown mostly in classification problems, we demonstrate the success of employing Bagging in sparse regression over the baseline method (L1 minimization). The framework emplo…
BRDAD uses bagging and regularization to improve anomaly detection without labeled data.
problem Anomaly detection in unlabeled data with sensitivity to k-nearest neighbors. method Bagged regularized k-distances (BRDAD) for anomaly detection, converting to convex optimization. result BRDAD addresses sensitivity to hyperparameter choice and improves performance on large datasets.
Proposes a new method for MIR using kernel mean embeddings.
problem Multiple instance regression (MIR) where bags contain multiple instances with a single label.
method Computes kernel mean embeddings of predicted label distributions and learns a regressor from these embeddings.
result Better results than baseline instance-MIR across all datasets, state-of-the-art on two.
Paper addresses instance-level label prediction in MIL, improving performance compared to existing methods.
problem Lack of instance-level label prediction in existing MIL approaches restricts their applicability.
method Proposes a novel algorithm with instance-level loss function, unbiasedly and consistently estimated.
result Empirically validated superior instance-level and bag-level performance compared to state-of-the-art methods.
New framework learns labels at both bag and graph levels.
problem Learning multi-label classifiers from multi-graph bags.
method Designing scoring functions and rank-loss objective for graph and bag levels; developing sub-gradient descent algorithm.
result Superior performance over state-of-the-art algorithms.
This paper compares two loss functions for learning from aggregated responses and introduces an interpolating estimator.
problem Learning from aggregated responses in privacy-sensitive settings.
method Investigates bag-level and instance-level loss functions, and introduces an interpolating estimator.
result Instance-level loss can be seen as a regularized form of bag-level loss, leading to improved estimators.
Improves key instance detection in MIL models by using neural network inversion with sparseness constraint.
problem Limited key instance detection performance in attention-based deep MIL models due to skewed attention scores.
method Sparse network inversion with a sparseness constraint incorporated into neural network inversion, solved by proximal gradient method.
result Significantly improved key instance detection performance while maintaining bag-level prediction performance.
WildWood improves Random Forest predictions using bootstrap out-of-bag samples.
problem Improving Random Forest predictions for supervised learning.
method Uses bootstrap out-of-bag samples to compute improved predictions by aggregating all possible subtrees with exponential weights.
result WildWood produces faster and more competitive predictions compared to other ensemble methods.
Labeling data for classification requires significant human effort. To reduce labeling cost, instead of labeling every instance, a group of instances (bag) is labeled by a single bag label. Computer algorithms are then used to infer the label for each instance in a bag, a process referred to as instance annotation. Thi…
We investigate the mapping class group of an orientable ω-bounded surface. Such a surface splits, by Nyikos's Bagpipe Theorem, into a union of a bag (a compact surface with boundary) and finitely many long pipes. The subgroup consisting of classes of homeomorphisms fixing the boundary of the bag is a normal subgroup …
Stacking is a general approach for combining multiple models toward greater predictive accuracy. It has found various application across different domains, ensuing from its meta-learning nature. Our understanding, nevertheless, on how and why stacking works remains intuitive and lacking in theoretical insight. In this …
Boosting weak learners to strong ones from aggregate labels is possible for LLP but not for MIL.
problem Boosting weak learners to strong ones from aggregate labels in learning from label proportions (LLP).
method Using a weak learner on large enough bags to obtain a strong learner for small bags in polynomial time.
result Boosting is possible for LLP but not for MIL.
SFBoW provides sentence embeddings with predefined dimensions.
problem Sentence embeddings problem at document-level.
method Refinement of Fuzzy Bag-of-Words, predefined dimension.
result Competitive performances in Semantic Textual Similarity benchmarks.
Learning from Label Proportions (LLP) is a learning setting, where the training data is provided in groups, or "bags", and only the proportion of each class in each bag is known. The task is to learn a model to predict the class labels of the individual instances. LLP has broad applications in political science, market…
Multiple instance learning (MIL) is a variation of supervised learning where a single class label is assigned to a bag of instances. In this paper, we state the MIL problem as learning the Bernoulli distribution of the bag label where the bag label probability is fully parameterized by neural networks. Furthermore, we …
A new method for deep multiple instance learning using self-attention.
problem Classifying bags of instances with dependencies.
method Introducing Self-Attention-based aggregation operation for bags of instances.
result SA-AbMILP outperforms other models in various datasets.
Study compares under-bagging with other methods for imbalanced data.
problem Comparing under-bagging with other methods for imbalanced data.
method Replica analysis of under-bagging, comparing with under-sampling and simple weighting.
result Under-bagging improves performance by increasing the majority class size.
M4L-JMF tackles multi-typed objects learning, improving on M3L.
problem Learning from multi-typed objects with diverse features and labels.
method Joint matrix factorization to encode and factorize multi-typed bags and their instances.
result M4L-JMF outperforms existing methods on benchmark datasets.
Study of Dirac-like operators on spin manifolds with large mass parameters.
problem Understanding spectra of Dirac-like operators with piecewise constant mass terms.
method Analysis of asymptotic regimes to derive effective operators.
result Extension of MIT Bag operator concept to spin geometry.
Proposes a novel Out-of-Bag anomaly detection method for ML systems.
problem Challenges of detecting data anomalies in real-world datasets.
method Model-based approach decomposing unsupervised problem into ensemble models using Out-of-Bag estimates.
result Demonstrates state-of-the-art performance and improved accuracy in ML systems.
We introduce an extension of the multi-instance learning problem where examples are organized as nested bags of instances (e.g., a document could be represented as a bag of sentences, which in turn are bags of words). This framework can be useful in various scenarios, such as text and image classification, but also sup…
Paper proposes M3Lcmf for better M3L performance.
problem Complex objects with diverse instances and multiple labels.
method Collaborative matrix factorization with heterogeneous network.
result M3Lcmf outperforms other solutions in benchmark datasets.
Data-OOB efficiently estimates data value using out-of-bag estimates.
problem Efficiently estimating the value of data in large datasets.
method Data-OOB method using out-of-bag estimates for bagging models.
result Significantly outperforms existing data valuation methods in identifying mislabeled data.
A new adaptive kNN classifier outperforms Random Forests.
problem Improving classification accuracy using nearest neighbors.
method Finding discriminant subspaces for efficient nearest neighbor classification, leveraging bagging for diversity.
result The proposed method outperforms Random Forests and other nearest neighbors ensembles.
BBM models short texts using biterms to improve coherence.
problem Challenges in analyzing short texts from social media.
method Bag of Biterms (BoB) for document representation and simple statistical models.
result BBM enhances coherence and performance over traditional models.