M4L-JMF tackles multi-typed objects learning, improving on M3L.
problem Learning from multi-typed objects with diverse features and labels.
method Joint matrix factorization to encode and factorize multi-typed bags and their instances.
result M4L-JMF outperforms existing methods on benchmark datasets.
Paper tackles gene mutation prediction for HCC using multi-instance multi-label learning.
problem Gene mutation prediction in hepatocellular carcinoma for personalized treatments.
method Multi-instance multi-label learning with oversampling for data imbalance.
result Proposed approach shows superiority in gene mutation prediction.
End-to-end method learns geometry and appearance for multi-view object detection.
problem Challenges in multi-view object detection, including viewpoint, lighting, and scale variability.
method Jointly learns multi-view geometry and warping for robust cross-view object detection.
result Superior performance compared to baselines on a new street-level panorama data set.
Paper proposes M3Lcmf for better M3L performance.
problem Complex objects with diverse instances and multiple labels.
method Collaborative matrix factorization with heterogeneous network.
result M3Lcmf outperforms other solutions in benchmark datasets.
Extends multi-instance learning to nested bags for better interpretation and classification.
problem Nested bags in multi-instance learning for diverse applications.
method Bag-layer neural network layer for aggregating bags of inputs.
result Bag-layer neural network can learn and interpret complex functions over sets of sets.
Multi-instance data, in which each object (bag) contains a collection of instances, are widespread in machine learning, computer vision, bioinformatics, signal processing, and social sciences. We present a maximum entropy (ME) framework for learning from multi-instance data. In this approach each bag is represented as …
We study learning latent models with multi-instance weak supervision.
problem Learning latent models with multi-instance weak supervision.
method Formulated as multi-instance Partial Label Learning (multi-instance PLL), proposed a necessary and sufficient condition for learnability, derived Rademacher-style error bounds.
result First theoretical study of multi-instance PLL with unknown transition function, aligns with empirical results but highlights scalability issues.
Paper uses financial news for stock trend forecasting using deep multiple instance learning.
problem Forecasting stock trends from financial news articles.
method Developed a flexible and adaptive multi-instance learning model for bags of instances (financial news articles) on trading days.
result Outstanding trend prediction accuracy compared to state-of-the-art approaches.
BP pretreatment reduces multi-label classification time.
problem Efficiently annotate large label sets for extreme multi-label classification.
method Divide instances into clusters, attach most relevant labels, train on pairs of clusters.
result BP reduces prediction time significantly without sacrificing accuracy.
SI learning is effective for unbalanced data, showing resilience to object dependencies.
problem Learning from unbalanced data in multi-instance learning.
method Analysis of SI learning objective with rich classifier families, focusing on unbalanced data.
result Unbalanced data improves resilience of SI method to object dependencies, especially in neural networks.
Much recent machine learning research has been directed towards leveraging shared statistics among labels, instances and data views, commonly referred to as multi-label, multi-instance and multi-view learning. The underlying premises are that there exist correlations among input parts and among output targets, and the …
AMI-Net+ tackles medical diagnosis from incomplete, imbalanced data.
problem Medical diagnosis from incomplete and imbalanced data.
method AMI-Net+ uses multi-instance neural network with embedding, multi-head attention, and gated attention-based pooling. It also employs focal loss and self-adaptive multi-instance pooling.
result AMI-Net+ outperforms state-of-the-art models on real-world medical datasets.
New methods detect targets from imprecisely labeled hyperspectral data.
problem Challenges in acquiring labeled hyperspectral data.
method Multi-Target MI-ACE and MI-SMF methods that learn target signatures from imprecisely labeled samples.
result Effective at learning target signatures and performing target detection.
Unified framework for various learning problems via Multiple-Instance Learning.
problem Various learning problems including multi-class, complementarily labeled, multi-label, and multi-task learning.
method Reduction of various learning problems to Multiple-Instance Learning (MIL) with theoretical guarantees.
result Unified and simplified framework for designing and analyzing algorithms for various learning problems.
OPLTs online train label trees for multi-label and multi-class classification.
problem Online multi-label and multi-class classification challenges.
method Fully online training of label trees without prior knowledge.
result Strong theoretical guarantees and low complexity.
CNN learns diabetic syndromes from patient records.
problem Syndrome differentiation in TCM is complex and lacks standardization.
method Multi-instance multi-task learning with CNN.
result Outperforms other methods on diabetes dataset.
We present a new approach for transferring knowledge from groups to individuals that comprise them. We evaluate our method in text, by inferring the ratings of individual sentences using full-review ratings. This approach, which combines ideas from transfer learning, deep learning and multi-instance learning, reduces t…
Labeling data for classification requires significant human effort. To reduce labeling cost, instead of labeling every instance, a group of instances (bag) is labeled by a single bag label. Computer algorithms are then used to infer the label for each instance in a bag, a process referred to as instance annotation. Thi…
Paper tackles distribution changes in MIL without test data.
problem Real-world MIL data violates i.i.d. assumption.
method Proposes a framework connecting MIL to causal effect estimation.
result Validated approach on various datasets.
In this paper, we investigate the multi-variate sequence classification problem from a multi-instance learning perspective. Real-world sequential data commonly show discriminative patterns only at specific time periods. For instance, we can identify a cropland during its growing season, but it looks similar to a barren…
PML-GAN tackles noisy multi-label annotations using adversarial learning.
problem Learning multi-label models from noisy, overcomplete annotations.
method PML-GAN uses a disambiguation network and a generative adversarial network to map noisy labels to clean labels and data samples.
result PML-GAN achieves state-of-the-art performance on partial multi-label learning datasets.
Prototypical Networks improve multi-label classification accuracy.
problem Multi-label classification with nonlinear label dependencies.
method Formulate multi-label learning as class distribution in a non-linear embedding space. For each label, positive and negative embeddings are compactly distributed. Labels are inferred by measuring the distance to prototype positive or negative embeddings.
result Extensive experiments show improved accuracy compared to state-of-the-art algorithms.
New RF dissimilarity measures improve multi-view learning accuracy.
problem Improving multi-view learning accuracy in HDLSS problems.
method Modified Random Forest proximity measures for HDLSS multi-view classification.
result Second method significantly more accurate than other state-of-the-art methods.
Solves dual imbalance in detecting sparse anomalies in MIL.
problem Detecting scarce and sparse anomalous samples in MIL.
method Reformulates MIL as a fine-grained PU learning problem, addressing imbalance at both macro and micro levels.
result Demonstrates effectiveness of BFGPU framework on synthetic and real-world datasets.
CSI detects novelty by contrasting shifted instances, outperforming existing methods.
problem Detecting samples from outside the training distribution.
method Contrastive learning with distributionally shifted augmentations.
result CSI outperforms existing methods in various novelty detection scenarios.
Paper tackles noisy similarity labels for multi-class classification.
problem Learning multi-class classifiers from noisy similarity-labeled data.
method Proposes a method using a noise transition matrix to learn from noisy data.
result Demonstrates superior performance compared to state-of-the-art methods.
Proposes an online metric learning method for multi-label classification.
problem Lack of consideration for label dependencies and theoretical analysis of loss functions in existing multi-label classification methods.
method Develops a novel online metric learning paradigm based on k-Nearest Neighbour (kNN) and large margin principle, adapted for online streaming data.
result The proposed OML algorithm outperforms state-of-the-art methods on benchmark multi-label datasets.
Proposes methods to improve multi-label learning by addressing local label imbalance.
problem Local label imbalance within minority class examples degrades multi-label learning performance.
method Introduces a measure to assess local label imbalance and two sampling approaches (MLSOL, MLUL) to address it.
result Experimental results show MLSOL and MLUL improve performance on multi-label datasets.
Multi-instance learning (MIL) has a wide range of applications due to its distinctive characteristics. Although many state-of-the-art algorithms have achieved decent performances, a plurality of existing methods solve the problem only in instance level rather than excavating relations among bags. In this paper, we prop…
InstaGAN tackles image-to-image translation for images with multiple instances and significant shape changes.
problem Challenging cases, especially images with multiple target instances and significant shape changes.
method Instance-aware GAN (InstaGAN) that incorporates instance information and context preserving loss.
result Improves multi-instance transfiguration while maintaining permutation invariance of instances.
Supervised object detection and semantic segmentation require object or even pixel level annotations. When there exist image level labels only, it is challenging for weakly supervised algorithms to achieve accurate predictions. The accuracy achieved by top weakly supervised algorithms is still significantly lower than …
Develops a method for manifold learning with small sample size datasets.
problem Improving manifold learning performance for multiple tasks with limited samples.
method Uses instance and model transfer to integrate manifold models from similar tasks.
result Successfully estimates manifolds with tiny sample sizes across multiple tasks.
Sparse coding (Sc) has been studied very well as a powerful data representation method. It attempts to represent the feature vector of a data sample by reconstructing it as the sparse linear combination of some basic elements, and a L2 norm distance function is usually used as the loss function for the reconstructio…
The paper proposes a method to improve fine-resolution predictions using coarse-resolution data.
problem Limited supervision for fine-resolution predictions with scarce data.
method Attention-based regularization on multi-view coarse-resolution data.
result The method improves fine-resolution predictions using coarse-resolution data.
We propose a nonparametric Bayesian probabilistic latent variable model for multi-view anomaly detection, which is the task of finding instances that have inconsistent views. With the proposed model, all views of a non-anomalous instance are assumed to be generated from a single latent vector. On the other hand, an ano…
Paper introduces a structured prediction approach for multi-agent reinforcement learning.
problem Scaling and generalization in cooperative multi-agent reinforcement learning.
method Structured prediction approach using learned scoring models for task assignment.
result The approach can generalize to larger problems with more agents and tasks.
Paper tackles rDR classification and lesion segmentation using self-supervised equivariant learning and attention-based MIL.
problem Classifying rDR and segmenting lesions from image-level labels.
method Integrates self-supervised equivariant attention mechanism (SEAM) with attention-based multi-instance learning (MIL).
result Achieved AU ROC of 0.958 on Eyepacs dataset, outperforming state-of-the-art.
Unified framework improves deep multi-view clustering by addressing self-supervision and contrastive alignment issues.
problem Variations in self-supervision-based methods for deep multi-view clustering.
method Unified DeepMVC framework that includes recent methods and leverages self-supervision and contrastive alignment.
result Contrastive alignment negatively impacts cluster separability, especially with many views.
This paper analyzes dynamic ensemble selection and preprocessing for multi-class imbalanced datasets.
problem Class imbalance in multi-class datasets where majority classes have more instances.
method Examined dynamic selection techniques and data preprocessing methods for multi-class imbalanced problems.
result Dynamic ensemble improves AUC and G-mean compared to static ensemble.
A new framework detects novel classes in data streams.
problem Detecting novel class labels in data streams.
method Semi-supervised multi-task learning framework for co-representation learning.
result Superior performance over existing methods on real-world datasets.
GIRNet tackles multi-tasking with mixed domain sequences, improving sentiment and tagging tasks.
problem Labeling sequences with mixed domain data and position-specific inference.
method Unified position-sensitive multi-task RNN architecture with gated state sequences from auxiliary data.
result GIRNet achieves new state-of-the-art performance in sentiment classification, POS tagging, and target position-sensitive annotation.
New algorithm for XMC from aggregated labels.
problem Finding relevant labels for inputs from a large label universe.
method Developed a scalable algorithm to impute individual labels from group labels.
result Advantages over existing approaches in XMC and MIML tasks.
Stochastic Gradient Trees learn decision trees incrementally.
problem Learning decision trees using stochastic gradient information.
method Incremental learning setting, soft splits not used, new tree not constructed per update.
result Performs similarly to standard incremental classification trees, outperforms state of the art incremental regression trees, comparable to batch multi-instance learning methods.
New method improves learning from multiple correlated data trajectories.
problem Learning from multiple correlated data trajectories without mixing assumptions.
method Hellinger localization framework for maximum likelihood estimation.
result Instance-optimal bounds that scale with full data budget under broad conditions.
Develops multi-task learning models for ordinal regression with heterogeneous data.
problem Tackling ordinal regression for heterogeneous, non-IID data.
method Sparse and deep multi-task learning approaches.
result Proposed MTOR models improve prediction performance.
MCC algorithm predicts with partial modalities, outperforming full modalities.
problem Predicting with inconsistent and diverse multi-modal data.
method Instance-oriented Multi-modal Classifier Chains (MCC) algorithm.
result MCC outperforms full modalities in prediction.
No communication allows optimal instance-dependent regret guarantees in multi-player bandits.
problem Achieving optimal instance-dependent regret in multi-player multi-armed bandits without communication.
method Characterization of Pareto optimal trade-offs and development of an algorithm.
result Achieving optimal instance-dependent regret requires strict sub-optimality in other regimes.
This paper proposes Relational Similarity Machines (RSM): a fast, accurate, and flexible relational learning framework for supervised and semi-supervised learning tasks. Despite the importance of relational learning, most existing methods are hard to adapt to different settings, due to issues with efficiency, scalabili…