A new framework decouples instance representation learning from subject-level supervision in EEG-based disease diagnosis.
problem Inherently assigning subject labels to all instances in EEG-based disease diagnosis leads to unreliable representations.
method BridgeMIL, a two-stage framework that pretrains an encoder without inherited instance labels and then applies subject-level supervision.
result BridgeMIL achieves the highest mean accuracy in 14 of 15 dataset-backbone settings, with an overall mean accuracy of 76.57%.
We describe a novel weakly supervised deep learning framework that combines both the discriminative and generative models to learn meaningful representation in the multiple instance learning (MIL) setting. MIL is a weakly supervised learning problem where labels are associated with groups of instances (referred as bags…
SEG-BERT improves graph instance learning by adapting GRAPH-BERT.
problem Graph instance representation learning challenges due to diverse sizes and node order.
method Adapted GRAPH-BERT with a segmented architecture to handle graph node orderlessness and diverse sizes.
result SEG-BERT outperforms comparison methods on six out of seven benchmark datasets.
RISE framework unifies and improves time series learning with missing data.
problem Learning from time series with missing data.
method RISE framework unifies and improves time series learning with missing data.
result RISE instances always benefit from encoders that learn representations for numerical values.
Open set recognition problems exist in many domains. For example in security, new malware classes emerge regularly; therefore malware classification systems need to identify instances from unknown classes in addition to discriminating between known classes. In this paper we present a neural network based representation…
In multiple instance learning, objects are sets (bags) of feature vectors (instances) rather than individual feature vectors. In this paper we address the problem of how these bags can best be represented. Two standard approaches are to use (dis)similarities between bags and prototype bags, or between bags and prototyp…
A new SSL method using whitening of latent-space features.
problem Efficiency and effectiveness of self-supervised representation learning.
method Proposes a new loss function based on whitening of latent-space features, avoiding the need for negatives and asymmetric networks.
result Improves efficiency and effectiveness of SSL by avoiding the need for negatives and asymmetric networks.
Sparse coding (Sc) has been studied very well as a powerful data representation method. It attempts to represent the feature vector of a data sample by reconstructing it as the sparse linear combination of some basic elements, and a L2 norm distance function is usually used as the loss function for the reconstructio…
CSI detects novelty by contrasting shifted instances, outperforming existing methods.
problem Detecting samples from outside the training distribution.
method Contrastive learning with distributionally shifted augmentations.
result CSI outperforms existing methods in various novelty detection scenarios.
BetaDataWeighter learns weights for unlabelled data to improve self-supervised learning accuracy.
problem Improving unsupervised representations with domain shift between unlabelled and target data.
method Learning Bayesian instance weights for unlabelled data to prioritize useful instances.
result BetaDataWeighter achieves highest average accuracy and prunes up to 78% of images without significant loss in accuracy.
Proposes Contrastive Clustering for improved clustering performance.
problem Improving clustering performance on various datasets.
method Instance- and cluster-level contrastive learning through data augmentations and feature space projections.
result Contrastive Clustering achieves significant improvements over 17 competitive methods.
A probabilistic method for deep embedding that improves classification accuracy and interpretability.
problem Improving classification accuracy and interpretability in deep learning.
method A probabilistic approach that treats embeddings as random variables, using a product distribution over labeled instances and marginalizing prototype proximity.
result Superior large- and open-set classification accuracy compared to state-of-the-art methods.
A new algorithm enhances minority class representation in imbalanced datasets.
problem Improving classification performance on imbalanced datasets.
method PO-QG algorithm using Proxima-Orion neighbors and q-Gaussian weighting.
result The PO-QG algorithm improves overall classification performance.
RL agents fail to generalize to unseen environments, even when dynamics are similar.
problem RL agents fail to generalize to unseen environments despite similar dynamics.
method Analyzed policy learning in POMDPs, formalized training dynamics as instances, and introduced a shared belief representation over an ensemble of specialized policies.
result Maximizing rewards induces instance-specific policies that are suboptimal on the training set.
The paper analyzes how deep neural networks handle noisy labels and finds disparate impacts.
problem Disparate impacts of noisy labels on instances with different representation frequencies.
method Quantifying harms, analyzing solutions, and comparing their impacts on different frequency instances.
result Existing solutions lead to disparate treatments, benefiting higher-frequency instances more.
Paper tackles gene mutation prediction for HCC using multi-instance multi-label learning.
problem Gene mutation prediction in hepatocellular carcinoma for personalized treatments.
method Multi-instance multi-label learning with oversampling for data imbalance.
result Proposed approach shows superiority in gene mutation prediction.
SoftCLT improves time series representation learning by soft contrastive loss.
problem Ignoring inherent correlations in time series leads to poor representation quality.
method SoftCLT introduces instance-wise and temporal contrastive loss with soft assignments.
result SoftCLT consistently improves various downstream tasks in time series learning.
Recently, deep architectures, such as recurrent and recursive neural networks have been successfully applied to various natural language processing tasks. Inspired by bidirectional recurrent neural networks which use representations that summarize the past and future around an instance, we propose a novel architecture …
SymNet uses neural models to solve RMDPs efficiently.
problem Limited effectiveness of generalized policies in RMDPs.
method SymNet trains shared parameters for an RDDL domain, converts instances to graphs, uses relational neural models for node embeddings, and scores actions based on embeddings.
result SymNet policies outperform random and state-of-the-art deep reactive policies on nine RDDL domains.
New RF dissimilarity measures improve multi-view learning accuracy.
problem Improving multi-view learning accuracy in HDLSS problems.
method Modified Random Forest proximity measures for HDLSS multi-view classification.
result Second method significantly more accurate than other state-of-the-art methods.
Recently neural networks and multiple instance learning are both attractive topics in Artificial Intelligence related research fields. Deep neural networks have achieved great success in supervised learning problems, and multiple instance learning as a typical weakly-supervised learning method is effective for many app…
One-shot VC model converts voices without parallel data.
problem Limited VC applicability due to training data restriction.
method Disentangles speaker and content representations with instance normalization.
result Model converts voices from unseen speakers with high similarity.
Graph neural networks improve MIL performance without losing interpretability.
problem Learning bag-level labels from bags of instances.
method Proposed a GNN-based algorithm treating bags as graphs to learn embeddings and predict labels.
result Achieves state-of-the-art performance on MIL datasets.
New framework analyzes why more negative samples improve self-supervised learning performance.
problem Inconsistency between theoretical degradation and empirical improvement of downstream supervised tasks with more negative samples.
method Coupon collector's problem framework to analyze self-supervised representation learning with more negative samples.
result Bound can implicitly incorporate supervised loss in self-supervised loss by increasing negative samples.
This paper explores the complexity of learning representations in contextual linear bandits.
problem Understanding the complexity of representation learning in contextual linear bandits.
method Systematic approach to representation learning in contextual linear bandits, focusing on instance-dependent perspective.
result Representation learning is fundamentally more complex than linear bandits, with some cases being arbitrarily harder.
Improved visual representation learning with conditional negative sampling.
problem Learning strong unsupervised visual representations using contrastive learning.
method Introduce a family of mutual information estimators that sample negatives conditionally.
result Improves accuracy by 2-5% points on four standard image datasets.
Paper proposes a new method for learning business process representations.
problem Challenges in capturing all useful information in business process data.
method Combines Gramian Angular Fields and Convolutional Neural Networks for representation learning.
result Demonstrates effectiveness of the approach through visualization and multiple process prediction tasks.
The instance segmentation problem intends to precisely detect and delineate objects in images. Most of the current solutions rely on deep convolutional neural networks but despite this fact proposed solutions are very diverse. Some solutions approach the problem as a network problem, where they use several networks or …
New method improves weakly-supervised action localization.
problem Locating action segments in videos with limited labels.
method Explicitly models key instance assignment as hidden variable using EM framework.
result Achieves state-of-the-art performance on THUMOS14 and ActivityNet1.2 benchmarks.
New mutual information framework improves contrastive learning for vision tasks.
problem Maximizing mutual information for better unsupervised learning representations.
method Reformulated mutual information as a lower bound, introducing new negative sampling strategies.
result Improved representations outperform previous methods in various vision tasks.
Multiple instance learning (MIL) is concerned with learning from sets (bags) of objects (instances), where the individual instance labels are ambiguous. In this setting, supervised learning cannot be applied directly. Often, specialized MIL methods learn by making additional assumptions about the relationship of the ba…
This paper introduces a new feature learning technique based on error representation.
problem Learning high-level features for classification from diverse and imbalanced data.
method Inverse feature learning using error representation approach.
result Significantly better performance compared to state-of-the-art techniques.
Random Forest proximity measures for multi-view classification.
problem Combining multiple heterogeneous data views for classification.
method Building dissimilarity representations for each view, fusing them dynamically.
result Dynamic View Selection improves multi-view classification performance.
AMI-Net+ tackles medical diagnosis from incomplete, imbalanced data.
problem Medical diagnosis from incomplete and imbalanced data.
method AMI-Net+ uses multi-instance neural network with embedding, multi-head attention, and gated attention-based pooling. It also employs focal loss and self-adaptive multi-instance pooling.
result AMI-Net+ outperforms state-of-the-art models on real-world medical datasets.
M4L-JMF tackles multi-typed objects learning, improving on M3L.
problem Learning from multi-typed objects with diverse features and labels.
method Joint matrix factorization to encode and factorize multi-typed bags and their instances.
result M4L-JMF outperforms existing methods on benchmark datasets.
New method improves unsupervised feature learning for natural data.
problem Natural data's correlated and long-tail distribution challenges instance-level contrastive learning.
method Cross-level instance-group discrimination (CLD) to integrate between-instance similarity.
result CLD achieves new state-of-the-art performance on various datasets.
Graph kernels have recently emerged as a promising approach for tackling the graph similarity and learning tasks at the same time. In this paper, we propose a general framework for designing graph kernels. The proposed framework capitalizes on the well-known message passing scheme on graphs. The kernels derived from th…
New findings on mapping class groups and their subgroups in homological representations.
problem Understanding subgroups within mapping class groups through homological representations.
method Analyzing the Johnson filtration and finite covers of mapping class groups.
result No faithful homological representations of mapping class groups exist.
Improves algorithm selection for thousands of candidates using dyadic features.
problem Selecting the best algorithm from a large set of candidates for specific problems.
method Proposes extreme algorithm selection (XAS) with dyadic feature representation.
result Improves significantly over current state of the art in various metrics.
Dual explanation method using convex hulls and example-based vectors.
problem Local and global explanation of complex models.
method Dual representation of instances as convex combinations, generating new dual dataset, training linear surrogate model, computing feature importance.
result Effective example-based and local/global explanation of complex models.
A method to prevent image representation collapse through data-dependent augmentation.
problem Representation collapse due to image augmentations that damage information.
method Formalizing a stochastic encoding process with a tug-of-war between corruption and preserved information, using infoMax objective.
result Learning a data-dependent distribution of augmentations to avoid representation collapse.
FAIR method uses adversarial training to learn fair instance weights.
problem Reduces bias in machine learning predictions through fair instance weighting.
method Adversarial training to learn instance weighting function ensuring fair predictions.
result Demonstrates better trade-off between accuracy and fairness compared to other models.
A test assesses the calibration of set-based epistemic uncertainty representations.
problem Evaluating the accuracy of set-based representations of epistemic uncertainty in machine learning.
method Proposes a novel statistical test to determine if a convex combination of predictions is calibrated, allowing instance-level variability.
result Demonstrates the benefits of capturing instance-level variability on synthetic and real-world experiments.
The goal of unsupervised representation learning is to extract a new representation of data, such that solving many different tasks becomes easier. Existing methods typically focus on vectorized data and offer little support for relational data, which additionally describe relationships among instances. In this work we…
We obtain a branched spherical CR structure on the complement of the figure eight knot with a given holonomy representation (called rho_2). There are essentially two boundary unipotent representations from the complement of the figure eight knot into PU(2,1), we call them rho_1 and rho_2. We make explicit some fundamen…
The paper proposes a deep learning technique for structured and composable representations.
problem Learning structured and composable representations from input images and discrete labels.
method End-to-end deep learning to learn representations based on distance estimates between class label and contextual information.
result The representations have a clear structure allowing for class and environment decomposition.
One of the key challenges of performing label prediction over a data stream concerns with the emergence of instances belonging to unobserved class labels over time. Previously, this problem has been addressed by detecting such instances and using them for appropriate classifier adaptation. The fundamental aspect of a n…
SpecAE detects anomalies in attributed networks by projecting them into a tailored space.
problem Detecting anomalies in attributed networks with complex dependencies and nodal attributes.
method Spectral convolution and deconvolution framework, leveraging Laplacian sharpening and density estimation.
result SpecAE effectively detects global and community anomalies in attributed networks.