A new framework decouples instance representation learning from subject-level supervision in EEG-based disease diagnosis.
problem Inherently assigning subject labels to all instances in EEG-based disease diagnosis leads to unreliable representations.
method BridgeMIL, a two-stage framework that pretrains an encoder without inherited instance labels and then applies subject-level supervision.
result BridgeMIL achieves the highest mean accuracy in 14 of 15 dataset-backbone settings, with an overall mean accuracy of 76.57%.
Machine learning techniques have gained prominence for the analysis of resting-state functional Magnetic Resonance Imaging (rs-fMRI) data. Here, we present an overview of various unsupervised and supervised machine learning applications to rs-fMRI. We present a methodical taxonomy of machine learning methods in resting…
Tree-based model averaging improves CATE estimation from diverse sites.
problem Limited sample size and privacy concerns prevent accurate personalized treatment effect estimation.
method Tree-based model averaging approach to estimate CATEs from multiple heterogeneous sites.
result Improved accuracy in estimating conditional average treatment effects (CATEs) across sites.
Proposes a method to cluster fMRI data and estimate brain connectivity networks.
problem Clustering fMRI data to identify patient groups based on brain connectivity.
method Random covariance clustering model (RCCM) to cluster subjects and estimate individual and shared FC networks.
result RCCM outperforms other methods in clustering and FC network estimation, demonstrated through simulations and real data.
CRBM generates digital twins for MS patients, aiding in disease progression analysis.
problem Characterizing and analyzing disease progression in MS patients.
method Unsupervised machine learning with Conditional Restricted Boltzmann Machines (CRBMs).
result Generated digital twins are statistically indistinguishable from actual subjects.
Proposes a method for valid inference in GPLSIMs with longitudinal data.
problem Challenges in longitudinal data inference due to within-subject correlation and unstable variance estimation.
method Profile estimating-equation approach using spline approximation and block empirical likelihood.
result Block empirical likelihood ratio statistic with Wilks-type chi-square limit for joint inference.
Paper adapts CVS method for TL in functional linear regression.
problem Improving estimation and prediction in scalar-on-function regression.
method Adapts control variates method for transfer learning.
result Establishes theoretical connection between O-TL and CVS-based TL.
Study compares neural and statistical models for Parkinson's disease progression from voice data.
problem Difficult statistical analysis of longitudinal voice biomarkers due to subject correlation, small cohorts, and varied disease trajectories.
method Evaluated Neural Mixed Effects (NME), Generalized Neural Network Mixed Models (GNMMs), and semi-parametric Generalized Additive Mixed Models (GAMMs).
result GAMMs achieve stronger predictive performance and retain interpretable smooth effects and subject-level structure.
Spontaneous brain activity, as observed in functional neuroimaging, has been shown to display reproducible structure that expresses brain architecture and carries markers of brain pathologies. An important view of modern neuroscience is that such large-scale structure of coherent activity reflects modularity properties…
The paper develops a method to optimize individualized treatment rules for cost-effectiveness.
problem Developing cost-effective individualized treatment rules for healthcare policy.
method Using conditional random forest and net-monetary-benefit (NMB) to estimate optimal CE-ITR.
result The approach optimizes healthcare resource allocation by maximizing health gains and minimizing costs.
Selective inference improves multi-task neuroimaging analysis.
problem Improving predictive performance and modeling accuracy in neuroimaging studies.
method Proposes a framework for selective inference to jointly identify relevant covariates and conduct valid inference in a sparsity-inducing model.
result Selective inference yields tighter confidence intervals and more accurate signal recovery than single-task methods.
LLmFPCA-detect detects anomalies in sparse longitudinal text data using LLMs and mFPCA.
problem Challenges in detecting patterns and anomalies in sparse longitudinal textual data.
method Pairs LLM-based text embeddings with mFPCA to detect clusters and anomalies.
result LLmFPCA-detect outperforms state-of-the-art baselines on Amazon and Wikipedia datasets.
A novel validation method improves feature importance analysis in subject-specific ML models.
problem Limited effectiveness of general ML models trained on large datasets for individual patient outcomes.
method A novel validation approach using a general ML model with repeated trials and random seed variation.
result Consistent identification of key features at the subject level and improved group-level feature importance analysis.
SupSiam and SupBYOL improve supervised representation learning with ANCL.
problem Improving supervised representation learning with ANCL.
method Proposed supervised ANCL framework leveraging labels to avoid collapse.
result Supervised ANCL improves representation learning across various datasets and tasks.
S4 learns new self-supervision automatically, improving accuracy with less human effort.
problem Lack of direct supervision in machine learning.
method Combines deep learning and probabilistic logic to automatically generate and verify new self-supervision.
result S4 can automatically propose accurate self-supervision, matching supervised methods with less human effort.
Self-supervised regularization improves semi-supervised learning performance without requiring unlabeled data.
problem Improving semi-supervised learning performance with limited labeled data.
method Introducing self-supervised regularization as a new approach to combine unlabeled data features.
result Self-supervised regularization significantly improves semi-supervised performance on image classification benchmarks.
Self-supervised learning enhances model robustness and uncertainty.
problem Improving model robustness and uncertainty estimation.
method Self-supervised learning without requiring labels.
result Self-supervised learning improves robustness to adversarial examples, label corruption, and input corruptions.
Study shows semi-supervised learning improves human activity recognition with minimal user input.
problem Improving human activity recognition models using incremental learning.
method Three approaches: non-supervised, semi-supervised, and supervised learning were compared.
result Semi-supervised learning achieves similar accuracy to supervised learning with minimal user input.
Unified VAE framework improves unsupervised, semi-supervised, and supervised learning.
problem Improving performance in learning tasks with limited labeled data.
method A VAE with a classification layer connected to the encoder and combined with the latent layer for the decoder, supplemented with a supervised loss for labeled data.
result The approach outperforms direct supervised setups and boosts unsupervised tasks with unlabeled data.
Paper analyzes if GANs with adversarial features outperform standard supervised learning.
problem Whether adversarial features improve performance over standard supervised learning.
method Theoretical analysis and empirical risk comparison.
result Supervised learning with adversarial features can outperform sole supervision under certain conditions.
Improves label propagation for weakly supervised learning.
problem Reducing the need for labeled data in machine learning.
method Label Propagation with Weak Supervision (LPA) analysis.
result Demonstrated improvements over existing methods on weakly supervised classification tasks.
Paper proposes an algorithm to recover full supervision from weakly labeled data.
problem Machine learning requires expensive data annotation, motivating the use of weak supervision.
method The paper introduces a disambiguation principle and an empirical disambiguation algorithm for partial labelling.
result The algorithm achieves exponential convergence rates under learnability assumptions.
Self-supervised attention model improves weakly labeled audio event classification.
problem Efficiently classify audio events with minimal labeled data.
method Develops a self-supervised attention model for weakly labeled audio clips.
result Self-supervised attention model performs comparably to strongly supervised model trained with strong labels.
The scarcity of data annotated at the desired level of granularity is a recurring issue in many applications. Significant amounts of effort have been devoted to developing weakly supervised methods tailored to each individual setting, which are often carefully designed to take advantage of the particular properties of …
Boosts few-shot learning with self-supervised representations.
problem Improving generalization on small labeled datasets.
method Introduces self-supervised tasks as auxiliary loss functions.
result Reduces relative error rate by 5-25% on few-shot learning benchmarks.
Traditionally, there are three species of classification: unsupervised, supervised, and semi-supervised. Supervised and semi-supervised classification differ by whether or not weight is given to unlabelled observations in the classification procedure. In unsupervised classification, or clustering, all observations are …
Proposes a constrained labeling method for weakly supervised learning.
problem Combining weak supervision signals while navigating misleading correlations.
method Randomized constrained labeling within a defined space.
result Randomized constrained labeling converges after few iterations and outperforms other methods.
Self-supervised and supervised methods learn similar intermediate visual representations but diverge in final layers.
problem Comparing self-supervised and supervised methods for visual learning.
method Comparison of contrastive self-supervised and supervised methods on simple image data.
result Contrastive and supervised methods learn similar intermediate representations but diverge in final layers.
Improved VAE learns disentangled representations with less supervision.
problem Learning disentangled representations is challenging.
method Semi-supervised disentanglement learning with label replacement.
result Significant improvement in disentanglement with minimal supervision.
Paper develops methods for semi-supervised Fréchet regression.
problem High costs of obtaining non-Euclidean labels.
method Proposes semi-supervised NW Fréchet regression and semi-supervised kNN Fréchet regression.
result Demonstrates superior performance over supervised methods.
Paper resolves the debate on process vs. outcome supervision in reinforcement learning.
problem Distinguishing between process and outcome supervision in reinforcement learning.
method Developed a technical tool (Change of Trajectory Measure Lemma) to show equivalence between outcome and process supervision under standard data coverage assumptions.
result Reinforcement learning through outcome supervision is statistically equivalent to process supervision, up to polynomial factors in horizon.
Optimal and safe semi-supervised learning estimator for high-dimensional data.
problem Improving regression parameter estimation with unlabeled data in high-dimensional settings.
method Established minimax lower bound, proposed optimal and safe semi-supervised estimators.
result Optimal semi-supervised estimator achieves the minimax lower bound.
Survey of self-supervised learning methods in computer vision, NLP, and graph learning.
problem Manual labeling and vulnerability to attacks in supervised learning.
method Generative, contrastive, and generative-contrastive approaches.
result Self-supervised learning achieves high performance in representation learning.
Improved self-supervised learning for document images.
problem Performance of self-supervised pre-training on document images is poor.
method Proposed context-aware alternatives and a novel multi-modal method.
result Novel method outperforms other self-supervised methods on document image classification.
Weak supervision challenges black-box models, suggesting fusion of modeling cultures.
problem Challenges of strong supervision in achieving accurate predictions.
method Integrating data modeling into algorithmic modeling for weak supervision.
result Integration of data modeling culture improves model stability and accuracy.
Proposes a framework for semi-supervised continual learning from sequentially arriving data.
problem Learning from data with changing task distribution over time, especially in domains with a mix of labeled and unlabeled data.
method Meta-Consolidation for Continual Semi-Supervised Learning (MCSSL) framework with a hypernetwork and semi-supervised auxiliary classifier.
result Significant improvements in continual semi-supervised learning setting.
Unified framework for semi-supervised learning reduces annotation needs.
problem Sparse annotations and large amounts of unlabeled data in computational pathology.
method S5CL integrates fully-supervised, self-supervised, and semi-supervised learning through hierarchical contrastive losses.
result S5CL improves accuracy and F1-score in histopathological datasets with sparse labels.
Self-supervision improves GCNs' generalizability and robustness.
problem Improving graph convolutional networks' performance.
method Three mechanisms of self-supervision, multi-task learning, and graph adversarial training.
result Self-supervision enhances GCNs' robustness and generalizability.
The paper explores how supervision level affects both statistical accuracy and computational efficiency in weakly supervised binary classification.
problem The impact of label flip probability on statistical and computational efficiency in weakly supervised binary classification.
method Information-theoretic and computational boundaries were established to characterize the relationship between supervision level and performance.
result The gap between statistical and computational boundaries narrows as the supervision level increases, indicating improved computational efficiency with more supervision.
For semi-supervised techniques to be applied safely in practice we at least want methods to outperform their supervised counterparts. We study this question for classification using the well-known quadratic surrogate loss function. Using a projection of the supervised estimate onto a set of constraints imposed by the u…
The paper argues all machine learning is supervised, challenging the term 'unsupervised learning'.
problem The categorization of machine learning as supervised vs unsupervised is misleading.
method Analyzes clustering and dimensionality reduction algorithms to argue they are internally supervised.
result All machine learning is internally supervised, challenging the term 'unsupervised learning'.
Hashing has been widely used for large-scale approximate nearest neighbor search because of its storage and search efficiency. Recent work has found that deep supervised hashing can significantly outperform non-deep supervised hashing in many applications. However, most existing deep supervised hashing methods adopt a …
A new SS-SOM method combines unlabeled and labeled data for clustering and classification.
problem Combining unlabeled and labeled data for clustering and classification in high-dimensional datasets.
method Semi-Supervised Self-Organizing Map (SS-SOM) that dynamically switches between supervised and unsupervised learning.
result SS-SOM outperforms other methods in low-labeled sample conditions and achieves good results with all labeled samples.
New framework analyzes why more negative samples improve self-supervised learning performance.
problem Inconsistency between theoretical degradation and empirical improvement of downstream supervised tasks with more negative samples.
method Coupon collector's problem framework to analyze self-supervised representation learning with more negative samples.
result Bound can implicitly incorporate supervised loss in self-supervised loss by increasing negative samples.
Maximizing the area under the receiver operating characteristic curve (AUC) is a standard approach to imbalanced classification. So far, various supervised AUC optimization methods have been developed and they are also extended to semi-supervised scenarios to cope with small sample problems. However, existing semi-supe…
A method for collecting human supervision that combines rules and instance labels.
problem Lack of labeled data and inefficient human supervision.
method Rule-exemplar method with training algorithm for joint denoising and model training.
result Our algorithm is more accurate than existing methods and effectively denoises rules.
PLRM synthesizes labels from mismatched sources for better training sets.
problem Creating labeled training sets is a major challenge in machine learning.
method PLRM uses probabilistic modeling to synthesize labels from indirect supervision sources with different output spaces.
result PLRM outperforms baselines by 2%-9% on various tasks.
Generative models enhance weak supervision for better image classification.
problem Lack of labeled data in supervised learning.
method Fusion of generative adversarial networks and weak supervision.
result Model improves multiclass image classification performance.