The paper analyzes the complexity of sparse label propagation on networks.
problem Computational complexity of sparse label propagation on network data.
method Characterization of iterations for achieving a prescribed accuracy using a first-order oracle model.
result An upper bound on iterations required for accuracy, showing sharpness for chain structures.
New method estimates graph compatibility from sparse labels.
problem Estimating graph compatibility from sparse labeled data.
method Factorized graph representations and algebraic amplification.
result End-to-end classification accuracy comparable to gold standard.
This work proposes a novel method for semi-supervised learning from partially labeled massive network-structured datasets, i.e., big data over networks. We model the underlying hypothesis, which relates data points to labels, as a graph signal, defined over some graph (network) structure intrinsic to the dataset. Follo…
Visual reranking is effective to improve the performance of the text-based video search. However, existing reranking algorithms can only achieve limited improvement because of the well-known semantic gap between low level visual features and high level semantic concepts. In this paper, we adopt interactive video search…
New method uses GNNs and node feature propagation for active learning in graph node classification.
problem Lack of labeled data for graph neural networks.
method Node feature propagation followed by K-Medoids clustering for instance selection.
result Proposed method significantly outperforms other methods on benchmark datasets.
Unified model combines feature and label propagation for semi-supervised classification.
problem Combining feature and label propagation for effective semi-supervised classification.
method Unified Message Passing Model (UniMP) using Graph Transformer and masked label prediction.
result Obtains new state-of-the-art results in Open Graph Benchmark (OGB).
Decoupled GCN is shown to be equivalent to label propagation.
problem Improving semi-supervised node classification in graph learning.
method The paper proves the equivalence of decoupled GCN and label propagation, and proposes a new method named PTA.
result Decoupled GCN is equivalent to two-step label propagation and can automatically assign weights to pseudo-labels.
Proposes a method to propagate uncertainty in neural networks for sparse coding.
problem Uncertainty in neural networks for sparse coding.
method Representing the target vector as a spike and slab distribution at each layer, deriving gradients of normalisation constants, and using Bayesian inference.
result Designs a novel Bayesian neural network for sparse coding.
DiAL uses Bayesian Dirichlet random fields for active learning with sparse labels.
problem Active learning with limited labeled data.
method Bayesian Dirichlet random field for feature-conditional class probabilities, calibrating with graph Laplacian.
result Competitive performance in low-label rate graph learning tasks.
Propagates soft labels on hypergraphs using optimal transportation.
problem Semi-supervised learning on hypergraphs.
method Wasserstein barycenters and message-passing algorithm.
result Generalization error bounds for 2-Wasserstein distance.
Improved accuracy in community detection with vertex labels.
problem Efficient inference in stochastic block models with vertex labels.
method Linearized belief propagation algorithm with vertex labels.
result Belief propagation achieves highest accuracy when a function of network parameters has a unique fixed point.
Improved diffusion map enhances manifold regularization for semi-supervised learning.
problem Limited performance of manifold regularization models in capturing global structure.
method Enhanced diffusion map with improved label propagation function.
result Proposed method improves manifold regularization model's performance.
There has been a recent interest in understanding the power of local algorithms for optimization and inference problems on sparse graphs. Gamarnik and Sudan (2014) showed that local algorithms are weaker than global algorithms for finding large independent sets in sparse random regular graphs. Montanari (2015) showed t…
Improves label propagation for weakly supervised learning.
problem Reducing the need for labeled data in machine learning.
method Label Propagation with Weak Supervision (LPA) analysis.
result Demonstrated improvements over existing methods on weakly supervised classification tasks.
New method learns compressed sensing matrix exploiting data structure.
problem Missing structure beyond sparsity in data.
method Gradient unrolling to learn a compressed sensing measurement matrix.
result Significantly fewer measurements for excellent reconstructions.
Unified model combines GCN and LPA for better node classification.
problem Combining GCN and LPA for improved node classification.
method Unified model that unifies GCN and LPA, learns edge weights and attention weights.
result Unified model outperforms state-of-the-art GCN-based methods in node classification accuracy.
TPN learns to propagate labels for few-shot learning.
problem Few-shot learning with limited training instances per class.
method Transductive Propagation Network (TPN) learns to propagate labels from labeled to unlabeled instances.
result TPN achieves state-of-the-art results on multiple benchmark datasets.
A new method improves label propagation for unsupervised domain adaptation.
problem Improving unsupervised domain adaptation through semi-supervised learning techniques.
method Label Propagation with Augmented Anchors (A2LP) for UDA. result A2LP improves over representative UDA methods and benchmarks. We introduce propagation kernels, a general graph-kernel framework for efficiently measuring the similarity of structured data. Propagation kernels are based on monitoring how information spreads through a set of given graphs. They leverage early-stage distributions from propagation schemes such as random walks to capt…
Simplified interactive image segmentation using kNN graphs.
problem Interactive image segmentation with user-provided labels.
method Undirected kNN graphs for label propagation.
result Effective interactive segmentation with significant accuracy.
Proposes a label propagation framework for domain adaptation.
problem Subpopulation shift in machine learning domains.
method Label propagation based on a teacher classifier trained on source domain.
result End-to-end finite-sample guarantees on domain adaptation algorithm.
This paper introduces PM and PMLP to enhance SSL by considering probability density and cluster assumptions.
problem Insufficient utilization of unlabeled data in SSL.
method Introduces PM to discern similarity and PMLP to consider cluster assumption in label propagation.
result PMLP outperforms other methods in SSL tasks.
Paper introduces MNNs for efficient neural network training.
problem Training large-scale sparse neural networks efficiently.
method Formal derivation of MNN architecture with forward-only gradient propagation.
result MNNs can efficiently compute gradients without backward computation.
Sparse coding approximates the data sample as a sparse linear combination of some basic codewords and uses the sparse codes as new presentations. In this paper, we investigate learning discriminative sparse codes by sparse coding in a semi-supervised manner, where only a few training samples are labeled. By using the m…
Graph-based Bayesian SSL uses graph theory to propagate labels from a few to many unlabeled features.
problem Efficiently propagating labels from a small set of labeled data to a large set of unlabeled data.
method Probabilistic framework using graph theory and Bayesian statistics.
result Mathematical foundations for improving the accuracy and efficiency of label propagation.
We tackle the problem of inferring node labels in a partially labeled graph where each node in the graph has multiple label types and each label type has a large number of possible labels. Our primary example, and the focus of this paper, is the joint inference of label types such as hometown, current city, and employe…
Gaussian processes (GPs) provide a nonparametric representation of functions. However, classical GP inference suffers from high computational cost and it is difficult to design nonstationary GP priors in practice. In this paper, we propose a sparse Gaussian process model, EigenGP, based on the Karhunen-Loeve (KL) expan…
Proposes a new method to estimate individual treatment effects using unlabeled data.
problem Difficult estimation of individual treatment effects due to high costs of intervention studies.
method Combines causal inference matching and semi-supervised learning label propagation.
result Demonstrates successful mitigation of data scarcity in ITE estimation.
Whereas CNNs have demonstrated immense progress in many vision problems, they suffer from a dependence on monumental amounts of labeled training data. On the other hand, dictionary learning does not scale to the size of problems that CNNs can handle, despite being very effective at low-level vision tasks such as denois…
Two active learning algorithms improve HSI classification using Fermat distances and harmonic label propagation.
problem Semi-supervised hyperspectral image classification with limited labeled data.
method Combines Fermat distances with Poisson-reweighted harmonic label propagation for active point selection.
result FALL and A-FALL algorithms enhance labeling accuracy and scalability for large HSI scenes.
Efficient graph-based algorithm for learning from bagged data.
problem Learning from bagged data with label proportions.
method Graph-based algorithm encouraging local smoothness and exploiting global structure.
result Preserves the mass of each bag while recovering true labels.
Proposes a method to align and differentiate feature clusters for unsupervised domain adaptation.
problem Difficulty in obtaining labeled data for domain adaptation.
method Label propagation and cycle consistency to align feature clusters.
result Successfully formed aligned and discriminative clusters for better domain adaptation.
Proposes an alternative approach to propagate labels in GCNs using network diffusion and clustering.
problem Challenges of training GCNs with limited labeled data and bias in network diffusion methods.
method Clustering nodes into communities, using diffusion to quantify proximity, and comparing topological profiles.
result Identifies nodes most similar to labeled nodes, improving label propagation in GCNs.
pRSL combines probabilistic rules to improve multi-label classification.
problem Modeling the structure between multi-label classes for better performance.
method Uses probabilistic propositional logic rules and belief propagation to combine predictions from multiple classifiers.
result pRSL achieves state-of-the-art performance on various benchmark datasets.
Contrastive regularization improves semi-supervised learning by better propagating confident pseudo-labels.
problem Consistency regularization's limitation in high performance and efficiency.
method Proposes contrastive regularization to update model features, pushing confident labels into unlabeled samples.
result Improves semi-supervised learning tasks with fewer training iterations and robust performance.
PPN learns from weakly-labeled data to improve few-shot learning.
problem Few-shot learning with limited labeled data.
method Prototype Propagation Network (PPN) trained on few-shot tasks with coarse-label data.
result PPN significantly outperforms other methods on benchmarks.
Improves NILM with multi-label SRC, outperforming state-of-the-art.
problem Non-intrusive load monitoring (NILM) for energy disaggregation.
method Modified multi-label sparse representation based classification (SRC).
result Significant improvement over state-of-the-art techniques with minimal training data.
Proposes LMSSC for multi-view semi-supervised classification.
problem Leveraging multiple complementary views for improved classification.
method Semi-supervised classification with latent multi-view representation learning.
result Unified framework for latent representation learning, graph construction, and label propagation.
KGNN-LS improves recommender systems using knowledge graphs and label smoothness.
problem Improving recommender systems through better user-item embeddings.
method KGNN-LS combines knowledge graphs, user-specific embeddings, and label smoothness regularization.
result KGNN-LS outperforms state-of-the-art baselines and handles cold-start scenarios.
New method finds sparse networks without labels, improving performance.
problem Sparse connectivity in neural networks to reduce memory and energy demands.
method Neural Tangent Transfer method to find sparse networks without labels.
result Sparse networks achieve higher classification performance and faster convergence.
Bayesian method for feature selection with grouping info using expectation propagation.
problem Feature selection with grouping info and sparsity constraints.
method Sparse-group Bayesian feature selection using expectation propagation.
result Our method outperforms existing methods in terms of feature selection accuracy and computational efficiency.
A new method improves graph-based semi-supervised classification by removing noise and mixed signs.
problem Inaccurate soft labels and noise in graph-based semi-supervised classification.
method Triple-matrix-recovery-based robust auto-weighted label propagation framework (ALP-TMR).
result Improved robustness to noise and outliers in label estimation.
Graph filtering framework improves semi-supervised learning efficiency.
problem Efficiently leverage unlabeled data with limited labeled data.
method Graph filtering to inject graph similarity into data features.
result Unified insights and improved modeling capabilities of label propagation and graph convolutional networks.
HERA improves PLL by integrating heterogeneous loss and sparse-low-rank regularization.
problem Learning from data with partial labels.
method Combines heterogeneous loss and sparse-low-rank regularization.
result Achieves superior performance on artificial and real-world data.
Paper proposes a method to recover accurate labels from partially valid data in multi-label learning.
problem Tackles noisy supervision in multi-label learning with partially valid labels.
method Develops a two-stage method that estimates label enrichment and ground-truth confidences.
result Demonstrates improved performance over state-of-the-art PML methods.
Mutual teaching improves graph models with less labeled data.
problem Training graph models with limited labeled data.
method Dual model training with mutual teaching strategy.
result Significant performance improvement with less labeled data.
Paper introduces a new framework for spatio-temporal structured sparse regression.
problem Reconstructing spatio-temporal evolving patterns with high accuracy.
method Hierarchical Gaussian process with expectation propagation for online and offline Bayesian inference.
result 15% improvement in F-measure compared to existing methods.
Crowdsourcing systems are popular for solving large-scale labelling tasks with low-paid workers. We study the problem of recovering the true labels from the possibly erroneous crowdsourced labels under the popular Dawid-Skene model. To address this inference problem, several algorithms have recently been proposed, but …