Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

4068131,2191,625 · Jun 202019922001200920172026
48 results for deep semi-supervised learning

Study investigates one-shot semi-supervised learning for image classification.

problem Training deep networks requires many labeled samples, limiting adoption.
method Empirical investigation of FixMatch method for one-shot semi-supervised learning.
result Uneven class accuracy is a barrier to high performance in one-shot semi-supervised learning.

Proposes a new method to learn distance metrics for semi-supervised learning.

problem Inconsistency between perturbed input sets and lack of pairwise relationship information.
method Metric Learning by Similarity Network (MLSN) co-training with a classification network to learn distance metrics adaptively.
result Performs better than state-of-the-art methods on empirical tasks.

Deep semi-supervised learning identifies tree species from natural images.

problem Identifying tree species in natural settings with limited labeled data.
method Two-fold approach using deep semi-supervised learning.
result Achieves 94.04% top-5 accuracy for leaves and 83.04% for bark.

Semi-supervised learning algorithms reduce the high cost of acquiring labeled training data by using both labeled and unlabeled data during learning. Deep Convolutional Networks (DCNs) have achieved great success in supervised tasks and as such have been widely employed in the semi-supervised learning. In this paper we…

2016-12-06abs ↗pdf ↗

The ever-increasing size of modern data sets combined with the difficulty of obtaining label information has made semi-supervised learning one of the problems of significant practical importance in modern data analysis. We revisit the approach to semi-supervised learning with generative models and develop new models th…

2014-06-20abs ↗pdf ↗

A new model improves semi-supervised learning for unstructured data.

problem Manual labeling of unstructured data is expensive, time-consuming, and prone to errors.
method Batch Semi-Supervised Self-Organizing Map (Batch SS-SOM) integrating deep learning techniques.
result Batch SS-SOM performs well in semi-supervised classification and clustering, even with few labeled samples.

FROST speeds up and stabilizes one-shot semi-supervised learning.

problem Slow training and sensitivity to labeled data choices in semi-supervised learning.
method Combines semi-supervised learning with a one-stage, single network self-training approach.
result FROST trains up to 10x faster and is more robust to labeled data choices.

This paper tackles high-dimensional uncertainty quantification with semi-supervised learning.

problem High-dimensional uncertainty quantification due to the curse of dimensionality.
method Autoencoder for dimension reduction, DFN for mapping and reconstruction, GP for surrogate modeling, semi-supervised learning for accuracy.
result The framework effectively reduces uncertainty quantification and reliability analysis for high-dimensional problems.

Paper formalizes continual semi-supervised anomaly detection, showing promising results.

problem Formalizing continual semi-supervised anomaly detection in real-world conditions.
method Baseline model of variational autoencoder (VAE) with deep generative replay and outlier rejection.
result Outlier rejection shows promising results, often surpassing baseline methods.

BOSS learns from one labeled sample per class to match fully supervised performance.

problem Achieving fully supervised performance with minimal labeled data.
method Combines class prototype refining, class balancing, and self-training.
result BOSS achieves comparable test accuracies to fully supervised learning.

Proposes a multimodal deep generative model for semi-supervised learning with class imbalance.

problem Class imbalance in semi-supervised learning with partial supervision.
method Separate encoders for each modality, sharing latent variables, and using Student's t-distributions for prior, encoder, and decoder.
result Outperforms baseline methods in generalization and classification performance for partially labeled multimodal data.

In emotion recognition, it is difficult to recognize human's emotional states using just a single modality. Besides, the annotation of physiological emotional data is particularly expensive. These two aspects make the building of effective emotion recognition model challenging. In this paper, we first build a multi-vie…

2017-04-25abs ↗pdf ↗

We exploit a recently derived inversion scheme for arbitrary deep neural networks to develop a new semi-supervised learning framework that applies to a wide range of systems and problems. The approach outperforms current state-of-the-art methods on MNIST reaching 99.14%99.14\% of test set accuracy while using 55 labeled e…

2017-11-12abs ↗pdf ↗

In this paper we consider the problem of semi-supervised learning with deep Convolutional Neural Networks (ConvNets). Semi-supervised learning is motivated on the observation that unlabeled data is cheap and can be used to improve the accuracy of classifiers. In this paper we propose an unsupervised regularization term…

2016-06-09abs ↗pdf ↗

Verification determines whether two samples belong to the same class or not, and has important applications such as face and fingerprint verification, where thousands or millions of categories are present but each category has scarce labeled examples, presenting two major challenges for existing deep learning models. W…

2017-06-12abs ↗pdf ↗

Improved neural topic model for semi-supervised learning.

problem Representing textual data in an interpretable manner with limited labeled data.
method Label-Indexed Neural Topic Model (LI-NTM) that combines deep generative models with semi-supervised learning.
result LI-NTM outperforms existing models in document reconstruction and classifier performance.

We introduce the SaaS Algorithm for semi-supervised learning, which uses learning speed during stochastic gradient descent in a deep neural network to measure the quality of an iterative estimate of the posterior probability of unknown labels. Training speed in supervised learning correlates strongly with the percentag…

2018-05-02abs ↗pdf ↗

Deep generative models parameterized by neural networks have recently achieved state-of-the-art performance in unsupervised and semi-supervised learning. We extend deep generative models with auxiliary variables which improves the variational approximation. The auxiliary variables leave the generative model unchanged b…

2016-02-17abs ↗pdf ↗

JRFs improve semi-supervised learning by balancing generation and classification.

problem Mode missing and mode covering issues in GANs and VAEs, and conflict between good classification and generation.
method Joint-stochastic-approximation random fields (JRFs) for deep undirected generative models.
result JRFs achieve good classification and generation results in SSL.

New JSA autoencoders tackle discrete latent variable models for semi-supervised learning.

problem Handling discrete observations and latent codes in deep generative models.
method Joint-stochastic-approximation (JSA) autoencoders that directly maximize data log-likelihood and minimize KL divergence.
result JSA autoencoders achieve comparable performance to continuous latent space models in semi-supervised tasks.

Study compares semi-supervised learning methods for anomaly detection in hydraulic systems.

problem Challenges in anomaly detection for hydraulic systems due to scarce labeled data.
method Compared various semi-supervised learning methods including traditional models and deep neural networks.
result Customized extreme learning machine (HELM) model achieved state-of-the-art performance.

Deep generative models (DGMs) are effective on learning multilayered representations of complex data and performing inference of input data by exploring the generative ability. However, it is relatively insufficient to empower the discriminative ability of DGMs on making accurate predictions. This paper presents max-ma…

2016-11-22abs ↗pdf ↗

We introduce a simple permutation equivariant layer for deep learning with set structure.This type of layer, obtained by parameter-sharing, has a simple implementation and linear-time complexity in the size of each set. We use deep permutation-invariant networks to perform point-could classification and MNIST-digit sum…

2016-11-14abs ↗pdf ↗

SDORE uses neural networks to estimate regression functions and their gradients, even with limited labeled data.

problem Nonparametric estimation of regression functions and their gradients.
method Semi-supervised deep ReQU neural networks with gradient norm regularization.
result Achieves minimax optimal convergence rates in L2L^{2}-norm and plug-in gradient estimator convergence.

Simplifies transfer learning with deep neural networks using ridge regression.

problem High computational cost of finetuning deep models for transfer learning.
method Leverage the low-rank property of deep neural networks' feature vectors in kernel ridge regression.
result Successful on supervised and semi-supervised transfer learning tasks.

In several domains obtaining class annotations is expensive while at the same time unlabelled data are abundant. While most semi-supervised approaches enforce restrictive assumptions on the data distribution, recent work has managed to learn semi-supervised models in a non-restrictive regime. However, so far such appro…

2017-10-10abs ↗pdf ↗

Deep semi-supervised anomaly detection improves fraud detection in financial markets.

problem Detecting fraud in high-frequency financial data with limited labeled examples.
method Evaluation of Deep Semi-Supervised Anomaly Detection (Deep SAD) on proprietary limit order book data.
result Deep SAD significantly improves fraud detection accuracy with minimal labeled data.

GraphXCOVID uses deep semi-supervised learning to identify COVID-19 from chest X-rays with minimal labels.

problem Identifying COVID-19 on chest X-rays with limited labelled data.
method Graph-based deep semi-supervised framework with pseudo-labeling and attention maps.
result Outperforms current supervised models with a tiny fraction of labelled examples.

This work tackles continual learning with semi-supervised data, showing that even with minimal labeled data, performance can match full-supervised methods.

problem Training deep networks on a stream of tasks without forgetting, especially when labeled data is scarce.
method Designing a novel CSSL method that leverages metric learning and consistency regularization to learn from both labeled and unlabeled data.
result Our method outperforms state-of-the-art methods trained with full supervision, achieving comparable performance with only 25% labeled data.

A new framework for semi-supervised learning using pseudo-representation labeling.

problem Improving deep learning models with limited labeled data.
method Pseudo-representation labeling framework integrating pseudo-labeling and self-supervised representation learning.
result Outperforms state-of-the-art semi-supervised learning methods in industrial classification problems.

COMBO network improves optical flow estimation by combining deep learning with brightness constancy.

problem Optical flow estimation using deep learning requires complex training schemes.
method COMBO network explicitly exploits brightness constancy and combines it with a data-driven approach.
result COMBO network outperforms state-of-the-art methods on various benchmarks.

MixMOOD improves SSDL by selecting unlabelled data based on deep feature similarity.

problem Class distribution mismatch in semi-supervised learning.
method MixMOOD uses deep dataset dissimilarity measures to select unlabelled data.
result MixMOOD selects unlabelled data based on strong correlation with MixMatch accuracy.

DS2CF-Net learns hierarchical representations with deep coupled factorization and enriched prior.

problem Learning deep hierarchical representations from data.
method Dual-constrained Deep Semi-Supervised Coupled Factorization Network (DS2CF-Net) with enriched prior.
result DS2CF-Net achieves state-of-the-art performance in representation learning and clustering.

New framework improves generative models with prediction and consistency constraints.

problem Improving generative models with sparse labeled data.
method Optimizes variational autoencoders with prediction and consistency constraints.
result Promising image classification performance, especially in semi-supervised scenarios.