Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

265278104 · Jun 202019922001200920172026
48 results for unlabeled mixtures

Identifying components and estimating mixing weights in unlabeled finite mixtures under marginal independence.

problem Identifying components and estimating mixing weights in unlabeled finite mixtures.
method Proving structural results and extending them to observable mixtures.
result Identifying components and estimating mixing weights under marginal independence.

Semi-supervised learning can't outperform supervised learning for 2-Gaussian mixture models.

problem Can semi-supervised learning algorithms improve over supervised learning?
method Deriving a tight lower bound for 2-Gaussian mixture models.
result No SSL algorithm can improve upon the minimax-optimal statistical error rates of supervised or unsupervised learning for these distributions.

ETM models improve efficiency in semi-supervised logistic regression.

problem Improving efficiency in logistic regression with limited labeled data.
method Developed exponential tilt mixture (ETM) models for semi-supervised estimation.
result ETM-based estimation demonstrates improved efficiency over supervised logistic regression.

A new method identifies sub-populations in unlabelled heterogeneous data by accounting for co-features.

problem Estimating sub-populations in unlabelled heterogeneous data with co-features.
method Mixture of Conditional Gaussian Graphical Models (CGGM) with penalized EM algorithm.
result The method successfully identifies sub-populations disrupted by co-features.

Framework uses unlabeled out-of-domain data to improve semi-supervised classification.

problem Improving generalization in semi-supervised classification problems.
method Combines Distributionally Robust Optimization (DRO) with self-supervised training.
result Significant improvement in generalization error compared to ERM.

Semi-supervised EM improves convergence rate with labeled samples.

problem Improving convergence rate in EM algorithm with labeled and unlabeled data.
method Analysis of semi-supervised EM algorithm for Gaussian mixture models.
result Labeled samples significantly improve the convergence rate for the EM algorithm.

The paper proposes methods to estimate positive examples and learn classifiers from mixed data.

problem Estimating the proportion of positive examples and learning classifiers from a mixture of positive and unlabeled data.
method Best Bin Estimation (BBE) for Mixture Proportion Estimation and Conditional Value Ignoring Risk (CVIR) for PU-learning.
result The proposed methods significantly improve both mixture proportion estimation and classifier learning.

We propose infinite mixture prototypes to adaptively represent both simple and complex data distributions for few-shot learning. Our infinite mixture prototypes represent each class by a set of clusters, unlike existing prototypical methods that represent each class by a single cluster. By inferring the number of clust…

2019-02-12abs ↗pdf ↗

Traditionally, there are three species of classification: unsupervised, supervised, and semi-supervised. Supervised and semi-supervised classification differ by whether or not weight is given to unlabelled observations in the classification procedure. In unsupervised classification, or clustering, all observations are …

2013-07-13abs ↗pdf ↗

We consider the problem of estimating the class prior in an unlabeled dataset. Under the assumption that an additional labeled dataset is available, the class prior can be estimated by fitting a mixture of class-wise data distributions to the unlabeled data distribution. However, in practice, such an additional labeled…

2016-11-05abs ↗pdf ↗

Meta-learning neural networks for better clustering representations.

problem Improving clustering performance with appropriate representations.
method Meta-learning method that trains neural networks for representations using VB inference with an infinite Gaussian mixture model.
result The method achieves higher clustering performance than existing methods.

Semi-supervised learning algorithms reduce the high cost of acquiring labeled training data by using both labeled and unlabeled data during learning. Deep Convolutional Networks (DCNs) have achieved great success in supervised tasks and as such have been widely employed in the semi-supervised learning. In this paper we…

2016-12-06abs ↗pdf ↗

Neural network robustness has recently been highlighted by the existence of adversarial examples. Many previous works show that the learned networks do not perform well on perturbed test data, and significantly more labeled data is required to achieve adversarially robust generalization. In this paper, we theoretically…

2019-06-03abs ↗pdf ↗

Algorithm learns mixtures of Markov chains and MDPs from short trajectories.

problem Learning mixtures of Markov chains and MDPs from short unlabeled trajectories.
method Subspace estimation, spectral clustering, EM algorithm, model estimation, classification.
result 96.6% average accuracy on a mixture of two MDPs in gridworld, outperforming EM algorithm with random initialization.

Mixture proportion estimation (MPE) is the problem of estimating the weight of a component distribution in a mixture, given samples from the mixture and component. This problem constitutes a key part in many "weakly supervised learning" problems like learning with positive and unlabelled samples, learning with label no…

2016-03-08abs ↗pdf ↗

Paper analyzes high-dimensional GMM for SSL, showing RMLE near-optimal performance.

problem Understanding when and why SSL works well with unlabeled data.
method Message-passing and state evolution methods for high-dimensional settings.
result RMLE achieves near-optimal performance in estimation and prediction with appropriate regularization.

Paper proposes a method to efficiently cluster stretched mixtures.

problem Clustering stretched elliptical mixtures using standard methods like PCA and k-means fails.
method Proposes a non-convex program to transform data into a one-dimensional point cloud.
result Efficient first-order algorithm achieves near-optimal statistical precision.

Transformers can cluster data from Gaussian mixtures without supervision.

problem Clustering data from Gaussian mixtures without labeled data.
method Theoretical analysis of attention-based layers, focusing on a simplified two-head attention layer and an identity matrix attention layer.
result Attention-based layers can align with true mixture centroids and adapt to input-specific distributions.

SSLfmm package improves semi-supervised learning by incorporating informative missingness in finite mixture models.

problem Improving semi-supervised learning with informative missingness in datasets.
method Estimates Bayes' classifier under a finite mixture model with MCAR and MAR missingness mechanisms.
result The classifier trained on partially labelled data can achieve lower misclassification rates than supervised methods.

The problem of developing binary classifiers from positive and unlabeled data is often encountered in machine learning. A common requirement in this setting is to approximate posterior probabilities of positive and negative classes for a previously unseen data point. This problem can be decomposed into two steps: (i) t…

2016-01-08abs ↗pdf ↗

The Expectation-Maximization (EM) algorithm is a fundamental tool in unsupervised machine learning. It is often used as an efficient way to solve Maximum Likelihood (ML) estimation problems, especially for models with latent variables. It is also the algorithm of choice to fit mixture models: generative models that rep…

2019-08-19abs ↗pdf ↗

This research improves asset life prediction by integrating deep learning with mixture distributions.

problem Predicting residual useful life for assets with multiple failure modes.
method Integrates mixture (log)-location-scale distribution with deep learning.
result Proposed models outperform existing methods in predicting residual useful life.

New framework optimizes label shift adaptation using aligned distribution mixture.

problem Label shift where source and target label distributions differ.
method Aligned Distribution Mixture (ADM) framework, incorporating insights from generalization theory.
result The ADM framework improves four typical label shift methods and introduces a one-step approach.

FlowGMM uses normalizing flows for semi-supervised learning, showing promising results across various data types.

problem Semi-supervised learning with limited labeled data.
method Normalizing flows combined with latent Gaussian mixture models for generative modeling.
result FlowGMM achieves promising results on multiple data types, including text and tabular data.

Semi-supervised learning benefits from informative missing labels, improving classifier performance.

problem Missing labels in semi-supervised learning can be informative, improving classifier performance.
method Formulates missingness as a mixture model problem and uses EM algorithm for fitting.
result Modelling informative missingness can yield a classifier with smaller expected error than a completely labelled sample.

Paper tackles MSDA with GMMs and OT, improving over prior art.

problem Adapting multiple heterogeneous source measures to a target measure.
method Optimal Transport between Gaussian Mixture Models, with novel barycenter calculation.
result Improves image classification and fault diagnosis benchmarks.

We develop a technique for deriving data-dependent error bounds for transductive learning algorithms based on transductive Rademacher complexity. Our technique is based on a novel general error bound for transduction in terms of transductive Rademacher complexity, together with a novel bounding technique for Rademacher…

2014-01-15abs ↗pdf ↗

GMMSEQ clusters AE data streams, identifying cluster onsets and growth.

problem Clustering unlabeled AE data with onsets and growth information.
method Modified Gaussian Mixture Models (GMM) with an objective function for AE timestamps.
result GMMSEQ provides better cluster characterization than standard methods.

We study the sample complexity of semi-supervised learning (SSL) and introduce new assumptions based on the mismatch between a mixture model learned from unlabeled data and the true mixture model induced by the (unknown) class conditional distributions. Under these assumptions, we establish an Ω(KlogK)Ω(K\log K) labeled samp…

2018-09-10abs ↗pdf ↗

Bayesian method estimates contamination factor for unsupervised anomaly detection.

problem No good methods for estimating contamination factor in unsupervised anomaly detection.
method Bayesian approach using mixture formulation of anomaly detector outputs.
result Estimated contamination factor distribution is well-calibrated and improves anomaly detection performance.