Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

67134200267 · Jun 202019922001200920182026
48 results for semi-supervised regression

Generative adversarial networks improved for regression tasks.

problem Improving neural network training with semi-supervised data.
method Feature contrasting loss function for discriminator training.
result Semi-supervised GANs can be effectively applied to regression problems.

Paper introduces semi-supervised linear extremile regression for high-dimensional data.

problem Challenges in high-dimensional extremile regression due to data sparsity and overfitting.
method Proposes semi-supervised learning for linear extremile regression, achieving n\sqrt{n}-consistency.
result Demonstrates improved estimation efficiency and performance in high-dimensional settings.

Study semi-supervised learning with noisy proxy covariates, deriving bounds and showing gains.

problem Learning from noisy proxy covariates with scarce labels.
method Two-stage estimator learning kernel eigenfeatures from all proxy covariates and fitting a ridge predictor on labeled data.
result Finite sample bounds show fast labeled sample rates and consistent gains over supervised and semi-supervised baselines.

A new framework for semi-supervised ordinal regression.

problem Lack of evaluation metrics and theoretical guarantees in existing semi-supervised ordinal regression.
method Empirical risk minimization principle, flexible model choices, and estimation error bound.
result Consistent risk estimator and improved performance across various metrics.

ETM models improve efficiency in semi-supervised logistic regression.

problem Improving efficiency in logistic regression with limited labeled data.
method Developed exponential tilt mixture (ETM) models for semi-supervised estimation.
result ETM-based estimation demonstrates improved efficiency over supervised logistic regression.

A method for semi-supervised regression under uncertainty combines graph Laplacian and cluster ensemble.

problem Semi-supervised regression with uncertain data structure and noise.
method Combines graph Laplacian regularization and cluster ensemble methodologies; uses low-rank decomposition of co-association matrix.
result Robust, efficient, and scalable method demonstrated through numerical experiments.

Unified framework for semi-supervised regression with misspecified models.

problem Estimating regression coefficients in conditional mean models with unlabeled data.
method Developed an augmented inverse probability weighted (AIPW) method using regularized calibrated estimators for PS and OR nuisance models.
result The proposed estimator is consistent, asymptotically normal, and provides valid confidence intervals even with misspecified OR models and high-dimensional data.

This paper presents Correlated Nystrom Views (XNV), a fast semi-supervised algorithm for regression and classification. The algorithm draws on two main ideas. First, it generates two views consisting of computationally inexpensive random features. Second, XNV applies multiview regression using Canonical Correlation Ana…

2013-06-24abs ↗pdf ↗

Develops a semi-supervised learning method using exponential tilt mixture models.

problem Improves classification accuracy with labeled and unlabeled data.
method Extends logistic regression to exponential tilt modeling, derives maximum likelihood estimation, and proposes regularized estimation.
result Demonstrates improved prediction accuracy compared to existing methods.

A scalable algorithm improves AUC optimization for semi-supervised ordinal regression.

problem Optimizing AUC for semi-supervised ordinal regression with limited labeled data.
method Proposes QS3^3ORAO using quadruply stochastic gradients for scalable kernelized learning.
result Converges to optimal solution at O(1/t)O(1/t) rate, demonstrating efficiency and effectiveness.

SDORE uses neural networks to estimate regression functions and their gradients, even with limited labeled data.

problem Nonparametric estimation of regression functions and their gradients.
method Semi-supervised deep ReQU neural networks with gradient norm regularization.
result Achieves minimax optimal convergence rates in L2L^{2}-norm and plug-in gradient estimator convergence.

Optimal and safe semi-supervised learning estimator for high-dimensional data.

problem Improving regression parameter estimation with unlabeled data in high-dimensional settings.
method Established minimax lower bound, proposed optimal and safe semi-supervised estimators.
result Optimal semi-supervised estimator achieves the minimax lower bound.

New method uses unlabeled data to estimate intercept in case-control logistic regression.

problem Estimating intercept in case-control logistic regression.
method Construct likelihood function, use iterative algorithm to find maximum likelihood estimator.
result Proposed method identifies intercept and improves estimation efficiency.

Semi-supervised learning improves prediction using unlabeled data.

problem Improving prediction performance using unlabeled data.
method General methodology for semi-supervised Empirical Risk Minimization (ERM) focusing on generalized linear regression.
result Adaptive SSL can achieve substantial improvement over supervised and null models in various settings.

Develops a framework for fair semi-supervised learning.

problem Balancing fairness and accuracy in semi-supervised learning.
method Formulates a framework as an optimization problem, incorporating classifier loss, label propagation loss, and fairness constraints.
result Achieves fair semi-supervised learning with better accuracy-fairness trade-off than fair supervised learning.

Bayesian analysis shows unlabeled data improve graph-based semi-supervised learning.

problem Improving semi-supervised learning with limited labeled data.
method Bayesian nonparametric approach using unlabeled data for graph-based learning.
result Posterior contracts optimally around the truth with sufficient unlabeled data.

New algorithm tackles regression on manifold data using diffusion and semi-supervised learning.

problem Regression on high-dimensional manifold data with complex structures.
method Diffusion-based spectral algorithm using graph Laplacian and heat kernel.
result Algorithm achieves convergence rate dependent on intrinsic manifold dimension, avoiding curse of dimensionality.

Study on reducing dimensionality in high-dimensional regression with kernel methods and stability analysis.

problem Analyzing errors in high-dimensional regression with dimensionality reduction and kernel regression.
method Derive a stability result for kernel regression with Wasserstein distance and apply it to PCA to deduce convergence rates.
result Two-step procedure yields useful convergence rates in semi-supervised settings.

A new method improves semi-supervised learning by handling tasks with different attribute spaces.

problem Existing methods assume tasks share the same attribute space, limiting their applicability.
method Meta-learning approach that embeds labeled and unlabeled data in task-specific spaces using neural networks.
result Improves test performance on tasks with small labeled data using unlabeled and various task data.

Study optimal spectral estimator for semi-supervised node classification.

problem Semi-supervised node classification on CSBM with limited labels.
method Spectral estimator inspired by PCA, graph ridge regression, GCN.
result Achieves information-theoretical threshold for exact recovery.

Method improves regression models using unlabeled data.

problem Improving predictive performance of regression models with limited labeled data.
method Mixed semi-supervised generalized-linear-regression with different mixing mechanisms.
result Integrating unlabeled data consistently improves predictive performance.

GNNs improve semi-supervised node regression, but why? We explain.

problem Understanding when and why GNNs succeed in semi-supervised node regression.
method Aggregate-and-readout model encompassing message passing architectures, least-squares estimation over GNNs with linear graph convolutions and a deep ReLU readout.
result Sharp non-asymptotic risk bound separating approximation, stochastic, and optimization errors.

Prediction-powered causal inference achieves smaller asymptotic variance than traditional methods.

problem Estimating causal and structural parameters in a semi-supervised setting.
method Combining efficient influence function with debiased machine learning and semi-supervised Riesz regression.
result Asymptotic variances of estimators match the derived efficiency bound.

We apply network Lasso to semi-supervised regression problems involving network structured data. This approach lends quite naturally to highly scalable learning algorithms in the form of message passing over an empirical graph which represents the network structure of the data. By using a simple non-parametric regressi…

2018-08-22abs ↗pdf ↗

We explore a novel approach to semi-supervised learning. This approach is contrary to the common approach in that the unlabeled examples serve to "muffle," rather than enhance, the guidance provided by the labeled examples. We provide several variants of the basic algorithm and show experimentally that they can achieve…

2016-05-28abs ↗pdf ↗

Simplifies transfer learning with deep neural networks using ridge regression.

problem High computational cost of finetuning deep models for transfer learning.
method Leverage the low-rank property of deep neural networks' feature vectors in kernel ridge regression.
result Successful on supervised and semi-supervised transfer learning tasks.

We consider semi-supervised regression when the predictor variables are drawn from an unknown manifold. A simple two step approach to this problem is to: (i) estimate the manifold geodesic distance between any pair of points using both the labeled and unlabeled instances; and (ii) apply a k nearest neighbor regressor b…

2016-11-07abs ↗pdf ↗

Optimal regression with reject option using conditional variance thresholding.

problem Regression with reject option to handle uncertain predictions.
method Derive optimal rule based on thresholding conditional variance, semi-supervised estimation using labeled and unlabeled data.
result The predictor with reject option is almost as good as the optimal predictor in terms of risk and rejection rate.

A new method for semi-supervised learning of sparse features using elastic-net.

problem Semi-supervised learning of sparse features in generalized linear models.
method Generalized Semi-Supervised Elastic-Net (s2net) framework.
result The s2net framework improves upon supervised elastic-net methods for semi-supervised learning.

Infinitely wide GCNs perform as GPs for graph semi-supervised learning.

problem Graph-based semi-supervised classification with limited labeled data.
method Proposes GPGC model combining GCNs and GPs for semi-supervised learning.
result GPGC outperforms state-of-the-art methods on various datasets.

Semi-supervised learning improves QSAR model predictions for novel compounds.

problem Improving model predictions for compounds not in the training set and adjusting for selection bias.
method Semi-supervised learning framework to estimate model quality and adjust for selection bias.
result Predictions for novel compounds are improved by accounting for compound similarity and selection bias.

Active learning improves soft sensor development by suggesting informative labels.

problem Expensive labeling of process variables in industrial settings.
method Adapted active learning strategies for online data streams and used semi-supervised autoencoders.
result Improved predictive performance of soft sensors using active learning and autoencoders.

Graph filtering framework improves semi-supervised learning efficiency.

problem Efficiently leverage unlabeled data with limited labeled data.
method Graph filtering to inject graph similarity into data features.
result Unified insights and improved modeling capabilities of label propagation and graph convolutional networks.

RegMixMatch optimizes Mixup for semi-supervised learning by integrating high- and low-confidence samples.

problem Mixup degrades SSL performance by compromising artificial labels purity.
method RegMixMatch integrates high- and low-confidence samples, uses class-aware Mixup, and mitigates confirmation bias.
result RegMixMatch achieves state-of-the-art performance in SSL benchmarks.

We propose a data-efficient Gaussian process-based Bayesian approach to the semi-supervised learning problem on graphs. The proposed model shows extremely competitive performance when compared to the state-of-the-art graph neural networks on semi-supervised learning benchmark experiments, and outperforms the neural net…

2018-09-12abs ↗pdf ↗

A new framework based on the theory of copulas is proposed to address semi- supervised domain adaptation problems. The presented method factorizes any multivariate density into a product of marginal distributions and bivariate cop- ula functions. Therefore, changes in each of these factors can be detected and corrected…

2013-01-01abs ↗pdf ↗

Propagating input uncertainty through non-linear Gaussian process (GP) mappings is intractable. This hinders the task of training GPs using uncertain and partially observed inputs. In this paper we refer to this task as "semi-described learning". We then introduce a GP framework that solves both, the semi-described and…

2015-09-03abs ↗pdf ↗

We propose a novel sparse preference learning/ranking algorithm. Our algorithm approximates the true utility function by a weighted sum of basis functions using the squared loss on pairs of data points, and is a generalization of the kernel matching pursuit method. It can operate both in a supervised and a semi-supervi…

2013-07-02abs ↗pdf ↗