arXiv research

Proposes FARM model combining latent factor and sparse regression.

We propose a nonparametric Bayesian factor regression model that accounts for uncertainty in the number of factors, and the relationship between factors. To accomplish this, we propose a sparse variant of the Indian Buffet Process and couple this with a hierarchical model over factors, based on Kingman's coalescent. We…

Paper develops a new estimator for high-dimensional panel data with common shocks.

In this paper, we propose a non-parametric conditional factor regression (NCFR)model for domains with high-dimensional input and response. NCFR enhances linear regression in two ways: a) introducing low-dimensional latent factors leading to dimensionality reduction and b) integrating an Indian Buffet Process as a prior…

Oracle inequality for sparse neural nets adapts to unknown structure.

Divide-and-conquer method speeds sparse factorization for large matrices.

We propose a combined model, which integrates the latent factor model and the logistic regression model, for the citation network. It is noticed that neither a latent factor model nor a logistic regression model alone is sufficient to capture the structure of the data. The proposed model has a latent (i.e., factor anal…

Optimal sketching bounds for sparse linear regression under various loss functions are established.

Based on a new atomic norm, we propose a new convex formulation for sparse matrix factorization problems in which the number of nonzero elements of the factors is assumed fixed and known. The formulation counts sparse PCA with multiple factors, subspace clustering and low-rank sparse bilinear regression as potential ap…

SOFARI improves inference on multi-task learning latent factors.

Study improves error bounds for sparse regression with heavy-tailed covariates.

PEER tackles multi-response regression with incomplete outcomes efficiently.

New algorithm reduces sample complexity for sparse linear regression.

Study improves carbon price forecasting using quantile regression and feature selection.

Many modern big data applications feature large scale in both numbers of responses and predictors. Better statistical efficiency and scientific insights can be enabled by understanding the large-scale response-predictor association network structures via layers of sparse latent factors ranked by importance. Yet sparsit…

Paper proposes a new method for sparse covariance Cholesky factor estimation.

PS^2 selects assets then weights for high-dimensional investing.

High dimensional sparse learning has imposed a great computational challenge to large scale data analysis. In this paper, we are interested in a broad class of sparse learning approaches formulated as linear programs parametrized by a {\em regularization factor}, and solve them by the parametric simplex method (PSM). O…

Robust estimators for Gaussian sparse tasks with optimal error under contamination.

The Lasso is suboptimal in sparse linear regression due to design matrix constraints.

Improved Frank-Wolfe algorithm speeds up training of differentially private LASSO models.

We propose Macau, a powerful and flexible Bayesian factorization method for heterogeneous data. Our model can factorize any set of entities and relations that can be represented by a relational model, including tensors and also multiple relations for each entity. Macau can also incorporate side information, specificall…

New method selects variables for GP regression using sparse projection.

This paper develops a fast algorithm for solving nonlinear PDEs using sparse Cholesky factorization.

Robust testing of sparse signals in corrupted data.

Model predicts phytoplankton subpopulations based on environmental factors.

We consider the problem of multivariate regression in a setting where the relevant predictors could be shared among different responses. We propose an algorithm which decomposes the coefficient matrix into the product of a long matrix and a wide matrix, with an elastic net penalty on the former and an $\ell_1$ penalty …

New method for hyperparameter tuning in sparse matrix factorization.

Linear Mixed Models (LMMs) are important tools in statistical genetics. When used for feature selection, they allow to find a sparse set of genetic traits that best predict a continuous phenotype of interest, while simultaneously correcting for various confounding factors such as age, ethnicity and population structure…

New algorithm learns sparse GLMs for binary outcomes efficiently.

Sparse APCA identifies sparse factors in financial returns over time.

Paper develops a new algorithm for sparse signal recovery.

Modeling inverse dynamics is crucial for accurate feedforward robot control. The model computes the necessary joint torques, to perform a desired movement. The highly non-linear inverse function of the dynamical system can be approximated using regression techniques. We propose as regression method a tensor decompositi…

We present a general framework, the coupled compound Poisson factorization (CCPF), to capture the missing-data mechanism in extremely sparse data sets by coupling a hierarchical Poisson factorization with an arbitrary data-generating model. We derive a stochastic variational inference algorithm for the resulting model …

We consider the classical sparse regression problem of recovering a sparse signal $x_0$ given a measurement vector $y = Φx_0+w$. We propose a tree search algorithm driven by the deep neural network for sparse regression (TSN). TSN improves the signal reconstruction performance of the deep neural network designed for sp…

Matrix factorizations and their extensions to tensor factorizations and decompositions have become prominent techniques for linear and multilinear blind source separation (BSS), especially multiway Independent Component Analysis (ICA), NonnegativeMatrix and Tensor Factorization (NMF/NTF), Smooth Component Analysis (Smo…

We consider multi-task regression models where observations are assumed to be a linear combination of several latent node and weight functions, all drawn from Gaussian process (GP) priors that allow nonzero covariance between grouped latent functions. We show that when these grouped functions are conditionally independ…

FLIPHAT addresses joint differential privacy for high-dimensional sparse linear bandits.

New method improves GP regression by relaxing variational assumption.

Gaussian process (GP) audio source separation is a time-domain approach that circumvents the inherent phase approximation issue of spectrogram based methods. Furthermore, through its kernel, GPs elegantly incorporate prior knowledge about the sources into the separation model. Despite these compelling advantages, the c…

Picasso is a new library for sparse learning problems in R and Python.

Unified framework for sparse logistic regression with nonconvex regularization.

Although there is a rich literature on methods for allowing the variance in a univariate regression model to vary with predictors, time and other factors, relatively little has been done in the multivariate case. Our focus is on developing a class of nonparametric covariance regression models, which allow an unknown p …

In this paper, we address the challenging problem of selecting tuning parameters for high-dimensional sparse regression. We propose a simple and computationally efficient method, called path thresholding (PaTh), that transforms any tuning parameter-dependent sparse regression algorithm into an asymptotically tuning-fre…

A new method for Bayesian neural networks using probabilistic backpropagation.

New test detects sparse alternatives in Gaussian random fields.

New method measures price elasticity from daily sales data.

Adaptive sparseness enhances robust regression using MCC and ARD.