We investigate the learning rate of multiple kernel learning (MKL) with and elastic-net regularizations. The elastic-net regularization is a composition of an -regularizer for inducing the sparsity and an -regularizer for controlling the smoothness. We focus on a sparse setting where the total …
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “Elastic-Net regularization”
We theoretically investigate the convergence rate and support consistency (i.e., correctly identifying the subset of non-zero coefficients in the large sample limit) of multiple kernel learning (MKL). We focus on MKL with block-l1 regularization (inducing sparse kernel combination), block-l2 regularization (inducing un…
ARGEN method improves variable selection and regularization in high-dimensional sparse models.
problem Constrained variable selection and regularization in high-dimensional sparse linear models.
method ARGEN penalty method, variable selection and regularization.
result ARGEN method has variable selection and estimation consistency under certain conditions.
We investigate the learning rate of multiple kernel leaning (MKL) with elastic-net regularization, which consists of an -regularizer for inducing the sparsity and an -regularizer for controlling the smoothness. We focus on a sparse setting where the total number of kernels is large but the number of non…
Due to the advantage of achieving a better performance under weak regularization, elastic net has attracted wide attention in statistics, machine learning, bioinformatics, and other fields. In particular, a variation of the elastic net, adaptive elastic net (AEN), integrates the adaptive grouping effect. In this paper,…
Within the framework of statistical learning theory we analyze in detail the so-called elastic-net regularization scheme proposed by Zou and Hastie for the selection of groups of correlated variables. To investigate on the statistical properties of this scheme and in particular on its consistency properties, we set up …
FedElasticNet reduces communication costs and handles client drift in FL.
problem Expensive communication costs and client drift issues in federated learning.
method Leverages elastic net regularizers to sparsify local updates and limit client drift.
result FedElasticNet effectively resolves communication cost and client drift problems.
Multiple kernel learning (MKL), structured sparsity, and multi-task learning have recently received considerable attention. In this paper, we show how different MKL algorithms can be understood as applications of either regularization on the kernel weights or block-norm-based regularization, which is more common in str…
Renet: Principled and Efficient Relaxation for the Elastic Net via Dynamic Objective Selectionstat.ME
Renet improves Elastic Net by dynamically selecting between convex blending and refitting, enhancing prediction accuracy.
problem Elastic Net's shrinkage bias limits its prediction accuracy in high-dimensional settings.
method Adaptive relaxation procedure that dynamically dispatches between convex blending and efficient sub-path refitting.
result Renet consistently outperforms standard Elastic Net and Adaptive Elastic Net in high-dimensional, low signal-to-noise ratio, and high-multicollinearity scenarios.
State-of-the-art subspace clustering methods are based on expressing each data point as a linear combination of other data points while regularizing the matrix of coefficients with , or nuclear norms. regularization is guaranteed to give a subspace-preserving affinity (i.e., there are no conne…
A new method for semi-supervised learning of sparse features using elastic-net.
problem Semi-supervised learning of sparse features in generalized linear models.
method Generalized Semi-Supervised Elastic-Net (s2net) framework.
result The s2net framework improves upon supervised elastic-net methods for semi-supervised learning.
Proposes novel wSVMs for sparse learning and accurate probability estimation.
problem Sparse features with redundant noise limit the performance of existing wSVMs.
method Develops -norm and elastic net regularized wSVMs for automatic variable selection and probability estimation.
result Elastic net regularized wSVMs achieve superior performance in variable selection and probability estimation.
We study a sparse negative binomial regression (NBR) for count data by showing the non-asymptotic advantages of using the elastic-net estimator. Two types of oracle inequalities are derived for the NBR's elastic-net estimates by using the Compatibility Factor Condition and the Stabil Condition. The second type of oracl…
It is well known that the out-of-sample performance of Markowitz's mean-variance portfolio criterion can be negatively affected by estimation errors in the mean and covariance. In this paper we address the problem by regularizing the mean-variance objective function with a weighted elastic net penalty. We show that the…
The choice of normalization affects the coefficients in regularized regression models.
problem The impact of normalization on the coefficients of regularized regression models.
method Investigated lasso, ridge, and elastic net regression with different normalization methods for binary and mixed features.
result Normalization affects the coefficients of regularized regression models, and specific scaling methods can mitigate this effect.
Improved Frank-Wolfe for sparse/low-rank problems.
problem Sparse/low-rank optimization problems.
method Primal-Dual Block Frank-Wolfe algorithm.
result Empirically outperforms state-of-the-art methods in classification tasks.
Differentially-Private Logistic Regression for Detecting Multiple-SNP Association in GWAS Databasesstat.ML
Following the publication of an attack on genome-wide association studies (GWAS) data proposed by Homer et al., considerable attention has been given to developing methods for releasing GWAS data in a privacy-preserving way. Here, we develop an end-to-end differentially private method for solving regression problems wi…
Enhanced ECCD speeds up elastic net model training.
problem Efficiently solving generalized linear models with elastic net constraints.
method Redesigned cyclic coordinate descent with Taylor expansion and batched computations.
result Empirically shows consistent performance improvement over state-of-the-art solvers.
RENT selects stable features for robust model interpretation.
problem Stability in feature selection for robust model interpretation.
method RENT uses an ensemble of elastic net models trained on distinct subsets of data.
result RENT selects features with high stability improving model robustness.
Study improves paddy rice yield predictions in Peru using sparse regression and climatic variables.
problem Improving precision of paddy rice yield forecasts in Peru.
method Sparse regression, Elastic-Net regularization, climatic variables, dynamic transformations.
result Improved predictive performance of paddy rice yield forecasts.
Structure learning in random fields has attracted considerable attention due to its difficulty and importance in areas such as remote sensing, computational biology, natural language processing, protein networks, and social network analysis. We consider the problem of estimating the probabilistic graph structure associ…
The paper develops methods for high-dimensional inference in Markov random fields.
problem Statistical inference for high-dimensional Markov random fields.
method Markov Chain Monte Carlo Maximum Likelihood Estimation (MCMC-MLE) with Elastic-net regularization.
result The proposed methods achieve -consistency and false discovery rate control.
Proposes HDBEN for heteroscedastic regression with improved sparsity and variance modeling.
problem Violation of constant error variance in high-dimensional regression.
method HDBEN framework using hierarchical Bayesian priors with and penalties.
result Achieves posterior concentration, variable selection consistency, and asymptotic normality.
Enhanced Elastic-Net with box-constraint improves support recovery in noisy measurements.
problem Support recovery of sparse signals from noisy measurements.
method Box-Elastic Net (Box-EN) method with mean squared error and probability of support recovery analysis.
result The Box-Elastic Net outperforms the standard Elastic-Net in support recovery.
Study on Transfer Elastic Net error bounds and grouping effect.
problem Estimation error and grouping effect in Transfer Elastic Net.
method Derives non-asymptotic error bound and examines grouping effect scenarios.
result Effective error bounds and grouping effect observed in Transfer Elastic Net.
LIT-LVM improves linear predictors by estimating interaction terms with latent vectors.
problem Accurately estimating coefficients for interaction terms in linear predictors.
method Structured regularization using latent vectors to represent features.
result LIT-LVM achieves superior prediction accuracy compared to other methods.
The diagnosis of Alzheimer's disease (AD) in routine clinical practice is most commonly based on subjective clinical interpretations. Quantitative electroencephalography (QEEG) measures have been shown to reflect neurodegenerative processes in AD and might qualify as affordable and thereby widely available markers to f…
In this article, we derive a Bayesian model to learning the sparse and low rank PARAFAC decomposition for the observed tensor with missing values via the elastic net, with property to find the true rank and sparse factor matrix which is robust to the noise. We formulate efficient block coordinate descent algorithm and …
In this paper we combine two important extensions of ordinary least squares regression: regularization and optimal scaling. Optimal scaling (sometimes also called optimal scoring) has originally been developed for categorical data, and the process finds quantifications for the categories that are optimal for the regres…
This paper provides theoretical guarantees for SPCA using the Elastic Net.
problem Lack of theoretical guarantees for the SPCA algorithm.
method Revisited and improved the SPCA algorithm of Zou et al. (2006) using the Elastic Net.
result Both algorithms can recover the principal subspace consistently under mild conditions.
Recent studies have highlighted the vulnerability of deep neural networks (DNNs) to adversarial examples - a visually indistinguishable adversarial image can easily be crafted to cause a well-trained model to misclassify. Existing methods for crafting adversarial examples are based on and distortion me…
We empirically investigate the best trade-off between sparse and uniformly-weighted multiple kernel learning (MKL) using the elastic-net regularization on real and simulated datasets. We find that the best trade-off parameter depends not only on the sparsity of the true kernel-weight spectrum but also on the linear dep…
Efficiently solves Elastic Net in high dimensions with Newton method.
problem Feature selection in high-dimensional data with non-negligible collinearity.
method Semi-smooth Newton Augmented Lagrangian Method.
result Significantly reduces computational cost compared to competitors.
We develop an approximate formula for evaluating a cross-validation estimator of predictive likelihood for multinomial logistic regression regularized by an -norm. This allows us to avoid repeated optimizations required for literally conducting cross-validation; hence, the computational time can be significantl…
A fast method estimates group-adaptive elastic net penalties using co-data.
problem Computational inefficiency in estimating group-adaptive elastic net penalties.
method Derive low-dimensional representation of Taylor approximation for marginal likelihood and its derivative for group-adaptive ridge penalties; approximate elastic net marginal likelihood by ridge; transform ridge penalties to elastic net penalties.
result Significantly decreases computation time and outperforms other methods.
Variable selection plays an important role in the high-dimensional data analysis. However the high-dimensional data often induces the strongly correlated variables problem. In this paper, we propose Elastic Net procedure for partially linear models and prove the group effect of its estimate. By a simulation study, we s…
Improved Kriging model reduces prediction errors.
problem Improving prediction accuracy in Kriging models.
method Theta-regularized Kriging model with Lasso, Ridge, and Elastic-net penalties.
result The Theta-regularized Kriging model outperforms other penalized Kriging models in accuracy and stability.
Network Elastic Net identifies smoking-specific gene expression for lung cancer prognosis.
problem Identifying smoking-specific gene expression biomarkers in lung cancer prognosis.
method Introduces Network Elastic Net, a method that clusters and regresses on graphs based on smoking behavior.
result Shows efficacy of clusters in identifying cancer stages using gene expression and smoking behavior.
We propose a robust elastic net (REN) model for high-dimensional sparse regression and give its performance guarantees (both the statistical error bound and the optimization bound). A simple idea of trimming the inner product is applied to the elastic net model. Specifically, we robustify the covariance matrix by trimm…
New SVM model balances sparsity and robustness in noisy data.
problem Noise sensitivity and lack of sparsity in traditional SVM models.
method Combines elastic net loss with robust loss framework, integrates with SVM, uses half-quadratic algorithm.
result Proves sparsity and robustness, outperforms traditional SVMs in noisy environments.
Paper develops algorithms for sparse linear regression with generalized elastic net penalty.
problem Sparse linear regression with robust penalty for high-dimensional data.
method Iterative Reweighted Framework based on ADMM and PMM with SNN.
result Efficient algorithms provide superior performance in both simulated and real data.
Proposes fwelnet to improve prediction using feature information.
problem Improving prediction accuracy in supervised learning settings.
method fwelnet uses feature-weighted elastic net to adapt feature penalties.
result fwelnet outperforms lasso in test MSE and feature selection.
Generalised elastic netsq-bio.NC
The elastic net was introduced as a heuristic algorithm for combinatorial optimisation and has been applied, among other problems, to biological modelling. It has an energy function which trades off a fitness term against a tension term. In the original formulation of the algorithm the tension term was implicitly based…
We derive a novel norm that corresponds to the tightest convex relaxation of sparsity combined with an penalty. We show that this new {\em -support norm} provides a tighter relaxation than the elastic net and is thus a good replacement for the Lasso or the elastic net in sparse prediction problems. Through …
New method uses sparse kernel PCA for better outlier detection.
problem Outlier detection using Kernel PCA.
method Formulated as a constrained optimization problem with elastic net regularization in kernel feature space.
result Using just 4% of principal components, we can nearly match and outperform KPCA.
This paper presents a robust matrix elastic net based canonical correlation analysis (RMEN-CCA) for multiple view unsupervised learning problems, which emphasizes the combination of CCA and the robust matrix elastic net (RMEN) used as coupled feature selection. The RMEN-CCA leverages the strength of the RMEN to distill…
Study evaluates various regularization methods for electricity price forecasting.
problem Improving accuracy of electricity price predictions.
method Applied ten different penalty functions to two model structures in two electricity markets.
result LQ and elastic net consistently produce more accurate forecasts than other regularization types.
A Reduction of the Elastic Net to Support Vector Machines with an Application to GPU Computingstat.ML
The past years have witnessed many dedicated open-source projects that built and maintain implementations of Support Vector Machines (SVM), parallelized for GPU, multi-core CPUs and distributed systems. Up to this point, no comparable effort has been made to parallelize the Elastic Net, despite its popularity in many h…