Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,181 papers · 148 categories

Trend · papers per month

14274154 · May 202619922001200920182026
48 results for L1 Penalty

Sparse reconstruction approaches using the re-weighted l1-penalty have been shown, both empirically and theoretically, to provide a significant improvement in recovering sparse signals in comparison to the l1-relaxation. However, numerical optimization of such penalties involves solving problems with l1-norms in the ob…

2013-12-05abs ↗pdf ↗

Adaptive l1-regularization controls short-selling in portfolio selection.

problem Financial markets' restrictions on short-selling and sparsity in portfolio solutions.
method Updating rule for l1-penalty parameter in Bregman iteration.
result Approach preserves properties of original l1-regularization and controls both sparsity and short positions.

Two sparsity-aware NSAF algorithms improve sparse system identification with lower complexity.

problem Sparse system identification with improved performance and lower complexity.
method Gradient descent method to minimize combined cost function and l1-norm penalty on filter coefficients.
result Proposed algorithms achieve comparable performance with lower computational complexity.

This study evaluates Lx-norm penalties for resolving complex LC-MS data.

problem Resolving complex LC-MS data with rotational ambiguity.
method Simulated LC-MS data and grid search strategy to compare L0-, L1-, and L2-norm penalties.
result L1-norm penalty (Lasso) provides more sparse solutions and reduces rotational ambiguity.

New method improves signal reconstruction with nonconvex penalties and parameter control.

problem Reconstructing sparse signals with nonconvex penalties and nonconvexity control.
method Introduces nonconvex penalties (SCAD, MCP) with nonconvexity parameters and controls them to guide AMP trajectory.
result Achieves perfect reconstruction for relatively dense signals with small nonconvexity parameters.

Two new methods improve block-sparse signal recovery from noisy data.

problem Recovering block-sparse signals with unknown partitions.
method LogLOP-l2/l1 and AdaLOP-l2/l1 methods using log-sum penalty and MCP.
result Our methods outperform existing techniques in estimation accuracy.

In this article, we discuss various implementation of L1 filtering in order to detect some properties of noisy signals. This filter consists of using a L1 penalty condition in order to obtain the filtered signal composed by a set of straight trends or steps. This penalty condition, which determines the number of breaks…

2014-03-17abs ↗pdf ↗

This paper addresses the problem of sparsity penalized least squares for applications in sparse signal processing, e.g. sparse deconvolution. This paper aims to induce sparsity more strongly than L1 norm regularization, while avoiding non-convex optimization. For this purpose, this paper describes the design and use of…

2013-02-22abs ↗pdf ↗

We consider the problem of learning a high-dimensional graphical model in which certain hub nodes are highly-connected to many other nodes. Many authors have studied the use of an l1 penalty in order to learn a sparse graph in high-dimensional setting. However, the l1 penalty implicitly assumes that each edge is equall…

2014-02-28abs ↗pdf ↗

Simplifies neural network compression with Gaussian priors and L1 regularization.

problem Neural network overfitting and scalability issues.
method Adds Gaussian priors and L1 regularization to the optimization problem for quantization and pruning.
result Achieves results competitive with state-of-the-art methods using simple modifications.

Paper analyzes SLOPE via AMP, providing an asymptotically sharp analysis and algorithmic approach.

problem Analyzing SLOPE's solution under Gaussian random designs.
method Developed an asymptotically exact characterization using approximate message passing.
result AMP iterates converge to the SLOPE solution in an asymptotic sense.

Proposes an L1-regularized functional SVM for binary classification with functional covariates.

problem Binary classification with multivariate functional covariates.
method L1-regularized functional support vector machine (SVM) with an accompanying algorithm.
result The proposed classifier performs well in prediction and feature selection.

This paper improves adversarial robustness of deep learning models.

problem Vulnerability of machine learning models to adversarial perturbations.
method Analyzes adversarial training for linear regression and neural networks, incorporating L1 penalty.
result Incorporating L1 penalty leads to consistent adversarially robust estimation in high-dimensional settings.

We investigate properties of estimators obtained by minimization of U-processes with the Lasso penalty in high-dimensional settings. Our attention is focused on the ranking problem that is popular in machine learning. It is related to guessing the ordering between objects on the basis of their observed predictors. We p…

2015-12-17abs ↗pdf ↗

Recently it has become popular to learn sparse Gaussian graphical models (GGMs) by imposing l1 or group l1,2 penalties on the elements of the precision matrix. Thispenalized likelihood approach results in a tractable convex optimization problem. In this paper, we reinterpret these results as performing MAP estimation u…

2012-05-09abs ↗pdf ↗

Study evaluates various regularization methods for electricity price forecasting.

problem Improving accuracy of electricity price predictions.
method Applied ten different penalty functions to two model structures in two electricity markets.
result LQ and elastic net consistently produce more accurate forecasts than other regularization types.

Paper proposes efficient algorithms for designing SLOPE penalty sequences.

problem Designing SLOPE penalty sequences is computationally expensive.
method Developed two efficient algorithms: PGD and CD for Gaussian and general data matrices respectively.
result Demonstrated improved mean squared error performance of SLOPE with designed penalties.

A new method for sparse regression models using graph structure.

problem Sparse regression models for high-dimensional data.
method Decomposes coefficient vector into latent variables, performs regularization on latent variables, uses proximal projection.
result Stable performance compared to other models, especially for high-dimensional data.

Proposes a new SVM model for binary classification with theoretical and practical advantages.

problem Binary classification in supervised learning.
method Quadratic surface support vector machine with L1 norm regularization.
result The model can detect true sparsity patterns and is efficient for both synthetic and real data.

Study ablated data augmentation techniques and their mathematical equivalence to penalties.

problem Lack of mathematical understanding of differences between ablated data augmentation techniques.
method Formal model of mean ablated data augmentation and inverted dropout for linear regression; empirical validation for deep networks.
result Ablated data augmentation and inverted dropout are mathematically equivalent to penalties in optimization.

New algorithms solve L1-regularized SVMs and related LPs, outperforming existing methods.

problem Solving large-scale L1-regularized SVMs and related linear programs.
method Combining column/constraint generation with first-order methods for non-smooth convex optimization.
result Our approach significantly outperforms commercial solvers and specialized implementations.

This work improves model estimation efficiency and subgroup identification in networked systems.

problem Improving model estimation efficiency and subgroup identification in networked systems.
method A tree-based l1l_1 penalty and decentralized ADMM algorithm are used to solve the objective function in parallel.
result The approach outperforms in estimation accuracy, computation speed, and communication cost.

PRESTO improves rare event prediction by shrinking towards proportional odds model.

problem Difficult to predict rare events due to class imbalance.
method PRESTO relaxes proportional odds model by estimating separate weights for transitions between categories, imposing L1 penalty to shrink towards proportional odds.
result PRESTO consistently estimates decision boundary weights under sparsity assumption, improving rare probability estimation.

A new algorithm estimates NARMAX models with L1 regularization using coordinate descent.

problem Estimating NARMAX models with interpretability and error regressors.
method Cyclical coordinate descent for L1-regularized NARMAX models with error regressors.
result The method provides interpretable models with fewer important regressors.

Monitoring means to observe a system for any changes which may occur over time, using a monitor or measuring device of some sort. In this paper we formulate a problem of monitoring dates of maximal risk of a financial position. Thus, the systems we are going to observe arise from situations in finance. The measuring de…

2009-02-16abs ↗pdf ↗

It is well known that quantile regression model minimizes the portfolio extreme risk, whenever the attention is placed on the estimation of the response variable left quantiles. We show that, by considering the entire conditional distribution of the dependent variable, it is possible to optimize different risk and perf…

2015-07-01abs ↗pdf ↗

We propose a mixed integer programming (MIP) model and iterative algorithms based on topological orders to solve optimization problems with acyclic constraints on a directed graph. The proposed MIP model has a significantly lower number of constraints compared to popular MIP models based on cycle elimination constraint…

2017-01-20abs ↗pdf ↗

We consider high-dimensional distribution estimation through autoregressive networks. By combining the concepts of sparsity, mixtures and parameter sharing we obtain a simple model which is fast to train and which achieves state-of-the-art or better results on several standard benchmark datasets. Specifically, we use a…

2015-11-15abs ↗pdf ↗

Variable selection for high-dimensional linear models has received a lot of attention lately, mostly in the context of l1-regularization. Part of the attraction is the variable selection effect: parsimonious models are obtained, which are very suitable for interpretation. In terms of predictive power, however, these re…

2009-06-19abs ↗pdf ↗

Paper proposes sparse classification method for high-dimensional data.

problem Sparse classification in high-dimensional data with positive-confidence samples.
method Developed a novel sparse-penalization framework using L1, SCAD, and MCP penalties for convex and non-convex shrinkage.
result Proved near minimax-optimal sparse recovery rates under Restricted Strong Convexity condition.

We study the problem of Robust Least Squares Regression (RLSR) where several response variables can be adversarially corrupted. More specifically, for a data matrix X \in R^{p x n} and an underlying model w*, the response vector is generated as y = X'w* + b where b \in R^n is the corruption vector supported over at mos…

2015-06-08abs ↗pdf ↗