DFR reduces the computational cost of sparse-group lasso and adaptive sparse-group lasso.
problem Sparse-group lasso's computational expense and need for tuning.
method Dual Feature Reduction (DFR) using strong screening rules and dual norms.
result DFR drastically reduces computational cost without affecting solution optimality.
New screening rules speed up Sparse-Group Lasso solving.
problem Efficiently solving Sparse-Group Lasso in high dimensions.
method Adapted safe screening rules for Sparse-Group Lasso.
result Significant speed-ups in computing time for coordinate descent.
Sparse group Lasso optimizes sparse and grouped parameters in high-dimensional data.
problem Simultaneously sparse and grouped parameters in high-dimensional linear regression.
method Sparse group Lasso, debiased sparse group Lasso, statistical inference.
result Matching upper and lower bounds on sample complexity and estimation error.
The sparse group lasso optimization problem is solved using a coordinate gradient descent algorithm. The algorithm is applicable to a broad class of convex loss functions. Convergence of the algorithm is established, and the algorithm is used to investigate the performance of the multinomial sparse group lasso classifi…
New theorem for generalized group sparsity improves consistency and convergence rates.
problem Improving statistical inference in high-dimensional data with element-wise and group-wise sparsity.
method Developed a generalized version of Sparse-Group Lasso and proved a universal theorem for consistency and convergence rates.
result Obtained results on consistency and convergence rates for different forms of double sparsity regularization.
Paper introduces machine learning for time series data, improving nowcasting accuracy.
problem Improving accuracy in nowcasting US GDP growth using machine learning.
method Sparse-group LASSO estimator for high-dimensional time series data, considering different sampling frequencies and financial/macroeconomic data tail properties.
result Sparse-group LASSO outperforms unstructured LASSO in nowcasting US GDP growth.
A new method solves large-scale sparse group square-root Lasso problems efficiently.
problem Large-scale linearly constrained sparse group square-root Lasso problems.
method Dual semismooth Newton based augmented Lagrangian method (ALM).
result The proposed method efficiently solves the problem with numerical experiments demonstrating its effectiveness.
The paper improves machine learning for heavy-tailed panel data.
problem Improving estimates for financial and economic data with fat tails.
method Sparse-group LASSO regularization and Fuk-Nagaev concentration inequality.
result Oracle inequalities for panel data estimators.
New method for inferring time series graph from sparse-group log-sum penalty.
problem Inferring conditional independence graph from high-dimensional stationary multivariate Gaussian time series.
method Sparse-group log-sum penalty (LSP) and alternating direction method of multipliers (ADMM) for iterative optimization.
result Local convergence of inverse PSD estimators to the true value with rate of convergence.
Standardization boosts sparse group lasso performance for categorical variables.
problem Improving performance of sparse group lasso with categorical variables.
method Column-wise scaling and re-scaling of coefficients, without orthonormalization.
result Column-wise scaling and re-scaling of coefficients achieves the same effect as orthonormalization.
Study high-dimensional Granger causality tests for VIX and financial news.
problem Testing Granger causality in high-dimensional time series data.
method Regularized regressions, sparse-group LASSO, HAC estimation of variance.
result Valid time series inference for Granger causality tests in high dimensions.
A new model identifies genetic risk factors using gene-level priors.
problem Identifying genetic risk factors from nucleotide-level genetic variants.
method Sparse Group Lasso with Group-level Graph structure (SGLGG) model.
result SGLGG effectively identifies phenotype-associated risk SNPs.
Paper develops a new estimator for high-dimensional panel data with common shocks.
problem Cross-sectionally dependent errors driven by common shocks in high-dimensional panel data.
method Factor-augmented sparse-group LASSO estimator combining MIDAS aggregation with latent factors.
result The estimator outperforms standard LASSO for prediction and estimation in settings with cross-sectional dependence.
Proposes a boosting framework for sparsity in grouped covariates.
problem Sparsity and selection bias in grouped covariates.
method Component-wise and group-wise gradient boosting with adjusted degrees of freedom.
result Reduces bias and improves predictability in variable selection.
Paper learns Granger causality for Hawkes processes using sparse group lasso.
problem Challenges in learning Granger causality for general point processes.
method Modeling impact functions with basis functions and using group sparsity for Granger causality graph recovery.
result Successfully learns Granger causality graph and triggering patterns of Hawkes processes.
Classification with a sparsity constraint on the solution plays a central role in many high dimensional machine learning applications. In some cases, the features can be grouped together so that entire subsets of features can be selected or not selected. In many applications, however, this can be too restrictive. In th…
The group lasso is a penalized regression method, used in regression problems where the covariates are partitioned into groups to promote sparsity at the group level. Existing methods for finding the group lasso estimator either use gradient projection methods to update the entire coefficient vector simultaneously at e…
Paper uses machine learning for nowcasting corporate earnings from mixed-frequency data.
problem Predicting corporate earnings for a large cross-section of firms with different frequency data.
method Structured machine learning regressions with sparse-group LASSO regularization for panel data.
result Machine learning models outperform traditional methods in nowcasting corporate earnings.
Sparse group matrix completion reduces complexity and improves performance.
problem Matrix completion with non-informative side features.
method Group-Lasso regularization for feature selection in matrix factorization.
result Theoretical sample complexity is significantly lower than competitors.
Unified analysis of multi-attribute graph learning with non-convex penalties.
problem Graph inference from multi-attribute data.
method Penalized log-likelihood objective function with ADMM and local linear approximation.
result Local consistency in support recovery and precision matrix estimation for non-convex penalties.
In a recent paper, it is shown that the LASSO algorithm exhibits "near-ideal behavior," in the following sense: Suppose y=Az+η where A satisfies the restricted isometry property (RIP) with a sufficiently small constant, and ∥η∥2≤ε. Then minimizing ∥z∥1 subject to $\Vert y - Az \Ver…
New bounds for Lasso and Group Lasso in high dimensions derived.
problem Estimation error bounds for Lasso and Group Lasso in high-dimensional settings.
method Recent advances in high-dimensional statistics to derive new L2 estimation upper bounds.
result Bounds match optimal minimax rate for Lasso and improve over existing results for Group Lasso.
Sparse graph learning for dependent time series using ADMM.
problem Inferring conditional independence graph of sparse, high-dimensional stationary multivariate Gaussian time series.
method Sparse-group lasso-based frequency-domain formulation and alternating direction method of multipliers (ADMM) optimization.
result Convergence of inverse PSD estimators to true value under certain conditions.
Bayesian method for feature selection with grouping info using expectation propagation.
problem Feature selection with grouping info and sparsity constraints.
method Sparse-group Bayesian feature selection using expectation propagation.
result Our method outperforms existing methods in terms of feature selection accuracy and computational efficiency.
Estimates VAR models with correlated data using structured norms.
problem Estimating VAR models with dependent data and structured norms.
method Structured VAR models with various norms, using Lasso-type techniques.
result Error bounds for structured VAR parameters are comparable to independent data settings.
A method for inferring graph from multivariate time series using ADMM.
problem Inferring conditional independence graph from multivariate Gaussian time series.
method Formulated as multi-attribute graph estimation, used ADMM to minimize penalized negative log-likelihood.
result Proposed method outperforms existing frequency-domain approaches in graph edge detection.
New method finds sparse groups of input variables for neural networks.
problem Finding optimal groups of input variables for neural networks.
method Developed a new loss function and optimization algorithm for multi-layer non-linear neural networks to achieve group sparsity.
result Achieved group sparsity in three real-world datasets, improving model performance and excluding a significant number of variables.
The paper examines how to protect LASSO-based feature selection from adversarial attacks.
problem Adversarial attacks on LASSO-based feature selection.
method Formulated as a bi-level optimization problem, reformulated LASSO with linear inequality constraints, solved using interior-point method, and modified using projected gradient descent.
result Demonstrated the effectiveness of the proposed method in protecting LASSO-based feature selection from adversarial attacks.
Sparse-input neural networks handle high-dimensional data with fewer features.
problem Neural networks struggle with high-dimensional data where input features exceed observations.
method Sparse group lasso penalty on first-layer input weights.
result Sparse-input neural networks achieve better performance than existing methods in high-dimensional data with complex interactions.
In many learning tasks, structural models usually lead to better interpretability and higher generalization performance. In recent years, however, the simple structural models such as lasso are frequently proved to be insufficient. Accordingly, there has been a lot of work on "superposition-structured" models where mul…
Paper introduces MGLasso for multiscale graph inference in clustering and network analysis.
problem Graphical models in high-dimensional data analysis need to handle clustering and sparsity simultaneously.
method MGLasso combines clustering and graph inference through a convex relaxation of k-means and hierarchical clustering. It uses CONESTA for regularization.
result MGLasso improves network interpretability by estimating graphs at multiple scales.
Unified approach for error bounds in group sparse compressed sensing.
problem Error bounds for group sparse vectors in compressed sensing.
method Unified approach using decomposable and γ-decomposable norms.
result Bounds for various group sparse norms derived.
Sparse modeling is a powerful framework for data analysis and processing. Traditionally, encoding in this framework is performed by solving an L1-regularized linear regression problem, commonly referred to as Lasso or Basis Pursuit. In this work we combine the sparsity-inducing property of the Lasso model at the indivi…
Safe screening rules improve variable selection speed in high-dimensional regression.
problem Efficiently selecting important variables in high-dimensional regression problems.
method Developing Gap Safe screening rules for generalized linear models with sparsity enforcing penalties.
result Significant speed-ups in variable selection compared to previous methods on various learning tasks.
New theoretical framework improves error rates for sparse learning with convex regularization.
problem Improving error rates for sparse learning with convex regularization.
method Proposed a new theoretical framework using common assumptions to derive high-dimensional estimation bounds.
result Improved error rates for L1, Slope, and Group L1-L2 regularizations, matching or exceeding existing results.
Study improves carbon price forecasting using quantile regression and feature selection.
problem Accurately predicting carbon prices influenced by geopolitical, social, and economic factors.
method Collect and analyze various influencing factors, select significant features, and use Sparse Quantile Group Lasso and Adaptive Sparse Quantile Group Lasso for robust predictions.
result Proposed methods outperform existing ones and provide a complete profile of future carbon prices.
In this paper we introduce a new optimization formulation for sparse regression and compressed sensing, called CLOT (Combined L-One and Two), wherein the regularizer is a convex combination of the ℓ1- and ℓ2-norms. This formulation differs from the Elastic Net (EN) formulation, in which the regularizer is a…
sgboost reduces variable selection bias in boosting with balanced group selection.
problem Reduces variable selection bias in boosting algorithms.
method Simulation-based approach to balance selection frequencies of base-learners.
result Demonstrates efficacy through simulations and flexible group variable selection.
Since learning is typically very slow in Boltzmann machines, there is a need to restrict connections within hidden layers. However, the resulting states of hidden units exhibit statistical dependencies. Based on this observation, we propose using l1/l2 regularization upon the activation possibilities of hidden unit…
Paper proposes a new sparse group k-max regularization for sparsity constraints.
problem Linear inverse problems with sparsity constraints are NP-hard.
method Sparse group k-max regularization, iterative soft thresholding algorithm.
result Approximates l0 norm more closely and enhances group-wise and in-group sparsity.
Guided adaptive shrinkage uses co-data to improve feature selection in genomic studies.
problem Feature selection challenges in high-dimensional genomics data, especially in clinical settings.
method Guided adaptive shrinkage methods that use co-data to adapt shrinkage parameters.
result Improves feature selection in genomic studies, demonstrated through comparisons and examples.
New method infers graph from dependent matrix data.
problem Inferring graph from dependent matrix data.
method Sparse-group lasso-based frequency-domain formulation with ADMM approach.
result Local convergence of inverse PSD estimators to true value.
Sparse feature selection has been demonstrated to be effective in handling high-dimensional data. While promising, most of the existing works use convex methods, which may be suboptimal in terms of the accuracy of feature selection and parameter estimation. In this paper, we expand a nonconvex paradigm to sparse group …
Unified parallel ADMM for high-dimensional regression with combined regularizations.
problem Efficiently solving high-dimensional regression problems with combined regularization terms in parallel.
method Unified constrained optimization formulation based on consensus problem, parallel ADMM algorithms.
result Global convergence and linear convergence rate of the proposed algorithm.
New rules reduce SLOPE model fitting time by screening out irrelevant variables.
problem Expensive tuning of regularization parameter in penalized regression models.
method Strong screening rules for group-based SLOPE models.
result Significant acceleration of fitting process for Group SLOPE and sparse-group SLOPE.
Unified analysis for graph learning from multi-attribute Gaussian time series.
problem Estimating conditional independence graph from multi-attribute Gaussian time series data.
method Unified theoretical analysis using a penalized log-likelihood objective function in the frequency domain.
result Established sufficient conditions for consistency and graph recovery in high-dimensional settings.
Paper identifies sparse multivariable ARX models using Bayesian learning.
problem Identifying sparse multivariable ARX models from data.
method Sparse Bayesian Learning (SBL) approach to infer network structure and dynamics.
result Proposed method infers both network topology and internal dynamics from data.
This paper tackles efficient learning for factorial marked temporal point processes.
problem Efficient learning for factorial marked temporal point processes.
method Decoupled learning method with two procedures: ADM-M and Fast ISTA, and a reformulated Logistic Regression model.
result Empirical results show the efficiency of the decoupled and reformulated method.