arXiv research

Develops a new screening method called Newton screening for faster and more accurate sparse learning.

We propose an algorithm, semismooth Newton coordinate descent (SNCD), for the elastic-net penalized Huber loss regression and quantile regression in high dimensional settings. Unlike existing coordinate descent type algorithms, the SNCD updates each regression coefficient and its corresponding subgradient simultaneousl…

RaSE screens variables via random subspaces, identifying joint effects.

The problem of learning a sparse model is conceptually interpreted as the process of identifying active features/samples and then optimizing the model over them. Recently introduced safe screening allows us to identify a part of non-active features/samples. So far, safe screening has been individually studied either fo…

New Bayesian optimization models for efficient material screening.

This paper treats the problem of screening for variables with high correlations in high dimensional data in which there can be many fewer samples than variables. We focus on threshold-based correlation screening methods for three related applications: screening for variables with large correlations within a single trea…

Statistical inference can be computationally prohibitive in ultrahigh-dimensional linear models. Correlation-based variable screening, in which one leverages marginal correlations for removal of irrelevant variables from the model prior to statistical inference, can be used to overcome this challenge. Prior works on co…

New screening rules improve lasso model fitting efficiency.

A new screening rule 'dynamic Sasvi' improves sparse optimization speed.

In the present paper, we introduce screen transversal lightlike submanifolds of metallic semi-Riemannian manifolds with its subclasses, namely screen transversal anti-invariant, radical screen transversal and isotropic screen transversal lightlike submanifolds, and give an example. We show that there do not exist co-is…

New AI platform screens portfolios for desirable firms and news.

A variable screening procedure via correlation learning was proposed Fan and Lv (2008) to reduce dimensionality in sparse ultra-high dimensional models. Even when the true model is linear, the marginal regression can be highly nonlinear. To address this issue, we further extend the correlation learning to marginal nonp…

Recent computational strategies based on screening tests have been proposed to accelerate algorithms addressing penalized sparse regression problems such as the Lasso. Such approaches build upon the idea that it is worth dedicating some small computational effort to locate inactive atoms and remove them from the dictio…

A new screening method for high-dimensional data reduces computational cost.

A new method for optimization in probability space using Newton's flows.

We study safe screening for metric learning. Distance metric learning can optimize a metric over a set of triplets, each one of which is defined by a pair of same class instances and an instance in a different class. However, the number of possible triplets is quite huge even for a small dataset. Our safe triplet scree…

In this paper we develop the notion of screen isoparametric hypersurface for null hypersurfaces of Robertson-Walker spacetimes. Using this formalism we derive Cartan identities for the screen principal curvatures of null screen hypersurfaces in Lorentzian space forms and provide a local characterization of such hypersu…

A new method for virtual drug screening detects top treatments.

A new screening rule improves lasso solving speed.

Recently, to solve large-scale lasso and group lasso problems, screening rules have been developed, the goal of which is to reduce the problem size by efficiently discarding zero coefficients using simple rules independently of the others. However, screening for overlapping group lasso remains an open challenge because…

We describe stochastic Newton and stochastic quasi-Newton approaches to efficiently solve large linear least-squares problems where the very large data sets present a significant computational burden (e.g., the size may exceed computer memory or data are collected in real-time). In our proposed framework, stochasticity…

Safe sample screening improves RSVM performance without sacrificing accuracy.

The main purpose of the present paper is to study the geometry of screen transversal lightlike submanifolds and radical screen transversal lightlike submanifolds and screen transversal anti-invariant lightlike submanifolds of Golden Semi-Riemannian manifolds. We investigate the geometry of distributions and obtain nece…

Newton's method solves variational problems on manifolds.

In data sets with many more features than observations, independent screening based on all univariate regression models leads to a computationally convenient variable selection method. Recent efforts have shown that in the case of generalized linear models, independent screening may suffice to capture all relevant feat…

Efficiently allocate budgets for LLM-assisted virtual screening to reduce costs.

Deep learning predicts breast cancer with high accuracy from patient data.

New rules reduce SLOPE model fitting time by screening out irrelevant variables.

A new method reduces feature screening cost from $O(np)$ to $O(\sqrt{n}p)$.

To find efficient screening methods for high dimensional linear regression models, this paper studies the relationship between model fitting and screening performance. Under a sparsity assumption, we show that a subset that includes the true submodel always yields smaller residual sum of squares (i.e., has better model…

Muon with Newton-Schulz converges to the same stationary point as SVD-polar, up to a constant factor.

Variable screening is a fast dimension reduction technique for assisting high dimensional feature selection. As a preselection method, it selects a moderate size subset of candidate variables for further refining via feature selection to produce the final model. The performance of variable screening depends on both com…

This paper introduces LR-FFS for robust feature screening in federated learning under label shift.

Model shows screening for infectious disease is hard but Thompson sampling works well.

A new method reduces feature size in CRFs for faster training.

Study Einstein warped-product manifolds with specific curvature conditions.

RNN operators solve Newton's equations with large timesteps for molecular dynamics.

We generalize Newton-type methods for minimizing smooth functions to handle a sum of two convex functions: a smooth function and a nonsmooth function with a simple proximal mapping. We show that the resulting proximal Newton-type methods inherit the desirable convergence behavior of Newton-type methods for minimizing s…

New algorithm improves convergence of gradient boosting trees.

The paper studies lightlike submanifolds in bronze semi-Riemannian manifolds with specific geometric properties.

Boosting algorithms are frequently used in applied data science and in research. To date, the distinction between boosting with either gradient descent or second-order Newton updates is often not made in both applied and methodological research, and it is thus implicitly assumed that the difference is irrelevant. The g…

We introduce two classes of null hypersurfaces of an indefinite Sasakian manifold, $(\overline{M}, \overlineφ,ζ, η)$, tangent to the characteristic vector field $ζ$, called; {\it contact screen conformal} and {\it contact screen umbilic} null hypersurfaces. These hypersurfaces come in to fill the existing gap in screen…

In the present paper, we show that the geometry of a screen integrable null hypersurface can be generated from an isometric immersion of a leaf of its screen distribution into the ambient space. We prove, under certain geometric conditions, that such immersions are contained in semi-Euclidean spheres or hyperbolic spac…

Newton's method tackles nonlinear mappings into vector bundles with connections and retractions.

Study on null hypersurfaces in complex contact manifolds.

Study uses Newton polytopes to distinguish Lagrangian fillings of Legendrian submanifolds.

This paper focusses on "safe" screening techniques for the LASSO problem. Motivated by the need for low-complexity algorithms, we propose a new approach, dubbed "joint" screening test, allowing to screen a set of atoms by carrying out one single test. The approach is particularized to two different sets of atoms, respe…

Screening rules help identify active sets in optimization problems.