Optimizes subset selection in sparse learning problems.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Asymptotically optimal algorithm for contextual linear bandits.
A new framework for training structured prediction models using smoothing.
Efficient algorithm solves best subset selection problem.
In this paper, we consider a class of finite-sum convex optimization problems whose objective function is given by the summation of () smooth components together with some other relatively simple terms. We first introduce a deterministic primal-dual gradient (PDG) method that can achieve the optimal black-bo…
Mirror flows converge to a limiting flow with a convex potential.
Dual martingales improve primal optimal stopping problem efficiency.
This paper certifies cluster assignments from sum-of-norms clustering algorithms.
Method prevents model divergence in rapidly changing ad markets.
Unified algorithm solves convex optimization problems with optimal rates.
Drago optimizes DRO problems with faster convergence.
Paper proposes a novel metric learning algorithm using Riemannian optimization.
We study primal-dual type stochastic optimization algorithms with non-uniform sampling. Our main theoretical contribution in this paper is to present a convergence analysis of Stochastic Primal Dual Coordinate (SPDC) Method with arbitrary sampling. Based on this theoretical framework, we propose Optimality Violation-ba…
We present a primal-dual algorithmic framework to obtain approximate solutions to a prototypical constrained convex optimization problem, and rigorously characterize how common structural assumptions affect the numerical efficiency. Our main analysis technique provides a fresh perspective on Nesterov's excessive gap te…
In this paper, we study a constrained utility maximization problem following the convex duality approach. After formulating the primal and dual problems, we construct the necessary and sufficient conditions for both the primal and dual problems in terms of FBSDEs plus additional conditions. Such formulation then allows…
PDCA algorithm learns policies for RL with constraints using a primal-dual approach.
CRPO solves challenging SRL problems with convergence guarantee.
New algorithm for federated learning with non-smooth regularizers.
Quantized Stochastic Primal-Dual Methods for Distributed Optimization
Paper explores generalization of minimax learners, proposing a new metric.
New algorithms improve computation of optimal transport and Wasserstein barycenter.
Constrained Markov Decision Process (CMDP) is a natural framework for reinforcement learning tasks with safety constraints, where agents learn a policy that maximizes the long-term reward while satisfying the constraints on the long-term cost. A canonical approach for solving CMDPs is the primal-dual method which updat…
We introduce Primal-Dual Wasserstein GAN, a new learning algorithm for building latent variable models of the data distribution based on the primal and the dual formulations of the optimal transport (OT) problem. We utilize the primal formulation to learn a flexible inference mechanism and to create an optimal approxim…
In the present paper, the primal-dual problem consisting of the investment risk minimization problem and the expected return maximization problem in the mean-variance model is discussed using replica analysis. As a natural extension of the investment risk minimization problem under only a budget constraint that we anal…
We study regularity properties of the dynamic value functions of primal and dual problems of optimal investing for utility functions defined on the whole real line. Relations between decomposition terms of value processes of primal and dual problems and between optimal solutions of basic and conditional utility maximiz…
We consider a generic convex optimization problem associated with regularized empirical risk minimization of linear predictors. The problem structure allows us to reformulate it as a convex-concave saddle point problem. We propose a stochastic primal-dual coordinate (SPDC) method, which alternates between maximizing ov…
In this paper, we revisit the portfolio optimization problems of the minimization/maximization of investment risk under constraints of budget and investment concentration (primal problem) and the maximization/minimization of investment concentration under constraints of budget and investment risk (dual problem) for the…
Derives a primal-dual MLSVD formulation for multilinear data.
Improved MPC with neural networks and active sets for large-scale problems.
Paper solves optimal transport with neural nets, also detects anomalies.
We propose a doubly stochastic primal-dual coordinate optimization algorithm for empirical risk minimization, which can be formulated as a bilinear saddle-point problem. In each iteration, our method randomly samples a block of coordinates of the primal and dual solutions to update. The linear convergence of our method…
A new method for distributed optimization reduces communication rounds without minibatches.
New algorithm speeds up large-scale statistical inference.
Entropic regularization is quickly emerging as a new standard in optimal transport (OT). It enables to cast the OT computation as a differentiable and unconstrained convex optimization problem, which can be efficiently solved using the Sinkhorn algorithm. However, entropy keeps the transportation plan strictly positive…
In this paper, we consider the problem of recovering a sparse signal based on penalized least squares formulations. We develop a novel algorithm of primal-dual active set type for a class of nonconvex sparsity-promoting penalties, including , bridge, smoothly clipped absolute deviation, capped and mini…
We develop a primal dual active set with continuation algorithm for solving the \ell^0-regularized least-squares problem that frequently arises in compressed sensing. The algorithm couples the the primal dual active set method with a continuation strategy on the regularization parameter. At each inner iteration, it fir…
Algorithm optimizes constrained reinforcement learning with dual variables.
LEAD algorithm speeds up decentralized optimization with compression.
New methods solve saddle point problems without line search.
We study a stochastic and distributed algorithm for nonconvex problems whose objective consists of a sum of nonconvex -smooth functions, plus a nonsmooth regularizer. The proposed NonconvEx primal-dual SpliTTing (NESTT) algorithm splits the problem into subproblems, and utilizes an augmented Lagrangian b…
Improved first-order algorithm for entropy regularized OT with faster convergence.
Incremental clustering approaches have been proposed for handling large data when given data set is too large to be stored. The key idea of these approaches is to find representatives to represent each cluster in each data chunk and final data analysis is carried out based on those identified representatives from all t…
We relate the minimax game of generative adversarial networks (GANs) to finding the saddle points of the Lagrangian function for a convex optimization problem, where the discriminator outputs and the distribution of generator outputs play the roles of primal variables and dual variables, respectively. This formulation …
For classification of the high frequency trading quantities, waiting times, price increments within and between sessions are referred to as the a-, b-, and c-increments. Statistics of the a-b-c-increments are computed for the Time & Sales records posted by the Chicago Mercantile Exchange Group for the futures traded on…
In this paper, we propose a probabilistic optimization method, named probabilistic incremental proximal gradient (PIPG) method, by developing a probabilistic interpretation of the incremental proximal gradient algorithm. We explicitly model the update rules of the incremental proximal gradient method and develop a syst…
New algorithms solve convex-concave problems faster than previous methods.
A new algorithm reduces the complexity of solving optimal transport problems.
New algorithm improves on EM for streaming data, outperforming existing methods.