Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

169,051 papers · 148 categories

Trend · papers per month

7.8%15.6%23.3%31.1% · Jun 202019922001200920172026
48 results for primal incremental optimization

Asymptotically optimal algorithm for contextual linear bandits.

problem Contextual linear bandits with suboptimal algorithms.
method Decoupling context distribution and exploration policy, incremental primal-dual approach, confidence intervals.
result Asymptotic optimality and scalability of the algorithm.

A new framework for training structured prediction models using smoothing.

problem Training smooth structured prediction models with non-smooth objectives.
method Smoothing over the maximum margin structured prediction objective to enable fast optimization.
result The proposed framework enables the use of efficient optimization algorithms for structured prediction.

In this paper, we consider a class of finite-sum convex optimization problems whose objective function is given by the summation of mm (1\ge 1) smooth components together with some other relatively simple terms. We first introduce a deterministic primal-dual gradient (PDG) method that can achieve the optimal black-bo…

2015-07-08abs ↗pdf ↗

This paper certifies cluster assignments from sum-of-norms clustering algorithms.

problem Certifying the correct cluster assignments from approximate solutions of sum-of-norms clustering.
method Presented a clustering test that identifies and certifies the correct cluster assignment from an approximate solution.
result The correct cluster assignment is guaranteed to be certified by a primal-dual path following algorithm after sufficient iterations.

Method prevents model divergence in rapidly changing ad markets.

problem Model divergence due to rapid ad turnover and discontinuity.
method Dual ascent optimization with latent vector constraints.
result Significant reduction in diverging instances and improved user experience/revenue.

Unified algorithm solves convex optimization problems with optimal rates.

problem Solving nonsmooth constrained convex optimization problems.
method Unified randomized block-coordinate primal-dual algorithm.
result Achieves optimal convergence rates of O(n/k)\mathcal{O}(n/k) and O(n2/k2)\mathcal{O}(n^2/k^2).

Drago optimizes DRO problems with faster convergence.

problem Distributionally robust optimization with closed, convex uncertainty sets.
method Primal-dual coupled variance reduction algorithm with cyclic and randomized updates.
result Achieves state-of-the-art linear convergence rate on strongly convex-strongly concave problems.

Paper proposes a novel metric learning algorithm using Riemannian optimization.

problem Optimizing a smooth, convex function in Riemannian space with constraints.
method Developed a primal-dual algorithm with proximal operator for iterative optimization.
result Demonstrated the efficacy of the proposed metric learning algorithm on fund selection.

We present a primal-dual algorithmic framework to obtain approximate solutions to a prototypical constrained convex optimization problem, and rigorously characterize how common structural assumptions affect the numerical efficiency. Our main analysis technique provides a fresh perspective on Nesterov's excessive gap te…

2014-06-20abs ↗pdf ↗

In this paper, we study a constrained utility maximization problem following the convex duality approach. After formulating the primal and dual problems, we construct the necessary and sufficient conditions for both the primal and dual problems in terms of FBSDEs plus additional conditions. Such formulation then allows…

2016-12-13abs ↗pdf ↗

PDCA algorithm learns policies for RL with constraints using a primal-dual approach.

problem Offline constrained reinforcement learning with general function approximation.
method Primal-Dual-Critic Algorithm (PDCA) using a primal-dual approach.
result PDCA finds a near saddle point of the Lagrangian, nearly optimal for constrained RL.

Quantized Stochastic Primal-Dual Methods for Distributed Optimization

problem Distributed optimization with stochastic gradients and finite-bit communication
method q-PDGD, a quantized stochastic primal-dual method
result Linear contraction to an explicit neighborhood under RSI, O(1/k) convergence under PL inequality

Paper explores generalization of minimax learners, proposing a new metric.

problem Understanding how minimax learners perform on unseen data.
method Proposes a new metric, the primal gap, to study generalization of minimax learners.
result Derives generalization error bounds for the primal gap in nonconvex-concave settings.

New algorithms improve computation of optimal transport and Wasserstein barycenter.

problem Computing optimal transport and Wasserstein barycenter for multiple probability distributions.
method Introduced APDRCD and APDGCD algorithms for efficient computation, demonstrating better performance than existing methods.
result New algorithms match or exceed the best known complexities for OT problems and improve practical performance.

We introduce Primal-Dual Wasserstein GAN, a new learning algorithm for building latent variable models of the data distribution based on the primal and the dual formulations of the optimal transport (OT) problem. We utilize the primal formulation to learn a flexible inference mechanism and to create an optimal approxim…

2018-05-24abs ↗pdf ↗

In the present paper, the primal-dual problem consisting of the investment risk minimization problem and the expected return maximization problem in the mean-variance model is discussed using replica analysis. As a natural extension of the investment risk minimization problem under only a budget constraint that we anal…

2016-09-18abs ↗pdf ↗

In this paper, we revisit the portfolio optimization problems of the minimization/maximization of investment risk under constraints of budget and investment concentration (primal problem) and the maximization/minimization of investment concentration under constraints of budget and investment risk (dual problem) for the…

2017-09-14abs ↗pdf ↗

A new method for distributed optimization reduces communication rounds without minibatches.

problem Efficient training in distributed machine learning with different data distributions.
method A primal-dual method (GA-MSGD) applied to the Lagrangian of distributed optimization.
result Achieves linear convergence in communication rounds for strongly convex objectives.

New algorithm speeds up large-scale statistical inference.

problem Efficiently solving large-scale mean-field variational inference problems.
method Developed a novel primal-dual algorithm (PD-VI) and a block-preconditioned extension (P2^2D-VI) for mean-field variational inference.
result PD-VI and P2^2D-VI achieve faster convergence and better solution quality compared to existing methods.

Entropic regularization is quickly emerging as a new standard in optimal transport (OT). It enables to cast the OT computation as a differentiable and unconstrained convex optimization problem, which can be efficiently solved using the Sinkhorn algorithm. However, entropy keeps the transportation plan strictly positive…

2017-10-17abs ↗pdf ↗

In this paper, we consider the problem of recovering a sparse signal based on penalized least squares formulations. We develop a novel algorithm of primal-dual active set type for a class of nonconvex sparsity-promoting penalties, including 0\ell^0, bridge, smoothly clipped absolute deviation, capped 1\ell^1 and mini…

2013-10-04abs ↗pdf ↗

Algorithm optimizes constrained reinforcement learning with dual variables.

problem Minimizing convex functional subject to convex constraint in large state spaces.
method VPDPO algorithm using Lagrangian and Fenchel duality.
result Achieves sublinear regret and constraint violation, globally optimal policy.

LEAD algorithm speeds up decentralized optimization with compression.

problem Slow convergence and stability issues in decentralized optimization with compression.
method Proposes the first linearly convergent decentralized algorithm with compression.
result First consensus error bound for coupled dynamics of primal and dual updates.

Improved first-order algorithm for entropy regularized OT with faster convergence.

problem Solving entropy regularized optimal transport efficiently.
method Accelerated primal-dual stochastic mirror descent algorithm with variance reduction.
result Improved rate from O~(n2.5/ε)\widetilde{O}({n^{2.5}}/ε) to O~(n2/ε)\widetilde{O}({n^2}/ε).

For classification of the high frequency trading quantities, waiting times, price increments within and between sessions are referred to as the a-, b-, and c-increments. Statistics of the a-b-c-increments are computed for the Time & Sales records posted by the Chicago Mercantile Exchange Group for the futures traded on…

2013-12-06abs ↗pdf ↗

In this paper, we propose a probabilistic optimization method, named probabilistic incremental proximal gradient (PIPG) method, by developing a probabilistic interpretation of the incremental proximal gradient algorithm. We explicitly model the update rules of the incremental proximal gradient method and develop a syst…

2018-12-04abs ↗pdf ↗

New algorithms solve convex-concave problems faster than previous methods.

problem Solving min-max problems without bilinear structure.
method Stochastic primal-dual algorithms with logarithmic dual updates.
result Faster convergence rates than O(1/T)O(1/\sqrt{T}) for certain problems.

A new algorithm reduces the complexity of solving optimal transport problems.

problem Optimal transport problem with linear constraints.
method Primal-dual accelerated stochastic gradient descent with variance reduction (PDASGD).
result Achieves the best-known computational complexity of O~(n2/ε)\widetilde{\mathcal{O}}(n^2/ε) for OT problems.

New algorithm improves on EM for streaming data, outperforming existing methods.

problem Processing high-volume, streaming data efficiently.
method Incremental stochastic Majorization-Minimization (MM) algorithm.
result The algorithm converges to a stationary point with vanishing gradient.