Paper explores weighted averaging schemes for SGD, achieving asymptotic normality and optimality.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Optimizing over-the-air convex optimization, analog schemes are nearly optimal at low SNR.
We study first-order optimization methods obtained by discretizing ordinary differential equations (ODEs) corresponding to Nesterov's accelerated gradient methods (NAGs) and Polyak's heavy-ball method. We consider three discretization schemes: an explicit Euler scheme, an implicit Euler scheme, and a symplectic scheme.…
This paper revisits optimal investment strategies for defined contribution pension schemes using forward preferences.
This paper augments the reward received by a reinforcement learning agent with potential functions in order to help the agent learn (possibly stochastic) optimal policies. We show that a potential-based reward shaping scheme is able to preserve optimality of stochastic policies, and demonstrate that the ability of an a…
It is of fundamental importance to find algorithms obtaining optimal performance for learning of statistical models in distributed and communication limited systems. Aiming at characterizing the optimal strategies, we consider learning of Gaussian Processes (GPs) in distributed systems as a pivotal example. We first ad…
We establish a tight characterization of the worst-case rates for the excess risk of agnostic learning with sample compression schemes and for uniform convergence for agnostic sample compression schemes. In particular, we find that the optimal rates of convergence for size- agnostic sample compression schemes are of…
The paper analyzes convergence of Riemannian SA schemes for stochastic optimization.
The MBO scheme for data clustering is analyzed in the large data limit, proving convergence to optimal partition problems.
Study on optimal fees in hedge funds with first-loss compensation.
A new one-point feedback scheme improves ZO algorithms for black-box optimization.
Stochastic Gradient Descent (SGD) is one of the simplest and most popular stochastic optimization methods. While it has already been theoretically studied for decades, the classical analysis usually required non-trivial smoothness assumptions, which do not apply to many modern applications of SGD with non-smooth object…
Conventional research attributes the improvements of generalization ability of deep neural networks either to powerful optimizers or the new network design. Different from them, in this paper, we aim to link the generalization ability of a deep network to optimizing a new objective function. To this end, we propose a \…
Paper proves global optimality of a simple optimization scheme for learning DAG models.
We consider a general class of high order weak approximation schemes for stochastic differential equations driven by Lévy processes with infinite activity. These schemes combine a compound Poisson approximation for the jump part of the Lévy process with a high order scheme for the Brownian driven component, applied bet…
New method learns population dynamics from snapshots using JKO scheme and inverse optimization.
Paper develops a new method for optimal stopping in American options.
Boosts change-point detection power with optimal sub-sampling.
Optimal student loan repayment strategies vary based on loan size.
A new insurance and reinsurance pricing scheme based on realized loss.
Study analyzes FIT schemes under market and regulatory uncertainty.
New schemes improve error estimates for sampling from non-log-concave distributions.
We show that asymptotically, completely asynchronous stochastic gradient procedures achieve optimal (even to constant factors) convergence rates for the solution of convex optimization problems under nearly the same conditions required for asymptotic optimality of standard stochastic gradient procedures. Roughly, the n…
The paper tackles the trade-off between fairness and accuracy in machine learning models.
Suppose that a graph is realized from a stochastic block model where one of the blocks is of interest, but many or all of the vertices' block labels are unobserved. The task is to order the vertices with unobserved block labels into a ``nomination list'' such that, with high probability, vertices from the interesting b…
The paper compares numerical schemes for nonholonomic systems using retraction maps.
This paper considers the optimal dividend payment problem in piecewise-deterministic compound Poisson risk models. The objective is to maximize the expected discounted dividend payout up to the time of ruin. We provide a comparative study in this general framework of both restricted and unrestricted payment schemes, wh…
Study optimizes pension scheme risk-sharing for longevity bonds.
Optimal trading strategy derived for nonlinear price impact models.
Pension schemes all over the world are under increasing pressure to efficiently hedge the longevity risk posed by ageing populations. In this work, we study an optimal investment problem for a defined contribution pension scheme which decides to hedge the longevity risk using a mortality-linked security, typically a lo…
Suppose that one particular block in a stochastic block model is of interest, but block labels are only observed for a few of the vertices in the network. Utilizing a graph realized from the model and the observed block labels, the vertex nomination task is to order the vertices with unobserved block labels into a rank…
This article analyzes the weak error of SGD optimization schemes.
Optimized AIS scheme reduces bias and MSE for general proposals.
Optimizes pension mix of PAYGO, EET, and individual savings.
Optimal resource allocation is a fundamental challenge for dense and heterogeneous wireless networks with massive wireless connections. Because of the non-convex nature of the optimization problem, it is computationally demanding to obtain the optimal resource allocation. Recently, deep reinforcement learning (DRL) has…
Variance-reduced algorithms, although achieve great theoretical performance, can run slowly in practice due to the periodic gradient estimation with a large batch of data. Batch-size adaptation thus arises as a promising approach to accelerate such algorithms. However, existing schemes either apply prescribed batch-siz…
Improves graph recovery in Gaussian graphical modeling.
A fast, accurate method for pricing American options with free boundaries.
Improved Gumbel watermark detection method.
Bayesian optimization uses triangulation candidates for better performance.
Forecasting a time series from multivariate predictors constitutes a challenging problem, especially using model-free approaches. Most techniques, such as nearest-neighbor prediction, quickly suffer from the curse of dimensionality and overfitting for more than a few predictors which has limited their application mostl…
A new dynamic learning-rate scheme for optimization.
In this paper, we present a discrete-type approximation scheme to solve continuous-time optimal stopping problems based on fully non-Markovian continuous processes adapted to the Brownian motion filtration. The approximations satisfy suitable variational inequalities which allow us to construct -optimal stopping tim…
Optimizes functionals on probability space using ICNNs.
In a market with a rough or Markovian mean-reverting stochastic volatility there is no perfect hedge. Here it is shown how various delta-type hedging strategies perform and can be evaluated in such markets in the case of European options. A precise characterization of the hedging cost, the replication cost caused by th…
Paper proves convergence of measure transfer schemes using slicing and matching.
A novel beam training scheme optimizes multi-hop THz communications with up to 75% performance gain.
Regularized nonlinear acceleration (RNA) estimates the minimum of a function by post-processing iterates from an algorithm such as the gradient method. It can be seen as a regularized version of Anderson acceleration, a classical acceleration scheme from numerical analysis. The new scheme provably improves the rate of …