A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Paper explores weighted averaging schemes for SGD, achieving asymptotic normality and optimality.
We propose and analyze a variant of the classic Polyak-Ruppert averaging scheme, broadly used in stochastic gradient methods. Rather than a uniform average of the iterates, we consider a weighted average, with weights decaying in a geometric fashion. In the context of linear least squares regression, we show that this …
Stochastic Gradient Descent (SGD) is one of the simplest and most popular stochastic optimization methods. While it has already been theoretically studied for decades, the classical analysis usually required non-trivial smoothness assumptions, which do not apply to many modern applications of SGD with non-smooth object…
Many problems in machine learning and game theory can be formulated as saddle-point problems, for which various first-order methods have been developed and proven efficient in practice. Under the general convex-concave assumption, most first-order methods only guarantee an ergodic convergence rate, that is, the uniform…
This paper analyzes SGD with increasingly weighted averaging for optimization and generalization.
In this paper, a standard PDE for the pricing of arithmetic average strike Asian call option is presented. A Crank-Nicolson Implicit Method and a Higher Order Compact finite difference scheme for this pricing problem is derived. Both these schemes were implemented for various values of risk free rate and volatility. Th…
We introduce a new wavelet transform suitable for analyzing functions on point clouds and graphs. Our construction is based on a generalization of the average interpolating refinement scheme of Donoho. The most important ingredient of the original scheme that needs to be altered is the choice of the interpolant. Here, …
New averaging technique speeds up Newton method convergence.
Q-learning for average cost MDPs gets a concentration bound.
New aggregation methods improve robustness and efficiency in distributed learning.
Study classifies stock price data into stationary and non-stationary periods for mechanical trading.
The definition of the covariant space-time averaging scheme for the objects (tensors, geometric objects, etc.) on differentiable metric manifolds with a volume n-form, which has been proposed for the formulation of macroscopic gravity, is analyzed. An overview of the space-time averaging procedure in Minkowski spacetim…
KL regularization helps RL algorithms by implicitly averaging q-values.
This work characterizes the benefits of averaging schemes widely used in conjunction with stochastic gradient descent (SGD). In particular, this work provides a sharp analysis of: (1) mini-batching, a method of averaging many samples of a stochastic gradient to both reduce the variance of the stochastic gradient estima…
Feature extraction is a very crucial task in image and pixel (voxel) classification and regression in biomedical image modeling. In this work we present a machine learning based feature extraction scheme based on inception models for pixel classification tasks. We extract features under multi-scale and multi-layer sche…
The variance reduction class of algorithms including the representative ones, SVRG and SARAH, have well documented merits for empirical risk minimization problems. However, they require grid search to tune parameters (step size and the number of iterations per inner loop) for optimal performance. This work introduces `…
New algorithm uses Whittle index to improve Q-learning for restless bandits.
New method approximates CVaR with less data for heavy-tailed risks.
In this note, we present a new averaging technique for the projected stochastic subgradient method. By using a weighted average with a weight of t+1 for each iterate w_t at iteration t, we obtain the convergence rate of O(1/t) with both an easy proof and an easy implementation. The new scheme is compared empirically to…
In this work we develop a new algorithm for regularized empirical risk minimization. Our method extends recent techniques of Shalev-Shwartz [02/2015], which enable a dual-free analysis of SDCA, to arbitrary mini-batching schemes. Moreover, our method is able to better utilize the information in the data defining the ER…
Enhances trading signals using image analysis and weighted moving averages.
A novel fully asynchronous scheme for distributed reinforcement learning over networks.
The paper studies risk-sensitive learning schemes and provides learning bounds for empirical OCE minimizers.
This paper augments the reward received by a reinforcement learning agent with potential functions in order to help the agent learn (possibly stochastic) optimal policies. We show that a potential-based reward shaping scheme is able to preserve optimality of stochastic policies, and demonstrate that the ability of an a…
PEAK tests means of multiple data streams with sequential betting.
Paper analyzes how EMA improves SGD in linear regression.
SQR Averaging improves probabilistic electricity price forecasting.
LASSO-PCA combines LASSO and PCA for automated forecast averaging.
Paper proposes efficient communication scheme for statistical learning.
Low-rank structure have been profoundly studied in data mining and machine learning. In this paper, we show a dense matrix 's low-rank approximation can be rapidly built from its left and right random projections and , or bilateral random projection (BRP). We then show power scheme can further…
FP-BMA improves generalization by encouraging flat posteriors in Bayesian Model Averaging.
Strategy evaluation schemes are a crucial factor in any agent-based market model, as they determine the agents' strategy preferences and consequently their behavioral pattern. This study investigates how the strategy evaluation schemes adopted by agents affect their performance in conjunction with the market circumstan…
Study optimal reward schemes for inducing desired player performance in risky contests.
Hybrid approach improves probabilistic forecasts for electricity trading.
We apply stochastic average gradient (SAG) algorithms for training conditional random fields (CRFs). We describe a practical implementation that uses structure in the CRF gradient to reduce the memory requirement of this linearly-convergent stochastic gradient method, propose a non-uniform sampling scheme that substant…
Robustness is an increasingly important property of machine learning models as they become more and more prevalent. We propose a defense against adversarial examples based on a k-nearest neighbor (kNN) on the intermediate activation of neural networks. Our scheme surpasses state-of-the-art defenses on MNIST and CIFAR-1…
Federated learning technique improves convergence speed with communication delays.
This paper analyzes the convergence of Federated Average under relaxed assumptions.
A new Bayesian modeling method is proposed by combining the maximization of the marginal likelihood with a momentum-space renormalization group transformation for Gaussian graphical models. Moreover, we present a scheme for computint the statistical averages of hyperparameters and mean square errors in our proposed met…
Revises Bayesian model averaging for foundation models.
Study shows different initialization schemes for LoRA finetuning impact performance.
Proposes a non-convex optimization method for a parsimonious weighted naive Bayes classifier.
New CNN initialization scheme derived from modern architectures.
This paper deals with the efficient numerical solution of the two-dimensional partial integro-differential complementarity problem (PIDCP) that holds for the value of American-style options under the two-asset Merton jump-diffusion model. We consider the adaptation of various operator splitting schemes of both the impl…
Despite the success of single-agent reinforcement learning, multi-agent reinforcement learning (MARL) remains challenging due to complex interactions between agents. Motivated by decentralized applications such as sensor networks, swarm robotics, and power grids, we study policy evaluation in MARL, where agents with jo…
Paper analyzes complexity of solving nonconvex-strongly-concave problems.
The paper provides bounds for regression schemes using nonstationary training samples.
We study the problem of adaptive control of a high dimensional linear quadratic (LQ) system. Previous work established the asymptotic convergence to an optimal controller for various adaptive control schemes. More recently, for the average cost LQ problem, a regret bound of was shown, apart form logarit…