A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Bayesian estimators for causal inference using hierarchical Gaussian Processes.
Quantum algorithms accelerate financial risk computation.
The estimation of advantage is crucial for a number of reinforcement learning algorithms, as it directly influences the choices of future paths. In this work, we propose a family of estimates based on the order statistics over the path ensemble, which allows one to flexibly drive the learning process, towards or agains…
This paper improves Q-learning bounds using reference-advantage decomposition.
Quantum advantage in derivative pricing requires 8k qubits and 54M T-depth.
Paper introduces DTAE to optimize RL algorithms, balancing exploration and exploitation.
Deep neural networks outperform other methods in estimating non-smooth functions with singularities.
New method learns time-varying home field advantage in football.
Quantum algorithms improve VaR and CVaR estimation for financial derivatives.
In traditional reinforcement learning, an agent maximizes the reward collected during its interaction with the environment by approximating the optimal policy through the estimation of value functions. Typically, given a state s and action a, the corresponding value is the expected discounted sum of rewards. The optima…
We present a method to derive local estimates for some classes of fully nonlinear elliptic equations. The advantage of our method is that we derive Hessian estimates directly from estimates. Also, the method is flexible and can be applied to a large class of equations.
The problem of estimating the number of sources and their angles of arrival from a single antenna array observation has been an active area of research in the signal processing community for the last few decades. When the number of sources is large, the maximum likelihood estimator is intractable due to its very high c…
Infinite horizon off-policy policy evaluation is a highly challenging task due to the excessively large variance of typical importance sampling (IS) estimators. Recently, Liu et al. (2018a) proposed an approach that significantly reduces the variance of infinite-horizon off-policy evaluation by estimating the stationar…
Develops a method to efficiently use offline data for RL policy optimization.
Proposes a new simulator for complex arrival processes.
We propose a simple method that combines neural networks and Gaussian processes. The proposed method can estimate the uncertainty of outputs and flexibly adjust target functions where training data exist, which are advantages of Gaussian processes. The proposed method can also achieve high generalization performance fo…
After presenting Actor Critic Methods (ACM), we show ACM are control variate estimators. Using the projection theorem, we prove that the Q and Advantage Actor Critic (A2C) methods are optimal in the sense of the norm for the control variate estimators spanned by functions conditioned by the current state and acti…
Policy optimization on high-dimensional continuous control tasks exhibits its difficulty caused by the large variance of the policy gradient estimators. We present the action subspace dependent gradient (ASDG) estimator which incorporates the Rao-Blackwell theorem (RB) and Control Variates (CV) into a unified framework…
TROLL improves RL for LLMs by replacing clipping with a trust region projection.
High-dimensional sparse modeling via regularization provides a powerful tool for analyzing large-scale data sets and obtaining meaningful, interpretable models. The use of nonconvex penalty functions shows advantage in selecting important features in high dimensions, but the global optimality of such methods still dema…
Entrocraft addresses RL performance saturation in LLMs by customizing entropy curves.
New federated method preserves privacy and estimates treatment effects.
The estimation of normalizing constants is a fundamental step in probabilistic model comparison. Sequential Monte Carlo methods may be used for this task and have the advantage of being inherently parallelizable. However, the standard choice of using a fixed number of particles at each iteration is suboptimal because s…
Quantum method speeds up risk estimation for insurance tail risks.
GANICE improves GAN-based causal inference by minimizing averaged Wasserstein risk.
The scalability of statistical estimators is of increasing importance in modern applications. One approach to implementing scalable algorithms is to compress data into a low dimensional latent space using dimension reduction methods. In this paper we develop an approach for dimension reduction that exploits the assumpt…
We study the problem of finding the most mutually correlated arms among many arms. We show that adaptive arms sampling strategies can have significant advantages over the non-adaptive uniform sampling strategy. Our proposed algorithms rely on a novel correlation estimator. The use of this accurate estimator allows us t…
We propose and analyze estimators for statistical functionals of one or more distributions under nonparametric assumptions. Our estimators are based on the theory of influence functions, which appear in the semiparametric statistics literature. We show that estimators based either on data-splitting or a leave-one-out t…
In this work, we present direction-of-arrival (DoA) estimation algorithms based on the Krylov subspace that effectively exploit prior knowledge of the signals that impinge on a sensor array. The proposed multi-step knowledge-aided iterative conjugate gradient (CG) (MS-KAI-CG) algorithms perform subtraction of the unwan…
New proof for stability estimates in complex equations without pluripotential theory.
The authors propose a parametric model called the arena model for prediction in paired competitions, i.e. paired comparisons with eliminations and bifurcations. The arena model has a number of appealing advantages. First, it predicts the results of competitions without rating many individuals. Second, it takes full adv…
New method estimates mutual information using normalizing flows.
New approach optimizes policies in adversarial MDPs using adversarial learning.
New estimator improves mutual information estimation.
We propose an estimation method for the conditional mode when the conditioning variable is high-dimensional. In the proposed method, we first estimate the conditional density by solving quantile regressions multiple times. We then estimate the conditional mode by finding the maximum of the estimated conditional density…
Estimates time-varying parameters from two OLS estimates.
DRL agents perform poorly at high decision frequencies, but a new algorithm improves performance.
Distributed securities exchanges may become de facto fragmented if they span geographical regions with asymmetric computer infrastructure. First, we build an economic model of a decentralized exchange with two miner clusters, standing in for compact areas of economic activity (e.g., cities). "Local" miners in the area …
Bayesian SAE model with spectral clustering and uncertainty quantification.
New model learning objective improves continuous control tasks.
Paper develops a new estimator for high-dimensional panel data with common shocks.
A new DDPM for link prediction using sub-graph likelihood estimation.
Deep learning solves and estimates complex financial models.
We extend CS divergence to conditional distributions and show its advantages in time series data and sequential decision making.
Uniform bounds for complex equations using Monge-Ampère method.
Recent policy optimization approaches have achieved substantial empirical success by constructing surrogate optimization objectives. The Approximate Policy Iteration objective (Schulman et al., 2015a; Kakade and Langford, 2002) has become a standard optimization target for reinforcement learning problems. Using this ob…
New method tightens variational representations of divergences for faster learning.
Develops a novel fast bootstrap for dependent data with higher-order accuracy.