We consider an optimal stopping problem where a constraint is placed on the distribution of the stopping time. Reformulating the problem in terms of so-called measure-valued martingales allows us to transform the marginal constraint into an initial condition and view the problem as a stochastic control problem; we esta…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “dynamic programming principle”
Paper explores two methods for optimal portfolio selection in financial markets.
problem Optimal portfolio selection for financial markets with jumps.
method Maximum principle and dynamic programming approach.
result Relationship between two methods and their adjoint processes.
dynestyx: A library for probabilistic programming of dynamical systems
problem integrating state-space models into probabilistic programming languages
method a unified interface for specifying priors and performing inference
result principled uncertainty quantification for state and parameters
Optimal Control Theory optimizes neural networks, improving robustness and efficiency.
problem Optimizing deep neural networks (DNNs) for better performance and efficiency.
method Integrating Optimal Control Theory with Backpropagation to develop a new optimizer.
result Optimal Control Theoretic Neural Optimizer (OCNOpt) improves upon existing methods in robustness and efficiency.
Study values American passport options in an exponential Lévy model.
problem Valuing an exotic derivative called the American passport option.
method Derived pricing equation using dynamic programming principle and proved viscosity solution.
result Option value is a viscosity solution of variational inequality and is convex.
New metric derived for robust optimization in stochastic control problems.
problem Non-parametric uncertainty in multiperiod stochastic control problems.
method Derived a new metric, adapted --Wasserstein distance, and used dynamic programming principle.
result Dynamic programming principle for DRO problems with semi-separable cost functions.
Choosing a portfolio of risky assets over time that maximizes the expected return at the same time as it minimizes portfolio risk is a classical problem in Mathematical Finance and is referred to as the dynamic Markowitz problem (when the risk is measured by variance) or more generally, the dynamic mean-risk problem. I…
We describe an abstract control-theoretic framework in which the validity of the dynamic programming principle can be established in continuous time by a verification of a small number of structural properties. As an application we treat several cases of interest, most notably the lower-hedging and utility-maximization…
We provide a dynamic programming principle for stochastic optimal control problems with expectation constraints. A weak formulation, using test functions and a probabilistic relaxation of the constraint, avoids restrictions related to a measurable selection but still implies the Hamilton-Jacobi-Bellman equation in the …
We give the simple proof of Bobkov's inequality using the arguments of dynamical programming principle. As a byproduct of the method we obtain a characterization of optimizers.
We study a stochastic game where one player tries to find a strategy such that the state process reaches a target of controlled-loss-type, no matter which action is chosen by the other player. We provide, in a general setup, a relaxed geometric dynamic programming principle for this problem and derive, for the case of …
Richard Bellman's Principle of Optimality, formulated in 1957, is the heart of dynamic programming, the mathematical discipline which studies the optimal solution of multi-period decision problems. In this paper, we look at the main trading principles of Jesse Livermore, the legendary stock operator whose method was pu…
The paper solves complex control problems using neural networks.
problem Solving McKean-Vlasov control problems.
method Mean-field neural networks and algorithms based on dynamic programming and stochastic maximum principle.
result Extensive numerical results show the accuracy of the proposed algorithms.
Risk measures applied to dynamic Markov processes with varying risk aversion.
problem Investigating dynamic risk measures in Markov decision processes with varying risk aversion.
method Distributional viewpoint on law-invariant convex risk measures, applied to Markov decision processes with latent costs and random actions.
result Existence of optimal policies in finite and infinite time horizons under mild assumptions.
Deep learning solves complex stochastic control with jumps.
problem Solving high-dimensional stochastic control tasks with jumps.
method Model-based approach using two neural networks, iteratively trained with objectives derived from the Hamilton-Jacobi-Bellman equation.
result Demonstrates effectiveness in solving complex high-dimensional stochastic control tasks.
Improved machine learning for reservoir optimization problems.
problem Optimizing control in high-dimensional storage problems.
method Modified dynamic programming algorithm with neural networks for Bellman values and conditional cuts.
result Neural networks outperform classical feedforward networks in estimating Bellman values.
Develops a model for bid and ask prices using stochastic control.
problem Modeling bid and ask prices of a European asset.
method Formulates a stochastic control problem, uses Girsanov theorem, Esscher transform, and dynamic programming.
result Derives equations to determine bid and ask prices.
Model stock price dynamics using semi-Markov processes.
problem Model stock price dynamics through a semi-Markov process.
method Use semi-Markov process with Poisson random measure, establish existence and uniqueness of solution, derive HJB equation.
result Obtain expressions for optimal controls and value function using HJB equation.
Paper characterizes optimal learning trajectories for high-dimensional nonlinear models.
problem Characterizing optimal learning trajectories in high-dimensional nonlinear models.
method Exploits maximum principle and dynamic programming for an optimal control problem of a gradient system.
result Constructs optimal learning trajectories leading to optimal model parameters.
The pricing of American style and multiple exercise options is a very challenging problem in mathematical finance. One usually employs a Least-Square Monte Carlo approach (Longstaff-Schwartz method) for the evaluation of conditional expectations which arise in the Backward Dynamic Programming principle for such optimal…
Stochastic Perron's Method for the Probability of lifetime ruin problem under transaction costsmath.OC
We apply stochastic Perron's method to a singular control problem where an individual targets at a given consumption rate, invests in a risky financial market in which trading is subject to proportional transaction costs, and seeks to minimize her probability of lifetime ruin. Without relying on the dynamic programming…
Unified framework for model- and value-optimistic reinforcement learning.
problem Designing and analyzing algorithms for episodic reinforcement learning.
method Lagrangian duality for a unified view of optimism.
result Unified algorithms with both efficient implementation and probabilistic analysis.
The optimal investment strategy of a DC pension plan under deposit loan spread and the O-U processq-fin.PM
This paper optimizes DC pension plan investments using O-U process and loan.
problem Optimizing investment strategy for DC pension plans under specific market conditions.
method Dynamic programming and Hamilton-Jacobi-Bellman equation to derive optimal investment strategy.
result Explicit expression for optimal investment strategy derived.
Viscosity properties with singularities in a state-constrained expected utility maximization problemq-fin.MF
We consider the value function originating from an expected utility maximization problem with finite fuel constraint and show its close relation to a nonlinear parabolic degenerated Hamilton-Jacobi-Bellman (HJB) equation with singularity. On one hand, we give a so-called verification argument based on the dynamic progr…
We consider an impulse control problem in infinite horizon applied with switching technology. We suppose that the firm decides at certain moments (impulse moments) to switch technology, leading to a jump of the firm value. We show that the value function for such problems satisfies a dynamic programming principle versi…
Develops RL for dynamic risk assessment in stochastic optimization.
problem Time-consistent risk assessment in stochastic optimization problems.
method Model-free reinforcement learning with dynamic convex risk measures, time-consistent dynamic programming, policy gradient updates, actor-critic neural network optimization.
result Demonstrates optimal policies for statistical arbitrage, financial hedging, and robot control.
Paper introduces a new volatility model for natural gas markets and discusses swing option pricing.
problem Modeling price and storage dynamics in natural gas markets with path-dependent volatility.
method Developed a novel stochastic path-dependent volatility model and used deep learning for swing option pricing.
result Proposed a deep learning method for numerical approximations of swing option pricing.
This paper optimizes sampling policies for Bayesian optimization to improve exploration and exploitation.
problem Improving the balance between exploration and exploitation in Bayesian optimization.
method Developed efficient methods to estimate and optimize non-myopic acquisition functions using rollout policies and stochastic gradient optimization.
result Efficient optimization of sampling policies leads to better performance in Bayesian optimization.
The classical dynamic programming-based optimal stochastic control methods fail to cope with nonseparable dynamic optimization problems as the principle of optimality no longer applies in such situations. Among these notorious nonseparable problems, the dynamic mean-variance portfolio selection formulation had posted a…
Abstract perspective on quadratic programming for optimal portfolio allocation.
problem Optimal allocation problems in long portfolio theory.
method Using maximum principles and distinguished boundaries in reproducing kernel Hilbert spaces.
result Support of an optimal distribution lies in a variety intersecting a distinguished boundary.
We construct an utility-based dynamic asset pricing model for a limit order market. The price is nonlinear in volume and subject to market impact. We solve an optimal hedging problem under the market impact and derive the dynamics of the efficient price, that is, the asset price when a representative liquidity demander…
New framework for robust reinforcement learning policies in uncertain environments.
problem Robust reinforcement learning policies in environments with distributional shifts.
method Comprehensive modeling framework centered around robust Markov decision processes (RMDPs).
result Existence and conditions for the dynamic programming principle (DPP) in RMDPs.
In this paper, we analyze dynamic programming as a novel approach to solve the problem of maximizing the profits of a bank. The mathematical model of the problem and the description of a bank's work is described in this paper. The problem is then approached using the method of dynamic programming. Dynamic programming m…
Study optimizes insurance investment to maximize utility across all capital levels.
problem Maximizing expected utility across all capital levels in an insurance company's investment strategy.
method Dynamic Programming Principle and Hamilton-Jacobi-Bellman (HJB) equation to prove existence of optimal strategy.
result Existence of optimal investment strategy proven under certain conditions.
GT-DDP optimizer trains residual networks using game theory.
problem Applying DDP to residual networks.
method Game-theoretic DDP optimizer for residual networks.
result Improved training convergence and variance reduction.
Approximate dynamic programming algorithms, such as approximate value iteration, have been successfully applied to many complex reinforcement learning tasks, and a better approximate dynamic programming algorithm is expected to further extend the applicability of reinforcement learning to various tasks. In this paper w…
Probabilistic programs with dynamic computation graphs can define measures over sample spaces with unbounded dimensionality, which constitute programmatic analogues to Bayesian nonparametrics. Owing to the generality of this model class, inference relies on `black-box' Monte Carlo methods that are often not able to tak…
This paper improves dynamic hedging accuracy using genetic programming to forecast implied volatilities.
problem Improving the accuracy of dynamic hedging using implied volatilities.
method The paper uses genetic programming to forecast implied volatilities and tests the performance of these forecasts in dynamic hedging strategies.
result Genetic programming-generated implied volatilities improve hedging accuracy compared to static training methods.
We extend the stochastic Perron method to analyze the framework of stochastic target games, in which one player tries to find a strategy such that the state process almost surely reaches a given target no matter which action is chosen by the other player. Within this framework, our method produces a viscosity sub-solut…
Paper aims to minimize ruin probability in insurance companies using Sparre Andersen model.
problem Minimizing ruin probability in insurance companies with Sparre Andersen surplus process.
method Markovization of the surplus process, investigation of value function's regularity, dynamic programming principle, and comparison of viscosity solutions.
result The value function is the unique constrained viscosity solution to the Hamilton-Jacobi-Bellman equation.
New method uses dynamic programming for meta continual learning.
problem Challenges of generalization and catastrophic forgetting in sequential learning.
method Developed a theoretical framework using dynamic programming for meta continual learning.
result Theoretical and practical method achieves better accuracy than existing methods.
The martingale optimal transport aims to optimally transfer a probability measure to another along the class of martingales. This problem is mainly motivated by the robust superhedging of exotic derivatives in financial mathematics, which turns out to be the corresponding Kantorovich dual. In this paper we consider the…
There is a perceived trade-off between machine learning code that is easy to write, and machine learning code that is scalable or fast to execute. In machine learning, imperative style libraries like Autograd and PyTorch are easy to write, but suffer from high interpretive overhead and are not easily deployable in prod…
Study Nash equilibria in mean field portfolio games with consumption.
problem Finding Nash equilibria in mean field portfolio games with consumption.
method Established a correspondence between equilibria and solutions to FBSDEs, using martingale and dynamic programming principles.
result Proved the uniqueness of Nash equilibrium in closed form under certain conditions.
We consider the robust exponential utility maximization problem in discrete time: An investor maximizes the worst case expected exponential utility with respect to a family of nondominated probabilistic models of her endowment by dynamically investing in a financial market, and statically in available options. We show …
Discrete time portfolio optimisation managing value at risk under heavy tail return distributionq-fin.PM
We consider an investor, whose portfolio consists of a single risky asset and a risk free asset, who wants to maximize his expected utility of the portfolio subject to the Value at Risk assuming a heavy tail distribution of the stock prices return. We use Markov Decision Process and dynamic programming principle to get…
We consider the learning of algorithmic tasks by mere observation of input-output pairs. Rather than studying this as a black-box discrete regression problem with no assumption whatsoever on the input-output mapping, we concentrate on tasks that are amenable to the principle of divide and conquer, and study what are it…
New methods improve global optimisation for expensive functions using lookahead strategies.
problem Optimising expensive functions without gradient info in high dimensions.
method Nonmyopic acquisition strategies based on approximate dynamic programming.
result Nonmyopic methods outperform myopic approaches in various applications.