DO-IQS recovers optimal stopping region from expert trajectories, addressing specific challenges.
problem Recovering optimal stopping region from expert trajectories with unknown gain functions.
method Dynamics-Aware Offline Inverse Q-Learning incorporating temporal information and confidence-based oversampling.
result Demonstrated performance on real and artificial data, including optimal intervention for critical events.
This paper analyzes optimal stopping regions for American options with Poisson exercise opportunities.
problem Analyzing the optimal stopping regions for American options with Poisson exercise opportunities.
method Computing identities related to the first Poisson arrival time to an interval and applying them to the computation of the optimal strategies.
result Explicit expressions of the stopping and continuation regions and the value function are obtained.
Neural networks optimize stopping boundaries in financial instruments.
problem Optimizing stopping boundaries in financial instruments.
method Deep neural networks and empirical risk minimization for parameterizing stopping boundaries.
result Proved existence of stopping boundary under natural assumptions.
We use probabilistic methods to characterise time dependent optimal stopping boundaries in a problem of multiple optimal stopping on a finite time horizon. Motivated by financial applications we consider a payoff of immediate stopping of "put" type and the underlying dynamics follows a geometric Brownian motion. The op…
The research proposes a stopping rule for reinforcement learning algorithms based on instance-dependent confidence.
problem Dramatic variation in convergence rates of reinforcement learning algorithms due to problem structure.
method Develops instance-dependent confidence regions and a data-dependent stopping rule for MDP policy evaluation and optimal value estimation.
result Proposes a stopping rule that adapts to the instance-specific difficulty of the problem, allowing for early termination.
Study optimal stopping for variable annuity contracts with discontinuous rewards.
problem Optimal timing to surrender a variable annuity contract with guaranteed minimum benefit.
method Analytical study of an optimal stopping problem with a discontinuous reward function, considering general fee and surrender charge functions.
result Characterization of the surrender region and its interrelation with fee and surrender charge functions.
Trailing stop is a popular stop-loss trading strategy by which the investor will sell the asset once its price experiences a pre-specified percentage drawdown. In this paper, we study the problem of timing buy and then sell an asset subject to a trailing stop. Under a general linear diffusion framework, we study an opt…
Motivated by the industry practice of pairs trading, we study the optimal timing strategies for trading a mean-reverting price spread. An optimal double stopping problem is formulated to analyze the timing to start and subsequently liquidate the position subject to transaction costs. Modeling the price spread by an Orn…
We consider the optimal stopping of a class of spectrally negative jump diffusions. We state a set of conditions under which the value is shown to have a representation in terms of an ordinary nonlinear programming problem. We establish a connection between the considered problem and a stopping problem of an associated…
We introduce a simple stochastic volatility model, whose novelty consists in taking into account hitting times of the asset price, and study the optimal stopping problem corresponding to a put option whose time horizon (after the asset price hits a certain level) is exponentially distributed. We obtain explicit optimal…
A leveraged exchange traded fund (LETF) is an exchange traded fund that uses financial derivatives to amplify the price changes of a basket of goods. In this paper, we consider the robust hedging of European options on a LETF, finding model-free bounds on the price of these options. To obtain an upper bound, we establi…
The paper analyzes optimal retirement timing considering age-dependent mortality risk.
problem Optimal retirement timing under age-dependent mortality risk.
method Formulated as a stochastic control and optimal stopping problem, transformed into a finite time horizon, three-dimensional degenerate optimal stopping problem.
result Existence of an optimal retirement boundary, characterized as a unique solution to a nonlinear integral equation.
Equivalences are known between problems of singular stochastic control (SSC) with convex performance criteria and related questions of optimal stopping, see for example Karatzas and Shreve [SIAM J. Control Optim. 22 (1984)]. The aim of this paper is to investigate how far connections of this type generalise to a non co…
We propose a new approach to solve optimal stopping problems via simulation. Working within the backward dynamic programming/Snell envelope framework, we augment the methodology of Longstaff-Schwartz that focuses on approximating the stopping strategy. Namely, we introduce adaptive generation of the stochastic grids an…
Neural networks solve variational inequalities for optimal stopping problems.
problem Solving variational inequalities for optimal stopping problems in finance.
method Proposed neural network approach using loss functions directly incorporating variational inequality on whole domain.
result Existence and convergence of neural networks whose losses converge to zero.
Investors with anxiety about drawdowns may use stop-loss and trailing stops as optimal selling strategies.
problem Investors' anxiety about drawdowns affects optimal selling strategies.
method Mathematical analysis of optimal stopping with random discounting.
result Stop-loss and trailing stops can be optimal selling strategies under anxiety about drawdowns.
This paper studies the timing of trades under mean-reverting price dynamics subject to fixed transaction costs. We solve an optimal double stopping problem to determine the optimal times to enter and subsequently exit the market, when prices are driven by an exponential Ornstein-Uhlenbeck process. In addition, we analy…
This paper introduces a more efficient method for estimating level sets with a stopping criterion.
problem Efficiently estimating regions where a function exceeds a threshold without exhaustive evaluations.
method Acquisition strategy with a stopping criterion for ε-accurate level set estimation. result The method satisfies ε-accuracy with a confidence level of 1−δ and guarantees on lower bounds of performance metrics. New method to assess uncertainty in Bayesian optimization.
problem Uncertainty quantification in Bayesian optimization.
method Constructing confidence regions of the maximum point or value of the objective function.
result Unified uncertainty quantification framework for various sampling policies and stopping criteria.
Adaptive stopping in MCMC using classifier-based dynamics
problem Sampling from complex, unnormalized probability densities
method Training state-dependent neural classifiers
result Significant reduction in average trajectory lengths
We investigate a class of optimal stopping problems arising in, for example, studies considering the timing of an irreversible investment when the underlying follows a skew Brownian motion. Our results indicate that the local directional predictability modeled by the presence of a skew point for the underlying has a no…
We study the optimal stopping of an American call option in a random time-horizon under exponential spectrally negative Lévy models. The random time-horizon is modeled as the so-called Omega default clock in insurance, which is the first time when the occupation time of the underlying Lévy process below a level y, ex…
New algorithm solves complex stopping problems with robust optimization.
problem Solving complex stochastic optimal stopping problems.
method Simulation-based robust optimization with exact reformulation as a zero-one bilinear program.
result Developed polynomial-time heuristics and algorithms for practical solution.
The paper analyzes perpetual American options with asset-dependent discounting.
problem Optimal stopping problem for perpetual American options with varying discount rates.
method Analyzes the convexity of the value function, determines stopping regions, and proves HJB equation.
result Identifies the form of the value function and proves put-call symmetry.
New method finds optimal training stop point with noisy labeled data.
problem Finding optimal training stop point with noisy labeled data.
method Analyzed training accuracy rate changes for different noise ratios to identify a training stop region. Developed a heuristic algorithm based on a small-learning assumption.
result Identified optimal training stop point at or close to maximum obtainable test accuracy.
Solves optimal stopping problem with Poisson constraints using jumps.
problem Optimal stopping with Poisson constraints and jumps.
method Penalized backward stochastic differential equation (PBSDE) with jumps, decomposition method based on Jacod-Pham, comparison theorem of BSDEs with jumps.
result Solves American option pricing in nonlinear markets with Poisson constraints.
In this work we consider optimal stopping problems with conditional convex risk measures called optimised certainty equivalents. Without assuming any kind of time-consistency for the underlying family of risk measures, we derive a novel representation for the solution of the optimal stopping problem. In particular, we …
Solves optimal stopping for Gauss-Markov bridges using time-space transformation.
problem Optimal stopping problem of a Gauss-Markov bridge.
method Time-space transformation approach, Picard iteration algorithm.
result Lipschitz continuity of the optimal stopping boundary and its characterization.
Dual martingales improve primal optimal stopping problem efficiency.
problem Optimal stopping problem in the primal formulation.
method Investigation of dual martingales to improve primal methods.
result Accurate dual martingale approximations reduce primal problem variance.
Study on randomized algorithms for optimal stopping problems.
problem Optimal stopping problems in randomized algorithms.
method Forward and backward Monte Carlo based optimisation algorithms.
result Proved convergence of the proposed algorithms and derived convergence rates.
The paper tackles optimal stopping problems using reinforcement learning and singular control.
problem Continuous-time and state-space optimal stopping problems.
method Formulated as a singular control problem with randomized stopping times and penalized cumulative residual entropy.
result Identified unique optimal exploratory strategy through dynamic programming.
Study optimal stopping in random exploration, deriving HJB and designing a reinforcement learning algorithm.
problem Optimal stopping problem in continuous time with random exploration.
method Transformed optimal stopping to optimal control problem, derived HJB equation, designed reinforcement learning algorithm.
result Convergence rate of policy iteration and comparison to classical optimal stopping.
Continuous-time optimal stopping solved with deep reinforcement learning
problem Optimal stopping problems in continuous time
method CARLOS (Continuous-time Adaptive Reinforcement Learning for Optimal Stopping)
result Higher prices than existing Bermudan solvers, approaching American upper bound
Study optimal stopping times under regime-switching models with constraints.
problem Optimal stopping times for discounted payoffs on a regime-switching geometric Brownian motion.
method Solve variational inequality to find value functions and optimal thresholds.
result Existence and expressions of optimal stopping times under specific conditions.
Solves inventory control with unknown demand trend using singular control.
problem Optimally managing inventory with an unknown demand trend.
method Formulates as a stochastic control problem under partial observation, solves equivalent separated problem using transition between formulations, and applies viscosity theory.
result Constructs an optimal control rule and shows bounded Lipschitz continuity of free boundaries.
We show, under weaker assumptions than in the previous literature, that a perpetual optimal stopping game always has a value. We also show that there exists an optimal stopping time for the seller, but not necessarily for the buyer. Moreover, conditions are provided under which the existence of an optimal stopping time…
This paper analyzes the problem of starting and stopping a Cox-Ingersoll-Ross (CIR) process with fixed costs. In addition, we also study a related optimal switching problem that involves an infinite sequence of starts and stops. We establish the conditions under which the starting-stopping and switching problems admit …
MUSE provides unbiased stopping estimates for optimal problems.
problem Estimating the utility of optimal stopping problems.
method Backward recursive construction of the Multilevel Unbiased Stopping Estimator (MUSE).
result MUSE achieves ε-accuracy with O(1/ε^2) computational cost.
Study optimal stopping problems with finite-time horizon and proves continuity and strict monotonicity of the boundary.
problem Optimal stopping problems with finite-time horizon and state-dependent discounting.
method Linear diffusion process, time-homogeneous gain function, fine regularity properties, continuity and strict monotonicity proof.
result Proves continuity and strict monotonicity of the optimal stopping boundary under mild assumptions.
Develops a method for solving optimal stopping problems with multiple exercise rights.
problem Optimal stopping with multiple exercise rights under model uncertainty.
method Pathwise duality approach based on robust martingale dual representation.
result Establishes upper and lower bounds that converge to the true solution.
Study optimal stopping times for multi-dimensional processes with non-exponential discounting.
problem Optimal stopping in multi-dimensional processes with non-exponential discounting.
method Probabilistic potential theory to establish existence of optimal equilibria.
result Existence of optimal equilibria for multi-dimensional stopping problems.
We consider the optimal double stopping time problem defined for each stopping time S by $v(S)=\esssup\{E[ψ(τ_1, τ_2) | \F_S], τ_1, τ_2 \geq S \}$. Following the optimal one stopping time problem, we study the existence of optimal stopping times and give a method to compute them. The key point is the construction of …
The study reveals optimal early stopping behaviors in deep learning models.
problem Understanding optimal early stopping in deep learning models.
method Theoretical analysis of linear models and experimental validation.
result Two distinct behaviors of optimal early stopping time depending on model dimension relative to dataset features.
Optimal timing for borrowing from a 457(b) plan to maximize returns.
problem Deciding the best time to borrow from a tax-advantaged retirement account.
method Formulated and solved the optimal stopping problem for a loan from a 457(b) plan.
result Derived cutoff rules for optimal loan control, showing how to wait until a certain amount of money is accumulated.
Deep neural networks can solve optimal stopping problems without dimensionality issues.
problem Optimal stopping problems in high-dimensional state spaces.
method Established a general framework for deep ReLU neural networks to approximate value functions and continuation values.
result Deep neural networks can approximate value functions and continuation values with error at most ε of size κd^q ε^(-r).
This work bounds the run-time of nonconvex optimization with early stopping.
problem Bounding the expected run-time of nonconvex optimization with early stopping.
method Derives conditions for well-defined early stopping based on validation function norms and bounds the expected number of iterations and gradient evaluations.
result Guarantees the validity of early stopping and provides bounds on the expected run-time for various optimization algorithms.
New method solves optimal stopping problems using rough path signatures.
problem Optimal stopping problems in finance and other fields.
method Using rough path signatures and deep neural networks.
result Solves optimal stopping problems efficiently under minimal assumptions.
In this paper we introduce and solve a class of optimal stopping problems of recursive type. In particular, the stopping payoff depends directly on the value function of the problem itself. In a multi-dimensional Markovian setting we show that the problem is well posed, in the sense that the value is indeed the unique …