Analyzes non-Markovian environments in stochastic approximation.
problem Understanding learning mechanisms in non-ergodic, non-Markovian settings.
method Analytic framework for transformer learning and continual learning.
result Proposes a new approach to transformer and continual learning.
Deep learning solves non-Markovian FBSDEs for utility maximization.
problem Solving utility maximization problems under rough volatility.
method Deep learning-based numerical methods for non-Markovian fully coupled FBSDEs.
result Error estimates and convergence provided for the deep learning approach.
HONEM learns embeddings for higher-order networks, improving performance in various tasks.
problem Existing methods fail to capture non-Markovian higher-order dependencies in networks.
method HONEM is a higher-order network embedding method designed for HON, capturing non-Markovian dependencies.
result HONEM outperforms other methods in node classification, network reconstruction, link prediction, and visualization.
Paper improves neural ODEs for forecasting non-Markovian processes.
problem Forecasting irregularly observed time series with incomplete data.
method Path-dependent Neural Jump ODEs with signature transform.
result Path-dependent NJ-ODE outperforms original framework in non-Markovian data.
This paper studies a class of non−Markovian singular stochastic control problems, for which we provide a novel probabilistic representation. The solution of such control problem is proved to identify with the solution of a Z−constrained BSDE, with dynamics associated to a non singular underlying forward process. Du…
In this paper, we present a discrete-type approximation scheme to solve continuous-time optimal stopping problems based on fully non-Markovian continuous processes adapted to the Brownian motion filtration. The approximations satisfy suitable variational inequalities which allow us to construct ε-optimal stopping tim…
Unified analytical tool for non-Markovian jump processes.
problem Analyzing history-dependent jump processes with non-Markovian behavior.
method Developed a standard form of master equations using Laplace-space embedding and asymptotic solution.
result Unified analytical toolset for general non-Markovian processes, leading to the GLE approximation.
The paper develops a deep signature approach for option pricing under non-Markovian stochastic volatility models.
problem Pricing options under non-Markovian stochastic volatility models is challenging due to the dependence on historical paths.
method Reformulate the asset dynamics as a rough stochastic differential equation and represent rough paths via signatures. Apply standard analytical tools to solve the transformed equation.
result The deep signature approach provides a theoretically grounded and computationally efficient framework for option pricing.
Study develops numerical schemes for non-Markovian volatility models with memory.
problem Existence and uniqueness of strong solutions for non-Markovian SDEs.
method Functional quantization scheme based on Lamperti transformation.
result Theoretical foundation for numerical schemes applied to specific models.
Paper tackles non-Markovian control problems with new learning methods.
problem Non-Markovian stochastic control problems with unknown parameters.
method Off-model training and importance sampling for deep neural network approximation.
result Quantitative error bounds for adaptive learning under model uncertainty.
In this paper, we present a Longstaff-Schwartz-type algorithm for optimal stopping time problems based on the Brownian motion filtration. The algorithm is based on Leão, Ohashi and Russo and, in contrast to previous works, our methodology applies to optimal stopping problems for fully non-Markovian and non-semimartinga…
Paper solves Merton's portfolio problem in a non-Markovian, non-semimartingale model.
problem Merton's portfolio optimization in a fake stationary Volterra-Heston model.
method Stochastic factor solution to a Riccati BSDE, combined with martingale optimality principle.
result Derives semi-closed form optimal strategies and value function.
Novel signature approach for pricing and hedging path-dependent options with market frictions.
problem Pricing and hedging path-dependent options with market frictions.
method Signature approach, mean-quadratic variation criterion, non-standard infinite-dimensional Riccati equations, time-augmented signature, non-Markovian stochastic control problem.
result Effective hedging strategies in frictional markets with low-truncated signature approximations.
Proves global well-posedness for superquadratic BSDEs without Markovian assumption.
problem Global well-posedness of multidimensional superquadratic BSDEs without Markovian assumption.
method Interplay between local well-posedness of FBSDEs and backward iterations of superquadratic BSDEs.
result Global well-posedness of superquadratic BSDEs proved.
We study stochastic differential equations (SDEs) whose drift and diffusion coefficients are path-dependent and controlled. We construct a value process on the canonical path space, considered simultaneously under a family of singular measures, rather than the usual family of processes indexed by the controls. This val…
Expands Thiele equation for non-Markovian life insurance cash flows.
problem Circular dependency in life insurance cash flows and reserves.
method Expands Thiele equation to non-Markovian frameworks and presents a recursive scheme.
result Calculates multiple contract modifications in non-Markovian life insurance.
Non-Markovian point process shows power-law scaling, similar to nonlinear Markovian process.
problem Understanding the scaling behavior of non-Markovian point processes.
method Analyzed a confined fractional Brownian motion-driven point process and compared it to a nonlinear Markovian process.
result A nonlinear Markovian process can reproduce the power-law scaling behavior of a non-Markovian point process.
The paper values variable annuities using complex stochastic models and deep learning.
problem Valuation of variable annuities with early surrender options under non-Markovian models.
method Developed a deep signature Least Squares Monte Carlo approach to handle path-dependent continuation values.
result Fair fees increase with Hurst parameters of stock volatility and mortality force.
Paper introduces PRMs to learn non-Markovian stochastic rewards for reinforcement learning.
problem Lack of structured representation for non-Markovian stochastic rewards in reinforcement learning.
method Introduces probabilistic reward machines (PRMs) and presents an algorithm to learn them from decision processes.
result Algorithm proves correct and convergent for learning PRMs from decision processes.
HS-FNO models non-Markovian PDEs by learning history and future states.
problem Non-Markovian dynamics where future states depend on past history.
method History-Space Fourier Neural Operator (HS-FNO) for delay and memory-driven PDEs.
result HS-FNO achieves lowest aggregate errors across various PDE families.
This work explores functional expansions to handle path dependence in various fields.
problem Path dependence and infinite-dimensional problems in non-Markovian systems.
method Generalizes Wiener series and functional Taylor expansion to handle static and dynamic functionals.
result Elegant separation of functionals from future trajectories in dynamic cases.
Paper tackles robust offline RL for non-Markovian processes, improving efficiency and applicability.
problem Learning robust policies for non-Markovian decision processes with limited offline data.
method Proposes a novel algorithm with dataset distillation and LCB design for robust values, derived new dual forms, and introduces concentrability coefficients.
result Proves polynomial sample efficiency for finding ε-optimal robust policies.
New method for pricing European options in rough LSV models.
problem Pricing European options in non-Markovian local stochastic volatility models.
method Conditional LSV dynamics, rough path theory, rough partial differential equations (RPDEs).
result Established a PDE pricing method for non-Markovian models.
New approach tackles non-Markovian behavior in maternal health programs.
problem Improving adherence and engagement in maternal and child healthcare programs.
method Extending RMABs to non-Markovian settings, using time-series forecasting and TARI policy.
result Significant increase in engagement and content listened compared to existing methods.
Paper solves complex game theory problems with new equations.
problem Zero-sum stochastic games with non-Markovian switching.
method New multidimensional SRE and BSDE solutions.
result Existence and uniqueness of SRE solutions.
ARL bridges non-Markovian decision processes with reinforcement learning, improving foresight and stability.
problem Inaccurate foresight in non-Markovian environments due to state-based methods' limitations.
method Lifted state space into a signature-augmented manifold, using a self-consistent field approach to anticipate future path-law.
result ARL achieves deterministic evaluation of expected returns with reduced computational complexity and variance.
A new model predicts price concavity and reversion after metaorder execution.
problem Modeling market response to exogenous trades on limit order books.
method Developed a Non-Markovian Zero Intelligence model with a time-weighted mid-price return function.
result The model predicts concave price paths and price reversion after metaorder execution.
Investigates optimal consumption and investment strategies in non-Markovian markets with unbounded parameters.
problem Optimal consumption and investment strategies in non-Markovian markets with unbounded parameters.
method Martingale optimal principle and quadratic BSDEs with exponential moment.
result Establishes optimal strategies for consumption and investment.
Two signature-based methods solve optimal stopping in non-Markovian frameworks.
problem Optimal stopping in non-Markovian frameworks, particularly pricing American options.
method Primal and dual formulations using linear functionals of rough path signatures.
result Both primal and dual methods converge and provide numerical examples.
Study optimal portfolios in a non-Markovian regime-switching model with random time horizon.
problem Optimal portfolio selection in a market with non-Markovian regime-switching and random time horizon.
method Formulated as a constrained stochastic linear-quadratic optimal control problem, derived closed-form expressions for optimal portfolios and efficient frontier.
result Closed-form expressions for optimal portfolios and efficient frontier derived under non-Markovian regime-switching and random time horizon.
Signature portfolios approximate optimal wealth in non-Markovian markets.
problem Approximating optimal wealth in non-Markovian markets.
method Linear path-functional portfolios based on signatures of market weights.
result Signature portfolios can uniformly approximate any continuous portfolio function.
In this paper, we provide conditions which ensure that stochastic Lipschitz BSDEs admit Malliavin differentiable solutions. We investigate the problem of existence of densities for the first components of solutions to general path-dependent stochastic Lipschitz BSDEs and obtain results for the second components in part…
Study analyzes non-Markovian effects in financial markets over multiple years.
problem Understanding non-Markovian dynamics and trader interactions in financial markets.
method Empirical analysis of self-response functions and trade sign correlators for different stocks over multiple years.
result Significant variations in traders' interactions over time, indicating changes in market mechanisms.
FDBM models use fractional Brownian motion to model complex stochastic processes.
problem Capturing memory effects and long-range dependencies in stochastic processes.
method Developed a generative diffusion bridge framework using a Markovian approximation of fractional Brownian motion.
result FDBM outperforms standard models in predicting future states and unpaired data translation.
This paper investigates Merton's portfolio problem in a rough stochastic environment described by Volterra Heston model. The model has a non-Markovian and non-semimartingale structure. By considering an auxiliary random process, we solve the portfolio optimization problem with the martingale optimality principle. Optim…
We establish existence, uniqueness and regularity of solution results for a class of backward stochastic partial differential equations with singular terminal condition. The equation describes the value function of non-Markovian stochastic optimal control problem in which the terminal state of the controlled process is…
We propose a multiresolution Gaussian process to capture long-range, non-Markovian dependencies while allowing for abrupt changes. The multiresolution GP hierarchically couples a collection of smooth GPs, each defined over an element of a random nested partition. Long-range dependencies are captured by the top-level GP…
Two deep learning algorithms solve utility maximisation problems in finance.
problem Solving utility maximisation problems in finance with deep learning.
method Two algorithms: one for Markovian problems via HJB equation and 2BSDE, the other for non-Markovian problems via adjoint BSDE.
result Highly accurate results with low computational cost, solving problems with power, log, and non-HARA utilities in various models.
Investigates mean-variance portfolio selection in non-Markovian markets.
problem Continuous-time Markowitz mean-variance portfolio selection in fake stationary affine Volterra models.
method Stochastic factor solution to a Riccati BSDE, deriving explicit solutions as multi-dimensional Riccati-Volterra equations.
result Analytical closed-form expressions for optimal portfolio policies and mean-variance efficient frontier.
DeepSynth synthesizes automata to guide deep RL agents through sparse, non-Markovian rewards.
problem Training deep RL agents with sparse, non-Markovian rewards and unknown high-level objectives.
method Employing a novel algorithm for synthesizing compact automata to uncover sequential structure from trace data.
result Reduces the number of iterations required for policy synthesis by two orders of magnitude and improves scalability.
Paper introduces MVS to detect non-Markovian observations in reinforcement learning.
problem Real-world sensors violate Markov property, leading to suboptimal reinforcement learning performance.
method Uses prediction-based Markov Violation Score (MVS) combining random forest and ridge regression.
result MVS detects non-Markovian structure in observation trajectories, quantifying its impact.
Path signatures improve hedging of exotic derivatives in non-Markovian models.
problem Hedging exotic derivatives under non-Markovian stochastic volatility models.
method Investigates path signatures in deep and shallow learning contexts, comparing neural networks and regression approaches.
result Path signatures outperform LSTM in most cases and yield more accurate results in hedging.
Extends pricing methods for index options under rough volatility.
problem Pricing and hedging of index options under non-Markovian dynamics.
method Extension of large deviations methods to non-local volatility dynamics, specifically rough volatility.
result Validates the approach for pricing index options under rough volatility.
The paper develops methods to price options under rough volatility models using BSPDEs.
problem Pricing options in models with non-Markovian dynamics.
method Backward stochastic partial differential equations (BSPDEs) and deep learning for numerical approximations.
result Existence and uniqueness of weak solutions for general nonlinear BSPDEs.
A new method predicts non-Markovian closure terms for complex systems.
problem Predicting the effect of unresolved variables on resolved dynamics in high-dimensional systems.
method Mamba-Assisted Closure (MAC) framework: sequence model trained to predict closure from resolved trajectory, coupled with reduced-order equations.
result Substantially outperforms existing methods in predictive accuracy and long-time stability.
SRMC framework reduces Monte Carlo variance by history-based sampling in high-dimensional spaces.
problem Efficient sampling in high-dimensional discrete or continuous state spaces.
method Score-Repellent Monte Carlo (SRMC) framework that summarizes history through running average of score evaluations.
result Improves estimator variance and mode coverage with constant memory usage.
New model controls memory in seq2seq tasks, revealing learning regimes.
problem Understanding memory in seq2seq tasks using neural networks.
method Introducing a stochastic switching-Ornstein-Uhlenbeck (SSOU) model to control memory and a measure of non-Markovianity.
result Two learning regimes emerge from the interplay of time scales in the SSOU process.
This work analyzes Q-learning with adaptive stepsizes for finite-time convergence.
problem Finite-time convergence analysis for average-reward Q-learning with adaptive stepsizes. method Adaptive stepsizes as local clocks, time-inhomogeneous Markovian reformulation, almost-sure time-varying bounds, conditioning arguments, and Markov chain concentration inequalities.
result Convergence rates of ildeO(1/k) for mean-square and pointwise mean-square convergence.