A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
New RL framework models continuous-time dynamics using neural ODEs.
Markov jump processes and continuous time Bayesian networks are important classes of continuous time dynamical systems. In this paper, we tackle the problem of inferring unobserved paths in these models by introducing a fast auxiliary variable Gibbs sampler. Our approach is based on the idea of uniformization, and sets…
Study approximates financial market with discrete-time models.
New algorithm for continuous-time switching systems using variational inference.
Continuous time framework for discrete data denoising models.
Logarithmic regret for continuous-time reinforcement learning.
New model for insurance states using Markov jump processes with non-countable state space.
Recently there have been exciting developments in Monte Carlo methods, with the development of new MCMC and sequential Monte Carlo (SMC) algorithms which are based on continuous-time, rather than discrete-time, Markov processes. This has led to some fundamentally new Monte Carlo algorithms which can be used to sample f…
New neural method for inferring Markov jump processes.
New algorithm learns value and advantage functions for continuous-time Markov processes without structural assumptions.
Recently, Ross showed that it is possible to recover an objective measure from a risk-neutral measure. His model assumes that there is a finite-state Markov process X that drives the economy in discrete time. Many authors extended his model to a continuous-time setting with a Markov diffusion process X with state space…
We consider a Hidden Markov Model (HMM) where the integrated continuous-time Markov chain can be observed at discrete time points perturbed by a Brownian motion. The aim is to derive a filter for the underlying continuous-time Markov chain. The recursion formula for the discrete-time filter is easy to derive, however i…
Neural models learn continuous-time Markov chain transition rates from data.
In this paper we present an algorithm for pricing barrier options in one-dimensional Markov models. The approach rests on the construction of an approximating continuous-time Markov chain that closely follows the dynamics of the given Markov model. We illustrate the method by implementing it for a range of models, incl…
We solve a continuous-time game-theoretic problem for Kihlstrom-Mirman preferences.
Efficiently infers coupled hidden Markov models with noisy discrete observations.
New CTBNs with clocks allow for non-exponential survival times.
DQNs can approximate optimal Q-functions with high accuracy on compact sets.
New entropy flow method extends generalization bounds for all Markov algorithms.
Fluid approximations have seen great success in approximating the macro-scale behaviour of Markov systems with a large number of discrete states. However, these methods rely on the continuous-time Markov chain (CTMC) having a particular population structure which suggests a natural continuous state-space endowed with a…
Paper approximates rough stochastic local volatility models for efficient computation.
Cai, Song and Kou (2015) [Cai, N., Y. Song, S. Kou (2015) A general framework for pricing Asian options under Markov processes. Oper. Res. 63(3): 540-554] made a breakthrough by proposing a general framework for pricing both discretely and continuously monitored Asian options under one-dimensional Markov processes. In …
This study shows how DDPM can be represented by the OU process.
We consider the problem of estimating the transition rate matrix of a continuous-time Markov chain from a finite-duration realisation of this process. We approach this problem in an imprecise probabilistic framework, using a set of prior distributions on the unknown transition rate matrix. The resulting estimator is a …
Continuous time Bayesian networks (CTBNs) describe structured stochastic processes with finitely many states that evolve over continuous time. A CTBN is a directed (possibly cyclic) dependency graph over a set of variables, each of which represents a finite state continuous time Markov process whose transition model is…
We consider models of the population or opinion dynamics which result in the non-linear stochastic differential equations (SDEs) exhibiting the spurious long-range memory. In this context, the correspondence between the description of the birth-death processes as the continuous-time Markov chains and the continuous SDE…
In most sampling algorithms, including Hamiltonian Monte Carlo, transition rates between states correspond to the probability of making a transition in a single time step, and are constrained to be less than or equal to 1. We derive a Hamiltonian Monte Carlo algorithm using a continuous time Markov jump process, and ar…
Method infers MJPs from noisy observations without prior training.
We consider continuous time Markovian processes where populations of individual agents interact stochastically according to kinetic rules. Despite the increasing prominence of such models in fields ranging from biology to smart cities, Bayesian inference for such systems remains challenging, as these are continuous tim…
In this paper we consider long-run risk sensitive average cost impulse control applied to a continuous-time Feller-Markov process. Using the probabilistic approach, we show how to get a solution to a suitable continuous-time Bellman equation and link it with the impulse control problem. The optimal strategy for the und…
New method infers hidden states in continuous-time phenomena better than traditional models.
Regime-switching models, in particular Hidden Markov Models (HMMs) where the switching is driven by an unobservable Markov chain, are widely-used in financial applications, due to their tractability and good econometric properties. In this work we consider HMMs in continuous time with both constant and switching volati…
Optimizes control of hybrid systems with multiple switching processes.
We study a portfolio selection problem in a continuous-time Itô-Markov additive market with prices of financial assets described by Markov additive processes which combine Lévy processes and regime switching models. Thus the model takes into account two sources of risk: the jump diffusion risk and the regime switching …
We consider the inverse problem of reconstructing the posterior measure over the trajec- tories of a diffusion process from discrete time observations and continuous time constraints. We cast the problem in a Bayesian framework and derive approximations to the posterior distributions of single time marginals using vari…
Method calculates Parisian stopping times and option prices using Markov chains.
Efficient method for lookback option pricing under Markov models.
We provide a new proof for regularity of affine processes on general state spaces by methods from the theory of Markovian semimartingales. On the way to this result we also show that the definition of an affine process, namely as stochastically continuous time-homogeneous Markov process with exponential affine Fourier-…
A new RG approach connects discrete and continuous time descriptions of Gaussian processes.
A \emph{new} notion of equilibrium, which we call \emph{strong equilibrium}, is introduced for time-inconsistent stopping problems in continuous time. Compared to the existing notions introduced in ArXiv: 1502.03998 and ArXiv: 1709.05181, which in this paper are called \emph{mild equilibrium} and \emph{weak equilibrium…
Paper solves POMDPs in continuous time and discrete spaces.
This paper studies the pricing of European-style Asian options when the price dynamics of the underlying risky asset are assumed to follow a Markov- modulated geometric Brownian motion; that is, the appreciation rate and the volatility of the underlying risky asset depend on unobservable states of the economy described…
A new method for inferring latent states in Markov jump processes.
This paper investigates the pricing of European-style lookback options when the price dynamics of the underlying risky asset are assumed to follow a Markov-modulated Geo-metric Brownian motion; that is, the appreciation rate and the volatility of the underlying risky asset depend on unobservable states of the economy d…
In many fields observations are performed irregularly along time, due to either measurement limitations or lack of a constant immanent rate. While discrete-time Markov models (as Dynamic Bayesian Networks) introduce either inefficient computation or an information loss to reasoning about such processes, continuous-time…
We introduce a class of hybrid marked point processes, which encompasses and extends continuous-time Markov chains and Hawkes processes. While this flexible class amalgamates such existing processes, it also contains novel processes with complex dynamics. These processes are defined implicitly via their intensity and a…
Paper introduces DMPMs for efficient discrete data generation with sharp convergence bounds.
We consider an investor faced with the utility maximization problem in which the risky asset price process has pure-jump dynamics affected by an unobservable continuous-time finite-state Markov chain, the intensity of which can also be controlled by actions of the investor. Using the classical filtering theory, we redu…