In this paper, we obtain stability results for martingale representations in a very general framework. More specifically, we consider a sequence of martingales each adapted to its own filtration, and a sequence of random variables measurable with respect to those filtrations. We assume that the terminal values of the m…
We present a set of high-probability inequalities that control the concentration of weighted averages of multiple (possibly uncountably many) simultaneously evolving and interdependent martingales. Our results extend the PAC-Bayesian analysis in learning theory from the i.i.d. setting to martingales opening the way for…
Paper develops probabilistic bounds for a stochastic gradient algorithm in non-convex problems.
problem Stochastic optimization in non-convex finite sum problems.
method Develops a new dimension-free Azuma-Hoeffding type bound for a martingale difference sequence.
result Empirical results show superior probabilistic performance of Prob-SARAH compared to other algorithms.
We provide non-asymptotic convergence rates of the Polyak-Ruppert averaged stochastic gradient descent (SGD) to a normal random vector for a class of twice-differentiable test functions. A crucial intermediate step is proving a non-asymptotic martingale central limit theorem (CLT), i.e., establishing the rates of conve…
Improved algorithms for stochastic linear bandits using tighter confidence sequences.
problem Stochastic linear bandits with improved worst-case regret guarantees.
method Novel tail bound for adaptive martingale mixtures to construct tighter confidence sequences.
result Linear bandit algorithm achieves competitive worst-case regret.
Extends martingale transport for robust finance problems.
problem Addressing specific robust finance problems not covered by standard martingale transport.
method Introduces an additional parameter to the weak martingale optimal transport problem and proves stability.
result Stability of the extended problem with respect to risk-neutral marginal distributions.
Paper addresses OPE for dependent bandit samples using MDS and batch updates.
problem Evaluating policies from non-i.i.d. historical data in contextual bandits.
method Constructs an MDS-based estimator for dependent samples, solves batch update and deficient support issues.
result Derives an asymptotically normal estimator for evaluation policy value.
Develops confidence bounds for off-policy evaluation in contextual bandits.
problem Evaluating policies that were not used to collect data.
method Martingale analysis for non-asymptotic, non-parametric, and valid confidence sequences.
result Empirically tight bounds on failure probability and width.
Study improves off-policy evaluation from non-i.i.d. bandit samples.
problem Improving off-policy evaluation from non-independent bandit samples.
method Constructing an estimator from a standardized martingale difference sequence.
result Proposed estimator performs better than existing methods.
Develops new e-processes and confidence sequences for Gaussian means with unknown variance.
problem Constructing valid t-tests and confidence sequences for Gaussian means with unknown variance.
method Explores generalized nonintegrable martingales and extended Ville's inequality, developing two new e-processes and confidence sequences.
result Analyzes the width of resulting confidence sequences with a polynomial dependence on error probability, proving it to be unavoidable and even better than classical fixed-sample t-tests.
Bayes-assisted confidence sequences improve efficiency for bounded means.
problem Efficient uncertainty quantification for bounded IID means without parametric assumptions.
method Bayesian working predictive model selects adaptive martingale updates maximizing predictive log-growth.
result Asymptotically log-optimal performance with informative priors reducing width and sampling effort.
We consider Lipschitz-type backward stochastic differential equations (BSDEs) driven by cylindrical martingales on the space of continuous functions. We show the existence and uniqueness of the solution of such infinite-dimensional BSDEs and prove that the sequence of solutions of corresponding finite-dimensional BSDEs…
We establish decoupled functional CLTs for two-time-scale stochastic approximation.
problem Understanding the asymptotic behavior of two-time-scale stochastic approximation.
method Martingale problem approach and auxiliary sequence.
result The limiting dynamics of two-time-scale SA are independent of each other.
The paper studies reward concentration in MDPs, covering asymptotic and non-asymptotic settings.
problem Reward concentration in Markov Decision Processes (MDPs).
method Unified approach to reward concentration in MDPs, including asymptotic and non-asymptotic bounds.
result Rate-equivalent definitions of regret for learning policies.
The paper develops a method for self-normalized inference in adaptive experiments.
problem Adaptive experiments require a fixed horizon for ATE estimation, but propensities can change.
method The method uses self-normalized martingale limit theory to estimate ATE.
result The Studentized statistic is asymptotically N(0,1) at the prespecified horizon.
Score-based martingale posteriors improve uncertainty quantification in deep neural networks.
problem Uncertainty quantification in deep neural networks
method Score-based martingale posteriors
result SMPs provide a fast, deterministic way to simulate the limiting random variable.
Under mild regularity assumptions, the transport problem is stable in the following sense: if a sequence of optimal transport plans π1,π2,… converges weakly to a transport plan π, then π is also optimal (between its marginals). Alfonsi, Corbetta and Jourdain asked whether the same property is true for th…
Unified framework for PE and TD methods in continuous time and space.
problem Policy evaluation and TD learning in continuous settings.
method Martingale characterization for designing PE algorithms.
result Convergent time-discretized algorithms converge to continuous-time counterparts.
Estimates mode of discrete distributions with fewer samples.
problem Identifying the mode of a discrete distribution with high probability.
method Generalizes PPR martingale confidence sequences to handle multiple modes.
result PPR-1v1 stopping rule is asymptotically optimal and significantly more efficient.
Maximal concentration bounds for stochastic approximation with heavy-tailed noise.
problem Analyzing the convergence of stochastic approximation algorithms under heavy-tailed Markovian noise.
method Novel Lyapunov function and black-box truncation argument.
result Tail behavior of the error can be sub-Gaussian, sub-Weibull, or lighter than any Pareto but heavier than any Weibull.
Given a set-valued stochastic process (Vt)t=0T, we say that the martingale selection problem is solvable if there exists an adapted sequence of selectors ξt∈Vt, admitting an equivalent martingale measure. The aim of this note is to underline the connection between this problem and the problems of asset pr…
We give a collection of explicit sufficient conditions for the true martingale property of a wide class of exponentials of semimartingales. We express the conditions in terms of semimartingale characteristics. This turns out to be very convenient in financial modeling in general. Especially it allows us to carefully di…
Paper analyzes convergence of two time-scale stochastic approximation using martingale approach.
problem Analyzing convergence of two time-scale stochastic approximation algorithms.
method Uses martingale approach to establish convergence conditions and rates.
result Establishes different rates of convergence for fast and slow subsystems.
The paper introduces methods to quantify uncertainty in sampling without replacement.
problem Accurately estimating parameters from finite populations sampled without replacement.
method Develops confidence sequences using Bayesian and empirical methods.
result Improved confidence intervals and sequences for sampling without replacement.
Deviation inequalities for stochastic approximation methods.
problem Establishing bounds on the deviation of stochastic approximation methods.
method Martingale approximation method for separately Lipschitz functions.
result Established various deviation inequalities for stochastic approximation by averaging and minimization.
New method improves GP uncertainty quantification for misspecified priors.
problem Uncertainty quantification for GPs under incorrect priors.
method Constructs a confidence sequence using martingale techniques.
result Empirically outperforms standard GP methods in robustness and utility for Bayesian Optimization.
We compute and discuss the Esscher martingale transform for exponential processes, the Esscher martingale transform for linear processes, the minimal martingale measure, the class of structure preserving martingale measures, and the minimum entropy martingale measure for stochastic volatility models of Ornstein-Uhlenbe…
Novel bounds improve TD learning consistency in RL.
problem Analyzing Temporal Difference learning's performance.
method High-dimensional concentration inequalities and Berry-Esseen bounds for Markov chain induced martingales.
result Sharp high-probability consistency guarantee for TD learning, matching asymptotic variance up to logarithmic factors.
Efficiently computes robust option prices using multi-marginal martingale transport.
problem Computing robust option prices under martingale constraints.
method Extending state space, sequential martingale structure, entropic regularisation.
result Fast computation of optimal solutions for large problems.
The study examines markets with multiple numéraires and finds equivalent martingale measures.
problem Analyzing markets with diverse assets and numéraires.
method Theoretical foundations and results on superreplication prices.
result Existence of equivalent martingale measures in markets with multiple numéraires.
The martingale optimal transport aims to optimally transfer a probability measure to another along the class of martingales. This problem is mainly motivated by the robust superhedging of exotic derivatives in financial mathematics, which turns out to be the corresponding Kantorovich dual. In this paper we consider the…
New framework quantifies uncertainty in flexible density-based clustering.
problem Uncertainty quantification in clustering with non-parametric density estimation.
method Martingale posterior distributions and density-based clustering.
result Efficient GPU-compatible inference on clustering structures with uncertainty.
We propose a unified and systematic framework for performing online nonnegative matrix factorization in the presence of outliers. Our framework is particularly suited to large-scale data. We propose two solvers based on projected gradient descent and the alternating direction method of multipliers. We prove that the se…
Recurrent neural networks' hidden state can be reconstructed from its past, providing a theoretical framework for stability and tracking.
problem Hidden-state stability in RNNs
method Backward coherence analysis
result Almost-sure convergence, rates under mixing, interpretable limiting representation, finite pathwise stopping times, and theoretical framework for time-uniform confidence sequences.
Near-optimal tests and confidence sequences for non-parametric data.
problem Flexible statistical inference and decision-making with non-parametric data.
method Classic delayed-start normal-mixture sequential probability ratio tests with asymptotic guarantees.
result Asymptotically optimal type-I error and expected rejection time guarantees.
Researchers created a continuous Markov martingale that mimics Brownian motion but lacks the strong Markov property.
problem Constructing a continuous Markov martingale with Brownian marginals that misses the strong Markov property.
method Developed a new approach to create a continuous Markov martingale that differs from Brownian motion in terms of the strong Markov property.
result A continuous Markov martingale with Brownian marginals that lacks the strong Markov property was successfully constructed.
New boundary condition for Black-Scholes equations in strict local martingale models.
problem Computing prices of European options with underlying asset as a strict local martingale.
method Numerical procedure using finite difference methods with a new boundary condition at infinity.
result The minimal solution, satisfying a discrete maximum principle, is the correct derivative price.
Paper improves CI and CS for bounded means using betting and mixtures.
problem Estimating means of bounded random variables.
method Composite nonnegative martingales, testing by betting, method of mixtures.
result Empirically outperforms existing CI and CS methods.
We present two alternative ways to apply PAC-Bayesian analysis to sequences of dependent random variables. The first is based on a new lemma that enables to bound expectations of convex functions of certain dependent random variables by expectations of the same functions of independent Bernoulli random variables. This …
A constrained informationally efficient market is defined to be one whose price process arises as the outcome of some equilibrium where agents face restrictions on trade. This paper investigates the case of short sale constraints, a setting which despite its simplicity, generates new insights. In particular, it is show…
Develops European power option pricing under correlated interest rate and asset processes.
problem Pricing European power options under correlated interest rate and asset processes.
method Martingale method and Girsannov transform.
result Derives European power option pricing formulae under two market assumptions.
Study a continuous portfolio optimization with a new CVaR-like constraint using martingale approach.
problem Optimizing a portfolio under a new CVaR-like constraint that is not compatible with traditional methods.
method Follows a martingale approach in a complete market setting, solving a convex constrained minimization problem.
result Obtains a tractable and interpretable characterization of the optimal strategy.
In a discrete-time financial market, a generalized duality is established for model-free superhedging, given marginal distributions of the underlying asset. Contrary to prior studies, we do not require contingent claims to be upper semicontinuous, allowing for upper semi-analytic ones. The generalized duality stipulate…
Develops a new duality between entropy martingale optimal transport and nonlinear pricing-hedging.
problem Entropy Martingale Optimal Transport problem and its associated optimization problem.
method Combines Entropy Optimal Transport and Martingale Optimal Transport theories, with novel penalization terms and constraints.
result Establishes a nonlinear robust pricing-hedging duality, covering various known robust results.
We develop a probabilistic framework for sequential random projection.
problem Challenges of sequential decision-making under uncertainty.
method Novel construction of a stopped process and method of mixtures.
result Achieved a non-asymptotic probability bound for random projection.
New algorithm selects robust martingale for optimal stopping problems.
problem Optimal stopping problems in stochastic processes.
method Randomized dual martingale minimization algorithm.
result Efficiently selects Doob martingale as close as possible.
In a model independent discrete time financial market, we discuss the richness of the family of martingale measures in relation to different notions of Arbitrage, generated by a class S of significant sets, which we call Arbitrage de la classe S. The choice of S reflects into the int…
New methods for anytime-valid off-policy inference in contextual bandits.
problem Estimating properties of hypothetical policies in adaptive experiments.
method Modern martingale techniques for comprehensive OPE inference.
result Valid anytime inference for off-policy mean reward values and entire reward distributions.