Noise injection before gradient steps helps in regularization for neural networks.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
We conduct mathematical analysis on the effect of batch normalization (BN) on gradient backpropogation in residual network training, which is believed to play a critical role in addressing the gradient vanishing/explosion problem, in this work. By analyzing the mean and variance behavior of the input and the gradient i…
We consider a class of asset pricing models, where the risk-neutral joint process of log-price and its stochastic variance is an affine process in the sense of Duffie, Filipovic and Schachermayer [2003]. First we obtain conditions for the price process to be conservative and a martingale. Then we present some results o…
We propose a randomised version of the Heston model-a widely used stochastic volatility model in mathematical finance-assuming that the starting point of the variance process is a random variable. In such a system, we study the small-and large-time behaviours of the implied volatility, and show that the proposed random…
We show that the moment explosion time in the rough Heston model [El Euch, Rosenbaum 2016, arxiv:1609.02108] is finite if and only if it is finite for the classical Heston model. Upper and lower bounds for the explosion time are established, as well as an algorithm to compute the explosion time (under some restrictions…
We present transductive Boltzmann machines (TBMs), which firstly achieve transductive learning of the Gibbs distribution. While exact learning of the Gibbs distribution is impossible by the family of existing Boltzmann machines due to combinatorial explosion of the sample space, TBMs overcome the problem by adaptively …
Study on martingale property and moment explosions in signature volatility models.
Classical (Itô diffusions) stochastic volatility models are not able to capture the steepness of small-maturity implied volatility smiles. Jumps, in particular exponential Lévy and affine models, which exhibit small-maturity exploding smiles, have historically been proposed to remedy this (see \cite{Tank} for an overvi…
BatchNorm helps train quantized networks by avoiding gradient explosion.
The market events of 2007-2009 have reinvigorated the search for realistic return models that capture greater likelihoods of extreme movements. In this paper we model the medium-term log-return dynamics in a market with both fundamental and technical traders. This is based on a Poisson trade arrival model with variable…
We study the problem of non-explosion of diffusion processes on a manifold with time-dependent Riemannian metric. In particular we obtain that Brownian motion cannot explode in finite time if the metric evolves under backwards Ricci flow. Our result makes it possible to remove the assumption of non-explosion in the pat…
We study the explosion of the solutions of the SDE in the quasi-Gaussian HJM model with a CEV-type volatility. The quasi-Gaussian HJM models are a popular approach for modeling the dynamics of the yield curve. This is due to their low dimensional Markovian representation which simplifies their numerical implementation …
New RL algorithm GDPO improves DLM reasoning efficiency.
SCOPE-FE improves feature engineering efficiency for high-dimensional datasets.
Bayesian model improves categorization of explosions from sparse data.
In this paper we investigate the asymptotics of forward-start options and the forward implied volatility smile in the Heston model as the maturity approaches zero. We prove that the forward smile for out-of-the-money options explodes and compute a closed-form high-order expansion detailing the rate of the explosion. Fu…
Keeping a basic tenet of economic theory, rational expectations, we model the nonlinear positive feedback between agents in the stock market as an interplay between nonlinearity and multiplicative noise. The derived hyperbolic stochastic finite-time singularity formula transforms a Gaussian white noise into a rich time…
In this paper, we establish sample path large and moderate deviation principles for log-price processes in Gaussian stochastic volatility models, and study the asymptotic behavior of exit probabilities, call pricing functions, and the implied volatility. In addition, we prove that if the volatility function in an uncor…
Recently, there is an explosive growth of activities to understand stringy properties of orbifolds. In this article, we survey some of recent developments.
Quasi-Gaussian HJM models are a popular approach for modeling the dynamics of the yield curve. This is due to their low dimensional Markovian representation, which greatly simplifies their numerical implementation. We present a qualitative study of the solutions of the quasi-Gaussian log-normal HJM model. Using a small…
The recent explosion in the amount and dimensionality of data has exacerbated the need of trading off computational and statistical efficiency carefully, so that inference is both tractable and meaningful. We propose a framework that provides an explicit opportunity for practitioners to specify how much statistical ris…
Study on VIX options pricing in SABR model, showing infinite prices due to volatility explosion.
RestoreAI predicts landmine risk from patterns, improving clearance efficiency.
We prove that the quotient space of a variationally complete group action is a good Riemannian orbifold. The result is generalized to singular Riemannian foliations without horizontal conjugate points.
Graph Convolutional Networks (GCNs) are powerful models for learning representations of attributed graphs. To scale GCNs to large graphs, state-of-the-art methods use various layer sampling techniques to alleviate the "neighbor explosion" problem during minibatch training. We propose GraphSAINT, a graph sampling based …
Wide-band Electromagnetic Induction Sensors (WEMI) have been used for a number of years in subsurface detection of explosive hazards. While WEMI sensors have proven effective at localizing objects exhibiting large magnetic responses, detecting objects lacking or containing very low amounts of conductive materials can b…
In the LIBOR market model, forward interest rates are log-normal under their respective forward measures. This note shows that their distributions under the other forward measures of the tenor structure have approximately log-normal tails.
We present a number of related comparison results, which allow to compare moment explosion times, moment generating functions and critical moments between rough and non-rough Heston models of stochastic volatility. All results are based on a comparison principle for certain non-linear Volterra integral equations. Our u…
The search for higher-order feature interactions that are statistically significantly associated with a class variable is of high relevance in fields such as Genetics or Healthcare, but the combinatorial explosion of the candidate space makes this problem extremely challenging in terms of computational efficiency and p…
Residual networks (ResNet) and weight normalization play an important role in various deep learning applications. However, parameter initialization strategies have not been studied previously for weight normalized networks and, in practice, initialization methods designed for un-normalized networks are used as a proxy.…
Paper addresses theoretical risks in neural MCCFR, proposing Robust Deep MCCFR for improved performance.
We exhibit sufficient conditions such that components of a multidimensional SDE giving rise to a local martingale are strict local martingales or martingales. We assume that the equations have diffusion coefficients of the form with being a stochastic volatility term.
Discrete time random walks on a finite set naturally translate via a one-to-one correspondence to discrete Laplace operators. Typically, Ollivier curvature has been investigated via random walks. We first extend the definition of Ollivier curvature to general weighted graphs and then give a strikingly simple representa…
At present, there is an explosion of practical interest in the pricing of interest rate (IR) derivatives. Textbook pricing methods do not take into account the leptokurticity of the underlying IR process. In this paper, such a leptokurtic behaviour is illustrated using LIBOR data, and a possible martingale pricing sche…
New neural networks model complex phenomena with fewer parameters.
Transformer model estimates keywords for better audio captioning.
We consider an interest rate model with log-normally distributed rates in the terminal measure in discrete time. Such models are used in financial practice as parametric versions of the Markov functional model, or as approximations to the log-normal Libor market model. We show that the model has two distinct regimes, a…
New paradigm for Neural ODEs stabilizes training and improves model performance.
Safe Pattern Pruning reduces pattern explosion in predictive pattern mining.
We show that in a large class of stochastic volatility models with additional skew-functions (local-stochastic volatility models) the tails of the cumulative distribution of the log-returns behave as exp(-c|y|), where c is a positive constant depending on time and on model parameters. We obtain this estimate proving a …
Predicts the age of astronomical transients from real-time data.
Lipschitz normalization boosts deep attention models, especially for graph neural networks.
We consider the stochastic volatility model , with uncorrelated standard Brownian motions. This is a special case of the Hull-White and the (log-normal) SABR model, which are widely used in financial practice. We study the properties of this model, discretized in …
We determine the long-time asymptotic behavior of a relativistic diffusion taking values in the unitary tangent bundle of a Robertson-Walker space-time. We prove in particular that when approaching the explosion time of the diffusion, its projection on the base manifold almost surely converges to a random point of the …
Detects anomalies in astronomical time series data.
Early training phase affects deep neural network optimization and generalization.
Ripple Walk Training tackles graph neural network training issues for large and deep graphs.
We present a self-consistent model for explosive financial bubbles, which combines a mean-reverting volatility process and a stochastic conditional return which reflects nonlinear positive feedbacks and continuous updates of the investors' beliefs and sentiments. The conditional expected returns exhibit faster-than-exp…