Derives equations for deep learning biases and weights, showing data complexity reduction.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
New DP framework using data truncation for efficient estimation.
In the context of the Dragulescu-Yakovenko (2000) model, we show that empirical income distribution with truncated datasets, cannot be properly modeled by the one-parameter exponential distribution. However, a truncated version characterized by an exponential distribution with two parameters gives an accurate fit.
Efficiently estimates covariance for sub-Weibull vectors with sub-Gaussian rate.
Improved regret bounds for adversarial linear contextual bandits.
Paper proposes approximate Stein classes for efficient truncated density estimation.
The COS method for European options pricing is improved with a new bound for the number of terms.
Using Monte Carlo simulation to calculate the Value at Risk (VaR) as a possible risk measure requires adequate techniques. One of these techniques is the application of a compound distribution for the aggregates in a portfolio. In this paper, we consider the aggregated loss of Gamma distributed severities and estimate …
Truncated densities are probability density functions defined on truncated domains. They share the same parametric form with their non-truncated counterparts up to a normalizing constant. Since the computation of their normalizing constants is usually infeasible, Maximum Likelihood Estimation cannot be easily applied t…
In the paper "On Truncated Variation of Brownian Motion with Drift" (Bull. Pol. Acad. Sci. Math. 56 (2008), no.4, 267 - 281) we defined truncated variation of Brownian motion with drift, where is a standard Brownian motion. Truncated variation differs from regular variation by neglect…
Stochastic gradient descent (SGD) is commonly used for optimization in large-scale machine learning problems. Langford et al. (2009) introduce a sparse online learning method to induce sparsity via truncated gradient. With high-dimensional sparse data, however, the method suffers from slow convergence and high variance…
New algorithms estimate parameters of Gaussian and non-Gaussian distributions from truncated samples.
New sampling method for Heston model reduces complexity.
This paper develops a path-first theory using signatures and jump lifts for self-exiting processes.
New method for constructing truncated vine copulas.
We study by theoretical analysis and by direct numerical simulation the dynamics of a wide class of asynchronous stochastic systems composed of many autocatalytic degrees of freedom. We describe the generic emergence of truncated power laws in the size distribution of their individual elements. The exponents of the…
UDN adapts depth to data complexity, outperforming standard neural networks.
Unified method for calculating financial option prices from characteristic functions.
Efficiently learns exponential family distributions with i.i.d. samples.
We analyze exponential integrability properties of the Cox-Ingersoll-Ross (CIR) process and its Euler discretizations with various types of truncation and reflection at 0. These properties play a key role in establishing the finiteness of moments and the strong convergence of numerical approximations for a class of sto…
Signature volatility models are analyzed for existence, arbitrage, completeness, and hedging-error decomposition.
Positive weights improve kernel quadrature's accuracy.
We study the Heston-Cox-Ingersoll-Ross++ stochastic-local volatility model in the context of foreign exchange markets and propose a Monte Carlo simulation scheme which combines the full truncation Euler scheme for the stochastic volatility component and the stochastic domestic and foreign short interest rates with the …
We present a probabilistic framework for nonlinearities, based on doubly truncated Gaussian distributions. By setting the truncation points appropriately, we are able to generate various types of nonlinearities within a unified framework, including sigmoid, tanh and ReLU, the most commonly used nonlinearities in neural…
We describe financial systems as condensates, similar to Bose-Einstein condensates, and calculate statistical distributions following from the model. The calculated distributions of investments into speculated financial assets are found equivalent to a Pareto distribution, and the calculated distributions of the price …
We present trellis networks, a new architecture for sequence modeling. On the one hand, a trellis network is a temporal convolutional network with special structure, characterized by weight tying across depth and direct injection of the input into deep layers. On the other hand, we show that truncated recurrent network…
In the past years, Deep convolution neural network has achieved great success in many artificial intelligence applications. However, its enormous model size and massive computation cost have become the main obstacle for deployment of such powerful algorithm in the low power and resource-limited mobile systems. As the c…
We consider the problem of predicting as well as the best linear combination of d given functions in least squares regression, and variants of this problem including constraints on the parameters of the linear combination. When the input distribution is known, there already exists an algorithm having an expected excess…
We use daily data on bilateral interbank exposures and monthly bank balance sheets to study network characteristics of the Russian interbank market over Aug 1998 - Oct 2004. Specifically, we examine the distributions of (un)directed (un)weighted degree, nodal attributes (bank assets, capital and capital-to-assets ratio…
A new method balances model quality and Byzantine robustness in Federated Learning.
Paper estimates spectral risk measures for insurance data with truncated and censored data.
Extends online learning to metric spaces using exponential weights.
New method improves sampling from logconcave distributions truncated on polytopes.
New tensor framework connects Fisher information, hypergraphs, and multi-observable correlations.
We consider the problem of online linear regression on arbitrary deterministic sequences when the ambient dimension d can be much larger than the number of time rounds T. We introduce the notion of sparsity regret bound, which is a deterministic online counterpart of recent risk bounds derived in the stochastic setting…
We consider the problem of numerical approximation for forward-backward stochastic differential equations with drivers of quadratic growth (qgFBSDE). To illustrate the significance of qgFBSDE, we discuss a problem of cross hedging of an insurance related financial derivative using correlated assets. For the convergence…
We propose a communicationally and computationally efficient algorithm for high-dimensional distributed sparse learning. At each iteration, local machines compute the gradient on local data and the master machine solves one shifted regularized minimization problem. The communication cost is reduced from constant …
Computing partition functions, the normalizing constants of probability distributions, is often hard. Variants of importance sampling give unbiased estimates of a normalizer Z, however, unbiased estimates of the reciprocal 1/Z are harder to obtain. Unbiased estimates of 1/Z allow Markov chain Monte Carlo sampling of "d…
New algorithm improves hypergraph clustering for unbalanced communities.
We introduce a covariance matrix estimator that both takes into account the heteroskedasticity of financial returns (by using an exponentially weighted moving average) and reduces the effective dimensionality of the estimation (and hence measurement noise) via techniques borrowed from random matrix theory. We calculate…
The development of global sensitivity analysis of numerical model outputs has recently raised new issues on 1-dimensional Poincaré inequalities. Typically two kind of sensitivity indices are linked by a Poincaré type inequality, which provide upper bounds of the most interpretable index by using the other one, cheaper …
The pricing of options in exponential Levy models amounts to the computation of expectations of functionals of Levy processes. In many situations, Monte-Carlo methods are used. However, the simulation of a Levy process with infinite Levy measure generally requires either to truncate small jumps or to replace them by a …
Constructs classifiers for neural networks with specific data configurations.
A new method for exponentially weighted moving models using approximations.
COS method convergence conditions expanded for heavy-tailed distributions.
Introduces Exponentially Weighted Signature for better path representation.
Optimality of TS with noninformative priors proven for Pareto model.
Deep learning has shown that learned functions can dramatically outperform hand-designed functions on perceptual tasks. Analogously, this suggests that learned optimizers may similarly outperform current hand-designed optimizers, especially for specific problems. However, learned optimizers are notoriously difficult to…