A new training method uses multilevel minimization for machine learning.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
A new multilevel framework speeds up ResNet training.
A multilevel optimization method for constrained problems.
Since Giles introduced the multilevel Monte Carlo path simulation method [18], there has been rapid development of the technique for a variety of applications in computational finance. This paper surveys the progress so far, highlights the key features in achieving a high rate of multilevel variance convergence, and su…
We develop a multilevel approach to compute approximate solutions to backward differential equations (BSDEs). The fully implementable algorithm of our multilevel scheme constructs sequential martingale control variates along a sequence of refining time-grids to reduce statistical approximation errors in an adaptive and…
Develops a fast algorithm for fitting multilevel factor models.
We investigate the extension of the multilevel Monte Carlo path simulation method to jump-diffusion SDEs. We consider models with finite rate activity, using a jump-adapted discretisation in which the jump times are computed and added to the standard uniform dis- cretisation times. The key component in multilevel analy…
Enhances SBI accuracy with multilevel Monte Carlo for expensive simulators.
Flexible framework assesses multilevel data group heterogeneity.
New neural network models speed up Bayesian multilevel modeling.
Efficiently price VIX options using multilevel Monte Carlo in rough Bergomi model.
This work is motivated by the needs of predictive analytics on healthcare data as represented by Electronic Medical Records. Such data is invariably problematic: noisy, with missing entries, with imbalance in classes of interests, leading to serious bias in predictive modeling. Since standard data mining methods often …
A method learns to solve multilevel combinatorial problems with two players.
The multilevel Monte Carlo path simulation method introduced by Giles ({\it Operations Research}, 56(3):607-617, 2008) exploits strong convergence properties to improve the computational complexity by combining simulations with different levels of resolution. In this paper we analyse its efficiency when using the Milst…
Proposes a method for multilevel explanations of black-box models.
We propose a novel probabilistic approach to multilevel clustering problems based on composite transportation distance, which is a variant of transportation distance where the underlying metric is Kullback-Leibler divergence. Our method involves solving a joint optimization problem over spaces of probability measures t…
In medical domain, data features often contain missing values. This can create serious bias in the predictive modeling. Typical standard data mining methods often produce poor performance measures. In this paper, we propose a new method to simultaneously classify large datasets and reduce the effects of missing values.…
Monte Carlo is a simple and flexible tool that is widely used in computational finance. In this context, it is common for the quantity of interest to be the expected value of a random variable defined via a stochastic differential equation. In 2008, Giles proposed a remarkable improvement to the approach of discretizin…
Improved Bayesian regression for large datasets using multilevel Gibbs sampling.
Improved multilevel scheme for value-at-risk computation.
Deep learning models exhibit state-of-the-art performance for many predictive healthcare tasks using electronic health records (EHR) data, but these models typically require training data volume that exceeds the capacity of most healthcare systems. External resources such as medical ontologies are used to bridge the da…
With the advent of massive data sets much of the computational science and engineering community has moved toward data-intensive approaches in regression and classification. However, these present significant challenges due to increasing size, complexity and dimensionality of the problems. In particular, covariance mat…
New estimator reduces nested expectation estimation costs.
We study the use of the multilevel Monte Carlo technique in the context of the calculation of Greeks. The pathwise sensitivity analysis differentiates the path evolution and reduces the payoff's smoothness. This leads to new challenges: the inapplicability of pathwise sensitivities to non-Lipschitz payoffs often makes …
Accelerates MCMC sampling for large-scale problems using machine learning.
In this short note we provide an unbiased multilevel Monte Carlo estimator of the log marginal likelihood and discuss its application to variational Bayes.
Option valuation problems are often solved using standard Monte Carlo (MC) methods. These techniques can often be enhanced using several strategies especially when one discretizes the dynamics of the underlying asset, of which we assume follows a diffusion process. We consider the combination of two methodologies in th…
This paper proposes and analyses a new multilevel Monte Carlo method for the estimation of mean exit times for multi-dimensional Brownian diffusions, and associated functionals which correspond to solutions to high-dimensional parabolic PDEs through the Feynman-Kac formula. In particular, it is proved that the complexi…
Automates kernel discovery for longitudinal data analysis.
Novel weak MLMC scheme for Lévy-driven SDEs, applied to financial derivatives pricing.
Sparse representations using overcomplete dictionaries have proved to be a powerful tool in many signal processing applications such as denoising, super-resolution, inpainting, compression or classification. The sparsity of the representation very much depends on how well the dictionary is adapted to the data at hand. …
This paper tackles fitting multilevel low rank matrices by addressing three problems.
We derive generalization and excess risk bounds for neural nets using a family of complexity measures based on a multilevel relative entropy. The bounds are obtained by introducing the notion of generated hierarchical coverings of neural nets and by using the technique of chaining mutual information introduced in Asadi…
Paper proposes a new algorithm to reduce derivative pricing computation time.
The paper discusses building ETF risk models using a multilevel classification taxonomy.
Adaptive Multilevel Splitting improves rare event pricing for financial derivatives.
In this paper, we are interested in the strong convergence properties of the Ninomiya-Victoir scheme which is known to exhibit weak convergence with order 2. We prove strong convergence with order . This study is aimed at analysing the use of this scheme either at each level or only at the finest level of a multil…
Proposes a method to reduce parallel complexity of MLMC in SGD.
Detects anomalies in vector fields without distributional assumptions.
MLMC boosts Bayesian optimization's look-ahead efficiency.
In this paper a novel modification of the multilevel Monte Carlo approach, allowing for further significant complexity reduction, is proposed. The idea of the modification is to use the method of control variates to reduce variance at level zero. We show that, under a proper choice of control variates, one can reduce t…
We apply multilevel Monte Carlo for option pricing problems using exponential Lévy models with a uniform timestep discretisation to monitor the running maximum required for lookback and barrier options. The numerical results demonstrate the computational efficiency of this approach. We derive estimates of the convergen…
New method estimates nested expectations with biased and antithetic sampling.
A new weighted MLMC method improves efficiency in Monte Carlo simulations.
Model trains passing events on a bridge using multilevel Gaussian process.
In this paper we discuss the possibility of using multilevel Monte Carlo (MLMC) methods for weak approximation schemes. It turns out that by means of a simple coupling between consecutive time discretisation levels, one can achieve the same complexity gain as under the presence of a strong convergence. We exemplify thi…
Bayesian inference for deep neural networks using trace-class priors and MLMC.
This paper investigates multilevel initialization strategies for training very deep neural networks with a layer-parallel multigrid solver. The scheme is based on the continuous interpretation of the training problem as a problem of optimal control, in which neural networks are represented as discretizations of time-de…