Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

2535067591,012 · Jun 202019922001200920172026
48 results for large time steps

Deep learning accelerates Monte Carlo SDE simulations with large time steps.

problem Accurate simulation of SDEs with large time steps.
method Polynomial chaos expansion with neural network learned stochastic collocation points.
result Data-driven scheme achieves strong convergence in Monte Carlo simulations.

GPU speeds up Monte Carlo simulations for large time steps.

problem Slow convergence and inaccurate solutions with large time steps in Monte Carlo simulations.
method Generalizes the Seven League scheme for GPU acceleration.
result Significantly improved computational speed.

Efficiently simulates the Heston model with large time steps using a novel method.

problem Challenges in simulating the Heston model with large time steps.
method Implicit integrated variance scheme exploiting the near-linear nature between stochastic driver and conditional integrated variance process.
result Achieves near-exact accuracy with coarse discretizations, efficient for large time steps.

We consider the exploration/exploitation problem in reinforcement learning. For exploitation, it is well known that the Bellman equation connects the value at any time-step to the expected value at subsequent time-steps. In this paper we consider a similar \textit{uncertainty} Bellman equation (UBE), which connects the…

2017-09-15abs ↗pdf ↗

Poisson Midpoint Method improves Langevin Dynamics for diffusion models.

problem Slow convergence of LMC in diffusion models requiring many small steps.
method Poisson Midpoint Method approximates LMC with larger steps, proving quadratic speed up.
result Poisson Midpoint Method maintains quality of DDPM with fewer calls.

In order to investigate the origin of large price fluctuations, we analyze stock price changes of ten frequently traded NASDAQ stocks in the year 2002. Though the influence of the trading frequency on the aggregate return in a certain time interval is important, it cannot alone explain the heavy tailed distribution of …

2006-06-18abs ↗pdf ↗

The Graph Convolutional Network (GCN) model and its variants are powerful graph embedding tools for facilitating classification and clustering on graphs. However, a major challenge is to reduce the complexity of layered GCNs and make them parallelizable and scalable on very large graphs -- state-of the art techniques a…

2018-10-28abs ↗pdf ↗

Time series forecasting with limited data is a challenging yet critical task. While transformers have achieved outstanding performances in time series forecasting, they often require many training samples due to the large number of trainable parameters. In this paper, we propose a training technique for transformers th…

2019-10-21abs ↗pdf ↗

Few-step protein backbone generators reduce sampling time by over 20x.

problem Computational bottleneck in diffusion-based protein generation models.
method Score distillation adapted for protein backbone generation, combined with inference time noise modulation.
result Significant reduction in sampling time (20+ fold) while maintaining comparable performance.

A new deep learning method for option pricing in rough volatility models.

problem Efficient pricing of European options in high-dimensional rough volatility models.
method Time-stepping deep gradient flow method reformulating the option pricing PDE as an energy minimization problem.
result The method respects asymptotic behavior and known bounds for option prices.

We conduct a large-scale study of language models for chord prediction. Specifically, we compare N-gram models to various flavours of recurrent neural networks on a comprehensive dataset comprising all publicly available datasets of annotated chords known to us. This large amount of data allows us to systematically exp…

2018-04-05abs ↗pdf ↗

Proposes a neural network for learning step-size policies for L-BFGS optimization.

problem Optimizing step sizes for L-BFGS in large-scale problems.
method Neural network architecture using local iterate information, trained via stochastic optimization.
result Outperforms existing step size selection methods in training classifiers.

Proposes a method for forecasting large-scale interval-valued time series.

problem Modeling and forecasting large-scale interval-valued time series.
method Feature extraction procedure involving auto-segmentation, clustering, and precision matrix estimation.
result The method enhances forecasting performance for large-scale interval-valued time series.

Applying standard Markov chain Monte Carlo (MCMC) algorithms to large data sets is computationally infeasible. The recently proposed stochastic gradient Langevin dynamics (SGLD) method circumvents this problem in three ways: it generates proposed moves using only a subset of the data, it skips the Metropolis-Hastings a…

2015-01-02abs ↗pdf ↗

A framework is introduced for actively and adaptively solving a sequence of machine learning problems, which are changing in bounded manner from one time step to the next. An algorithm is developed that actively queries the labels of the most informative samples from an unlabeled data pool, and that adapts to the chang…

2018-05-29abs ↗pdf ↗

A method to reduce Hessian matrix calculation cost in gradient-based meta-learning.

problem High memory footprint in calculating Hessian matrix for large-scale applications.
method Multi-step estimation of gradients to reuse the same gradient in a window of inner steps.
result Significant reduction in training time and memory usage with competitive or improved accuracies.

The Teacher Forcing algorithm trains recurrent networks by supplying observed sequence values as inputs during training and using the network's own one-step-ahead predictions to do multi-step sampling. We introduce the Professor Forcing algorithm, which uses adversarial domain adaptation to encourage the dynamics of th…

2016-10-27abs ↗pdf ↗

LSD distills high-quality samplers for DDMs with fewer steps.

problem Inefficient sampling in DDMs leads to low quality and high computational cost.
method LSD employs a distillation approach to train fast samplers with learnable coefficients and time schedules.
result LSD+ achieves higher sampling quality with fewer steps compared to existing samplers.

Discontinuous Finite Element Methods (DFEM) have been widely used for solving SnS_n radiation transport problems in participative and non-participative media. In the DFEM SnS_n methodology, the transport equation is discretized into a set of algebraic equations that have to be solved for each spatial cell and angular d…

2019-06-06abs ↗pdf ↗

The paper studies how search and distillation improve reasoning in large language models.

problem Improving reasoning capabilities of large language models.
method Viewing chain-of-thought generation as a metastable Markov process, proving benefits of search and distillation.
result Search protocol rewards sparse edges, reducing the expected number of steps to reach different clusters.

The paper studies momentum-based minimization for Ginzburg-Landau on Euclidean spaces and graphs.

problem Minimizing the Ginzburg-Landau functional on Euclidean spaces and graphs.
method Momentum-based minimization using a convex-concave splitting-based FISTA-type time discretization.
result Momentum can lead to faster convergence if the time step size is large but not too large.

The Frank-Wolfe (FW) algorithm has been widely used in solving nuclear norm constrained problems, since it does not require projections. However, FW often yields high rank intermediate iterates, which can be very expensive in time and space costs for large problems. To address this issue, we propose a rank-drop method …

2017-04-13abs ↗pdf ↗

The paper develops a neural network-based method for detecting change points in large-scale time-evolving data.

problem Detecting and locating change points in multivariate time-evolving data.
method Two-step procedure involving neural network training and test error function calibration over moving windows.
result Consistent estimates for the number and locations of change points under temporal dependence.

An intrinsic problem of classifiers based on machine learning (ML) methods is that their learning time grows as the size and complexity of the training dataset increases. For this reason, it is important to have efficient computational methods and algorithms that can be applied on large datasets, such that it is still …

2013-04-12abs ↗pdf ↗

A hybrid training method reduces SNN training time and complexity.

problem Training deep SNNs is computationally expensive and time-consuming.
method Hybrid training technique combining initialization from converted SNNs and incremental spike-timing dependent backpropagation (STDB).
result The method converges in less than 20 epochs, reducing training complexity and time.

Nowadays, the major challenge in machine learning is the Big Data challenge. The big data problems due to large number of data points or large number of features in each data point, or both, the training of models have become very slow. The training time has two major components: Time to access the data and time to pro…

2018-01-18abs ↗pdf ↗

SnAp approximates RTRL for online training of sparse recurrent networks.

problem Training large sparse recurrent networks online is computationally expensive.
method Sparse n-step Approximation (SnAp) of the RTRL influence matrix.
result SnAp with n=2 remains tractable for highly sparse networks and outperforms backpropagation through time.

Training a neural network with the gradient descent algorithm gives rise to a discrete-time nonlinear dynamical system. Consequently, behaviors that are typically observed in these systems emerge during training, such as convergence to an orbit but not to a fixed point or dependence of convergence on the initialization…

2018-05-22abs ↗pdf ↗

WALNUTS improves sampling efficiency and robustness for multi-scale distributions.

problem Adapting leapfrog step size for multi-scale posterior distributions.
method Adapts leapfrog step size at fixed intervals of simulated time, selecting the largest step size to keep energy error below a threshold.
result Substantial improvements in sampling efficiency and robustness compared to standard NUTS.

We propose mS2GD: a method incorporating a mini-batching scheme for improving the theoretical complexity and practical performance of semi-stochastic gradient descent (S2GD). We consider the problem of minimizing a strongly convex function represented as the sum of an average of a large number of smooth convex function…

2015-04-16abs ↗pdf ↗