We study first-order optimization methods obtained by discretizing ordinary differential equations (ODEs) corresponding to Nesterov's accelerated gradient methods (NAGs) and Polyak's heavy-ball method. We consider three discretization schemes: an explicit Euler scheme, an implicit Euler scheme, and a symplectic scheme.…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “implicit scheme”
Market makers optimize trading with a new implicit scheme for complex inequalities.
problem Optimizing trading in a limit order book with stochastic and impulse control.
method Implicit numerical scheme coupled with policy iteration algorithm.
result Convergence to the unique viscosity solution of the HJBQVI.
JKO scheme adds deceleration in rapidly changing metric curvature directions.
problem Understanding the implicit bias of the JKO scheme in Wasserstein gradient flow.
method Characterized the implicit bias of the JKO scheme at second order in η, modifying the energy functional.
result JKO scheme adds deceleration in directions where metric curvature of J is rapidly changing.
Implicit schemes are popular methods for the integration of time dependent PDEs such as hyperbolic and parabolic PDEs. However the necessity to solve corresponding linear systems at each time step constitutes a complexity bottleneck in their application to PDEs with rough coefficients. We present a generalization of ga…
Implicit discourse relation classification is of great challenge due to the lack of connectives as strong linguistic cues, which motivates the use of annotated implicit connectives to improve the recognition. We propose a feature imitation framework in which an implicit relation network is driven to learn from another …
We present a sparse grid high-order alternating direction implicit (ADI) scheme for option pricing in stochastic volatility models. The scheme is second-order in time and fourth-order in space. Numerical experiments confirm the computational efficiency gains achieved by the sparse grid combination technique.
Proposes LBD for more robust deep learning models.
problem Improving robustness and uncertainty in deep learning models.
method Model-agnostic learnable Bernoulli dropout with joint optimization of dropout rates.
result Superior performance compared to other dropout schemes.
The coupled system, where one is a degenerate parabolic equation and the other has not a diffusion term arises in the modeling of European options with liquidity shocks. Two implicit-explicit (IMEX) schemes that preserve the positivity of the differential problem solution are constructed and analyzed. Numerical experim…
Operator splitting schemes for American options under the two-asset Merton jump-diffusion modelmath.NA
The paper develops and tests operator splitting schemes for American options in a complex model.
problem Efficient numerical solution of American options under a two-asset Merton jump-diffusion model.
method Adaptation of IMEX and ADI operator splitting schemes to solve the two-dimensional PIDCP.
result Investigates and compares the convergence and performance of eight operator splitting methods.
New method accelerates energetic variational inference using particle dynamics.
problem Efficiently solving variational inference problems with reduced computational cost.
method Particle-based variational inference with implicit scheme, inspired by energy quadratization and operator splitting.
result Significantly reduces computational cost compared to existing methods.
Efficiently simulates the Heston model with large time steps using a novel method.
problem Challenges in simulating the Heston model with large time steps.
method Implicit integrated variance scheme exploiting the near-linear nature between stochastic driver and conditional integrated variance process.
result Achieves near-exact accuracy with coarse discretizations, efficient for large time steps.
Convergence Analysis and Implicit Regularization of Feedback Alignment for Deep Linear Networkscs.LG
FA algorithm provides convergence guarantees for deep linear networks.
problem Training efficiency and convergence of deep neural networks.
method Theoretical analysis of Feedback Alignment (FA) algorithm for deep linear networks.
result Certain initializations lead to implicit anti-regularization, affecting learning effectiveness.
In this paper a simple, effective adaptation of Alternating Direction Implicit (ADI) time discretization schemes is proposed for the numerical pricing of American-style options under the Heston model via a partial differential complementarity problem. The stability and convergence of the new methods are extensively inv…
ISALT: Inference-based schemes adaptive to large time-stepping for locally Lipschitz ergodic systemsmath.NA
ISALT uses inference to simulate SDEs with large time-steps, improving efficiency.
problem Efficiently simulating ergodic SDEs with large time-steps.
method Inference-based schemes adaptive to large time-steps (ISALT) from data.
result ISALT achieves significant time reduction and optimal accuracy.
New probabilistic scheme combines deep learning with Runge-Kutta methods for solving PDEs.
problem Solving high-dimensional semi-linear parabolic PDEs efficiently.
method Probabilistic scheme using deep learning and Runge-Kutta methods.
result Crank-Nicolson schemes are efficient in terms of precision, computational cost, and numerical implementation.
New boundary treatment improves accuracy for complex PDEs.
problem Order reduction in high-order IMEX schemes for multidimensional PDEs.
method Novel boundary treatment algorithms for Cartesian meshes, treating implicit-explicit stages similarly to interior points.
result Recovery of designed order of convergence by numerical verification.
This paper deals with a high-order accurate implicit finite-difference approach to the pricing of barrier options. In this way various types of barrier options are priced, including barrier options paying rebates, and options on dividend-paying-stocks. Moreover, the barriers may be monitored either continuously or disc…
We present a design and implementation of the Thomas algorithm optimized for hardware acceleration on an FPGA, the Thomas Core. The hardware-based algorithm combined with the custom data flow and low level parallelism available in an FPGA reduces the overall complexity from 8N down to 5N serial arithmetic operations, a…
In this effort, we propose a new deep architecture utilizing residual blocks inspired by implicit discretization schemes. As opposed to the standard feed-forward networks, the outputs of the proposed implicit residual blocks are defined as the fixed points of the appropriately chosen nonlinear transformations. We show …
In this paper we investigate the effectiveness of Alternating Direction Implicit (ADI) time discretization schemes in the numerical solution of the three-dimensional Heston-Hull-White partial differential equation, which is semidiscretized by applying finite difference schemes on nonuniform spatial grids. We consider t…
Unweighted matrix factorization can match or outperform weighted methods in recommender systems.
problem Improving recommendation performance with matrix factorization on implicit feedback data.
method Systematic study of various weighting schemes and matrix factorization algorithms.
result Training with unweighted data can perform comparably to, and sometimes outperform, training with weighted data.
Financial derivatives pricing aims to find the fair value of a financial contract on an underlying asset. Here we consider option pricing in the partial differential equations framework. The contemporary models lead to one-dimensional or multidimensional parabolic problems of the convection-diffusion type and generaliz…
Large data limit of the MBO scheme for data clustering: -convergence of the thresholding energiesmath.AP
The MBO scheme for data clustering is analyzed in the large data limit, proving convergence to optimal partition problems.
problem Analyzing the MBO scheme for data clustering in the large data limit.
method Implicit gradient descent on the thresholding energy of a similarity graph.
result The MBO scheme outcomes converge to minimizers of a weighted optimal partition problem.
Noise in RNNs promotes flatter minima and more stable dynamics.
problem Understanding and optimizing the training of RNNs with noise.
method Formalizing RNNs as stochastic differential equations and analyzing the effect of noise in the hidden states.
result Noise injection in RNNs leads to flatter minima, more stable dynamics, and improved robustness.
Efficient numerical valuation of European options under the two-asset Kou jump-diffusion modelmath.NA
The paper efficiently solves a complex option valuation equation for two assets.
problem Valuation of European options under a two-asset Kou jump-diffusion model.
method Extends an efficient algorithm for a one-dimensional integral to a two-dimensional one, using operator splitting schemes for time discretization.
result The method achieves optimal computational cost and stable convergence for various operator splitting schemes.
We investigate implicit regularization schemes for gradient descent methods applied to unpenalized least squares regression to solve the problem of reconstructing a sparse signal from an underdetermined system of linear measurements under the restricted isometry assumption. For a given parametrization yielding a non-co…
Novel IMEX scheme solves financial PDEs with mixed derivatives.
problem Numerical approximations for financial PDEs with mixed derivatives.
method Second order finite volume IMEX Runge-Kutta scheme.
result Achieves true second order convergence with non-regular initial conditions.
We propose a new high-order alternating direction implicit (ADI) finite difference scheme for the solution of initial-boundary value problems of convection-diffusion type with mixed derivatives and non-constant coefficients, as they arise from stochastic volatility models in option pricing. Our approach combines differ…
In this paper, a standard PDE for the pricing of arithmetic average strike Asian call option is presented. A Crank-Nicolson Implicit Method and a Higher Order Compact finite difference scheme for this pricing problem is derived. Both these schemes were implemented for various values of risk free rate and volatility. Th…
Modality-agnostic compression improves across diverse data types.
problem Efficiently compressing data across multiple modalities.
method Functional view of data, Implicit Neural Representation (INR), modality-agnostic latent representations, variational compression.
result Improved performance compared to existing methods, especially for diverse modalities.
Simulating integrated Volterra square-root processes and Volterra Heston models via Inverse Gaussianq-fin.MF
A new simulation method for Volterra processes improves convergence for rough kernels.
problem Simulating Volterra processes with singular kernels.
method iVi (integrated Volterra implicit) scheme based on Inverse Gaussian distribution.
result The iVi scheme achieves weak convergence with few time steps, especially for rough kernels.
Research covers geometry, analysis, and integration on infinite-dimensional spaces.
problem Exploring geometric and analytical structures in infinite-dimensional settings.
method Analyzes numerical schemes, Lie groups, connections, and integration theory.
result Developed new methods for integration and analysis on infinite-dimensional manifolds.
Gradient descent training of neural networks leads to solutions close to natural cubic splines.
problem Understanding the implicit bias of gradient descent in neural networks.
method Analysis of gradient descent training for wide neural networks, focusing on the curvature penalty and initialization schemes.
result The solutions of gradient descent training are polyharmonic splines for certain initialization schemes.
A Penalty Method for the Numerical Solution of Hamilton-Jacobi-Bellman (HJB) Equations in Financeq-fin.CP
We present a simple and easy to implement method for the numerical solution of a rather general class of Hamilton-Jacobi-Bellman (HJB) equations. In many cases, the considered problems have only a viscosity solution, to which, fortunately, many intuitive (e.g. finite difference based) discretisations can be shown to co…
This paper summarizes closed-form relations for SE(3) maps and their derivatives.
problem Closed-form expressions for SE(3) maps and their derivatives are scattered in the literature.
method Summarizes and provides proofs for relevant closed-form relations of the exponential and Cayley map on SE(3).
result Provides an implicit generalized-alpha scheme for rigid/flexible multibody systems using the Cayley map.
Develops a new option pricing model under G-expectation framework.
problem Modeling uncertainty in financial markets and robust valuation under model uncertainty.
method G-expectation framework, logarithmic transformation, finite difference schemes.
result Unified risk-neutral valuation approach yielding G-Black-Scholes equation.
Adaptive method improves numerical solution of Cox-Ingersoll-Ross model.
problem Approximating solutions to the Cox-Ingersoll-Ross model efficiently.
method Path-bounded timestepping with hybrid approach, including a backstop method.
result The adaptive method is strongly convergent, with strong error control.
New algorithm handles delayed feedback robustly, reducing regret without knowing delay bounds.
problem Bandits with variably delayed feedback, especially excessive delays.
method Implicit exploration scheme, adaptive skipping, drifted regret control.
result Can tolerate arbitrary excessive delays up to order T, reducing regret.
Improved speech recognition with language model integration in sequence-to-sequence models.
problem Improving word error rate in speech recognition models.
method Log-linear combination of acoustic and language models with per-token renormalization.
result The proposed method shows good improvements over standard model combination on Librispeech system.
Adam's bias shifts from full-batch to max-margin of different norms for separable data.
problem Understanding Adam's implicit bias in the incremental batch setting.
method Analyzing incremental Adam on linearly separable data, constructing datasets, and using a proxy algorithm.
result Incremental Adam can converge to different max-margin classifiers depending on the dataset and batching scheme.
Novel approach to contextual bandits using self-supervised learning.
problem Exploiting rich data representations in computer vision without explicit labels.
method Combining contextual bandit objective with self-supervision objective.
result Substantial gains in cumulative reward on computer vision datasets.
We exhibit differential geometric structures that arise in numerical methods, based on the construction of Cauchy sequences, that are currently used to prove explicitly the existence of weak solutions to functional equations. We describe the geometric framework, highlight several examples and describe how two well-know…
A new method for pricing options with stochastic volatility and jumps.
problem Pricing options under stochastic volatility and jumps.
method Fourth-order compact finite-difference scheme with implicit-explicit Crank-Nicolson framework.
result The method achieves near-fourth-order spatial accuracy and up to two orders of magnitude lower runtime than quadratic finite elements.
This paper considers the single factor Heath-Jarrow-Morton model for the interest rate curve with stochastic volatility. Its natural formulation, described in terms of stochastic differential equations, is solved through Monte Carlo simulations, that usually involve rather large computation time, inefficient from a pra…
We present a dynamical system framework for understanding Nesterov's accelerated gradient method. In contrast to earlier work, our derivation does not rely on a vanishing step size argument. We show that Nesterov acceleration arises from discretizing an ordinary differential equation with a semi-implicit Euler integrat…
We analyze exponential integrability properties of the Cox-Ingersoll-Ross (CIR) process and its Euler discretizations with various types of truncation and reflection at 0. These properties play a key role in establishing the finiteness of moments and the strong convergence of numerical approximations for a class of sto…
ConQUR tackles delusional bias in deep Q-learning, improving performance in Atari games.
problem Delusional bias in deep Q-learning.
method Efficient methods to mitigate delusional bias by training Q-approximators with consistent labels and a search framework.
result Improves performance in Atari games, sometimes dramatically.
NoisyMix boosts model robustness to common corruptions.
problem Improving robustness of neural networks in real-world applications.
method NoisyMix training scheme that uses noisy augmentations in input and feature space.
result NoisyMix produces more robust models with well-calibrated class membership probabilities.