SA-Solver improves stochastic sampling from DPMs.
problem Efficient sampling from Diffusion Probabilistic Models (DPMs) is time-consuming.
method Proposes SA-Solver, an improved stochastic Adams method for solving diffusion SDE.
result SA-Solver achieves improved or comparable performance compared to SOTA methods for few-step sampling.
New deep learning solver for high-dimensional derivative pricing.
problem High-dimensional derivatives pricing problems.
method Combines deep learning with least square regression for backward SDE solving.
result Accurate and efficient pricing of complex derivatives.
A new stochastic solver improves Convolutional Sparse Coding efficiency.
problem Efficiency and sparsity in Convolutional Sparse Coding.
method Randomized subsampling strategy in spatial domain for online learning.
result Improved execution time with no loss in learning quality.
Quantum machine learning solves high-dimensional PDEs with lower variance and improved accuracy.
problem Approximating solutions to high-dimensional parabolic PDEs.
method Pure Variational Quantum Circuit (VQC) for BSDE approximation, using temporal discretization and Monte Carlo simulation.
result VQC achieves lower variance and improved accuracy in most cases, particularly in highly nonlinear regimes.
Rex solves the inverse problem for ODE/SDE solvers, improving precision and stability.
problem Inversion of ODE/SDE solvers is inaccurate and impractical for precision applications.
method Rex uses Lawson methods to convert explicit Runge-Kutta schemes into algebraically reversible ones.
result Rex achieves near-machine-precision reconstruction and improves generative models.
A new approach RA improves stochastic optimization by executing multiple steps between subsample updates.
problem Improving the efficiency and effectiveness of stochastic optimization methods.
method Developed Retrospective Approximation (RA) which executes multiple steps between subsample updates using a deterministic solver.
result RA achieves almost sure and L1 consistency under weak conditions and optimizes iteration and oracle complexity. The paper speeds up hyperparameter optimisation in Gaussian processes.
problem Scaling hyperparameter optimisation to large datasets.
method Improvements to linear system solvers (pathwise gradient, warm starting, early stopping).
result Speed-ups of up to 72x and residual norm decreases of up to 7x.
Extends deep solver to FBSDEs with jumps for option pricing.
problem Solving FBSDEs with jumps for financial applications.
method Discretization, ANN parametrization, reinforcement learning, loss function minimization.
result Successfully applied to option pricing in low and high dimensions.
Develops a new solver for optimizing with stochastic dominance constraints.
problem Optimizing with stochastic dominance constraints is computationally expensive and impractical.
method Introduces Light Stochastic Dominance Solver (light-SD) that uses Lagrangian properties and surrogate approximation.
result The light-SD solver demonstrates superior performance on various problems.
Developing stable and scalable probabilistic ODE solvers for stiff and high-dimensional problems.
problem Stiff and high-dimensional ODEs
method Matrix-free update step and iterative re-linearization
result Improved stability and scalability
NSFs learn SDE transition laws for efficient sampling.
problem Efficiently sampling between arbitrary time points in SDEs.
method Conditional normalising flows with architectural constraints.
result Up to two orders of magnitude speed-ups at large time gaps.
FlowKac solves high-dimensional Fokker-Planck equations efficiently.
problem Intractability of Fokker-Planck equation solutions in high dimensions.
method Reformulates Fokker-Planck using Feynman-Kac, adaptive stochastic sampling, and normalizing flows.
result Significant computational efficiency and accuracy improvements over existing methods.
New integration method improves BSDE-based PDE solvers.
problem Discretization bias in standard BSDE-based solvers.
method Proposed Stratonovich-based BSDE formulation with stochastic Heun integration.
result Eliminates bias issues and outperforms EM-based variants.
New method solves constrained stochastic optimization problems efficiently.
problem Online statistical inference of constrained stochastic nonlinear optimization problems.
method Stochastic Sequential Quadratic Programming (StoSQP) with iterative sketching solver.
result The rescaled primal-dual sequence converges to a mean-zero Gaussian distribution.
Cyanure offers efficient solvers for linear model learning in Python, C++, and more.
problem Efficiently solving empirical risk minimization problems for linear models.
method Stochastic variance-reduced optimization with acceleration mechanisms.
result Handles a wide range of loss and regularization functions.
Scalable solver reduces PDE uncertainty with active learning.
problem High computational cost in solving PDEs.
method Stochastic dual descent and clustering-based active learning.
result Solver scales to large number of collocation points.
A mesh-free method solves continuum-marginal optimal transport problems.
problem Recovering minimum-energy velocity fields from time-continuous probability marginals.
method Embeds weak continuity equation in a reproducing kernel Hilbert space, optimizing with mini-batch stochastic methods.
result Accurately recovers drift and maintains marginal consistency in synthetic experiments.
In applications of Gaussian processes where quantification of uncertainty is of primary interest, it is necessary to accurately characterize the posterior distribution over covariance parameters. This paper proposes an adaptation of the Stochastic Gradient Langevin Dynamics algorithm to draw samples from the posterior …
GENOT matches cells across data modalities using neural OT solvers.
problem Scalability, privacy, and out-of-sample estimation issues in traditional OT solvers.
method Learn stochastic maps, parameterize OT maps, relax mass conservation, integrate quadratic solvers.
result Demonstrates significant potential for enhancing therapeutic strategies.
Deep-learning method solves BSVIEs and coupled systems.
problem High-dimensional, time-inconsistent stochastic control problems.
method Trains a neural network to approximate solution fields directly.
result Non-asymptotic error bound and scalable performance.
This paper proposes a data-driven approach, by means of an Artificial Neural Network (ANN), to value financial options and to calculate implied volatilities with the aim of accelerating the corresponding numerical methods. With ANNs being universal function approximators, this method trains an optimized ANN on a data s…
Paper accelerates diffusion models, improving sampling speed.
problem Low sampling speed in score-based diffusion models.
method Design of novel training-free algorithms for deterministic and stochastic samplers.
result Accelerated samplers converge faster with improved rates.
Proposes a new regularizer for semi-supervised learning on multilayer graphs.
problem Semi-supervised learning on multilayer graphs with labeled and unlabeled data.
method Generalized matrix mean regularizer and matrix-free numerical scheme.
result The regularizer outperforms state-of-the-art methods numerically.
New method efficiently computes gradients for stochastic differential equations.
problem Computing gradients for stochastic differential equations efficiently.
method Generalized adjoint sensitivity method to stochastic differential equations.
result Time-efficient and memory-efficient computation of gradients with high-order solvers.
Paper introduces a new method to solve complex PDEs efficiently.
problem Solving high-dimensional semilinear PDEs and BSDEs.
method Decomposes PDEs into linear and nonlinear parts, uses Deep BSDE solver with control variate method.
result Errors of the new method are much smaller than those of the original Deep BSDE solver.
New solver SR2 tackles deep neural network training with nonsmooth regularization.
problem Training deep neural networks with nonsmooth regularization to achieve sparsity and efficiency.
method Combines adaptive quadratic regularization with proximal stochastic gradient principles.
result Established worst-case iteration complexity of O(ε^−2) for SR2.
New method reduces variance in stochastic optimization with high confidence.
problem Achieving high-probability guarantees in stochastic optimization with weaker noise assumptions.
method Stochastic proximal point method combining proximal subproblem solver and probability booster.
result Demonstrates convergence with low sample complexity under bounded variance assumptions.
We propose a fast second-order method that can be used as a drop-in replacement for current deep learning solvers. Compared to stochastic gradient descent (SGD), it only requires two additional forward-mode automatic differentiation operations per iteration, which has a computational cost comparable to two standard for…
TADA improves diffusion sampling without training, up to 186% faster.
problem Efficient sampling in diffusion models, especially for high-fidelity images.
method Training-free ODE solver with higher-dimensional initial noise.
result Up to 186% faster sampling compared to state-of-the-art methods.
NWoS solves high-dimensional Poisson equations using neural networks.
problem Efficiently solving high-dimensional Poisson equations.
method Neural Walk-on-Spheres (NWoS) leveraging stochastic representations and Walk-on-Spheres methods.
result NWoS outperforms competing methods in accuracy, speed, and computational costs.
Flexible algorithms for maximizing rewards in structured bandits.
problem Reward maximization in structured stochastic multi-armed bandit problems.
method Asymptotically optimal algorithms using iterative saddle-point solvers.
result Achieves optimal performance with minimal computational burden.
Differentiable layers for convex optimization problems.
problem Rigidity of existing differentiable optimization layers.
method Disciplined parametrized programming and affine-solver-affine form.
result Efficient analytical differentiation through convex programs.
DeepGSB solves MFGs with non-differentiable preferences.
problem Solving MFGs with non-differentiable preferences and exact population convergence.
method Generalized Schrödinger Bridge via Forward-Backward SDEs and Temporal Difference learning.
result DeepGSB provides necessary and sufficient conditions for mean-field problems.
Quantum Transformer solves high-dimensional PDEs with improved accuracy.
problem Solving high-dimensional parabolic PDEs in engineering and physics.
method Quantum Transformer BSDE solver using FC-VQC with causal attention.
result Quantum Transformer consistently outperforms classical methods on PDE benchmarks.
We introduce an efficient message passing scheme for solving Constraint Satisfaction Problems (CSPs), which uses stochastic perturbation of Belief Propagation (BP) and Survey Propagation (SP) messages to bypass decimation and directly produce a single satisfying assignment. Our first CSP solver, called Perturbed Blief …
SCaSML improves PDE solvers by correcting errors efficiently.
problem Reliable and error-free high-dimensional PDE solutions.
method Defect correction method to derive a Structural-preserving Law of Defect.
result SCaSML achieves faster convergence and reduced errors in high-dimensional PDEs.
Exact solver speeds up Weston-Watkins SVM subproblem significantly.
problem Improving performance of Weston-Watkins multiclass SVM.
method Novel reparametrization for exact subproblem solving.
result Significant speed-up over state-of-the-art solvers for large number of classes.
Frank-Wolfe (FW) algorithms have been often proposed over the last few years as efficient solvers for a variety of optimization problems arising in the field of Machine Learning. The ability to work with cheap projection-free iterations and the incremental nature of the method make FW a very effective choice for many l…
Optimizes neural networks with blackbox solvers using Time-cost Regularization.
problem Improving neural network performance by integrating efficient solvers for complex problems.
method Optimizes both the primary loss function and the performance of the blackbox solver using Time-cost Regularization. Introduces a hyper-blackbox concept to learn blackbox parameters.
result Significant improvement in neural network performance through optimization of blackbox solvers.
This paper speeds up iterative GP inference with warm starting.
problem Improving scalability of Gaussian process inference.
method Warm starting sequential posteriors using known solutions.
result Significant speed-ups and improved Bayesian optimisation performance.
Efficient neural networks compute various differential operators cheaply.
problem Efficient computation of higher time complexity differential operators.
method Restricted neural network architectures with diagonal and hollow Jacobian matrices, allowing efficient extraction of dimension-wise derivatives.
result Demonstrated efficient computation of differential operators for various applications.
Study analyzes 3,171 stocks to pick efficient portfolios using quantum and classical solvers.
problem Creating efficient stock portfolios from a large dataset.
method Used classical and quantum solvers to optimize portfolios of 3,171 US stocks.
result Demonstrated the effectiveness of quantum and classical solvers in portfolio optimization.
Financial portfolio optimization is a widely studied problem in mathematics, statistics, financial and computational literature. It adheres to determining an optimal combination of weights associated with financial assets held in a portfolio. In practice, it faces challenges by virtue of varying math. formulations, par…
The numerical solution of large-scale PDEs, such as those occurring in data-driven applications, unavoidably require powerful parallel computers and tailored parallel algorithms to make the best possible use of them. In fact, considerations about the parallelization and scalability of realistic problems are often criti…
The minimization of convex objectives coming from linear supervised learning problems, such as penalized generalized linear models, can be formulated as finite sums of convex functions. For such problems, a large set of stochastic first-order solvers based on the idea of variance reduction are available and combine bot…
New solver MPLP++ outperforms existing solvers for dense graph models.
problem Efficiently solving dense, discrete Graphical Models with pairwise potentials.
method Dual Block-Coordinate Ascent with MPLP++ modification.
result MPLP++ significantly outperforms existing solvers, including TRWS.
We describe novel subgradient methods for a broad class of matrix optimization problems involving nuclear norm regularization. Unlike existing approaches, our method executes very cheap iterations by combining low-rank stochastic subgradients with efficient incremental SVD updates, made possible by highly optimized and…
Stochastic gradient methods converge for training wide PINNs.
problem Convergence of stochastic gradient descent in training over-parameterized PINNs.
method Established linear convergence of stochastic gradient descent/flow in training over-parameterized two-layer PINNs.
result Linear convergence with high probability for general activation functions.