The success of deep neural networks has inspired many to wonder whether other learners could benefit from deep, layered architectures. We present a general framework called forward thinking for deep learning that generalizes the architectural flexibility and sophistication of deep neural networks while also allowing fo…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Forward deep learning”
ForecastNet uses a time-variant deep feed-forward neural network for better multi-step-ahead time series forecasting.
problem Time-invariant architectures limit multi-step-ahead forecasting.
method ForecastNet employs a deep feed-forward architecture with time-variant parameters and interleaved outputs.
result ForecastNet outperforms other models on multi-step-ahead time series forecasting tasks.
In this introductory paper, we discuss how quantitative finance problems under some common risk factor dynamics for some common instruments and approaches can be formulated as time-continuous or time-discrete forward-backward stochastic differential equations (FBSDE) final-value or control problems, how these final val…
A new method uses deep learning to price barrier options.
problem Pricing barrier options with boundary conditions.
method Forward deep BSDEs with added nodes for barrier conditions.
result Can handle any barrier condition and boundary conditions.
Physics-informed deep learning for PDEs solves forward and inverse problems efficiently.
problem Solving forward and inverse problems in parametric PDEs efficiently and accurately.
method Physics-informed deep latent variable model (PDDLVM) combining deep neural networks, probabilistic modelling, and variational inference.
result Achieves up to three orders of magnitude speed-up compared to traditional FEM while providing coherent uncertainty estimates.
FISAR uses neural networks to optimize safe reinforcement learning with forward-invariant constraints.
problem Safe reinforcement learning with constraints in safety-critical environments.
method Imposing linear constraints on policy parameters' updating dynamics, using a DNN-based optimizer to satisfy these constraints.
result The policy decreases constraint violation and maximizes cumulative reward monotonically.
Deep learning solves non-Markovian FBSDEs for utility maximization.
problem Solving utility maximization problems under rough volatility.
method Deep learning-based numerical methods for non-Markovian fully coupled FBSDEs.
result Error estimates and convergence provided for the deep learning approach.
Deep learning calibrates HJM forward curves for commodity options pricing.
problem Calibrating HJM forward curves for accurate option pricing in commodity markets.
method Introduced a neural network to approximate true option prices from model parameters, calibrated using observed option prices.
result Neural network calibration yields high accuracy in recovering option prices, even with model parameter approximation loss.
A new algorithm solves high-dimensional nonlinear BSDEs efficiently.
problem Solving high-dimensional nonlinear backward stochastic differential equations (BSDEs).
method Transformed BSDE into a differential deep learning problem using Malliavin calculus. Discretized integrals using Euler-Maruyama method. Approximated solution with three deep neural networks. Optimized parameters using a differential learning loss function.
result Our algorithm is more accurate and faster than other methods.
Deep network learns Obstacle Tower challenge without human demonstrations.
problem Master procedurally generated levels that get progressively harder.
method Deep Reinforcement Learning with a simple feed-forward network.
result Performed competitively in a reinforcement learning competition.
Scalable physics-informed deep generative model for solving forward and inverse stochastic differential equationsphysics.comp-ph
New model solves complex SDEs with high-dimensional spatial and stochastic spaces.
problem Solving SDEs with high-dimensional spatial and stochastic spaces.
method Physics-informed deep generative model (sPI-GeM) combining PI-BasisNet and PI-GeM.
result Scalable solution for high-dimensional SDE problems.
We present a general framework for training deep neural networks without backpropagation. This substantially decreases training time and also allows for construction of deep networks with many sorts of learners, including networks whose layers are defined by functions that are not easily differentiated, like decision t…
A new model improves uncertainty estimation in deep learning.
problem Deep Kernel Learning (DKL) produces unreliable uncertainty estimates.
method Proposed a bi-Lipschitz constraint to preserve distances in feature space.
result DUE model outperforms previous DKL and other methods in uncertainty quality.
Proposes a deep model for Bayesian quantile regression without Gaussian assumptions.
problem Uncertainty quantification from single forward-pass models is computationally expensive and restrictive.
method Deep evidential learning for Bayesian quantile regression.
result Achieves calibrated uncertainties on non-Gaussian distributions.
SHINE uses forward pass quasi-Newton matrices to approximate Jacobian inverses for faster bi-level optimization.
problem Efficiently solving bi-level optimization problems with large Jacobian matrices.
method Proposes using quasi-Newton matrices from the forward pass to approximate the inverse Jacobian matrix.
result Empirically shows SHINE reduces computational cost of the backward pass for various problems.
FBSJNN solves PIDEs and FBSDEJs with deep learning, offering theoretical and numerical efficiency.
problem Solving Partial Integro-Differential Equations and Forward-Backward Stochastic Differential Equations with Jumps.
method FBSJNN framework using a single neural network for both solution approximation and non-local integral.
result FBSJNN achieves numerical solutions with a relative error of , demonstrating efficiency.
Bayesian Deep Learning tackles inverse problems with neural networks and approximate computations.
problem Solving inverse problems with indirect measurements and uncertainties.
method Bayesian Deep Learning, using neural networks and approximate computations.
result Effective solutions for inverse problems using Bayesian Deep Learning.
Single-pass method estimates neural network uncertainty.
problem Uncertainty estimation in deep learning requires multiple passes.
method Probabilistic reasoning over neural network depths.
result Single forward pass for uncertainty estimation.
Simple neural net outperforms complex uncertainty methods.
problem Reliable uncertainty estimation from deterministic models.
method A simple baseline using a single softmax neural net with residual connections and spectral normalization.
result Simple neural net outperforms DUQ and SNGP on uncertainty prediction.
Training deep recurrent neural network (RNN) architectures is complicated due to the increased network complexity. This disrupts the learning of higher order abstracts using deep RNN. In case of feed-forward networks training deep structures is simple and faster while learning long-term temporal information is not poss…
Classical numerical methods for solving partial differential equations suffer from the curse dimensionality mainly due to their reliance on meticulously generated spatio-temporal grids. Inspired by modern deep learning based techniques for solving forward and inverse problems associated with partial differential equati…
We propose a new forward-backward stochastic differential equation solver for high-dimensional derivatives pricing problems by combining deep learning solver with least square regression technique widely used in the least square Monte Carlo method for the valuation of American options. Our numerical experiments demonst…
Framework for confidence estimation in deep CT reconstructions.
problem Uncertainty in deep learning-based CT reconstructions.
method Sequential likelihood mixing framework with log-linear forward model.
result Deep models yield tighter confidence regions than classical methods.
We propose a neural network-based algorithm for solving forward and inverse problems for partial differential equations in unsupervised fashion. The solution is approximated by a deep neural network which is the minimizer of a cost function, and satisfies the PDE, boundary conditions, and additional regularizations. Th…
Accelerating PDE-constrained Inverse Solutions with Deep Learning and Reduced Order Modelsphysics.comp-ph
Inverse problems are pervasive mathematical methods in inferring knowledge from observational and experimental data by leveraging simulations and models. Unlike direct inference methods, inverse problem approaches typically require many forward model solves usually governed by Partial Differential Equations (PDEs). Thi…
SDPA is shown to be an optimal transport problem in deep learning.
problem The mathematical foundation and optimization perspective of SDPA.
method SDPA is shown to be the exact solution to a degenerate, one-sided Entropic Optimal Transport (EOT) problem.
result The SDPA mechanism is a principled mechanism where the forward pass performs optimal inference and the backward pass implements a rational, manifold-aware learning update.
We present experiments demonstrating that some other form of capacity control, different from network size, plays a central role in learning multilayer feed-forward networks. We argue, partially through analogy to matrix factorization, that this is an inductive bias that can help shed light on deep learning.
Bayesian units improve speech recognition with minimal parameters.
problem Improving speech recognition models with fewer parameters.
method Derived Bayesian recurrent units integrated into deep learning frameworks.
result Adding Bayesian units improves speech recognition performance.
Proposes a new CG interpretation of neural networks for better theoretical analysis.
problem Lack of theoretical analysis in neural networks interpretation.
method Interprets neural networks as chain graphs and feed-forward as approximate inference.
result Provides novel theoretical support and insights for various neural network techniques.
Extends deep solver to FBSDEs with jumps for option pricing.
problem Solving FBSDEs with jumps for financial applications.
method Discretization, ANN parametrization, reinforcement learning, loss function minimization.
result Successfully applied to option pricing in low and high dimensions.
A new method solves complex financial problems using deep learning.
problem Optimal stopping and option pricing in finance.
method Compound BSDE method, based on reformulating BSDEs.
result The method offers accurate and efficient solutions for high-dimensional problems.
Applications in quantitative finance such as optimal trade execution, risk management of options, and optimal asset allocation involve the solution of high dimensional and nonlinear Partial Differential Equations (PDEs). The connection between PDEs and systems of Forward-Backward Stochastic Differential Equations (FBSD…
We introduce a new deep-learning based algorithm to evaluate options in affine rough stochastic volatility models. Viewing the pricing function as the solution to a curve-dependent PDE (CPDE), depending on forward curves rather than the whole path of the process, for which we develop a numerical scheme based on deep le…
Deep neural networks solve noisy, complex problems accurately.
problem Reconstructing solutions from noisy, high-dimensional, non-linear inverse problems.
method Restricting infinite-dimensional forward operators to finite-dimensional spaces, training neural networks to approximate these operators robustly to noise.
result Deep neural networks can accurately solve high-dimensional, noisy, non-linear inverse problems.
Single deep model detects out-of-distribution data with single forward pass.
problem Detecting out-of-distribution data points in neural networks.
method Deterministic uncertainty quantification (DUQ) using gradient penalty for reliable detection.
result Single model outperforms or matches ensemble methods in out-of-distribution detection.
Deep learning is increasingly being used in high-stake decision making applications that affect individual lives. However, deep learning models might exhibit algorithmic discrimination behaviors with respect to protected groups, potentially posing negative impacts on individuals and society. Therefore, fairness in deep…
This paper introduces Selective-Backprop, a technique that accelerates the training of deep neural networks (DNNs) by prioritizing examples with high loss at each iteration. Selective-Backprop uses the output of a training example's forward pass to decide whether to use that example to compute gradients and update para…
Deep-learning method solves BSVIEs and coupled systems.
problem High-dimensional, time-inconsistent stochastic control problems.
method Trains a neural network to approximate solution fields directly.
result Non-asymptotic error bound and scalable performance.
PFP-BNNs offer a fast, deterministic approach to Bayesian neural networks.
problem Limited uncertainty handling in traditional neural networks restricts their use in safety-critical settings.
method Probabilistic Forward Pass (PFP) approximates Stochastic Variational Inference (SVI) for efficient BNNs.
result PFP-BNNs achieve up to 4200x speedup over SVI-BNNs while maintaining similar accuracy and uncertainty.
Causal Deep Learningcs.LG
Causal deep learning tackles causal inference using tensor factor analysis.
problem Addressing causal questions in data using neural networks.
method Tensor factor analysis and neural network architectures (causal capsules, tensor transformer, multilinear projection algorithm).
result Derives deep neural networks for causal inference with tensor factor analysis.
This research examines the geometry of latent spaces in push-forward generative models.
problem Tendency of deep generative models to output samples outside target distribution support.
method Geometric measure theory and truncation method to enforce simplicial cluster structure.
result Proves sufficient condition for optimality in latent space geometry.
Deep model improves option pricing for CSI 300 index with sentiment and volatility features.
problem Challenges in real market option pricing, especially with constant volatility assumption.
method Deep Forward-Backward Stochastic Differential Equation (FBSDE) framework with dual-network architecture.
result Significant reduction in MAE and MAPE compared to BSM model.
Neural networks offer high-accuracy solutions to a range of problems, but are costly to run in production systems because of computational and memory requirements during a forward pass. Given a trained network, we propose a techique called Deep Learning Approximation to build a faster network in a tiny fraction of the …
GANs can learn hierarchical distributions in real-world images efficiently.
problem Understanding and efficiently learning complex, real-world distributions with GANs.
method Formally studying how GANs can learn hierarchically generated distributions close to real-life image distributions using SGDA.
result Training GANs via SGDA can efficiently learn distributions with a 'forward super-resolution' structure, both in sample and time complexities.
AAMDRL uses DRL to manage assets in noisy, changing environments.
problem Learning in noisy, self-adapting environments with sequential data.
method Augmented state information, one-period lag, walk forward analysis.
result AAMDRL outperforms traditional methods in asset management.
Deep learning surrogate interacting Markov chain Monte Carlo based full wave inversion scheme for properties of materials quantificationcond-mat.mtrl-sci
Full Wave Inversion (FWI) imaging scheme has many applications in engineering, geoscience and medical sciences. In this paper, a surrogate deep learning FWI approach is presented to quantify properties of materials using stress waves. Such inverse problems, in general, are ill-posed and nonconvex, especially in cases w…
We examine Deep Canonically Correlated LSTMs as a way to learn nonlinear transformations of variable length sequences and embed them into a correlated, fixed dimensional space. We use LSTMs to transform multi-view time-series data non-linearly while learning temporal relationships within the data. We then perform corre…
We introduce a model based off-the-grid image reconstruction algorithm using deep learned priors. The main difference of the proposed scheme with current deep learning strategies is the learning of non-linear annihilation relations in Fourier space. We rely on a model based framework, which allows us to use a significa…