Deep RL learns optimal trading strategies.
problem Optimizing trading strategies using deep reinforcement learning.
method Deep deterministic policy gradient algorithm applied to simple trading environments.
result Deep RL can recover optimal trading strategies and achieve close-to-optimal rewards.
VeLO learns versatile optimizers from deep learning tasks.
problem Training deep learning models with hand-designed optimizers.
method Meta-training a neural network optimizer on a wide variety of optimization tasks.
result The learned optimizer automatically adapts to different optimization tasks without hyperparameter tuning.
This paper surveys gradient-based multi-objective deep learning methods.
problem Balancing multiple conflicting objectives in deep learning models.
method Gradient-based techniques adapted from Multi-Objective Optimization.
result Comprehensive survey of gradient-based multi-objective deep learning algorithms.
We simplify deep learning convergence analysis using basic math.
problem Ensuring reliable convergence of optimization algorithms in deep networks.
method Elementary arguments and computations to estimate smoothness constants.
result Systematic computation of smoothness constants for first-order algorithms.
Paper uses deep reinforcement learning for optimal stock portfolio management.
problem Optimizing stock portfolio choices in complex market environments.
method Direct deep reinforcement learning to learn factor representations and make optimal decisions.
result Deep learning outperforms average market performance in portfolio allocation.
Study compares various optimization algorithms for deep learning.
problem Challenges in optimizing deep neural networks as they grow deeper and datasets increase.
method Implemented and compared adaptive gradient methods for supervised and unsupervised tasks on four image datasets.
result Differences in behavior and performance of optimization algorithms during training.
Deep RL optimizes dynamic portfolio weights in China's stock market.
problem Traditional portfolio optimization methods struggle with dynamic asset weight adjustments.
method Developed a deep reinforcement learning framework with novel reward functions and random sampling.
result Model outperforms traditional methods in portfolio optimization and risk mitigation.
We explore the use of deep learning and deep reinforcement learning for optimization problems in transportation. Many transportation system analysis tasks are formulated as an optimization problem - such as optimal control problems in intelligent transportation systems and long term urban planning. Often transportation…
Deep learning models optimize protein sequences.
problem Optimizing protein properties through sequence design.
method Deep generative models guided by machine learning.
result Improved protein sequence generation from prior knowledge.
Scalable tools for nested optimization in deep learning.
problem Solving nested optimization problems on a large scale in deep learning.
method Building scalable tools for bilevel optimization.
result Tools for nested optimization scale to deep learning setups.
Lecture notes on linear neural networks for deep learning optimization and generalization.
problem Understanding optimization and generalization in deep learning models.
method Mathematical tools and dynamical systems theory.
result Potential of mathematical tools to enhance understanding of deep learning.
Given a set of observations generated by an optimization process, the goal of inverse optimization is to determine likely parameters of that process. We cast inverse optimization as a form of deep learning. Our method, called deep inverse optimization, is to unroll an iterative optimization process and then use backpro…
Deep learning improves portfolio optimization in volatile markets.
problem Challenges in long-only, multi-asset strategies across market cycles.
method Training DL models with limited regime data using pre-training techniques and transformer architectures.
result Models show resilience and improved predictive accuracy in volatile markets.
This paper surveys RL for combinatorial optimization, focusing on TSP.
problem Optimizing solutions for combinatorial optimization problems.
method Reinforcement learning applied to combinatorial optimization problems, specifically the TSP.
result Deep learning mechanisms enhance RL algorithms for near-optimal solutions.
The performance of deep neural networks (DNN) is very sensitive to the particular choice of hyper-parameters. To make it worse, the shape of the learning curve can be significantly affected when a technique like batchnorm is used. As a result, hyperparameter optimization of deep networks can be much more challenging th…
Deep learning improves sensor performance optimization.
problem Optimizing sensor performance based on key metrics.
method Re-approach non-linear regression using deep learning with Keras and Tensorflow.
result Deep learning models improve sensor performance optimization.
LM optimization outperforms other methods in deep learning tasks but at high computational cost.
problem Finding efficient optimization methods for deep learning models.
method Comparing first-order (CG, SGD, LM, L-BFGS) and higher-order optimization functions.
result Levemberg-Marquardt (LM) optimization significantly improves convergence but at a high computational cost.
DeepCO uses deep learning for offline combinatorial optimization in warehouse operations.
problem Optimizing warehouse operation sequences in offline settings.
method DeepCO framework utilizing distribution regularized optimization for TSP.
result DeepCO reduces route length by 5.7% on average for TSP problems.
DC3 uses deep learning to solve hard-constrained optimization problems efficiently.
problem Hard constraints in optimization problems make classical solvers slow and infeasible.
method DC3 employs a differentiable procedure to enforce feasibility and unrolls corrections for inequality constraints.
result DC3 achieves near-optimal solutions while maintaining feasibility in both synthetic and real-world tasks.
New kernel connects deep learning to optimization, improving generalization.
problem Understanding why deep neural networks generalize well at over-parameterization.
method Established Neural Optimization Kernel (NOK) linking deep NN to optimization problems.
result New generalization bound for deep structured approximated NOK architecture.
Deep learning optimizes gas storage operations.
problem Optimizing underground natural gas storage operations.
method Reinforcement learning techniques applied to high-dimensional forward markets with constraints.
result Performance of deep learning method superior to least-squares Monte-Carlo approach.
This paper proposes a new global optimization algorithm using deep learning.
problem Developing efficient algorithms for global optimization of non-convex functions.
method Two-phase approach: minimization phase with model-driven deep learning, escaping phase with reinforcement learning.
result The proposed algorithm significantly outperforms classical optimization methods and handles ill-posed functions.
Deep learning improves optimal trading strategies in complex markets.
problem Finding optimal trading strategies in markets with multiple time scales.
method Deep differentiable reinforcement learning applied to optimal trading.
result Deep learning leads to more accurate and stable optimal trading strategies.
Wide deep neural networks are easy to optimize without constraints.
problem Optimizing wide deep neural networks.
method Analysis of optimization landscapes and empirical-risk minimization.
result Wide neural networks have no confined points, making optimization easier.
OpTorch optimizes deep learning for resource-limited environments.
problem Resource constraints in deep learning training.
method Optimized deep learning pipelines in training time and memory.
result Achieved similar accuracy to existing libraries with reduced memory usage.
We propose a novel training algorithm for reinforcement learning which combines the strength of deep Q-learning with a constrained optimization approach to tighten optimality and encourage faster reward propagation. Our novel technique makes deep reinforcement learning more practical by drastically reducing the trainin…
In this paper, we introduce McTorch, a manifold optimization library for deep learning that extends PyTorch. It aims to lower the barrier for users wishing to use manifold constraints in deep learning applications, i.e., when the parameters are constrained to lie on a manifold. Such constraints include the popular orth…
A new method approximates expected empirical loss for stochastic deep learning tasks.
problem Determining optimal step sizes for stochastic gradient descent in deep learning.
method Applying one-dimensional function fitting to noisy losses of vertical cross sections to approximate expected empirical loss.
result The method leads to a robust and straightforward optimization method that performs well across datasets and architectures.
This paper analyzes challenges and solutions in deep learning optimization.
problem Gradient vanishing and exploding issues in deep learning.
method Improvement of gradient flow and constraints on Lipschitz constant.
result Enhanced understanding of Jacobian matrices and Lipschitz constants in deep learning modules.
Deep Penalty Method solves high-dimensional optimal stopping problems using deep learning.
problem High-dimensional optimal stopping problems in American option pricing.
method Inspired by penalty method for PDEs, approximates penalized PDE with Deep BSDE framework.
result Error bound of DPM is O ( 1 λ ) + O ( λ h ) + O ( h ) O(\frac{1}{\lambda}) + O(\lambda h) + O(\sqrt{h}) O ( λ 1 ) + O ( λh ) + O ( h ) . Exact second-order optimization for deep learning reduces computational cost and improves performance.
problem Inadequate use of second-order optimization methods in deep learning due to high computational cost and non-convexity.
method Developed an exact stochastic second-order Newton method that addresses the non-convexity issue and provides an expression for the stochastic Hessian.
result Exact second-order Newton direction formula and its application in deep learning datasets.
The paper develops a new theory to understand deep learning optimization.
problem Understanding the dynamics of optimization in deep learning, especially in the edge of stability regime.
method Developed a central flow differential equation to describe the time-averaged trajectory of oscillatory optimizers.
result Central flows can predict long-term optimization trajectories with high numerical accuracy.
Attempts from different disciplines to provide a fundamental understanding of deep learning have advanced rapidly in recent years, yet a unified framework remains relatively limited. In this article, we provide one possible way to align existing branches of deep learning theory through the lens of dynamical system and …
Despite the huge empirical success of deep learning, theoretical understanding of neural networks learning process is still lacking. This is the reason, why some of its features seem "mysterious". We emphasize two mysteries of deep learning: generalization mystery, and optimization mystery. In this essay we review and …
Book introduces deep learning methods with math, theory, and applications.
problem Understanding deep learning algorithms and their mathematical foundations.
method Reviews various ANN architectures and optimization methods, covers theoretical aspects.
result Provides a solid mathematical foundation for deep learning.
Examines learned optimizers in deep learning, revealing their dynamics and potential improvements.
problem Stability and generalization issues with learned optimizers.
method Analyzes optimization trajectories using network architecture symmetries and parameter update distributions, contrasts with manual designs.
result Identifies key insights for improving learned optimizers by leveraging strengths from both learned and manual designs.
This paper reviews hyper-parameter optimization methods for deep learning.
problem Designing and training deep neural networks is challenging and unpredictable.
method Reviews major optimization algorithms and services for hyper-parameter tuning.
result Comprehensive comparison of optimization algorithms and services.
Paper optimizes urban navigation with deep learning models.
problem Real-time urban pathfinding challenges.
method Enhanced A* algorithm and neural network model.
result Neural network model outperforms traditional methods, reducing travel times by up to 40%.
Framework explains deep learning generalization by comparing real and ideal worlds.
problem Understanding why deep models generalize well in practice.
method Integrates real-world empirical loss with ideal population loss to decompose test error.
result The gap between real and ideal worlds is small in deep learning, suggesting robust optimization leads to good generalization.
Optimization geometry affects deep learning performance.
problem The impact of optimization geometry on deep learning performance.
method Analysis of pseudogradient methods for learning generalized linear models.
result Non-asymptotic bounds on generalization error characterize model performance.
Study improves theoretical understanding of Bayesian deep learning for classification tasks.
problem Theoretical gap in understanding Bayesian approaches in deep learning for classification.
method PAC-Bayes bounds techniques and Spike-and-Slab priors for sparse deep learning.
result Established non-asymptotic results for prediction error, achieving minimax optimal rates.
Study shows code-level optimizations significantly impact deep RL algorithms.
problem Understanding the impact of implementation details on deep RL algorithms.
method Case study on PPO and TRPO, investigating the effects of code-level optimizations.
result Code-level optimizations are crucial for performance in deep RL algorithms.
Deep reinforcement learning finds optimal learning policies for adaptive systems.
problem Finding individualized learning plans for learners with unknown latent traits.
method Formulated as a Markov decision process, applied deep Q-learning with a transition model estimator.
result The algorithm efficiently discovers optimal learning policies with small data sets.
Optimizes deep learning training by treating it as an optimal control problem.
problem Fragility of deep neural networks to adversarial inputs.
method Formulates adversarial training as a min-max optimization problem and interprets it as an optimal control problem.
result Provides the first convergence analysis of adversarial training algorithm.
Because the choice and tuning of the optimizer affects the speed, and ultimately the performance of deep learning, there is significant past and recent research in this area. Yet, perhaps surprisingly, there is no generally agreed-upon protocol for the quantitative and reproducible evaluation of optimization strategies…
In this paper, we aim at providing an introduction to the gradient descent based optimization algorithms for learning deep neural network models. Deep learning models involving multiple nonlinear projection layers are very challenging to train. Nowadays, most of the deep learning model training still relies on the back…
Learning the optimized solution as a function of environmental parameters is effective in solving numerical optimization in real time for time-sensitive applications. Existing works of learning to optimize train deep neural networks (DNN) with labels, and the learnt solution are inaccurate, which cannot be employed to …
Deep RL optimizes goal-based investing strategies.
problem Optimizing investment strategies for achieving financial goals.
method Novel deep reinforcement learning approach for goal-based investing.
result Superior performance compared to benchmarks.