Probabilistic deep learning uses neural networks and models to handle uncertainty.
problem Handling uncertainty in deep learning models.
method Two approaches: probabilistic neural networks and deep probabilistic models.
result TensorFlow Probability library supports both approaches.
Improves deep learning robustness by considering task and model.
problem Adversarial attacks on deep learning systems.
method Binary and interval label encoding strategy to redefine classification tasks and design corresponding loss functions.
result Our method enhances robustness without sacrificing accuracy.
Proposes model-based robust deep learning to handle natural variation in data.
problem Deep learning's fragility to natural variation in data.
method Develops model-based robust training algorithms using deep generative models to learn natural variation.
result Deep neural networks trained with model-based algorithms outperform standard and norm-bounded robust algorithms.
Bayesian methods enhance deep learning models by improving reliability and uncertainty.
problem Improving reliability and uncertainty awareness in deep learning models.
method Approximate Bayesian inference techniques, including SG-MCMC and VI, applied to deep learning models.
result Enhanced posterior inference for deep learning models, particularly in neural networks and generative models.
Deep learning is very effective at jointly learning feature representations and classification models, especially when dealing with high dimensional input patterns. Probabilistic logic reasoning, on the other hand, is capable to take consistent and robust decisions in complex environments. The integration of deep learn…
Paper tackles interpretability issues in deep learning models.
problem Lack of understanding of deep learning models' decision-making processes.
method Integrates concepts from machine learning, quantum computation, and quantum field theory.
result Demonstrates a many valued quantum logic system in Convolutional Deep Belief Networks.
The study improves deep learning models for safer autonomous vehicles.
problem Robustness of deep neural network models in autonomous driving.
method Analyzes and proposes solutions for deep learning model robustness.
result Enhanced deep learning models for safer autonomous vehicles.
Deep SSMs use neural networks to identify complex systems.
problem Identifying nonlinear systems with high uncertainty.
method Deep state space models with neural networks.
result Deep SSMs outperform traditional methods on benchmarks.
New deep learning model interprets tabular data with variable selection and explainability.
problem Deep learning models lack interpretability and variable selection.
method Proposes a new network architecture that combines deep learning with generalized linear models.
result The model provides superior predictive power and interpretable results.
Deep RL solves complex macroeconomic models.
problem Solving dynamic stochastic general equilibrium models with bounded rationality.
method Using deep reinforcement learning to model agents as neural networks.
result Artificially intelligent agents can solve models in all policy regimes.
Multimodal deep learning improves flaw detection in software programs.
problem Current flaw detection relies on single software representations.
method Adapted multimodal deep learning models for flaw detection.
result Multimodal models outperform traditional deep learning models.
Quantile deep learning improves time series prediction accuracy and uncertainty quantification.
problem Uncertainty in multi-step time series prediction.
method Developed a novel quantile regression deep learning framework for multi-step time series prediction.
result Integrating quantile loss function with deep learning provides additional predictions for selected quantiles without loss in accuracy.
Deep learning models improve financial price forecasting accuracy.
problem Accurately predicting financial time series prices.
method Review of recent advancements in deep learning models for price forecasting.
result Deep learning models outperform traditional methods in financial price forecasting.
Adversarial deep hedging learns to hedge without specifying asset price models.
problem Lack of effective underlying asset models for deep hedging.
method Adversarial learning framework where a hedger and a generator compete to improve hedging performance.
result Adversarial deep hedging achieves competitive performance without explicit asset process modeling.
Characterizes deep neural network weight space for adversarial attacks.
problem Poor performance of deep learning models in adversarial examples.
method Characterizes deep neural network solution space using two paradigms.
result Adversarial attacks are less successful against Associative Memory Models.
Existing deep learning models may encounter great challenges in handling graph structured data. In this paper, we introduce a new deep learning model for graph data specifically, namely the deep loopy neural network. Significantly different from the previous deep models, inside the deep loopy neural network, there exis…
Deep learning improves option pricing for a non-martingale asset model.
problem Computing call option prices for the Barndorff-Nielsen and Shephard model with infinite jumps.
method Developed a supervised deep-learning scheme using Monte Carlo teaching data and a Black-Scholes-derived variable.
result Significant improvement in accuracy of option pricing.
Review of priors in Bayesian deep learning models.
problem The importance of prior choices in Bayesian deep learning models.
method Overview of different priors and methods of learning priors from data.
result Motivate practitioners to think carefully about prior specification.
Proposes a deep latent factor model for better recommendation systems.
problem Improving collaborative filtering in recommendation systems.
method Introduces a deeper latent factor model using deep learning.
result Significantly outperforms state-of-the-art techniques in experiments.
Study compares random and learned features in deep Bayesian linear models.
problem Understanding how feature learning affects generalization in deep learning.
method Comparing deep random feature models to deep networks with trained layers.
result Random feature models can display double-descent behavior, while deep networks do not.
Deep learning models outperform classical methods in text classification.
problem Improving text classification accuracy using deep learning.
method Comprehensive review of deep learning models and datasets for text classification.
result Deep learning models outperform classical methods on various text classification tasks.
Survey of deep learning methods for time series forecasting.
problem Improving accuracy in time series predictions across various domains.
method Analysis of common encoder and decoder designs, hybrid models, and decision support.
result Advancements in deep learning for time series forecasting.
Model-based machine learning improves communication systems.
problem Improving symbol detection in communication receivers.
method Review and comparison of model-based and deep learning approaches, focusing on deep unfolding and DNN-aided hybrid algorithms.
result Different strategies of conventional deep architectures and hybrid algorithms show advantages and drawbacks.
Gradient amplification boosts deep learning model performance without increasing training time.
problem Vanishing gradients in deep neural networks.
method Gradient amplification approach to prevent vanishing gradients and training strategy to enable/disable across epochs.
result Improves performance of deep learning models with reduced training time.
The study compares econometric and deep learning models for forecasting COMEX copper futures volatility.
problem Forecasting volatility of COMEX copper futures across different time intervals.
method Econometric models (GARCH, HAR) and deep learning models (RNN, LSTM, GRU) applied to daily and hourly data.
result Deep learning models outperform econometric models in hourly data, but HAR remains the best overall for daily data.
In this paper we introduce ZhuSuan, a python probabilistic programming library for Bayesian deep learning, which conjoins the complimentary advantages of Bayesian methods and deep learning. ZhuSuan is built upon Tensorflow. Unlike existing deep learning libraries, which are mainly designed for deterministic neural netw…
Deep active inference learns policies from sensory inputs.
problem Learning policies in partially observable domains.
method Optimizes expected free energy with a variational autoencoder.
result Comparable or better performance than deep Q-learning.
Proves deep networks can learn hierarchical structures efficiently.
problem Understanding how deep networks learn hierarchical structures in data.
method Random Hierarchy Models, gradient-based methods, layerwise training.
result Proves deep networks can efficiently learn hierarchical structures.
Deep-RLS uses deep learning to improve PCA for better source separation.
problem Improving PCA for better source separation in nonlinear systems.
method Inspired by RLS, Deep-RLS unfolds RLS iterations into a deep neural network.
result Deep-RLS significantly improves accuracy in recovering source signals.
NeurIPS 2020 competition seeks to predict deep learning generalization.
problem Understanding and predicting generalization in deep learning models.
method Propose complexity measures to accurately predict generalization performance.
result A robust complexity measure could improve deep learning reliability.
Deep RL applied for Indian stock trading strategies.
problem Designing profitable trading strategies for Indian stock markets.
method Applied deep reinforcement learning to ten Indian stock datasets.
result Models' performance compared and evaluated.
Training deep learning models on mobile devices recently becomes possible, because of increasing computation power on mobile hardware and the advantages of enabling high user experiences. Most of the existing work on machine learning at mobile devices is focused on the inference of deep learning models (particularly co…
Although deep learning has shown great success in recent years, researchers have discovered a critical flaw where small, imperceptible changes in the input to the system can drastically change the output classification. These attacks are exploitable in nearly all of the existing deep learning classification frameworks.…
Develops a KL-divergence-based deep learning method for survival analysis with short data.
problem Challenges of training deep learning models with limited survival data.
method Kullback-Leibler (KL) divergence to integrate external and internal data.
result Proposed model achieves better performance and higher robustness.
This paper identifies duplicate questions on Quora using machine and deep learning models.
problem Detecting semantically identical questions on Quora to improve user experience.
method Applied machine learning and deep learning techniques on Quora's dataset.
result Xgboost model with character level term frequency and inverse term frequency achieved 85.82% accuracy.
Survey of deep learning methods for forex and stock price prediction.
problem Improving accuracy and return in financial prediction.
method Classification of papers based on different deep learning methods.
result Recent models combining LSTM with other methods yield great returns and performances.
Deep learning methods improve subsurface flow modeling efficiency.
problem Efficiently modeling subsurface flow with uncertain parameters.
method Two categories of deep-learning based inverse modeling methods: surrogate-based and direct.
result Deep-learning methods significantly accelerate subsurface flow modeling.
Survey of deep learning models for scientific discovery.
problem Identifying which scientific problems are most suitable for deep learning.
method Overview of deep learning models, tasks, training methods, and techniques.
result Helps accelerate deep learning use in scientific domains.
Explains deep learning models and their geometric properties.
problem Understanding the geometric intuition behind deep learning models.
method Geometrical intuition and novel insights into loss surfaces of deep learning models.
result Deep neural networks carve out manifolds with multiplication neurons.
Recently, deep models have had considerable success in several tasks, especially with low-level representations. However, effective learning from sparse noisy samples is a major challenge in most deep models, especially in domains with structured representations. Inspired by the proven success of human guided machine l…
Flexible framework for deep distributional regression models.
problem Learning conditional distributions from semi-structured data.
method Combines additive regression models with deep networks using TensorFlow.
result State-of-the-art predictive performance with interpretability.
Bayesian sparsification reduces deep neural network complexity.
problem Complexity of deep neural networks limits their performance.
method Combines Bayesian shrinkage priors with stochastic variational inference.
result Bayesian model reduction (BMR) is a more efficient alternative for pruning model weights.
Develops deep learning model for detecting anomalies in transportation data.
problem Anomaly detection in temporal data of transportation networks.
method Proposes EVT-LSTM model combining LSTM and EVT, trained with an objective function.
result EVT-LSTM model outperforms other models in anomaly detection.
Study evaluates deep learning models for cryptocurrency price prediction.
problem Accurate cryptocurrency price forecasting models are needed due to market volatility.
method Reviewed and evaluated deep learning models including LSTM, CNN, and Transformer.
result Convolutional LSTM with multivariate approach provides best prediction accuracy.
Yes, they do. This paper provides the first empirical demonstration that deep convolutional models really need to be both deep and convolutional, even when trained with methods such as distillation that allow small or shallow models of high accuracy to be trained. Although previous research showed that shallow feed-for…
We propose to represent a return model and risk model in a unified manner with deep learning, which is a representative model that can express a nonlinear relationship. Although deep learning performs quite well, it has significant disadvantages such as a lack of transparency and limitations to the interpretability of …
This paper reviews methods for interpreting deep learning models with sequential data.
problem Limited interpretability of deep learning models in sequential data domains.
method Reviews and compares techniques for sequential interpretability.
result Current techniques have limitations and future research is needed.
Deep learning models optimize protein sequences.
problem Optimizing protein properties through sequence design.
method Deep generative models guided by machine learning.
result Improved protein sequence generation from prior knowledge.