Improves deep learning robustness by considering task and model.
problem Adversarial attacks on deep learning systems.
method Binary and interval label encoding strategy to redefine classification tasks and design corresponding loss functions.
result Our method enhances robustness without sacrificing accuracy.
Quantile deep learning improves time series prediction accuracy and uncertainty quantification.
problem Uncertainty in multi-step time series prediction.
method Developed a novel quantile regression deep learning framework for multi-step time series prediction.
result Integrating quantile loss function with deep learning provides additional predictions for selected quantiles without loss in accuracy.
New deep learning model interprets tabular data with variable selection and explainability.
problem Deep learning models lack interpretability and variable selection.
method Proposes a new network architecture that combines deep learning with generalized linear models.
result The model provides superior predictive power and interpretable results.
Multimodal deep learning improves flaw detection in software programs.
problem Current flaw detection relies on single software representations.
method Adapted multimodal deep learning models for flaw detection.
result Multimodal models outperform traditional deep learning models.
Deep learning improves option pricing for a non-martingale asset model.
problem Computing call option prices for the Barndorff-Nielsen and Shephard model with infinite jumps.
method Developed a supervised deep-learning scheme using Monte Carlo teaching data and a Black-Scholes-derived variable.
result Significant improvement in accuracy of option pricing.
Proposes model-based robust deep learning to handle natural variation in data.
problem Deep learning's fragility to natural variation in data.
method Develops model-based robust training algorithms using deep generative models to learn natural variation.
result Deep neural networks trained with model-based algorithms outperform standard and norm-bounded robust algorithms.
Survey of deep learning methods for time series forecasting.
problem Improving accuracy in time series predictions across various domains.
method Analysis of common encoder and decoder designs, hybrid models, and decision support.
result Advancements in deep learning for time series forecasting.
Deep learning models improve financial price forecasting accuracy.
problem Accurately predicting financial time series prices.
method Review of recent advancements in deep learning models for price forecasting.
result Deep learning models outperform traditional methods in financial price forecasting.
Probabilistic deep learning uses neural networks and models to handle uncertainty.
problem Handling uncertainty in deep learning models.
method Two approaches: probabilistic neural networks and deep probabilistic models.
result TensorFlow Probability library supports both approaches.
Deep learning models outperform classical methods in text classification.
problem Improving text classification accuracy using deep learning.
method Comprehensive review of deep learning models and datasets for text classification.
result Deep learning models outperform classical methods on various text classification tasks.
The study compares econometric and deep learning models for forecasting COMEX copper futures volatility.
problem Forecasting volatility of COMEX copper futures across different time intervals.
method Econometric models (GARCH, HAR) and deep learning models (RNN, LSTM, GRU) applied to daily and hourly data.
result Deep learning models outperform econometric models in hourly data, but HAR remains the best overall for daily data.
The study improves deep learning models for safer autonomous vehicles.
problem Robustness of deep neural network models in autonomous driving.
method Analyzes and proposes solutions for deep learning model robustness.
result Enhanced deep learning models for safer autonomous vehicles.
Develops a KL-divergence-based deep learning method for survival analysis with short data.
problem Challenges of training deep learning models with limited survival data.
method Kullback-Leibler (KL) divergence to integrate external and internal data.
result Proposed model achieves better performance and higher robustness.
Deep learning methods improve subsurface flow modeling efficiency.
problem Efficiently modeling subsurface flow with uncertain parameters.
method Two categories of deep-learning based inverse modeling methods: surrogate-based and direct.
result Deep-learning methods significantly accelerate subsurface flow modeling.
Training deep learning models on mobile devices recently becomes possible, because of increasing computation power on mobile hardware and the advantages of enabling high user experiences. Most of the existing work on machine learning at mobile devices is focused on the inference of deep learning models (particularly co…
Bayesian methods enhance deep learning models by improving reliability and uncertainty.
problem Improving reliability and uncertainty awareness in deep learning models.
method Approximate Bayesian inference techniques, including SG-MCMC and VI, applied to deep learning models.
result Enhanced posterior inference for deep learning models, particularly in neural networks and generative models.
Review of priors in Bayesian deep learning models.
problem The importance of prior choices in Bayesian deep learning models.
method Overview of different priors and methods of learning priors from data.
result Motivate practitioners to think carefully about prior specification.
Paper tackles interpretability issues in deep learning models.
problem Lack of understanding of deep learning models' decision-making processes.
method Integrates concepts from machine learning, quantum computation, and quantum field theory.
result Demonstrates a many valued quantum logic system in Convolutional Deep Belief Networks.
NeurIPS 2020 competition seeks to predict deep learning generalization.
problem Understanding and predicting generalization in deep learning models.
method Propose complexity measures to accurately predict generalization performance.
result A robust complexity measure could improve deep learning reliability.
Study evaluates deep learning models for cryptocurrency price prediction.
problem Accurate cryptocurrency price forecasting models are needed due to market volatility.
method Reviewed and evaluated deep learning models including LSTM, CNN, and Transformer.
result Convolutional LSTM with multivariate approach provides best prediction accuracy.
Deep learning predicts currency volatility accurately.
problem Predicting future volatility in Forex trading.
method Constructed a deep-learning network using multiscale LSTM with multi-currency pairs.
result Multiscale LSTM model outperforms conventional models.
Simpler model outperforms deep learning for disease prediction.
problem Challenges of deep learning models in interpretability and feasibility.
method Developed a simpler tree-based model for EHR data.
result Improved performance over deep learning models while maintaining interpretability.
Develops deep learning model for detecting anomalies in transportation data.
problem Anomaly detection in temporal data of transportation networks.
method Proposes EVT-LSTM model combining LSTM and EVT, trained with an objective function.
result EVT-LSTM model outperforms other models in anomaly detection.
Explains deep learning models and their geometric properties.
problem Understanding the geometric intuition behind deep learning models.
method Geometrical intuition and novel insights into loss surfaces of deep learning models.
result Deep neural networks carve out manifolds with multiplication neurons.
This paper reviews methods for interpreting deep learning models with sequential data.
problem Limited interpretability of deep learning models in sequential data domains.
method Reviews and compares techniques for sequential interpretability.
result Current techniques have limitations and future research is needed.
A theoretical framework for deep learning is proposed to explain its effectiveness.
problem Lack of a comprehensive theory explaining deep learning's effectiveness.
method Integrates three characteristics into a graphical model called neurashed.
result Explains common empirical patterns in deep learning and provides insights into regularization and elasticity.
Paper explores physics-informed deep learning for system reliability assessment.
problem Limited study on deep learning for system reliability assessment.
method Physics-informed deep learning approach for system reliability assessment.
result Physics-informed deep learning can alleviate computational challenges and combine measurement data and mathematical models.
Survey of deep learning models for scientific discovery.
problem Identifying which scientific problems are most suitable for deep learning.
method Overview of deep learning models, tasks, training methods, and techniques.
result Helps accelerate deep learning use in scientific domains.
Adapts linearised Laplace method for deep learning models.
problem Incompatibility of linearised Laplace method with modern deep learning tools.
method Examines and adapts linearised Laplace method for model selection in deep learning.
result Recommendations for better adapting linearised Laplace method to modern deep learning.
Deep learning models viewed through tame geometry for convergence guarantees.
problem Understanding convergence guarantees in deep learning models.
method Introducing tame geometry concepts and tools for nonsmooth nonconvex settings.
result Illustrates tame geometry as a natural framework for AI systems, especially deep learning.
Survey of deep learning methods for forex and stock price prediction.
problem Improving accuracy and return in financial prediction.
method Classification of papers based on different deep learning methods.
result Recent models combining LSTM with other methods yield great returns and performances.
Paper improves deep learning models for limit order book data.
problem Deep learning models' performance depends on robust input data representation.
method Identified and modified flaws in existing representations.
result Proposed modifications lead to state-of-the-art performance.
New deep learning model uses self-attention to consider entire dataset for predictions.
problem Traditional deep learning models focus on single input datapoints; this model considers the whole dataset.
method Introduces self-attention mechanism to reason about relationships between datapoints.
result Models solve cross-datapoint lookup and complex reasoning tasks.
Deep learning predicts ICU mortality with enhanced interpretability.
problem Improving mortality prediction accuracy and clinician trust in AI.
method Trained a deep learning model on MIMIC-III to interpret nursing notes.
result Model reaches ROC of 0.8629, outperforming SAPS-II.
Deep learning predicts NFT prices with high accuracy.
problem Dynamic valuation of non-fungible tokens (NFTs).
method Trained deep learning model on Ethereum blockchain data.
result Highly accurate price predictions of NFTs.
Deep learning models have exhibited superior performance in predictive tasks with the explosively increasing Electronic Health Records (EHR). However, due to the lack of transparency, behaviors of deep learning models are difficult to interpret. Without trustworthiness, deep learning models will not be able to assist i…
Deep learning is increasingly being used in high-stake decision making applications that affect individual lives. However, deep learning models might exhibit algorithmic discrimination behaviors with respect to protected groups, potentially posing negative impacts on individuals and society. Therefore, fairness in deep…
A new measure predicts deep learning model performance.
problem Predicting the generalization error of deep learning models.
method 2sED measure based on effective dimension, layerwise iterative approximation.
result 2sED correlates well with training error and generalization error.
Deep learning framework predicts streamflow and flood probabilities in Australian catchments.
problem Large-scale flooding prediction challenges due to model calibration and missing data.
method Ensemble quantile-based deep learning framework using quantile regression and CAMELS dataset.
result Notable efficacy and uncertainties in streamflow forecasts with varied catchment properties.
Deep learning has arguably achieved tremendous success in recent years. In simple words, deep learning uses the composition of many nonlinear functions to model the complex dependency between input features and labels. While neural networks have a long history, recent advances have greatly improved their performance in…
In recent years, China, the United States and other countries, Google and other high-tech companies have increased investment in artificial intelligence. Deep learning is one of the current artificial intelligence research's key areas. This paper analyzes and summarizes the latest progress and future research direction…
Deep learning models perform variably across continents/seasons in land cover mapping.
problem Variability in deep learning model performance across different continents/seasons.
method Clustering techniques on satellite imagery from different continents.
result Model performance varies significantly between different continents/seasons.
Deep learning improves asset pricing and risk premium measurement.
problem Improving asset pricing and risk premium measurement using deep learning.
method Investigates various deep learning methods for asset pricing, especially for risk premia measurement.
result RNNs with memory mechanism and attention have the best performance in terms of predictivity.
Deep learning models, especially CNNs, can predict radio frequency power faster than traditional methods.
problem Accurate radio frequency power prediction for optimal transmitter location.
method Empirical analysis of deep learning models including CNNs and UNET variations for power prediction.
result Deep learning models, particularly CNNs, are effective and generalize well to new regions for power prediction.
While perception tasks such as visual object recognition and text understanding play an important role in human intelligence, the subsequent tasks that involve inference, reasoning and planning require an even higher level of intelligence. The past few years have seen major advances in many perception tasks using deep …
Deep learning improves macroeconomic forecasting and risk assessment.
problem Improving accuracy in macroeconomic forecasting and sovereign risk assessment.
method Nowcasting and forecasting using deep learning techniques.
result Deep learning methods outperform traditional econometric techniques in out-of-sample performance.
This paper identifies duplicate questions on Quora using machine and deep learning models.
problem Detecting semantically identical questions on Quora to improve user experience.
method Applied machine learning and deep learning techniques on Quora's dataset.
result Xgboost model with character level term frequency and inverse term frequency achieved 85.82% accuracy.
User smeznar achieved 8th place in PGDL by predicting generalization of deep learning models.
problem Understanding and predicting generalization in deep learning models.
method Creating simple metrics and finding their best combination for automatic testing on a dataset.
result Combination of various properties of neural network architectures can be used for generalization prediction.