Bayesian Deep Learning tackles inverse problems with neural networks and approximate computations.
problem Solving inverse problems with indirect measurements and uncertainties.
method Bayesian Deep Learning, using neural networks and approximate computations.
result Effective solutions for inverse problems using Bayesian Deep Learning.
Bayesian-Deep Learning model predicts Covid-19 evolution in Spain.
problem Estimating the future evolution of Covid-19 in Spain.
method Combines DL techniques with Bayesian Poisson-Gamma model for counts.
result Allows prediction of future evolution and estimation of scenarios.
This work analyzes aggregation strategies for Bayesian deep learning models in federated learning.
problem Improper aggregation of Bayesian deep learning models in federated learning leads to sub-optimal performance.
method Six aggregation strategies for Bayesian deep learning models are analyzed using CIFAR-10 dataset and a fully variational ResNet-20 architecture.
result Aggregation strategy is a key hyperparameter affecting accuracy, calibration, uncertainty quantification, training stability, and client compute requirements.
Bayesian DL model improves DCMs for better predictive and inferential performance.
problem Limited interpretability and predictive underperformance of traditional DCMs.
method Integrates deep learning with approximate Bayesian inference (SGLD).
result Improves predictive and inferential metrics in discrete choice models.
In the last decade, deep learning (DL) has outperformed model-based and statistical approaches in predicting the remaining useful life (RUL) of machinery in the context of condition-based maintenance. One of the major drawbacks of DL is that it heavily depends on a large amount of labeled data, which are typically expe…
Deep Learning (DL) methods have been transforming computer vision with innovative adaptations to other domains including climate change. For DL to pervade Science and Engineering (S&E) applications where risk management is a core component, well-characterized uncertainty estimates must accompany predictions. However, S…
Spike-and-Slab Deep Learning (SS-DL) is a fully Bayesian alternative to Dropout for improving generalizability of deep ReLU networks. This new type of regularization enables provable recovery of smooth input-output maps with unknown levels of smoothness. Indeed, we show that the posterior distribution concentrates at t…
Locally Valid and Discriminative prediction intervals for deep learning models.
problem Efficient and theoretically sound uncertainty quantification for deep learning models.
method Locally Valid and Discriminative prediction intervals (LVD) using kernel regression.
result Locally Valid and Discriminative prediction intervals (LVD) offer better performance and scalability compared to existing methods.
Deep Learning (DL) methods have emerged as one of the most powerful tools for functional approximation and prediction. While the representation properties of DL have been well studied, uncertainty quantification remains challenging and largely unexplored. Data augmentation techniques are a natural approach to provide u…
Comparison of AutoML and DL shows AutoML outperforms simple DL for binary classification.
problem Choosing between AutoML and DL for binary classification tasks.
method Comparison of AutoML and DL on 6 public datasets, evaluation of a new AutoML tool.
result AutoML outperforms simple DL classifiers but integrating DL into AutoML improves performance further.
Study evaluates quality of uncertainty estimates for neural networks.
problem Lack of principled assessment methods for evaluating uncertainty quality in deep learning.
method Statistical methods of frequentist interval coverage, interval width, and expected calibration error.
result Different UQ methods produce markedly different quality uncertainty estimates.
Teaches deep learning to statisticians.
problem Statisticians lack expertise in deep learning.
method Developed a program and taught DL to statistics graduate students.
result Provided tips and resources for teaching DL.
This paper clarifies deep learning for IS scholars.
problem Limited IS contributions in deep learning.
method Systematic review and framework development.
result Clear guidelines for IS scholars to make DL contributions.
Deep learning improves automated detection of epileptic seizures.
problem Automated detection of epileptic seizures using traditional methods is limited.
method Deep learning techniques for feature extraction and classification.
result Deep learning enhances accuracy in diagnosing epileptic seizures.
Proposes a novel deep DL approach for inference tasks.
problem Improvements needed in Deep DL methods for inference tasks and denoising.
method Combines DL layers with RNNs to learn a deep transform and metric.
result Outperforms existing DDL and state-of-the-art CNNs in inference applications.
Deep learning enhances smart fish farming through automated feature extraction.
problem Challenges in obtaining labeled data limit DL applications in aquaculture.
method Application of DL techniques in aquaculture, including live fish identification, species classification, and feeding decision-making.
result Deep learning's ability to automatically extract features is a significant contribution.
Benchmark for DL inference on embedded HWAs, focusing on autonomous driving.
problem Lack of comprehensive benchmarks for DL hardware.
method Developed a benchmark for inference on embedded HWAs, focusing on autonomous driving. Proposed new granularity, benchmark procedures, and performance indicators.
result Identifies mismatches between HWAs and DL models.
Develops deep probabilistic graphical modeling for better flexibility and interpretability.
problem Lack of flexibility in probabilistic graphical models and interpretability in deep learning.
method Combines deep learning and probabilistic graphical modeling to create flexible models with interpretable latent structures.
result Solves problems in probabilistic topic models and introduces new learning algorithms.
This paper introduces a new metric for deep learning networks based on their classification performance.
problem The mystery and black-box nature of deep learning networks.
method Proposes a new distance measure based on the probabilistic performance of deep learning networks.
result The proposed metric space is compact and coincides with the quotient topological space.
Paper improves candlestick classification model's resistance to adversarial attacks.
problem Adversarial attacks on deep learning models for candlestick classification.
method Constructs perturbed examples to enhance model robustness.
result Boosted stability of DL models for candlestick classification.
QBC uses quantum computers to speed up Bayesian computation.
problem Exponential speed-up in Bayesian computation.
method Quantum von Neumann measurement for simulating ML algorithms.
result Quantum versions of regression, Gaussian processes, and SGD.
A review of ML and DL for ecological data analysis.
problem Understanding the strengths and limitations of ML and DL in ecological research.
method Historical overview, algorithm families, differences, universal principles, and emerging trends.
result ML and DL excel in prediction tasks but are still debated for causal inference.
Improved DL models robust against adversarial attacks for wireless signal classification.
problem Adversarial attacks on deep learning-based wireless signal classifiers.
method Knowledge distillation and network pruning followed by adversarial training.
result Proposed models achieve better robustness and higher accuracy than standard models.
Survey of integrating domain knowledge into DL models.
problem Improving DL model performance with limited data or complex functions.
method Five categories of approaches to inject domain knowledge into DL models.
result Survey identifies five main categories of approaches.
More and more companies have deployed machine learning (ML) clusters, where deep learning (DL) models are trained for providing various AI-driven services. Efficient resource scheduling is essential for maximal utilization of expensive DL clusters. Existing cluster schedulers either are agnostic to ML workload characte…
Understanding the global optimality in deep learning (DL) has been attracting more and more attention recently. Conventional DL solvers, however, have not been developed intentionally to seek for such global optimality. In this paper we propose a novel approximation algorithm, BPGrad, towards optimizing deep models glo…
Deep learning aids in autism diagnosis and rehabilitation using neuroimaging data.
problem Challenges in automated detection and rehabilitation of ASD using neuroimaging data.
method Deep learning techniques applied to neuroimaging data for ASD diagnosis and rehabilitation.
result Deep learning improves accuracy in ASD diagnosis and rehabilitation.
A recent trend observed in traditionally challenging fields such as computer vision and natural language processing has been the significant performance gains shown by deep learning (DL). In many different research fields, DL models have been evolving rapidly and become ubiquitous. Despite researchers' excitement, unfo…
DeepPurpose simplifies DL for DTI prediction.
problem Accurate prediction of drug-target interactions.
method Comprehensive deep learning library with 15 compound and protein encoders and 50 neural architectures.
result State-of-the-art performance on benchmark datasets.
Deep active learning aims to reduce annotation costs while leveraging DL's powerful learning.
problem Traditional AL struggles with few labeled samples, while DL requires large datasets.
method Formal classification and systematic overview of existing DAL work.
result DAL can reduce annotation costs while maintaining DL's learning capabilities.
Deep learning applied to biological data mining.
problem Mining complex biological data from diverse sources.
method Artificial neural networks, deep learning architectures.
result Deep learning techniques improve pattern recognition in biological data.
Deep learning (DL) defines a new data-driven programming paradigm that constructs the internal system logic of a crafted neuron network through a set of training data. We have seen wide adoption of DL in many safety-critical scenarios. However, a plethora of studies have shown that the state-of-the-art DL systems suffe…
Survey examines anomaly detection methods for deep learning.
problem Out-of-distribution and adversarial examples in deep learning.
method Taxonomy of existing anomaly detection techniques.
result Discussion of strengths and weaknesses of techniques.
Deep learning (DL), a new-generation of artificial neural network research, has transformed industries, daily lives and various scientific disciplines in recent years. DL represents significant progress in the ability of neural networks to automatically engineer problem-relevant features and capture highly complex data…
Virtual reality (VR) offers immersive visualization and intuitive interaction. We leverage VR to enable any biomedical professional to deploy a deep learning (DL) model for image classification. While DL models can be powerful tools for data analysis, they are also challenging to understand and develop. To make deep le…
A new method approximates deep neural networks using Kalman Filters.
problem Approximating deep neural networks with limited data.
method Matrix Ensemble Kalman Filter-based multi-arm ANN (MEnKF-ANN).
result MEnKF-ANN can adequately approximate LSTM networks and provide uncertainty estimates.
Zero loss is achievable in overparametrized DL networks under specific conditions.
problem Achieving zero loss in overparametrized deep learning networks.
method Determine sufficient conditions for zero loss attainability and present an explicit construction of zero loss minimizers.
result Explicit minimizers for zero loss in overparametrized DL networks are constructed without gradient descent.
Computational intelligence in finance has been a very popular topic for both academia and financial industry in the last few decades. Numerous studies have been published resulting in various models. Meanwhile, within the Machine Learning (ML) field, Deep Learning (DL) started getting a lot of attention recently, mostl…
Deep learning (DL) is a high dimensional data reduction technique for constructing high-dimensional predictors in input-output models. DL is a form of machine learning that uses hierarchical layers of latent features. In this article, we review the state-of-the-art of deep learning from a modeling and algorithmic persp…
The past few years have seen a surge of applying Deep Learning (DL) models for a wide array of tasks such as image classification, object detection, machine translation, etc. While DL models provide an opportunity to solve otherwise intractable tasks, their adoption relies on them being optimized to meet latency and re…
Defense against DL-based lithographic hotspot detectors backdooring attacks reduces success rate from 84% to ~0%
problem DL-based lithographic hotspot detectors are vulnerable to backdoor attacks that can misclassify hotspots.
method Training data augmentation to eliminate intentional biases introduced during training.
result Significant reduction in attack success rate (from 84% to ~0%) using the proposed defense.
DL models for MTS regression are vulnerable to adversarial attacks, posing risks in safety-critical applications.
problem Vulnerability of DL models to adversarial examples in MTS regression.
method Adversarial attack generation techniques from image classification were adapted for MTS.
result All state-of-the-art DL regression models (CNN, LSTM, GRU) are vulnerable to adversarial attacks.
We explore how Deep Learning (DL) can be utilized to predict prognosis of acute myeloid leukemia (AML). Out of TCGA (The Cancer Genome Atlas) database, 94 AML cases are used in this study. Input data include age, 10 common cytogenetic and 23 most common mutation results; output is the prognosis (diagnosis to death, DTD…
In this survey paper, we systematically summarize existing literature on bearing fault diagnostics with machine learning (ML) and data mining techniques. While conventional ML methods, including artificial neural network (ANN), principal component analysis (PCA), support vector machines (SVM), etc., have been successfu…
This paper presents a review of deep learning (DL) based medical image registration methods. We summarized the latest developments and applications of DL-based registration methods in the medical field. These methods were classified into seven categories according to their methods, functions and popularity. A detailed …
Deep learning models struggle with new data in stock price trend prediction.
problem Stock price trend prediction using Deep Learning models.
method Examination of fifteen state-of-the-art DL models on LOB data, using LOBCAST framework.
result All models show significant performance drop with new data, questioning their market applicability.
Machine learning and deep learning infer surface/groundwater exchange from temperature data.
problem Inferring surface/groundwater exchange from temperature data with high temporal resolution.
method Application of machine learning and deep learning algorithms to infer surface/groundwater exchange flux from subsurface temperature observations.
result DL methods outperform ML methods in interpreting noisy temperature data, especially with a smoothing filter.
Survey on uncertainty in ML and DL, covering sources, quantification, and decision-making.
problem Understanding and quantifying uncertainty in ML and DL for risk-sensitive applications.
method Structured review of literature, categorizing uncertainty, assessing uncertainty quantification techniques.
result Broadened scope of uncertainty discussion and updated DL uncertainty quantification methods.