Develops deep probabilistic graphical modeling for better flexibility and interpretability.
problem Lack of flexibility in probabilistic graphical models and interpretability in deep learning.
method Combines deep learning and probabilistic graphical modeling to create flexible models with interpretable latent structures.
result Solves problems in probabilistic topic models and introduces new learning algorithms.
VTA offers flexible DL specialization for evolving workloads.
problem Inflexible specialized DL hardware accelerators.
method Parametrizable architecture, two-level ISA, JIT compiler.
result Flexible deep learning specialization on edge-class FPGAs.
A review of ML and DL for ecological data analysis.
problem Understanding the strengths and limitations of ML and DL in ecological research.
method Historical overview, algorithm families, differences, universal principles, and emerging trends.
result ML and DL excel in prediction tasks but are still debated for causal inference.
Proposes a novel deep DL approach for inference tasks.
problem Improvements needed in Deep DL methods for inference tasks and denoising.
method Combines DL layers with RNNs to learn a deep transform and metric.
result Outperforms existing DDL and state-of-the-art CNNs in inference applications.
Deep neural networks for ordinal outcomes combining image and tabular data.
problem Lack of interpretable models for ordinal outcomes in mixed data types.
method Ordinal Neural Network Transformation Models (ONTRAMs) integrating DL and classical ordinal regression.
result ONTRAMs achieve performance equivalent to standard multi-class DL models but are faster and more interpretable.
Paper develops DL methods for signal demodulation in wireless comms.
problem Signal demodulation in wireless communications.
method Proposes DBN-SVM and AdaBoost demodulators using real modulated signals.
result Proposed DBN-SVM and AdaBoost demodulators outperform traditional methods.
New DL model handles missing data in biomedical datasets.
problem Handling missing data in modern biomedical datasets.
method Proposed a new DL architecture, dlglm, for generalized linear models.
result Outperforms existing methods in MNAR missingness scenarios.
Locally Valid and Discriminative prediction intervals for deep learning models.
problem Efficient and theoretically sound uncertainty quantification for deep learning models.
method Locally Valid and Discriminative prediction intervals (LVD) using kernel regression.
result Locally Valid and Discriminative prediction intervals (LVD) offer better performance and scalability compared to existing methods.
Bayesian DL model improves DCMs for better predictive and inferential performance.
problem Limited interpretability and predictive underperformance of traditional DCMs.
method Integrates deep learning with approximate Bayesian inference (SGLD).
result Improves predictive and inferential metrics in discrete choice models.
MAX simplifies access to DL models for non-experts.
problem Difficulty for non-experts in adopting latest DL models.
method Proposes MAX, a Python library that wraps DL models and provides RESTful APIs.
result Maximizes ease of using state-of-the-art DL models for inference.
DL/FBF improves GPSR solutions by selecting compact, generalising expressions.
problem Overfitting and structural bloat in symbolic regression with genetic programming.
method Description length (DL) and fractional Bayes factor (FBF) criteria for selecting compact, generalising expressions.
result DL/FBF post-selection improves test performance compared to AIC/BIC baseline.
DLBricks automates DL benchmarking on CPUs, reducing effort and time.
problem Lack of representative and up-to-date DL benchmarks on CPUs.
method Decomposes DL models into runnable networks, leveraging layer repetition and auto-generation.
result Accurately estimates DL model performance and speeds up benchmarking time.
Deep learning (DL) defines a new data-driven programming paradigm that constructs the internal system logic of a crafted neuron network through a set of training data. We have seen wide adoption of DL in many safety-critical scenarios. However, a plethora of studies have shown that the state-of-the-art DL systems suffe…
Comparison of AutoML and DL shows AutoML outperforms simple DL for binary classification.
problem Choosing between AutoML and DL for binary classification tasks.
method Comparison of AutoML and DL on 6 public datasets, evaluation of a new AutoML tool.
result AutoML outperforms simple DL classifiers but integrating DL into AutoML improves performance further.
The paper proposes a tool to detect invalid inputs in DL models.
problem Vulnerability of DL models to invalid inputs during runtime.
method Design and implementation of a tool that extracts data flow footprints and conducts assertion-based validation.
result The assertion-based data sanity check mechanism effectively identifies invalid input cases.
Deep learning improves automated detection of epileptic seizures.
problem Automated detection of epileptic seizures using traditional methods is limited.
method Deep learning techniques for feature extraction and classification.
result Deep learning enhances accuracy in diagnosing epileptic seizures.
A scalable DL benchmarking platform for evaluating and comparing models, frameworks, and hardware.
problem Lack of a uniform DL benchmarking platform for evaluating and comparing innovations.
method Identified 10 design features for a DL benchmarking platform, proposed MLModelScope, and implemented as an open-source project.
result Demonstrated how model, hardware, and framework selection affect accuracy and performance under different scenarios.
The paper tackles hardware efficiency in DL models, predicting and optimizing for latency and energy cost.
problem Predicting and optimizing hardware efficiency for DL models during inference.
method Develops predictive models and hardware-aware optimization techniques.
result Predictive models and optimization techniques can significantly improve hardware efficiency in DL applications.
Deep learning enhances smart fish farming through automated feature extraction.
problem Challenges in obtaining labeled data limit DL applications in aquaculture.
method Application of DL techniques in aquaculture, including live fish identification, species classification, and feeding decision-making.
result Deep learning's ability to automatically extract features is a significant contribution.
This paper clarifies deep learning for IS scholars.
problem Limited IS contributions in deep learning.
method Systematic review and framework development.
result Clear guidelines for IS scholars to make DL contributions.
Bayesian Deep Learning tackles inverse problems with neural networks and approximate computations.
problem Solving inverse problems with indirect measurements and uncertainties.
method Bayesian Deep Learning, using neural networks and approximate computations.
result Effective solutions for inverse problems using Bayesian Deep Learning.
Deep learning (DL), a new-generation of artificial neural network research, has transformed industries, daily lives and various scientific disciplines in recent years. DL represents significant progress in the ability of neural networks to automatically engineer problem-relevant features and capture highly complex data…
Benchmark for DL inference on embedded HWAs, focusing on autonomous driving.
problem Lack of comprehensive benchmarks for DL hardware.
method Developed a benchmark for inference on embedded HWAs, focusing on autonomous driving. Proposed new granularity, benchmark procedures, and performance indicators.
result Identifies mismatches between HWAs and DL models.
DL2 uses deep learning to optimize resource allocation in DL clusters.
problem Efficient resource scheduling for deep learning clusters is challenging.
method DL2 combines supervised learning and reinforcement learning to dynamically allocate resources.
result DL2 reduces average training completion time by 44.1% compared to fairness scheduler.
Diestel-Leader graphs are neither hyperbolic nor CAT(0), so their visual boundaries may be pathological. Indeed, we show that for d>2, ∂DLd(q) carries the indiscrete topology. On the other hand, ∂DL2(q), while not Hausdorff, is T1, totally disconnected, and compact. Since $\text{D…
Improved DL models robust against adversarial attacks for wireless signal classification.
problem Adversarial attacks on deep learning-based wireless signal classifiers.
method Knowledge distillation and network pruning followed by adversarial training.
result Proposed models achieve better robustness and higher accuracy than standard models.
Defense against DL-based lithographic hotspot detectors backdooring attacks reduces success rate from 84% to ~0%
problem DL-based lithographic hotspot detectors are vulnerable to backdoor attacks that can misclassify hotspots.
method Training data augmentation to eliminate intentional biases introduced during training.
result Significant reduction in attack success rate (from 84% to ~0%) using the proposed defense.
This paper introduces a new metric for deep learning networks based on their classification performance.
problem The mystery and black-box nature of deep learning networks.
method Proposes a new distance measure based on the probabilistic performance of deep learning networks.
result The proposed metric space is compact and coincides with the quotient topological space.
Solves challenges in replicating ML/DL model evaluations.
problem Challenges in evaluating and studying ML/DL innovations.
method Proposes MLModelScope for repeatable model evaluation.
result Facilitates rapid adoption of ML/DL innovations.
Understanding the global optimality in deep learning (DL) has been attracting more and more attention recently. Conventional DL solvers, however, have not been developed intentionally to seek for such global optimality. In this paper we propose a novel approximation algorithm, BPGrad, towards optimizing deep models glo…
A DL autoencoder tackles interference channels, improving SNR and INR.
problem Improving performance in interference channels with varying interference levels.
method Designing a DL neural network autoencoder for a k-user Gaussian interference channel, classifying interferences as weak to very strong.
result DL autoencoder significantly mitigates interference effects, especially with known α and low offset.
Teaches deep learning to statisticians.
problem Statisticians lack expertise in deep learning.
method Developed a program and taught DL to statistics graduate students.
result Provided tips and resources for teaching DL.
Paper improves candlestick classification model's resistance to adversarial attacks.
problem Adversarial attacks on deep learning models for candlestick classification.
method Constructs perturbed examples to enhance model robustness.
result Boosted stability of DL models for candlestick classification.
A new method approximates deep neural networks using Kalman Filters.
problem Approximating deep neural networks with limited data.
method Matrix Ensemble Kalman Filter-based multi-arm ANN (MEnKF-ANN).
result MEnKF-ANN can adequately approximate LSTM networks and provide uncertainty estimates.
A multiple instance dictionary learning approach, Dictionary Learning using Functions of Multiple Instances (DL-FUMI), is used to perform beat-to-beat heart rate estimation and to characterize heartbeat signatures from ballistocardiogram (BCG) signals collected with a hydraulic bed sensor. DL-FUMI estimates a "heartbea…
The study compares DLS method with machine learning for cricket match result prediction.
problem Improving accuracy of Duckworth-Lewis-Stern method for cricket match result prediction.
method Comparison of Duckworth-Lewis-Stern method with various supervised learning algorithms and optimization of DLS resource table.
result Development of Unpredictability Index to rank nations based on unpredictability in ODI matches.
Survey of ML and DL for bearing fault diagnostics.
problem Fault detection and categorization in bearings.
method Review of conventional ML methods and analysis of DL algorithms.
result DL methods outperform conventional ML in fault feature extraction and classification.
Recent advances in adversarial Deep Learning (DL) have opened up a largely unexplored surface for malicious attacks jeopardizing the integrity of autonomous DL systems. With the wide-spread usage of DL in critical and time-sensitive applications, including unmanned vehicles, drones, and video surveillance systems, onli…
DL-based radio signal classification is vulnerable to adversarial attacks.
problem Vulnerability of DL to adversarial attacks in radio signal classification.
method Crafted white-box and universal black-box adversarial attacks.
result Adversarial attacks can reduce classification performance with small perturbations.
DL improves precipitation nowcasting from radar images.
problem Precise short-term precipitation predictions for extreme weather adaptation.
method Image-to-image translation using UNET CNN, compared to optical flow, persistence, and HRRR.
result UNET-based DL outperforms traditional models in 1 km x 1 km, 1 hour precipitation nowcasting.
Deep Learning predicts prognosis of AML cases using cytogenetics, age, and mutations.
problem Predicting prognosis of acute myeloid leukemia (AML) cases.
method Hierarchical Deep Learning model using autoencoders, trained on TCGA database.
result Achieved 83% accuracy in predicting prognosis of AML cases.
Survey of deep learning models in finance.
problem Improving financial models with deep learning.
method Categorized and analyzed financial applications of deep learning models.
result Outperformance of deep learning over classical models in finance.
Deep learning aids in autism diagnosis and rehabilitation using neuroimaging data.
problem Challenges in automated detection and rehabilitation of ASD using neuroimaging data.
method Deep learning techniques applied to neuroimaging data for ASD diagnosis and rehabilitation.
result Deep learning improves accuracy in ASD diagnosis and rehabilitation.
A new method detects hallucinations in medical image restoration using Fourier Ring Correlation.
problem Detecting hallucinations in DL outputs for medical image restoration.
method sFRC (s(c)can FRC) over small patches of DL outputs and reference images.
result sFRC effectively detects hallucinations in CT and MRI restoration problems.
Paper uses DL and image embedding to classify power grid disturbances.
problem Classifying transient disturbances in power grids.
method Transformed time series data into images using Gramian Angular Field, then applied CNN and RNN for classification.
result DL algorithms outperform traditional data mining methods in power grid disturbance classification.
Paper explores DL for RS image classification, achieving better results.
problem Challenges in processing rich spatio-spectral RS datasets.
method Introduces a three-dimensional DL approach for RS hyperspectral image classification.
result Proposed method achieves better classification rate than state-of-the-art methods.
A multiple instance dictionary learning method using functions of multiple instances (DL-FUMI) is proposed to address target detection and two-class classification problems with inaccurate training labels. Given inaccurate training labels, DL-FUMI learns a set of target dictionary atoms that describe the most distincti…
New DL algorithm detects critical chest X-ray findings without manual annotations.
problem Lack of explainability and manual annotation costs for DL models in medical imaging.
method Multi-instance learning approach to jointly classify and localize critical findings in CXR.
result Competitive classification results on three CXR datasets.