Morph accelerates 3D CNNs for video recognition, reducing energy consumption and improving performance.
problem Efficiently accelerating 3D CNNs for video recognition is challenging due to their large memory footprint and higher dimensionality.
method Designing a flexible accelerator called Morph that adapts to different spatial and temporal tiling strategies, and codesigning a software infrastructure to control the hardware.
result Morph achieves up to 3.4x reduction in energy consumption and up to 5.1x improvement in performance/watt compared to a baseline 3D CNN accelerator.
3D Convolutional Neural Networks (3D-CNN) have been used for object recognition based on the voxelized shape of an object. However, interpreting the decision making process of these 3D-CNNs is still an infeasible task. In this paper, we present a unique 3D-CNN based Gradient-weighted Class Activation Mapping method (3D…
3D CNN accurately classifies infant neurodevelopmental age from MRI scans.
problem Estimating neurodevelopmental age in infants from MRI data.
method 3D Convolutional Neural Network (3D CNN) trained on MRI images of 112 infants.
result 3D CNN achieves 99% sensitivity and 98.3% specificity in age classification.
Early diagnosis, playing an important role in preventing progress and treating the Alzheimer\{'}s disease (AD), is based on classification of features extracted from brain images. The features have to accurately capture main AD-related variations of anatomical brain structures, such as, e.g., ventricles size, hippocamp…
Early diagnosis, playing an important role in preventing progress and treating the Alzheimer's disease (AD), is based on classification of features extracted from brain images. The features have to accurately capture main AD-related variations of anatomical brain structures, such as, e.g., ventricles size, hippocampus …
3D convolutional neural networks (3D-CNN) have been used for object recognition based on the voxelized shape of an object. In this paper, we present a 3D-CNN based method to learn distinct local geometric features of interest within an object. In this context, the voxelized representation may not be sufficient to captu…
3D CNNs interpret brain MRI differences between men and women.
problem Interpreting 3D CNNs for voxel-wise brain MRI analysis.
method Three interpretation methods: Meaningful Perturbations, Grad CAM, and Guided Backpropagation.
result Voxel-wise 3D CNN interpretation of brain MRI data.
A method to prune 3D CNNs by assigning different regularization parameters to layers based on importance.
problem Massive computation and storage consumption in 3D CNNs.
method Regularization-based pruning method assigning different regularization parameters to different weight groups.
result Pruning leads to 2x speedup with minimal accuracy loss for 3DResNet18 and C3D.
We develop three efficient approaches for generating visual explanations from 3D convolutional neural networks (3D-CNNs) for Alzheimer's disease classification. One approach conducts sensitivity analysis on hierarchical 3D image segmentation, and the other two visualize network activations on a spatial map. Visual chec…
Predict steering angles of self-driving cars from images.
problem Predicting steering angles for self-driving cars using image data.
method Used deep learning techniques like Transfer Learning, 3D CNN, LSTM, and ResNet to predict steering angles.
result Both models placed in the top ten of Udacity's challenge.
Unified framework for nuclear reactor perturbation analysis using CNN and LSTM.
problem Monitoring reactor cores for safety and perturbation identification.
method 3D-CNN and LSTM networks for frequency and time domain analysis, respectively.
result High accuracy in recognising perturbation type and precise source localisation in frequency domain.
JigsawHSI improves land-use classification using hyperspectral images.
problem Land-use land-cover classification in hyperspectral images.
method Convolutional Neural Network (CNN) tailored for geoscientific analysis, using Jigsaw architecture.
result JigsawHSI achieves state-of-the-art performance in land-use classification.
Novel approach combines local and global brain changes for AD prediction.
problem Detecting Alzheimer's disease through local and global brain changes.
method Patch-based 3D-CNNs combined with global topological features for multi-scale brain tissue connectivity.
result Average precision score of 0.95 for classifying cognitively normal subjects and AD patients (prevalence ~55%).
Convolutional LSTM detects emphysema in lung cancer screening images.
problem Learning disease signatures from weakly annotated volumetric medical images.
method 3D volumetric images analyzed as a sequence of 2D images using convolutional LSTM.
result Convolutional LSTM model outperformed other methods in detecting emphysema.
Study evaluates using multiple slices as input for CNNs in medical image segmentation.
problem Improving segmentation performance in medical images with limited computational resources.
method Compared pseudo-3D and 2D approaches using different CNN architectures and datasets.
result Multi-slice inputs did not significantly improve segmentation performance over 2D or 3D CNNs.
Ensemble learning improves rs-fMRI predictions using 3D CNNs.
problem Improving specificity and sensitivity of rs-fMRI measurements through better parcellation schemes.
method Ensemble learning with 3D CNNs to combine predictions from different parcellations.
result Ensemble learning with 3D CNNs outperforms traditional methods in rs-fMRI classification and regression tasks.
Tab2vox converts tabular data into 3D images for improved demand forecasting.
problem Forecasting demand influenced by multi-level causes and large volatility.
method Tab2vox neural architecture search (NAS) model to convert tabular data into 3D voxel images for 3D CNN forecasting.
result 3D CNN forecasting model outperforms existing tabular data techniques.
Improved 3D MRI classification using contrastive learning with continuous proxy metadata.
problem Insufficient labelled data for 3D medical image classification.
method Proposed a new loss function (y-Aware InfoNCE) to leverage continuous proxy metadata in contrastive learning.
result 3D CNN model pre-trained on 10^4 multi-site healthy brain MRI scans outperforms fully-supervised methods.
X-Caps improves medical diagnosis explainability by encoding visual attributes in capsules.
problem Uninterpretable predictions from deep neural networks in healthcare.
method Teaches a novel multi-task capsule network to encode high-level visual attributes and malignancy scores.
result X-Caps outperforms state-of-the-art deep dense 3D CNNs in capturing visually interpretable attributes and malignancy prediction.
Physics-constrained neural nets solve EM fields of charged particle beams.
problem Solving Maxwell's equations for intense charged particle beams.
method 3D Convolutional Neural Networks (CNNs) constrained by physics.
result 3D CNNs generate electromagnetic fields from current and charge densities.
3D Steerable CNNs learn equivariant features for 3D data.
problem Learning rotationally equivariant features in volumetric data.
method SE(3)-equivariant convolutions using steerable kernel basis.
result 3D Steerable CNNs are effective for protein structure classification and amino acid propensity prediction.
This paper explores the capabilities of convolutional neural networks to deal with a task that is easily manageable for humans: perceiving 3D pose of a human body from varying angles. However, in our approach, we are restricted to using a monocular vision system. For this purpose, we apply a convolutional neural networ…
CNN improves rs-fMRI diagnosis accuracy for autism.
problem Limited capacity of rs-fMRI machine learning models.
method Volumetric 3D Convolutional Neural Network (CNN) framework.
result State-of-the-art accuracy in rs-fMRI-based autism diagnosis.
Lung cancer is the leading cause of cancer-related death worldwide. Early diagnosis of pulmonary nodules in Computed Tomography (CT) chest scans provides an opportunity for designing effective treatment and making financial and care plans. In this paper, we consider the problem of diagnostic classification between beni…
Enhances hand gesture recognition with separate networks and shared features.
problem Improving recognition accuracy of unimodal 3D-CNNs for dynamic hand gestures.
method Separate networks for each modality, collaborative learning, spatiotemporal semantic alignment loss, focal regularization.
result Improves test time recognition accuracy and state-of-the-art performance.
Computer aided diagnostic (CAD) system is crucial for modern med-ical imaging. But almost all CAD systems operate on reconstructed images, which were optimized for radiologists. Computer vision can capture features that is subtle to human observers, so it is desirable to design a CAD system op-erating on the raw data. …
Stein shrinkage improves BN robustness against adversarial attacks.
problem Improving BN robustness against adversarial attacks.
method Applying Stein shrinkage to BN mean and variance estimates.
result Stein shrinkage outperforms vanilla BN in adversarial settings.
Proposes a multi-level learning approach for 3D object recognition.
problem Improving 3D object recognition accuracy through multi-scale spatial features.
method End-to-end multi-level learning on a multi-level voxel grid.
result Comparable object recognition performance with lower memory usage.
Deep CNNs identify age-related patterns in fetal brain activity.
problem Understanding age effects in fetal brain development.
method Supervised 3D Convolutional Neural Networks applied to fetal fMRI data.
result Deep CNNs can distinguish age groups in fetal brain activity.