Proposes dense transformer networks for better pixel-wise predictions.
problem Current deep learning methods for dense prediction are limited by fixed patch sizes.
method Introduces dense transformer networks with learnable patch sizes and shapes.
result Superior performance in natural and biological image segmentation tasks.
Semantic boundary and edge detection aims at simultaneously detecting object edge pixels in images and assigning class labels to them. Systematic training of predictors for this task requires the labeling of edges in images which is a particularly tedious task. We propose a novel strategy for solving this task, when pi…
The paper introduces metrics to quantify information discarding in DNNs.
problem Understanding how input information is discarded during neural network processing.
method Developed two entropy-based metrics to measure pixel-wise and reconstruction uncertainty.
result The metrics provide new insights into DNN performance and information processing efficiency.
FCDD improves image anomaly detection without post-hoc explainers.
problem Image anomaly detection, especially pixel-wise.
method Fully Convolutional Data Description (FCDD) directly addresses anomaly detection without post-hoc methods.
result FCDD achieves state-of-the-art results on pixel-wise AD tasks.
Augmented CT slices improve liver lesion classification accuracy.
problem Improving pixel-wise classification of hepatic lesions and normal liver tissues.
method Anatomical data augmentation using adjacent CT slices for training a U-net network.
result Improvement of 3% in success rate, 5% in classification accuracy, and 4% in Dice.
This work replaces pixel-wise reconstruction in VAEs with real NVP transformations.
problem Shortcomings of pixel-wise reconstruction in VAEs.
method Used real-valued non-volume preserving transformations (real NVP) for conditional likelihood computation.
result A simple VAE with real NVP is competitive with complex VAE structures on image modeling tasks.
Improves image quality in generative models by estimating pixel-wise aleatoric uncertainty.
problem Lack of quantitative assessment of image quality in diffusion models.
method Estimate pixel-wise aleatoric uncertainty during sampling phase using a perturbation scheme designed for diffusion models.
result Uncertainty-guided sampling leads to better sample generation quality as shown by FID scores.
Graph U-Nets improve graph representation learning.
problem Challenges in learning representations for graph data.
method Proposed novel graph pooling and unpooling operations in a graph U-Nets architecture.
result Graph U-Nets achieve better performance on node and graph classification tasks.
Lazy labels enable deep learning for microscopy segmentation without full annotation.
problem Lack of pixel-wise annotations limits fully supervised learning for bioimage segmentation.
method Lazy labels combined with coarse labels for training a deep neural network.
result Model achieves accurate segmentation with minimal pixel-wise annotations.
Anomaly detection scores from VAE gradients improve tumor detection.
problem Improving anomaly detection in medical imaging.
method Using Variational Autoencoders to approximate anomaly ratings.
result Variance Autoencoder gradient-based ratings outperform other methods in tumor detection.
Pixel-wise relevance method shows how CNNs classify faces, varying across datasets and tasks.
problem Interpreting black-box CNN face recognition models.
method Layer-wise relevance propagation (LRP) applied to VGG-16 models trained for face recognition.
result Relevance maps are generally stable across random initializations and tasks, but less so across pretraining datasets.
New neural network separates singing voices from music using cross entropy loss.
problem Separating singing voices from music accompaniment.
method Deep Convolutional Neural Network (CNN) trained with Ideal Binary Mask (IBM) and cross entropy loss.
result Proposed CNN outperforms existing systems in MIREX evaluations.
InstaHide encrypts images for privacy in distributed learning.
problem Private training of deep neural networks on distributed data.
method Encryption of training images with one-time secret keys and pixel-wise masks.
result Preserves privacy with minor accuracy loss, secure against known attacks.
A new method for spotting symbols in CAD images reduces annotation costs and improves accuracy.
problem Challenging task of labeling symbols from CAD drawings.
method Pixel-wise point location via Progressive Gaussian Kernels (PGK) and local offset.
result The proposed method achieves good generalization on real-world CAD images.
RankSEG-RMA improves semantic segmentation efficiency and applicability.
problem Inconsistent or suboptimal semantic segmentation results due to argmax or thresholding.
method Developed RankSEG-RMA using reciprocal moment approximation to optimize Dice and IoU metrics.
result RankSEG-RMA reduces computational complexity to O(d) while maintaining comparable performance.
Generative model creates realistic scenes from pixel-wise labels.
problem Creating photo-realistic scenes from pixel-wise labels.
method Semantic bottleneck GAN model combining conditional and unconditional generation networks.
result Model outperforms state-of-the-art models in unsupervised image synthesis.
Paper evaluates CNN-based facial landmark detection methods.
problem Evaluate characteristics and performance of CNN-based facial landmark detection methods.
method Divided into regression and heatmap approaches, investigated using a hybrid loss function and discrimination network.
result Proposed model outperforms other models in all tested datasets.
This paper explores the trade-off between spatial and adversarial robustness in neural networks.
problem Understanding the trade-off between spatial and adversarial robustness in neural networks.
method Quantitative analysis and empirical testing with curriculum learning.
result Spatial robustness and adversarial robustness are quantitatively related and can be improved simultaneously.
Method meta-classifies semantic segmentation predictions using dispersion measures.
problem Assessing the quality of semantic segmentation predictions.
method Aggregates dispersion measures (entropy) of predicted probabilities to derive metrics correlated with IoU.
result Metrics correlate well with IoU, providing reliable prediction quality ratings.
Method generates uncertainty measures for street scene segmentation.
problem Reliability and uncertainty measures in semantic segmentation of street scenes.
method Nested crops, neural network segmentation, post-processing, uncertainty heat maps.
result Significant improvements in classification and regression performance.
A deep learning framework separates overlapping nuclei in histology images.
problem Challenges in nuclear segmentation due to overlapping nuclei.
method Proposal-free spatially-aware deep learning framework with multi-scale spatial information.
result State-of-the-art performance in nuclear segmentation on a multi-organ data set.
SLUG method detects bias and out-of-distribution content in generative models.
problem Generative models can underrepresent certain groups and fail on out-of-distribution data.
method SLUG: A new uncertainty quantification method for VAEs combining Laplace approximations and stochastic trace estimators.
result SLUG's UQ score correlates with bias and out-of-distribution content.
Proposes a new method for robust uncertainty quantification in regression tasks.
problem Robust uncertainty estimation for deep neural networks in regression tasks.
method Generalized Auxiliary Uncertainty Estimator (AuxUE) scheme, considering both aleatoric and epistemic uncertainties.
result DIDO method provides robust uncertainty estimates in noisy inputs, scalable to image-level and pixel-wise tasks.
GANCS uses GANs to speed up MRI reconstruction while maintaining diagnostic quality.
problem Time and resource intensive MRI reconstruction and loss of diagnostic quality in compressed sensing.
method Generative adversarial networks (GAN) trained on historical patient data to learn diagnostic-quality MR images.
result GANCS reconstructs MRI images in a few milliseconds with high contrast and texture details.
RGI improves robustness of GAN-inversion for image restoration and anomaly detection.
problem Robustness of GAN-inversion to unknown gross corruptions.
method Proposes RGI and R-RGI methods with provable robustness guarantees.
result Restored images and corrupted region masks converge to ground truth under mild assumptions.
A novel approach predicts long-term stock price trends using 2D-convolutional encoders and semantic segmentation.
problem Predicting long-term daily stock price changes with deep learning models.
method Proposes a hierarchical CNN structure with Atrous Spatial Pyramid Pooling blocks to capture both long and short-term temporal relationships.
result Achieved overall accuracy and AUC of 78.18% and 0.88 for predicting trends over the next 20 days.
New optimization criteria improve variational autoencoders for clearer images and latent features.
problem Improving clarity and informativeness of variational autoencoders' latent features and samples.
method Proposed new optimization criteria and a sequential VAE model.
result New criteria help generate clearer images and more informative latent features.
Flow-SSN improves segmentation efficiency and accuracy.
problem Challenges in medical imaging segmentation, especially high-rank pixel-wise covariances.
method Generative segmentation model using discrete-time autoregressive and continuous-time flow variants.
result Flow-SSNs can estimate high-rank pixel-wise covariances efficiently without assuming rank or storing parameters.
Generative model improves latent space convexity through adversarial training on interpolations.
problem Improving latent space convexity in generative models.
method Adversarial training on latent space interpolations within an AE-GAN architecture.
result Convex latent distribution of generated images, preserving realistic resemblances.
SaR-SVM-STV improves hyperspectral image classification with shape-adaptive reconstruction and denoising.
problem Classifying hyperspectral images with limited labeled data.
method Shape-adaptive Reconstruction (SaR) for pixel preprocessing, SVM for probability estimation, and Smoothed Total Variation (STV) for denoising.
result SaR-SVM-STV outperforms SVM-STV with fewer labeled data.
ceVAE improves anomaly detection in medical images by combining reconstruction and density-based scoring.
problem Lack of formal assertions and comparability in anomaly scores based on reconstruction error.
method Proposes Context-encoding Variational Autoencoder (ceVAE) that combines reconstruction and density-based scoring.
result ceVAE achieves unsupervised ROC-AUCs of 0.95 and 0.89 on BraTS-2017 and ISLES-2015 benchmarks, outperforming state-of-the-art methods.
UOLO detects and segments objects in medical images, achieving state-of-the-art performance.
problem Automatic detection and segmentation of objects in medical images.
method UOLO combines object segmentation and detection using a novel loss function.
result UOLO achieves state-of-the-art performance on optic disc and fovea detection and segmentation from retinal images.
Novel framework monitors cardiac image segmentation models in real-time.
problem Ensuring continuous high model performance and segmentation results in clinics.
method Formulated as anomaly detection, the framework derives surrogate quality measures for segmentation.
result Demonstrated accurate, fast, and scalable quality control monitoring.
Deep Leakage from Gradients can reveal private training data from shared gradients.
problem The safety of gradients in multi-node machine learning systems is questionable.
method Empirical validation of Deep Leakage from Gradient attack on computer vision and natural language processing tasks.
result The attack is more effective than previous methods, achieving pixel-wise accuracy for images and token-wise matching for texts.
Pixel-wise classification, where each pixel is assigned to a predefined class, is one of the most important procedures in hyperspectral image (HSI) analysis. By representing a test pixel as a linear combination of a small subset of labeled pixels, a sparse representation classifier (SRC) gives rather plausible results …
Method estimates uncertainty in CT reconstructions.
problem Lack of accurate uncertainty estimates in deep-learning CT reconstructions.
method Linearised deep image prior with conjugate Gaussian-linear model error bars and Gaussian surrogate for TV regularisation.
result Method provides superior calibration of uncertainty estimates.
A real-time adaptive background subtraction framework using a rejection cascade of Gaussians.
problem Real-time background subtraction with pixel-wise modeling trade-offs.
method Decompose Gaussian Mixture Model into an adaptive cascade of Gaussians (CoG).
result 4-5x speed-up and 17% accuracy improvement over baseline.
Antithetic noise improves diffusion models' uncertainty quantification.
problem Improving uncertainty quantification in diffusion models.
method Pairing each noise sample with its negation, leading to strong negative correlation.
result Substantially more reliable uncertainty quantification with up to 90% narrower confidence intervals.
EnhanceNet improves image quality through automated texture synthesis.
problem Traditional image super-resolution methods produce over-smoothed images.
method Automated texture synthesis in adversarial training setting.
result Achieves state-of-the-art results in image quality benchmarks.
Improved flow-based models capture dependencies better with multi-scale autoregressive priors.
problem Limited expressiveness of flow-based models for long-range data dependencies.
method Introducing channel-wise dependencies through multi-scale autoregressive priors (mAR) in split coupling flow layers (mAR-SCF).
result Achieves state-of-the-art density estimation results on MNIST, CIFAR-10, and ImageNet.
DVNet efficiently segments large neurovascular datasets using skip connections.
problem Challenges in segmenting large neurovascular datasets from high-throughput microscopy data.
method A fully-convolutional, deep, and densely-connected encoder-decoder network with skip connections.
result DVNet achieves superior performance in semantic segmentation of neurovascular datasets.
Paper describes a video surveillance system for highway traffic events.
problem Detecting specific sequences of situations in highway traffic videos.
method Compares RNN and CNN architectures for analyzing video frames and sequences.
result Best architecture performs well in real conditions.
CBDA improves active learning for semantic segmentation, especially with imbalanced classes.
problem Class imbalance degrades performance in domain adaptive active learning.
method Class Balanced Dynamic Acquisition (CBDA) selects more balanced labels for active learning.
result CBDA increases minority class performance and outperforms baselines by 0.6-2.4 mIoU.
DeepIrisNet2 learns iris codes without iris segmentation or normalization.
problem Iris recognition under non-ideal conditions.
method Deep learning framework with spatial transformer layers and dual CNN segmentation.
result Significantly improves iris recognition performance.
Paper presents a method to detect out-of-distribution spectra in intra-operative functional imaging.
problem Detecting out-of-distribution (OoD) spectra in multispectral optical imaging during surgery.
method Information theory-based approach using WAIC with an ensemble of INNs.
result The method is effective in detecting OoD spectra, improving the reliability of functional imaging.
Study detects boundaries in unlabeled noisy images without labels.
problem Detecting boundaries in unlabeled noisy images without labels.
method Proposed a continuous hinge-type surrogate loss for boundary detection, combined with deep neural networks.
result Deep neural network achieves minimax-optimal boundary recovery rate under piecewise smooth boundary model.
Paper proposes structured semantic perturbations to improve adversarial attacks.
problem Vulnerability of deep neural networks to adversarial attacks.
method Manipulates semantic attributes via disentangled latent codes.
result Demonstrates the effectiveness of structured semantic perturbations.
Improved semantic segmentation accuracy by addressing class imbalance.
problem Class imbalance in training data leads to misclassification of rare classes.
method Localized weighting of posterior class probabilities with pixel-wise priors.
result Significant improvement in recall and reduction of non-detection rate for rare classes.