The study evaluates neural network patching techniques to adapt models to concept drift.
problem Adapting neural network models to handle concept drift in nonstationary environments.
method Investigated different engagement layers and patch architectures to enhance neural network patching.
result Identified generally applicable heuristics for parametrizing the patching procedure.
New method makes neural networks more resilient to location-optimized adversarial patches.
problem Neural networks' vulnerability to adversarial patches that are visible but still effective.
method Developed a practical approach to optimize patch locations and applied adversarial training.
result Significantly improved robustness against adversarial patches on CIFAR10 and GTSRB.
Efficiently processes high res images by selecting relevant patches.
problem High memory and compute requirements for processing large images.
method Differentiable Top-K operator to select relevant patches.
result End-to-end trainable model using backpropagation.
Patch augmentation boosts neural network accuracy and robustness.
problem Improving neural network accuracy and robustness to adversarial attacks.
method Data augmentation technique creating new images by superimposing patches from image pairs.
result Significant accuracy improvements on CIFAR-10 and CIFAR-100 datasets.
Symbolic neural network for analyzing and patching complex systems.
problem Analyzing and verifying complex neural networks.
method Symbolic representation of piecewise-linear neural networks for efficient computation.
result Demonstrated applications in weakest preconditions, strongest postconditions, and patching.
Sparse neural networks visualize paired transcriptomic and electrophysiological data.
problem Efficiently analyzing and visualizing paired multivariate neuroscientific data.
method Sparse deep neural networks with a two-dimensional bottleneck and group lasso penalty.
result Biologically interpretable two-dimensional visualizations of paired data.
ALONE uses neural networks to accelerate cine MRI without needing ground truth.
problem Accelerated MRI reconstruction without using ground truth.
method Unsupervised learning of shallow CNNs to approximate MRI patches.
result ALONE outperforms TV and DIC methods in cine MRI reconstruction.
Patch ranking improves CNN performance by focusing on object content, not location.
problem CNNs lack rotation and translation invariance, limiting model capacity.
method Patch ranking before convolution and pooling to encode invariance.
result Patch ranking module improves CNN performance on various tasks.
Trojans can be inserted into deep neural networks without altering training data.
problem Inserting malicious code into deep learning models without changing training data.
method Patches model parameters in memory to achieve desired behavior on specific inputs.
result Efficient patches can induce trojan behavior with minimal risk of detection.
Deep neural networks are powerful machine learning approaches that have exhibited excellent results on many classification tasks. However, they are considered as black boxes and some of their properties remain to be formalized. In the context of image recognition, it is still an arduous task to understand why an image …
Sparse connectivity improves generalization in neural networks below the Edge of Stability.
problem Generalization guarantees for fully-connected networks fail at the Edge of Stability.
method Analyzed sparse connectivity's impact on generalization in two-layer ReLU networks.
result Sparse connectivity changes the effective constraint, leading to non-vacuous generalization bounds.
A new method increases 3D medical image segmentation accuracy and speed.
problem Training large 3D medical images on GPUs with limited memory.
method Data-swapping method to enlarge GPU memory and avoid patching.
result Improved segmentation accuracy and speed for full-size images.
PatchGT uses non-trainable graph patches to improve graph representation learning.
problem Learning high-level information in graph tasks with direct Transformer models.
method PatchGT segments graphs into non-trainable patches, uses GNN for patch-level learning, and Transformer for graph-level learning.
result PatchGT achieves higher expressiveness and competitive performance on benchmark datasets.
CutMix enhances feature learning in neural networks, improving test accuracy.
problem Understanding and improving feature learning in neural networks using patch-level augmentation.
method Three distinct methods: vanilla training, Cutout training, and CutMix training were studied.
result CutMix training yields the highest test accuracy and learns all features and noise vectors evenly.
We give the first provably efficient algorithm for learning a one hidden layer convolutional network with respect to a general class of (potentially overlapping) patches. Additionally, our algorithm requires only mild conditions on the underlying distribution. We prove that our framework captures commonly used schemes …
To alleviate the burden of gathering detailed expert annotations when training deep neural networks, we propose a weakly supervised learning approach to recognize metastases in microscopic images of breast lymph nodes. We describe an alternative training loss which clusters weakly labeled bags in latent space to inform…
Improved CNN model accuracy and generalizability through data pre-processing.
problem Enhancing accuracy and generalizability of CNN-based LULC classification.
method Trials of different data preparation methods, including patch selection, size, and augmentations.
result Combining multiple grids and rotations of patches improved model accuracy and generalizability.
New mechanism discovered for feature learning in CNNs.
problem Understanding how CNNs learn features from images.
method Proposed Convolutional Neural Feature Ansatz linking filter covariances to patch-based AGOPs.
result Deep ConvRFM algorithm learns features similar to deep CNNs, improving performance.
Semantic segmentation is an established while rapidly evolving field in medical imaging. In this paper we focus on the segmentation of brain Magnetic Resonance Images (MRI) into cerebral structures using convolutional neural networks (CNN). CNNs achieve good performance by finding effective high dimensional image featu…
Study on neural networks' sample complexity with one hidden layer.
problem Understanding how sample complexity is affected by network architecture and norm constraints.
method Norm-based uniform convergence bounds for scalar-valued one-hidden-layer networks, focusing on spectral and Frobenius norms.
result Spectral norm control is insufficient for uniform convergence guarantees, but Frobenius norm control is sufficient, with conditions.
Translating or rotating an input image should not affect the results of many computer vision tasks. Convolutional neural networks (CNNs) are already translation equivariant: input image translations produce proportionate feature map translations. This is not the case for rotations. Global rotation equivariance is typic…
The forecasting and reconstruction of ocean and atmosphere dynamics from satellite observation time series are key challenges. While model-driven representations remain the classic approaches, data-driven representations become more and more appealing to benefit from available large-scale observation and simulation dat…
Paper proposes CNN for diagnosing rare muscular dystrophies from images.
problem Challenges in diagnosing rare diseases due to lack of data.
method Uses a Convolutional Neural Network (CNN) for patch-based classification of confocal microscopy images.
result CNN system identifies problematic areas and provides global patient evaluation.
Proposes a new regularization method for deep learning models.
problem Lack of leverage from neighboring sample relationships in existing regularization techniques.
method Patch-level Neighborhood Interpolation (Pani) that constructs patch-level graphs and linearly interpolates neighborhood patch features.
result Demonstrates effectiveness of Pani in both supervised and semi-supervised settings.
New neural network learns seismic horizon locations from few images.
problem Automated detection of seismic horizons from small patches is inefficient.
method Multi-resolution U-net with projected loss-function for non-linear regression.
result Network accurately predicts horizon locations even far from known areas.
We present a novel approach to automatically segment magnetic resonance (MR) images of the human brain into anatomical regions. Our methodology is based on a deep artificial neural network that assigns each voxel in an MR image of the brain to its corresponding anatomical region. The inputs of the network capture infor…
We propose a new algorithm to learn a one-hidden-layer convolutional neural network where both the convolutional weights and the outputs weights are parameters to be learned. Our algorithm works for a general class of (potentially overlapping) patches, including commonly used structures for computer vision tasks. Our a…
Framework detects and classifies multi-label RBC images from microscopic images.
problem Challenges in separating touching or overlapping cells for classification.
method Region proposal model + CNN feature extraction + multi-label prediction networks.
result Framework achieves good performance in automatic cell detection and classification.
Paper introduces MSP Network for harmonizing images from different scanners.
problem Improving predictive performance and learning efficiency in data harmonization.
method Multi-Stage Prediction (MSP) Network integrating neural networks of different architectures.
result MSP Network shows 20% improvement in patch-based mean-squared error over state-of-the-art methods.
Reinforcement Patching optimizes dynamic sequence patching for efficient time series forecasting.
problem Efficiently learning data-adaptive representations for long-horizon sequence data, especially continuous sequences.
method Reinforcement Patching (ReinPatch) uses reinforcement learning to optimize dynamic patching policies and sequence backbones.
result ReinPatch achieves compelling performance in time-series forecasting compared to state-of-the-art methods.
GOTEX synthesizes textures by optimizing feature distributions using optimal transport.
problem Texture synthesis with control over feature distributions.
method Optimal transport for statistical feature distribution comparison, semi-dual formulation, minimax optimization.
result GOTEX produces high-quality textures with various features, outperforming state-of-the-art methods.
Context-aware CNN improves cancer grading accuracy.
problem Grading colorectal cancer histology images accurately.
method Proposes a context-aware neural network for 1,792x1,792 pixel images.
result Outperforms traditional methods by 3.61%.
Deep neural network improves malaria detection from red blood cells.
problem Improving malaria detection from red blood cell images.
method End-to-end deep learning approach using convolutional neural networks.
result Best model achieves 97.77% accuracy.
The key idea of current deep learning methods for dense prediction is to apply a model on a regular patch centered on each pixel to make pixel-wise predictions. These methods are limited in the sense that the patches are determined by network architecture instead of learned from data. In this work, we propose the dense…
Scene parsing is an important and challenging prob- lem in computer vision. It requires labeling each pixel in an image with the category it belongs to. Tradition- ally, it has been approached with hand-engineered features from color information in images. Recently convolutional neural networks (CNNs), which automatica…
Novel CNN-based gaze scanpath comparison distinguishes experts from novices in dental radiograph interpretation.
problem Distinguishing expertise in dental radiograph interpretation based on gaze behavior.
method Convolutional neural networks (CNN) process scene information at the fixation level, using image patches as input to compare gaze scanpaths.
result 93% accuracy in distinguishing experts from novices using image patch features.
TAP transfers knowledge from unlabeled data to improve cross-modal learning.
problem Improving supervised learning performance using unlabeled data from a different modality.
method Probabilistic approach for missing information estimation, kernel regression, cross-attention module, TAP neural network.
result TAP significantly improves generalization across different domains and neural network architectures.
Batch normalization biases linear models towards uniform margins, improving performance in binary classification.
problem Understanding the implicit bias of batch normalization in linear models and neural networks.
method Analyzing gradient descent convergence on linear models and two-layer CNNs with batch normalization.
result Gradient descent with batch normalization in linear models converges to a uniform margin classifier with an exponential convergence rate.
A new tensor network method for image classification reduces computation cost.
problem Efficiently classifying images in high-dimensional spaces.
method Proposes a multi-layered tensor network (MLTN) that performs one MPS operation per layer, reducing computation cost.
result Reduces computation cost without degrading performance.
Selfie pretrains image embeddings without pixel-level predictions.
problem Training image embeddings efficiently with limited labeled data.
method Contrastive Predictive Coding loss for masked patches, using convolutional and attention mechanisms.
result Significant improvement in ResNet-50 accuracy on ImageNet 224 x 224 with 60 examples per class (5%).
Large initial learning rate helps neural nets generalize better.
problem Understanding why large initial learning rates lead to better neural net generalization.
method Developed a proof for a two-layer network and demonstrated with experiments on CIFAR-10.
result Proved that a two-layer network trained with a large initial learning rate and annealing generalizes better than one trained with a small learning rate.
In recent years, many publications showed that convolutional neural network based features can have a superior performance to engineered features. However, not much effort was taken so far to extract local features efficiently for a whole image. In this paper, we present an approach to compute patch-based local feature…
A technique to quickly fix mistakes in neural networks.
problem Fixing model errors in neural networks quickly and without affecting other samples.
method Editable Training, a model-agnostic training technique.
result Effectiveness demonstrated on large-scale image classification and machine translation tasks.
Deep convolutional neural networks have become a key element in the recent breakthrough of salient object detection. However, existing CNN-based methods are based on either patch-wise (region-wise) training and inference or fully convolutional networks. Methods in the former category are generally time-consuming due to…
Although the recent progress in the deep neural network has led to the development of learnable local feature descriptors, there is no explicit answer for estimation of the necessary size of a neural network. Specifically, the local feature is represented in a low dimensional space, so the neural network should have mo…
New method reduces parameter overhead for Bayesian neural networks.
problem High parameter overhead and difficulty of implementation in variational Bayesian neural networks.
method Constructs a general variational family for ensemble-based Bayesian neural networks that works well with batch normalization layers.
result Improves predictive accuracy and achieves almost perfect calibration on a ResNet-18 trained with ImageNet.
A new approach selects tuning parameters for embedding methods.
problem Difficulty in selecting tuning parameters for embedding methods.
method Minimize a stress notion to supervise tuning parameter selection.
result Uncover a new bias--variance tradeoff phenomenon.
Convolutional operator learning is gaining attention in many signal processing and computer vision applications. Learning kernels has mostly relied on so-called patch-domain approaches that extract and store many overlapping patches across training signals. Due to memory demands, patch-domain methods have limitations w…