ACNN improves medical image segmentation with full resolution and higher IoUs.
problem Reduced spatial resolution in current DCNNs hinders medical image segmentation.
method Proposes ACNN using atrous convolution, cascaded atrous II-blocks, residual learning, and Instance Normalization.
result ACNN achieves higher IoUs than U-Net and Deeplabv3+ with fewer parameters.
Novel neural network improves retinal blood vessel segmentation accuracy.
problem Lack of effective low-level and high-level features in existing approaches.
method Proposes a convolutional neural network using atrous convolution for multi-scale features.
result Significantly outperforms existing approaches in accuracy and speed.
B-Spline CNNs on Lie Groups expand G-CNNs to arbitrary groups.
problem Leveraging geometric structure for improved feature learning.
method Lifting feature maps to B-spline expansions on Lie algebra.
result G-CNNs on Lie groups outperform classical 2D CNNs.
GSANet improves semantic segmentation accuracy with selective and global attention.
problem Semantic segmentation accuracy improvement.
method Global and selective attention mechanism with ASPP and sparsemax.
result GSANet achieves state-of-the-art accuracy on ADE20k and Cityscapes datasets.
A novel approach predicts long-term stock price trends using 2D-convolutional encoders and semantic segmentation.
problem Predicting long-term daily stock price changes with deep learning models.
method Proposes a hierarchical CNN structure with Atrous Spatial Pyramid Pooling blocks to capture both long and short-term temporal relationships.
result Achieved overall accuracy and AUC of 78.18% and 0.88 for predicting trends over the next 20 days.
DeepCAM learns convolutional dictionaries for image processing.
problem Processing high-dimensional signals like images efficiently.
method Introduces a Deep Convolutional Analysis Dictionary Model (DeepCAM) using convolutional dictionaries.
result DeepCAM achieves performance comparable to other methods on single image super-resolution.
Improved generative models using flexible convolutions.
problem Generating high-quality images efficiently.
method Generalized 1 x 1 convolutions to d x d convolutions, chaining autoregressive and periodic convolutions.
result Flexible d x d convolutions significantly improve generative flow models' performance.
Introduces Finslerian convolution metrics and their properties.
problem No specific problem stated; focuses on new metric concept.
method Definition and study of Finslerian convolution metrics.
result Characterization of Finslerian convolution metrics of Riemannian, Minkowskian, and Randers types.
DSGC unifies graph and grid convolutions.
problem Lack of understanding between graph and grid convolutions.
method Depthwise separable graph convolution.
result DSGC outperforms existing methods on benchmark datasets.
TAGCN improves graph CNN performance without approximation.
problem Performance loss in spectral graph convolutional neural networks.
method Topology adaptive graph convolutional network (TAGCN) with adaptive filters.
result TAGCN outperforms existing spectral CNNs on various datasets.
New PTC convolution preserves properties of Euclidean convolutions on manifolds.
problem Lack of generalizable convolutions on curved domains with desirable properties.
method Parallel transport convolution (PTC) on Riemannian manifolds.
result PTC preserves compactly supported filters and directionality.
VC dimensions of group CNNs are infinite for certain kernels and groups.
problem Estimating the generalization capacity of group convolutional neural networks.
method Identifying precise VC dimension estimates for simple sets of group CNNs.
result Two-parameter families of convolutional neural networks have an infinite VC dimension for infinite groups and certain kernels.
We introduce a guide to help deep learning practitioners understand and manipulate convolutional neural network architectures. The guide clarifies the relationship between various properties (input shape, kernel shape, zero padding, strides and output shape) of convolutional, pooling and transposed convolutional layers…
ConvNets can be translated into CKNs that perform similarly.
problem The distinction between ConvNets and kernel-based methods.
method Translation of ConvNets into CKNs using a new gradient algorithm.
result CKNs perform as well as ConvNets, supporting the translation.
Enhances group convolutional networks with attention to learn meaningful relationships.
problem Lack of explicit means to learn meaningful relationships among symmetry patterns.
method Introduces attentive group equivariant convolutions, applying attention during convolution.
result Consistently outperforms conventional group convolutional networks on benchmark datasets.
We introduce Group equivariant Convolutional Neural Networks (G-CNNs), a natural generalization of convolutional neural networks that reduces sample complexity by exploiting symmetries. G-CNNs use G-convolutions, a new type of layer that enjoys a substantially higher degree of weight sharing than regular convolution la…
In recent times, the use of separable convolutions in deep convolutional neural network architectures has been explored. Several researchers, most notably (Chollet, 2016) and (Ghosh, 2017) have used separable convolutions in their deep architectures and have demonstrated state of the art or close to state of the art pe…
Proves DCNNs with expansive convolution are strongly universally consistent.
problem Theoretical consistency of deep convolutional neural networks (DCNNs).
method Empirical risk minimization on DCNNs with expansive convolution (with zero-padding).
result DCNNs with expansive convolution are strongly universally consistent.
New framework for manifold convolutions using toric embeddings.
problem Computational intractability of manifold convolutions.
method Isometric embeddings into tori for global manifold convolutions.
result Global definition of manifold convolutions on finite approximations.
Paper improves graph convolutional networks by adjusting filter size.
problem Improving predictive performance of graph convolutional networks.
method Introducing a hyper-parameter to influence filter size in graph convolutions.
result Improves predictive performance of Deep Graph Convolutional Networks.
Functor connects Lie groupoid algebras to bornological structures.
problem Establishing a functorial relationship between Lie groupoid convolution algebras and bornological structures.
method Developed a monoidal functor from differentiable stacks to Morita 2-category of complete bornological algebras.
result Convolution algebras are self-induced and convolution modules are smooth.
IEA improves CNN models by averaging multiple convolutional layers.
problem Improving CNN model accuracy through ensemble learning.
method Replacing single convolutional layers with Inner Average Ensembles (IEA) of multiple convolutional layers.
result CNN models using IEA outperform those with regular convolutional layers.
HexaConv improves CNN performance by using hexagonal filters and group convolutions.
problem Improving CNN performance by exploiting more symmetries.
method Implementing planar and group convolutions over hexagonal lattices.
result HexaConv outperforms conventional CNNs on aerial scene classification.
New method enforces orthogonality in convolutional layers for improved robustness.
problem Improving adversarial robustness in deep learning models.
method Applying the Cayley transform to skew-symmetric convolutions in the Fourier domain.
result The proposed method preserves orthogonality and enhances adversarial robustness compared to existing techniques.
New method improves grouped convolutions on edge devices.
problem Efficiently implementing grouped convolutions on edge devices.
method Grouped Spatial Pack Convolutions (GSPC) in TVM.
result GSPC outperforms existing implementations by 3.4x, 8x, and 4x on average.
GCNs improve regression tasks by aggregating neighbor signals.
problem GCNs' statistical properties in regression tasks are poorly understood.
method Examined two GCN convolutions and their impact on learning error.
result GCNs have a bias-variance trade-off that depends on neighborhood size and topology.
Convolution and pooling improve kernel methods in image classification.
problem Understanding the interplay between approximation and generalization in convolutional architectures.
method Characterized RKHS of kernels with convolution, pooling, and downsampling, computed generalization error.
result Convolution and pooling operations trade off approximation with generalization power.
Convolutional networks outperform fully-connected ones in certain tasks.
problem Understanding the computational advantage of convolutional networks over fully-connected networks.
method Demonstrated a computational advantage through a specific problem class.
result Convolutional networks can solve certain problems that fully-connected networks cannot, even with gradient descent.
Proposes a method to constrain singular values of convolutional kernels in neural networks.
problem Avoiding exploding/vanishing gradient problems and improving generalizability in neural networks.
method Introduces a penalty function to constrain singular values of convolutional kernels around 1, and derives an algorithm for optimization.
result Demonstrates the effectiveness of the method through numerical examples.
Proposes a fixed smooth convolutional layer to reduce checkerboard artifacts in CNNs.
problem Checkerboard artifacts in CNNs during upsampling and strided convolution.
method Fixed convolutional layer with adjustable smoothness, applied to four CNNs and GANs.
result Significantly improves classification performance and image generation quality.
Adaptive convolution improves GANs performance on image generation.
problem GANs struggle with generating images of objects with diverse appearances.
method Proposes adaptive convolution to learn upsampling based on local context.
result Adaptive convolution models improve GANs performance on CIFAR-10 and STL-10 datasets.
This work proposes hyperbolic deep convolutional neural networks for better pattern recognition.
problem The limitations of Euclidean deep convolutional neural networks in capturing intricate patterns.
method Developed Hyperbolic DCNN based on Poincaré Disc, analyzing expansive convolution in non-Euclidean space.
result Hyperbolic convolutional architecture outperforms Euclidean ones in pattern recognition tasks.
New bounds for CNNs show better generalization than previous models.
problem Improving understanding of CNNs' generalization ability.
method Proposed tighter generalization bounds for CNNs by exploiting the sparse and permutation structure of weight matrices and spectral norms of convolution operations.
result Theoretical and experimental results show tighter bounds for CNNs than existing bounds.
New linear flows using exponential of linear transformations improve generative models.
problem Improving generative models in machine learning.
method Developed convolution exponentials and generalized Sylvester Flows using the exponential of linear transformations.
result Convolution exponentials and Convolutional Sylvester Flows outperform other models in log-likelihood.
Convolutional Gaussian Processes improve image classification accuracy.
problem Improving Gaussian Processes for high-dimensional inputs like images.
method Introducing convolutional structure into Gaussian processes with an inter-domain inducing point approximation.
result Convolutional Gaussian Processes achieve better generalization and faster inference on image datasets.
WaveletNet improves edge device efficiency with logarithmic convolution.
problem Efficiency and performance on edge devices for CNNs.
method Introduces WaveletNet architecture with wavelet convolution and depthwise fast wavelet transform.
result WaveletNet achieves superior and comparable performance to state-of-the-art models on CIFAR-10 and ImageNet.
Direct convolution eliminates memory overhead and improves performance.
problem Memory overhead and suboptimal performance in convolution layers.
method Implementing direct convolution without additional memory overhead.
result Performance improvement between 10% to 400% on various architectures.
A new convolution method stabilizes GANs by learning coarse structures first.
problem Mode collapse in GANs during training.
method Soft octave convolutions that split filters into high and low frequency parts, shifting weight updates.
result Reduces mode collapse and artifacts in generated images.
Self-attention can replace convolutional layers in vision tasks.
problem The supremacy of convolutional layers in vision tasks.
method Analysis and experiments with self-attention layers compared to convolutional layers.
result Self-attention layers can perform as well as convolutional layers and learn to do so.
We describe convolutional networks using harmonic functions.
problem Understanding the function space and smoothness of convolutional networks.
method Using reproducing kernel Hilbert spaces and functional ANOVA decomposition.
result Convolutional networks can be decomposed into a sum of elementary functions.
New updates for β-divergence in convolutional NMF are stable and consistent.
problem Improving the stability and consistency of NMF updates for convolutional data.
method Presented multiplicative updates for β-divergence in closed form. result The new updates are stable and consistent across common β values. Alternative to convolutions using decision trees for neural networks.
problem Replacing complex convolutions with simpler decision-based layers.
method Binary decisions as indices to conditional distributions, trained using backpropagation.
result Performance similar to conventional neural networks, with runtime improvements.
Convolutional networks can denoise images without training data.
problem Denoising and regularization of images without labeled data.
method Exploiting the structural bias of convolutional generators through gradient descent.
result Early-stopped gradient descent denoises/regularizes images effectively.
Adapts PAC-Bayesian analysis to convolutional neural networks.
problem Generalization error of convolutional neural networks.
method PAC-Bayesian framework applied to convolutional layers.
result Margin bounds for convolutional neural networks.
Proposes a new convolutional neural network for non-grid data.
problem Limited applicability of standard CNNs to non-grid structured data.
method Introduces Parametric Continuous Convolution (PCC) with learnable kernel functions.
result Significant improvement in point cloud segmentation and lidar motion estimation.
New method bounds singular values of convolutional kernels to stabilize gradients.
problem Stable gradients in convolutional neural networks.
method Frobenius norm regularization for convolutional kernels.
result Bounded singular values of transformation matrices.
Deep convolutional Gaussian processes boost image classification accuracy.
problem Image classification with hierarchical feature combinations.
method Deep Gaussian process architecture with convolutional structure.
result Significantly improved image classification performance on MNIST and CIFAR-10 datasets.
New mechanism discovered for feature learning in CNNs.
problem Understanding how CNNs learn features from images.
method Proposed Convolutional Neural Feature Ansatz linking filter covariances to patch-based AGOPs.
result Deep ConvRFM algorithm learns features similar to deep CNNs, improving performance.