Enhances group convolutional networks with attention to learn meaningful relationships.
problem Lack of explicit means to learn meaningful relationships among symmetry patterns.
method Introduces attentive group equivariant convolutions, applying attention during convolution.
result Consistently outperforms conventional group convolutional networks on benchmark datasets.
Generalizes CNNs for Lie group equivariance across various data types.
problem Equivariance to transformations like rotations for non-image data.
method Constructs equivariant convolutional layers for Lie groups.
result Models conserve linear and angular momentum in Hamiltonian systems.
Generalizes equivariance and convolution to compact groups for neural networks.
problem Ensuring equivariance in neural networks for various domain actions.
method Representation theory and noncommutative harmonic analysis.
result Convolution is necessary and sufficient for equivariance to compact group actions.
Group-equivariant subsampling layers improve CNNs' equivariance.
problem Non-translation equivariance in subsampling operations.
method Translation and group-equivariant subsampling/upsampling layers.
result Group-equivariant autoencoders learn equivariant representations.
G-CNNs reduce sample complexity by exploiting symmetries.
problem Reducing sample complexity in neural networks.
method Group equivariant convolutions that exploit symmetries.
result Achieve state-of-the-art results on CIFAR10 and rotated MNIST.
An impossibility result shows limitations in learning symmetries and equivariant functions.
problem Learning symmetries and equivariant functions simultaneously is impossible under certain conditions.
method Careful study of approximation for groups and semigroups, analysis of neural networks.
result Linearly equivariant networks can be used to learn equivariant functions, but group-convolutional networks have limitations.
RotDCF decomposes CNN filters for rotation-equivariant deep networks.
problem Handling global deformations in images for vision tasks.
method Decomposes convolutional filters over joint steerable bases for rotation-equivariance.
result Significantly reduces model size and computational complexity while preserving performance.
L-CNNs maintain gauge symmetry on non-Abelian lattice theories.
problem Applying convolutional neural networks to non-Abelian lattice gauge theories while preserving gauge symmetry.
method Developed a geometric formulation of L-CNNs that are equivariant under global symmetries and gauge transformations.
result Convolutional operations in L-CNNs are a specific case of gauge-equivariant neural networks on SU(N) principal bundles. This work introduces a method for almost equivariance in neural networks using Lie algebra convolutions.
problem Real-world data often does not conform to strict group equivariances, leading to underperformance in models.
method Definition and practical implementation of almost equivariance through Lie algebra convolutions.
result Demonstrated the validity of the approach through benchmarking against fully equivariant settings.
Improved sample efficiency in semantic segmentation with rotation equivariant CNNs.
problem Efficiently segmenting images with rotation and reflection symmetries.
method Introduced rotation-equivariant CNNs with new equivariant convolutions and transposed convolutions.
result Significant gains in sample efficiency and robustness to symmetry transformations.
Generalizes CNNs on homogeneous spaces like Euclidean and spherical surfaces.
problem Classifying and understanding equivariant CNNs on homogeneous spaces.
method Develops a theory for equivariant maps between field spaces of given types.
result Equivariant kernels correspond to the most general kind of equivariant linear maps.
Paper introduces method to make neural networks symmetrical.
problem Creating symmetrical neural networks for data with inherent symmetries.
method Introduces a method for modifying neural networks to enforce equivariance.
result Group convolutional neural networks are a special case of the introduced framework.
ScDCFNet improves multiscale image classification with reduced model size.
problem Improving performance in multiscale image classification.
method Decomposed convolutional filters for ST-equivariant CNNs.
result ScDCFNet achieves significantly improved performance in multiscale image classification.
LieTransformer extends self-attention to Lie groups for improved deep learning tasks.
problem Improving deep learning performance through group equivariant self-attention.
method LieSelfAttention layers that are equivariant to arbitrary Lie groups and their discrete subgroups.
result Competitive experimental results on various tasks.
GCNNs on homogeneous spaces use vector bundles and Hilbert spaces.
problem Learning data on homogeneous spaces with global symmetry.
method Analysis of G-equivariant convolutional layers on homogeneous G/K spaces, using vector bundles and reproducing kernel Hilbert spaces. result A precise criterion for expressing G-equivariant layers as convolutional layers, leading to stronger results for some groups. PDE-based G-CNNs add geometric symmetries to CNNs without augmentation.
problem Designing CNNs with built-in symmetries like rotation.
method Formulate CNN layers as PDE solvers on homogeneous spaces.
result PDE-G-CNNs achieve better performance with fewer parameters.
Lie groupoid equivariant neural networks are a new type of neural network.
problem Designing neural networks that respect the structure of Lie groupoids.
method Introducing Lie groupoid equivariant convolutions and layers, and showing their equivalence to Lie algebroid-equivariant networks.
result Lie groupoid equivariant neural networks are equivalent to certain Lie algebroid-equivariant networks.
B-Spline CNNs on Lie Groups expand G-CNNs to arbitrary groups.
problem Leveraging geometric structure for improved feature learning.
method Lifting feature maps to B-spline expansions on Lie algebra.
result G-CNNs on Lie groups outperform classical 2D CNNs.
Develops a framework for designing quantum neural networks that respect symmetries.
problem Trainability and generalization issues in quantum neural networks.
method Equivariant quantum neural networks (EQNN) for any symmetry group.
result Efficient construction of equivariant layers for EQNNs, including QCNNs.
ChebLieNet uses Lie groups to create invariant spectral graph networks.
problem Handling anisotropic data in graph neural networks.
method Develops anisotropic convolutional layers on Lie groups with Riemannian metrics.
result Demonstrates the effectiveness of balancing equivariance and invariance.
Group equivariant neural networks simplify complex tasks with group representation theory.
problem Challenging tasks requiring input transformations like rotations.
method Group representation theory, non-commutative harmonic analysis, differential geometry.
result A neural network is group equivariant if and only if it has a convolutional structure.
Unified method for CNNs to approximate equivariant maps across various groups.
problem Limited universal approximation theorems for CNNs with specific groups and settings.
method Unified approach to derive universal approximation theorems for equivariant maps by CNNs in diverse settings.
result Ability to handle non-linear equivariant maps between infinite-dimensional spaces for non-compact groups.
EquivCNP learns group symmetries for conditional data.
problem Learning conditional models with data symmetries.
method Group equivariant decomposition and Lie group convolutional layers.
result EquivCNP achieves comparable performance and zero-shot generalization.
Coordinate-independent convolutions on manifolds avoid reference frame ambiguity.
problem Applying convolutions on non-Euclidean manifolds without reference frame ambiguity.
method Developed coordinate-independent and gauge-equivariant convolutions on Riemannian manifolds.
result Coordinate-independent convolutions are equivariant under local gauge transformations.
The study quantifies how many objects can be linearly classified under all views.
problem Understanding the expressivity of group-equivariant representations.
method Generalization of Cover's Function Counting Theorem to quantify separable dichotomies.
result The fraction of separable dichotomies is determined by the fixed space dimension of the group action.
The paper introduces models to learn generalized transformation equivariant representations.
problem Capturing intrinsic visual structures equivariant to various transformations.
method Deterministic and probabilistic AutoEncoding Transformations (AET and AVT) models trained to learn visual representations from generic groups of transformations.
result Generalized TERs (GTERs) that are equivariant to transformations in a more general fashion.
Paper defines mathematical framework for neural network explainability.
problem Neural network explainability and equivariant operators.
method Mathematical framework based on Group Equivariant Non-Expansive Operators (GENEOs) and complexity measures.
result Formal properties and interpretability of Group Equivariant Operators (GEOs) defined.
Geometric models improve feature extraction and equivariance in image generation.
problem Improving feature extraction at multiscale levels and reducing network complexity.
method Proposes a geometric generative model based on morphological PDEs and GANs, incorporating equivariance for geometric interpretability.
result Preliminary results show GM-GAN outperforms classical GANs on MNIST data.
CubeNet preserves 3D shape signatures through equivariance.
problem 3D ConvNets fail to capture pose differences.
method Group Convolutional Neural Network with linear equivariance to 3D transformations.
result Achieves state-of-the-art on ModelNet10 classification.
Unified theorem for deep and shallow joint-equivariant machines.
problem Universal approximation of joint-equivariant machines.
method Constructive universal approximation theorem based on ridgelet transform.
result Unified approximation of deep and shallow networks.
3D Steerable CNNs learn equivariant features for 3D data.
problem Learning rotationally equivariant features in volumetric data.
method SE(3)-equivariant convolutions using steerable kernel basis.
result 3D Steerable CNNs are effective for protein structure classification and amino acid propensity prediction.
A new capsule network framework that preserves input transformations.
problem Inefficiency in learning part-whole relationships and lack of equivariance guarantees in capsule networks.
method Proposes a new capsule network framework that learns to projectively encode pose-variations for every capsule-type of each layer using a trainable, equivariant function over a grid of group-transformations.
result The proposed framework is equivariant and preserves the compositional representation of an input under transformations.
New framework for equivariant neural networks using Lie group decompositions.
problem Limitations of existing equivariant neural network methods for Lie groups.
method Lie group structure and geometry, decomposition into subgroups and submanifolds.
result Equivariant neural networks for affine transformations outperform previous methods.
This paper establishes a mathematical framework for G-CNNs on homogeneous spaces.
problem Designing equivariant neural networks for data with symmetries.
method Using Mackey's theory on induced representations, the paper presents a general framework for G-CNNs.
result G-CNNs are a universal class of equivariant network architectures.
Develops methods for learning similarity metrics and group-equivariant representations.
problem Learning discriminative representations for comparing objects, especially when limited computational resources are available.
method Proposes new formulations for metric learning, including extensions for kNN regression and asymmetric similarity learning. Introduces a computationally inexpensive approach for estimating metrics using gradient estimates. Develops SO(3)-equivariant neural networks for spherical data.
result Demonstrates improved k-NN accuracy and regression performance through novel metric learning formulations.
In this article, we start to recall the inversion formula for the convolution with the Box spline. The equivariant cohomology and the equivariant K-theory with respect to a compact torus G of various spaces associated to a linear action of G in a vector space M can be both described using some vector spaces of distribu…
New framework uses symmetry-based matrices for efficient, flexible NNs.
problem Designing neural networks with relaxed equivariance.
method Symmetry-based structured matrices, Group Matrices (GMs).
result GMs enable competitive performance with fewer parameters.
L-CNNs learn gauge invariant quantities on lattices.
problem Learning gauge invariant quantities on lattices.
method Novel convolutional layer preserving gauge equivariance and forming Wilson loops.
result L-CNNs can approximate any gauge covariant function on the lattice.
The paper develops a new mathematical framework for group-equivariant operators in machine learning.
problem Developing a robust mathematical framework for group-equivariant operators in machine learning.
method The paper introduces group-equivariant non-expansive operators (GENEOs) and studies their topological and metric properties.
result The space of GENEOs is compact and convex, providing fundamental guarantees for machine learning.
L-CNNs preserve gauge symmetry in neural networks.
problem Applying machine learning to lattice gauge theory while preserving gauge symmetry.
method L-CNNs use gauge equivariance to construct a gauge equivariant convolutional layer and bilinear layer.
result L-CNNs achieve higher accuracy in non-linear regression tasks compared to non-equivariant CNNs.
Equivariant CNNs improve RL performance in symmetric environments.
problem Learning equivariant representations for RL in symmetric environments.
method Proposed and studied equivariant CNNs for RL.
result Equivariant CNNs enhance RL performance and sample efficiency.
Method learns equivariances from data without custom architecture design.
problem Learning equivariances for tasks without manually designed architectures.
method Reparameterization to learn equivariant parameter sharing.
result Can learn equivariances for any finite group of transformations.
Rotation-equivariant CNN reveals common features in V1 neurons.
problem V1 models fail to predict natural stimuli responses accurately.
method Rotation-equivariant convolutional neural network model.
result Rotation-equivariant network outperforms regular CNN and reveals common features.
New homological results for bordered Floer algebras derived from hypertoric categories.
problem Homological properties of bordered Floer algebras.
method Affine quasi hereditary property of equivariant hypertoric convolution algebras and computation of Ext groups.
result Existence of standard modules and isomorphism of Ext groups to bordered strands dg algebras.
The paper generalizes equivariant neural networks on homogeneous spaces to the non-linear setting.
problem Equivariant neural networks on homogeneous spaces.
method Deriving generalized steerability constraints for non-linear equivariant layers.
result The universality of the derived construction for non-linear equivariant layers.
Translationally equivariant neural networks improve performance and generalization in physics problems.
problem Performance and generalization issues in machine learning applied to physics problems.
method Investigation of translationally equivariant convolutional neural networks for complex scalar field theory on a 2D lattice.
result Translationally equivariant neural networks significantly outperform non-equivariant architectures in various regression and classification tasks.
Rotationally equivariant convolutions improve molecular property prediction.
problem Predicting molecular properties using graph neural networks.
method Ablation study with rotationally equivariant and invariant convolutions on QM9 data set.
result Rotationally equivariant layers decrease test error by an average of 23%.
Scale-equivariant CNNs handle scale changes for improved performance.
problem Translation equivariance is not sufficient for handling scale changes in CNNs.
method Developed scale-equivariant convolutional networks with steerable filters.
result Demonstrated state-of-the-art results on MNIST-scale and STL-10 datasets.