In neural networks, it is often desirable to work with various representations of the same space. For example, 3D rotations can be represented with quaternions or Euler angles. In this paper, we advance a definition of a continuous representation, which can be helpful for training deep neural networks. We relate this t…
This paper proposes a set of rules to revise various neural networks for 3D point cloud processing to rotation-equivariant quaternion neural networks (REQNNs). We find that when a neural network uses quaternion features under certain conditions, the network feature naturally has the rotation-equivariance property. Rota…
Convolutional networks are successful due to their equivariance/invariance under translations. However, rotatable data such as images, volumes, shapes, or point clouds require processing with equivariance/invariance under rotations in cases where the rotational orientation of the coordinate system does not affect the m…
Recent years have witnessed the emergence and increasing popularity of 3D medical imaging techniques with the development of 3D sensors and technology. However, achieving geometric invariance in the processing of 3D medical images is computationally expensive but nonetheless essential due to the presence of possible er…
A method improves Cryo-EM 3D map refinement by regularizing rotation estimation.
problem Noise-robustness vs. data-consistency in Cryo-EM 3D map reconstruction.
method Ellipsoidal support lifting (ESL) for regularizing and approximating the global minimizer over Riemannian manifolds.
result The induced bias due to regularizing effect of ESL estimates better rotations than global optimisation.
We present a three-dimensional graph convolutional network (3DGCN), which predicts molecular properties and biochemical activities, based on 3D molecular graph. In the 3DGCN, graph convolution is unified with learning operations on the vector to handle the spatial information from molecular topology. The 3DGCN model ex…
3D Convolutional Neural Networks are sensitive to transformations applied to their input. This is a problem because a voxelized version of a 3D object, and its rotated clone, will look unrelated to each other after passing through to the last layer of a network. Instead, an idealized model would preserve a meaningful r…
The paper proposes a method to learn 3D object pose manifolds using GANs and elasticae.
problem Learning image manifolds of 3D objects with limited data.
method Geom-SGAN and elasticae for geometry-preserving image interpolation.
result The method outperforms state-of-the-art GANs and VAEs in learning rotation paths.
New neural network processes 3D volumes with improved equivariance.
problem Improving neural network performance on 3D volumes with symmetries.
method Equivariant neural network using moving frames approach.
result Trained model outperforms benchmarks in medical volume classification.
New method uses scalar-based models to approximate spherical tensors efficiently.
problem Efficiently approximating spherical tensors with equivariant functions.
method Expressing equivariant functions as the product of a scalar function and a small tensor basis.
result Approximations are fast, simple to implement, and accurate in practical settings.
This paper has been withdrawn by the author due to an error
SE(3)-Transformers maintain equivariance for 3D data under rotations and translations.
problem Ensuring stable and predictable performance in 3D data under transformations.
method Introducing a self-attention module that is equivariant under continuous 3D roto-translations.
result The SE(3)-Transformer outperforms non-equivariant and non-attention models on real-world datasets.
We present a 3D capsule module for processing point clouds that is equivariant to 3D rotations and translations, as well as invariant to permutations of the input points. The operator receives a sparse set of local reference frames, computed from an input point cloud and establishes end-to-end transformation equivarian…
Proposes a robust 3D classification method for sparse point clouds.
problem Invariance to rotation, positional shift, scaling, and robustness to point sparsity in point cloud classification.
method Introduces a graph-based feature learning approach with an end-to-end neural network.
result Significantly improves 3D object classification and retrieval tasks with sparse point clouds.
New dataset tests mental rotation from single images, improving model understanding of 3D scenes.
problem Understanding how a scene looks from a different viewpoint using a single image.
method Created CLEVR-MRT dataset, explored neural architectures for volumetric scene representations.
result Demonstrated the effectiveness of volumetric representations in answering mental rotation questions.
TURB-Rot provides a large database of turbulent rotating flow snapshots for research.
problem Lack of large-scale, high-resolution datasets for turbulent rotating flows.
method Direct Numerical Simulations of Navier-Stokes equations with rotation.
result Provides a diverse set of 300K complex images and fields for testing.
Study rotational surfaces with prescribed Gauss curvature in 3D space.
problem Classify and analyze rotational surfaces with prescribed Gauss curvature.
method Phase plane analysis and mild assumptions on the prescribed function.
result Existence of singular radial solutions intersecting orthogonally the axis of rotation.
Study of 3d-3d correspondence involving q-Weyl algebra and 3d-index.
problem Understanding the action of a q-Weyl algebra on the 3d-index of knots. method Investigation of the q-Weyl algebra's module action on the 3d-index, conjecturing structural properties. result Bilinear factorization, pair of linear q-difference equations, and rational function matrix for the 3d-index determination. Solves surface problem in 3D light cone.
problem Björling problem for zero mean curvature surfaces in the three-dimensional light cone.
method Solves the Björling problem for zero mean curvature surfaces in the three-dimensional light cone.
result Constructs and classifies all rotational zero mean curvature surfaces.
Geometric GNNs model 3D atomic systems with rotations and translations.
problem Modeling 3D atomic systems with geometric graphs and machine learning.
method Invariant, equivariant, and unconstrained GNN architectures.
result Geometric GNNs leverage physical symmetries and chemical properties.
Study of loxodromes on twisted surfaces in 3D space.
problem Characterizing loxodromes on surfaces with varying curvature.
method Analysis of loxodromes on twisted surfaces in Euclidean 3-space.
result Construction of examples to visualize loxodromes on twisted surfaces.
"Ends of hyperbolic 3-manifolds should support canonical Wick Rotations, so they realize effective interactions of their ending globally hyperbolic spacetimes of constant curvature." We develop a consistent sector of WR-rescaling theory in 3D gravity, that, in particular, concretizes the above guess for many geometrica…
The study characterizes loxodromes on specific rotational surfaces in 3D space.
problem Characterizing loxodromes on rotational surfaces with special geometric properties.
method Parametrizations and curvature/torsion calculations for loxodromes on various rotational surfaces.
result The loxodrome on a flat rotational surface is a general helix.
A novel deep learning architecture (XmasNet) based on convolutional neural networks was developed for the classification of prostate cancer lesions, using the 3D multiparametric MRI data provided by the PROSTATEx challenge. End-to-end training was performed for XmasNet, with data augmentation done through 3D rotation a…
This chapter introduces quaternion machine learning for 3D rotations.
problem Lack of quaternion machine learning for 3D rotations.
method Augmented statistics, widely linear models, quaternion calculus, mean square estimation.
result Foundation for quaternion machine learning.
A new method for 3D surface registration using dynamic programming.
problem Elastic shape registration of 3D surfaces.
method Optimization over a subset of reparametrizations using dynamic programming.
result Proposes an algorithm that produces a solution closer to optimal than gradient-based methods.
Study large N oscillations in 3D theories related to black hole physics.
problem Understanding large N sign oscillations in 3D theories via holography.
method Holographic computation of on-shell actions for Euclidean supergravity solutions, Wick rotation of magnetically charged AdS4 black holes.
result Proposed a non-trivial mathematical conjecture regarding phase factors of twisted Reidemeister-Ray-Singer torsion.
Discuss knots in SgimesS1, introducing rotating information and invariants.
problem Understanding knots in SgimesS1 and their invariants. method Introduce diagrams, moves, and rotating information to construct invariants.
result Construct invariants using the rotating information of knots in SgimesS1. Existing networks directly learn feature representations on 3D point clouds for shape analysis. We argue that 3D point clouds are highly redundant and hold irregular (permutation-invariant) structure, which makes it difficult to achieve inter-class discrimination efficiently. In this paper, we propose a two-faceted sol…
In this paper, a new algorithm based on differential geometry viewpoint to solve the 3D rotating Navier-Stokes equations with complex Boundary is proposed, which is called Bi-parallel algorithm. For xample, it can be applied to passage flow between two blades in impeller and circulation flow through aircrafts with comp…
We present an unsupervised approach for learning to estimate three dimensional (3D) facial structure from a single image while also predicting 3D viewpoint transformations that match a desired pose and facial geometry. We achieve this by inferring the depth of facial keypoints of an input image in an unsupervised manne…
Proves inequality for special 3D shapes, generalizing to non-symmetric ones.
problem Proving a mathematical inequality for specific 3D shapes.
method Operator theoretic approach combined with spherical function decomposition.
result Generalized inequality for non-symmetric bodies of revolution.
Graph Neural Networks model 3D granular flow simulations.
problem Accurate modeling of complex 3D granular flow processes.
method Graph Neural Networks approach to simulate 3D granular flow using LIGGGHTS.
result Machine learning trajectories match physical granular flow processes.
Study on unfolding maps of surfaces in 3D space, proving versality conditions.
problem Investigating the versality of rotation unfolding of folding maps for surfaces in R3. method Introducing and analyzing the rotation unfolding of folding maps, proving versality conditions in terms of geometry.
result Proved conditions for the rotation unfolding to be versal, showing diffeomorphic type of tangent plane locus.
Proves uniqueness of translators in 3D space.
problem Uniqueness of pitchfork and helicoid translators in mean curvature flow.
method Arc-counting argument and rotational maximum principle.
result Proves conjecture on uniqueness of translators.
New rigidity found for 3D warped product domains.
problem Finding rigidity conditions for warped product domains.
method Developed scalar curvature rigidity for a general class of domains.
result Identified domains satisfying a boundary condition analogous to logarithmic concavity.
Deep 3D models are vulnerable to isometry transformations under adversarial attacks.
problem Vulnerability of deep 3D models to isometry transformations under adversarial attacks.
method Developed a black-box attack with success rate over 95% and a novel white-box attack framework.
result Deep 3D models are extremely vulnerable to isometry transformations under adversarial attacks.
3D adversarial logos can fool object detectors in real-world settings.
problem Creating robust adversarial attacks in 3D rendering views.
method Constructing 3D adversarial logos via texture mapping and differentiable rendering.
result 3D adversarial logos are more versatile and robust than traditional adversarial patches.
Scientific imaging techniques such as optical and electron microscopy and computed tomography (CT) scanning are used to study the 3D structure of an object through 2D observations. These observations are related to the original 3D object through orthogonal integral projections. For common 3D reconstruction algorithms, …
New neural network predicts accurate protein complex structures.
problem Predicting accurate protein complex structures from atomic coordinates.
method Rotation-equivariant neural network combining point-based representation, equivariance, local convolutions, and hierarchical subsampling.
result Significant improvement in identifying accurate structural models.
We introduce SARR for symmetric object pose estimation, improving CNN performance.
problem Ambiguities in symmetric object orientations hinder deep learning pose estimation.
method Numeric rotation representation using symmetry-derived trigonometric identities.
result SARR enables standard CNNs to achieve state-of-the-art performance.
The paper classifies special surfaces in a 3D space.
problem Classifying λ-translators in S2imesR. method Investigates surfaces with specific curvature properties under group actions.
result Identifies all λ-translators invariant by rotations and vertical translations. New kernel interprets 3D anisotropic data with rotations and improved predictions.
problem Capturing rotated anisotropy in 3D spatial fields.
method Introduces a Lie-algebraic kernel with three principal length-scales and an explicit rotation.
result Posterior recovers rotated anisotropy and improves prediction over axis-aligned kernels.
The paper learns pose variations within shape populations using constrained mixtures of factor analyzers.
problem Learning pose variations within a shape population with articulated parts and relative rotations.
method Formulated as mixtures of factor analyzers, segmentation by component posterior probabilities, and constraints on factor loading matrices for rotation matrices.
result Automatic learning of pose variations from shape populations, resulting in smooth and realistic animations.
We propose a method to learn object representations from 3D point clouds using bundles of geometrically interpretable hidden units, which we call geometric capsules. Each geometric capsule represents a visual entity, such as an object or a part, and consists of two components: a pose and a feature. The pose encodes whe…
BGNNs model particle-boundary interactions efficiently.
problem Efficiently modeling geometric boundaries in 3D simulations.
method Introduce Boundary Graph Neural Networks (BGNNs) to dynamically modify graph structures.
result BGNNs accurately reproduce 3D granular flows without handcrafted conditions.
Enforcing distributions of latent variables in neural networks is an active subject. It is vital in all kinds of generative models, where we want to be able to interpolate between points in the latent space, or sample from it. Modern generative AutoEncoders (AE) like WAE, SWAE, CWAE add a regularizer to the standard (d…
Deep learning has proven to yield fast and accurate predictions of quantum-chemical properties to accelerate the discovery of novel molecules and materials. As an exhaustive exploration of the vast chemical space is still infeasible, we require generative models that guide our search towards systems with desired proper…