Understanding the three-dimensional (3D) structure of the genome is essential for elucidating vital biological processes and their links to human disease. To determine how the genome folds within the nucleus, chromosome conformation capture methods such as HiC have recently been employed. However, computational methods…
GIBLy adds geometric priors to 3D segmentation models, improving performance with minimal overhead.
problem Lack of explicit geometric information in 3D semantic segmentation models.
method Introduces GIBLy, a lightweight geometric inductive bias layer that integrates learnable geometric priors into existing 3D segmentation pipelines.
result Consistent performance gains across multiple benchmarks, including up to +11.5% mIoU on TS40K with PTV3.
3D object classification and segmentation using deep neural networks has been extremely successful. As the problem of identifying 3D objects has many safety-critical applications, the neural networks have to be robust against adversarial changes to the input data set. There is a growing body of research on generating h…
New benchmarks for RNA 3D structure-function modeling.
problem Lack of standardized benchmarks for RNA deep learning.
method Developed seven benchmark datasets, provided tools for data handling, and offered a user-friendly environment for model comparison.
result Demonstrated utility with baseline results using a relational graph neural network.
The paper proposes methods for volumetric parameterization of 3D solid manifolds.
problem Complex structure of solid manifolds makes conventional approaches ineffective.
method Incorporates models to preserve geometric structure, achieve density equalization, and balance distortions.
result Various 3D manifold parameterizations with different properties can be achieved.
3D object recognition accuracy can be improved by learning the multi-scale spatial features from 3D spatial geometric representations of objects such as point clouds, 3D models, surfaces, and RGB-D data. Current deep learning approaches learn such features either using structured data representations (voxel grids and o…
LatticeNet segments 3D point clouds faster and more efficiently.
problem Challenges in applying CNNs to 3D point cloud data.
method Embeds point cloud geometry into a permutohedral lattice for fast convolutions.
result Achieves state-of-the-art performance in 3D segmentation.
Noise2Filter improves 3D tomography reconstruction efficiency and accuracy.
problem Efficiently reconstructing 3D tomographic images in real-time with limited data.
method Self-supervised learning and a learned filter method.
result Noise2Filter achieves real-time reconstruction with limited loss of accuracy.
Mapper-GIN simplifies 3D point cloud classification with lightweight structure.
problem Robust 3D point cloud classification under corruption.
method Mapper algorithm for structural decomposition, GIN for graph classification.
result Mapper-GIN achieves competitive accuracy with minimal parameters.
A key goal of computer vision is to recover the underlying 3D structure from 2D observations of the world. In this paper we learn strong deep generative models of 3D structures, and recover these structures from 3D and 2D images via probabilistic inference. We demonstrate high-quality samples and report log-likelihoods…
Improved 3D generative models for drug design reduce bias and enhance data efficiency.
problem Data sparsity and bias in 3D molecular design models.
method Multi-level contrastive learning protocol for bias control and data efficiency.
result Hierarchical generative models that are topologically unbiased and explainable.
Transformer-M learns molecular data in 2D or 3D formats.
problem Learning models for molecules are limited to specific data formats.
method Developed a Transformer-based model that can handle 2D and 3D molecular data.
result Transformer-M achieves strong performance on both 2D and 3D molecular tasks.
Scientific imaging techniques such as optical and electron microscopy and computed tomography (CT) scanning are used to study the 3D structure of an object through 2D observations. These observations are related to the original 3D object through orthogonal integral projections. For common 3D reconstruction algorithms, …
A new 2.5D U-net for 3D segmentation reduces memory constraints.
problem Large storage requirements for 3D convolutions in neural networks.
method Transform volumetric data into sequences of 2D images, apply 2D convolutions, and reconstruct.
result Outperforms existing methods in volumetric segmentation tasks.
This work generates synthetic 3D thermal facial data using 2D facial data and deep learning.
problem Creating large datasets for deep learning in computer vision.
method 3D facial modelling techniques and deep learning methodologies.
result Synthetic 3D thermal facial data created for deep learning applications.
New 3D protein analysis methods improve accuracy.
problem Lack of suitable learning algorithms for protein data.
method Intrinsic-Extrinsic Convolution and Pooling for 3D protein structures.
result Outperforms state-of-the-art methods on protein analysis tasks.
NeRF-VAE generates 3D scenes with geometric structure from few images.
problem Generating 3D scenes from few images with geometric consistency.
method Combines NeRF and VAE, incorporating shared geometric structure.
result NeRF-VAE can infer and render geometrically-consistent scenes from unseen environments.
The paper classifies isometries on specific Lie groups.
problem Classifying isometries on nonnilpotent, solvable 3D Lie groups.
method Proving automorphisms are the only isometries for rank two Almost-Riemannian Structures.
result A classification result for rank two ARSs on nonnilpotent, solvable 3D Lie groups.
Predicting RNA base distances using a large language model.
problem Accurately predicting RNA structural information, especially distance maps.
method Using a large pretrained RNA language model coupled with a transformer.
result The model can accurately infer RNA base distances from sequence data.
A GMM-based method generates new 3D structures from medical images.
problem Generating new medical images from limited data and different modalities.
method Gaussian Mixture Model (GMM) for point-cloud generation.
result Generated point-clouds closely match training samples from the same class.
Graph convolutional neural networks (Graph-CNNs) extend traditional CNNs to handle data that is supported on a graph. Major challenges when working with data on graphs are that the support set (the vertices of the graph) do not typically have a natural ordering, and in general, the topology of the graph is not regular …
Study of 3d-3d correspondence involving q-Weyl algebra and 3d-index.
problem Understanding the action of a q-Weyl algebra on the 3d-index of knots. method Investigation of the q-Weyl algebra's module action on the 3d-index, conjecturing structural properties. result Bilinear factorization, pair of linear q-difference equations, and rational function matrix for the 3d-index determination. We present a convolutional network that is equivariant to rigid body motions. The model uses scalar-, vector-, and tensor fields over 3D Euclidean space to represent data, and equivariant convolutions to map between such representations. These SE(3)-equivariant convolutions utilize kernels which are parameterized as a …
Early diagnosis, playing an important role in preventing progress and treating the Alzheimer\{'}s disease (AD), is based on classification of features extracted from brain images. The features have to accurately capture main AD-related variations of anatomical brain structures, such as, e.g., ventricles size, hippocamp…
Early diagnosis, playing an important role in preventing progress and treating the Alzheimer's disease (AD), is based on classification of features extracted from brain images. The features have to accurately capture main AD-related variations of anatomical brain structures, such as, e.g., ventricles size, hippocampus …
The 3D index of Dimofte-Gaiotto-Gukov a partially defined function on the set of ideal triangulations of 3-manifolds with r torii boundary components. For a fixed 2r tuple of integers, the index takes values in the set of q-series with integer coefficients. Our goal is to give an axiomatic definition of the tetra…
Machine learning methods have shown promise in predicting molecular properties, and given sufficient training data machine learning approaches can enable rapid high-throughput virtual screening of large libraries of compounds. Graph-based neural network architectures have emerged in recent years as the most successful …
Efficiently learns 3D convolutions with less data.
problem High parameter and data costs in 3D convolutions.
method Temporal factorization of 3D kernels.
result Significantly reduces training data requirement and parameter count.
Generative neural network designs novel 3D molecules with specified properties.
problem Designing molecules with desired properties in chemistry.
method Conditional generative neural network for 3D molecular structures.
result Demonstrated utility in generating novel molecules with specified motifs or composition.
VecMol generates 3D molecules as continuous vector fields, overcoming modality and geometry constraints.
problem Challenges in generating 3D molecules, especially in drug discovery and materials science.
method VecMol reimagines molecular representation by modeling 3D molecules as continuous vector fields over Euclidean space, parameterized by a neural field and generated using a latent diffusion model.
result Vector-field-based representations show promise for 3D molecular generation, validated on benchmarks.
The success of various applications including robotics, digital content creation, and visualization demand a structured and abstract representation of the 3D world from limited sensor data. Inspired by the nature of human perception of 3D shapes as a collection of simple parts, we explore such an abstract shape represe…
3D models vulnerable to adversarial attacks, new method improves success rate and naturalness.
problem Vulnerability of 3D deep learning models to adversarial examples in the physical world.
method ε-isometric (ε-ISO) attack considering geometric properties and invariance to physical transformations. result Significantly improved attack success rate and naturalness of 3D adversarial examples.
Advanced 3D metrology technologies such as Coordinate Measuring Machine (CMM) and laser 3D scanners have facilitated the collection of massive point cloud data, beneficial for process monitoring, control and optimization. However, due to their high dimensionality and structure complexity, modeling and analysis of point…
Generative model calibrates 3D battery cathode morphologies from 2D images.
problem Calibrate 3D morphologies of all-solid-state battery cathodes from 2D microscopy images.
method Combining GANs with excursion sets of Gaussian random fields.
result Calibrated digital twins enable systematic exploration of morphological scenarios.
In this paper we study the small time asymptotics for the heat kernel on a sub-Riemannian manifold, using a perturbative approach. We then explicitly compute, in the case of a 3D contact structure, the first two coefficients of the small time asymptotics expansion of the heat kernel on the diagonal, expressing them in …
GCDM generates valid large 3D molecules and optimizes existing molecules.
problem Lack of geometric properties in 3D molecule generation models.
method Introduces Geometry-Complete Diffusion Model (GCDM) using equivariant GNNs.
result Significantly outperforms existing models in 3D molecule generation and optimization.
Study evaluates using multiple slices as input for CNNs in medical image segmentation.
problem Improving segmentation performance in medical images with limited computational resources.
method Compared pseudo-3D and 2D approaches using different CNN architectures and datasets.
result Multi-slice inputs did not significantly improve segmentation performance over 2D or 3D CNNs.
We introduce a variational approach to learning and inference of temporally hierarchical structure and representation for sequential data. We propose the Variational Temporal Abstraction (VTA), a hierarchical recurrent state space model that can infer the latent temporal structure and thus perform the stochastic state …
The paper studies decay near singularities of 3d Yang-Mills-Higgs fields.
problem Understanding isolated singularities of 3d Yang-Mills-Higgs fields.
method Derives decay estimates and applies removable singularity theorems.
result Generalizes removable singularity theorems for 3d Yang-Mills-Higgs fields.
PointTriNet generates 3D triangulations from point clouds efficiently and scalably.
problem Generating a triangulation among a set of points in 3D space.
method Iteratively applies a classification network and a proposal network over nearby points and triangles, using a novel triangle-relative input encoding.
result Generates robust and scalable triangulations for 3D learning pipelines.
A novel method compares 3D point clouds using information geometry.
problem Comparing 3D point clouds in machine learning applications.
method Interprets point clouds as probability density functions on a statistical manifold, using GMM and Modified Symmetric KL divergence.
result Demonstrates effectiveness through various case studies.
Agent learns to navigate uncertain 3D maps using a hybrid planner.
problem Planning in 3D environments with uncertain topological maps.
method Hierarchical strategy combining graph planner and local policy, data-driven learning with neural network.
result Machine learning can overcome missing information in probabilistic topological maps.
BPI models 2D patterns on multiple planes and 3D scene from a single image.
problem Understanding and editing images with multiple 2D planes and 3D scene from a single image.
method Box Program Induction (BPI) with neural networks and search-based algorithm.
result Holistic, structured scene representation enables 3D-aware image editing.
GTA improves transformer-based NVS models by encoding geometric structure.
problem Suboptimal positional encoding for 3D vision tasks.
method Geometry-aware attention mechanism encoding geometric structure of tokens.
result GTA improves learning efficiency and performance of NVS models.
Classifies 3D manifolds with specific structures and automorphisms.
problem Classifying compact 3D manifolds with path structures and large automorphism groups.
method Uses Cartan connections and constant curvature analysis.
result Curvature of Cartan connections is constant for these manifolds.
We rephrase the problem of 3D reconstruction from images in terms of intersections of projections of orbits of custom built Lie groups actions. We then use an algorithmic method based on moving frames "a la Fels-Olver" to obtain a fundamental set of invariants of these groups actions. The invariants are used to define …
Deep-learning method estimates bone 3D structure from X-ray images.
problem Estimating bone 3D structure from X-ray images.
method Triplet loss-trained neural network selecting closest 3D bone shape from predefined set.
result Average RMS distance of 1.08 mm between predicted and true shapes.
DreamFusion uses text-to-image diffusion models to create 3D images efficiently.
problem Lack of large-scale 3D datasets and efficient architectures for 3D synthesis.
method Adapting a 2D diffusion model to 3D synthesis using a loss based on probability density distillation.
result A 3D model can be optimized from a 2D diffusion model, allowing for text-to-3D synthesis.