DreamFusion uses text-to-image diffusion models to create 3D images efficiently.
problem Lack of large-scale 3D datasets and efficient architectures for 3D synthesis.
method Adapting a 2D diffusion model to 3D synthesis using a loss based on probability density distillation.
result A 3D model can be optimized from a 2D diffusion model, allowing for text-to-3D synthesis.
Equivariant diffusion model generates 3D molecules efficiently.
problem Generating high-quality 3D molecules efficiently.
method Equivariant Diffusion Model (EDM) that operates on atom coordinates and types.
result Significantly outperforms previous methods in molecule quality and training efficiency.
GCDM generates valid large 3D molecules and optimizes existing molecules.
problem Lack of geometric properties in 3D molecule generation models.
method Introduces Geometry-Complete Diffusion Model (GCDM) using equivariant GNNs.
result Significantly outperforms existing models in 3D molecule generation and optimization.
DISPR uses diffusion models to predict 3D cell shapes from 2D images.
problem Predicting 3D cell shapes from 2D microscopy images.
method Diffusion model trained to predict 3D shapes from 2D microscopy images as a prior.
result Adding DISPR predictions to minority cell classes improves classification accuracy.
LION generates high-quality 3D shapes using hierarchical latent diffusion models.
problem Creating high-quality 3D shapes for digital artists.
method Hierarchical Latent Point Diffusion Model (LION) with a global shape latent and point-structured latent space.
result LION achieves state-of-the-art generation performance on ShapeNet benchmarks.
Non-autoregressive method speeds up protein folding prediction 23 times.
problem Generating protein sequences with higher order interactions.
method Discrete diffusion conditioned on 3D structure using ProteinMPNN.
result 23 times speed up in inference without performance loss.
CARV reduces compute cost for downstream pipelines using diffusion models.
problem High variance in Monte Carlo estimators from diffusion models limits compute efficiency.
method CARV uses hierarchical MC estimation with amortized upstream computation and stratified-inverse-CDF.
result CARV delivers 2-3x effective compute multipliers without changing the objective.
VecMol generates 3D molecules as continuous vector fields, overcoming modality and geometry constraints.
problem Challenges in generating 3D molecules, especially in drug discovery and materials science.
method VecMol reimagines molecular representation by modeling 3D molecules as continuous vector fields over Euclidean space, parameterized by a neural field and generated using a latent diffusion model.
result Vector-field-based representations show promise for 3D molecular generation, validated on benchmarks.
ED-NeRF efficiently edits 3D scenes using latent space NeRF and improved loss functions.
problem Slow training speeds and inadequate editing loss functions in existing NeRF editing techniques.
method Embedding real-world scenes into latent space of LDM, using a unique refinement layer and an improved loss function.
result ED-NeRF achieves faster editing speed and improved output quality compared to state-of-the-art models.
DreamPropeller accelerates text-to-3D generation by 4.7x with minimal loss in quality.
problem Long generation times in text-to-3D generation algorithms degrade user experience.
method DreamPropeller uses Picard iterations generalized for non-ODE paths to accelerate parallel sampling.
result Empirically achieves up to 4.7x speedup with negligible quality loss.
RaMViD uses diffusion models for video prediction and infilling.
problem Predicting and infilling missing information in videos.
method Extends image diffusion models to videos using 3D convolutions and a new conditioning technique.
result Achieves state-of-the-art results on video prediction benchmarks.
RADAR uses diffusion models to detect anomalies without reconstruction, improving accuracy and efficiency.
problem Challenges in anomaly detection and segmentation, especially in real-time applications.
method RADAR uses attention-based diffusion models to directly produce anomaly maps from the diffusion process, bypassing reconstruction.
result RADAR improves F1 score by 7% on MVTec-AD and 13% on 3D-printed material compared to state-of-the-art methods.
AbDiffuser generates full-atom antibodies with sequence and structure fidelity.
problem Generating high-fidelity antibodies with both structure and sequence information.
method Equivariant and physics-informed diffusion model with novel protein structure representation.
result AbDiffuser generates antibodies with sequence and structural properties matching a reference set.
Generates garden paintings from text descriptions using deep learning.
problem Lack of firsthand material for traditional Chinese garden reconstruction.
method Deep learning model trained on text and paintings of Ming Dynasty gardens.
result Model generates garden paintings in Ming Dynasty style based on textual descriptions.
Diffusion models mimic human actions in sequential tasks.
problem Cloning human behavior in dynamic environments is challenging.
method Adapting diffusion models to handle stochastic, multimodal, and correlated actions.
result Diffusion models closely replicate human behavior in robotic and gaming tasks.
We make posterior sampling in FWI feasible for large surveys.
problem Uncertainty-aware subsurface models at field scale.
method Coupling diffusion-based posterior sampling with simultaneous-source FWI data.
result Lower model error and better data fit at reduced computational cost.
Method optimizes diffusion model generation to meet user preferences.
problem Optimizing diffusion model generation with only black-box target scores.
method Covariance-adaptive sequential optimization algorithm for black-box optimization.
result Proves superior performance in achieving better target scores.
3D CNNs interpret brain MRI differences between men and women.
problem Interpreting 3D CNNs for voxel-wise brain MRI analysis.
method Three interpretation methods: Meaningful Perturbations, Grad CAM, and Guided Backpropagation.
result Voxel-wise 3D CNN interpretation of brain MRI data.
Tract-specific diffusion measures, as derived from brain diffusion MRI, have been linked to white matter tract structural integrity and neurodegeneration. As a consequence, there is a large interest in the automatic segmentation of white matter tract in diffusion tensor MRI data. Methods based on the tractography are p…
A new diffusion model generates novel protein backbones without relying on pretrained networks.
problem Generating novel protein backbones without relying on pretrained networks.
method Developed a SE(3) invariant diffusion model on multiple frames, called FrameDiff.
result Generated designable protein monomers up to 500 amino acids without pretrained networks.
A 3D almost-Riemannian manifold is a generalized Riemannian manifold defined locally by 3 vector fields that play the role of an orthonormal frame, but could become collinear on some set $\Zz$ called the singular set. Under the Hormander condition, a 3D almost-Riemannian structure still has a metric space structure, wh…
New model simplifies symmetry handling in generative AI.
problem Symmetry handling in generative models for scientific tasks.
method Quotient-space diffusion models, viewing symmetry as quotient space.
result Improves performance over existing methods for molecular structure generation.
Data assimilation for subsurface flow using latent diffusion models shows that ensemble Kalman methods may overestimate posterior uncertainty, while Monte Carlo sampling is more reliable.
problem Data assimilation for subsurface flow
method Ensemble Kalman smoother and Markov chain Monte Carlo sampling
result Monte Carlo sampling is more reliable than ensemble Kalman methods
A new diffusion sampling method combines Krylov subspace and diffusion models for faster and more efficient inverse problems.
problem Efficiently solving large-scale inverse problems in high-performance computing.
method Proposes a novel diffusion sampling strategy that integrates Krylov subspace methods with diffusion models.
result Demonstrates significant speedup (80x faster inference time) and improved reconstruction quality on real-world medical imaging problems.
This work extends diffusion models to function space for better generative modeling.
problem Limited applicability of diffusion models to functional data domains.
method Introduces Denoising Diffusion Operators (DDOs) for training diffusion models in function space.
result Demonstrates accurate function-valued generation at fixed cost.
GEOMANCER learns manifold factors without supervision.
problem Learning to factorize Lie group orbits from data.
method Subspace diffusion estimation of invariant subspaces.
result Unsupervised disentanglement of complex manifolds possible.
New method learns diverse protein scaffolds for motif design.
problem Designing long, diverse protein scaffolds for specific motifs.
method E(3)-equivariant graph neural network for diffusion modeling.
result First to guarantee conditional sampling from diffusion models.
Diffuse optical tomography (DOT) has been investigated as an alternative imaging modality for breast cancer detection thanks to its excellent contrast to hemoglobin oxidization level. However, due to the complicated non-linear photon scattering physics and ill-posedness, the conventional reconstruction algorithms are s…
Investigates stochastic networks on disordered lattices, converging to Brownian web in 2D.
problem Stochastic networks on disordered lattices.
method Directed spanning forests on randomly perturbed lattices.
result DSF converges to Brownian web in 2D under diffusive scaling.
DDMI generates high-quality INRs by adapting positional embeddings.
problem Existing INR generative models fail to produce high-quality representations.
method DDMI uses adaptive positional embeddings and a D2C-VAE to enhance expressive power.
result DDMI outperforms existing models across multiple modalities and datasets.
The automatic segmentation of human knee cartilage from 3D MR images is a useful yet challenging task due to the thin sheet structure of the cartilage with diffuse boundaries and inhomogeneous intensities. In this paper, we present an iterative multi-class learning method to segment the femoral, tibial and patellar car…
In this paper we provide the small-time heat kernel asymptotics at the cut locus in three relevant cases: generic low-dimensional Riemannian manifolds, generic 3D contact sub-Riemannian manifolds (close to the starting point) and generic 4D quasi-contact sub-Riemannian manifolds (close to a generic starting point). As …
We study knots in 3d Chern-Simons theory with complex gauge group SL(N,C), in the context of its relation with 3d N=2 theory (the so-called 3d-3d correspondence). The defect has either co-dimension 2 or co-dimension 4 inside the 6d (2,0) theory, which is compactified on a 3-manifold M^. …
New method uses PINNs to solve complex PDEs with sparse measurements.
problem Joint estimation of source and parameters in advection-diffusion equations with limited data.
method Weighted adaptive approach based on neural tangent kernel of PINNs.
result Successful estimation of source function, velocity, and diffusion parameters.
Study of 3d-3d correspondence involving q-Weyl algebra and 3d-index.
problem Understanding the action of a q-Weyl algebra on the 3d-index of knots. method Investigation of the q-Weyl algebra's module action on the 3d-index, conjecturing structural properties. result Bilinear factorization, pair of linear q-difference equations, and rational function matrix for the 3d-index determination. Paper proposes Sinkformers for Transformers with doubly stochastic attention.
problem Improving Transformer models' accuracy in vision and natural language processing.
method Using Sinkhorn's algorithm to make attention matrices doubly stochastic instead of SoftMax normalization.
result Sinkformers enhance model accuracy in vision and natural language processing tasks.
3D dual field theories for Virasoro minimal models constructed using Seifert fiber spaces.
problem Constructing 3D dual field theories for Virasoro minimal models.
method 3D-3D correspondence and Seifert fiber spaces.
result 3D dual field theories constructed for Virasoro minimal models.
3D flying wings created for any angle asymptotic cones.
problem Creating 3D steady gradient Ricci solitons with any angle asymptotic cones.
method Constructing 3D flying wings for any angle asymptotic cones.
result 3D flying wings constructed for any angle asymptotic cones.
Proposes a new effective central charge for 3d N=2 theories.
problem Understanding the effective central charge in 3d N=2 theories.
method Analyzes the superconformal index to propose a new quantity and discusses its properties and computation.
result Proposes a new effective central charge for 3d N=2 theories.
Autonomous driving requires 3D perception of vehicles and other objects in the in environment. Much of the current methods support 2D vehicle detection. This paper proposes a flexible pipeline to adopt any 2D detection network and fuse it with a 3D point cloud to generate 3D information with minimum changes of the 2D d…
Smooth 3D flows from non-smooth starting points.
problem Creating smooth Ricci flows from non-smooth initial conditions.
method Generalized singular Ricci flow applied to 3D complete manifolds.
result Existence of smooth Ricci flows starting from non-smooth initial conditions.
3D Axial-Attention improves lung nodule classification accuracy.
problem Limited 3D attention in existing methods.
method Proposes 3D Axial-Attention network with 3D positional encoding.
result 3D Axial-Attention achieves state-of-the-art performance.
3D steady gradient Ricci solitons are all O(2)-symmetric.
problem Characterizing 3D steady gradient Ricci solitons.
method Analyzing asymptotic behavior and using O(2) symmetry.
result All 3D steady gradient Ricci solitons are O(2)-symmetric.
3D Convolutional Neural Networks (3D-CNN) have been used for object recognition based on the voxelized shape of an object. However, interpreting the decision making process of these 3D-CNNs is still an infeasible task. In this paper, we present a unique 3D-CNN based Gradient-weighted Class Activation Mapping method (3D…
Deep generative architectures provide a way to model not only images but also complex, 3-dimensional objects, such as point clouds. In this work, we present a novel method to obtain meaningful representations of 3D shapes that can be used for challenging tasks including 3D points generation, reconstruction, compression…
Graph Neural Networks improve 3D object detection in LiDAR point clouds.
problem Challenges in processing LiDAR data due to its 3D geometry and massive volume.
method Proposes a Graph Neural Network (GNN) based framework for 3D object detection.
result GNNs successfully identify objects in 3D LiDAR point clouds.
The study connects knot complements to 3d theories via half-index calculations.
problem Understanding the relationship between knot complements and 3d theories.
method Using half-index calculations and inverted Habiro series, the study realizes knot complements as homological blocks.
result The colored Jones polynomial is derived from choosing specific poles in the half-index integral expression.
Existing networks directly learn feature representations on 3D point clouds for shape analysis. We argue that 3D point clouds are highly redundant and hold irregular (permutation-invariant) structure, which makes it difficult to achieve inter-class discrimination efficiently. In this paper, we propose a two-faceted sol…