Noise2Filter improves 3D tomography reconstruction efficiency and accuracy.
problem Efficiently reconstructing 3D tomographic images in real-time with limited data.
method Self-supervised learning and a learned filter method.
result Noise2Filter achieves real-time reconstruction with limited loss of accuracy.
3D shape instantiation which reconstructs the 3D shape of a target from limited 2D images or projections is an emerging technique for surgical intervention. It improves the currently less-informative and insufficient 2D navigation schemes for robot-assisted Minimally Invasive Surgery (MIS) to 3D navigation. Previously,…
Topology-enhanced loss improves 3D object reconstruction from 2D images.
problem Challenges in reconstructing 3D objects from 2D images, especially capturing shape information.
method Integrates multi-scale topological features into the reconstruction loss using cubical complexes and optimal transport distance.
result Topology-aware loss substantially improves 3D reconstruction quality.
Recent work on single-view 3D reconstruction shows impressive results, but has been restricted to a few fixed categories where extensive training data is available. The problem of generalizing these models to new classes with limited training data is largely open. To address this problem, we present a new model archite…
For homeland and transportation security applications, 2D X-ray explosive detection system (EDS) have been widely used, but they have limitations in recognizing 3D shape of the hidden objects. Among various types of 3D computed tomography (CT) systems to address this issue, this paper is interested in a stationary CT u…
DISPR uses diffusion models to predict 3D cell shapes from 2D images.
problem Predicting 3D cell shapes from 2D microscopy images.
method Diffusion model trained to predict 3D shapes from 2D microscopy images as a prior.
result Adding DISPR predictions to minority cell classes improves classification accuracy.
New method reconstructs 3D shapes from 2D images using Kendall's shape space.
problem Reconstruct 3D shapes from 2D images, especially for rare specimens.
method Kendall's shape space approach with prior information.
result More robust and plausible shapes compared to previous methods.
Scientific imaging techniques such as optical and electron microscopy and computed tomography (CT) scanning are used to study the 3D structure of an object through 2D observations. These observations are related to the original 3D object through orthogonal integral projections. For common 3D reconstruction algorithms, …
A ML-based method reconstructs 3D organ doses from 2D radiographs for pediatric abdominal radiotherapy.
problem Reconstructing detailed 3D dose distributions for childhood cancer survivors using limited 2D radiographs.
method Surrogate-free ML approach using 142 abdominal planning CTs, 300 artificial plans, and evolutionary algorithm.
result Accurate 3D dose reconstructions with MAEs ≤ 1.7 Gy for edge organs, validated on independent dataset.
Pix2Shape learns 3D scene representations from single images without supervision.
problem Learning 3D scene information from a single image without supervision.
method Pix2Shape uses an encoder, decoder, and critic network to generate 2.5D surfel-based reconstructions.
result Pix2Shape can generate complex 3D scenes from a single image, scaling with on-screen resolution.
Regularizes 3D inverse scattering with tangent-point energy for better solutions.
problem Ill-conditioned inverse obstacle scattering problems in 3D.
method Tikhonov regularization using tangent-point energy to penalize surface roughness and ensure well-posedness.
result Regularized solutions converge to true solution as noise level decreases.
3D dust map of the Milky Way improves resolution and accuracy.
problem Reconstructing the 3D dust distribution in the Milky Way.
method Gaussian process regression on spherical coordinates with iterative grid refinement.
result Improved 3D dust map with increased resolution and accuracy.
Single-particle electron cryomicroscopy is an essential tool for high-resolution 3D reconstruction of proteins and other biological macromolecules. An important challenge in cryo-EM is the reconstruction of non-rigid molecules with parts that move and deform. Traditional reconstruction methods fail in these cases, resu…
The reconstruction of an object's shape or surface from a set of 3D points plays an important role in medical image analysis, e.g. in anatomy reconstruction from tomographic measurements or in the process of aligning intra-operative navigation and preoperative planning data. In such scenarios, one usually has to deal w…
Optimizes master faces for 2D and 3D face verification using evolutionary algorithms and neural networks.
problem Impersonation attacks using master faces for face-based identity authentication.
method Evolutionary algorithm in latent space of StyleGAN, neural network to direct search, 2D and 3D face reconstruction.
result Obtains high impersonation rates with fewer master faces for 2D and 3D face verification.
Bayesian framework optimizes 3D view selection for specific tasks.
problem Optimizing 3D view selection for specific tasks in reconstruction.
method Bayesian decision theory, prior and posterior distributions, stochastic surface reconstruction.
result Framework achieves superior performance with fewer views.
RADAR uses diffusion models to detect anomalies without reconstruction, improving accuracy and efficiency.
problem Challenges in anomaly detection and segmentation, especially in real-time applications.
method RADAR uses attention-based diffusion models to directly produce anomaly maps from the diffusion process, bypassing reconstruction.
result RADAR improves F1 score by 7% on MVTec-AD and 13% on 3D-printed material compared to state-of-the-art methods.
Magnetic particle imaging (MPI) data is commonly reconstructed using a system matrix acquired in a time-consuming calibration measurement. The calibration approach has the important advantage over model-based reconstruction that it takes the complex particle physics as well as system imperfections into account. This be…
We introduce a novel approach for predicting the progression of adolescent idiopathic scoliosis from 3D spine models reconstructed from biplanar X-ray images. Recent progress in machine learning have allowed to improve classification and prognosis rates, but lack a probabilistic framework to measure uncertainty in the …
PolyGen models 3D meshes directly, predicting vertices and faces sequentially.
problem Efficiently modeling 3D geometry for computer graphics, robotics, and games.
method Transformer-based autoregressive model for predicting mesh vertices and faces.
result PolyGen produces high-quality, usable 3D meshes and competitive conditional performance.
New condition for reconstructing Morse functions on 3D manifolds.
problem Reconstructing Morse functions with specific level sets.
method Studied a necessary and sufficient condition for reconstruction.
result New condition strengthens previous sufficient conditions.
We solve 6-DoF localisation and 3D reconstruction using deep state-space models.
problem 6-DoF localisation and dense 3D reconstruction in spatial environments.
method Approximate Bayesian inference in a deep state-space model combining learning and domain knowledge.
result Near state-of-the-art performance on UAV flight data.
Cryo-electron microscopy (cryo-EM) is a powerful technique for determining the structure of proteins and other macromolecular complexes at near-atomic resolution. In single particle cryo-EM, the central problem is to reconstruct the three-dimensional structure of a macromolecule from 104−7 noisy and randomly orien…
LION generates high-quality 3D shapes using hierarchical latent diffusion models.
problem Creating high-quality 3D shapes for digital artists.
method Hierarchical Latent Point Diffusion Model (LION) with a global shape latent and point-structured latent space.
result LION achieves state-of-the-art generation performance on ShapeNet benchmarks.
Paper uses VAEs and GANs to estimate cryo-EM image orientation and camera parameters.
problem Estimating orientation and camera parameters from noisy cryo-EM images.
method Combines VAEs and GANs to learn latent representation, then designs estimation method.
result Geometric approach for fast cryo-EM biomolecule reconstruction.
The field of multiple view geometry has seen tremendous progress in reconstruction and calibration due to methods for extracting reliable point features and key developments in projective geometry. Point features, however, are not available in certain applications and result in unstructured point cloud reconstructions.…
BCAE-2D compresses 3D data from a time projection chamber at high speed.
problem Compressing high-speed, sparse 3D data from a time projection chamber.
method 2D Bicephalous Convolutional Autoencoder (BCAE-2D) approach.
result 3x speedup in compression throughput with improved reconstruction accuracy.
We rephrase the problem of 3D reconstruction from images in terms of intersections of projections of orbits of custom built Lie groups actions. We then use an algorithmic method based on moving frames "a la Fels-Olver" to obtain a fundamental set of invariants of these groups actions. The invariants are used to define …
Deep-learning method estimates bone 3D structure from X-ray images.
problem Estimating bone 3D structure from X-ray images.
method Triplet loss-trained neural network selecting closest 3D bone shape from predefined set.
result Average RMS distance of 1.08 mm between predicted and true shapes.
Researchers solve 3D cube complex boundary rigidity problem.
problem Determining the combinatorial type of a 3D CAT(0) cube complex from boundary distances.
method Discrete version of boundary rigidity problem, focusing on CAT(0) cube complexes.
result The combinatorial type of a finite CAT(0) cube complex can be reconstructed from its boundary distances.
We present a new approach to 3D object representation where a neural network encodes the geometry of an object directly into the weights and biases of a second 'mapping' network. This mapping network can be used to reconstruct an object by applying its encoded transformation to points randomly sampled from a simple geo…
The development of computed tomography (CT) image reconstruction methods that significantly reduce patient radiation exposure while maintaining high image quality is an important area of research in low-dose CT (LDCT) imaging. We propose a new penalized weighted least squares (PWLS) reconstruction method that exploits …
Generative adversarial networks reconstruct MRI images without full data.
problem Lack of fully-sampled ground truth data for supervised MRI reconstruction.
method Generative adversarial networks for unsupervised MRI reconstruction.
result Reconstructed images show more anatomical structure than conventional methods.
A method improves Cryo-EM 3D map refinement by regularizing rotation estimation.
problem Noise-robustness vs. data-consistency in Cryo-EM 3D map reconstruction.
method Ellipsoidal support lifting (ESL) for regularizing and approximating the global minimizer over Riemannian manifolds.
result The induced bias due to regularizing effect of ESL estimates better rotations than global optimisation.
Enhances 2D face recognition with 3D features using active illumination.
problem Improving robustness of 2D face recognition to spoofing attacks and low-light conditions.
method Projecting a high spatial frequency pattern onto the face to recover 3D information and a 2D image simultaneously.
result Significantly boosts face recognition performance and dramatically improves robustness to spoofing attacks.
Deep generative architectures provide a way to model not only images but also complex, 3-dimensional objects, such as point clouds. In this work, we present a novel method to obtain meaningful representations of 3D shapes that can be used for challenging tasks including 3D points generation, reconstruction, compression…
Understanding the three-dimensional (3D) structure of the genome is essential for elucidating vital biological processes and their links to human disease. To determine how the genome folds within the nucleus, chromosome conformation capture methods such as HiC have recently been employed. However, computational methods…
Proposes categorification of Z-invariants for specific 3-manifolds.
problem Categorification of Z-invariants for negative definite plumbed 3-manifolds.
method Abelian categorification using 3d N=2 theory and log VOAs.
result Nested Weyl-type character formulas reconstruct Z^-invariants. A machine learning method predicts rock permeability from 3D images.
problem Efficiently predict permeability of heterogeneous rocks for planetary and robotic applications.
method Machine learning guided 3D properties recognition of rock morphology from 3D micro CT and MRI images.
result The morphology decoder method accurately predicts permeability from 3D images.
Study reconstructs Morse-Bott functions with specific preimage conditions on 3D manifolds.
problem Reconstructing Morse-Bott functions with prescribed preimages on 3D manifolds.
method Conditions and approach based on previous work by Sharko and others.
result New result on reconstruction of nice smooth functions with specified preimages.
Extends gradient-based optimization to spline functions.
problem Limitations of standard differentiable programming methods.
method Derives Jacobian of spline functions and uses it in predictive models.
result Improved performance in various applications.
A new method monitors unstructured 3D shapes without registration.
problem Error-prone registration and mesh reconstruction steps in PCD monitoring.
method Intrinsic geometric properties of shapes, using Laplacian and geodesic distances.
result Effective monitoring of defects without registration and mesh reconstruction.
This paper introduces a new approach for the automated reconstruction - reassembly of fragmented objects having one surface near to plane, on the basis of the 3D representation of their constituent fragments. The whole process starts by 3D scanning of the available fragments. The obtained representations are properly p…
A new 2.5D U-net for 3D segmentation reduces memory constraints.
problem Large storage requirements for 3D convolutions in neural networks.
method Transform volumetric data into sequences of 2D images, apply 2D convolutions, and reconstruct.
result Outperforms existing methods in volumetric segmentation tasks.
3D dataset for intracranial aneurysms aids deep learning applications.
problem Lack of 3D medical datasets for deep learning.
method Developed an open-access 3D dataset, IntrA, for intracranial aneurysms.
result Demonstrated the challenges and performance of 3D medical datasets.
Proposes a constant memory iterative inverse model using invertible networks.
problem Memory limitations in iterative learning approaches for inverse problems.
method Invertible networks to avoid storing intermediate activations, constant memory model.
result Trains 400-layer models on 3D MRI volumes, achieving state-of-the-art image reconstruction.
Deep learning improves medical ultrasound image segmentation accuracy.
problem Improving accuracy in medical ultrasound image segmentation.
method Categorizes deep learning methods into six groups and analyzes current representative algorithms.
result Current methods show significant improvement in image segmentation accuracy.
Generative model learns to autoencode and generate sets of images.
problem Learning to represent and generate sets of images with unknown number of sets.
method Set Distribution Networks (SDNs) learn set encoder, discriminator, generator, and prior.
result SDNs can reconstruct and generate sets of images with preserved attributes.