Enhances 2D face recognition with 3D features using active illumination.
problem Improving robustness of 2D face recognition to spoofing attacks and low-light conditions.
method Projecting a high spatial frequency pattern onto the face to recover 3D information and a 2D image simultaneously.
result Significantly boosts face recognition performance and dramatically improves robustness to spoofing attacks.
Instantiation-Net reconstructs 3D mesh from single 2D image for right ventricle.
problem Reconstructing 3D shape from limited 2D images for surgical navigation.
method Combines DCNN for feature extraction and GCN for mesh reconstruction.
result Demonstrates practical strength and potential clinical use.
BCAE-2D compresses 3D data from a time projection chamber at high speed.
problem Compressing high-speed, sparse 3D data from a time projection chamber.
method 2D Bicephalous Convolutional Autoencoder (BCAE-2D) approach.
result 3x speedup in compression throughput with improved reconstruction accuracy.
3D ConvNets improved with Project & Excite for medical imaging segmentation.
problem Improving segmentation performance in 3D medical imaging.
method Proposed Project & Excite (PE) modules for 3D F-CNNs, extending 2D recalibration methods.
result Project & Excite modules boost segmentation performance up to 0.3 in Dice Score.
A new 2.5D U-net for 3D segmentation reduces memory constraints.
problem Large storage requirements for 3D convolutions in neural networks.
method Transform volumetric data into sequences of 2D images, apply 2D convolutions, and reconstruct.
result Outperforms existing methods in volumetric segmentation tasks.
Flexible pipeline for 3D vehicle detection from 2D images.
problem Current methods lack 3D perception of vehicles and other objects.
method Adopt any 2D detection network, fuse with 3D point cloud, develop model fitting algorithm, refine with CNN.
result 3D detection results rank second among algorithms, demonstrating competencies.
Proposes a model to generate 3D-aware images from 2D images.
problem Generating 3D-aware images from 2D images.
method Likelihood-based top-down model using Neural Radiance Fields and energy-based latent variables.
result Model can infer 3D object structures from 2D images and generate novel views.
Paper classifies brain signals using eigenvalues for 2D and 3D educational content questions.
problem Classifying brain signals for 2D and 3D educational content questions.
method Eigenvalues of covariance matrix used as features; KNN and SVM classifiers applied.
result No significant difference in learning, memory retention, and recall between 2D and 3D educational content.
New method reconstructs 3D shapes from 2D images using Kendall's shape space.
problem Reconstruct 3D shapes from 2D images, especially for rare specimens.
method Kendall's shape space approach with prior information.
result More robust and plausible shapes compared to previous methods.
Optimizes master faces for 2D and 3D face verification using evolutionary algorithms and neural networks.
problem Impersonation attacks using master faces for face-based identity authentication.
method Evolutionary algorithm in latent space of StyleGAN, neural network to direct search, 2D and 3D face reconstruction.
result Obtains high impersonation rates with fewer master faces for 2D and 3D face verification.
Paper extends 2D ZSAD to 3D MRI without training, achieving robust anomaly detection.
problem Challenges in extending zero-shot anomaly detection to 3D medical images.
method Constructs localized volumetric tokens by aggregating 2D slices processed by 2D foundation models.
result Training-free, batch-based ZSAD effectively extends from 2D encoders to full 3D MRI volumes.
Algorithms compute the topology of hyperelliptic curves in 2D and 3D.
problem Computing the topology of hyperelliptic curves in higher dimensions.
method Birational mapping of the plane or space to compute the topology of the curve.
result Algorithms implemented in { t Maple} for computing the topology of hyperelliptic curves.
Transformer-M learns molecular data in 2D or 3D formats.
problem Learning models for molecules are limited to specific data formats.
method Developed a Transformer-based model that can handle 2D and 3D molecular data.
result Transformer-M achieves strong performance on both 2D and 3D molecular tasks.
DISPR uses diffusion models to predict 3D cell shapes from 2D images.
problem Predicting 3D cell shapes from 2D microscopy images.
method Diffusion model trained to predict 3D shapes from 2D microscopy images as a prior.
result Adding DISPR predictions to minority cell classes improves classification accuracy.
DreamFusion uses text-to-image diffusion models to create 3D images efficiently.
problem Lack of large-scale 3D datasets and efficient architectures for 3D synthesis.
method Adapting a 2D diffusion model to 3D synthesis using a loss based on probability density distillation.
result A 3D model can be optimized from a 2D diffusion model, allowing for text-to-3D synthesis.
A key goal of computer vision is to recover the underlying 3D structure from 2D observations of the world. In this paper we learn strong deep generative models of 3D structures, and recover these structures from 3D and 2D images via probabilistic inference. We demonstrate high-quality samples and report log-likelihoods…
Study evaluates using multiple slices as input for CNNs in medical image segmentation.
problem Improving segmentation performance in medical images with limited computational resources.
method Compared pseudo-3D and 2D approaches using different CNN architectures and datasets.
result Multi-slice inputs did not significantly improve segmentation performance over 2D or 3D CNNs.
Within the Solvency II framework the insurance industry requires a realistic modelling of the risk processes relevant for its business. Every insurance company should be capable of running a holistic risk management process to meet this challenge. For property and casualty (P&C) insurance companies the risk adequate mo…
We propose a method to generate multiple diverse and valid human pose hypotheses in 3D all consistent with the 2D detection of joints in a monocular RGB image. We use a novel generative model uniform (unbiased) in the space of anatomically plausible 3D poses. Our model is compositional (produces a pose by combining par…
Overview of methods for rotating 2D and 3D data.
problem Processing data with equivariance/invariance under rotations.
method An overview of methods for 2D and 3D rotations.
result Identification of commonalities and links between methods.
BPI models 2D patterns on multiple planes and 3D scene from a single image.
problem Understanding and editing images with multiple 2D planes and 3D scene from a single image.
method Box Program Induction (BPI) with neural networks and search-based algorithm.
result Holistic, structured scene representation enables 3D-aware image editing.
New lattice stick knot condition identified.
problem Determining if 2D lattice knots project to 3D lattice sticks.
method Provided a necessary and sufficient condition.
result Identified a condition for 2D lattice knots to project to 3D lattice sticks.
Paper develops a differentiable approach for 3D imaging models using Fourier slice theorem.
problem Uncertainty in 3D structure modeling and pose estimation in scientific imaging.
method Differentiable probabilistic models in Fourier space with backpropagation through projection.
result Validates approach on 3D protein reconstruction and extends to probabilistic models.
2D tissue model predicts neurotoxicity more accurately and robustly.
problem Fast and accurate prediction of developmental neurotoxicity.
method Machine learning on 2D bio-engineered tissue models.
result 2D model outperforms 3D model in accuracy and robustness.
Research evaluates adversarial attacks and defenses on 3D point cloud classifiers.
problem Robustness of 3D object classifiers against adversarial attacks.
method Extending 2D adversarial attacks to 3D point clouds and proposing new defenses.
result 3D point cloud classifiers are weak to adversarial attacks but more defensible.
This paper improves 3D pose recovery from 2D images using non-convex regularization.
problem 3D object pose recovery from 2D images.
method Proposes non-convex regularization with leaky capped ℓ1-norm (LCNR) and multi-stage optimization.
result Theoretical analysis shows estimation error decreases with optimization stages.
Proposes a method to improve skull stripping accuracy in MRI images.
problem Skull stripping accuracy in MRI images is improved.
method Context-encoding method to empower 2D networks with 3D semantic information.
result Achieves superior accuracy (dice score 99.6% on NFBS, 99.09% on LPBA40, 99.17% on OASIS) compared to state-of-the-art methods.
We describe rules for building 2d theories labeled by 4-manifolds. Using the proposed dictionary between building blocks of 4-manifolds and 2d N=(0,2) theories, we obtain a number of results, which include new 3d N=2 theories T[M_3] associated with rational homology spheres and new results for Vafa-Witten partition fun…
Light-based attacks can misclassify images without altering physical objects.
problem Physical attacks on deep learning classifiers are limited by the ability to modify inputs directly.
method Constructs an experimental setup with a light projection source, object, and camera. Uses differential evolution to select light patterns.
result Projected light can degrade classification accuracy from 98% to 22% for 2D objects and from 89% to 43% for 3D objects.
The paper uses facial keypoints to estimate post-surgical pain intensity.
problem Accurately assessing pain levels from self-reported ratings is challenging.
method The approach analyzes 2D and 3D facial keypoints to estimate pain intensity.
result The pain estimation model uses multiple instance learning.
This work generates synthetic 3D thermal facial data using 2D facial data and deep learning.
problem Creating large datasets for deep learning in computer vision.
method 3D facial modelling techniques and deep learning methodologies.
result Synthetic 3D thermal facial data created for deep learning applications.
Improved 2D cardiac MRI with less data using deep learning.
problem Reducing artefacts in undersampled 2D radial cine MRI.
method Modified U-net trained on spatio-temporal slices.
result Outperforms existing methods in image quality and training efficiency.
DFKI Cabin Simulator tests visual monitoring functions in vehicles.
problem Validating novel human-vehicle interfaces and driver assistance systems.
method Driving simulator with in-cabin mock-up and camera system.
result Validation of in-cabin monitoring functions for advanced driver assistance and automated driving.
StyleNeRF generates high-resolution images with 3D consistency and style control.
problem Generating high-resolution images with fine details and 3D consistency.
method Integrates NeRF into a style-based generator for efficient high-resolution image synthesis.
result Synthesizes high-resolution images at interactive rates with high 3D consistency and style control.
Deep learning improves 3D reconstruction from sparse X-ray views.
problem Sparse view CT reconstruction produces severe streaking artifacts.
method Proposes a deep learning architecture for 3D reconstruction from 9 views.
result Superior reconstruction performance confirmed with real data.
Study bends 2D surfaces in 3D space using special equations.
problem Investigate infinitesimal bendings of 2D surfaces in 3D space.
method Use Bers-Vekua type equations and systems of differential equations with periodic coefficients.
result Construct bending fields for specific classes of 2D surfaces.
3D adversarial logos can fool object detectors in real-world settings.
problem Creating robust adversarial attacks in 3D rendering views.
method Constructing 3D adversarial logos via texture mapping and differentiable rendering.
result 3D adversarial logos are more versatile and robust than traditional adversarial patches.
Spherical CNNs tackle 3D data analysis, especially spherical images.
problem Learning problems involving spherical images, like omnidirectional vision and molecular regression.
method Defined spherical cross-correlation, developed a generalized FFT for efficient computation.
result Demonstrated spherical CNNs' effectiveness in 3D model recognition and atomization energy regression.
Generates coherent 3D scenes from monocular videos without supervision.
problem Lack of 3D scene modeling in video generation models.
method Trains a model to generate 3D scenes with moving objects and a background from monocular videos.
result Trained model generates coherent 3D scenes with multiple moving objects and a background.
Paper connects 3D gravity averages to 2D CFT correlators.
problem Understanding 3D gravity partition functions.
method 3D topological field theories and mapping class group averages.
result Established a correspondence between 3D gravity averages and 2D CFT correlators.
Topology-enhanced loss improves 3D object reconstruction from 2D images.
problem Challenges in reconstructing 3D objects from 2D images, especially capturing shape information.
method Integrates multi-scale topological features into the reconstruction loss using cubical complexes and optimal transport distance.
result Topology-aware loss substantially improves 3D reconstruction quality.
New method reconstructs 3D protein structures from cryo-EM images.
problem Reconstructing continuous protein structures from noisy cryo-EM projections.
method Neural network-based approach that models structural heterogeneity in Fourier space.
result Demonstrated successful ab initio reconstruction of 3D protein complexes.
Deep-learning method estimates bone 3D structure from X-ray images.
problem Estimating bone 3D structure from X-ray images.
method Triplet loss-trained neural network selecting closest 3D bone shape from predefined set.
result Average RMS distance of 1.08 mm between predicted and true shapes.
Generative model calibrates 3D battery cathode morphologies from 2D images.
problem Calibrate 3D morphologies of all-solid-state battery cathodes from 2D microscopy images.
method Combining GANs with excursion sets of Gaussian random fields.
result Calibrated digital twins enable systematic exploration of morphological scenarios.
Trans-Unet predicts brain folding patterns from 3D point-clouds using novel 3D-to-2D transformation.
problem Challenges in learning high-fidelity 3D point-cloud features, including permutation invariance and fine-grained surface reconstruction.
method Transform 3D point-clouds into a 2D grid domain, then use a U-shaped hybrid model with CNNs and self-attention mechanisms.
result Trans-Unet achieves high-resolution predictions of brain patch growth, surpassing existing methods in fidelity and accuracy.
Paper uses VAEs and GANs to estimate cryo-EM image orientation and camera parameters.
problem Estimating orientation and camera parameters from noisy cryo-EM images.
method Combines VAEs and GANs to learn latent representation, then designs estimation method.
result Geometric approach for fast cryo-EM biomolecule reconstruction.
The paper explores squircles and their 3D applications.
problem None explicitly stated; focuses on squircle equations and 3D surfaces.
method Examined and discussed squircle equations, then developed 3D surfaces based on these shapes.
result Developed 3D surfaces based on squircle equations.
2d dualities linked to 4-simplex triangulation.
problem Exploring dualities between 2d and 3d theories via 4-manifold geometry.
method Using Pachner moves and supersymmetric half-indices.
result Identified IR dualities and abelian dualities.