Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

6201,2401,8592,479 · Jun 202019922001200920172026
48 results for 2D to 3D

Enhances 2D face recognition with 3D features using active illumination.

problem Improving robustness of 2D face recognition to spoofing attacks and low-light conditions.
method Projecting a high spatial frequency pattern onto the face to recover 3D information and a 2D image simultaneously.
result Significantly boosts face recognition performance and dramatically improves robustness to spoofing attacks.

Proposes a model to generate 3D-aware images from 2D images.

problem Generating 3D-aware images from 2D images.
method Likelihood-based top-down model using Neural Radiance Fields and energy-based latent variables.
result Model can infer 3D object structures from 2D images and generate novel views.

Autonomous driving requires 3D perception of vehicles and other objects in the in environment. Much of the current methods support 2D vehicle detection. This paper proposes a flexible pipeline to adopt any 2D detection network and fuse it with a 3D point cloud to generate 3D information with minimum changes of the 2D d…

2018-02-12abs ↗pdf ↗

Optimizes master faces for 2D and 3D face verification using evolutionary algorithms and neural networks.

problem Impersonation attacks using master faces for face-based identity authentication.
method Evolutionary algorithm in latent space of StyleGAN, neural network to direct search, 2D and 3D face reconstruction.
result Obtains high impersonation rates with fewer master faces for 2D and 3D face verification.

Paper extends 2D ZSAD to 3D MRI without training, achieving robust anomaly detection.

problem Challenges in extending zero-shot anomaly detection to 3D medical images.
method Constructs localized volumetric tokens by aggregating 2D slices processed by 2D foundation models.
result Training-free, batch-based ZSAD effectively extends from 2D encoders to full 3D MRI volumes.

DreamFusion uses text-to-image diffusion models to create 3D images efficiently.

problem Lack of large-scale 3D datasets and efficient architectures for 3D synthesis.
method Adapting a 2D diffusion model to 3D synthesis using a loss based on probability density distillation.
result A 3D model can be optimized from a 2D diffusion model, allowing for text-to-3D synthesis.

A key goal of computer vision is to recover the underlying 3D structure from 2D observations of the world. In this paper we learn strong deep generative models of 3D structures, and recover these structures from 3D and 2D images via probabilistic inference. We demonstrate high-quality samples and report log-likelihoods…

2016-07-03abs ↗pdf ↗

We describe rules for building 2d theories labeled by 4-manifolds. Using the proposed dictionary between building blocks of 4-manifolds and 2d N=(0,2) theories, we obtain a number of results, which include new 3d N=2 theories T[M_3] associated with rational homology spheres and new results for Vafa-Witten partition fun…

2013-06-18abs ↗pdf ↗

StyleNeRF generates high-resolution images with 3D consistency and style control.

problem Generating high-resolution images with fine details and 3D consistency.
method Integrates NeRF into a style-based generator for efficient high-resolution image synthesis.
result Synthesizes high-resolution images at interactive rates with high 3D consistency and style control.

Generates coherent 3D scenes from monocular videos without supervision.

problem Lack of 3D scene modeling in video generation models.
method Trains a model to generate 3D scenes with moving objects and a background from monocular videos.
result Trained model generates coherent 3D scenes with multiple moving objects and a background.

Topology-enhanced loss improves 3D object reconstruction from 2D images.

problem Challenges in reconstructing 3D objects from 2D images, especially capturing shape information.
method Integrates multi-scale topological features into the reconstruction loss using cubical complexes and optimal transport distance.
result Topology-aware loss substantially improves 3D reconstruction quality.

We present algorithms to compute the topology of 2D and 3D hyperelliptic curves. The algorithms are based on the fact that 2D and 3D hyperelliptic curves can be seen as the image of a planar curve (the Weierstrass form of the curve), whose topology is easy to compute, under a birational mapping of the plane or the spac…

2018-12-30abs ↗pdf ↗

Generative model calibrates 3D battery cathode morphologies from 2D images.

problem Calibrate 3D morphologies of all-solid-state battery cathodes from 2D microscopy images.
method Combining GANs with excursion sets of Gaussian random fields.
result Calibrated digital twins enable systematic exploration of morphological scenarios.

STRING improves 2D and 3D position encodings for better performance.

problem Efficient and accurate position encoding for 2D and 3D applications.
method STRING extends Rotary Position Encodings with a unifying theoretical framework, maintaining translation invariance and low computational cost.
result STRING shows substantial gains in open-vocabulary object detection and robotics.

The question we address here is of whether phenomena of collective bankruptcies are related to self-organized criticality. In order to answer it we propose a simple model of banking networks based on the random directed percolation. We study effects of one bank failure on the nucleation of contagion phase in a financia…

2001-11-30abs ↗pdf ↗

We propose that a simple, Lagrangian 2d N=(0,2)\mathcal{N}=(0, 2) duality interface between the 3d N=2\mathcal{N}=2 XYZ model and 3d N=2\mathcal{N}=2 SQED can be associated to the simplest triangulated 4-manifold: the 4-simplex. We then begin to flesh out a dictionary between more general triangulated 4-manifolds with boundar…

2019-05-13abs ↗pdf ↗

Explains a 2D color exchange invariant correspondence to 3D linking numbers.

problem Understanding color exchange invariants in 2D dynamics and their 3D geometric interpretation.
method Visualizes invariants as linking of lines on a special surface with Arf-Kervaire invariant one, and interprets it as an obstruction to continuous transformation.
result Interprets a 2D color exchange invariant as a 3D linking number, providing a topological explanation.

Convolutional networks are successful due to their equivariance/invariance under translations. However, rotatable data such as images, volumes, shapes, or point clouds require processing with equivariance/invariance under rotations in cases where the rotational orientation of the coordinate system does not affect the m…

2019-10-31abs ↗pdf ↗

Convolutional neural networks are state-of-the-art for various segmentation tasks. While for 2D images these networks are also computationally efficient, 3D convolutions have huge storage requirements and therefore, end-to-end training is limited by GPU memory and data size. To overcome this issue, we introduce a netwo…

2019-10-23abs ↗pdf ↗

Fully Convolutional Neural Networks (F-CNNs) achieve state-of-the-art performance for segmentation tasks in computer vision and medical imaging. Recently, computational blocks termed squeeze and excitation (SE) have been introduced to recalibrate F-CNN feature maps both channel- and spatial-wise, boosting segmentation …

2020-02-25abs ↗pdf ↗

Recently, multiple formulations of vision problems as probabilistic inversions of generative models based on computer graphics have been proposed. However, applications to 3D perception from natural images have focused on low-dimensional latent scenes, due to challenges in both modeling and inference. Accounting for th…

2014-07-04abs ↗pdf ↗

ED-NeRF efficiently edits 3D scenes using latent space NeRF and improved loss functions.

problem Slow training speeds and inadequate editing loss functions in existing NeRF editing techniques.
method Embedding real-world scenes into latent space of LDM, using a unique refinement layer and an improved loss function.
result ED-NeRF achieves faster editing speed and improved output quality compared to state-of-the-art models.

Improved 3D generative models for drug design reduce bias and enhance data efficiency.

problem Data sparsity and bias in 3D molecular design models.
method Multi-level contrastive learning protocol for bias control and data efficiency.
result Hierarchical generative models that are topologically unbiased and explainable.