We propose a method to generate multiple diverse and valid human pose hypotheses in 3D all consistent with the 2D detection of joints in a monocular RGB image. We use a novel generative model uniform (unbiased) in the space of anatomically plausible 3D poses. Our model is compositional (produces a pose by combining par…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,932 papers · 148 categories
Trend · papers per month
48 results for “3D Human Poses”
New framework predicts diverse, contextually plausible 3D human motions.
problem Predicting multiple plausible future 3D poses given observed poses.
method Developed a new variational framework that conditions latent variable on past observation to encourage relevant information.
result Our approach generates motions of higher quality and preserves contextual information.
Generative model creates realistic dance poses from music.
problem Generating human-like dance poses from music.
method Music feature encoder, pose generator, music genre classifier integrated.
result Generative autoregressive model synthesizes dance sequences up to 5,000 frames.
We consider the problem of learning object arrangements in a 3D scene. The key idea here is to learn how objects relate to human poses based on their affordances, ease of use and reachability. In contrast to modeling object-object relationships, modeling human-object relationships scales linearly in the number of objec…
This paper explores the capabilities of convolutional neural networks to deal with a task that is easily manageable for humans: perceiving 3D pose of a human body from varying angles. However, in our approach, we are restricted to using a monocular vision system. For this purpose, we apply a convolutional neural networ…
Tensor neural network improves human pose classification from 3D skeleton data.
problem Efficiently processing spatiotemporal data for human pose classification.
method Proposes a tensor-based neural network with three components: spatiotemporal feature construction, tensor fusion, and tensor-based neural network processing.
result Achieves state-of-the-art performance in human pose classification.
DMGNN predicts 3D human motions using adaptive multiscale graphs.
problem Predicting 3D skeleton-based human motions accurately.
method Dynamic multiscale graph neural networks (DMGNN) with adaptive multiscale graphs and MGCU.
result DMGNN outperforms state-of-the-art methods in short and long-term predictions.
Paper predicts TUG score from gait characteristics using machine learning.
problem Assessing fall risk in the elderly.
method 3D pose estimation, gait characteristics computation, copula entropy selection, predictive models.
result Effectiveness of the proposed method demonstrated on real-world data.
For recovering 3D object poses from 2D images, a prevalent method is to pre-train an over-complete dictionary of 3D basis poses. During testing, the detected 2D pose is matched to dictionary by where , by estimating the rotation , pr…
We present an unsupervised approach for learning to estimate three dimensional (3D) facial structure from a single image while also predicting 3D viewpoint transformations that match a desired pose and facial geometry. We achieve this by inferring the depth of facial keypoints of an input image in an unsupervised manne…
This work generates synthetic 3D thermal facial data using 2D facial data and deep learning.
problem Creating large datasets for deep learning in computer vision.
method 3D facial modelling techniques and deep learning methodologies.
result Synthetic 3D thermal facial data created for deep learning applications.
New method embeds RNN Seq2Seq models to visualize spatiotemporal data.
problem Visualizing and interpreting spatiotemporal data in sequence prediction tasks.
method Embedding approach to visualize and interpret RNN Seq2Seq model representations.
result Embedding space projections of RNN Seq2Seq models capture spatiotemporal dynamics.
Geometric Capsule Autoencoders group 3D points into parts and objects.
problem Learning object representations from 3D point clouds.
method Geometric capsules with pose and feature components, Multi-View Agreement voting mechanism.
result Learned representations enable object identification and canonical pose recovery.
Roweisposes, Including Eigenposes, Supervised Eigenposes, and Fisherposes, for 3D Action Recognitioncs.CV
Paper proposes Roweisposes for 3D action recognition using generalized eigenvalue problem.
problem Need for basic methods in 3D action recognition.
method Roweisposes uses Roweis discriminant analysis for generalized subspace learning.
result Roweisposes is effective for 3D action recognition.
DFKI Cabin Simulator tests visual monitoring functions in vehicles.
problem Validating novel human-vehicle interfaces and driver assistance systems.
method Driving simulator with in-cabin mock-up and camera system.
result Validation of in-cabin monitoring functions for advanced driver assistance and automated driving.
New method reconstructs 3D shapes from 2D images using Kendall's shape space.
problem Reconstruct 3D shapes from 2D images, especially for rare specimens.
method Kendall's shape space approach with prior information.
result More robust and plausible shapes compared to previous methods.
New benchmark for non-rigid 3D human shape retrieval.
problem Distinguishing between body shapes of 3D human models.
method Extended benchmark with 145 new models and FAUST dataset.
result Improved comparison of 25 shape retrieval methods.
This paper presents KeypointNet, an end-to-end geometric reasoning framework to learn an optimal set of category-specific 3D keypoints, along with their detectors. Given a single image, KeypointNet extracts 3D keypoints that are optimized for a downstream task. We demonstrate this framework on 3D pose estimation by pro…
Generative model disentangles 3D shapes into independent factors.
problem Learning rich representations of deformable 3D shapes.
method Supervised 3D mesh-convolutional Variational AutoEncoder with latent feature disentanglement.
result Explicit disentanglement of latent factors improves shape generation and downstream tasks.
In neural networks, it is often desirable to work with various representations of the same space. For example, 3D rotations can be represented with quaternions or Euler angles. In this paper, we advance a definition of a continuous representation, which can be helpful for training deep neural networks. We relate this t…
Recently, multiple formulations of vision problems as probabilistic inversions of generative models based on computer graphics have been proposed. However, applications to 3D perception from natural images have focused on low-dimensional latent scenes, due to challenges in both modeling and inference. Accounting for th…
The paper proposes a method to learn 3D object pose manifolds using GANs and elasticae.
problem Learning image manifolds of 3D objects with limited data.
method Geom-SGAN and elasticae for geometry-preserving image interpolation.
result The method outperforms state-of-the-art GANs and VAEs in learning rotation paths.
Enhanced 3D shape analysis using information geometry.
problem Challenges in comparing 3D point clouds due to their unstructured nature and complex geometry.
method Information geometric framework for 3D point cloud shape analysis using Gaussian Mixture Models (GMMs) on a statistical manifold. Proposed MSKL divergence with upper and lower bounds.
result MSKL provides stable and monotonically varying values that directly reflect geometric variation, outperforming traditional distances and existing KL approximations.
Paper develops a differentiable approach for 3D imaging models using Fourier slice theorem.
problem Uncertainty in 3D structure modeling and pose estimation in scientific imaging.
method Differentiable probabilistic models in Fourier space with backpropagation through projection.
result Validates approach on 3D protein reconstruction and extends to probabilistic models.
Constructing of molecular structural models from Cryo-Electron Microscopy (Cryo-EM) density volumes is the critical last step of structure determination by Cryo-EM technologies. Methods have evolved from manual construction by structural biologists to perform 6D translation-rotation searching, which is extremely comput…
Protein-ligand scoring is an important step in a structure-based drug design pipeline. Selecting a correct binding pose and predicting the binding affinity of a protein-ligand complex enables effective virtual screening. Machine learning techniques can make use of the increasing amounts of structural data that are beco…
Proposes a model to generate 3D-aware images from 2D images.
problem Generating 3D-aware images from 2D images.
method Likelihood-based top-down model using Neural Radiance Fields and energy-based latent variables.
result Model can infer 3D object structures from 2D images and generate novel views.
Paper tackles unsupervised learning of 3D shapes from single images.
problem Learning 3D shapes from single images without supervision.
method Generative models, variational auto-encoders, adversarial methods.
result Model learns 3D shapes and poses from single images, showing potential for various datasets.
Augment small datasets with synthetic backgrounds to train lightweight CNNs for human pose estimation.
problem Training CNNs from limited real-world data for human pose estimation.
method Synthetic background substitution for data augmentation.
result Improves generalization to unseen environments.
Efficiently infers switching nonlinear systems with collapsed amortized variational inference.
problem Inference in switching nonlinear dynamical systems with discrete latent variables.
method Learn an inference network as a proposal for continuous latent variables, performing exact marginalization of discrete variables.
result Successfully segments time series data into meaningful regimes using piece-wise nonlinear dynamics.
StyleNeRF generates high-resolution images with 3D consistency and style control.
problem Generating high-resolution images with fine details and 3D consistency.
method Integrates NeRF into a style-based generator for efficient high-resolution image synthesis.
result Synthesizes high-resolution images at interactive rates with high 3D consistency and style control.
Unsupervised mesh disentanglement separates identity and pose.
problem Geometric disentanglement for 3D deformable models.
method CFAN-VAE architecture using conformal factor and normal features.
result CFAN-VAE achieves state-of-the-art performance on unsupervised geometric disentanglement.
Training 3D object detectors for autonomous driving has been limited to small datasets due to the effort required to generate annotations. Reducing both task complexity and the amount of task switching done by annotators is key to reducing the effort and time required to generate 3D bounding box annotations. This paper…
3D Convolutional Neural Networks are sensitive to transformations applied to their input. This is a problem because a voxelized version of a 3D object, and its rotated clone, will look unrelated to each other after passing through to the last layer of a network. Instead, an idealized model would preserve a meaningful r…
New dataset tests mental rotation from single images, improving model understanding of 3D scenes.
problem Understanding how a scene looks from a different viewpoint using a single image.
method Created CLEVR-MRT dataset, explored neural architectures for volumetric scene representations.
result Demonstrated the effectiveness of volumetric representations in answering mental rotation questions.
Paper introduces a new method for generating diverse human motion predictions.
problem Stochastic human motion prediction with limited flexibility.
method Stochastically combines root variations with previous pose information in a recurrent network.
result Model generates more diverse motion sequences than existing techniques.
Selective relevance method improves motion explainability in 3D activity recognition models.
problem Models do not appropriately factor motion information into their decisions.
method Selective relevance method to adapt 2D explanation techniques for 3D inputs.
result Improves selectivity of motion explanations, revealing model's spatial bias.
Deep generative modelling for human body analysis is an emerging problem with many interesting applications. However, the latent space learned by such approaches is typically not interpretable, resulting in less flexibility. In this work, we present deep generative models for human body analysis in which the body pose …
ES-VAE models skeletal pose trajectories by removing nuisance factors.
problem Handling camera orientation, subject scale, viewpoint, and execution speed in skeletal data.
method ES-VAE uses TSRVF representation on Kendall's shape manifold to isolate shape dynamics.
result ES-VAE outperforms standard VAEs and sequence modeling baselines in gait cycle prediction and action recognition.
LatticeNet segments 3D point clouds faster and more efficiently.
problem Challenges in applying CNNs to 3D point cloud data.
method Embeds point cloud geometry into a permutohedral lattice for fast convolutions.
result Achieves state-of-the-art performance in 3D segmentation.
This research detects and identifies human-made objects in 3D point clouds using novel methods.
problem Detect and identify human-made objects in 3D point clouds.
method Ground filtering, local information extraction, clustering using Marked Point Fields (MPFs) and Hessian matrix.
result The proposed method outperforms previous techniques in detecting human-made objects.
2D tissue model predicts neurotoxicity more accurately and robustly.
problem Fast and accurate prediction of developmental neurotoxicity.
method Machine learning on 2D bio-engineered tissue models.
result 2D model outperforms 3D model in accuracy and robustness.
Towards Symmetry-sensitive Pose Estimation: A Rotation Representation for Symmetric Object Classescs.CV
We introduce SARR for symmetric object pose estimation, improving CNN performance.
problem Ambiguities in symmetric object orientations hinder deep learning pose estimation.
method Numeric rotation representation using symmetry-derived trigonometric identities.
result SARR enables standard CNNs to achieve state-of-the-art performance.
A novel method compares 3D point clouds using information geometry.
problem Comparing 3D point clouds in machine learning applications.
method Interprets point clouds as probability density functions on a statistical manifold, using GMM and Modified Symmetric KL divergence.
result Demonstrates effectiveness through various case studies.
We consider the problem of estimating human pose and trajectory by an aerial robot with a monocular camera in near real time. We present a preliminary solution whose distinguishing feature is a dynamic classifier selection architecture. In our solution, each video frame is corrected for perspective using projective tra…
A new NAS framework optimizes 3D medical image segmentation architectures.
problem Optimizing neural architectures for high-resolution 3D medical images.
method Stochastic sampling algorithm for scalable gradient-based optimization of neural connectivities and operation types in both encoder and decoder.
result Automatically designed architecture outperforms human-designed U-Net.
Current deep learning results on video generation are limited while there are only a few first results on video prediction and no relevant significant results on video completion. This is due to the severe ill-posedness inherent in these three problems. In this paper, we focus on human action videos, and propose a gene…
mm-Pose detects human skeletons in real-time using mmWave radar and CNNs.
problem Real-time human skeletal posture estimation in various scenarios.
method mmWave radar, radar-to-image representation, forked CNN architecture.
result Accurate predictions for human skeletal joints in 3D space.