Self-supervised method estimates depth from monocular endoscopy videos.
problem Depth estimation from monocular endoscopy data without manual labeling.
method Convolutional neural networks trained with sparse supervision from stereo methods.
result Submillimeter mean residual error in cross-patient CT scans comparison.
Self-supervised method estimates distances on fisheye cameras for autonomous driving.
problem Accurate Euclidean distance estimation on fisheye cameras for autonomous driving.
method Self-supervised scale-aware framework for monocular fisheye videos.
result State-of-the-art results on KITTI dataset, comparable to other methods.
Generates coherent 3D scenes from monocular videos without supervision.
problem Lack of 3D scene modeling in video generation models.
method Trains a model to generate 3D scenes with moving objects and a background from monocular videos.
result Trained model generates coherent 3D scenes with multiple moving objects and a background.
Per-pixel ground-truth depth data is challenging to acquire at scale. To overcome this limitation, self-supervised learning has emerged as a promising alternative for training models to perform monocular depth estimation. In this paper, we propose a set of improvements, which together result in both quantitatively and …
GANVO uses GANs to estimate camera motion and depth from unlabelled images.
problem Lack of labelled data for deep VO and depth estimation.
method Generative adversarial networks for unsupervised learning of 6-DoF pose and depth.
result Outperforms existing methods in pose estimation and depth recovery.
Regression Prior Networks improve ensemble performance on regression tasks.
problem Improving ensemble performance on regression tasks.
method Extending Prior Networks and Ensemble Distribution Distillation (EnD2) to regression tasks using the Normal-Wishart distribution. result Regression Prior Networks yield performance competitive with ensemble approaches on regression tasks.
Proposes a new metric to evaluate uncertainty in deep learning predictions.
problem Evaluating the reliability of deep learning predictions, especially uncertainty.
method Develops a novel metric for evaluating relative uncertainty in regression tasks with deep neural networks.
result Validates the new metric on a toy dataset and applies it to monocular depth estimation.
Learning based methods have shown very promising results for the task of depth estimation in single images. However, most existing approaches treat depth prediction as a supervised regression problem and as a result, require vast quantities of corresponding ground truth depth data for training. Just recording quality d…
Paper tackles depth estimation and optic disc-cup segmentation from color fundus images.
problem Depth estimation and optic disc-cup segmentation from color fundus images.
method Uses fully convolutional networks for monocular retinal depth estimation and optic disc-cup segmentation.
result Demonstrates improved accuracy in depth estimation and optic disc-cup segmentation.
We demonstrate the first application of deep reinforcement learning to autonomous driving. From randomly initialised parameters, our model is able to learn a policy for lane following in a handful of training episodes using a single monocular image as input. We provide a general and easy to obtain reward: the distance …
This paper improves 3D pose recovery from 2D images using non-convex regularization.
problem 3D object pose recovery from 2D images.
method Proposes non-convex regularization with leaky capped ℓ1-norm (LCNR) and multi-stage optimization.
result Theoretical analysis shows estimation error decreases with optimization stages.
We present a generalization of the Cauchy/Lorentzian, Geman-McClure, Welsch/Leclerc, generalized Charbonnier, Charbonnier/pseudo-Huber/L1-L2, and L2 loss functions. By introducing robustness as a continuous parameter, our loss function allows algorithms built around robust loss minimization to be generalized, which imp…
NAVREN-RL uses deep reinforcement learning to teach drones indoor navigation.
problem Teaching drones to navigate indoor environments efficiently.
method End-to-end deep reinforcement learning with a custom reward function, expert data integration.
result Drones successfully navigate indoor arenas avoiding obstacles.
This paper explores the capabilities of convolutional neural networks to deal with a task that is easily manageable for humans: perceiving 3D pose of a human body from varying angles. However, in our approach, we are restricted to using a monocular vision system. For this purpose, we apply a convolutional neural networ…
Sparsity inducing regularization is an important part for learning over-complete visual representations. Despite the popularity of ℓ1 regularization, in this paper, we investigate the usage of non-convex regularizations in this problem. Our contribution consists of three parts. First, we propose the leaky capped …
New method improves reliability of depth estimation models.
problem Uncertainty quantification in large-scale vision models.
method Parameter-efficient Bayesian neural networks with PEFT methods.
result Combining PEFT methods with Bayesian inference enhances predictive performance.
We propose a method to generate multiple diverse and valid human pose hypotheses in 3D all consistent with the 2D detection of joints in a monocular RGB image. We use a novel generative model uniform (unbiased) in the space of anatomically plausible 3D poses. Our model is compositional (produces a pose by combining par…
We consider the task of semantic robotic grasping, in which a robot picks up an object of a user-specified class using only monocular images. Inspired by the two-stream hypothesis of visual reasoning, we present a semantic grasping framework that learns object detection, classification, and grasp planning in an end-to-…
New approach learns traffic behavior from unlabelled video.
problem Learning from demonstration in settings with unlabelled raw video data.
method Calibrates camera, detects objects, tracks them, and uses trajectories for LfD.
result Can learn traffic behavior from raw video without additional expert knowledge.
Y-GAN uses multi-camera data to estimate depth maps without expensive hardware.
problem Depth perception for autonomous systems requires accurate 3D spatial information.
method Proposes Y-GAN, a deep convolutional generative adversarial network.
result Y-GAN estimates depth maps from multi-camera stereo images without ground truth data.
Compact Gaussian model approximates deep ensemble predictions.
problem Efficiently approximating deep ensemble models for image prediction.
method Sparse-structured multivariate Gaussian with Cholesky parameterization trained to match pre-trained ensemble outputs.
result Compact representation captures uncertainty and structured correlations explicitly.
New method reconstructs 3D shapes from 2D images using Kendall's shape space.
problem Reconstruct 3D shapes from 2D images, especially for rare specimens.
method Kendall's shape space approach with prior information.
result More robust and plausible shapes compared to previous methods.
Proposes a new method for robust uncertainty quantification in regression tasks.
problem Robust uncertainty estimation for deep neural networks in regression tasks.
method Generalized Auxiliary Uncertainty Estimator (AuxUE) scheme, considering both aleatoric and epistemic uncertainties.
result DIDO method provides robust uncertainty estimates in noisy inputs, scalable to image-level and pixel-wise tasks.
Enhances SSL methods with depth cues for better image understanding.
problem Lack of depth cues in 2D image pixel maps limits SSL performance.
method Integrates depth signals from a pretrained monocular RGB-to-depth model into contrastive learning frameworks.
result Improves SSL methods' robustness and generalization with depth signals.
Hybrid RL combines simulated and real data for robust autonomous flight.
problem Challenges in training deep RL models for real-world robotic tasks.
method Combines real-world and simulated data to improve generalization.
result Quadrotor avoids collisions using only a monocular camera.
Aerial robot estimates human pose and path using dynamic classifier selection.
problem Estimating human pose and trajectory from aerial video.
method Dynamic classifier selection architecture; perspective correction; HOG and CNN features; 64 pose-viewpoint classes.
result Dynamic classifier selection improves efficiency and accuracy.