This research uses PointNets to detect 2D objects from radar data.
problem Detecting 2D objects from sparse radar data for automated driving.
method Adapting PointNets for radar data, performing 2D object classification and bounding box regression.
result Demonstrates the potential of PointNets for 2D object detection in radar data.
Autonomous driving requires 3D perception of vehicles and other objects in the in environment. Much of the current methods support 2D vehicle detection. This paper proposes a flexible pipeline to adopt any 2D detection network and fuse it with a 3D point cloud to generate 3D information with minimum changes of the 2D d…
3D object detection improved using energy-based models.
problem Accurate 3D object detection in cluttered environments from sparse LiDAR data.
method Designing a differentiable pooling operator for 3D bounding boxes integrated into a state-of-the-art 3D object detector.
result Our approach consistently outperforms the SA-SSD baseline across all 3DOD metrics on the KITTI dataset.
Generates coherent 3D scenes from monocular videos without supervision.
problem Lack of 3D scene modeling in video generation models.
method Trains a model to generate 3D scenes with moving objects and a background from monocular videos.
result Trained model generates coherent 3D scenes with multiple moving objects and a background.
Paper extends 2D ZSAD to 3D MRI without training, achieving robust anomaly detection.
problem Challenges in extending zero-shot anomaly detection to 3D medical images.
method Constructs localized volumetric tokens by aggregating 2D slices processed by 2D foundation models.
result Training-free, batch-based ZSAD effectively extends from 2D encoders to full 3D MRI volumes.
Two-step conformal prediction method for adaptive bounding box uncertainties in multi-object detection.
problem Quantifying predictive uncertainty for multi-object detection in safety-critical applications.
method Developed a two-step conformal prediction approach to propagate uncertainty in predicted class labels into bounding box uncertainties, ensuring coverage for incorrectly classified objects.
result Desired coverage levels are satisfied with practically tight predictive uncertainty intervals on real-world datasets.
Proposes a model to generate 3D-aware images from 2D images.
problem Generating 3D-aware images from 2D images.
method Likelihood-based top-down model using Neural Radiance Fields and energy-based latent variables.
result Model can infer 3D object structures from 2D images and generate novel views.
Object detection in point clouds is an important aspect of many robotics applications such as autonomous driving. In this paper we consider the problem of encoding a point cloud into a format appropriate for a downstream detection pipeline. Recent literature suggests two types of encoders; fixed encoders tend to be fas…
Tracking large numbers of densely-arranged, interacting objects is challenging due to occlusions and the resulting complexity of possible trajectory combinations, as well as the sparsity of relevant, labeled datasets. Here we describe a novel technique of collective tracking in the model environment of a 2D honeybee hi…
We propose a method to generate multiple diverse and valid human pose hypotheses in 3D all consistent with the 2D detection of joints in a monocular RGB image. We use a novel generative model uniform (unbiased) in the space of anatomically plausible 3D poses. Our model is compositional (produces a pose by combining par…
STRING improves 2D and 3D position encodings for better performance.
problem Efficient and accurate position encoding for 2D and 3D applications.
method STRING extends Rotary Position Encodings with a unifying theoretical framework, maintaining translation invariance and low computational cost.
result STRING shows substantial gains in open-vocabulary object detection and robotics.
Deep learning improves automatic image segmentation.
problem Automatic object localization and boundary delineation in images and medical scans.
method Proposed and evaluated novel dilated dense encoder-decoder architectures for salient object segmentation and lesion localization in medical images.
result Proposed architectures outperform state-of-the-art models in accuracy and efficiency.
2DSig-Detect detects adversarial perturbations in images.
problem Adversarial attacks degrade image model performance.
method 2D-signature embedded semi-supervised framework using rough path theory.
result 2DSig-Detect outperforms other methods in detecting adversarial perturbations.
Cryo-electron microscopy (cryo-EM) is an emerging experimental method to characterize the structure of large biomolecular assemblies. Single particle cryo-EM records 2D images (so-called micrographs) of projections of the three-dimensional particle, which need to be processed to obtain the three-dimensional reconstruct…
Method learns symmetries in curves without augmentation.
problem Symmetries in datasets like rotations and scalings.
method Geometric learning using principal fiber bundles.
result 2-parameter family of canonical curve parameterizations.
In this paper we propose novel Deformable Part Networks (DPNs) to learn {\em pose-invariant} representations for 2D object recognition. In contrast to the state-of-the-art pose-aware networks such as CapsNet \cite{sabour2017dynamic} and STN \cite{jaderberg2015spatial}, DPNs can be naturally {\em interpreted} as an effi…
CARML uses meta-learning to avoid obstacles in 2D vehicle navigation.
problem Collision avoidance in 2D vehicle navigation.
method Model-Agnostic Meta-Learning for multi-objective reinforcement learning.
result CARML outperforms a baseline TD3 solution in obstacle avoidance.
From human crowds to cells in tissue, the detection and efficient tracking of multiple objects in dense configurations is an important and unsolved problem. In the past, limitations of image analysis have restricted studies of dense groups to tracking a single or subset of marked individuals, or to coarse-grained group…
A number of recent approaches to policy learning in 2D game domains have been successful going directly from raw input images to actions. However when employed in complex 3D environments, they typically suffer from challenges related to partial observability, combinatorial exploration spaces, path planning, and a scarc…
Topology-enhanced loss improves 3D object reconstruction from 2D images.
problem Challenges in reconstructing 3D objects from 2D images, especially capturing shape information.
method Integrates multi-scale topological features into the reconstruction loss using cubical complexes and optimal transport distance.
result Topology-aware loss substantially improves 3D reconstruction quality.
3D object classification and segmentation using deep neural networks has been extremely successful. As the problem of identifying 3D objects has many safety-critical applications, the neural networks have to be robust against adversarial changes to the input data set. There is a growing body of research on generating h…
Overview of methods for rotating 2D and 3D data.
problem Processing data with equivariance/invariance under rotations.
method An overview of methods for 2D and 3D rotations.
result Identification of commonalities and links between methods.
3D adversarial logos can fool object detectors in real-world settings.
problem Creating robust adversarial attacks in 3D rendering views.
method Constructing 3D adversarial logos via texture mapping and differentiable rendering.
result 3D adversarial logos are more versatile and robust than traditional adversarial patches.
Study of null mean curvature flow on de Sitter lightcone, related to 2d-Ricci flow.
problem Analyzing singularity formation and asymptotic behavior of null mean curvature flow.
method Rescaling procedure to relate to 2d-Ricci flow, singularity analysis, asymptotic behavior study.
result Ancient solutions to the flow can be understood in terms of 2d-Ricci flow.
Open 2D TFTs extend to closed theories with circle value as Hochschild homology.
problem Extending open 2D TFTs to closed theories.
method Using symmetric monoidal ∞-categories and Hochschild homology.
result Open 2D TFTs admit initial open-closed extensions.
New model preserves symmetry in multivariate time series, improving performance.
problem Implicit ordering in MTS models violates inherent exchangeability.
method Permutation-equivariant 2D state space model with canonical architecture.
result Eliminates sequential dependency chains and simplifies stability analysis.
New security patch for object tracking in self-driving cars mitigates vulnerabilities.
problem Vulnerability of object tracking in self-driving cars, especially Kalman Filter-based trackers.
method Adaptive strategy to balance focus on observations and predictions based on deviation anomaly index.
result Certified effectiveness against a generalized hijacking attack model.
The question we address here is of whether phenomena of collective bankruptcies are related to self-organized criticality. In order to answer it we propose a simple model of banking networks based on the random directed percolation. We study effects of one bank failure on the nucleation of contagion phase in a financia…
Detect objects from motion without annotations.
problem Weakly supervised object detection.
method Train model on videos of moving objects and negative scenes.
result Detects objects in single images without annotations.
Proposes class-agnostic object detection to handle all objects without class labels.
problem Difficulty and cost in creating annotated datasets limit conventional object detection models to specific object types.
method Proposes class-agnostic object detection as a new problem and proposes training and evaluation protocols. Uses adversarial learning to exclude class-specific information.
result Adversarial learning improves class-agnostic detection efficacy.
Recent progress in deep generative models has led to tremendous breakthroughs in image generation. However, while existing models can synthesize photorealistic images, they lack an understanding of our underlying 3D world. We present a new generative model, Visual Object Networks (VON), synthesizing natural images of o…
Deep learning detects schools of herring from echograms.
problem Manual interpretation of echograms is time-consuming and inconsistent.
method Deep learning framework for automatic detection.
result Deep learning outperforms traditional machine learning.
For homeland and transportation security applications, 2D X-ray explosive detection system (EDS) have been widely used, but they have limitations in recognizing 3D shape of the hidden objects. Among various types of 3D computed tomography (CT) systems to address this issue, this paper is interested in a stationary CT u…
End-to-end method learns geometry and appearance for multi-view object detection.
problem Challenges in multi-view object detection, including viewpoint, lighting, and scale variability.
method Jointly learns multi-view geometry and warping for robust cross-view object detection.
result Superior performance compared to baselines on a new street-level panorama data set.
Paper presents attacks on real-time object detection systems.
problem Adversarial attacks on real-time object detection systems.
method Three targeted adversarial Objectness Gradient attacks (TOG).
result Adversarial attacks can cause object-vanishing, object-fabrication, and object-mislabeling.
Physical patches can fool object detectors anywhere in an image.
problem Physical adversarial attacks on object detection systems.
method Demonstrated a patch that suppresses all detected objects regardless of its position.
result A patch can be placed anywhere in an image to suppress all detected objects, including those far away.
We explore a solution for learning disease signatures from weakly, yet easily obtainable, annotated volumetric medical imaging data by analyzing 3D volumes as a sequence of 2D images. We demonstrate the performance of our solution in the detection of emphysema in lung cancer screening low-dose CT images. Our approach u…
CNN detects phase transitions in Potts models without prior knowledge.
problem Detecting phase transitions in q-state Potts models using deep learning. method Trained a deep CNN on Ising model spin configurations and temperatures, then tested on Potts model images.
result Deep CNN accurately detects phase transitions in Potts models, including high- and low-temperature regions.
Automates detection of electric devices in 3D x-ray images of luggage.
problem Detecting electric devices in cluttered 3D baggage images.
method Unpack, Predict, eXtract, Repack (UXPR) algorithm using segmentation and ensemble learning.
result System can accurately detect electric devices in 3D baggage images.
Benchmark improves object detection robustness in winter weather.
problem Assessing object detection models' performance under image corruptions.
method Developed three benchmark datasets with various image corruptions; used data augmentation to improve robustness.
result Simple data augmentation significantly enhances model robustness across different corruptions and datasets.
Paper develops SKPD framework for signal region detection in image regression.
problem Limited research on image region detection in high-resolution image regression.
method Sparse Kronecker Product Decomposition (SKPD) framework for matrices and tensors.
result Computed solutions converge to truth with guaranteed consistency.
SECRM-2D improves RL-based autonomous driving with safety guarantees.
problem Safety and efficiency trade-offs in RL-based autonomous driving.
method RL-based controller with safety constraints for efficient and comfortable driving.
result SECRM-2D avoids crashes and improves efficiency and comfort compared to baselines.
Deep RL learns to construct objects from 2D images by avoiding brick overlaps.
problem Learning to construct objects from partial 2D images with constraints.
method Combination of reinforcement learning and action validity prediction.
result Successfully constructs unseen objects from 2D images.
Paper finds new criteria for conjugate points in fluid flows.
problem Finding conjugate points in steady 2D Euler flows.
method Develops a new sufficient criterion for conjugate points, applies to any rotational cell, and uses a general construction of steady fluid surfaces.
result Improves on existing criteria and captures all known conjugate points in rotational cells.
Polarimetric images enhance object detection in adverse weather conditions.
problem Object detection in road scenes is challenging in adverse weather conditions.
method Combining polarimetric imaging and deep learning.
result Polarimetry improves object detection by 20% to 50% compared to conventional RGB images.
Robots detect and recognize objects in real-time for better manipulation.
problem Real-time object detection and recognition for humanoid robots.
method Modified YOLOv3 algorithm, quantization, and re-arrangement of layers for low-compute NAO robots.
result Robots can perform real-time detection, recognition, and localization of objects.
Algorithm learns user's reward function from hypothetical behaviors.
problem Aligning agent behavior with unknown user objectives.
method Synthesizes hypothetical behaviors, asks user for rewards, trains neural network.
result Significantly outperforms prior methods in learning reward models.
Deep Sets improve reinforcement learning agent's object-centered navigation and generalization.
problem Improving reinforcement learning agents' ability to generalize to unseen objects and goals.
method Combining object-wise permutation invariant networks (Deep Sets) and gated-attention mechanisms.
result Agent demonstrates strong generalization to out-of-distribution goals in a procedurally-generated 2D world.