Visual relationship detection can bridge the gap between computer vision and natural language for scene understanding of images. Different from pure object recognition tasks, the relation triplets of subject-predicate-object lie on an extreme diversity space, such as \textit{person-behind-person} and \textit{car-behind…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,982 papers · 148 categories
Trend · papers per month
48 results for “Visual Object Detection”
Proposes class-agnostic object detection to handle all objects without class labels.
problem Difficulty and cost in creating annotated datasets limit conventional object detection models to specific object types.
method Proposes class-agnostic object detection as a new problem and proposes training and evaluation protocols. Uses adversarial learning to exclude class-specific information.
result Adversarial learning improves class-agnostic detection efficacy.
Paper uses SSD to detect miners' activities in a mining environment.
problem Tracking miners' activities in a mining environment with little obstruction.
method Used SSD trained on COCO dataset to detect miners' activities. Implemented machine learning algorithms using Tensorflow and C++.
result Improved accuracy of detecting miners' activities through data fusion.
UN-AVOIDS visualizes and detects anomalies without needing labeled data.
problem The need for a unified framework to visualize and detect anomalies.
method UN-AVOIDS is an unsupervised, nonparametric approach that transforms data into a new space (NCDF) for both visualization and detection.
result UN-AVOIDS assigns invariant anomalous scores and achieves high AUC in detecting anomalies.
Convolutional Neural Networks (CNN) are successfully used for various visual perception tasks including bounding box object detection, semantic segmentation, optical flow, depth estimation and visual SLAM. Generally these tasks are independently explored and modeled. In this paper, we present a joint multi-task network…
Balanced Activation improves object detection performance on long-tailed datasets.
problem Mismatch between training and testing label distributions in object detection.
method Introduces Balanced Activation (Balanced Softmax and Balanced Sigmoid) to address label distribution shift.
result Balanced Activation provides ~3% gain in mAP on LVIS-1.0 compared to state-of-the-art methods.
Paper develops brain-inspired unsupervised learning for scalable object detection.
problem Machine vision systems struggle with object discovery and detection, especially under nonideal conditions.
method Leverages large-scale perceptual data to develop brain-inspired flexible, scale, and shift invariant object prototypes.
result Efficient unsupervised learning framework constructs accurate part-aware object models and robust detection algorithms.
Discriminative Bimodal Networks for Visual Localization and Detection with Natural Language Queriescs.CV
Associating image regions with text queries has been recently explored as a new way to bridge visual and linguistic representations. A few pioneering approaches have been proposed based on recurrent neural language models trained generatively (e.g., generating captions), but achieving somewhat limited localization accu…
FedVision uses federated learning to improve object detection without transmitting data.
problem Challenges in building object detection models on large training datasets due to privacy and cost issues.
method Federated learning (FL) platform for easy integration by non-experts.
result Significant efficiency improvement and cost reduction in smart city applications.
Paper tackles zero-shot learning for semantic image interpretation.
problem Extracting structured semantic descriptions from images requires complete training sets, which are often unavailable.
method Uses Logic Tensor Networks to leverage logical constraints and similarities among relationships in the training set.
result Background knowledge can alleviate the incompleteness of training sets, improving zero-shot learning performance.
Deep neural networks have achieved impressive success in large-scale visual object recognition tasks with a predefined set of classes. However, recognizing objects of novel classes unseen during training still remains challenging. The problem of detecting such novel classes has been addressed in the literature, but mos…
New method improves EBMs for regression tasks.
problem Training EBMs for regression is challenging.
method Proposed a simple yet effective extension of noise contrastive estimation.
result Our method achieves state-of-the-art performance on 1D regression and object detection.
Improved visual representation learning with conditional negative sampling.
problem Learning strong unsupervised visual representations using contrastive learning.
method Introduce a family of mutual information estimators that sample negatives conditionally.
result Improves accuracy by 2-5% points on four standard image datasets.
The Familiarity Hypothesis explains deep open set methods' success in detecting novel objects.
problem Detecting novel objects in open set recognition problems.
method Logits-based detection of absence of familiar features.
result Familiarity-based detection fails in scenarios with both novel and familiar objects.
This paper presents a novel yet intuitive approach to unsupervised feature learning. Inspired by the human visual system, we explore whether low-level motion-based grouping cues can be used to learn an effective visual representation. Specifically, we use unsupervised motion-based segmentation on videos to obtain segme…
PiVoT improves real-time multi-object detection and tracking in clutter.
problem Challenges in multi-object detection and tracking from noisy point clouds.
method Variational inference for fast, clutter-resilient multi-object tracking.
result Substantial performance improvement over existing Bayesian trackers.
Improved satellite object detection with NN upscaling.
problem Improving object detection accuracy on small objects in satellite images.
method Comparison of Super-Resolution (SR) and Nearest Neighbors (NN) interpolation on xView satellite data.
result NN upscaling yields nearly identical object detection results to SR with a 0.0002 AP difference.
The visual systems of many mammals, including humans, is able to integrate the geometric information of visual stimuli and to perform cognitive tasks already at the first stages of the cortical processing. This is thought to be the result of a combination of mechanisms, which include feature extraction at single cell l…
Multi-Region Neural Representation: A novel model for decoding visual stimuli in human brainsstat.ML
Multivariate Pattern (MVP) classification holds enormous potential for decoding visual stimuli in the human brain by employing task-based fMRI data sets. There is a wide range of challenges in the MVP techniques, i.e. decreasing noise and sparsity, defining effective regions of interest (ROIs), visualizing results, and…
We present an approach for reconfiguration of dynamic visual sensor networks with deep reinforcement learning (RL). Our RL agent uses a modified asynchronous advantage actor-critic framework and the recently proposed Relational Network module at the foundation of its network architecture. To address the issue of sample…
Object detection in streaming images is a major step in different detection-based applications, such as object tracking, action recognition, robot navigation, and visual surveillance applications. In mostcases, image quality is noisy and biased, and as a result, the data distributions are disturbed and imbalanced. Most…
Deep learning detects sleep state fluctuations in neonates from single EEG channel.
problem Monitoring sleep state fluctuations in neonatal intensive care units.
method Deep learning-based algorithm trained on 53 EEG recordings, validated on 30 polysomnography recordings.
result High accuracy (90%) in detecting quiet sleep states from single EEG channel, generalizing well to external dataset.
Visual spoofing bypasses spam filters and plagiarism detection.
problem Vulnerability in spam filters that can be exploited by visually similar but differently encoded characters.
method Replaces characters with visually similar but differently encoded characters from a different alphabet.
result Spammers can create messages that bypass existing spam filters.
Transformer-based method discovers objects from images without labels.
problem Discovering objects in images without labeled data.
method Graph-based approach using self-supervised transformer features and normalized graph-cut.
result Significantly boosts performance in unsupervised object discovery.
This research reverses feature visualization in neural networks to optimize for specific feature objectives.
problem The invertibility of feature visualization in neural networks is not well understood.
method The approach involves optimizing for the feature objective that generates the input used in feature visualization, using the gradient of a specific objective function.
result A closed-form solution is found to minimize the gradient, providing an alternative view on network sensitivity.
Mobile app uses CNN to help visually impaired cross streets.
problem Helping visually impaired cross streets safely.
method LytNetV2 deep learning model for pedestrian traffic light detection.
result 96% classification accuracy and 6.15 degree angle error.
Proposes a deep Auto-Encoder-like framework for visual-tactile fusion object clustering.
problem Combining visual and tactile information for better object clustering.
method Deep Auto-Encoder-like Non-negative Matrix Factorization framework, graph regularizer, modality-level consensus regularizer, alternating minimization strategy.
result Improves object clustering performance by leveraging both visual and tactile modalities.
This work learns visual representations for deformable objects using contrastive estimation.
problem Challenges in learning plannable visual representations for deformable objects.
method Jointly optimizes visual representation and dynamics models using contrastive estimation.
result Substantial improvements in performance over standard model-based learning techniques.
New mutual information framework improves contrastive learning for vision tasks.
problem Maximizing mutual information for better unsupervised learning representations.
method Reformulated mutual information as a lower bound, introducing new negative sampling strategies.
result Improved representations outperform previous methods in various vision tasks.
AI enhances pollen recognition in veterinary imaging using holographic microscopy.
problem Challenges in recognizing pollen in holographic images due to speckle noise and artifacts.
method Training YOLOv8s and MobileNetV3L on dual-modality dataset, employing WGAN-SN for synthetic data augmentation.
result GAN-based augmentation improves object detection and classification in holographic images, closing the performance gap.
Deep convolutional neural networks have recently achieved state-of-the-art performance on a number of image recognition benchmarks, including the ImageNet Large-Scale Visual Recognition Challenge (ILSVRC-2012). The winning model on the localization sub-task was a network that predicts a single bounding box and a confid…
Background: A universal unanswered question in neuroscience and machine learning is whether computers can decode the patterns of the human brain. Multi-Voxels Pattern Analysis (MVPA) is a critical tool for addressing this question. However, there are two challenges in the previous MVPA methods, which include decreasing…
A universal unanswered question in neuroscience and machine learning is whether computers can decode the patterns of the human brain. Multi-Voxels Pattern Analysis (MVPA) is a critical tool for addressing this question. However, there are two challenges in the previous MVPA methods, which include decreasing sparsity an…
Neural model predicts object states and physical parameters from visual observations.
problem Computational models struggle with physical reasoning and adapting to new environments.
method Visual prior predicts particle-based system from visual observations; inference module refines estimates subject to dynamics constraints.
result Model can infer physical properties within a few observations and adapt to unseen scenarios.
Learning automatically the structure of object categories remains an important open problem in computer vision. In this paper, we propose a novel unsupervised approach that can discover and learn landmarks in object categories, thus characterizing their structure. Our approach is based on factorizing image deformations…
Detects anomalies in autonomous mobile robots using vision.
problem Anomaly detection for autonomous mobile robots.
method Unsupervised deep learning methods and a novel dataset.
result State-of-the-art approach tested on a new dataset.
We consider the problem of naming objects in complex, natural scenes containing widely varying object appearance and subtly different names. Informed by cognitive research, we propose an approach based on sharing context based object hypotheses between visual and lexical spaces. To this end, we present the Visual Seman…
Semantic boundary and edge detection aims at simultaneously detecting object edge pixels in images and assigning class labels to them. Systematic training of predictors for this task requires the labeling of edges in images which is a particularly tedious task. We propose a novel strategy for solving this task, when pi…
Visual analytics tool detects and corrects concept drift in data streams.
problem Concept drift causes inaccurate predictions in evolving data.
method DriftVis combines drift detection and visualization.
result Visual analytics supports detection, examination, and correction of concept drift.
New research validates a best practice for explaining neural network decisions.
problem Transparency in neural network decision-making.
method Layer-wise Relevance Propagation (LRP) with layer-dependent approach.
result Layer-dependent LRP better represents model reasoning and improves object detection.
We consider the task of semantic robotic grasping, in which a robot picks up an object of a user-specified class using only monocular images. Inspired by the two-stream hypothesis of visual reasoning, we present a semantic grasping framework that learns object detection, classification, and grasp planning in an end-to-…
A new system detects and classifies defects in semiconductor manufacturing.
problem Detecting and classifying novel defect patterns in high-resolution imagery.
method Stacked hybrid convolutional neural networks (SH-CNN) with visual attention.
result SH-CNN outperforms current approaches in automated visual inspection.
Survey visual analytics methods for detecting anomalous user behaviors.
problem Understanding and detecting anomalous user behaviors in various domains.
method Survey and classification of visual analytics methods in four categories.
result Discussion of findings and potential research directions.
VCML learns concepts and metaconcepts from images and questions.
problem Learning concepts and metaconcepts from visual data.
method Bidirectional connection between visual concepts and metaconcepts.
result VCML can generalize from limited data and noisy inputs.
Human visual object recognition is typically rapid and seemingly effortless, as well as largely independent of viewpoint and object orientation. Until very recently, animate visual systems were the only ones capable of this remarkable computational feat. This has changed with the rise of a class of computer vision algo…
Constellation learns group-level visual relationships for abstract reasoning.
problem Learning configurational properties of entire groups of objects.
method Introduces Constellation, a network that learns relational abstractions over static visual scenes.
result Offers a basis for abstract relational reasoning and sensory imagination.
Generates coherent 3D scenes from monocular videos without supervision.
problem Lack of 3D scene modeling in video generation models.
method Trains a model to generate 3D scenes with moving objects and a background from monocular videos.
result Trained model generates coherent 3D scenes with multiple moving objects and a background.
Proposes manifold-based unsupervised anomaly detection for visual data.
problem Rare anomalies in unlabeled data.
method Constant curvature manifolds, hyperspherical Variational Auto-Encoders (VAE) with gyroplane layer.
result State-of-the-art results on visual anomaly benchmarks and histopathology.