Detect objects from motion without annotations.
problem Weakly supervised object detection.
method Train model on videos of moving objects and negative scenes.
result Detects objects in single images without annotations.
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
169,051 papers · 148 categories
Trend · papers per month
48 results for “video object detection”
Unsupervised Detection and Tracking of Arbitrary Objects with Dependent Dirichlet Process Mixturesstat.ML
This paper proposes a technique for the unsupervised detection and tracking of arbitrary objects in videos. It is intended to reduce the need for detection and localization methods tailored to specific object types and serve as a general framework applicable to videos with varied objects, backgrounds, and image qualiti…
TokenCut detects and segments objects in images and videos without supervision.
problem Detecting and segmenting salient objects in images and videos without labeled data.
method Graph-based approach using self-supervised transformer features and Normalized Cut algorithm.
result Achieves state-of-the-art results on various detection and segmentation tasks.
SCNN improves video object detection speed by 178%.
problem Limited throughput in existing CNNs for video object detection.
method Proposes SCNN, a statistical CNN that processes correlated distributions.
result Achieves 178% speedup over existing CNNs for video object detection.
Fastest video anomaly detection via teacher-student distillation.
problem Anomaly detection in video at high speed.
method Adversarial knowledge distillation from object-level teacher models.
result 7-62 times faster than state-of-the-art methods.
Generates coherent 3D scenes from monocular videos without supervision.
problem Lack of 3D scene modeling in video generation models.
method Trains a model to generate 3D scenes with moving objects and a background from monocular videos.
result Trained model generates coherent 3D scenes with multiple moving objects and a background.
Online anomaly detection in surveillance videos with false alarm rate bounds.
problem Lack of theoretical performance analysis and online decision making in anomaly detection.
method Proposes an online anomaly detection method with asymptotic bounds on false alarm rate.
result Demonstrates effectiveness on publicly available data sets, outperforming state-of-the-art algorithms.
Video analytics requires operating with large amounts of data. Compressive sensing allows to reduce the number of measurements required to represent the video using the prior knowledge of sparsity of the original signal, but it imposes certain conditions on the design matrix. The Bayesian compressive sensing approach r…
Paper improves video categorization using temporal coherence.
problem Video categorization in multiple modalities.
method Temporal coherence-based regularization for multimodal models.
result Models with temporal coherence outperform state-of-the-art.
New architecture tracks objects in cluttered scenes without supervision.
problem Learning to track objects in large scenes with many objects.
method Spatially invariant computations and representations.
result Outperforms competing methods in tracking objects in cluttered scenes.
Online Multi-Object Tracking (MOT) from videos is a challenging computer vision task which has been extensively studied for decades. Most of the existing MOT algorithms are based on the Tracking-by-Detection (TBD) paradigm combined with popular machine learning approaches which largely reduce the human effort to tune a…
Dataset for object detection at Oktoberfest beer tent.
problem Realistic object detection in a busy, diverse setting.
method Hand-annotated 1,110 images, provided trained models.
result Challenging dataset for object detection.
D-City is a diverse traffic dataset for AI development.
problem Lack of comprehensive, detailed datasets for AI in driving.
method Collects over 10,000 dashcam videos with detailed annotations.
result Advances AI in driving perception and related areas.
Paper proposes detecting video manipulation using stream descriptors.
problem Misuse of manipulated video content.
method Binary classifiers on multimedia stream descriptors.
result Scalable approach can detect high-quality manipulations.
Develops a deep metric learning approach for detecting bugs in video games.
problem Automated detection of bugs in video games.
method State-State Siamese Networks (S3N) for deep metric learning.
result S3N learns meaningful embeddings to identify various types of bugs.
TrackNet: A Deep Learning Network for Tracking High-speed and Tiny Objects in Sports Applicationscs.LG
TrackNet tracks tiny balls in sports videos with high precision.
problem Accurately tracking tiny and fast-moving objects like tennis balls in sports videos.
method Developed a heatmap-based deep learning network, TrackNet, trained on public and additional labeled videos.
result Achieved high precision (99.7%) in ball tracking on public domain videos.
This paper optimizes object tracking on edge devices with small matrices.
problem Efficiently tracking objects in video sequences on edge devices with small matrices.
method Parallelized a Simple Online and Real-time Tracking (SORT) application on shared-memory multicores.
result Throughput-based parallelization technique outperforms multi-threading for small matrices.
New algorithm rSVDdpd improves robustness and scalability for video surveillance background modeling.
problem Camera tampering and noisy videos make background separation challenging.
method Introduces rSVDdpd, a robust singular value decomposition technique for scalable video surveillance.
result Demonstrates superior performance on benchmark and real-life datasets.
New method tackles anomaly detection in video surveillance using continual learning.
problem Challenges in continual learning for high-dimensional applications like video surveillance.
method Transfer learning and continual learning for online anomaly detection.
result Significantly reduces training complexity and continual learning from recent data.
CitySim: A Drone-Based Vehicle Trajectory Dataset for Safety Oriented Research and Digital Twinscs.CV
CitySim dataset captures vehicle trajectories for safety research.
problem Lack of fine-grain vehicle trajectories for safety-oriented research.
method Five-step procedure: video stabilization, object filtering, stitching, detection, and error filtering.
result CitySim dataset improves safety evaluations and facilitates digital-twin research.
We present Sequential Attend, Infer, Repeat (SQAIR), an interpretable deep generative model for videos of moving objects. It can reliably discover and track objects throughout the sequence of frames, and can also generate future frames conditioning on the current frame, thereby simulating expected motion of objects. Th…
A robust visual tracking system requires an object appearance model that is able to handle occlusion, pose, and illumination variations in the video stream. This can be difficult to accomplish when the model is trained using only a single image. In this paper, we first propose a tracking approach based on affine subspa…
The paper solves video object segmentation without supervision using nonconvex optimization.
problem Unsupervised video object segmentation via background subtraction.
method Formulates the problem as a nonnegative variant of robust principal component analysis, ensuring global optimality under certain conditions.
result Conditions guaranteeing the uniqueness and global optimality of object segmentation are derived and demonstrated with real data.
LeagueAI generates synthetic data for better object detection in video games.
problem Laborious work of gathering large amounts of hand-labeled data for machine vision applications.
method Automatic synthetic dataset generation using game 3D models and background.
result Models trained on synthetic data outperformed those on hand-labeled data in precision and reliability.
Study builds tools to detect misinformation in online medical videos.
problem Misleading information in online medical videos.
method Manual annotation of a dataset, use of linguistic, acoustic, and user engagement features for classification models.
result Automatic models can identify misinformation with up to 74% accuracy.
Automated video conferencing system improves user experience with ASD and VC.
problem Improve remote video conferencing experience through automated speaker detection and virtual cinematography.
method Uses 4K wide-FOV camera, depth camera, and microphone array to extract features and train machine learning models for ASD and VC.
result System performs within 0.3 MOS of an expert cinematographer, as rated by users.
A new VAD method uses respiration patterns from video to detect speech.
problem Improving VAD performance in noisy audio recordings.
method Extract respiration patterns from video, use neural models to detect speech.
result Efficacy demonstrated through experiments on real acoustic environments.
Learning from demonstration (LfD) is useful in settings where hand-coding behaviour or a reward function is impractical. It has succeeded in a wide range of problems but typically relies on manually generated demonstrations or specially deployed sensors and has not generally been able to leverage the copious demonstrat…
WSGN detects actions from weak supervision, improving performance on THUMOS14 and Charades.
problem Challenging action detection requires detailed manual supervision.
method WSGN learns action detection from video-level labels, exploiting both video-specific and dataset-wide statistics.
result WSGN achieves significant gains in action detection for THUMOS14 and Charades datasets.
Survey of deep learning methods for video multi-object tracking.
problem Tracking multiple objects in video sequences.
method Review of deep learning approaches applied to MOT stages.
result Identification of similarities among top-performing methods.
FedVision uses federated learning to improve object detection without transmitting data.
problem Challenges in building object detection models on large training datasets due to privacy and cost issues.
method Federated learning (FL) platform for easy integration by non-experts.
result Significant efficiency improvement and cost reduction in smart city applications.
STOVE predicts convincing physical behavior in videos.
problem Learning models from videos with objects and interactions.
method Compositional state-space model combining image and dynamics models.
result Predicts videos with convincing physical behavior over hundreds of timesteps.
Efficiently detects anomalies in videos with reduced computation.
problem Anomaly detection in videos for robust and efficient systems.
method Powers-of-two weights and denoising for CNN simplification and robustness.
result 10% faster detection with comparable accuracy and robustness.
Proposes a novel anomaly detection method for echocardiogram videos.
problem Anomaly detection in echocardiogram videos.
method Dynamic Variational Trajectory Models (TVAE-C, TVAE-R, TVAE-S) trained on healthy infant echocardiogram videos.
result Superior performance in detecting congenital heart defects and pulmonary hypertension.
Deep neural network detects driver intentions from video.
problem Detecting driver intentions for safer self-driving.
method Uses deep learning to analyze turn signals and emergency flashers.
result High per-frame accuracy in challenging scenarios.
From human crowds to cells in tissue, the detection and efficient tracking of multiple objects in dense configurations is an important and unsolved problem. In the past, limitations of image analysis have restricted studies of dense groups to tracking a single or subset of marked individuals, or to coarse-grained group…
Body-worn video (BWV) cameras are increasingly utilized by police departments to provide a record of police-public interactions. However, large-scale BWV deployment produces terabytes of data per week, necessitating the development of effective computational methods to identify salient changes in video. In work carried…
Edge filters reduce video data transmission to datacenters.
problem Strain on wide area network infrastructure due to video camera deployments.
method FilterForward system with lightweight edge filters and microclassifiers.
result Reduces bandwidth use by an order of magnitude.
A novel dynamic Bayesian nonparametric topic model for anomaly detection in video is proposed in this paper. Batch and online Gibbs samplers are developed for inference. The paper introduces a new abnormality measure for decision making. The proposed method is evaluated on both synthetic and real data. The comparison w…
Paper defends against adversarial videos by detecting and reducing imperceptible perturbations.
problem Adversarial videos can fool well-trained video classification models.
method Temporal consistency between frames and spatial denoising to detect and reduce perturbations.
result The proposed method significantly improves robustness against adversarial attacks.
Patient pain can be detected highly reliably from facial expressions using a set of facial muscle-based action units (AUs) defined by the Facial Action Coding System (FACS). A key characteristic of facial expression of pain is the simultaneous occurrence of pain-related AU combinations, whose automated detection would …
Human communication takes many forms, including speech, text and instructional videos. It typically has an underlying structure, with a starting point, ending, and certain objective steps between them. In this paper, we consider instructional videos where there are tens of millions of them on the Internet. We propose a…
Disentangling Controllable Object through Video Prediction Improves Visual Reinforcement Learningcs.LG
A framework disentangles controllable objects from visual signals for improved RL.
problem Improving sample efficiency and game performance in vision-based RL.
method Action-conditioned video prediction to disentangle controllable objects.
result Improved sample efficiency and game performance in Atari games.
Paper describes a video surveillance system for highway traffic events.
problem Detecting specific sequences of situations in highway traffic videos.
method Compares RNN and CNN architectures for analyzing video frames and sequences.
result Best architecture performs well in real conditions.
Paper introduces adversarial lossy compression for video artifacts reduction.
problem Unpleasant reconstruction artifacts in standard video coding schemes at low bit-rates.
method Adversarial lossy video compression model minimizing an adversarial distortion objective.
result Reduction of perceptual artifacts and detail reconstruction under extreme compression.
DIVE learns video representations even with missing data.
problem Missing data in video sequences.
method Disentangled Imputed Video autoEncoder (DIVE) with missingness latent variable.
result DIVE outperforms state-of-the-art baselines in imputing and predicting missing video frames.
We address an anomaly detection setting in which training sequences are unavailable and anomalies are scored independently of temporal ordering. Current algorithms in anomaly detection are based on the classical density estimation approach of learning high-dimensional models and finding low-probability events. These al…
Improved object segmentation and tracking in video using optical flow and initial state conditioning.
problem Challenges in fully unsupervised object-centric learning from video data.
method Weakly-supervised approach using optical flow and initial state conditioning.
result Conditioning the model on simple object location cues significantly improves instance segmentation in realistic synthetic data.