Digital camera pipelines employ color constancy methods to estimate an unknown scene illuminant, in order to re-illuminate images as if they were acquired under an achromatic light source. Fully-supervised learning approaches exhibit state-of-the-art estimation accuracy with camera-specific labelled training imagery. R…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “camera”
Camera model identification refers to the problem of linking a picture to the camera model used to shoot it. As this might be an enabling factor in different forensic applications to single out possible suspects (e.g., detecting the author of child abuse or terrorist propaganda material), many accurate camera model att…
Biodiversity conservation depends on accurate, up-to-date information about wildlife population distributions. Motion-activated cameras, also known as camera traps, are a critical tool for population surveys, as they are cheap and non-intrusive. However, extracting useful information from camera trap images is a cumber…
Fisheye cameras are commonly employed for obtaining a large field of view in surveillance, augmented reality and in particular automotive applications. In spite of their prevalence, there are few public datasets for detailed evaluation of computer vision algorithms on fisheye images. We release the first extensive fish…
Cameras are an essential part of sensor suite in autonomous driving. Surround-view cameras are directly exposed to external environment and are vulnerable to get soiled. Cameras have a much higher degradation in performance due to soiling compared to other sensors. Thus it is critical to accurately detect soiling on th…
Deep learning identifies precipitation clouds from all-sky camera data.
problem Automating cloud warning systems for observatories.
method Deep learning using EfficientNet network.
result Average accuracy of 99% in identifying rainfall potential and 96% in cloud coverage.
V-SysId identifies keypoints and 3D system from unlabeled videos.
problem Identifying keypoints and 3D system from unlabeled videos.
method Alternates between parameter estimation and extrinsic camera calibration, using motion equations as weak supervision.
result Utility of the approach demonstrated across various settings.
A method for camera calibration using heatmap regression for fisheye images.
problem Accurate and robust camera angle estimation from fisheye images in the Manhattan world.
method Heatmap regression to detect directions of labeled image coordinates, simultaneous rotation and fisheye distortion recovery.
result Our method outperforms conventional methods on large-scale datasets and with off-the-shelf cameras.
As video camera deployments continue to grow, the need to process large volumes of real-time data strains wide area network infrastructure. When per-camera bandwidth is limited, it is infeasible for applications such as traffic monitoring and pedestrian tracking to offload high-quality video streams to a datacenter. Th…
EvAn detects anomalies in event-based camera data with reduced complexity.
problem Anomaly detection in event-based camera data.
method Dual discriminator cGAN on event data with learned representation.
result Reduction in computational complexity compared to state-of-the-art methods.
A drone-based MOT algorithm tracks vehicles using neural network detections and TPMBM filter.
problem Tracking multiple vehicles from drone-mounted cameras.
method Neural network for object detection, TPMBM filter for trajectory estimation, von-Mises Fisher distribution for DOA.
result TPMBM filter optimally estimates vehicle trajectories.
Paper uses VAEs and GANs to estimate cryo-EM image orientation and camera parameters.
problem Estimating orientation and camera parameters from noisy cryo-EM images.
method Combines VAEs and GANs to learn latent representation, then designs estimation method.
result Geometric approach for fast cryo-EM biomolecule reconstruction.
A fast geometric regularizer improves event camera performance.
problem Event collapse in contrast maximization framework.
method Geometric regularizer to mitigate overfitting.
result State-of-the-art accuracy with reduced computational complexity.
Waymo Open Dataset provides a large, diverse, and synchronized LiDAR and camera dataset for autonomous driving research.
problem Limited diversity and scale in existing self-driving datasets hinder real-world problem alignment.
method Developed a new large-scale, high-quality, diverse dataset with synchronized LiDAR and camera data.
result The dataset is 15x more diverse than the largest existing dataset based on a proposed diversity metric.
The introduction of cheap RGB-D cameras, stereo cameras, and LIDAR devices has given the computer vision community 3D information that conventional RGB cameras cannot provide. This data is often stored as a point cloud. In this paper, we present a novel method to apply the concept of convolutional neural networks to th…
Paper proposes a method to improve semantic segmentation for fisheye urban driving images.
problem Semantic segmentation for fisheye urban driving images is challenging due to distortion and lack of large datasets.
method A seven degrees of freedom augmentation method is proposed to transform rectilinear images into fisheye images.
result Training with seven-DoF augmentation improves model accuracy and robustness against distorted fisheye data.
In the emerging advancement in the branch of autonomous robotics, the ability of a robot to efficiently localize and construct maps of its surrounding is crucial. This paper deals with utilizing thermal-infrared cameras, as opposed to conventional cameras as the primary sensor to capture images of the robot's surroundi…
P3I learns holistic scene representations from a single image.
problem Inferring camera poses, object locations, and global scene structures from a single image.
method Combines search-based and gradient-based algorithms.
result P3I outperforms baselines on various image manipulation tasks.
In most agent-based simulators, pedestrians navigate from origins to destinations. Consequently, destinations are essential input parameters to the simulation. While many other relevant parameters as positions, speeds and densities can be obtained from sensors, like cameras, destinations cannot be observed directly. Ou…
Convolutional neural networks are commonly used to control the steering angle for autonomous cars. Most of the time, multiple long range cameras are used to generate lateral failure cases. In this paper we present a novel model to generate this data and label augmentation using only one short range fisheye camera. We p…
LiDAR and Camera Detection Fusion in a Real Time Industrial Multi-Sensor Collision Avoidance Systemcs.CV
Collision avoidance is a critical task in many applications, such as ADAS (advanced driver-assistance systems), industrial automation and robotics. In an industrial automation setting, certain areas should be off limits to an automated vehicle for protection of people and high-valued assets. These areas can be quaranti…
Particle identification in ground-based gamma-ray astronomy using convolutional neural networksastro-ph.IM
Modern detectors of cosmic gamma-rays are a special type of imaging telescopes (air Cherenkov telescopes) supplied with cameras with a relatively large number of photomultiplier-based pixels. For example, the camera of the TAIGA-IACT telescope has 560 pixels of hexagonal structure. Images in such cameras can be analyse…
Recent progress on many imaging and vision tasks has been driven by the use of deep feed-forward neural networks, which are trained by propagating gradients of a loss defined on the final output, back through the network up to the first layer that operates directly on the image. We propose back-propagating one step fur…
Our research focuses on analysing human activities according to a known behaviorist scenario, in case of noisy and high dimensional collected data. The data come from the monitoring of patients with dementia diseases by wearable cameras. We define a structural model of video recordings based on a Hidden Markov Model. N…
Recent work has documented the susceptibility of deep learning systems to adversarial examples, but most such attacks directly manipulate the digital input to a classifier. Although a smaller line of work considers physical adversarial attacks, in all cases these involve manipulating the object of interest, e.g., putti…
This work presents a new robust PCA method for foreground-background separation on freely moving camera video with possible dense and sparse corruptions. Our proposed method registers the frames of the corrupted video and then encodes the varying perspective arising from camera motion as missing data in a global model.…
We integrate camera pose correlations into deep models using Gaussian processes.
problem Lack of inter-frame reasoning in deep neural networks.
method Derive a principled framework combining camera pose information with deep models using a novel view kernel.
result Soft-prior knowledge aids pose-related vision tasks like novel view synthesis.
PIP-Net predicts pedestrian crossing intentions with up to 4-second lead.
problem Accurate pedestrian intention prediction for autonomous vehicles in real-world scenarios.
method Recurrent and temporal attention-based model using kinematic and spatial features.
result PIP-Net predicts pedestrian crossing intentions up to 4 seconds in advance.
Y-GAN: A Generative Adversarial Network for Depthmap Estimation from Multi-camera Stereo Imagescs.CV
Depth perception is a key component for autonomous systems that interact in the real world, such as delivery robots, warehouse robots, and self-driving cars. Tasks in autonomous robotics such as 3D object recognition, simultaneous localization and mapping (SLAM), path planning and navigation, require some form of 3D sp…
Learning from demonstration (LfD) is useful in settings where hand-coding behaviour or a reward function is impractical. It has succeeded in a wide range of problems but typically relies on manually generated demonstrations or specially deployed sensors and has not generally been able to leverage the copious demonstrat…
This work presents a novel approach for robust PCA with total variation regularization for foreground-background separation and denoising on noisy, moving camera video. Our proposed algorithm registers the raw (possibly corrupted) frames of a video and then jointly processes the registered frames to produce a decomposi…
Person re-identification (re-id), an emerging problem in visual surveillance, deals with maintaining entities of individuals whilst they traverse various locations surveilled by a camera network. From a visual perspective re-id is challenging due to significant changes in visual appearance of individuals in cameras wit…
The field of multiple view geometry has seen tremendous progress in reconstruction and calibration due to methods for extracting reliable point features and key developments in projective geometry. Point features, however, are not available in certain applications and result in unstructured point cloud reconstructions.…
Person re-identification (Re-ID) aims at matching images of the same person across disjoint camera views, which is a challenging problem in multimedia analysis, multimedia editing and content-based media retrieval communities. The major challenge lies in how to preserve similarity of the same person across video footag…
Fisheye cameras are commonly used in applications like autonomous driving and surveillance to provide a large field of view (). However, they come at the cost of strong non-linear distortions which require more complex algorithms. In this paper, we explore Euclidean distance estimation on fisheye cameras …
Automated video conferencing system improves user experience with ASD and VC.
problem Improve remote video conferencing experience through automated speaker detection and virtual cinematography.
method Uses 4K wide-FOV camera, depth camera, and microphone array to extract features and train machine learning models for ASD and VC.
result System performs within 0.3 MOS of an expert cinematographer, as rated by users.
Most existing machine learning classifiers are highly vulnerable to adversarial examples. An adversarial example is a sample of input data which has been modified very slightly in a way that is intended to cause a machine learning classifier to misclassify it. In many cases, these modifications can be so subtle that a …
Uncertainty-aware performance assessment of optical imaging modalities with invertible neural networksphysics.med-ph
Purpose: Optical imaging is evolving as a key technique for advanced sensing in the operating room. Recent research has shown that machine learning algorithms can be used to address the inverse problem of converting pixel-wise multispectral reflectance measurements to underlying tissue parameters, such as oxygenation. …
New algorithm rSVDdpd improves robustness and scalability for video surveillance background modeling.
problem Camera tampering and noisy videos make background separation challenging.
method Introduces rSVDdpd, a robust singular value decomposition technique for scalable video surveillance.
result Demonstrates superior performance on benchmark and real-life datasets.
Deep Neural Networks (DNNs) have tremendous potential in advancing the vision for self-driving cars. However, the security of DNN models in this context leads to major safety implications and needs to be better understood. We consider the case study of steering angle prediction from camera images, using the dataset fro…
Monitoring of disasters is crucial for mitigating their effects on the environment and human population, and can be facilitated by the use of unmanned aerial vehicles (UAV), equipped with camera sensors that produce aerial photos of the areas of interest. A modern technique for recognition of events based on aerial pho…
Robots detect and recognize objects in real-time for better manipulation.
problem Real-time object detection and recognition for humanoid robots.
method Modified YOLOv3 algorithm, quantization, and re-arrangement of layers for low-compute NAO robots.
result Robots can perform real-time detection, recognition, and localization of objects.
(ABRIDGED) In previous work, two platforms have been developed for testing computer-vision algorithms for robotic planetary exploration (McGuire et al. 2004b,2005; Bartolo et al. 2007). The wearable-computer platform has been tested at geological and astrobiological field sites in Spain (Rivas Vaciamadrid and Riba de S…
The usability and practicality of any machine learning (ML) applications are largely influenced by two critical but hard-to-attain factors: low latency and low cost. Unfortunately, achieving low latency and low cost is very challenging when ML depends on real-world data that are highly distributed and rapidly growing (…
Body-worn video (BWV) cameras are increasingly utilized by police departments to provide a record of police-public interactions. However, large-scale BWV deployment produces terabytes of data per week, necessitating the development of effective computational methods to identify salient changes in video. In work carried…
A new approach for learning from expert demonstrations using multiple perspectives.
problem Learning from expert demonstrations with limited information from different perspectives.
method Generative adversarial network-based active learning approach.
result Our approach effectively learns from expert demonstrations and highlights the importance of architectural choices.
Body-worn cameras are now commonly used for logging daily life, sports, and law enforcement activities, creating a large volume of archived footage. This paper studies the problem of classifying frames of footage according to the activity of the camera-wearer with an emphasis on application to real-world police body-wo…
We give lower and upper bounds for the first eigenvalue of geodesic balls in spherically symmetric manifolds. These lower and upper bounds are -dependent on the metric coefficients. It gives better lower bounds for the first eigenvalue of spherical caps than those from Betz-Camera-Gzyl.