FedVision uses federated learning to improve object detection without transmitting data.
problem Challenges in building object detection models on large training datasets due to privacy and cost issues.
method Federated learning (FL) platform for easy integration by non-experts.
result Significant efficiency improvement and cost reduction in smart city applications.
The NIPS 2018 Adversarial Vision Challenge is a competition to facilitate measurable progress towards robust machine vision models and more generally applicable adversarial attacks. This document is an updated version of our competition proposal that was accepted in the competition track of 32nd Conference on Neural In…
Survey on deep neural networks for vision and speech.
problem Improving intelligent vision and speech systems.
method Review of deep learning models and challenges.
result Emerging technologies show promise for future systems.
Real-time uncertainty estimation for computer vision tasks.
problem Real-time inference of uncertainty in deep learning models.
method Uncertainty-Aware Distribution Distillation method for fast inference.
result Significantly reduced inference time with improved uncertainty and predictive performance.
This paper tackles shape denoising in computer vision and medical imaging.
problem Handling shapes with missing pieces or outliers in shape modeling.
method Introduces six types of noise and an objective measure for shape denoising.
result Evaluates seven shape denoising methods, six of which are based on deep learning.
Top 8 robotic vision systems tackled lifelong object recognition challenges.
problem Lifelong learning in robotic vision for varied, dynamic environments.
method Design of a dataset with diverse conditions and rules for evaluation.
result Robotic vision systems improved over time with dynamic object appearances.
A basic assumption of statistical learning theory is that train and test data are drawn from the same underlying distribution. Unfortunately, this assumption doesn't hold in many applications. Instead, ample labeled data might exist in a particular `source' domain while inference is needed in another, `target' domain. …
Mobile V-MoEs scale down ViTs for resource-constrained vision tasks.
problem Scaling down Vision Transformers for resource-constrained applications.
method Sparse Mixture-of-Experts (MoEs) applied to entire images, with a stable training procedure.
result Mobile V-MoEs achieve better performance-efficiency trade-offs than dense ViTs.
Computer vision models are unstable due to task symmetries and labelling issues.
problem Instability of computer vision models in classification tasks.
method Analysis of symmetries, categorical nature, and labelling issues.
result Instability is a necessary result of current computer vision formulation.
CViT learns complex physical systems using vision transformer techniques.
problem Learning maps between infinite-dimensional function spaces in scientific machine learning.
method Combines vision transformer encoder, grid-based coordinate embedding, and cross-attention mechanism.
result Achieves state-of-the-art performance on multiple benchmarks, often surpassing larger models.
New dataset and benchmarks for lifelong robotic vision tasks.
problem Challenges in applying computer vision to robots, especially lifelong learning.
method Provided a new lifelong robotic vision dataset and benchmarks.
result Demonstrated the complexity and bottlenecks in lifelong object recognition.
Bayesian deep learning methods improve uncertainty estimation in computer vision.
problem Estimating uncertainty in deep learning models for robust computer vision.
method Comprehensive evaluation framework for scalable epistemic uncertainty estimation methods.
result Ensembling provides more reliable uncertainty estimates than MC-dropout.
Meta Omnium benchmarks few-shot learning across diverse vision tasks.
problem Evaluating generalization of few-shot learning across multiple vision tasks.
method Introduction of Meta Omnium dataset and evaluation of meta-learning algorithms.
result Meta-learning algorithms can generalize across diverse vision tasks.
Study proposes a statistical test for Vision Transformer's attention mechanisms.
problem ViT's attention mechanisms may focus on irrelevant regions, leading to unreliable evidence.
method Selective inference framework to quantify statistical significance of attentions as p-values.
result Proposed method enables reliable quantification of false positive detection probability of attentions.
Study evaluates conformal prediction methods for safety in vision models under shifts and long-tailed data.
problem Safety guarantees of conformal prediction methods under distribution shifts and long-tailed data.
method Empirical evaluation of post-hoc and training-based conformal prediction methods on large-scale datasets and models.
result Performance of conformal prediction methods degrades significantly under distribution shifts and long-tailed data.
Systematic review of machine vision in robotics, highlighting challenges and improvements.
problem Challenges in machine vision for robotics, especially occlusion and lighting variance.
method Systematic literature review of 172 papers from four databases, selecting 52 relevant papers.
result Robustness and computation time improvements, but occlusion and lighting variance remain major issues.
IrisNet tracks tongue contours in ultrasound videos using deep learning.
problem Automatic and real-time tracking of tongue contours in ultrasound videos.
method Convolutional neural network mimicking peripheral vision.
result Outstanding generalization on various ultrasound tongue datasets.
Develops methods for training models with few annotations in computer vision tasks.
problem Training models with limited labeled data in computer vision.
method Theoretical, algorithmic, and experimental contributions for Meta-Learning and Semi-Supervised Learning.
result Improves Contrastive Learning and proposes a semi-supervised method for transformer-based object detectors.
Automate residual plot assessment with R package and Shiny application
problem Diagnosing linear models
method Computer vision model for residual plot assessment
result Predicts visual signal strength and supports model fit assessment
This work makes vision networks more interpretable by identifying key neurons.
problem Complex deep networks are hard to interpret, hindering safety-critical applications.
method Uses stochastic local competition and multimodal models to dissect and interpret neurons.
result The method generates understandable descriptions for a few active neurons, revealing network decision-making.
TACTO simulates high-resolution touch sensing for robotics.
problem Accurate simulation of touch sensing in robotics.
method Fast, flexible, open-source simulator for vision-based tactile sensors.
result Demonstrated TACTO's effectiveness in grasping stability prediction and marble manipulation control.
Paper proposes multiscale self-attentive convolutions for vision and language.
problem Improving language and vision understanding models using self-attention.
method Developed 1D and 2D Self Attentive Convolutions (SAC), multiscale SAC (MSAC).
result MSAC enhances model performance for vision and language tasks.
Paper explores how analysts balance rule-based and situational aspects of data analytics.
problem Balancing mechanistic and situational aspects of data analytics.
method CSCW and social science research, ethnographic fieldwork.
result Effective data vision requires straddling formal abstraction and empirical contingency.
In this thesis I explore challenging discrete energy minimization problems that arise mainly in the context of computer vision tasks. This work motivates the use of such "hard-to-optimize" non-submodular functionals, and proposes methods and algorithms to cope with the NP-hardness of their optimization. Consequently, t…
This paper surveys black-box attacks on computer vision models.
problem Real-life adversarial attacks on deep learning models.
method Comprehensive comparative study of attacks and defenses.
result Significant amount of research on reliability of models.
New methods for graph completion improve image annotation and neuroimaging.
problem Sequential acquisition of partial measurements on graphs.
method Optimization model in Fourier domain, adaptive submodularity.
result Promising results on images and neuroimaging applications.
Sparse Vision MoE matches dense networks in image recognition while using less compute.
problem Scaling vision models efficiently in computer vision.
method Vision MoE (V-MoE) - a sparse version of Vision Transformer.
result V-MoE matches state-of-the-art dense networks in image recognition with half the compute.
Robust CLIP improves vision models' resistance to attacks.
problem Vulnerability of vision models to adversarial attacks.
method Unsupervised adversarial fine-tuning of CLIP.
result Robust CLIP prevents stealth attacks on vision models.
WoodScape dataset for fisheye cameras in autonomous driving.
problem Lack of public datasets for evaluating computer vision on fisheye images.
method Release WoodScape dataset with four surround view cameras and nine tasks.
result Encourages adaptation of computer vision models for fisheye cameras.
CVPR 2020 challenge evaluates continual learning in computer vision.
problem Making AI systems more adaptive and efficient.
method Evaluated different continual learning approaches on a common hardware with shared metrics.
result Reported main results, finalists, and prize winners.
We integrate camera pose correlations into deep models using Gaussian processes.
problem Lack of inter-frame reasoning in deep neural networks.
method Derive a principled framework combining camera pose information with deep models using a novel view kernel.
result Soft-prior knowledge aids pose-related vision tasks like novel view synthesis.
Motivated by vision tasks such as robust face and object recognition, we consider the following general problem: given a collection of low-dimensional linear subspaces in a high-dimensional ambient (image) space and a query point (image), efficiently determine the nearest subspace to the query in ℓ1 distance. We …
Computer vision SSL methods show effectiveness on time series data.
problem Evaluate if computer vision SSL frameworks are effective on time series data.
method Evaluated on UCR and UEA archives, proposed a new method improving VICReg.
result Computer vision SSL frameworks can be effective on time series data.
Survey of complex-valued neural networks for improved performance.
problem Lack of complex-valued neural networks in machine learning frameworks.
method Literature review of CVNNs.
result Advantages of CVNNs over real-valued neural networks.
Quantum hybrid vision transformers improve event classification in high energy physics.
problem Excessive computational resources for training and deploying vision transformer models.
method Constructed quantum hybrid vision transformers for high energy physics event classification.
result Quantum hybrid models achieve comparable performance to classical models with fewer parameters.
Graphs provide an efficient tool for object representation in various computer vision applications. Once graph-based representations are constructed, an important question is how to compare graphs. This problem is often formulated as a graph matching problem where one seeks a mapping between vertices of two graphs whic…
LeagueAI generates synthetic data for better object detection in video games.
problem Laborious work of gathering large amounts of hand-labeled data for machine vision applications.
method Automatic synthetic dataset generation using game 3D models and background.
result Models trained on synthetic data outperformed those on hand-labeled data in precision and reliability.
A number of results have recently demonstrated the benefits of incorporating various constraints when training deep architectures in vision and machine learning. The advantages range from guarantees for statistical generalization to better accuracy to compression. But support for general constraints within widely used …
Improved model robustness against corruptions using online adaptation.
problem Machine vision models' vulnerability to image corruptions like blurring or compression artefacts.
method Using corrupted images' statistics for unsupervised online adaptation to improve robustness.
result ResNet-50 achieves 62.2% mCE on ImageNet-C with adaptation, improving from 76.7% without.
This paper surveys algorithmic advancements in Optimal Transport with applications in machine learning.
problem Quantifying differences between distributions in various fields.
method Examines classical and modern computational techniques, including Sinkhorn iterations and primal-dual strategies.
result Highlights the robustness and scalability of OT algorithms in high-dimensional problems.
GSA-Nets apply group equivariance to self-attention for vision tasks.
problem Improving self-attention networks for vision tasks.
method Define group-equivariant positional encodings.
result GSA-Nets outperform non-equivariant self-attention networks on vision benchmarks.
3DB framework tests and debugs computer vision models using photorealistic simulation.
problem Discovering vulnerabilities and understanding model decision-making in computer vision systems.
method Unified framework using photorealistic simulation to test and debug vision models.
result Insights generated by 3DB transfer to the physical world, enabling robustness analysis.
Integrating visual and linguistic information into a single multimodal representation is an unsolved problem with wide-reaching applications to both natural language processing and computer vision. In this paper, we present a simple method to build multimodal representations by learning a language-to-vision mapping and…
Introduces basic facts on early vision's functional architecture.
problem Accessibility of early vision's functional architecture for non-specialists.
method Survey of three neurogeometric models and discussion of the conformal model.
result Synthesis of symplectic and spherical models into the conformal model.
Proposes hinge-Wasserstein to improve uncertainty estimation in regression tasks.
problem Estimating multimodal aleatoric uncertainty in regression tasks from images.
method Regression-by-classification paradigm with hinge-Wasserstein loss.
result Hinge-Wasserstein loss improves uncertainty estimation on challenging tasks.
The paper investigates AI robustness through experiments and statistical analysis.
problem Inaccurate AI predictions can lead to safety and adoption issues.
method Design of experiments framework to study AI classification robustness.
result AI algorithms' robustness is influenced by various factors.
Vision and language tasks often fail to test AI comprehensively.
problem Current vision and language tasks are flawed due to dataset and evaluation issues.
method Review of current state and proposal for improvement.
result State-of-the-art systems perform well due to dataset and evaluation flaws.
Large-scale labeled training datasets have enabled deep neural networks to excel on a wide range of benchmark vision tasks. However, in many applications it is prohibitively expensive or time-consuming to obtain large quantities of labeled data. To cope with limited labeled training data, many have attempted to directl…