Detect facial keypoints is a critical element in face recognition. However, there is difficulty to catch keypoints on the face due to complex influences from original images, and there is no guidance to suitable algorithms. In this paper, we study different algorithms that can be applied to locate keyponits. Specifical…
PRNet registers partial 3D shapes using deep learning.
problem Partial-to-partial point cloud registration.
method Self-supervised deep learning network for non-convex alignment and partial correspondence.
result Outperforms existing methods on synthetic data.
This paper presents KeypointNet, an end-to-end geometric reasoning framework to learn an optimal set of category-specific 3D keypoints, along with their detectors. Given a single image, KeypointNet extracts 3D keypoints that are optimized for a downstream task. We demonstrate this framework on 3D pose estimation by pro…
V-SysId identifies keypoints and 3D system from unlabeled videos.
problem Identifying keypoints and 3D system from unlabeled videos.
method Alternates between parameter estimation and extrinsic camera calibration, using motion equations as weak supervision.
result Utility of the approach demonstrated across various settings.
KINet learns object interactions without supervision for robotic pushing.
problem Lack of supervised data for object-centric forward prediction.
method End-to-end unsupervised framework using keypoint representation and contrastive estimation.
result Automatically generalizes to unseen scenarios and accurately predicts future states.
The paper uses facial keypoints to estimate post-surgical pain intensity.
problem Accurately assessing pain levels from self-reported ratings is challenging.
method The approach analyzes 2D and 3D facial keypoints to estimate pain intensity.
result The pain estimation model uses multiple instance learning.
New mutual information framework improves contrastive learning for vision tasks.
problem Maximizing mutual information for better unsupervised learning representations.
method Reformulated mutual information as a lower bound, introducing new negative sampling strategies.
result Improved representations outperform previous methods in various vision tasks.
This paper introduces a novel deep learning framework for image animation. Given an input image with a target object and a driving video sequence depicting a moving object, our framework generates a video in which the target object is animated according to the driving sequence. This is achieved through a deep architect…
We present an unsupervised approach for learning to estimate three dimensional (3D) facial structure from a single image while also predicting 3D viewpoint transformations that match a desired pose and facial geometry. We achieve this by inferring the depth of facial keypoints of an input image in an unsupervised manne…
Model discovers causal relationships from video data of physical systems.
problem Discover structural dependencies and causal interactions in physical systems from video data.
method End-to-end model with perception, inference, and dynamics modules; handles unknown interventions.
result Model correctly identifies causal interactions and makes long-term predictions.
End-to-end trainable graph matching using improved combinatorial solvers.
problem Graph matching in deep learning.
method Combining deep learning with optimized combinatorial solvers.
result Advances state-of-the-art on deep graph matching benchmarks.
Improved visual representation learning with conditional negative sampling.
problem Learning strong unsupervised visual representations using contrastive learning.
method Introduce a family of mutual information estimators that sample negatives conditionally.
result Improves accuracy by 2-5% points on four standard image datasets.
A method for camera calibration using heatmap regression for fisheye images.
problem Accurate and robust camera angle estimation from fisheye images in the Manhattan world.
method Heatmap regression to detect directions of labeled image coordinates, simultaneous rotation and fisheye distortion recovery.
result Our method outperforms conventional methods on large-scale datasets and with off-the-shelf cameras.
Introduces Motion Programs for better video analysis of human motion.
problem Current video analysis focuses on raw pixels or keypoints, missing higher-level motion primitives.
method Introduces Motion Programs as a neuro-symbolic representation of motions as a composition of high-level primitives.
result Motion Programs accurately describe diverse human motions and improve downstream tasks.
New method improves human mesh recovery for obese people.
problem Improving mesh recovery for obese people.
method Generative optimization of mesh parameters from 2D keypoints.
result Significant improvement in mesh recovery performance on obese person images.
A new method for spotting symbols in CAD images reduces annotation costs and improves accuracy.
problem Challenging task of labeling symbols from CAD drawings.
method Pixel-wise point location via Progressive Gaussian Kernels (PGK) and local offset.
result The proposed method achieves good generalization on real-world CAD images.
Simple methods improve regression transferability estimation.
problem Estimating how well regression models transfer between tasks.
method Two simple, computationally efficient approaches based on negative regularized mean squared error.
result Significantly outperform existing methods in accuracy and efficiency.
We propose Progressive Structure-conditional Generative Adversarial Networks (PSGAN), a new framework that can generate full-body and high-resolution character images based on structural information. Recent progress in generative adversarial networks with progressive training has made it possible to generate high-resol…
We tackle here the problem of multimodal image non-rigid registration, which is of prime importance in remote sensing and medical imaging. The difficulties encountered by classical registration approaches include feature design and slow optimization by gradient descent. By analyzing these methods, we note the significa…
Meta Omnium benchmarks few-shot learning across diverse vision tasks.
problem Evaluating generalization of few-shot learning across multiple vision tasks.
method Introduction of Meta Omnium dataset and evaluation of meta-learning algorithms.
result Meta-learning algorithms can generalize across diverse vision tasks.
Prediction and interpolation for long-range video data involves the complex task of modeling motion trajectories for each visible object, occlusions and dis-occlusions, as well as appearance changes due to viewpoint and lighting. Optical flow based techniques generalize but are suitable only for short temporal ranges. …
Quantum machine learning improves satellite image alignment.
problem Align satellite images taken at different times and angles.
method Quantum machine learning techniques for feature extraction and matching.
result Quantum methods show potential for future improvements.
The explanation of the photoelectric effect by Einstein and Maxwell's field theory of electromagnetism have motivated De Broglie to make the hypothesis that matter exhibits both waves and particles like-properties. These representations of matter are enlightened by string theory which represents particles with stringli…
The paper proposes blending gradient boosted trees and neural networks for hierarchical time series forecasting.
problem Point and probabilistic forecasting of hierarchical time series.
method A blending methodology of gradient boosted trees and neural networks, with feature engineering and diverse model selection.
result Ranked within the gold medal range in both Accuracy and Uncertainty tracks of the M5 Competition.
The field of multiple view geometry has seen tremendous progress in reconstruction and calibration due to methods for extracting reliable point features and key developments in projective geometry. Point features, however, are not available in certain applications and result in unstructured point cloud reconstructions.…
New link detection results using closures of 3-braids.
problem Link detection using homology theories.
method Closure operations on 3-braids and homology theories.
result Detection of specific links using link Floer homology, Khovanov homology, and annular Khovanov homology.
Deep learning improves anomaly detection across various fields.
problem Detecting anomalies in data with advanced approaches.
method Survey of deep learning methods for anomaly detection.
result Advancements in deep anomaly detection address unique challenges.
Graph energy helps detect communities in networks better than traditional methods.
problem Detecting communities in sparse networks where traditional methods fail.
method Using graph energy based on the full spectrum of adjacency matrices.
result The difference in graph energy between a planted partition model and an Erdős--Rényi network has a distinct transition at the detectability threshold.
Monitoring gas turbine combustors health, in particular, early detecting abnormal behaviors and incipient faults, is critical in ensuring gas turbines operating efficiently and in preventing costly unplanned maintenance. One popular means of detecting combustor abnormalities is through continuously monitoring exhaust g…
New ML-based detection improves PMH signal detection in load-modulated MIMO systems.
problem Detecting PMH signals without prior CSI is challenging and computationally expensive.
method Proposes HEM-ML and HEM-KD schemes using EM and KD-tree for efficient detection.
result Achieves comparable detection results to optimal ML detector with reduced complexity.
Develops slope detection for 3-manifolds with torus boundaries.
problem Determining slopes on the boundary of 3-manifolds with torus boundaries.
method Introduces order-detection and representation-detection of slopes, proving their equivalence.
result Shows how slopes' behavior changes with cabling, improving previous results.
2DSig-Detect detects adversarial perturbations in images.
problem Adversarial attacks degrade image model performance.
method 2D-signature embedded semi-supervised framework using rough path theory.
result 2DSig-Detect outperforms other methods in detecting adversarial perturbations.
Develops a method to detect changes in linear systems with temporal correlations.
problem Detect abrupt changes in time series data with temporal correlations.
method Data-dependent threshold for online change point detection in linear dynamical systems.
result Achieves a pre-specified upper bound on the probability of false alarms and provides a finite-sample-based bound for detection probability.
Tackles the computational hardness of HPC detection, conjecturing equivalence to PC detection.
problem Computational hardness of hypergraphic planted clique detection.
method No specific method mentioned; focuses on conjecturing equivalence.
result Equivalence of computational hardness between HPC and PC detection.
Real-time fuel leakage detection framework MOCPD improves accuracy.
problem Early detection of fuel leakage to prevent hazards and losses.
method Memory-based Online Change Point Detection (MOCPD) framework.
result MOCPD outperforms baseline methods in detection accuracy.
Study on detecting hierarchical community structures in networks.
problem Detecting hierarchical community structures in networks.
method Analysis of planted hierarchies of partitions in networks, identifying additional detectability phases.
result There are additional phases in which the presence of multiple consistent partitions can either help or hinder detection of hierarchical structures.
Deep object detection improves mitotic nucleus detection in breast cancer biopsies.
problem Challenges in automated mitotic nucleus detection in breast cancer histopathological images.
method Adapted Mask R-CNN for deep object detection, initially selects candidate regions with maximum recall, refines them with multi-object loss function.
result Improved discrimination ability (F-score of 0.86) and significant precision (0.86) for mitotic nuclei compared to two-stage models.
ECAD detects anomalies without data exchangeability, improving traffic flow detection.
problem Detecting anomalies in spatio-temporal data with missing values.
method ECAD uses conformal prediction to wrap around any regression algorithm, controlling Type-I error without data exchangeability.
result ECAD outperforms other methods in detecting anomalous traffic flow.
Autonomous driving requires 3D perception of vehicles and other objects in the in environment. Much of the current methods support 2D vehicle detection. This paper proposes a flexible pipeline to adopt any 2D detection network and fuse it with a 3D point cloud to generate 3D information with minimum changes of the 2D d…
PAC-Wrap provides provable guarantees for semi-supervised anomaly detection.
problem Ensuring reliable anomaly detection in safety-critical applications.
method PAC-Wrap wraps around existing anomaly detection methods to provide PAC guarantees.
result PAC-Wrap effectively provides rigorous guarantees for various anomaly detectors.
This paper offers a distribution-free method for post-detection changepoint localization.
problem Locating the exact time of a change in distribution after a sequential detection procedure.
method A distribution-free framework using conformal test martingales for sequential change detection and post-detection inference.
result Valid post-detection coverage guarantees and non-asymptotic bounds on confidence set size.
The study defines backdoor detection in ML and proves its infeasibility.
problem Backdoor detection in machine learning systems.
method Formal statistical definition and analysis of feasibility.
result Backdoor detection is impossible except for very small alphabet sizes.
Detects data drift in deep learning models using neural embeddings.
problem Detecting changes in data distribution in deep learning models.
method Formulates drift detection in a sequential decision framework and introduces a loss function to balance false alarms and quick detection.
result Demonstrates improved ability to balance false alarms and quick detection in change detection.
It follows from earlier work of Silver-Williams and the authors that twisted Alexander polynomials detect the unknot and the Hopf link. We now show that twisted Alexander polynomials also detect the trefoil and the figure-8 knot, that twisted Alexander polynomials detect whether a link is split and that twisted Alexand…
This research identifies flaws in drift detection methods and creates adversarial data streams to exploit them.
problem The challenge of detecting data distribution changes (drift) in real-time systems.
method Developed adversarial data streams to show weaknesses in existing drift detection schemes.
result Demonstrated that common drift detection methods can be fooled by adversarial data streams.
Multimodal deep learning improves flaw detection in software programs.
problem Current flaw detection relies on single software representations.
method Adapted multimodal deep learning models for flaw detection.
result Multimodal models outperform traditional deep learning models.
New method detects OOD samples using neural network trajectories.
problem Lack of comprehensive layer exploration in OOD detection.
method Functional data perspective, analyzing sample trajectories through multi-layer classifier.
result Empirically validated as effective compared to state-of-the-art methods.
Proposes OCGNN for detecting anomalies in graph data.
problem Detecting anomalies in graph-structured data.
method One Class Graph Neural Network (OCGNN) combining Graph Neural Networks and one-class classification.
result Significant improvements in anomaly detection compared to baselines.