Can machine learning predict pedestrian destinations from video data?
problem Determining pedestrian destinations from video data without direct observation.
method Used density heatmaps as input to train a Random Forest predictor.
result Motivated further analysis of the methodology.
CADO optimizes heatmap-based solvers for cost minimization, overcoming performance limitations.
problem Heatmap-based solvers lack objective alignment for cost minimization.
method CADO uses Reinforcement Learning to optimize solution cost directly, introducing Label-Centered Reward and Hybrid Fine-Tuning.
result CADO achieves state-of-the-art performance across diverse benchmarks.
Bayesian approach for aggregating unreliable data sources to create accurate heatmaps.
problem Classifying regions with sparse, unreliable data from multiple sources.
method Bayesian Gaussian Process classifier that models reliability and bias of each data source.
result Reduces crowdsourced data needed and improves accuracy of heatmaps.
Paper proposes a method to interpret deep neural networks using attention mechanisms.
problem Interpreting deep neural network models to understand their performance.
method Proposes a novel method using attention mechanisms to analyze neural network models.
result Improved attention based method shows better classifier interpretation.
A method for camera calibration using heatmap regression for fisheye images.
problem Accurate and robust camera angle estimation from fisheye images in the Manhattan world.
method Heatmap regression to detect directions of labeled image coordinates, simultaneous rotation and fisheye distortion recovery.
result Our method outperforms conventional methods on large-scale datasets and with off-the-shelf cameras.
Study evaluates saliency maps on artificial data with different backgrounds.
problem Objective evaluation of saliency methods on artificial data with varying backgrounds.
method Developed a framework to generate artificial data with synthetic lesions and a known ground truth map, evaluated two data sets with different backgrounds (Perlin noise and 2D brain MRI slices).
result Heatmaps vary strongly between saliency methods and backgrounds.
New approach predicts event probabilities for better event detection.
problem Class imbalance and inaccurate event detection in time series analysis.
method Regression-based approach to predict probability densities at event locations.
result Regression-based approaches outperform segmentation-based methods.
Deep learning model detects landmarks in X-ray cephalograms.
problem Automatically detecting landmarks in cephalometric X-ray images.
method 2-stage U-Net with attention mechanism and Expansive Exploration strategy.
result State-of-the-art results in landmark detection.
FCDD explains deep anomaly detection by mapping anomalies away and providing heatmap explanations.
problem Deep one-class classification's non-linear transformation makes it hard to interpret.
method FCDD learns a mapping that concentrates nominal samples, maps anomalies away, and provides heatmap explanations.
result FCDD sets a new state of the art in unsupervised anomaly detection on MVTec-AD.
Background: In cognitive neuroscience the potential of Deep Neural Networks (DNNs) for solving complex classification tasks is yet to be fully exploited. The most limiting factor is that DNNs as notorious 'black boxes' do not provide insight into neurophysiological phenomena underlying a decision. Layer-wise Relevance …
cGAP visualizes high-dimensional categorical data with interpretable geometric structure.
problem Lack of visualization tools for high-dimensional categorical data.
method cGAP uses Homogeneity Analysis (HOMALS) to embed data in a 3D space and maps it to colors.
result cGAP reveals coherent clusters, outliers, and local-to-global structure in categorical data.
cGAP visualizes high-dimensional categorical data with interpretable geometric structure.
problem Lack of visualization tools for high-dimensional categorical data.
method cGAP uses Homogeneity Analysis (HOMALS) to embed data in a 3D space and maps it to colors for visualization.
result cGAP reveals coherent clusters, outliers, and local-to-global structure in categorical data.
DPERC efficiently estimates covariance matrices for mixed data with missing values.
problem Estimating covariance matrices for datasets with missing values and mixed features.
method Direct Parameter Estimation for Randomly Missing Data with Categorical Features (DPERC).
result DPERC outperforms other methods in estimating covariance matrices for mixed data with missing values.
Paper evaluates CNN-based facial landmark detection methods.
problem Evaluate characteristics and performance of CNN-based facial landmark detection methods.
method Divided into regression and heatmap approaches, investigated using a hybrid loss function and discrimination network.
result Proposed model outperforms other models in all tested datasets.
Paper proposes model to assess financial risk of grid-ignited wildfires.
problem Financial risk and solvency threats from grid-ignited wildfires.
method Integrated model to evaluate damage costs and risk levels.
result Identifies high-risk areas for preemptive actions.
We improve neural network explainability by bypassing batch normalization.
problem Lack of transparency in neural networks.
method Layer-wise Relevance Propagation with a method to include normalization layers.
result Heatmaps are more accurate for convolutional layers with our method.
Deep learning animates objects from input images and videos.
problem Animating arbitrary objects from input images and videos.
method A deep learning framework with three modules: Keypoint Detector, Dense Motion prediction network, and Motion Transfer Network.
result Our method outperforms state-of-the-art image animation and video generation methods.
Proposes AtCoR for predicting bike station usage, improving station network reconfiguration.
problem Challenges in predicting new bike stations due to lack of historical data.
method AtCoR algorithm that predicts both existing and new bike stations using station-centered heatmaps and historical correlations.
result AtCoR outperforms existing models in predicting bike station usage.
Analyzed banking crises across 66 countries, showing interconnections and clustering patterns.
problem Characterizing banking crises and their interconnections across different countries.
method Used dichotomous banking crises time series data from 1800 to 2014, analyzed via heatmap matrices and clustering.
result Countries exhibit pairwise correlation in banking crises, and crises tend to affect countries with financial links.
New tools explain FRF model predictions in high-dimensional ECG data.
problem Lack of interpretability in Functional Random Forests (FRF) models.
method Introduces FPDPs, FPC Probability Heatmaps, and various FPC importance metrics.
result Enhances transparency of FRF models by revealing FPC contributions.
Proposes a new method for explaining deep CNNs used in MRI-based AD diagnosis.
problem Lack of transparency and interpretability in deep CNN models for AD diagnosis.
method Swap Test method designed specifically for brain scan task.
result Proposed method provides more suitable explanations for AD diagnosis using MRI.
Paper identifies and solves a 'scrambled translation' issue in UNMT models.
problem Scrambled translation in UNMT models using word shuffle noise.
method Retraining UNMT models without noise after a pre-defined number of iterations.
result Retraining strategy improves BLEU scores by 10-20% on various language pairs.
MCD offers a complete model understanding for high-stake decisions.
problem Local model understanding in XAI methods is not sufficient for high-stake decisions.
method MCD extends concept-based methods to ensure global model understanding via multi-dimensional subspaces.
result MCD provides a complete model understanding, ensuring the model reasoning is related to the actual model.
Satellite images improve real-estate price predictions.
problem Improving accuracy of real-estate price predictions.
method Used convolutional neural networks (CNN) to incorporate satellite image data.
result CNN model trained on satellite images and structured data performs 7% better in MAE.
TrackNet tracks tiny balls in sports videos with high precision.
problem Accurately tracking tiny and fast-moving objects like tennis balls in sports videos.
method Developed a heatmap-based deep learning network, TrackNet, trained on public and additional labeled videos.
result Achieved high precision (99.7%) in ball tracking on public domain videos.
Simple aggregation of multiple methods defends against adversarial attacks on neural networks.
problem Manipulation of machine learning models to hide discriminating features.
method Aggregation of multiple explanation methods to make the model robust against adversarial attacks.
result The model remains robust even when the attacker has knowledge of the model weights and explanation methods.
Current XAI research lacks solid foundations and clear goals.
problem Inadequate conceptual, ethical, and methodological foundations in XAI research.
method Discussion of misconceptions and suggestions for improvement.
result Current XAI research needs to address conceptual, ethical, and methodological issues.
Neural nets predict user attention from mouse movements.
problem Predicting user attention from mouse cursor movements.
method Investigated different mouse movement representations and trained neural networks.
result Neural networks outperform handcrafted features for predicting user attention.
Paper proposes a method to detect glare in document images.
problem Glare obscures text in document images, hindering recognition.
method Divides document into blocks, collects luminance and histogram features, uses CNN to detect glare.
result High recall and f-score in detecting glare.
This paper focuses on the problem of explaining predictions of psychological attributes such as attractiveness, happiness, confidence and intelligence from face photographs using deep neural networks. Since psychological attribute datasets typically suffer from small sample sizes, we apply transfer learning with two ba…
Applying deep learning methods to mammography assessment has remained a challenging topic. Dense noise with sparse expressions, mega-pixel raw data resolution, lack of diverse examples have all been factors affecting performance. The lack of pixel-level ground truths have especially limited segmentation methods in push…
Humans take advantage of real world symmetries for various tasks, yet capturing their superb symmetry perception mechanism with a computational model remains elusive. Motivated by a new study demonstrating the extremely high inter-person accuracy of human perceived symmetries in the wild, we have constructed the first …
The paper uses DNN for electricity price forecasting and XAI for understanding the factors.
problem Complex interactions and dependencies in electricity markets make it hard to understand price dynamics.
method Used DNN for forecasting and XAI (SHAP, Gradient, heatmaps) for understanding factors.
result Introduced novel concepts SSHAP values and SSHAP lines for enhanced representation of high-dimensional tabular models.
A new matrix factorization method for high-dimensional data.
problem Exploiting sparse structures in complex data for better interpretability.
method Bayesian shrinkage priors and flexible sparse patterns modeled through row and column dependencies.
result Demonstrated practical advantages through simulation and soccer heatmap analysis.
New method discovers concepts in hidden feature layers using sparse subspace clustering.
problem Local attribution methods fail to identify coherent model behavior across samples.
method Sparse Subspace Clustering (SSCC) for concept discovery.
result Empirically validated method for various image classification tasks.
Unsupervised learning of time series data, also known as temporal clustering, is a challenging problem in machine learning. Here we propose a novel algorithm, Deep Temporal Clustering (DTC), to naturally integrate dimensionality reduction and temporal clustering into a single end-to-end learning framework, fully unsupe…
Unsupervised deep learning detects image quality issues without annotations.
problem Anomaly detection in images with quality issues.
method Use of deep generative models, specifically normalizing flows, for anomaly detection.
result Accurate semantic labeling and quality trends observed in images.
Wavelet Attribution Method (WAM) improves feature attribution for deep models.
problem Inability of pixel-based heatmaps to capture data structure and variability in feature attribution.
method Wavelet domain for feature attribution, leveraging spatial and scale-localized properties of wavelet coefficients.
result WAM provides quantitatively superior explanations across audio, image, and volume modalities.
Proposes a novel anomaly detection method for echocardiogram videos.
problem Anomaly detection in echocardiogram videos.
method Dynamic Variational Trajectory Models (TVAE-C, TVAE-R, TVAE-S) trained on healthy infant echocardiogram videos.
result Superior performance in detecting congenital heart defects and pulmonary hypertension.
URT layer improves few-shot image classification across diverse domains.
problem Few-shot image classification in multi-domain settings.
method Meta-learns to dynamically re-weight and compose domain-specific representations.
result Sets new state-of-the-art on Meta-Dataset.
XLabel tool reduces medical experts' workload by 40% and explains its decisions.
problem Efficiently labeling large electronic health records.
method Visual-interactive tool using Explainable Boosting Machine (EBM) for classification and explanation.
result EBM achieves high accuracy and explainability, even with mislabeled data.
New framework quantifies uncertainties in neural network explanations.
problem Lack of methods to quantify uncertainties in neural network explanations.
method Converts any explanation method into a Bayesian neural network method, modeling uncertainties.
result Allows quantification of explanation uncertainties and appropriate confidence levels.
A neural network improves DOA estimation from a single snapshot.
problem Estimating DOAs from a single snapshot with limited aperture.
method Deep learning architecture trained to generate high-resolution spatial spectrum.
result Our (SP)2-Net outperforms classical methods. MCD reformulates conditional density estimation into binary classification.
problem Conditional density estimation in statistical and machine learning.
method Marginal Contrastive Discrimination, reformulating into marginal and ratio density functions for binary classification.
result Significantly outperforms existing methods on most density models and regression datasets.
A new model for estimating multivariate densities efficiently.
problem Estimating complex multivariate densities efficiently.
method CDO model based on kernel mean embeddings and RKHS.
result Competitive performance with neural models and Gaussian processes.
Paper proposes MMC to avoid high-density bias in clustering.
problem High-density bias in density-based clustering.
method Introduces mass distribution as a better foundation for clustering, proposing mass-maximization clustering (MMC).
result MMC avoids high-density bias and discovers clusters of arbitrary shapes, sizes, and densities.
A new method for spotting symbols in CAD images reduces annotation costs and improves accuracy.
problem Challenging task of labeling symbols from CAD drawings.
method Pixel-wise point location via Progressive Gaussian Kernels (PGK) and local offset.
result The proposed method achieves good generalization on real-world CAD images.
New method minimizes robust density power-based divergences for general parametric densities.
problem Computational complexity of minimizing DPD for general parametric densities.
method Stochastic approach to minimize DPD for general parametric density models.
result Proposed method can be applied to minimize other density power-based γ-divergences.