New method visualizes decision boundaries of classification models.
problem Difficulty in understanding how classification models interpret data.
method Hybrid supervised-unsupervised technique for visualizing decision boundaries.
result Provides interpretable maps for qualitative and quantitative analysis.
We propose a method to visualize class similarity in large-scale classifiers.
problem Analyzing hierarchical structures and relationships in large-scale classification.
method Compute class similarity based on prediction scores and visualize the class similarity matrix.
result Visualizing class similarity matrices reveals hierarchical structures and relationships.
Visual design improves financial data classification accuracy.
problem Improving financial decision-making through better data representation.
method Comparing numeric vs visual data representations in supervised classification.
result Visual transformation of numeric data leads to higher predictability.
ExMatrix visualizes RF models, aiding in decision understanding.
problem Lack of interpretability in complex models like RF.
method ExMatrix, a novel visualization method for RF interpretability.
result ExMatrix handles large, complex RF models and promotes interpretability.
We develop three efficient approaches for generating visual explanations from 3D convolutional neural networks (3D-CNNs) for Alzheimer's disease classification. One approach conducts sensitivity analysis on hierarchical 3D image segmentation, and the other two visualize network activations on a spatial map. Visual chec…
Study examines how uncertainty visualization affects analyst trust in automated classification systems.
problem The impact of uncertainty on analyst trust in automated classification systems.
method Empirical study evaluating different active learning query policies and visualizations.
result Query policy significantly influences analyst trust in automated classification systems.
InstanceFlow visualizes classifier confusion over training epochs.
problem Limited model interpretability through aggregate performance measures.
method Dual-view visualization tool showing instance-level learning behavior.
result Allows temporal analysis of training process and instance-level performance.
System helps scientists visualize deep learning model of x-ray images.
problem Understanding complex x-ray scattering images with multiple attributes.
method Interactive visualization system in feature space and classification output.
result Users can explore and compare images and attributes flexibly.
PySS3 simplifies access to SS3's text classification and visualization.
problem Limited availability of an open-source SS3 implementation.
method Developed PySS3, an open-source Python package implementing SS3.
result PySS3 enables robust, explainable, and trusty text classification.
Method generates visual explanations for similarity models without classification.
problem Lack of visual explanations for similarity models trained without classification loss.
method Gradient-based visual attention using learned feature embeddings.
result Attention maps improve model performance and can be used as constraints.
Large dataset of e-retailer images for improving visual search and product classification.
problem Improving the relevancy of visual search and product recommendation systems.
method Sharing a large dataset of 12M images from an online store classified into 5K categories.
result Demonstrates the effectiveness of deep learning in image classification.
Visualizes classification results with class maps.
problem Label bias in classification predictions.
method Class maps reflecting probability, distance, and mislabeling likelihood.
result Insight into classification results and data structure.
The paper supports task classification from eye movements, achieving 95.4% accuracy.
problem Decoding the observer's task from eye movements.
method Exploratory analysis, feature projection, feature elimination, SVM and Ada Boosting classifier training.
result Achieved 95.4% accuracy in task classification.
The ability to look multiple times through a series of pose-adjusted glimpses is fundamental to human vision. This critical faculty allows us to understand highly complex visual scenes. Short term memory plays an integral role in aggregating the information obtained from these glimpses and informing our interpretation …
This work examines how non-identical data distributions affect Federated Learning performance.
problem The impact of non-identical data distributions on Federated Learning performance.
method Synthesized datasets with varying degrees of data distribution similarity, evaluated Federated Averaging algorithm performance, proposed server momentum mitigation.
result Performance of Federated Learning degrades as data distributions differ more, and a mitigation strategy improves accuracy.
Develops counterfactual visual explanations to show how images could change to classify differently.
problem Creating understandable explanations for vision system predictions.
method Selects a distractor image and identifies spatial regions to modify for different classification.
result Users trained with counterfactual explanations perform better in fine-grained bird classification.
Ensembles of classifier models typically deliver superior performance and can outperform single classifier models given a dataset and classification task at hand. However, the gain in performance comes together with the lack in comprehensibility, posing a challenge to understand how each model affects the classificatio…
Explains Thurston geometries and visualization techniques.
problem Classifying Thurston geometries and their visualization.
method Survey of history and recent techniques.
result Discussion of recent immersive visualization techniques.
Art historians and archaeologists have long grappled with the regional classification of ancient Near Eastern ivory carvings. Based on the visual similarity of sculptures, individuals within these fields have proposed object assemblages linked to hypothesized regional production centers. Using quantitative rather than …
We consider the problem of explaining the decisions of deep neural networks for image recognition in terms of human-recognizable visual concepts. In particular, given a test set of images, we aim to explain each classification in terms of a small number of image regions, or activation maps, which have been associated w…
Researchers classify and visualize 5-cube cubical surfaces.
problem Classifying and visualizing surfaces in a 5-dimensional cube.
method Exhaustive search, classification by genus and demigenus, 3D visualization, reinforcement learning for optimization.
result 2690 connected closed cubical surfaces in the 5-cube, visualized and optimized for 3D printing.
Paper introduces Balanced Meta-Softmax for better long-tailed visual recognition.
problem Long-tailed distribution mismatch between training and testing data.
method Balanced Meta-Softmax, an unbiased extension of Softmax, using a Meta Sampler.
result Balanced Meta-Softmax outperforms state-of-the-art solutions on visual recognition and instance segmentation.
Enhances projection pursuit tree classifier with visual diagnostics for better multi-class classification.
problem Rigidity of original algorithm limits performance in complex high-dimensional classification problems.
method Allowing more splits and flexible class groupings in projection pursuit computation, and developing visual diagnostics.
result Demonstrates enhanced classifier performs as intended through interactive visual diagnostics.
Visual question answering is a recently proposed artificial intelligence task that requires a deep understanding of both images and texts. In deep learning, images are typically modeled through convolutional neural networks, and texts are typically modeled through recurrent neural networks. While the requirement for mo…
A novel supervised visualization technique for data exploration.
problem Lack of supervised dimensionality reduction methods considering class labels.
method Random forest proximities and diffusion-based dimensionality reduction.
result Retains local and global structures in data, emphasizing important variables.
Visualizes information flow in ML systems for better understanding and analysis.
problem Understanding the flow of information in complex ML systems.
method Proposes a visual approach using Sankey Diagrams to analyze flow of information.
result Demonstrates the effectiveness of the proposed technique in diagnosing model performance.
Developing a visual platform for faster astronomical source cataloging.
problem Speeding up cataloging of large area surveys in radio astronomy.
method Integration of advanced source finding and classification tools into a visual analytic platform.
result Improvement and acceleration of cataloging process in astronomical surveys.
Machine learning analysis of galaxy catalogues finds only one class separable.
problem Difficulty in classifying galaxies using visual inspection schemes.
method Generalized Relevance Matrix Learning Vector Quantization and Random Forests.
result Only one class, Little Blue Spheroids, is consistently separable.
Adds a precortical module to CNNs for improved robustness to light variations.
problem Robustness of CNNs to global light intensity and contrast variations.
method Developed a mathematical model of the mammalian visual pathway, inspired by CNNs, and added a preliminary convolutional module.
result Significantly more robust CNNs achieved with added module on MNIST, FashionMNIST, and SVHN databases.
Background: A universal unanswered question in neuroscience and machine learning is whether computers can decode the patterns of the human brain. Multi-Voxels Pattern Analysis (MVPA) is a critical tool for addressing this question. However, there are two challenges in the previous MVPA methods, which include decreasing…
A universal unanswered question in neuroscience and machine learning is whether computers can decode the patterns of the human brain. Multi-Voxels Pattern Analysis (MVPA) is a critical tool for addressing this question. However, there are two challenges in the previous MVPA methods, which include decreasing sparsity an…
Human visual object recognition is typically rapid and seemingly effortless, as well as largely independent of viewpoint and object orientation. Until very recently, animate visual systems were the only ones capable of this remarkable computational feat. This has changed with the rise of a class of computer vision algo…
In this paper, we present a technique for unsupervised learning of visual representations. Specifically, we train a model for foreground and background classification task, in the process of which it learns visual representations. Foreground and background patches for training come af- ter mining for such patches from …
Visual spoofing bypasses spam filters and plagiarism detection.
problem Vulnerability in spam filters that can be exploited by visually similar but differently encoded characters.
method Replaces characters with visually similar but differently encoded characters from a different alphabet.
result Spammers can create messages that bypass existing spam filters.
A network removes irrelevant structures from chest radiographs for better analysis.
problem Clutter in chest radiographs hinders visual inspection and analysis.
method Fully Convolutional Network to suppress undesired visual structure.
result Improved classifier performance with limited training data.
Improved audio event recognition using audiovisual transformers.
problem Weakly labeled audio event classification with limited temporal information.
method Adapted transformer architecture that combines audio and video inputs.
result State-of-the-art performance on audiovisual data set.
It is becoming increasingly important for machine learning methods to make predictions that are interpretable as well as accurate. In many practical applications, it is of interest which features and feature interactions are relevant to the prediction task. We present a novel method, Selective Bayesian Forest Classifie…
Interpretability is a key factor in the design of automatic classifiers for medical diagnosis. Deep learning models have been proven to be a very effective classification algorithm when trained in a supervised way with enough data. The main concern is the difficulty of inferring rationale interpretations from them. Dif…
Language is increasingly being used to define rich visual recognition problems with supporting image collections sourced from the web. Structured prediction models are used in these tasks to take advantage of correlations between co-occurring labels and visual input but risk inadvertently encoding social biases found i…
Improved DNN calibration without sacrificing accuracy.
problem Poor calibration of over-parametrized DNNs in safety-critical applications.
method Decoupling feature extraction and classification layers, and applying Gaussian priors.
result Significant improvement in model calibration with minimal training cost.
Program synthesis struggles with complex spatial relationships in image classification.
problem Challenges in solving Synthetic Visual Reasoning Test problems.
method Quantitative reanalysis of human and machine performance, improved program synthesis classifier, categorization of SVRT problems.
result Program synthesis is constrained by spatial relationships in images, not just shape specification.
VTAB benchmarks diverse visual tasks to assess representation learning effectiveness.
problem Lack of a unified evaluation for general visual representations.
method Developed VTAB, a benchmark for diverse visual tasks, and evaluated many representation learning algorithms.
result VTAB revealed insights into the effectiveness of various representation learning methods.
Interactive tool helps choose and understand classification metrics.
problem Common metrics for binary classification have limitations.
method Graphical application to visualize and explore evaluation metrics.
result Promotes careful attention to interpretation of metrics.
Boosts neural network performance by improving weight separability.
problem Improving the separability of weight vectors in neural networks.
method Proposes a new evaluation metric and feed-backward reconstruction loss to encourage weight separability.
result Improves visual recognition performance across various tasks.
Thousands of first-millennium BCE ivory carvings have been excavated from Neo-Assyrian sites in Mesopotamia (primarily Nimrud, Khorsabad, and Arslan Tash) hundreds of miles from their Levantine production contexts. At present, their specific manufacture dates and workshop localities are unknown. Relying on subjective, …
Deep convolutional neural networks (CNNs) have demonstrated impressive performance on visual object classification tasks. In addition, it is a useful model for predication of neuronal responses recorded in visual system. However, there is still no clear understanding of what CNNs learn in terms of visual neuronal circu…
Graph neural networks improve music genre classification on audio datasets.
problem Difficulty in applying deep learning on spectrograms due to lack of quality data and augmentation.
method Combination of CNN and Graph Neural Networks (GNN) with Siamese Neural Networks.
result Achieved state-of-the-art results on GTZAN and AudioSet datasets.
Visualizes classification accuracy and label bias in neural nets and trees.
problem Identifying mislabeled cases in neural net and tree-based classifications.
method Silhouette plots and quasi residual plots of PAC (probability of alternative class).
result Comparison of different classifications using silhouette width and PAC plots.