3D RadViz improves 3D data visualization of multidimensional datasets.
problem Tackles the challenge of visualizing multidimensional datasets in 3D.
method Develops RadViz3D, a 3D radial visualization tool with uniform anchor points.
result Improves the display of multidimensional datasets, especially for uncorrelated variables.
Efficiently visualizes uncertainty in local divergence of 2D vector fields.
problem Uncertainty in vector field data leads to inaccurate divergence computations.
method Closed-form approach for highly efficient and accurate uncertainty visualization of local divergence, assuming independently Gaussian-distributed vector uncertainties.
result Significantly enhanced efficiency and accuracy of our algorithms over classical MC approach.
Visualizes deep neural networks for speech recognition using learned topographic filter maps.
problem Unintuitive internal structure of deep neural networks complicates activation visualization.
method Trains a convolutional speech recognition model with filters arranged in a 2D grid, highlighting similar filters.
result Topographic filter maps visualize artificial neuron activations more intuitively.
IANN visualizes all input variables effects simultaneously.
problem Inability to visualize all input variables effects simultaneously in black-box functions.
method Interpretable Architecture Neural Network (IANN) approach.
result Visualization of all input variables effects directly and simultaneously.
RNNs and their variants have been widely adopted for image captioning. In RNNs, the production of a caption is driven by a sequence of latent states. Existing captioning models usually represent latent states as vectors, taking this practice for granted. We rethink this choice and study an alternative formulation, name…
DFKI Cabin Simulator tests visual monitoring functions in vehicles.
problem Validating novel human-vehicle interfaces and driver assistance systems.
method Driving simulator with in-cabin mock-up and camera system.
result Validation of in-cabin monitoring functions for advanced driver assistance and automated driving.
The paper explores squircles and their 3D applications.
problem None explicitly stated; focuses on squircle equations and 3D surfaces.
method Examined and discussed squircle equations, then developed 3D surfaces based on these shapes.
result Developed 3D surfaces based on squircle equations.
Explains a 2D color exchange invariant correspondence to 3D linking numbers.
problem Understanding color exchange invariants in 2D dynamics and their 3D geometric interpretation.
method Visualizes invariants as linking of lines on a special surface with Arf-Kervaire invariant one, and interprets it as an obstruction to continuous transformation.
result Interprets a 2D color exchange invariant as a 3D linking number, providing a topological explanation.
BPI models 2D patterns on multiple planes and 3D scene from a single image.
problem Understanding and editing images with multiple 2D planes and 3D scene from a single image.
method Box Program Induction (BPI) with neural networks and search-based algorithm.
result Holistic, structured scene representation enables 3D-aware image editing.
Previously, we proposed a physically-inspired method to construct data points into an effective in-tree (IT) structure, in which the underlying cluster structure in the dataset is well revealed. Although there are some edges in the IT structure requiring to be removed, such undesired edges are generally distinguishable…
A network removes irrelevant structures from chest radiographs for better analysis.
problem Clutter in chest radiographs hinders visual inspection and analysis.
method Fully Convolutional Network to suppress undesired visual structure.
result Improved classifier performance with limited training data.
Recent progress in deep generative models has led to tremendous breakthroughs in image generation. However, while existing models can synthesize photorealistic images, they lack an understanding of our underlying 3D world. We present a new generative model, Visual Object Networks (VON), synthesizing natural images of o…
GradVis visualizes and analyzes deep neural network optimization surfaces efficiently.
problem Understanding and optimizing deep neural network training landscapes.
method Developed an open-source library GradVis for efficient visualization and analysis of optimization surfaces.
result GradVis enables plotting of optimization surfaces and trajectories for large networks.
Proposes a neural network method to improve consistencies in high dimensional data analysis.
problem Inconsistencies among dimensionality reduction, clustering, and visualization tasks in high dimensional data analysis.
method Consistent Representation Learning (CRL) neural network that performs NLDR transformations to satisfy LGP constraints.
result Improves consistencies in data interpretation through end-to-end task execution.
Visualizes deep neural network decisions in 2D for better understanding.
problem Difficulty in comprehending complex deep learning models.
method Discriminative dimensionality reduction for 2D visualization of model decisions.
result Insight into how different data properties are treated by the model.
3D filament plots visualize curves in datasets, avoiding visual clutter.
problem Visualizing high-dimensional data relationships in scatterplots of points.
method Construct 3D filament plots using linear isometries and Frenet-Serret systems.
result 3D filament plots preserve Euclidean distances and avoid visual clutter.
Probabilistic inversion within a multiple-point statistics framework is often computationally prohibitive for high-dimensional problems. To partly address this, we introduce and evaluate a new training-image based inversion approach for complex geologic media. Our approach relies on a deep neural network of the generat…
Generates coherent 3D scenes from monocular videos without supervision.
problem Lack of 3D scene modeling in video generation models.
method Trains a model to generate 3D scenes with moving objects and a background from monocular videos.
result Trained model generates coherent 3D scenes with multiple moving objects and a background.
With the advent of Deep Learning (DL) techniques, especially Generative Adversarial Networks (GANs), data augmentation and generation are quickly evolving domains that have raised much interest recently. However, the DL techniques are data demanding and since, medical data is not easily accessible, they suffer from dat…
A visualization aids in comparing regression models by highlighting errors and correlations.
problem Comparing regression models is difficult due to varying hyper-parameters and metrics.
method Introduces a novel visualization approach using 2D residual space, Mahalanobis distance, and colormaps.
result Enhanced understanding of regression model performance differences and error distributions.
Introduces CHL, a new loss function for continuous similarity learning.
problem Binary similarity learning limitations.
method CHL is a novel loss function that generalizes histogram loss to continuous similarities.
result CHL solves a wider range of tasks including similarity learning, representation learning, and data visualization.
ViewFool identifies adversarial viewpoints to test image recognition robustness.
problem Lack of robustness to viewpoint changes in visual recognition models.
method Neural Radiance Fields (NeRF) and entropic regularizer to find adversarial viewpoints.
result Common image classifiers are highly vulnerable to generated adversarial viewpoints.
New method clusters and visualizes anomalies in complex systems.
problem Identifying simultaneous extreme values in random vectors.
method Mixture model based on multivariate extreme value theory.
result Assigns posterior probabilities for anomaly types and clusters extreme observations.
Capsule Networks have great potential to tackle problems in structural biology because of their attention to hierarchical relationships. This paper describes the implementation and application of a Capsule Network architecture to the classification of RAS protein family structures on GPU-based computational resources. …
Adversarial attacks on spectrograms can fool audio classifiers trained on waveforms.
problem Susceptibility of audio classifiers to adversarial attacks on spectrograms.
method Applying adversarial attacks to spectrograms and reconstructing audio waveforms.
result Perturbed spectrograms can fool 2D CNNs and 1D CNNs trained on audio waveforms.
A new method embeds sparse stochastic graphs into low dimensions.
problem Embedding large, sparse, stochastic graphs into low-dimensional spaces.
method Spaceland Embedding (SG-t-SNE) inspired by t-SNE, leveraging modern computing techniques.
result Effective embedding results on synthetic and real-world graphs.
VARENN visualizes climate data in 2D images for analysis.
problem Lack of integrated spatiotemporal data in climate models.
method VARENN uses convolutional neural networks to summarize monthly climate data into 2D color images.
result VARENN models accurately classify temperature and precipitation changes.
The paper finds and visualizes unique geometric polyhedra and tori with few vertices.
problem Finding and visualizing geometric polyhedra and tori with specific vertex configurations.
method Using Schlegel diagrams and geometric realization in 3D and 4D space.
result Identifies and visualizes 12 triangulations of the 2-torus and 12 triangulations of the 2D projective plane.
Deep learning detects schools of herring from echograms.
problem Manual interpretation of echograms is time-consuming and inconsistent.
method Deep learning framework for automatic detection.
result Deep learning outperforms traditional machine learning.
Deep learning improves 3D microscopy resolution without matched target images.
problem Anisotropic resolution in volumetric fluorescence microscopy.
method Cycle-consistent generative adversarial network trained on unpaired 2D images.
result Enhanced axial resolution and restored details between imaging planes.
X-Caps improves medical diagnosis explainability by encoding visual attributes in capsules.
problem Uninterpretable predictions from deep neural networks in healthcare.
method Teaches a novel multi-task capsule network to encode high-level visual attributes and malignancy scores.
result X-Caps outperforms state-of-the-art deep dense 3D CNNs in capturing visually interpretable attributes and malignancy prediction.
Plasma tomography consists in reconstructing the 2D radiation profile in a poloidal cross-section of a fusion device, based on line-integrated measurements along several lines of sight. The reconstruction process is computationally intensive and, in practice, only a few reconstructions are usually computed per pulse. I…
Tracking large numbers of densely-arranged, interacting objects is challenging due to occlusions and the resulting complexity of possible trajectory combinations, as well as the sparsity of relevant, labeled datasets. Here we describe a novel technique of collective tracking in the model environment of a 2D honeybee hi…
VTA learns hierarchical temporal structure for sequential data.
problem Learning interpretable temporal structure in sequential data.
method Hierarchical recurrent state space model with variational approach.
result VTA models 2D and 3D visual sequences with hierarchical structure.
2D CNNs approximate Korobov functions with near-optimal rates.
problem Approximating Korobov functions using 2D CNNs.
method Constructive approach for 2D CNNs with ReLU activations and fully connected layers.
result 2D CNNs achieve near-optimal approximation rates for Korobov functions.
Visual perception is a challenging problem in part due to illumination variations. A possible solution is to first estimate an illumination invariant representation before using it for recognition. The object albedo and surface normals are examples of such representations. In this paper, we introduce a multilayer gener…
Helps visually impaired users make better decisions by adjusting their observations.
problem Systematic biases in users' perception and processing of visual information.
method Synthesizes new observations based on true observations to correct user biases.
result Significant improvement in task performance for users with various biases.
Recent developments in deep reinforcement learning have enabled the creation of agents for solving a large variety of games given a visual input. These methods have been proven successful for 2D games, like the Atari games, or for simple tasks, like navigating in mazes. It is still an open question, how to address more…
This research uses PointNets to detect 2D objects from radar data.
problem Detecting 2D objects from sparse radar data for automated driving.
method Adapting PointNets for radar data, performing 2D object classification and bounding box regression.
result Demonstrates the potential of PointNets for 2D object detection in radar data.
Unified model learns concepts across domains like left and right.
problem Limited generalization of language concepts in inference-only models.
method Logic-Enhanced Foundation Model (LEFT) with a differentiable, domain-independent program executor.
result LEFT flexibly learns and reasons with concepts across 2D images, 3D scenes, human motions, and robotic manipulation.
Proposes a model to generate 3D-aware images from 2D images.
problem Generating 3D-aware images from 2D images.
method Likelihood-based top-down model using Neural Radiance Fields and energy-based latent variables.
result Model can infer 3D object structures from 2D images and generate novel views.
Derive bihamiltonian structure for rational reduction of 2D-Toda hierarchy
problem Derive bihamiltonian structure for rational reduction of 2D-Toda hierarchy
method Direct computations
result Derive local bihamiltonian structure
Enhances 2D face recognition with 3D features using active illumination.
problem Improving robustness of 2D face recognition to spoofing attacks and low-light conditions.
method Projecting a high spatial frequency pattern onto the face to recover 3D information and a 2D image simultaneously.
result Significantly boosts face recognition performance and dramatically improves robustness to spoofing attacks.
A novel method compresses point cloud attributes by folding them onto a 2D grid.
problem Efficiently compressing point cloud attributes for storage and transmission.
method Interpreting point clouds as 2D manifolds, folding onto a grid, and mapping attributes to the grid using optimized methods.
result The proposed folding-based approach achieves performance comparable to state-of-the-art codecs.
Paper classifies brain signals using eigenvalues for 2D and 3D educational content questions.
problem Classifying brain signals for 2D and 3D educational content questions.
method Eigenvalues of covariance matrix used as features; KNN and SVM classifiers applied.
result No significant difference in learning, memory retention, and recall between 2D and 3D educational content.
The paper explores methods to explain brain tumor segmentation models and extract visualizations.
problem Improving interpretability of deep learning models for brain tumor segmentation.
method Exploring techniques to explain brain tumor segmentation models and extract visualizations.
result Brain tumor segmentation networks learn human-understandable disentangled concepts and use a top-down approach.
Study uses ML techniques to reveal quantum-like features in classical systems.
problem Understanding the intuition behind unsupervised ML in physical systems.
method Three ML techniques applied to adjacency matrices of 2D particulate systems.
result ML techniques reveal quantum-like features in classical systems.
2D tissue model predicts neurotoxicity more accurately and robustly.
problem Fast and accurate prediction of developmental neurotoxicity.
method Machine learning on 2D bio-engineered tissue models.
result 2D model outperforms 3D model in accuracy and robustness.