SATNet solves the Symbol Grounding Problem, enabling self-supervised learning.
problem Mapping visual inputs to symbolic variables without explicit supervision.
method Self-supervised pre-training pipeline and proofreading method.
result SATNet achieves full accuracy with no label leakage, surpassing state-of-the-art.
Paper introduces scalable neural architecture for solving NP-hard problems.
problem Solving NP-hard reasoning problems from natural inputs.
method Scalable neural architecture and loss function for discrete Graphical Models.
result Empirically shows efficient learning of NP-hard problems.
Integrating logical reasoning within deep learning architectures has been a major goal of modern AI systems. In this paper, we propose a new direction toward this goal by introducing a differentiable (smoothed) maximum satisfiability (MAXSAT) solver that can be integrated into the loop of larger deep learning systems. …
SE-RRMs solve structured problems like Sudoku and ARC-AGI by enforcing symbol equivariance.
problem Structured reasoning problems like Sudoku and ARC-AGI.
method Symbol-equivariant recurrent reasoning models enforcing permutation equivariance.
result SE-RRMs outperform prior RRMs on 9x9 Sudoku and generalize to larger and smaller instances.
We introduce Deep Reasoning Networks (DRNets), an end-to-end framework that combines deep learning with reasoning for solving complex tasks, typically in an unsupervised or weakly-supervised setting. DRNets exploit problem structure and prior knowledge by tightly combining logic and constraint reasoning with stochastic…
Neural framework learns one solution from multiple for combinatorial problems.
problem Finding any one of many possible solutions for combinatorial problems.
method Adapts existing prediction networks to handle solution multiplicity using a selection module trained via RL.
result Framework significantly improves accuracy in solving combinatorial problems.
Generative models on spheres improve discrete sequence sampling.
problem Learning generative models for discrete sequences in continuous space.
method Work on sphere Sd−1, using von Mises-Fisher distribution and radial symmetry. result Improved results on Sudoku and language modeling with vMF path.
Paper presents a framework to automatically discover constraints from data.
problem Discovering constraints from data for structured output prediction.
method Formulates structured output prediction as ILP, mines constraints by estimating polytopes of feasible set.
result Successfully identifies feasible sets and constraints for various tasks.
Proposes a method to generate text that adheres to logical constraints.
problem Generating text that respects logical constraints is hard for autoregressive models.
method Bayesian conditioning to draw samples subject to a constraint, considering the entire sequence and inducing a local, factorized distribution.
result Our approach generates samples that closely approximate the target distribution and are guaranteed to satisfy the constraints.
DTM improves dLLM fine-tuning stability and performance.
problem Intractable sequence-level marginal likelihoods for masked diffusion models.
method Discrete Tilt Matching (DTM) recasts dLLM fine-tuning as state-level matching of local unmasking posteriors under reward tilting.
result DTM yields strong gains on Sudoku and Countdown while remaining competitive on MATH500 and GSM8K.
This paper presents OptNet, a network architecture that integrates optimization problems (here, specifically in the form of quadratic programs) as individual layers in larger end-to-end trainable deep networks. These layers encode constraints and complex dependencies between the hidden states that traditional convoluti…
ERM uses energy-based selection to improve recursive reasoning.
problem Lack of principled inference mechanism in recursive models.
method Energy-guided Recursive Model (ERM) introduces Hopfield energies for trajectory selection.
result ERM achieves optimal solutions on various puzzles.
regvis.net offers a visual survey of regulatory visualization.
problem Lack of a comprehensive resource for regulatory visualization.
method Collection and manual tagging of 80+ publications, creation of a searchable webpage.
result First publication set tailored for regulatory visualization.
We study how to leverage off-the-shelf visual and linguistic data to cope with out-of-vocabulary answers in visual question answering task. Existing large-scale visual datasets with annotations such as image class labels, bounding boxes and region descriptions are good sources for learning rich and diverse visual conce…
Improved Markov models learn from their mistakes and adapt to problem complexity.
problem Limitations of standard masked discrete diffusion models in reasoning tasks.
method Learning a Markov transition kernel trained on its own outputs, allowing remasking and adaptation.
result Significant improvement in solving reasoning problems, especially Sudoku-Extreme and Countdown-4.
Improves generative models by optimizing rewards and sample editing.
problem Efficiently generating high-reward samples with structural constraints.
method Introduces MDM-VGB, a discrete diffusion sampler that augments unmasking generation with reward-guided remasking.
result MDM-VGB achieves quadratic complexity and robustness to noise, outperforming heuristics like best-of-N. Proposes a spectral method to assess and combine multiple data visualizations.
problem Evaluating and combining the strengths of different data visualization algorithms.
method Spectral method for assessing and combining multiple visualizations.
result Proposes a visualization eigenscore to quantify relative performance and a consensus visualization.
To convey neural network architectures in publications, appropriate visualizations are of great importance. While most current deep learning papers contain such visualizations, these are usually handcrafted just before publication, which results in a lack of a common visual grammar, significant time investment, errors,…
AV-CPL uses continuous pseudo-labels for AVSR combining labeled and unlabeled data.
problem Improving AVSR performance with labeled and unlabeled data.
method Semi-supervised method using continuous pseudo-labels generated by the same AVSR model.
result Significant improvements in VSR performance on LRS3 dataset.
Visualizes futures markets using particle physics tools.
problem Understanding high-velocity data in futures markets.
method Uses ROOT, an open-source data-analysis tool, to reconstruct and visualize message-based data.
result Allows stakeholders to gain a better understanding of markets and monitor effectively.
New report on machine learning visualization techniques and trends.
problem Improving trust in machine learning models through visualization.
method Analysis of peer-reviewed articles on machine learning visualization techniques.
result Rapid growth in machine learning visualization techniques over the past three years.
The abstract discusses how humans use visualizations in machine learning.
problem The reliance on human involvement in AI systems and analytics.
method Review of seven steps in the ML process and different visualization techniques.
result Different visualizations are used at various stages of the ML process.
IANN visualizes all input variables effects simultaneously.
problem Inability to visualize all input variables effects simultaneously in black-box functions.
method Interpretable Architecture Neural Network (IANN) approach.
result Visualization of all input variables effects directly and simultaneously.
Consensus dimension reduction combines multiple visualizations to identify shared patterns.
problem Conflicting visualizations from different dimension reduction methods.
method Multi-view learning to identify stable patterns across multiple views.
result Consensus visualization effectively identifies shared low-dimensional data structure.
Visualizes deep generative models for drug design.
problem Limited visualization tools for deep generative models in drug discovery.
method Proposes a visualization framework for deep graph generative models.
result Interactive visualization and molecular optimization tools.
This paper discusses the role of risk communication in macroprudential oversight and of visualization in risk communication. Beyond the soar in data availability and precision, the transition from firm-centric to system-wide supervision imposes vast data needs. Moreover, except for internal communication as in any orga…
Paper establishes baselines for offline RL from visual observations.
problem Challenges in offline reinforcement learning from visual observations with continuous action spaces.
method Simple baselines and benchmarking tasks for offline RL from visual observations.
result Simple modifications to existing online RL algorithms outperform existing offline RL methods.
WAPPO optimizes feature distributions for better visual transfer in RL.
problem Improving visual transfer in reinforcement learning.
method WAPPO uses Wasserstein Confusion to minimize feature distribution distance.
result WAPPO outperforms previous methods in visual transfer across different environments.
We introduce the notion of the visual core of a hyperbolic 3-manifold N and explore its basic properties. The visual core can be thought of as a harmonic analysis analogue of the convex core. We investigate circumstances in which the visual core of a cover N' of N embeds under the covering map from N' to N. We apply th…
Improved text-to-image and multimodal understanding through adaptive generation order optimization.
problem Determining optimal generation sequences in text-to-image synthesis and multimodal understanding.
method Introduced a learnable control module trained via Group Relative Policy Optimization (GRPO) to determine the generation order.
result Learning the control block substantially improves text-to-image alignment and multimodal understanding in DLMs.
A novel method visualizes higher-dimensional spaces using hyperbolic geometry.
problem Challenges in visualizing higher-dimensional spaces.
method Interactive visualization of higher-dimensional grids based on hyperbolic geometry.
result Our method shows the whole higher-dimensional space at once and avoids disadvantages of previous methods.
Ray marching method visualizes flat surfaces efficiently.
problem Efficient visualization of flat surfaces.
method Ray marching approach for intuitive exploration.
result Effective visualization of translation surfaces and polyhedra.
Pretrained model improves visual dialog performance.
problem Improving performance in visual dialog tasks.
method Pretrained ViLBERT model on vision-language datasets, fine-tuned on VisDial.
result Best model outperforms prior work by more than 1% on NDCG and MRR.
We present GraphTSNE, a novel visualization technique for graph-structured data based on t-SNE. The growing interest in graph-structured data increases the importance of gaining human insight into such datasets by means of visualization. Among the most popular visualization techniques, classical t-SNE is not suitable o…
Adversarial attacks can manipulate ML-aided visualizations, tricking analysts.
problem Adversarial attacks on ML-aided visualizations.
method Identifying attack surface and exemplifying five adversarial attacks.
result Adversaries can induce various attacks, like creating arbitrary and deceptive visualizations.
DEN creates interpretable visualizations using Siamese networks.
problem Creating interpretable visualizations of complex datasets.
method Differentiating Embedding Networks (DEN) using Siamese neural networks and loss functions.
result DEN outperforms existing techniques on FashionMNIST and interpretable features are identified.
Explains visual metrics on hyperbolic space boundaries.
problem Understanding the geometry of hyperbolic spaces.
method Construction of visual metrics, quasisymmetries, and invariants.
result Detailed examples and applications of Gromov's round trees.
Developing a visual platform for faster astronomical source cataloging.
problem Speeding up cataloging of large area surveys in radio astronomy.
method Integration of advanced source finding and classification tools into a visual analytic platform.
result Improvement and acceleration of cataloging process in astronomical surveys.
Croke and Kleiner constructed two homeomorphic locally CAT(0) complexes whose universal covers have visual boundaries that are not homeomorphic. We construct two homeomorphic locally CAT(0) complexes so that the visual boundary of one universal cover contains a nonplanar graph, while the visual boundary of the other do…
As machine learning becomes more pervasive, there is an urgent need for interpretable explanations of predictive models. Prior work has developed effective methods for visualizing global model behavior, as well as generating local (instance-specific) explanations. However, relatively little work has addressed regional …
Neural coding is one of the central questions in systems neuroscience for understanding how the brain processes stimulus from the environment, moreover, it is also a cornerstone for designing algorithms of brain-machine interface, where decoding incoming stimulus is highly demanded for better performance of physical de…
GTSNE improves data visualization for high-dimensional data.
problem Visualizing high-dimensional data points in a 2D map.
method GTSNE is a variation of t-SNE that captures both local and macro structures.
result GTSNE produces better visualizations of high-dimensional data compared to other methods.
UN-AVOIDS visualizes and detects anomalies without needing labeled data.
problem The need for a unified framework to visualize and detect anomalies.
method UN-AVOIDS is an unsupervised, nonparametric approach that transforms data into a new space (NCDF) for both visualization and detection.
result UN-AVOIDS assigns invariant anomalous scores and achieves high AUC in detecting anomalies.
Speech enhancement (SE) aims to reduce noise in speech signals. Most SE techniques focus only on addressing audio information. In this work, inspired by multimodal learning, which utilizes data from different modalities, and the recent success of convolutional neural networks (CNNs) in SE, we propose an audio-visual de…
Speech enhancement (SE) aims to reduce noise in speech signals. Most SE techniques focus only on addressing audio information. In this work, inspired by multimodal learning, which utilizes data from different modalities, and the recent success of convolutional neural networks (CNNs) in SE, we propose an audio-visual de…
Method generates visual explanations for similarity models without classification.
problem Lack of visual explanations for similarity models trained without classification loss.
method Gradient-based visual attention using learned feature embeddings.
result Attention maps improve model performance and can be used as constraints.
A neural network visualizes data structure and concepts.
problem Data visualization and concept understanding.
method Mixing autoencoder and classifier for multi-perspective visualization.
result The network produces different topological maps based on training as autoencoder or classifier.
This paper proposes a web-based visual graph analytics platform for interactive graph mining, visualization, and real-time exploration of networks. GraphVis is fast, intuitive, and flexible, combining interactive visualizations with analytic techniques to reveal important patterns and insights for sense making, reasoni…