Constellation learns group-level visual relationships for abstract reasoning.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Conventional wisdom holds that model-based planning is a powerful approach to sequential decision-making. It is often very challenging in practice, however, because while a model can be used to evaluate a plan, it does not prescribe how to construct a plan. Here we introduce the "Imagination-based Planner", the first m…
Chirped sinosoids and interferometric phase plots are functions that are not periodic, but are the composition of a smooth function and a periodic function. These functions functions factor into a pair of maps: from their domain to a circle, and from a circle to their codomain. One can easily imagine replacing the circ…
Enhances robotic grasping efficiency with learning-adaptive imagination.
VTA learns hierarchical temporal structure for sequential data.
This document consists of the collection of handouts for a two-week summer workshop entitled 'Geometry and the Imagination', led by John Conway, Peter Doyle, Jane Gilman and Bill Thurston at the Geometry Center in Minneapolis, June 17-28, 1991. The workshop was based on a course `Geometry and the Imagination' which we …
Novel deep learning architecture decodes imagined speech from EEG.
This paper improves robot grasping by integrating meta-control and latent-space imagination.
It is easy for people to imagine what a man with pink hair looks like, even if they have never seen such a person before. We call the ability to create images of novel semantic concepts visually grounded imagination. In this paper, we show how we can modify variational auto-encoders to perform this task. Our method use…
New RL framework learns task completion without prior knowledge.
The seemingly infinite diversity of the natural world arises from a relatively small set of coherent rules, such as the laws of physics or chemistry. We conjecture that these rules give rise to regularities that can be discovered through primarily unsupervised experiences and represented as abstract concepts. If such r…
Unified model improves object-centric world modeling with new abilities.
New approach to counterfactual reasoning avoids demographic interventions.
WMPG reduces policy gradient variance using world models.
Reinforcement learning has seen great advancements in the past five years. The successful introduction of deep learning in place of more traditional methods allowed reinforcement learning to scale to very complex domains achieving super-human performance in environments like the game of Go or numerous video games. Desp…
We introduce Imagination-Augmented Agents (I2As), a novel architecture for deep reinforcement learning combining model-free and model-based aspects. In contrast to most existing model-based reinforcement learning and planning methods, which prescribe how a model should be used to arrive at a policy, I2As learn to inter…
Dreamer 4 learns Minecraft tasks from videos alone.
Deep imagination optimizes decision-making in large trees with limited resources.
Speech-related Brain Computer Interface (BCI) technologies provide effective vocal communication strategies for controlling devices through speech commands interpreted from brain signals. In order to infer imagined speech from active thoughts, we propose a novel hierarchical deep learning BCI system for subject-indepen…
A new method for robot manipulation tasks using imagined object goals.
Recent model-free reinforcement learning algorithms have proposed incorporating learned dynamics models as a source of additional data with the intention of reducing sample complexity. Such methods hold the promise of incorporating imagined data coupled with a notion of model uncertainty to accelerate the learning of c…
New Dreamer model tackles object vanishing in robot learning.
We propose a mixed deep neural network strategy, incorporating parallel combination of Convolutional (CNN) and Recurrent Neural Networks (RNN), cascaded with deep autoencoders and fully connected layers towards automatic identification of imagined speech from EEG. Instead of utilizing raw EEG channel data, we compute t…
In recent years, deep generative models have been shown to 'imagine' convincing high-dimensional observations such as images, audio, and even video, learning directly from raw data. In this work, we ask how to imagine goal-directed visual plans -- a plausible sequence of observations that transition a dynamical system …
An infinitary version of braid groups has been considered as a direct limit of n-braid groups. However, we can imagine more complicated braids with infinitely many strings. We invetisgate basic properties especially when the number of strings is countable.
Together with the Moebius strip, the Klein bottle is one of the intriguing objects in the universe of geometry, sometimes appearing in non-mathematical contexts too. Until now, several parametrizations of it as a surface immersed in ordinary three-space have been found, some of which are very elegant and lead to nice a…
Atoms and molecules are important conceptual entities we invented to understand the physical world around us. The key to their usefulness lies in the organization of nuclear and electronic degrees of freedom into a single dynamical variable whose time evolution we can better imagine. The use of such effective variables…
The use of synthetic data generated by Generative Adversarial Networks (GANs) has become quite a popular method to do data augmentation for many applications. While practitioners celebrate this as an economical way to get more synthetic data that can be used to train downstream classifiers, it is not clear that they re…
UWM-JEPA predicts future scenarios in belief space, improving accuracy in partially observed environments.
For an autonomous agent to fulfill a wide range of user-specified goals at test time, it must be able to learn broadly applicable and general-purpose skill repertoires. Furthermore, to provide the requisite level of generality, these skills must handle raw sensory input such as images. In this paper, we propose an algo…
Model predicts multi-agent trajectories using a differentiable simulator.
Model learns tool affordances from vision, enabling tool selection.
Riemannian metric learning improves data representation across various fields.
Humans are able to imagine a person's voice from the person's appearance and imagine the person's appearance from his/her voice. In this paper, we make the first attempt to develop a method that can convert speech into a voice that matches an input face image and generate a face image that matches the voice of the inpu…
REFIL learns from imagined sub-group interactions to improve multi-agent reinforcement learning.
This work is an analytical and numerical study of the composition of several fractals into one and of the relation between the composite dimension and the dimensions of the component fractals. In the case of composition of standard IFS with segments of equal size, the composite dimension can be expressed as a function …
Just as semantic hashing can accelerate information retrieval, binary valued embeddings can significantly reduce latency in the retrieval of graphical data. We introduce a simple but effective model for learning such binary vectors for nodes in a graph. By imagining the embeddings as independent coin flips of varying b…
New geometric approach for analyzing compositional data like gut microbiomes.
We demonstrate a conditional autoregressive pipeline for efficient music recomposition, based on methods presented in van den Oord et al.(2017). Recomposition (Casal & Casey, 2010) focuses on reworking existing musical pieces, adhering to structure at a high level while also re-imagining other aspects of the work. This…
Study on deep neural networks using branching processes and Mehler's formula.
Improved fMRI activation detection for single-subject studies.
We establish conditions for compositional generalization in machine learning.
This paper proves hyperbolicity of virtual knot compositions.
Develops methods for causal inference in compositional data using instrumental variables.
In classical field theory, the composite fibred manifolds Y -> Z -> X provides the adequate mathematical formulation of gauge models with broken symmetries, e.g., the gauge gravitation theory. This work is devoted to connections on composite fibred manifolds. In particular, we get the horizontal splitting of the vertic…
The p-index improves investment performance for NYSE stocks but not for SSE stocks.
Model predicts composite structures assembly quality with input uncertainty.
New algorithm reduces complexity for optimizing complex machine learning tasks.