Constellation learns group-level visual relationships for abstract reasoning.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Abstract discusses different corks.
Attention mechanisms have been boosting the performance of deep learning models on a wide range of applications, ranging from speech understanding to program induction. However, despite experiments from psychology which suggest that attention plays an essential role in visual reasoning, the full potential of attention …
A distinctive property of human and animal intelligence is the ability to form abstractions by neglecting irrelevant information which allows to separate structure from noise. From an information theoretic point of view abstractions are desirable because they allow for very efficient information processing. In artifici…
We introduce an algorithm for model-based hierarchical reinforcement learning to acquire self-contained transition and reward models suitable for probabilistic planning at multiple levels of abstraction. We call this framework Planning with Abstract Learned Models (PALM). By representing subtasks symbolically using a n…
Resolving abstract anaphora is an important, but difficult task for text understanding. Yet, with recent advances in representation learning this task becomes a more tangible aim. A central property of abstract anaphora is that it establishes a relation between the anaphor embedded in the anaphoric sentence and its (ty…
Unified framework for causal models at different levels of abstraction.
moment maps arise as a generalization of genuine moment maps on symplectic manifolds when the symplectic structure is discarded, but the relation between the mapping and the action is kept. Particular examples of abstract moment maps had been used in Hamiltonian mechanics for some time, but the abstract notion originat…
Successful multimodal search and retrieval requires the automatic understanding of semantic cross-modal relations, which, however, is still an open research problem. Previous work has suggested the metrics cross-modal mutual information and semantic correlation to model and predict cross-modal semantic relations of ima…
CIB compresses variables causally, preserving key causal interactions.
A new layer learns abstract relations from graph structure using finite-state automata.
Abstract commensurators linked to topological models of solenoids.
According to a mainstream position in contemporary cognitive science and philosophy, the use of abstract compositional concepts is both a necessary and a sufficient condition for the presence of genuine thought. In this article, we show how the ability to develop and utilise abstract conceptual structures can be achiev…
XIMP improves molecular property prediction by integrating multiple graph representations.
Despite their impressive performance in many tasks, deep neural networks often struggle at relational reasoning. This has recently been remedied with the introduction of a plug-in relational module that considers relations between pairs of objects. Unfortunately, this is combinatorially expensive. In this extended abst…
We define a certain abstract planar algebra by generators and relations, study various aspects of its structure, and then identify it with Jones' spin planar algebra.
COTA learns abstraction maps from data without complete SCM knowledge.
Geometric duality connects graph isomorphism and knot equivalence.
We show that the theory of stable complex -cobordisms, for a torus , is embedded into the theory of stable complex -cobordisms of not necessarily compact manifolds equipped with proper abstract moment maps. Thus the introduction of such non-compact cobordisms in the stable complex -cobordism theory does not…
A new method learns object hierarchies from images to reason about physical interactions.
It is well-known that there are a number of relations between theoretical finance theory and information theory. Some of these relations are exact and some are approximate. In this paper we will explore some of these relations and determine under which conditions the relations are exact. It turns out that portfolio the…
O-minimal geometry generalizes both semialgebraic and subanalytic geometries, and has been very successful in solving special cases of some problems in arithmetic geometry, such as André-Oort conjecture. Among the many tools developed in an o-minimal setting are cohomology theories for abstract-definable continuous man…
We describe a general framework for measuring risks, where the risk measure takes values in an abstract cone. It is shown that this approach naturally includes the classical risk measures and set-valued risk measures and yields a natural definition of vector-valued risk measures. Several main constructions of risk meas…
This short note provides an overview of some theorems and conjectures obtained by the author and his collaborators. It is an extended abstract for the Oberwolfach workshop "New Trends in Teichmüller Theory and Mapping Class Groups", 2 September - 8 September 2018.
Although exploration in reinforcement learning is well understood from a theoretical point of view, provably correct methods remain impractical. In this paper we study the interplay between exploration and approximation, what we call approximate exploration. Our main goal is to further our theoretical understanding of …
In this article, we extend the conventional framework of convolutional-Restricted-Boltzmann-Machine to learn highly abstract features among abitrary number of time related input maps by constructing a layer of multiplicative units, which capture the relations among inputs. In many cases, more than two maps are strongly…
We present an image preprocessing technique capable of improving the performance of few-shot classifiers on abstract visual reasoning tasks. Many visual reasoning tasks with abstract features are easy for humans to learn with few examples but very difficult for computer vision approaches with the same number of samples…
Deep reinforcement learning has recently shown many impressive successes. However, one major obstacle towards applying such methods to real-world problems is their lack of data-efficiency. To this end, we propose the Bottleneck Simulator: a model-based reinforcement learning method which combines a learned, factorized …
The abstract discusses how Kähler-Einstein metrics relate to algebraic geometry.
The abstract explains counterexamples in 4-manifold topology.
In this paper, we show that standard feed-forward and recurrent neural networks fail to learn abstract patterns based on identity rules. We propose Relation Based Pattern (RBP) extensions to neural network structures that solve this problem and answer, as well as raise, questions about integrating structures for induct…
The paper classifies symmetric triads with multiplicities and their applications.
Abstracts index for ML4H workshop at NeurIPS 2019.
Abstraction is a fundamental part when learning behavioral models of systems. Usually the process of abstraction is manually defined by domain experts. This paper presents a method to perform automatic abstraction for network protocols. In particular a weakly supervised clustering algorithm is used to build an abstract…
This letter introduces an abstract learning problem called the "set embedding": The objective is to map sets into probability distributions so as to lose less information. We relate set union and intersection operations with corresponding interpolations of probability distributions. We also demonstrate a preliminary so…
The paper aims to mathematically define and learn abstractions from data.
The abstract discusses connections between K-stability, heights, and rational points on Fano varieties.
Abstract MDPs enable strategic exploration and fast reward transfer in complex environments.
A model is developed to study the effectiveness of innovation and its impact on structure creation and structure change on agent-based societies. The abstract model that is developed is easily adapted to any particular field. In any interacting environment, the agents receive something from the environment (the other a…
Transfer learning which aims at utilizing knowledge learned from one problem (source domain) to solve another different but related problem (target domain) has attracted wide research attentions. However, the current transfer learning methods are mostly uninterpretable, especially to people without ML expertise. In thi…
Abstractor enhances Transformers for relational reasoning, improving sample efficiency and performance.
In this paper, we obtain a new abstract formula relating eigenvalues of a self-adjoint operator to two families of symmetric and skew-symmetric operators and their commutators. This formula generalizes earlier ones obtained by Harrell, Stubbe, Hook, Ashbaugh, Hermi, Levitin and Parnovski. We also show how one can use t…
We provide an interpretation of the APS index theorem of Piazza-Schick and Zeidler in terms of coarse homotopy theory. On the one hand we propose a motivic version of the boundary value problem, the index theorem, and the associated secondary invariants. On the other hand, we discuss in detail how the abstract version …
The abstract discusses conjectures about virtual Legendrian knots and their relation to causality.
Tabular Q-Learning with learned state abstractions solves continuous control tasks.
New approach to abstract neural network representations using renormalization group.
Study investigates how simple speech sounds can form abstract categories.
Defines new metrics for Lorentzian spaces and their convergence.