A new method shapes reinforcement learning environments by abstracting large state spaces.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
The success of various applications including robotics, digital content creation, and visualization demand a structured and abstract representation of the 3D world from limited sensor data. Inspired by the nature of human perception of 3D shapes as a collection of simple parts, we explore such an abstract shape represe…
Improved reinforcement learning with deep learning.
In shape analysis, the concept of shape spaces has always been vague, requiring a case-by-case approach for every new type of shape. In this paper, we give a general definition for an abstract space of shapes in a manifold. This notion encompasses every shape space studied so far in the literature, and offers a rigorou…
VQShape learns interpretable time-series representations and achieves comparable performance to specialist models.
Python tools for 3D shape analysis on Kendall's space.
Geomstats introduces shape module for analyzing shapes of objects.
Modular meta-learning is a new framework that generalizes to unseen datasets by combining a small set of neural modules in different ways. In this work we propose abstract graph networks: using graphs as abstractions of a system's subparts without a fixed assignment of nodes to system subparts, for which we would need …
Mid-training improves RL by identifying compact action abstractions.
The paper presents a method for analyzing shape graphs using specific features.
Despite remarkable advances in automated visual recognition by machines, some visual tasks remain challenging for machines. Fleuret et al. (2011) introduced the Synthetic Visual Reasoning Test (SVRT) to highlight this point, which required classification of images consisting of randomly generated shapes based on hidden…
New dataset and techniques detect money laundering patterns in crypto.
The abstract introduces a new concept called flagfolds to model multi-dimensional shapes.
Equivariant cohomology simplifies symplectic manifold integrals with group actions.
Generative models learn distributions of continuous functions.
The study of shadow of Vietoris-Rips complexes and their homotopy properties.
In this paper, we present a deep-learning based method for estimating the 3D structure of a bone from a pair of 2D X-ray images. Our triplet loss-trained neural network selects the most closely matching 3D bone shape from a predefined set of shapes. Our predictions have an average root mean square (RMS) distance of 1.0…
Commissioned by MIT's in-house artist Jane Philbrick, we evolve an abstract 2D surface (resembling Marta Pan's 1961 "Sculpture Flottante I") under mean curvature, all the while calculating the eigenmodes and eigenvalues of the Laplace-Beltrami operator on the resulting shapes. These are then synthesized into a sound-wa…
Interprets how intrinsic motivation shapes behavior in RL agents.
Constructs moduli stacks of quiver bundles and applies to Higgs bundles.
Abstraction is a fundamental part when learning behavioral models of systems. Usually the process of abstraction is manually defined by domain experts. This paper presents a method to perform automatic abstraction for network protocols. In particular a weakly supervised clustering algorithm is used to build an abstract…
The paper aims to mathematically define and learn abstractions from data.
Unified framework for causal models at different levels of abstraction.
Abstract MDPs enable strategic exploration and fast reward transfer in complex environments.
Spectral Graph Convolutional Networks (GCNs) are a generalization of convolutional networks to learning on graph-structured data. Applications of spectral GCNs have been successful, but limited to a few problems where the graph is fixed, such as shape correspondence and node classification. In this work, we address thi…
New approach to abstract neural network representations using renormalization group.
Study investigates how simple speech sounds can form abstract categories.
The abstract proves spherical surface decompositions with conical singularities.
Abstract Neural Networks (ANNs) improve DNN verification efficiency.
A distinctive property of human and animal intelligence is the ability to form abstractions by neglecting irrelevant information which allows to separate structure from noise. From an information theoretic point of view abstractions are desirable because they allow for very efficient information processing. In artifici…
Algorithm finds latent structure in value functions for improved reinforcement learning.
Abstraction plays a key role in concept learning and knowledge discovery; this paper is concerned with computational abstraction. In particular, we study the nature of abstraction through a group-theoretic approach, formalizing it as symmetry-driven---as opposed to data-driven---hierarchical clustering. Thus, the resul…
A collection of the accepted abstracts for the Machine Learning for Health (ML4H) workshop at NeurIPS 2019. This index is not complete, as some accepted abstracts chose to opt-out of inclusion.
The paper proposes a principle for dynamically adjusting the granularity of reinforcement learning abstractions.
We present PubMed 200k RCT, a new dataset based on PubMed for sequential sentence classification. The dataset consists of approximately 200,000 abstracts of randomized controlled trials, totaling 2.3 million sentences. Each sentence of each abstract is labeled with their role in the abstract using one of the following …
Convolution is an efficient technique to obtain abstract feature representations using hierarchical layers in deep networks. Although performing convolution in Euclidean geometries is fairly straightforward, its extension to other topological spaces---such as a sphere () or a unit ball ()---…
We prove a definable version of the Whitney embedding theorem for abstract-definable manifolds with , namely: every abstract-definable manifold is abstract-definable embedded into , for some positive integer . As a consequence, we show that every abstract-de…
This paper simplifies OPE in large state spaces using state abstractions.
We introduce an algorithm for model-based hierarchical reinforcement learning to acquire self-contained transition and reward models suitable for probabilistic planning at multiple levels of abstraction. We call this framework Planning with Abstract Learned Models (PALM). By representing subtasks symbolically using a n…
Probabilistic representations, such as Bayesian and Markov networks, are fundamental to much of statistical machine learning. Thus, learning probabilistic representations directly from data is a deep challenge, the main computational bottleneck being inference that is intractable. Tractable learning is a powerful new p…
CIB compresses variables causally, preserving key causal interactions.
Constellation learns group-level visual relationships for abstract reasoning.
Abstract discusses different corks.
Can simple algorithms with a good representation solve challenging reinforcement learning problems? In this work, we answer this question in the affirmative, where we take "simple learning algorithm" to be tabular Q-Learning, the "good representations" to be a learned state abstraction, and "challenging problems" to be…
We present a training system, which can provably defend significantly larger neural networks than previously possible, including ResNet-34 and DenseNet-100. Our approach is based on differentiable abstract interpretation and introduces two novel concepts: (i) abstract layers for fine-tuning the precision and scalabilit…
The study proves topological rigidity for certain geometric shapes using Poincaré inequalities.
Deep neural network learns discrete state abstractions for efficient planning.
moment maps arise as a generalization of genuine moment maps on symplectic manifolds when the symplectic structure is discarded, but the relation between the mapping and the action is kept. Particular examples of abstract moment maps had been used in Hamiltonian mechanics for some time, but the abstract notion originat…