The paper proposes a framework to reason about object dynamics for faster reinforcement learning.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Object-based approaches for learning action-conditioned dynamics has demonstrated promise for generalization and interpretability. However, existing approaches suffer from structural limitations and optimization difficulties for common environments with multiple dynamic objects. In this paper, we present a novel self-s…
Bayesian methods improve tracking multiple objects through dynamic dependencies.
This paper describes how to define and work with differential equations in the abstract setting of tangent categories. The key notion is that of a curve object which is, for differential geometry, the structural analogue of a natural number object. A curve object is a preinitial object for dynamical systems; dynamical …
Modeling interacting objects with latent Gaussian process ODEs.
We propose a framework for the completely unsupervised learning of latent object properties from their interactions: the perception-prediction network (PPN). Consisting of a perception module that extracts representations of latent object properties and a prediction module that uses those extracted properties to simula…
New method optimizes multiple objectives using particle dynamics and gradient flow.
Soft geometric bias improves physical dynamics predictions.
New architecture separates object state and behavior for better game dynamics.
This work learns visual representations for deformable objects using contrastive estimation.
Paper proposes learning system dynamics from irregularly-sampled partial observations.
In this paper we present an end-to-end deep learning framework to turn images that show dynamic content, such as vehicles or pedestrians, into realistic static frames. This objective encounters two main challenges: detecting all the dynamic objects, and inpainting the static occluded background with plausible imagery. …
We present an approach to learn the dynamics of multiple objects from image sequences in an unsupervised way. We introduce a probabilistic model that first generate noisy positions for each object through a separate linear state-space model, and then renders the positions of all objects in the same image through a high…
The central task in modeling complex dynamical systems is parameter estimation. This task involves numerous evaluations of a computationally expensive objective function. Surrogate-based optimization introduces a computationally efficient predictive model that approximates the value of the objective function. The stand…
Paper approximates solutions for complex decision processes with limited precision.
In unsupervised learning, there is no apparent straightforward cost function that can capture the significant factors of variations and similarities. Since natural systems have smooth dynamics, an opportunity is lost if an unsupervised objective function remains static during the training process. The absence of concre…
Top 8 robotic vision systems tackled lifelong object recognition challenges.
Scalability in terms of object density in a scene is a primary challenge in unsupervised sequential object-oriented representation learning. Most of the previous models have been shown to work only on scenes with a few objects. In this paper, we propose SCALOR, a probabilistic generative world model for learning SCALab…
Many real-world decision problems are characterized by multiple conflicting objectives which must be balanced based on their relative importance. In the dynamic weights setting the relative importance changes over time and specialized algorithms that deal with such change, such as a tabular Reinforcement Learning (RL) …
LRSAO uses RL to dynamically select and unlearn auxiliary objectives for EA optimization.
Real-world dynamical systems often consist of multiple stochastic subsystems that interact with each other. Modeling and forecasting the behavior of such dynamics are generally not easy, due to the inherent hardness in understanding the complicated interactions and evolutions of their constituents. This paper introduce…
A new framework reduces inconsistencies in chaotic surrogate modeling.
In order to meet the diverse challenges in solving many real-world problems, an intelligent agent has to be able to dynamically construct a model of its environment. Objects facilitate the modular reuse of prior knowledge and the combinatorial construction of such models. In this work, we argue that dynamically bound f…
Study on neural networks with regularisation and its impact on training dynamics.
New framework solves dynamic bilevel optimization problems in reinforcement learning.
Capsule networks improve with dynamic routing using Wasserstein objective.
In this paper we construct some natural geometrical objects on the 1-jet space J^1(R,R^3), like a nonlinear connection, a Cartan linear connection (together with its d-torsions and d-curvatures), a jet "electromagnetic" d-field and its geometric "electromagnetic" Yang-Mills energy, starting from a given dynamical syste…
We introduce a topological object, called hairy Cantor set, which in many ways enjoys the universal features of objects like Jordan curve, Cantor set, Cantor bouquet, hairy Jordan curve, etc. We give an axiomatic characterisation of hairy Cantor sets, and prove that any two such objects in the plane are ambiently homeo…
The Lagrangian description of mechanical systems and the Legendre Transformation (considered as a passage from the Lagrangian to the Hamiltonian formulation of the dynamics) for point-like objects, for which the infinitesimal configuration space is TM, is based on the existence of canonical symplectic isomorphisms of d…
Designs a framework to transfer causal models between similar environments.
This work discovers latent field effects governing interacting dynamical systems.
This paper improves forecast stability without sacrificing accuracy using dynamic loss weighting.
New online algorithms tackle dynamic decision-focused learning.
Games generalize the single-objective optimization paradigm by introducing different objective functions for different players. Differentiable games often proceed by simultaneous or alternating gradient updates. In machine learning, games are gaining new importance through formulations like generative adversarial netwo…
This paper takes a step towards temporal reasoning in a dynamically changing video, not in the pixel space that constitutes its frames, but in a latent space that describes the non-linear dynamics of the objects in its world. We introduce the Kalman variational auto-encoder, a framework for unsupervised learning of seq…
We prove that stochastic gradient descent efficiently converges to the global optimizer of the maximum likelihood objective of an unknown linear time-invariant dynamical system from a sequence of noisy observations generated by the system. Even though the objective function is non-convex, we provide polynomial running …
Neural model predicts object states and physical parameters from visual observations.
New neural network designs learn contact dynamics efficiently.
A novel tracking algorithm models dynamic objects as ellipsoids with time-varying orientation.
This paper examines challenges and solutions for solving variational inequalities.
Model-based reinforcement learning (MBRL) has been shown to be a powerful framework for data-efficiently learning control of continuous tasks. Recent work in MBRL has mostly focused on using more advanced function approximators and planning schemes, with little development of the general framework. In this paper, we id…
When humans observe a physical system, they can easily locate objects, understand their interactions, and anticipate future behavior, even in settings with complicated and previously unseen interactions. For computers, however, learning such models from videos in an unsupervised fashion is an unsolved research problem.…
Proposes local coordinate frames for improving model performance in complex dynamical systems.
Paper uses RL for dynamic swaption hedging, outperforming traditional methods.
Wasserstein gradient flows are continuous time dynamics that define curves of steepest descent to minimize an objective function over the space of probability measures (i.e., the Wasserstein space). This objective is typically a divergence w.r.t. a fixed target distribution. In recent years, these continuous time dynam…
Classical knot theory deals with {\em diagrams} and {\em invariants}. By means of horizontal {\em trisecants}, we construct a new theory of classical braids with invariants valued in {\em pictures}. These pictures are closely related to diagrams of the initial object. The main tool is the notion of {\em free -braid …
SPARTAN learns sparse interaction graphs between objects in scenes.
Recurrent-DBN models dynamic relational data with interpretable latent structures.