arXiv research

We present a self-contained proof of the Gauss-Bonnet theorem for two-dimensional surfaces embedded in $R^3$ using just classical vector calculus. The exposition should be accessible to advanced undergraduate and non-expert graduate students. It may be viewed as an illustration and exercise in multivariate calculus and…

Study of rotation angles in a rotating disc model.

An ability to postpone one's execution without penalty provides an important strategic advantage in high-frequency trading. To elucidate competition between traders one has to formulate to a quantitative theory of formation of the execution price from market expectations and quotes. This theory was provided in 2005 by …

Paper solves pendulum swing-up problem using RL.

In this paper we show that there are applications that transform the movement of a pendulum into movements in $\mathbb{R}^3$. This can be done using Euler top system of differential equations. On the constant level surfaces, Euler top system reduces to the equation of a pendulum. Those properties are also considered in…

This paper studies the topology of the constant energy surfaces of the double spherical pendulum.

Study of sub-Riemannian problem on specific Lie groups, revealing symmetries and bounds.

This study presents the results of a series of simulation experiments that evaluate and compare four different manifold alignment methods under the influence of noise. The data was created by simulating the dynamics of two slightly different double pendulums in three-dimensional space. The method of semi-supervised fea…

An energy based approach for stabilizing a mechanical system has offered a simple yet powerful control scheme. However, since it does not impose such strong constraints on parameter space of the controller, finding appropriate parameter values for an optimal controller is known to be hard. This paper intends to generat…

This paper classifies Legendre singularities of sub-Riemannian geodesics on surfaces.

Estimates system parameters from a single observation using kernel-based score.

Study on elastic curves with variable stiffness, derived from bending energy.

CW-EDMD improves prediction accuracy by learning local Koopman models for different state-space regions.

Reinforcement learning is a powerful paradigm for learning optimal policies from experimental data. However, to find optimal policies, most reinforcement learning algorithms explore all possible actions, which may be harmful for real-world systems. As a consequence, learning algorithms are rarely applied on safety-crit…

Paper constructs new minimal submanifolds in spheres by spinning given ones.

Discover conservation laws from trajectories using a neural network.

In this study we introduce a new technique for symbolic regression that guarantees global optimality. This is achieved by formulating a mixed integer non-linear program (MINLP) whose solution is a symbolic mathematical expression of minimum complexity that explains the observations. We demonstrate our approach by redis…

Paper proposes adaptive control for unknown systems using reinforcement learning.

We propose new symplectic networks (SympNets) for identifying Hamiltonian systems from data based on a composition of linear, activation and gradient modules. In particular, we define two classes of SympNets: the LA-SympNets composed of linear and activation modules, and the G-SympNets composed of gradient modules. Cor…

We propose directed time series regression, a new approach to estimating parameters of time-series models for use in certainty equivalent model predictive control. The approach combines merits of least squares regression and empirical optimization. Through a computational study involving a stochastic version of a well …

We study the determination of the second-order normal form for perturbed Hamiltonians $H_ε=H_0 +εH_1 +\frac{ε^2}{2} H_2$, relative to the periodic flow of the unperturbed Hamiltonian $H_0$. The formalism presented here is global, and can be easily implemented in any CAS. We illustrate it by means of two examples: the H…

Model-based reinforcement learning methods typically learn models for high-dimensional state spaces by aiming to reconstruct and predict the original observations. However, drawing inspiration from model-free reinforcement learning, we propose learning a latent dynamics model directly from rewards. In this work, we int…

Comparison of UQ methods in deep learning for a simple physical system.

New AI learns like neurons, generalizing from sparse rewards.

Almost toric manifolds form a class of singular Lagrangian fibered symplectic manifolds that is a natural generalization of toric manifolds. Notable examples include the K3 surface, the phase space of the spherical pendulum and rational balls useful for symplectic surgeries. The main result of the paper is a complete c…

We consider magnetic geodesic flows of the normal metrics on a class of homogeneous spaces, in particular (co)adjoint orbits of compact Lie groups. We give the proof of the non-commutative integrability of flows and show, in addition, for the case of (co)adjoint orbits, the usual Liouville integrability by means of ana…

The present paper extends the classical second-order variational problem of Herglotz type to the more general context of the Euclidean sphere S^n following variational and optimal control approaches. The relation between the Hamiltonian equations and the generalized Euler-Lagrange equations is established. This problem…

Developing mathematical models of dynamic systems is central to many disciplines of engineering and science. Models facilitate simulations, analysis of the system's behavior, decision making and design of automatic control algorithms. Even inherently model-free control techniques such as reinforcement learning (RL) hav…

This paper detects Markov violations in RL with noise, improving policy development.

We briefly review the notion of second order constrained (continuous) system (SOCS) and then propose a discrete time counterpart of it, which we naturally call discrete second order constrained system (DSOCS). To illustrate and test numerically our model, we construct certain integrators that simulate the evolution of …

We study the motion of a particle in the hyperbolic plane (embedded in Minkowski space), under the action of a potential that depends only on one variable. This problem is the analogous to the spherical pendulum in a unidirectional force field. However, for the discussion of the hyperbolic plane one has to distinguish …

Neural SVEs model complex systems with memory, outperforming traditional methods.

Controller seeks informative system observations to predict nonlinear dynamics.

Approximate 3D elastic curves with exact constraints

Policy gradient algorithms typically combine discounted future rewards with an estimated value function, to compute the direction and magnitude of parameter updates. However, for most Reinforcement Learning tasks, humans can provide additional insight to constrain the policy learning. We introduce a general method to i…

A core novelty of Alpha Zero is the interleaving of tree search and deep learning, which has proven very successful in board games like Chess, Shogi and Go. These games have a discrete action space. However, many real-world reinforcement learning domains have continuous action spaces, for example in robotic control, na…

Learning to make decisions from observed data in dynamic environments remains a problem of fundamental importance in a number of fields, from artificial intelligence and robotics, to medicine and finance. This paper concerns the problem of learning control policies for unknown linear dynamical systems so as to maximize…

Reinforcement learning is a promising approach to learning robotics controllers. It has recently been shown that algorithms based on finite-difference estimates of the policy gradient are competitive with algorithms based on the policy gradient theorem. We propose a theoretical framework for understanding this phenomen…

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on absolute or deterministic reward as a metric for optimization process renders rein…

We present an approach to identify concise equations from data using a shallow neural network approach. In contrast to ordinary black-box regression, this approach allows understanding functional relations and generalizing them from observed data to unseen parts of the parameter space. We show how to extend the class o…

PID control architectures are widely used in industrial applications. Despite their low number of open parameters, tuning multiple, coupled PID controllers can become tedious in practice. In this paper, we extend PILCO, a model-based policy search framework, to automatically tune multivariate PID controllers purely bas…

We introduce and begin the study of new knot energies defined on knot diagrams. Physically, they model the internal energy of thin metallic solid tori squeezed between two parallel planes. Thus the knots considered can perform the second and third Reidemeister moves, but not the first one. The energy functionals consid…

Many dynamical systems exhibit similar structure, as often captured by hand-designed simplified models that can be used for analysis and control. We develop a method for learning to correspond pairs of dynamical systems via a learned latent dynamical system. Given trajectory data from two dynamical systems, we learn a …

Expert augmentation improves hybrid model generalization.

We present foundations for using Model Predictive Control (MPC) as a differentiable policy class for reinforcement learning in continuous state and action spaces. This provides one way of leveraging and combining the advantages of model-free and model-based approaches. Specifically, we differentiate through MPC by usin…

Method learns latent dynamics of complex systems from noisy data.

This paper improves reinforcement learning policies in a scalable way.

Simplifies neural network models by explicitly enforcing constraints in Cartesian coordinates.