arXiv research

Framework learns robust control policies from expert demonstrations.

Fault detection problem for closed loop uncertain dynamical systems, is investigated in this paper, using different deep learning based methods. Traditional classifier based method does not perform well, because of the inherent difficulty of detecting system level faults for closed loop dynamical system. Specifically, …

Study on parameter dynamics in exponential families under closed-loop learning.

Formula adjusts steady-state models for control confounding.

This paper addresses the problem of learning the optimal control policy for a nonlinear stochastic dynamical system with continuous state space, continuous action space and unknown dynamics. This class of problems are typically addressed in stochastic adaptive control and reinforcement learning literature using model-b…

Data-efficient reinforcement learning (RL) in continuous state-action spaces using very high-dimensional observations remains a key challenge in developing fully autonomous systems. We consider a particularly important instance of this challenge, the pixels-to-torques problem, where an RL agent learns a closed-loop con…

Data-efficient learning in continuous state-action spaces using very high-dimensional observations remains a key challenge in developing fully autonomous systems. In this paper, we consider one instance of this challenge, the pixels to torques problem, where an agent must learn a closed-loop control policy from pixel i…

Robot science discovers new materials faster.

Study bounds the length of shortest periodic geodesics on certain curved spaces.

For large-scale industrial processes under closed-loop control, process dynamics directly resulting from control action are typical characteristics and may show different behaviors between real faults and normal changes of operating conditions. However, conventional distributed monitoring approaches do not consider the…

This work discusses a closed-loop control strategy for complex systems utilizing scarce and streaming data. A discrete embedding space is first built using hash functions applied to the sensor measurements from which a Markov process model is derived, approximating the complex system's dynamics. A control strategy is t…

Geometrically characterizes virtual nonlinear nonholonomic constraints using symplectic methods.

Closed loop solitons in a plane, whose curvatures obey the modified Korteweg-de Vries equation, were investigated. It was shown that their tangential vectors are expressed by ratio of Weierstrass sigma functions for genus one case and ratio of Baker's sigma functions for the genus two case. This study is closely relate…

Analyzes how learning algorithms affect and are affected by data manipulation.

DQN outperforms static policies in a dynamic fee environment for automated market makers.

Deep neural networks are known to be fragile to small adversarial perturbations. This issue becomes more critical when a neural network is interconnected with a physical system in a closed loop. In this paper, we show how to combine recent works on neural network certification tools (which are mainly used in static set…

We propose a reinforcement learning (RL) based closed loop power control algorithm for the downlink of the voice over LTE (VoLTE) radio bearer for an indoor environment served by small cells. The main contributions of our paper are to 1) use RL to solve performance tuning problems in an indoor cellular network for voic…

This paper uses NLDT to find interpretable control rules from complex DRL policies.

New budget quantifies drift in closed-loop learning, improving reproducibility.

In this paper, we study the problem of learning vision-based dynamic manipulation skills using a scalable reinforcement learning approach. We study this problem in the context of grasping, a longstanding challenge in robotic manipulation. In contrast to static learning behaviors that choose a grasp point and then execu…

Paper predicts recycling bin full events to reduce RVM downtime.

Study shows how multiple traders can trade together without excessive price impact.

Sequential learning of tasks using gradient descent leads to an unremitting decline in the accuracy of tasks for which training data is no longer available, termed catastrophic forgetting. Generative models have been explored as a means to approximate the distribution of old tasks and bypass storage of real data. Here …

AdaptOn achieves logarithmic regret in adaptive control of unknown partially observable linear systems.

CLQT benchmarks LLM portfolio managers by evaluating their decision-making process, not just returns.

Reinforcement Learning optimizes low-thrust interplanetary trajectories under disturbances.

The paper tackles performative risk optimization under weak convexity assumptions.

Robust model predictive control (MPC) is a well-known control technique for model-based control with constraints and uncertainties. In classic robust tube-based MPC approaches, an open-loop control sequence is computed via periodically solving an online nominal MPC problem, which requires prior model information and fr…

A homothety surface can be assembled from polygons by identifying their edges in pairs via homotheties, which are compositions of translation and scaling. We consider linear trajectories on a 1-parameter family of genus-2 homothety surfaces. The closure of a trajectory on each of these surfaces always has Hausdorff dim…

ApolloRL offers a platform for RL research in autonomous driving.

Study finds loops with specific curvature exist using Hardy's inequality.

New framework optimizes forecasting and decision-making in dynamic systems.

Paper tackles stochastic control with mean and higher-order moments, finding Nash equilibria.

A geometric approach to differential game theory is illustrated. The parallel pursuit is considered as a two-player zero-sum differential game. The optimal strategies of each player is designed based on Riemann-Finsler geometry. Our approach incorporates a closed loop optimal control and the presentation is familiar wi…

PandaAI: A practical agent for neuro-symbolic data analysis and decision-making in finance

The paper provides guarantees for feedback control with sensor errors.

We present an alternative local definition of the writhe of a self-avoiding closed loop which differs from the traditional non-local definition by an integer. When studying dynamics this difference is immaterial. We employ a formula due to Aldinger, Klapper and Tabor for the change in writhe and propose a set of local,…

We enhance autonomous materials research with problem-aware models.

Filling length measures the length of the contracting closed loops in a null-homotopy. The filling length function of Gromov for a finitely presented group measures the filling length as a function of length of edge-loops in the Cayley 2-complex. We give a bound on the filling length function in terms of the log of an …

Unsupervised exploration and representation learning become increasingly important when learning in diverse and sparse environments. The information-theoretic principle of empowerment formalizes an unsupervised exploration objective through an agent trying to maximize its influence on the future states of its environme…

Deep RL improves blood glucose control for T1D patients.

Neural Networks (NN) have been proposed in the past as an effective means for both modeling and control of systems with very complex dynamics. However, despite the extensive research, NN-based controllers have not been adopted by the industry for safety critical systems. The primary reason is that systems with learning…

Iterative method learns unknown constraints for MPC control.

TIE framework detects out-of-distribution samples and estimates uncertainty without external datasets.

Combines Gaussian processes and polynomial chaos for stochastic control.

In this work, we propose a new learning approach for autonomous navigation and landing of an Unmanned-Aerial-Vehicle (UAV). We develop a multimodal fusion of deep neural architectures for visual-inertial odometry. We train the model in an end-to-end fashion to estimate the current vehicle pose from streams of visual an…

Co-adaptation is a special form of on-line learning where an algorithm $\mathcal{A}$ must assist an unknown algorithm $\mathcal{B}$ to perform some task. This is a general framework and has applications in recommendation systems, search, education, and much more. Today, the most common use of co-adaptive algorithms is …

We propose a sliding surface for systems on the Lie group $SO(3)\times \mathbb{R}^3$ . The sliding surface is shown to be a Lie subgroup. The reduced-order dynamics along the sliding subgroup have an almost globally asymptotically stable equilibrium. The sliding surface is used to design a sliding-mode controller for t…