The paper tackles data-driven optimal control of unknown nonlinear systems using RKHS.
problem Unknown nonlinear dynamics and stage cost functions.
method Embed state densities into RKHS, learn Markov operators, solve Hamilton-Jacobi-Bellman recursions.
result Solves a wide range of nonlinear control problems, including depth regulation.
We discuss smooth nonlinear control systems with symmetry. For a free and proper action of the symmetry group, the reduction of symmetry gives rise to a reduced smooth nonlinear control system. If the action of the symmetry group is only proper, the reduced nonlinear control system need not be smooth. Using the smooth …
Study optimal control in unknown nonlinear systems with near-optimal regret bound.
problem Sequential control in unknown, nonlinear dynamical systems.
method LC^3 algorithm, based on information theory.
result Near-optimal O ( T ) O(\sqrt{T}) O ( T ) regret bound for episodic settings. Researchers develop a method to control nonlinear systems with Koopman operator regression.
problem Controlling nonlinear systems with finite action spaces.
method Koopman operator regression for dynamics estimation and model predictive control for control.
result The method yields a linear switching predictive model for control.
CNN identifies nonlinear human posture control models efficiently.
problem Identifying nonlinear human posture control models.
method Convolutional Neural Networks (CNN) for model identification.
result Efficiently identifies nonlinear human posture control models.
Controller seeks informative system observations to predict nonlinear dynamics.
problem Predicting nonlinear dynamics with uncertain parameters.
method Expected free energy minimization for balancing goal state and informative observations.
result Controller improves performance in uncertain parameter scenarios.
Neuro-inspired RL solves complex control problems with fewer controllers.
problem Solving nonlinear control problems with unknown dynamics efficiently.
method Hierarchical RL framework combining limb coordination and reinforcement learning.
result Local LQR controllers combined with a reinforcement learner solve global nonlinear problems.
Adapts model-based advice to stabilize black-box policies for nonlinear control.
problem Stabilizing machine-learned policies for nonlinear control with limited model information.
method Proposes an adaptive λ λ λ -confident policy to combine black-box and model-based advice. result Proves the stability of the adaptive λ λ λ -confident policy and its competitive ratio. Breaks down complex nonlinear dynamics into simpler components.
problem Control of nonlinear dynamical systems remains challenging.
method Inspired by hybrid switching systems, decomposes dynamics into simpler stochastic switching linear dynamical systems.
result Extracts hierarchies of Markovian and auto-regressive locally linear controllers from nonlinear experts.
Reinforcement learning controls complex, black-boxed systems like greenhouses.
problem Controlling nonlinear, complex, and black-boxed systems.
method Actor-critic reinforcement learning approach.
result Successfully maintained greenhouse conditions for 20 times longer than other methods.
We introduce a data-based approach to estimating key quantities which arise in the study of nonlinear control systems and random nonlinear dynamical systems. Our approach hinges on the observation that much of the existing linear theory may be readily extended to nonlinear systems - with a reasonable expectation of suc…
Optimizes exploration for nonlinear systems to learn controllers efficiently.
problem Learning optimal controllers for unknown nonlinear systems.
method Formally quantifies which parameters are most critical, and develops an algorithm to efficiently explore these parameters.
result Proves a near-instance-optimal rate for learning controllers.
New neural methods for stable control with provable guarantees.
problem Designing stable control policies for nonlinear systems.
method Neural network Lyapunov functions and a falsifier to guide learning.
result Provable stability of controlled nonlinear systems.
A controller learns to control a nonlinear plant with unknown model and partial observation using continuous deep Q-learning.
problem Designing a controller for a nonlinear plant with unknown model and partial sensor observation under network delays.
method Continuous deep Q-learning applied to an extended state including past control inputs and outputs.
result The controller can learn a robust control policy to network delays with partial sensor observation.
The paper designs neural networks with assurance for controlling nonlinear systems.
problem Designing neural networks with assurance for nonlinear system control.
method Bounding the number of affine functions needed for a CPWA function, connecting it to a TLL NN architecture.
result The TLL NN architecture is parameterized by the number of affine functions in the CPWA function it realizes.
Data-driven control of robotic systems using Koopman operators with error bounds.
problem Real-time control of nonlinear robotic systems with unknown dynamics.
method Constructing a Koopman operator-based linear representation using higher-order derivatives of nonlinear dynamics, with error bounds derived from Taylor series accuracy analysis.
result The Koopman model provides marginally better performance than competing nonlinear modeling methods and can be efficiently controlled using linear control design tools.
Paper uses Koopman operator and Nyström method for efficient nonlinear control.
problem Control of nonlinear dynamical systems.
method Combines Koopman operator framework with Nyström approximation for kernel methods.
result Theoretical guarantees on the convergence rates of the approximated Riccati operator and regulator objective.
Random features enhance control of complex systems.
problem Flexible nonlinear models for control-affine systems.
method Random features approximations for control-affine structure.
result Methods formalized and shown to relate to ADP and AD kernels.
Combines Gaussian processes and polynomial chaos for stochastic control.
problem Uncertainties in dynamic models lead to performance issues in predictive control.
method Combines Gaussian processes with polynomial chaos expansions to estimate probability distributions of nonlinear functions.
result Demonstrates accurate approximation and closed-loop performance in stochastic nonlinear model predictive control.
We consider a stochastic control problem for a class of nonlinear kernels. More precisely, our problem of interest consists in the optimisation, over a set of possibly non-dominated probability measures, of solutions of backward stochastic differential equations (BSDEs). Since BSDEs are nonlinear generalisations of the…
Modeling financial systemic risk with optimal control theory for stability.
problem Analyzing and stabilizing systemic risk in interconnected financial entities.
method Developed a theoretical model using optimal control theory, including steps for synthesizing stabilizing controllers.
result The model ensures that the H ∞ H^{\infty} H ∞ norms of the mappings from disturbance to output are less than a predefined constant, stabilizing the system. Novel algorithm for optimal control of nonlinear systems.
problem Optimal control of nonlinear stochastic dynamical systems with unknown dynamics.
method Decoupled data-based approach combining open-loop and closed-loop control.
result Performance of D2C algorithm is approximately optimal and significantly reduces training time.
Efficient learning-based MPC for unknown nonlinear systems with state constraints.
problem Control of discrete-time nonlinear systems with unknown dynamics and state constraints.
method Receding horizon reinforcement learning (r-LPC) using Koopman operator-based prediction model.
result Proven closed-loop recursive feasibility, robustness, and asymptotic stability under function approximation errors.
This paper addresses the model-free nonlinear optimal problem with generalized cost functional, and a data-based reinforcement learning technique is developed. It is known that the nonlinear optimal control problem relies on the solution of the Hamilton-Jacobi-Bellman (HJB) equation, which is a nonlinear partial differ…
This paper explores using nonlinear control for robust logarithmic growth in coin flipping games.
problem Tackles the use of nonlinear control in recursive betting games with logarithmic growth.
method Formulates a robust nonlinear control problem for a simple coin flipping game, considering a probability range for the coin's bias.
result Provides a closed-form description of the optimal robust nonlinear controller, which outperforms linear controllers.
New algorithm solves Schrödinger bridge problem with mismatched channels.
problem Solving Schrödinger bridge problem with input and noise channel mismatch.
method Design of a Sinkhorn recursion with memory for nonlinear PDEs.
result Demonstrates solving control-affine Schrödinger bridge problem.
This paper analyzes a simplified strategy for nonlinear control using local linear models and iLQR updates.
problem Nonlinear policy optimization in control systems.
method Iterative estimation of local linear models and iLQR-like policy updates.
result Demonstrates polynomial sample complexity and overcomes exponential problem horizon dependence.
RichID learns optimal control policies from nonlinear observations.
problem Continuous control with unknown nonlinearity in system model.
method RichID algorithm using a least-squares regression oracle.
result First provable sample complexity guarantee for continuous control.
New NN design for nonlinear systems control with guarantees.
problem Designing NN architectures for nonlinear system control with guarantees.
method Exploits system model to design NN architecture, uses TLL NN for approximation.
result Guaranteed NN architecture sufficient for implementing a controller.
New method uses neural nets to control systems safely with disturbances.
problem Designing safe control laws for systems with disturbances.
method Imitation learning to train neural network controllers that satisfy CBF constraints.
result Demonstrated on a unicycle model with external disturbances.
This paper uses NLDT to find interpretable control rules from complex DRL policies.
problem Complex, non-interpretable policies from black-box AI methods.
method Evolutionary optimization of NLDT for hierarchical control rules.
result Interpretable control rules with similar performance to black-box DRL.
In this paper, we consider nonlinear PDEs in a port-Hamiltonian setting based on an underlying jet-bundle structure. We restrict ourselves to systems with 1-dimensional spatial domain and 2nd-order Hamiltonian including certain dissipation models that can be incorporated in the port- Hamiltonian framework by means of a…
Two new Koopman models improve nonlinear system prediction.
problem Predicting nonlinear, nonconvex dynamic systems.
method Convex and Extended Koopman Models using deep learning.
result Significantly improved predictive performance.
We introduce a novel data-driven order reduction method for nonlinear control systems, drawing on recent progress in machine learning and statistical dimensionality reduction. The method rests on the assumption that the nonlinear system behaves linearly when lifted into a high (or infinite) dimensional feature space wh…
Nonlinear RNNs' memory capacity varies widely, making it impractical.
problem The usefulness of memory capacity as a metric for linear RNNs is questioned.
method Analysis of random nonlinear RNNs with varying input scales.
result Memory capacity of nonlinear RNNs is arbitrary and impractical.
Method solves high-dimensional nonlinear PDEs using neural networks.
problem Solving high-dimensional fully nonlinear PDEs.
method Backward induction with multi-layer neural networks to estimate solution and its gradient, with Hessian approximated by automatic differentiation.
result Method extends previous work on semi-linear PDEs to fully nonlinear cases, demonstrating accuracy on various examples.
Optimizes electric field to control molecule states in Hartree-Fock theory.
problem Optimizing electric field to drive molecule from initial to target state.
method Trust region optimization with gradients from adjoint state method.
result Achieves desired target states with minimal control effort.
Proposes a new estimator for weak instrumental variables in panel data models.
problem Weak instrumental variables due to ignored nonlinearities in panel data.
method Triangular simultaneous equation model with a nonlinear reduced form equation and a control function approach using Super Learner.
result The proposed SLCF estimator is consistent and asymptotically normal, achieving a parametric rate of convergence.
Novel method estimates complex nonlinear systems with stochastic differential equations.
problem Handling complex nonlinear dynamical systems with strong learning guarantees.
method Estimates drift and diffusion coefficients of continuous, multidimensional, nonlinear controlled stochastic differential equations.
result Strong theoretical guarantees including finite-sample bounds for various metrics.
Paper develops a novel approach for optimal control using kernel methods.
problem Optimal control of nonlinear stochastic systems.
method Infinitesimal generator approach in reproducing kernel Hilbert spaces.
result Data-driven solution to optimal control problems.
This work establishes safe reinforcement learning for LQR with nonlinear baselines.
problem Safe reinforcement learning in LQR with unknown dynamics and safety constraints.
method General framework for nonlinear baselines, focusing on 1D spaces.
result Achieves optimal regret bounds for constrained reinforcement learning.
Non-bilinear observations make optimal control harder, showing non-convex costs and non-affine optimal controllers.
problem Optimal control from bilinear observations in linear systems is challenging.
method Analytical and numerical methods to study the non-convex cost-to-go and non-affine optimal controllers.
result The Separation Principle does not hold for bilinear observations, leading to non-convex costs and non-affine optimal controllers.
Clarifies relation for solving control-affine Schrödinger bridge problems.
problem Solving control-affine Schrödinger bridge problems via Hopf-Cole transform.
method Applies Hopf-Cole transform to conditions of optimality, resulting in nonlinear PDEs.
result Generic control-affine Schrödinger bridge requires further algorithmic development.
New measure EC assesses node contributions in nonlinear, time-varying systems.
problem Existing node contribution measures assume linear, time-invariant dynamics, failing for complex, real-world systems.
method Defined 'emergent contribution (EC)' as a dynamical leverage measure from Jacobians of differentiable models.
result EC diverges from average controllability under persistent regime switching and sign reversal, identifying limits of local linearization.
Combines Lyapunov functions with controller synthesis for safe control policies.
problem Ensuring safety in controller design for nonlinear systems.
method Iterative algorithm combining Lyapunov function estimation and controller synthesis.
result Effective control policies with large safe regions are derived.
Transforms input design for probabilistic models into optimal control of a Hamiltonian system.
problem Designing inputs for probabilistic models with intractable posterior distributions.
method Representing posterior as Hamiltonian system trajectories, solving optimal control problem.
result Parameter posterior concentrates around true parameter values.
Geometrically characterizes virtual nonlinear nonholonomic constraints using symplectic methods.
problem Characterizing virtual nonlinear nonholonomic constraints geometrically.
method Geometric characterization using symplectic structures and Chetaev equations.
result A unique control law exists to satisfy virtual constraints, and closed-loop dynamics are projections of uncontrolled dynamics.
Safe control for vehicles using learned perception from images.
problem Controlling autonomous vehicles with partial state information from images.
method Learned perception map and safe set design for a closed loop system.
result Generalization properties of the perception-control loop are favorable.