Paper optimizes industrial refrigeration using adaptive exploration.
problem Challenges in optimizing real-time industrial processes with unknown characteristics and safety constraints.
method Adaptive and explorative real-time optimization framework with Gaussian process uncertainty quantification.
result Approach increases energy efficiency of refrigeration process, approximating complete information solutions.
New method solves KP problem using global Cartan decompositions.
problem Solving time-optimal unitaries for targets in semi-simple Lie groups.
method Global Cartan decompositions of symmetric spaces for optimal control.
result Analytical solutions for time-optimal unitaries under specific conditions.
Enhances quantum circuit synthesis using deep learning and geometric methods.
problem Optimizing quantum circuits for time efficiency.
method Combining deep learning with geometric control techniques.
result Improved time-optimal control in quantum circuit synthesis.
In this paper we study the sub-Finsler geometry as a time-optimal control problem. In particular, we consider non-smooth and non-strictly convex sub-Finsler structures associated with the Heisenberg, Grushin, and Martinet distributions. Motivated by problems in geometric group theory, we characterize extremal curves, d…
We consider in this paper the regularity problem for time-optimal trajectories of a single-input control-affine system on a n-dimensional manifold. We prove that, under generic conditions on the drift and the controlled vector field, any control u associated with an optimal trajectory is smooth out of a countable set o…
We consider control-linear left-invariant time-optimal problems on step 2 Carnot groups with strictly convex set of control parameters (in particular, sub-Finsler problems). We describe all linear-in-momenta Casimirs on the dual of the Lie algebra. In the case of rank 3 Lie groups we describe the symplectic foliation o…
We describe co-adjoint orbits and Casimir functions for two-step free-nilpotent Lie algebras. The symplectic foliation consists of affine subspaces of the Lie coalgebra of different dimensions. Further, we consider left-invariant time-optimal problems on two-step Carnot groups, for which the set of admissible velocitie…
This study examines abnormal geodesics in 2D-Zermelo navigation problems, revealing their role in separating time minimal and maximal curves.
problem The role of abnormal geodesics in planar Zermelo navigation problems with strong current.
method Geometric time optimal control approach, focusing on the heading angle of the ship.
result Abnormal geodesics separate time minimal and maximal curves, and are both small-time minimizing and maximizing.
We use martingale and stochastic analysis techniques to study a continuous-time optimal stopping problem, in which the decision maker uses a dynamic convex risk measure to evaluate future rewards. We also find a saddle point for an equivalent zero-sum game of control and stopping, between an agent (the "stopper") who c…
The quantum navigation problem of finding the time-optimal control Hamiltonian that transports a given initial state to a target state through quantum wind, that is, under the influence of external fields or potentials, is analysed. By lifting the problem from the state space to the space of unitary gates realising the…
Researchers describe Casimir functions for 3- and 4-step nilpotent Lie groups.
problem Understanding Casimir functions for free nilpotent Lie groups of steps 3 and 4.
method Construction of Casimir functions for free nilpotent Lie groups of steps 3 and 4.
result For 3-step groups, coadjoint orbits are fully described as affine subspaces or direct products of quadrics.
The goal of this paper is to describe Zermelo's navigation problem on Riemannian manifolds as a time-optimal control problem and give an efficient method in order to evaluate its control curvature. We will show that up to change the Riemannian metric on the manifold the control curvature of Zermelo's problem has a simp…
ARTEO algorithm optimizes safety-critical systems with uncertainty.
problem Decision-making under uncertainty with safety constraints in real-time optimization.
method ARTEO algorithm uses multi-armed bandits as a mathematical programming problem subject to safety constraints, learning unknown characteristics through exploration and incorporating uncertainty quantification.
result ARTEO achieves less cumulative regret with accurate and safe decisions.
We consider the Zermelo navigation problem on the ellipsoid of revolution (spheroid) in the presence of a perturbation W determined by a mild velocity vector field, ∣W∣<1, with application of Finsler metric of Randers type in the context of the corresponding optimal control represented by a time-efficient ship's he…
In this paper we study a sub-Finsler geometric problem on the free-nilpotent group of rank 2 and step 3. Such a group is also called Cartan group and has a natural structure of Carnot group, which we metrize considering the ℓ∞ norm on its first layer. We adopt the point of view of time-optimal control theory…
On the ground of origins of the theory of Lie groups and Lie algebras, their (co)adjoint representations, and the Pontryagin maximum principle for the time-optimal problem are given an independent foundation for methods of geodesic vector field to search for normal geodesics of left-invariant (sub-)Finsler metrics on L…
Optimizes trading policies using future price forecasts.
problem Static reinforcement learning agents lack mechanisms for using price forecasts at inference time.
method FPILOT framework inspired by Model Predictive Control (MPC). Uses a predictive model to construct an allocation-based imagined return objective at each decision step.
result Consistent improvements in total return and risk-adjusted metrics across various policy learning algorithms.
Efficient deep policy gradient method for continuous-time control problems.
problem Optimal control in continuous time with fine time discretization.
method Multi-scale deep policy gradient method with varying time discretization.
result Targeted efficiency in computational resources achieved through multi-scale approach.
Given a sequential learning algorithm and a target model, sequential machine teaching aims to find the shortest training sequence to drive the learning algorithm to the target model. We present the first principled way to find such shortest training sequences. Our key insight is to formulate sequential machine teaching…
Study optimizes trading in multiple assets with cross-effects.
problem Optimizing trade execution in multiple assets with cross-impact effects.
method Formulated as a stochastic control problem, extended to progressively measurable controls, solved using linear-quadratic control theory.
result Cross-hedging effects can be optimal, e.g., trading in an asset without an initial position.
Pronounced variability due to the growth of renewable energy sources, flexible loads, and distributed generation is challenging residential distribution systems. This context, motivates well fast, efficient, and robust reactive power control. Real-time optimal reactive power control is possible in theory by solving a n…
A great deal of academic and theoretical work has been dedicated to optimal liquidation of large orders these last twenty years. The optimal split of an order through time (`optimal trade scheduling') and space (`smart order routing') is of high interest \rred{to} practitioners because of the increasing complexity of t…
The stochastic knapsack has been used as a model in wide ranging applications from dynamic resource allocation to admission control in telecommunication. In recent years, a variation of the model has become a basic tool in studying problems that arise in revenue management and dynamic/flexible pricing; and it is in thi…
New method learns policies from offline data using operator models.
problem Limited understanding of approximation errors in offline reinforcement learning.
method Linking reinforcement learning to Hamilton-Jacobi-Bellman equation, proposing operator-theoretic algorithm.
result Global convergence of the value function and finite-sample guarantees derived.
This paper tackles robust control of noisy systems with uncertain distributions.
problem Optimal control of sampled-data stochastic systems with multiplicative noise and distributional ambiguity.
method Develops a convex relaxation to handle the ``concave-max'' geometry and derives a probabilistic performance guarantee.
result Derives an explicit, non-asymptotic bound on the duality gap and proves robust viability conditions.
We develop a theory for solving continuous time optimal stopping problems for non-linear expectations. Our motivation is to consider problems in which the stopper uses risk measures to evaluate future rewards.
Imitation learning is a control design paradigm that seeks to learn a control policy reproducing demonstrations from expert agents. By substituting expert demonstrations for optimal behaviours, the same paradigm leads to the design of control policies closely approximating the optimal state-feedback. This approach requ…
In this paper, we propose two discontinuous dynamical systems in continuous time with guaranteed prescribed finite-time local convergence to strict local minima of a given cost function. Our approach consists of exploiting a Lyapunov-based differential inequality for differential inclusions, which leads to finite-time …
This paper addresses the model-free nonlinear optimal problem with generalized cost functional, and a data-based reinforcement learning technique is developed. It is known that the nonlinear optimal control problem relies on the solution of the Hamilton-Jacobi-Bellman (HJB) equation, which is a nonlinear partial differ…
The paper is devoted to the local classification of generic control-affine systems on an n-dimensional manifold with scalar input for any n>3 or with two inputs for n=4 and n=5, up to state-feedback transformations, preserving the affine structure. First using the Poincare series of moduli numbers we introduce the intr…
In this article we propose a Weighted Stochastic Mesh (WSM) Algorithm for approximating the value of a discrete and continuous time optimal stopping problem. We prove that in the discrete case the WSM algorithm leads to semi-tractability of the corresponding optimal problems in the sense that its complexity is bounded …
AuON is a linear-time optimizer that improves upon Muon's performance without approximate orthogonal matrices.
problem High memory and computational costs of orthogonal momentum updates.
method AuON uses normalized nonlinear scaling and a 'emergency brake' to handle exploding attention logits.
result AuON achieves strong performance without approximate orthogonal matrices, preserving structural alignment and reconditioning.
Paper approximates Kelly betting for wealth growth.
problem Optimizing wealth growth in Kelly betting.
method Taylor-based approximation for quadratic programming.
result Closed-form approximate solution with interesting properties.
We consider remodeling the planar search patterns, in the presence of the river-type perturbation represented by the weak vector field, basing on the time-optimal paths as Finslerian solutions to the Zermelo navigation problem via Randers metric.
This paper develops a framework for training and evaluating neural networks for MPC.
problem Lack of a general framework for characterizing learning approaches in MPC.
method Developed a framework using PyTorch and CVXPY, incorporating hit-and-run sampling for efficient training data generation.
result Proposed metrics for validating neural network-based MPC approaches.
Reinforcement learning (RL) has traditionally been understood from an episodic perspective; the concept of non-episodic RL, where there is no restart and therefore no reliable recovery, remains elusive. A fundamental question in non-episodic RL is how to measure the performance of a learner and derive algorithms to max…
In this paper, we examine higher order difference problems. Using the "squeezing" argument, we derive both Euler's condition and the transversality condition. In order to derive the two conditions, two needed assumptions are identified. A counterexample, in which the transversality condition is not satisfied without th…
Researchers find optimal paths on a specific geometric group.
problem Finding optimal paths on a Cartan group with a sub-Finsler quasimetric.
method Using the Pontryagin Maximum Principle in coordinates of the first kind.
result They found extremals for arbitrary left-invariant sub-Finsler quasimetrics.
Continuous-time optimal stopping solved with deep reinforcement learning
problem Optimal stopping problems in continuous time
method CARLOS (Continuous-time Adaptive Reinforcement Learning for Optimal Stopping)
result Higher prices than existing Bermudan solvers, approaching American upper bound
The authors found extremals of arbitrary left-invariant sub-Finsler metric on the Engel group defined by a distribution of rank two. They use for this the Pontryagin Maximum Principle for the corresponding time-optimal problem in coordinates of the first kind. The obtained results are applied to the case of left-invari…
A new RL method handles uncertainty and constraints in real-time optimization.
problem Real-time optimization under process uncertainty and constraints.
method Chance-constrained reinforcement learning to handle probabilistic state constraints.
result Satisfies process constraints with high probability in real-time.
Consider power utility maximization of terminal wealth in a 1-dimensional continuous-time exponential Levy model with finite time horizon. We discretize the model by restricting portfolio adjustments to an equidistant discrete time grid. Under minimal assumptions we prove convergence of the optimal discrete-time strate…
The paper studies problem of continuous time optimal portfolio selection for a incom- plete market diffusion model. It is shown that, under some mild conditions, near optimal strategies for investors with different performance criteria can be constructed using a limited number of fixed processes (mutual funds), for a m…
Modeling market dynamics with informed and uninformed traders and fads.
problem Optimizing market making in a market with fads, informed, and uninformed traders.
method Characterizing the optimal liquidity provision problem in a market with fads, informed, and uninformed traders, considering both complete and partial information.
result The price of liquidity is a function of the proportion of informed traders, and strategies ignoring fads underperform.
Optimizes portfolio growth rate for a behavioral investor considering terminal relative growth rate.
problem Optimizing a behavioral investor's portfolio growth rate under relative growth criterion.
method Martingale method, concavification, and quantile optimization techniques.
result Derives closed-form optimal growth rate and finds significant impact of benchmark growth rate.
Solves time-optimal navigation on slippery slopes with cross gravitational wind.
problem Time-optimal navigation on a slippery cross slope under gravitational wind.
method New Finsler metric derived for the problem, considering both lateral and longitudinal gravitational effects.
result Conditions for strong convexity and purely geometric solution provided.
Paper proposes efficient image inversion and editing using rectified stochastic differential equations.
problem Inversion and editing of real images using generative models.
method Proposes RF inversion using dynamic optimal control and a linear quadratic regulator, extending to stochastic sampler for Flux.
result Allows state-of-the-art performance in zero-shot inversion and editing, outperforming prior works.
Study uses RL to optimize investment with financial constraints, showing exploration benefits.
problem Optimal investment with financial constraints in continuous time.
method Reinforcement learning framework, focusing on Gaussian and truncated Gaussian distributions.
result Exploration leads to more dispersed wealth distribution with heavier tails, especially with smaller exploration parameters.