RL approach for target tracking with unknown dynamics and sensor control.
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Trend · papers per month
Perfect tracking control for real-world Euler-Lagrange systems is challenging due to uncertainties in the system model and external disturbances. The magnitude of the tracking error can be reduced either by increasing the feedback gains or improving the model of the system. The latter is clearly preferable as it allows…
Paper presents neural network controllers for offset-free setpoint tracking.
Paper solves tracking control for -flat systems using classical states.
Improved FDR control for sparse financial index tracking.
In this paper, we propose new conditions guaranteeing that the trajectories of a mechanical control system can track any curve on the configuration manifold. We focus on systems that can be represented as forced affine connection control systems and we generalize the sufficient conditions for tracking known in the lite…
The paper solves a control problem using reflections to track a benchmark process.
The paper extends Merton's problem by adding benchmark tracking, finding optimal strategies.
New approach uses Gaussian processes to learn and track complex systems with guaranteed accuracy.
Study optimal consumption with relaxed benchmarks and drawdown constraints.
In this paper we consider -flat nonlinear control systems with two inputs, and show that every such system can be rendered static feedback linearizable by prolongations of a suitably chosen control. This result is not only of theoretical interest, but has also important implications on the design of flatness bas…
Bayesian approach for constructing and rebalancing sparse index-tracking portfolios.
Combining causality, control, and reinforcement learning for system control.
We develop a methodology for index tracking and risk exposure control using financial derivatives. Under a continuous-time diffusion framework for price evolution, we present a pathwise approach to construct dynamic portfolios of derivatives in order to gain exposure to an index and/or market factors that may be not di…
In this work, a new approach for Sun tracking systems is presented. Due to the current system limitations regarding costs and operational problems, a new approach based on low cost, computer vision open hardware and deep learning has been developed. The preliminary tests carried out successfully in Plataforma solar de …
This paper explores the capability of deep neural networks to capture key characteristics of vehicle dynamics, and their ability to perform coupled longitudinal and lateral control of a vehicle. To this extent, two different artificial neural networks are trained to compute vehicle controls corresponding to a reference…
This paper investigates trajectory tracking problem for a class of underactuated autonomous underwater vehicles (AUVs) with unknown dynamics and constrained inputs. Different from existing policy gradient methods which employ single actor-critic but cannot realize satisfactory tracking control accuracy and stable learn…
Our goal is to improve variance reducing stochastic methods through better control variates. We first propose a modification of SVRG which uses the Hessian to track gradients over time, rather than to recondition, increasing the correlation of the control variates and leading to faster theoretical convergence close to …
This paper optimizes portfolio selection by penalizing tracking error, improving Sharpe ratio.
Method improves volatility targeting for index construction.
Optimal portfolio tracking with dynamic capital injection into a ratcheting benchmark.
We consider the problem of tracking a target whose dynamics is modeled by a continuous Itō semi-martingale. The aim is to minimize both deviation from the target and tracking efforts. We establish the existence of asymptotic lower bounds for this problem, depending on the cost structure. These lower bounds can be relat…
This paper optimizes tracking portfolios in incomplete markets using reinforcement learning.
We propose a long term portfolio management method which takes into account a liability. Our approach is based on the LQG (Linear, Quadratic cost, Gaussian) control problem framework and then the optimal portfolio strategy hedges the liability by directly tracking a benchmark process which represents the liability. Two…
Paper proposes adaptive control for unknown systems using reinforcement learning.
In the automation of many kinds of processes, the observable outcome can often be described as the combined effect of an entire sequence of actions, or controls, applied throughout its execution. In these cases, strategies to optimise control policies for individual stages of the process might not be applicable, and in…
Quantifying behavior is crucial for many applications in neuroscience. Videography provides easy methods for the observation and recording of animal behavior in diverse settings, yet extracting particular aspects of a behavior for further analysis can be highly time consuming. In motor control studies, humans or other …
Deep RL improves power control and scheduling for wireless multicast systems.
We use online convex optimization (OCO) for setpoint tracking with uncertain, flexible loads. We consider full feedback from the loads, bandit feedback, and two intermediate types of feedback: partial bandit where a subset of the loads are individually observed and the rest are observed in aggregate, and Bernoulli feed…
Gaussian Processes (GPs) are widely employed in control and learning because of their principled treatment of uncertainty. However, tracking uncertainty for iterative, multi-step predictions in general leads to an analytically intractable problem. While approximation methods exist, they do not come with guarantees, mak…
Proposes an efficient method for sparse index tracking with -norm constraints.
In microsurgery, lasers have emerged as precise tools for bone ablation. A challenge is automatic control of laser bone ablation with 4D optical coherence tomography (OCT). OCT as high resolution imaging modality provides volumetric images of tissue and foresees information of bone position and orientation (pose) as we…
This work presents a methodology to design trajectory tracking feedback control laws, which embed non-parametric statistical models, such as Gaussian Processes (GPs). The aim is to minimize unmodeled dynamics such as undesired slippages. The proposed approach has the benefit of avoiding complex terramechanics analysis …
We study the tracking of a trajectory for a nonholonomic system by recasting the problem as a constrained optimal control problem. The cost function is chosen to minimize the error in positions and velocities between the trajectory of a nonholonomic system and the desired reference trajectory, both evolving on the dist…
We consider a multicast scheme recently proposed for a wireless downlink in [1]. It was shown earlier that power control can significantly improve its performance. However for this system, obtaining optimal power control is intractable because of a very large state space. Therefore in this paper we use deep reinforceme…
The paper provides guarantees for feedback control with sensor errors.
In this paper, we propose a reinforcement learning-based algorithm for trajectory optimization for constrained dynamical systems. This problem is motivated by the fact that for most robotic systems, the dynamics may not always be known. Generating smooth, dynamically feasible trajectories could be difficult for such sy…
Decentralized solutions to finite-sum minimization are of significant importance in many signal processing, control, and machine learning applications. In such settings, the data is distributed over a network of arbitrarily-connected nodes and raw data sharing is prohibitive often due to communication or privacy constr…
We apply Deep Q-network (DQN) with the consideration of safety during the task for deciding whether to conduct the maneuver. Furthermore, we design two similar Deep Q learning frameworks with quadratic approximator for deciding how to select a comfortable gap and just follow the preceding vehicle. Finally, a polynomial…
Portfolio management problems are often divided into two types: active and passive, where the objective is to outperform and track a preselected benchmark, respectively. Here, we formulate and solve a dynamic asset allocation problem that combines these two objectives in a unified framework. We look to maximize the exp…
Percolation on complex networks has been used to study computer viruses, epidemics, and other casual processes. Here, we present conditions for the existence of a network specific, observation dependent, phase transition in the updated posterior of node states resulting from actively monitoring the network. Since tradi…
Deep learning predicts market sensitivities for cost-effective index tracking.
Paper studies optimal tracking portfolio in mean field game of large fund competition.
We consider the optimal control problem for a linear conditional McKean-Vlasov equation with quadratic cost functional. The coefficients of the system and the weigh-ting matrices in the cost functional are allowed to be adapted processes with respect to the common noise filtration. Semi closed-loop strategies are intro…
Active learning method estimates nonlinear systems efficiently.
The paper analyzes deep neural networks using control theory to set a time limit for their convergence.
Motivated by the recent applications of game-theoretical learning techniques to the design of distributed control systems, we study a class of control problems that can be formulated as potential games with continuous action sets, and we propose an actor-critic reinforcement learning algorithm that provably converges t…
EviTrack improves sequential prediction in delayed disambiguation scenarios.