Paper uses imitation learning to create efficient insulin policies from MPC demonstrations.
problem Resource-constrained medical devices struggle with complex MPC optimizations and state estimation errors.
method Imitation learning of neural network policies from MPC-computed demonstrations, using Bayesian inference with Monte Carlo Dropout.
result Trained policies generalize well to different patient cohorts, outperforming traditional MPC with state estimation.
Study discovers patterns in insulin needs for T1D patients.
problem Finding the right insulin dose and time for T1D patients is challenging.
method Used OpenAPS Data Commons dataset and time series techniques like matrix profile and multi-variate clustering.
result Identified temporal patterns in insulin needs driven by factors like carbohydrates and possibly others.
Deep RL improves blood glucose control for T1D patients.
problem Managing blood glucose levels for people with type 1 diabetes.
method Developed deep reinforcement learning techniques for automated blood glucose control.
result Deep RL approach outperforms baseline control algorithms, reducing glycemic risk and hypoglycemia.
Neural system optimizes glucose levels in diabetics.
problem Limited research on continuous glucose maintenance devices.
method Differential predictive control with neural policy and differentiable modeling.
result Improves glucose level optimization in real-time.
\begin{abstract} We model individual T2DM patient blood glucose level (BGL) by stochastic process with discrete number of states mainly but not solely governed by medication regimen (e.g. insulin injections). BGL states change otherwise according to various physiological triggers which render a stochastic, statisticall…
Framework generates personalized insulin treatment strategies using deep models.
problem Developing optimal personalized treatment strategies for diabetes patients.
method Combines deep generative time series models with decision theory.
result Demonstrated improved personalized insulin treatment strategies for diabetes patients.
New model predicts blood glucose in diabetics with improved accuracy.
problem Forecasting blood glucose in type 1 diabetics with high accuracy.
method Integrates machine learning with existing biomedical model to capture time-varying dynamics.
result Improved long-term forecasting of blood glucose up to 6 hours.
Reinforcement Learning improves insulin bolus decisions for type-I diabetes patients.
problem Optimal insulin bolus decisions for type-I diabetes patients are not well-established.
method Applied Reinforcement Learning to simulated T1DM data.
result Optimal bolus rule differs from standard advisors and can prevent hypoglycemia.
Machine learning detects subtle glucose changes for early diabetes diagnosis.
problem Challenging early-stage diabetes diagnosis due to subtle glucose changes.
method Applied machine learning to synthetic glucose profiles generated by a biophysical model.
result High accuracy (above 85%) in detecting insulin resistance using various neural networks.
HAD-Net forecasts glucose levels with insights into insulin and carbs diffusion.
problem Inaccurate predictions in glucose level forecasting without context understanding.
method Hybrid model combining deep learning and physiological models, using recurrent attention network.
result Achieves competitive performance in glucose level forecasting with plausible diffusion insights.
Paper proposes a DRL-based controller for networked AP systems that reduces communication frequency.
problem Reduce communication frequency in networked AP systems while maintaining control performance.
method Develops a DRL-based controller that avoids explicit update timing learning, using a semi-Markov decision process (SMDP).
result Improves communication efficiency without sacrificing control performance.
Patients with Type I Diabetes (T1D) must take insulin injections to prevent the serious long term effects of hyperglycemia - high blood glucose (BG). Patients must also be careful not to inject too much insulin because this could induce hypoglycemia (low BG), which can potentially be fatal. Patients therefore follow a …
Hybrid model learns interpretable meal-level glycemic control.
problem Lack of flexible, interpretable meal-level glycemic control methods.
method Hybrid variational autoencoder grounding latent space to mechanistic differential equation.
result Unsupervised representation discovers separation between individuals based on disease severity.
Modern treatments for Type 1 diabetes (T1D) use devices known as artificial pancreata (APs), which combine an insulin pump with a continuous glucose monitor (CGM) operating in a closed-loop manner to control blood glucose levels. In practice, poor performance of APs (frequent hyper- or hypoglycemic events) is common en…
CBDL uses credal sets to improve uncertainty quantification in deep learning.
problem Uncertainty in predictions and robustness to distribution shifts in deep learning.
method Train an infinite ensemble of Bayesian Neural Networks using credal sets.
result CBDL distinguishes between aleatoric and epistemic uncertainties and quantifies them better than single BNNs.
New model predicts multiple outputs with missing labels.
problem Missing group labels in multi-output regression.
method Weakly-supervised multi-output model using correlated Gaussian processes.
result Model excels in multi-output settings with missing labels.
Study robust best-arm identification in linear bandits with lower bounds and algorithms.
problem Identify a near-optimal robust arm in linear bandits with adversarial actions.
method Propose instance-dependent lower bounds and both static and adaptive bandit algorithms.
result Sample complexity matches the lower bound and algorithms effectively identify robust arms.
Paper presents estimators for entropy and information in probabilistic models.
problem Estimating entropy and mutual information in high dimensions is challenging.
method EEVI uses importance sampling with proposal distributions like amortized variational inference and sequential Monte Carlo.
result EEVI delivers accurate upper and lower bounds on information quantities.
A method models continuous-time glucose distributions in children with diabetes.
problem Capturing subtle temporal changes in glucose distributions.
method Probabilistic framework using Gaussian mixtures and neural ODEs.
result Detects treatment-related improvements in glucose dynamics.
RETAIN model improves glucose forecasting for diabetics, offering both accuracy and interpretability.
problem Inability of deep learning models to interpret their predictions in healthcare.
method Two-level attention mechanism in a recurrent neural network (RETAIN) architecture.
result RETAIN model achieves comparable accuracy to LSTM and FCN models while being highly interpretable.
Modern automation systems rely on closed loop control, wherein a controller interacts with a controlled process, based on observations. These systems are increasingly complex, yet most controllers are linear Proportional-Integral-Derivative (PID) controllers. PID controllers perform well on linear and near-linear syste…
Derives optimal control conditions using calculus of variations.
problem Optimizing Markov control in stochastic control problems.
method Calculus of variations approach to derive necessary conditions.
result Solves the Merton portfolio optimization problem.
Framework simplifies vision-based control and goal discovery.
problem Learning proportional control from visual data.
method Introduces NewtonianVAE for proportional control and goal discovery.
result Dramatic simplification and acceleration of vision-based controllers.
Paper studies constrained control games with a novel approximation method.
problem Games with constrained control directions.
method Approximation procedure based on L1-stability estimates and almost sure convergence. result Existence of game's value and optimal strategy for the stopper.
This work tackles force control for contact-rich manipulation tasks with rigid robots using RL.
problem Challenges in working with real robotic hardware, especially position-controlled robots.
method Combines RL with traditional force control techniques, implementing parallel position/force control and admittance control.
result Validated methods on both simulation and real robot (UR3 e-series) for force control.
RL applied to TCLs for power consumption control.
problem Optimizing power consumption using TCLs with RL.
method Modelica-based reinforcement learning (Q-learning) for stochastic TCLs.
result Q-learning parameters affect controller performance.
A framework integrates machine learning with robust control for safer, more reliable systems.
problem Combining machine learning with robust control for systems with stringent safety and reliability requirements.
method Integrates Gaussian Process Regression and state-of-the-art robust controller synthesis within a framework that provides rigorous guarantees.
result Demonstrated improved performance with more data while maintaining rigorous guarantees.
Paper uses deep reinforcement learning for better control of rocket engines during start-up phases.
problem Lack of optimal control during transient phases of liquid rocket engines.
method Deep reinforcement learning approach for optimal control of a gas-generator engine's continuous start-up phase.
result Deep reinforcement learning controller achieves highest performance and minimal computational effort.
Neural ODEs control graph dynamics with low energy feedback.
problem Controlling complex dynamical systems on graphs.
method Neural Ordinary Differential Equation Control (NODEC) framework.
result NODEC learns low-energy control signals for graph dynamical systems.
Just as an explicit parameterisation of system dynamics by state, i.e., a choice of coordinates, can impede the identification of general structure, so it is too with an explicit parameterisation of system dynamics by control. However, such explicit and fixed parameterisation by control is commonplace in control theory…
Unified control theory and machine learning for safety in uncertain systems.
problem Safety guarantees for systems with measurement model uncertainty.
method Measurement-Robust Control Barrier Functions (MR-CBFs) for control synthesis.
result MR-CBFs ensure safety in perception systems with measurement model uncertainty.
Paper studies optimal control for a specific geometric problem.
problem Optimal control problem associated with the Paneitz obstacle problem.
method Existence and regularity results for optimal controls.
result Existence of optimal controls and their properties.
Hybrid systems are characterized by having an interaction between continuous dynamics and discrete events. The contribution of this paper is to provide hybrid systems with a novel geometric formulation so that controls can be added. Using this framework we describe some new global controllability tests for hybrid contr…
Optimizes dividend policies in a Brownian model with controlled rates.
problem Realistic optimal dividend policies in a stochastic control problem.
method Delayed linear control strategies for refracted diffusion processes.
result Optimality of delayed linear control strategies for dividend payments.
Paper proposes a new method to optimize robot body structure and control policy.
problem Optimizing robot body structure and control policy in a coupled manner.
method Revisits co-design problem as a Stackelberg game, incorporating control adaptation dynamics.
result Stackelberg PPO outperforms standard PPO in stability and performance.
Non-bilinear observations make optimal control harder, showing non-convex costs and non-affine optimal controllers.
problem Optimal control from bilinear observations in linear systems is challenging.
method Analytical and numerical methods to study the non-convex cost-to-go and non-affine optimal controllers.
result The Separation Principle does not hold for bilinear observations, leading to non-convex costs and non-affine optimal controllers.
Defense strategy improves controller robustness against adversarial attacks.
problem Adversarial attacks on learning-enabled controllers in CPS.
method Two-stage defense strategy treating controller and environment as black-boxes with unknown dynamics.
result Defense strategy effectively improves controller robustness in realistic control domains.
This paper considers control systems defined on Lie algebroids. After deriving basic controllability tests for general control systems, we specialize our discussion to the class of mechanical control systems on Lie algebroids. This class of systems includes mechanical systems subject to holonomic and nonholonomic const…
Survey of theoretical foundations for policy optimization in control.
problem Understanding the theoretical properties of gradient-based methods in control and reinforcement learning.
method Interdisciplinary review of optimization landscape, convergence, and sample complexity for various control problems.
result Recent theoretical results on stability and robustness in learning-based control.
Survey combines FL and control for better adaptability and privacy.
problem Combining FL and control for better adaptability and privacy.
method Combining Federated Learning (FL) and control methods.
result Combining FL and control enhances adaptability, scalability, generalization, and privacy.
New method for handling multi-dimensional singular controls with jump costs in mean-field problems.
problem Handling jump costs in multi-dimensional singular controls.
method Introducing two-layer parametrisations to interpolate jumps on both distributional and pathwise levels.
result Derivation of a DPP and characterisation of the value function as a minimal super-solution to a quasi-variational inequality.
Researchers develop a method to control nonlinear systems with Koopman operator regression.
problem Controlling nonlinear systems with finite action spaces.
method Koopman operator regression for dynamics estimation and model predictive control for control.
result The method yields a linear switching predictive model for control.
Anticipatory model generates music with control over events.
problem Controlling symbolic music generation.
method Interleaving event and control sequences to predict future events.
result Anticipatory model matches autoregressive models in performance and can infill control tasks.
New algorithm achieves logarithmic regret for adversarial online control.
problem Online linear-quadratic control in systems with adversarial disturbances.
method Characterization of optimal offline control law, reduced to online learning with approximate advantage functions.
result First algorithm with logarithmic regret for arbitrary adversarial disturbance sequences.
Meta-learning control algorithm with finite-time guarantees for unknown systems.
problem Online control of unknown linear systems with constraints.
method Provable regret guarantees for an iterative control algorithm.
result Regret bounds of O(T3/4) for controller cost and constraint violation. Designs adaptive controller for networked control systems with wireless data transmission.
problem Adaptive control in networked systems with unreliable wireless channels.
method Upper Confidence Bounds for Networked Control Systems (UCB-NCS) learning rule.
result Non-asymptotic performance guarantees with a regret bound of O(C√T).
New robust control method for uncertain systems using bootstrapped noise.
problem Designing controllers robust to model uncertainties in finite data.
method Least-squares model estimator, bootstrap resampling, multiplicative noise LQR.
result Significantly outperforms certainty equivalent controllers in numerical tests.
Since governments give stimulus to firms and expect the spillover effect by fiscal policies, it is important to know the effectiveness that they can control the economy. To clarify the controllability of the economy, we investigate a firm production network observed exhaustively in Japan and what firms should be direct…