Deep RL optimizes power control for wireless multicast systems.
problem Optimal power control is intractable due to a large state space.
method Deep reinforcement learning with function approximation via neural networks.
result Optimal power control can be learned for large systems.
Paper develops an AI system to improve power system control.
problem Insufficient effectiveness of existing power system control.
method Combines deep learning and game theory for power system control.
result Improves power system control to normal steady-state or post-emergency conditions.
Paper uses deep reinforcement learning for adaptive emergency control of power systems.
problem Traditional emergency control schemes are inadequate for modern power grids due to increasing uncertainties.
method Developed deep reinforcement learning (DRL) for adaptive emergency control of power systems.
result Demonstrated excellent performance and robustness of DRL-based emergency control schemes in various scenarios.
Deep RL improves power control and scheduling for wireless multicast systems.
problem Scalable power control and scheduling for wireless multicast networks.
method Deep reinforcement learning with function approximation using a deep neural network.
result Deep RL can learn optimal power control policies for large systems.
Statistical learning improves reactive power control in distribution systems.
problem Challenges in reactive power control due to renewable energy sources and flexible loads.
method A deep neural network parameterizes the input-output relationship between grid states and optimal reactive power control. Unknown weights are learned offline to minimize power loss, and inference is fast with matrix-vector multiplications.
result Computational efficiency and robustness to random input perturbations demonstrated in a 47-bus distribution network.
This paper optimizes a power-to-heat system using reinforcement learning for cost minimization under uncertain conditions.
problem Optimizing a power-to-heat system with fluctuating renewable energy sources.
method Stochastic optimal control, reinforcement learning (Q-learning).
result Reinforcement learning provides an efficient solution to the optimization problem.
A predictor improves power grid frequency forecasts up to one hour.
problem Improving frequency forecast for better power system stability.
method Developed a weighted-nearest-neighbor (WNN) predictor.
result Forecasts for up to one hour are more precise than averaged daily profiles.
As energy markets begin clearing at sub-hourly rates, their interaction with load control systems becomes a potentially important consideration. A simple model for the control of thermal systems using market-based power distribution strategies is proposed, with particular attention to the behavior and dynamics of elect…
New adversarial training method improves robustness of power system controllers.
problem Designing robust controllers for complex cyber-physical power systems.
method Adversarial training approach with fixed opponent policy.
result Adversarial trained controllers show useful preventive behaviors in the N-1 problem.
RL applied to TCLs for power consumption control.
problem Optimizing power consumption using TCLs with RL.
method Modelica-based reinforcement learning (Q-learning) for stochastic TCLs.
result Q-learning parameters affect controller performance.
Paper proposes a new method to secure power system operation using machine learning.
problem Ensuring secure power system operation under high uncertainty.
method Embedding disjunctive rules from Decision Trees in an optimization framework using GDP and a two-step search method.
result The method achieves efficient system control at a marginal increase in system price compared to an oracle model.
Study optimizes building energy control and power planning using RL.
problem Optimizing academic buildings' HVAC and power systems.
method Reinforcement Learning (RL) for scheduling and planning.
result Algorithm optimizes hourly energy usage and handles short-term changes.
New online learning algorithms improve cyberattack detection in industrial control systems.
problem Detecting cyberattacks in industrial control systems with limited resources.
method Online learning algorithms to process continuous data streams and address class imbalance.
result Improved detection rate of cyberattacks in industrial control systems.
New approach uses machine learning to control DERs without centralized communication.
problem Optimal power flow requires extensive communication; new method uses local data.
method Data-driven approach to learn control policies for DERs to mimic centralized OPF solutions.
result Decentralized controllers closely match centralized OPF solution, providing near optimal performance.
Deep actor-critic learning optimizes power control in mobile networks.
problem Optimizing power control in large-scale wireless mobile networks.
method Multi-agent deep reinforcement learning with deep deterministic policy gradient.
result The algorithm maximizes a global utility function in a distributed manner.
A neural network method optimizes power control in multi-user channels.
problem Maximizing sum rate in multi-user interference channels.
method PCNet, a multi-layer neural network, directly maximizes sum rate; ePCNet is an ensemble of multiple PCNets.
result ePCNet outperforms existing power control methods by 1.2%-4.6%.
Networks of coupled dynamical systems provide a powerful way to model systems with enormously complex dynamics, such as the human brain. Control of synchronization in such networked systems has far reaching applications in many domains, including engineering and medicine. In this paper, we formulate the synchronization…
Research explores how interconnected systems synchronize and how to control their behavior.
problem Understanding and controlling the behavior of interconnected dynamical systems.
method Mean field games approach applied to controlled coupled oscillators.
result Developed methods to predict and influence emergent phenomena in interconnected systems.
New method segments power grids in real time for easier control.
problem Segmenting large-scale power grids for real-time control.
method Guided machine learning approach with Influence Graph and community detection.
result Promising and original interpretable results on various grids.
The abstract discusses convergent realizations of Lie subalgebras in control theory.
problem Characterizing Lie subalgebras that can be realized as convergent vector fields.
method Generalizations and reformulations of algebraic properties for output realization.
result Recovery and clarification of previous results on control-affine systems and realization of Chen-Fliess series.
Decision-calibrated prediction sets improve power system operations by reducing unnecessary costs.
problem Balancing operating costs and reliability in power systems with renewable uncertainty.
method Learn conditional prediction sets as sub-level sets of norm-based score functions, calibrate uncertainty sets based on reliability of downstream decisions.
result Decision-calibrated sets lead to more efficient operations with smaller uncertainty sets and lower costs compared to standard coverage-based calibration.
The paper proposes a method to identify causal structure in complex dynamical systems.
problem Spurious correlations in data-driven models limit the performance of control systems.
method The method leverages controllability concepts to compute input trajectories and uses causal inference techniques.
result The method reliably identifies the true causal structure of control systems from real-world data.
Paper introduces reinforcement learning for managing power grids.
problem Balancing power flows and maintaining grid stability in real-time.
method Reinforcement Learning applied to power network operations.
result Demonstrates feasibility of machine learning in power grid management.
Paper develops a distributed power control method for large energy harvesting networks using deep reinforcement learning.
problem Optimal power control for large energy harvesting networks with limited causal information.
method Multi-agent reinforcement learning framework to solve a mean-field game problem.
result Proposed method converges to optimal power control policies in a distributed fashion.
New LQR kernels improve controller learning from data.
problem Optimal controller design for nonlinear systems from data is challenging.
method Developed LQR kernels for Bayesian optimization.
result LQR kernels lead to superior learning performance on uncertain systems.
The paper proposes a data-driven method for optimal power flow and voltage regulation in distribution grids.
problem Optimal power flow and voltage regulation in decentralized power grids.
method The approach uses a network model, historic data, and regression to find functions approximating optimal reactive power injections for inverters.
result The method achieves near-optimal results in voltage- and capacity-constrained loss minimization and voltage flattening.
Survey of RL methods for optimizing power grid topologies.
problem Optimizing power grid operation with adaptive control strategies.
method Reinforcement Learning (RL) for dynamic and uncertain environments.
result Comprehensive evaluation of RL-based methods for power grid topology optimization.
This paper uses Gaussian Process and converse Lyapunov function to estimate power system ROA.
problem Estimating the region of attraction (ROA) for power systems with conservative and limited analytical methods.
method Combining converse Lyapunov theorem and Gaussian Process to estimate ROA without needing an analytic Lyapunov function.
result The approach can significantly enlarge the estimated ROA compared to analytical methods.
Survey of deep RL in intelligent transportation systems.
problem Optimizing traffic signals and autonomous driving using deep RL.
method Comprehensive review of deep RL applications in traffic control and autonomous driving.
result Summarizes existing works in deep RL-based transportation applications.
Paper analyzes CCT sensitivity in constrained power systems, offering insights into system stability and parameter changes.
problem Identifying preventive control measures to avoid large generation losses during disturbances.
method Derived first-order CCT sensitivity for generic constrained power systems using trajectory sensitivity computation.
result Sensitivity of CCT to system parameters, providing insights into feasibility and stability.
Deep residual networks can approximate any continuous function using control theory.
problem Universal approximation capabilities of deep residual neural networks.
method Relating residual networks to control systems and using Lie algebraic techniques.
result Deep residual networks with adequately deep layers can approximate any continuous function on a compact set.
Breaks down complex nonlinear dynamics into simpler components.
problem Control of nonlinear dynamical systems remains challenging.
method Inspired by hybrid switching systems, decomposes dynamics into simpler stochastic switching linear dynamical systems.
result Extracts hierarchies of Markovian and auto-regressive locally linear controllers from nonlinear experts.
Distributed, controllable energy storage devices offer several benefits to electric power system operation. Three such benefits include reducing peak load, providing standby power, and enhancing power quality. These benefits, however, are only realized during peak load or during an outage, events that are infrequent. T…
Exact results on power-law distributions in systems with resets.
problem Understanding power-law distributions in systems with resets.
method Exact mathematical analysis of multiplicative processes with resets.
result Power-law distributions are built up over time and their moments behave quantitatively determined by parameters.
The paper proposes a method to identify power system oscillation modes using blind source separation.
problem Accurately identifying oscillation modes in power systems with renewable energy sources.
method A high-order blind source identification (HOBI) algorithm based on copula statistic combined with Hilbert transform and iteration procedure.
result The method can identify all oscillation modes and model order from a single channel of observation signals, outperforming state-of-the-art methods.
Study compares different levels of supervision for training graph embeddings in wireless networks.
problem Improving power control in wireless interference networks.
method Training graph neural networks (GNNs) with different levels of supervision (supervised, unsupervised, self-supervised).
result Different levels of supervision impact system-level throughput, convergence, and generalization.
Paper robustifies reinforcement learning agents against action space perturbations.
problem Vulnerability of reinforcement learning agents to action space perturbations (e.g. actuator attacks).
method Adversarial training to robustify DRL agents against perturbations.
result DRL agents can be robustified against action space perturbations through adversarial training.
In this contribution we present an intrinsic description of time-variant Port Hamiltonian systems as they appear in modeling and control theory. This formulation is based on the splitting of the state bundle and the use of appropriate covariant derivatives, which guarantees that the structure of the equations is invari…
Paper optimizes energy-based controller for swinging up a pendulum using entropy search.
problem Finding optimal parameters for energy-based controllers is hard.
method Bayesian optimization (Entropy Search) applied to energy-based controller design.
result Optimal controller improves performance of a swinging pendulum.
An array system of coupled maps is proposed as a model for economy evolution. The local dynamics of each map or agent is controlled by two parameters. One of them represents the growth capacity of the agent and the other one is a control term representing the local environmental pressure which avoids an exponential gro…
AI model enhances grid monitoring with synchro-waveform tech.
problem Dynamic, stochastic, low-inertia future grids need advanced monitoring.
method AI Foundation Model with synchro-waveform tech.
result Significantly improved fault detection accuracy and speed.
This paper analyzes a simplified strategy for nonlinear control using local linear models and iLQR updates.
problem Nonlinear policy optimization in control systems.
method Iterative estimation of local linear models and iLQR-like policy updates.
result Demonstrates polynomial sample complexity and overcomes exponential problem horizon dependence.
We propose a framework for modeling and estimating the state of controlled dynamical systems, where an agent can affect the system through actions and receives partial observations. Based on this framework, we propose the Predictive State Representation with Random Fourier Features (RFFPSR). A key property in RFF-PSRs …
A new bandit strategy improves learning speed at the cost of accuracy.
problem Learning speed vs. accuracy trade-off in multi-armed bandits.
method Weighted Thompson Sampling (WTS) for multi-armed bandits with Gaussian feedback.
result Upper bound matches log(T) lower bound, solving fundamental problem.
The grid integration of intermittent Renewable Energy Sources (RES) causes costs for grid operators due to forecast uncertainty and the resulting production schedule mismatches. These so-called profile service costs are marginal cost components and can be understood as an insurance fee against RES production schedule u…
Proposes a deep learning method for uncertainty propagation in complex systems.
problem Uncertainty propagation in nonlinear dynamic systems with many uncertain variables.
method Data-driven approach using deep learning to approximate PDFs of uncertain systems.
result Demonstrates robustness evaluation of a feedback controller for a six-dimensional system.
Paper develops a fast method to find near-optimal power solutions.
problem Solving AC OPF on fast timescales for large networks.
method Leverages machine learning to map system loading to optimal generation values.
result Near-optimal and feasible solutions found on milliseconds timescales.
Deep reinforcement learning optimizes power allocation in wireless networks.
problem Challenges in optimizing power allocation in large wireless networks.
method Distributively executed dynamic power allocation scheme using deep Q-learning.
result Achieves near-optimal power allocation in real-time with delayed CSI.