Paper uses deep reinforcement learning for adaptive emergency control of power systems.
problem Traditional emergency control schemes are inadequate for modern power grids due to increasing uncertainties.
method Developed deep reinforcement learning (DRL) for adaptive emergency control of power systems.
result Demonstrated excellent performance and robustness of DRL-based emergency control schemes in various scenarios.
Year by year control of normal and emergency conditions of up-to-date power systems becomes an increasingly complicated problem. With the increasing complexity the existing control system of power system conditions which includes operative actions of the dispatcher and work of special automatic devices proves to be ins…
Research explores how interconnected systems synchronize and how to control their behavior.
problem Understanding and controlling the behavior of interconnected dynamical systems.
method Mean field games approach applied to controlled coupled oscillators.
result Developed methods to predict and influence emergent phenomena in interconnected systems.
An array system of coupled maps is proposed as a model for economy evolution. The local dynamics of each map or agent is controlled by two parameters. One of them represents the growth capacity of the agent and the other one is a control term representing the local environmental pressure which avoids an exponential gro…
Survey of RL methods for optimizing power grid topologies.
problem Optimizing power grid operation with adaptive control strategies.
method Reinforcement Learning (RL) for dynamic and uncertain environments.
result Comprehensive evaluation of RL-based methods for power grid topology optimization.
A deterministic system of coupled maps is proposed as a model for economic activity among interacting agents. The values of the maps represent the wealth of the agents. The dynamics of the system is controlled by two parameters. One parameter expresses the growth capacity of the agents and the other describes the local…
Deep RL optimizes power control for wireless multicast systems.
problem Optimal power control is intractable due to a large state space.
method Deep reinforcement learning with function approximation via neural networks.
result Optimal power control can be learned for large systems.
Deep RL improves power control and scheduling for wireless multicast systems.
problem Scalable power control and scheduling for wireless multicast networks.
method Deep reinforcement learning with function approximation using a deep neural network.
result Deep RL can learn optimal power control policies for large systems.
Paper robustifies reinforcement learning agents against action space perturbations.
problem Vulnerability of reinforcement learning agents to action space perturbations (e.g. actuator attacks).
method Adversarial training to robustify DRL agents against perturbations.
result DRL agents can be robustified against action space perturbations through adversarial training.
Prototype controls stochastic drug resistance in cells.
problem Emergence of drug-resistant cells from random mutations.
method Deep reinforcement learning for adaptive drug dosing.
result 100% success rate in suppressing cell proliferation.
Novel method improves load estimation in power grids using anomaly and change point detection.
problem Improving load estimation in power grid systems.
method Combining unsupervised anomaly and change point detection methods for automatic filtering.
result Automatic load estimation is accurate with 90% estimates within a 10% error margin.
New measure EC assesses node contributions in nonlinear, time-varying systems.
problem Existing node contribution measures assume linear, time-invariant dynamics, failing for complex, real-world systems.
method Defined 'emergent contribution (EC)' as a dynamical leverage measure from Jacobians of differentiable models.
result EC diverges from average controllability under persistent regime switching and sign reversal, identifying limits of local linearization.
Statistical learning improves reactive power control in distribution systems.
problem Challenges in reactive power control due to renewable energy sources and flexible loads.
method A deep neural network parameterizes the input-output relationship between grid states and optimal reactive power control. Unknown weights are learned offline to minimize power loss, and inference is fast with matrix-vector multiplications.
result Computational efficiency and robustness to random input perturbations demonstrated in a 47-bus distribution network.
This paper optimizes a power-to-heat system using reinforcement learning for cost minimization under uncertain conditions.
problem Optimizing a power-to-heat system with fluctuating renewable energy sources.
method Stochastic optimal control, reinforcement learning (Q-learning).
result Reinforcement learning provides an efficient solution to the optimization problem.
A predictor improves power grid frequency forecasts up to one hour.
problem Improving frequency forecast for better power system stability.
method Developed a weighted-nearest-neighbor (WNN) predictor.
result Forecasts for up to one hour are more precise than averaged daily profiles.
As energy markets begin clearing at sub-hourly rates, their interaction with load control systems becomes a potentially important consideration. A simple model for the control of thermal systems using market-based power distribution strategies is proposed, with particular attention to the behavior and dynamics of elect…
Mobile edge computing (MEC) emerges recently as a promising solution to relieve resource-limited mobile devices from computation-intensive tasks, which enables devices to offload workloads to nearby MEC servers and improve the quality of computation experience. Nevertheless, by considering a MEC system consisting of mu…
New adversarial training method improves robustness of power system controllers.
problem Designing robust controllers for complex cyber-physical power systems.
method Adversarial training approach with fixed opponent policy.
result Adversarial trained controllers show useful preventive behaviors in the N-1 problem.
Develops a framework for analyzing multi-agent and many-body systems with feedback loops.
problem Optimal order of multi-agent and general many-body systems
method Derive macroscopic properties and optimal degree of order
result Optimal degree of order balances productivity, stability, and adaptability
This work enables UAVs to autonomously form desired trajectories without needing a central plan.
problem Autonomous formation of complex trajectories in UAVs.
method Decentralized control system using geometric embeddings.
result Quadcopters self-organize into desired trajectories while maintaining separation.
This paper ranks Latin American countries based on AI potential.
problem Identifying emerging AI powers in Latin America.
method Ranking based on infrastructure, education, and finance.
result Argentina, Colombia, Uruguay, Costa Rica, and Ecuador are new emerging powers in AI.
RL applied to TCLs for power consumption control.
problem Optimizing power consumption using TCLs with RL.
method Modelica-based reinforcement learning (Q-learning) for stochastic TCLs.
result Q-learning parameters affect controller performance.
New online learning algorithms improve cyberattack detection in industrial control systems.
problem Detecting cyberattacks in industrial control systems with limited resources.
method Online learning algorithms to process continuous data streams and address class imbalance.
result Improved detection rate of cyberattacks in industrial control systems.
We introduce a stochastic model to explain a double power-law distribution which exhibits two different Paretian behaviors in the upper and the lower tail and widely exists in social and economic systems. The model incorporates fitness consideration and noise fluctuation. We find that if the number of variables (e.g. t…
NeurT-FDR controls FDR by incorporating feature hierarchy.
problem Controlling FDR in complex, large-scale hypothesis testing problems.
method NeurT-FDR uses a neural network to parametrize test-level covariates and a regression framework to adjust feature hierarchy.
result NeurT-FDR makes substantially more discoveries than competitive baselines.
Method detects critical events in complex systems by learning latent causal structure.
problem Detecting onset of epileptic seizures, customer churn, or pandemics from hidden causal interactions.
method A machine learning method that learns an optimal feature representation from powers of the empirical covariance or precision matrix.
result Proves structural consistency and demonstrates competitive results in seizure and churn prediction.
Identifying coordinate transformations that make strongly nonlinear dynamics approximately linear is a central challenge in modern dynamical systems. These transformations have the potential to enable prediction, estimation, and control of nonlinear systems using standard linear theory. The Koopman operator has emerged…
New AI governance framework tackles risks in finance.
problem Risks from evolving AI models in finance.
method Agent-based framework with modular governance architecture.
result Controls quarantine harmful behavior in real time.
This work analyzes how deep neural networks' expressiveness increases with depth and width.
problem Understanding the expressiveness of deep neural networks (DNNs) based on their Lipschitz constants.
method Leveraging random matrix theory, the study characterizes the expressiveness of DNNs by their Lipschitz constant, showing exponential and polynomial increases with depth and width, respectively.
result The expressiveness of DNNs increases exponentially with depth and polynomially with width, consistent with function approximation benefits.
Deep actor-critic learning optimizes power control in mobile networks.
problem Optimizing power control in large-scale wireless mobile networks.
method Multi-agent deep reinforcement learning with deep deterministic policy gradient.
result The algorithm maximizes a global utility function in a distributed manner.
NeurT-FDR controls FDR by incorporating auxiliary covariates in deep learning.
problem Controlling FDR in complex large-scale problems with indirect relations among covariates.
method NeurT-FDR uses a deep Black-Box framework that parametrizes test-level covariates as a neural network and adjusts auxiliary covariates through a regression framework.
result NeurT-FDR makes substantially more discoveries in real datasets compared to competitive baselines.
The dynamics of many socioeconomic systems is determined by the decision making process of agents. The decision process depends on agent's characteristics, such as preferences, risk aversion, behavioral biases, etc.. In addition, in some systems the size of agents can be highly heterogeneous leading to very different i…
Networks of coupled dynamical systems provide a powerful way to model systems with enormously complex dynamics, such as the human brain. Control of synchronization in such networked systems has far reaching applications in many domains, including engineering and medicine. In this paper, we formulate the synchronization…
We introduce a model for the adaptive evolution of a network of company ownerships. In a recent work it has been shown that the empirical global network of corporate control is marked by a central, tightly connected "core" made of a small number of large companies which control a significant part of the global economy.…
We study by theoretical analysis and by direct numerical simulation the dynamics of a wide class of asynchronous stochastic systems composed of many autocatalytic degrees of freedom. We describe the generic emergence of truncated power laws in the size distribution of their individual elements. The exponents α of the…
New control methods for systems with adversarial perturbations.
problem Control systems with adversarial noise.
method Online convex optimization and convex relaxations.
result Low regret policies against adversarial perturbations.
Unified theory of deep learning from approximation to emergence.
problem Understanding the mechanisms behind deep learning.
method Unified, proof-oriented approach tracing from classical foundations to contemporary mechanisms.
result Unified theory explaining deep learning from approximation to emergence.
The implementation of optimal power flow (OPF) methods to perform voltage and power flow regulation in electric networks is generally believed to require extensive communication. We consider distribution systems with multiple controllable Distributed Energy Resources (DERs) and present a data-driven approach to learn c…
Study confirms financial bubbles' common patterns in isolated markets.
problem Testing universal dynamics of financial bubbles in isolated markets.
method Log-Periodic Power Law Singularity (LPPLS) model analysis of two major bubble episodes.
result Tehran Stock Exchange shows clear LPPLS hallmarks, supporting bubble universality.
A deep neural network (DNN) based power control method is proposed, which aims at solving the non-convex optimization problem of maximizing the sum rate of a multi-user interference channel. Towards this end, we first present PCNet, which is a multi-layer fully connected neural network that is specifically designed for…
Machine learning techniques have been used in the past using Monte Carlo samples to construct predictors of the dynamic stability of power systems. In this paper we move beyond the task of prediction and propose a comprehensive approach to use predictors, such as Decision Trees (DT), within a standard optimization fram…
The abstract discusses convergent realizations of Lie subalgebras in control theory.
problem Characterizing Lie subalgebras that can be realized as convergent vector fields.
method Generalizations and reformulations of algebraic properties for output realization.
result Recovery and clarification of previous results on control-affine systems and realization of Chen-Fliess series.
Differentiable simulations control molecular Hamiltonians for desired outcomes.
problem Control and learning of molecular Hamiltonians for desired outcomes.
method Differentiable simulations to differentiate Hamiltonians with respect to target observables.
result Control and learning of molecular Hamiltonians for desired outcomes.
Decision-calibrated prediction sets improve power system operations by reducing unnecessary costs.
problem Balancing operating costs and reliability in power systems with renewable uncertainty.
method Learn conditional prediction sets as sub-level sets of norm-based score functions, calibrate uncertainty sets based on reliability of downstream decisions.
result Decision-calibrated sets lead to more efficient operations with smaller uncertainty sets and lower costs compared to standard coverage-based calibration.
The paper proposes a method to identify causal structure in complex dynamical systems.
problem Spurious correlations in data-driven models limit the performance of control systems.
method The method leverages controllability concepts to compute input trajectories and uses causal inference techniques.
result The method reliably identifies the true causal structure of control systems from real-world data.
Paper introduces reinforcement learning for managing power grids.
problem Balancing power flows and maintaining grid stability in real-time.
method Reinforcement Learning applied to power network operations.
result Demonstrates feasibility of machine learning in power grid management.
Paper develops a distributed power control method for large energy harvesting networks using deep reinforcement learning.
problem Optimal power control for large energy harvesting networks with limited causal information.
method Multi-agent reinforcement learning framework to solve a mean-field game problem.
result Proposed method converges to optimal power control policies in a distributed fashion.
Optimizes power systems with energy storage under uncertainty using scenario-based method.
problem Optimizing power systems with energy storage, intermittent renewable generation, and uncontrollable loads under uncertainty.
method Developed a novel solution method based on scenario optimization and strategic sampling to solve the chance-constrained optimal power system operation problem.
result The strategic sampling method significantly improves computational efficiency and data-driven convex approximation of power flow.