In this paper, we first study the Poisson reductions of controlled Hamiltonian (CH) system and symmetric CH system by controllability distributions. These reductions are the extension of Poisson reductions by distribution for Poisson manifolds to that for phase spaces of CH systems with external force and control. We g…
Efficiently designs distributed controllers for sparse systems with sub-linear sample complexity.
problem Designing robust distributed controllers for unknown-but-sparse linear systems.
method Combining distributed controller synthesis and structured linear inverse problems for system identification.
result Near-optimal distributed controllers can be learned with sub-linear sample complexity and near-linear time complexity.
A method to minimize regret in multi-agent control systems with adversarial disturbances.
problem Optimal control of dynamical systems with adversarial disturbances and multiple agents.
method Reduction from online convex optimization to a distributed algorithm for multi-agent control.
result The resulting distributed algorithm has low regret relative to the optimal precomputed joint policy.
New approach to control diffusion processes with soft constraints.
problem Finding an optimal diffusion process with a target terminal distribution.
method Generalized Schrödinger bridge problem with soft constraints, solving for a geometric mixture of target and other distributions.
result The terminal distribution of the optimally controlled process is a geometric mixture of the target and another distribution.
Paper tackles overestimation bias in continuous control, improving performance by 25%.
problem Overestimation bias in off-policy learning.
method Truncated Quantile Critics (TQC) combines distributional representation, truncation, and ensembling of critics.
result TQC outperforms state-of-the-art methods by 25% on the Humanoid environment.
Proves Sard conjecture for specific distributions, controlling divergence of vector fields.
problem Proving the Sard conjecture for certain types of distributions.
method Constructs a singular distribution capturing essential abnormal lifts, proving the conjecture for rank 3 distributions in dimension 4 and generic corank 1 distributions.
result Proves the Sard conjecture for generic co-rank one distributions.
We simplify motion control of a snake robot using nilpotent approximation.
problem Controlling motion of a trident snake robot.
method Constructing a privileged coordinate system and a nilpotent approximation.
result Motions corresponding to Lie brackets are well approximated by the nilpotent approximation.
A new method for estimating causal effects using synthetic controls.
problem Evaluating causal effects of policy changes in settings with observational data.
method Distributional Synthetic Controls method.
result Allows construction of entire synthetic distributions for the treated unit.
Statistical learning improves reactive power control in distribution systems.
problem Challenges in reactive power control due to renewable energy sources and flexible loads.
method A deep neural network parameterizes the input-output relationship between grid states and optimal reactive power control. Unknown weights are learned offline to minimize power loss, and inference is fast with matrix-vector multiplications.
result Computational efficiency and robustness to random input perturbations demonstrated in a 47-bus distribution network.
The paper tackles voltage control in distribution systems with uncertainties using chance constraints.
problem Voltage control in distribution systems with high uncertainties from distributed energy resources.
method Chance constraint approach accounting for arbitrary correlations, solved via stochastic quasi gradient method.
result The method is more robust and computationally tractable compared to conventional approaches.
D4PG combines distributional reinforcement learning with distributed learning for control tasks.
problem Continuous control tasks in reinforcement learning.
method Adapting distributional reinforcement learning to continuous control, using a distributed framework, N-step returns, and prioritized experience replay.
result D4PG achieves state-of-the-art performance across various control tasks.
New approach uses machine learning to control DERs without centralized communication.
problem Optimal power flow requires extensive communication; new method uses local data.
method Data-driven approach to learn control policies for DERs to mimic centralized OPF solutions.
result Decentralized controllers closely match centralized OPF solution, providing near optimal performance.
Paper develops a distributed power control method for large energy harvesting networks using deep reinforcement learning.
problem Optimal power control for large energy harvesting networks with limited causal information.
method Multi-agent reinforcement learning framework to solve a mean-field game problem.
result Proposed method converges to optimal power control policies in a distributed fashion.
New TTP framework fuses control arms while controlling Type-I error.
problem Bias in borrowing control data from previous trials.
method Kernel two-sample testing via MMD and equivalence testing.
result Higher power than standard TTP methods while maintaining error control.
This work improves variational inference by reducing gradient variance.
problem Hard optimization of flexible variational distributions.
method Control variate based on quadratic approximation of the model's mean and covariance.
result Significant improvement in gradient variance and optimization convergence.
Nonparametric adaptive robust control tackles model uncertainty in stochastic processes.
problem Model uncertainty in stochastic processes.
method Adaptive robust control methodology using online learning and uncertainty reduction, empirical distribution, and Lagrangian duality.
result Nonparametric adaptive robust control approach is preferable to traditional robust frameworks.
Optimal control in latent factor models uses Tsallis entropy for exploration.
problem Optimal control in models with latent factors.
method Reward exploration with Tsallis entropy and derive q-Gaussian distribution over states. result Optimal policy derived in a model-agnostic setting.
A new method for continuous control avoids local movement issues.
problem Limitations of policy gradient methods in continuous control.
method Distributional framework and Generative Actor Critic (GAC) method.
result GAC outperforms policy gradient methods in continuous domains.
Motivated by control-affine systems in optimal control theory, we introduce the notion of a point-affine distribution on a manifold X - i.e., an affine distribution F together with a distinguished vector field contained in F. We compute local invariants for point-affine distributions of constant type when dim(X)=n, ran…
Paper proposes a method to monitor industrial processes under closed-loop control.
problem Difficulty distinguishing between real process faults and normal operating conditions changes.
method Develops a distributed monitoring system by capturing static and dynamic characteristics of large-scale closed-loop industrial processes.
result The method effectively distinguishes between real process faults and normal operating conditions changes.
DVK model infers uncertainty-aware dynamical models for better control.
problem Uncertainty in nonlinear dynamical systems makes prediction and control challenging.
method Deep Variational Koopman (DVK) model infers distributions over observations.
result DVK model provides a distribution over dynamical models for long-term prediction and control.
Survey combines FL and control for better adaptability and privacy.
problem Combining FL and control for better adaptability and privacy.
method Combining Federated Learning (FL) and control methods.
result Combining FL and control enhances adaptability, scalability, generalization, and privacy.
Develops a new reinforcement learning framework for complex control problems.
problem Continuous-time extended mean field control with deterministic policies.
method Model-free sensitivity formula, deterministic policy gradient, local value and advantage-rate representations.
result Demonstrates efficiency, stability, and robustness in solving complex control problems.
Unified framework suppresses model bias in semi-supervised learning with decoupled sampling control.
problem Class imbalance in semi-supervised learning, especially with distributional mismatches.
method Unified framework SC-SSL with decoupled sampling control, explicit expansion capability, and adaptive sampling probabilities.
result Consistent and state-of-the-art performance across various benchmark datasets and distribution settings.
Paper formulates mutual information optimal control for discrete-time systems.
problem Optimal control of discrete-time linear systems with mutual information.
method Formulates MIOCP as an extension of MEOCP, derives optimal policy and prior, proposes alternating minimization algorithm.
result Proposes an alternating minimization algorithm for MIOCP.
Extends conformal prediction for controlling expected risk of monotone loss functions.
problem Controlling expected risk of monotone loss functions.
method Generalizes split conformal prediction with coverage guarantee, extending to distribution shift, quantile risk, multiple, adversarial, and expectations of U-statistics.
result Tight up to an O(1/n) factor, with worked examples in computer vision and natural language processing. Simpler one-step distributional RL framework for control.
problem Lack of a unified theory for DistrRL in control.
method One-step distributional reinforcement learning (OS-DistrRL) framework.
result Unified theory for policy evaluation and control.
A new framework for generative modeling using controlled vector fields.
problem Expressive modeling with limited parameters.
method Continuous-time modeling with modulated fixed vector fields and learned scalar controls.
result Expressive transport achieved with a small number of learned control channels.
A new method improves stability in policy learning for continuous control tasks.
problem Stability issues in policy gradient methods when policies are close to deterministic.
method Target Distribution Learning (TDL) alternates between proposing a target distribution and training the policy network to approach it.
result TDL leads to more stable policy improvements over iterations compared to existing methods.
Unified framework for FDR control in knockoffs, validating Gaussian knockoffs.
problem Asymptotic FDR control in knockoffs with user-specified distributions.
method Unified theoretical framework, three conditions on approximate knockoff statistics, Gaussian knockoffs generator based on moments matching.
result Gaussian knockoffs generator achieves asymptotic FDR control.
The paper accelerates gradient flows on probability distributions using optimal control theory.
problem Optimizing probability distributions efficiently.
method Variational formulation and Hamilton's equations for accelerated gradient flows.
result The method achieves accelerated density transport from any initial distribution to a target distribution.
We solve continuous-time reinforcement learning using distributional Hamilton-Jacobi-Bellman equations.
problem Predicting the distribution of returns in continuous-time, stochastic environments.
method We derive a distributional Hamilton-Jacobi-Bellman equation for Itô diffusions and Feller-Dynkin processes, and propose an algorithm based on a JKO scheme.
result We propose an online control algorithm that can be used to approximately solve the distributional HJB equation.
New methodology controls synthetic data bias for neural program synthesis.
problem Deep networks generalize poorly to certain data distributions when trained on synthetic examples.
method Proposes a new methodology to control and evaluate the bias of synthetic data distributions over programs and specifications.
result Training deep networks on controlled synthetic data distributions leads to improved cross-distribution generalization performance.
The paper presents the geometry of Lie algebroids and its applications to optimal control. The first part deals with the theory of Lie algebroids, connections on Lie algebroids and dynamical systems defined on Lie algebroids (mainly Lagrangian and Hamiltonian systems). In the second part we use the framework of Lie alg…
Optimal policy for multi-hypothesis testing with controlled sensing to minimize delay and error.
problem Minimizing delay in multi-hypothesis testing with controlled sensing.
method Designing a policy to control the delay while ensuring error probability constraint.
result Policy achieves information-theoretic lower bound on expected delay asymptotically.
Optimal control strategies modify wealth inequality variance.
problem Minimizing wealth inequality variance in a market economy.
method Kinetic models and model predictive control for wealth dynamics.
result Control modifies Pareto index of wealth distribution.
New SLC distributions enable easier control over diversity.
problem Lack of easy control over diversity in existing models.
method Developed strongly log-concave distributions and two tools for sampling and mode finding.
result Established weak log-submodularity for SLC functions and optimization guarantees for mode finding.
A novel framework synthesizes treatment data across sites using optimal transport.
problem Estimating treatment effects across different sites with varying conditions.
method Distributional causal inference, Optimal Transport for alignment of control group distributions.
result Synthetic treatment group data aligns with true target distribution under general conditions.
Bayesian PROCOVA uses AI to adjust for covariates in RCTs.
problem Unbiased and precise treatment effect inferences from RCTs.
method Generative AI constructs digital twins for covariate adjustment, using an additive mixture prior.
result Efficiency gains in smaller RCTs compared to frequentist methods.
Paper designs energy-based controllers and observers for complex systems.
problem Controlling and observing infinite-dimensional systems with in-domain actuation.
method Uses Stokes-Dirac structures and jet-bundle structures to derive controllers and observers.
result Control schemes derived in both frameworks are equivalent.
TabCF simplifies causal inference for distributional effects.
problem Estimating causal effects with unmeasured confounding.
method Control function regression using tabular foundation models.
result Accurate, fast, and transparent causal estimation of distributional quantities.
Boosted Control Functions improve prediction under distributional shifts.
problem Prediction under distributional shifts in the presence of hidden confounding.
method Boosted Control Function (BCF) and ControlTwicing algorithm.
result BCF allows for distribution generalization and invariance under nonlinear, non-identifiable structural functions.
Finite resources limit false discovery rate control in structured hypothesis spaces.
problem Controlling false discovery rate in hypothesis testing with finite data and structured hypothesis spaces.
method Framework for exact FDR control and adaptive power maximization.
result Exact FDR control and adaptive power maximization.
We study Bayesian optimal control of a general class of smoothly parameterized Markov decision problems. Since computing the optimal control is computationally expensive, we design an algorithm that trades off performance for computational efficiency. The algorithm is a lazy posterior sampling method that maintains a d…
New framework controls statistical dispersion for high-stakes applications.
problem Understanding and controlling the dispersion of loss distributions in high-stakes applications.
method Simple yet flexible framework for distribution-free control of statistical dispersion measures.
result Proposed methods control statistical dispersion measures with societal implications.
We solve a complex Bayesian control problem with novel methods.
problem Optimizing control of a hidden signal's influence on noisy observations.
method Measure-valued HJB perspective, viscosity theory, approximation arguments.
result Equivalence to HJB equation and continuous viscosity solution.
Develops a new approach to optimal control of stochastic systems.
problem Optimal control of stochastic nonlinear dynamical systems is challenging.
method Formulates optimal control as input estimation, using probabilistic inference and Expectation Maximization.
result Extracts time-varying linear Gaussian feedback controllers from the joint state-action distribution.
Dynamic programming for optimal stopping under distribution constraints.
problem Optimal stopping with distributional constraints.
method Reformulating as measure-valued martingales and stochastic control problem.
result Established dynamic programming principle.