Iroko enables RL for datacenter CC, outperforming TCP on fat-tree and dumbbell topologies.
problem Stability and over-fitting issues in RL for datacenter networks.
method Developed Iroko emulator to support various network conditions and algorithms.
result Deep RL algorithms outperform TCP on fat-tree and dumbbell topologies.
Paper uses DeePC to improve urban traffic lights, reducing congestion and emissions.
problem Urban traffic congestion in expanding cities.
method Behavioral system theory, data-driven control, DeePC algorithm.
result DeePC outperforms existing traffic control methods in travel time and CO2 emissions.
Adaptive traffic control uses deep RL to improve decision-making.
problem Improving traffic control using deep RL.
method Integrates recent deep RL techniques into a novel DQN-based algorithm (TC-DQN+) for traffic control.
result Proposes a new reward function for traffic control.
Develops a new model for controllable and realistic traffic simulation.
problem Lack of models that offer both controllability and realism in traffic simulation.
method Guided Conditional Diffusion (CTG) model using diffusion modeling and differentiable logic.
result Improves controllability-realism tradeoff over strong baselines.
Survey on modern traffic signal control methods.
problem Minimizing travel time at road intersections.
method Machine learning, reinforcement learning.
result Promotes interdisciplinary research on traffic signal control.
Existing inefficient traffic light control causes numerous problems, such as long delay and waste of energy. To improve efficiency, taking real-time traffic information as an input and dynamically adjusting the traffic light duration accordingly is a must. In terms of how to dynamically adjust traffic signals' duration…
A new framework reduces traffic congestion by 36%.
problem Efficient traffic signal control in a metropolitan area.
method Two-stage framework combining Evolution Strategies and multi-agent reinforcement learning.
result Reduces traffic congestion by 36%.
Paper proposes a deep RL approach for traffic signal control balancing efficiency and equity.
problem Inefficient and inflexible traffic signal controllers.
method Deep reinforcement learning with a novel reward function combining efficiency and equity.
result The proposed algorithm achieves state-of-the-art performance on various traffic scenarios.
GeneraLight improves traffic signal control models' generalization ability.
problem Overfitting and lack of generalization ability in RL TSC models.
method GeneraLight uses a meta-RL framework with a traffic flow generator based on GANs.
result GeneraLight significantly boosts generalization performance across different traffic flows.
A new traffic signal control method using phase competition.
problem Improving urban transportation efficiency through advanced learning techniques.
method Intuitive phase competition principle applied to reinforcement learning for traffic signal control.
result Our model achieves better solutions, faster convergence, and superior generalizability compared to existing RL methods.
IG-RL learns adaptive traffic signals for any network, outperforming existing methods.
problem Adaptive traffic signal control for large networks with combinatorial state and action spaces.
method Graph-Convolutional Networks for decentralized, flexible control.
result IG-RL generalizes to new networks and traffic conditions without additional training.
Paper develops a framework to test deep RL traffic controllers under various uncertainties.
problem Developing robust deep RL traffic controllers for dynamic urban areas.
method Open-source callback-based framework for evaluating deep RL configurations in a traffic simulation.
result Deep RL controllers perform well under demand surges, incidents, and sensor failures.
Proposes a graph neural network for traffic forecasting in WANs.
problem Traffic forecasting challenges in WANs due to dynamic and large data volumes.
method Dynamic diffusion convolutional recurrent neural networks for multistep traffic forecasting.
result Significant improvements in forecasting accuracy compared to classical methods.
Urban Traffic Control (UTC) plays an essential role in Intelligent Transportation System (ITS) but remains difficult. Since model-based UTC methods may not accurately describe the complex nature of traffic dynamics in all situations, model-free data-driven UTC methods, especially reinforcement learning (RL) based UTC m…
A2C-based MARL controls large-scale traffic signals more efficiently.
problem Scalability issue in centralized RL for large-scale traffic control.
method Decentralized Multi-Agent A2C with improved observability and reduced learning difficulty.
result Optimal, robust, and sample-efficient control over other algorithms.
Backdoor attacks on DRL-based traffic controllers cause stop-and-go waves or crashes.
problem Vulnerability of DRL-based traffic controllers to machine learning attacks.
method Developed a trigger design methodology based on traffic physics principles.
result Backdoored models can cause stop-and-go traffic waves or AV crashes when triggered.
Deep reinforcement learning system improves air traffic control efficiency and safety.
problem High-density, dynamic, and stochastic air traffic control challenges.
method Deep multi-agent reinforcement learning framework using actor-critic model with PPO loss function.
result Framework resolves 99.97% of all conflicts in extreme high-density scenarios.
MuJAM learns traffic signal control policies that generalize to unseen intersections and traffic conditions.
problem Lack of transferability in reinforcement learning methods for traffic signal control.
method Model-based graph reinforcement learning with explicit coordination and generalization to both cyclic and acyclic constraints.
result MuJAM outperforms existing methods in zero-shot and larger transfer settings.
Novel Bayesian meta-reinforcement learning framework improves traffic signal control robustness.
problem Lack of robustness and stability in adaptation for traffic signal control.
method Value-based Bayesian meta-reinforcement learning framework BM-DQN with fast-adaptation variation and DQN fast-update advantage.
result Framework adapts more quickly and robustly to new scenarios than previous methods.
Bayesian model improves traffic prediction with uncertainty estimates.
problem Lack of uncertainty estimates in deep-learning traffic models.
method Proposes a Bayesian recurrent neural network with spectral normalization.
result Spectral normalization improves uncertainty estimates and generalizability.
Survey of deep RL in intelligent transportation systems.
problem Optimizing traffic signals and autonomous driving using deep RL.
method Comprehensive review of deep RL applications in traffic control and autonomous driving.
result Summarizes existing works in deep RL-based transportation applications.
NCPF model improves traffic data imputation with neural and tensor methods.
problem Pervasive missing data in traffic analysis due to sensor failures and gaps.
method Neural Canonical Polyadic Factorization (NCPF) integrating CP decomposition and deep learning.
result NCPF outperforms state-of-the-art baselines in urban traffic datasets.
New method improves traffic data recovery for streaming data.
problem Improve data quality in traffic data for ITS.
method Online robust tensor recovery algorithm leveraging spatio-temporal correlations and local consistency.
result Significantly improved computational efficiency and high recovery accuracy.
QCOMBO optimizes traffic signals across large networks using a combination of independent and centralized RL.
problem Optimizing global traffic conditions over large road networks using single-agent reinforcement learning is challenging.
method QCOMBO integrates independent and centralized learning to optimize traffic signals, using a consistency regularization loss to ensure scalability.
result QCOMBO outperforms state-of-the-art MARL algorithms in diverse road topologies and traffic flow conditions.
The goal of this project is to introduce and present a machine learning application that aims to improve the quality of life of people in Singapore. In particular, we investigate the use of machine learning solutions to tackle the problem of traffic congestion in Singapore. In layman's terms, we seek to make Singapore …
T-GCN predicts traffic using neural networks for spatial and temporal data.
problem Accurate real-time traffic forecasting in urban networks.
method Combines GCN for spatial and GRU for temporal data analysis.
result T-GCN outperforms state-of-the-art baselines on real-world traffic datasets.
Paper proposes a new model for imputing missing spatiotemporal traffic data.
problem Missing data and sparsity in spatiotemporal traffic data.
method Low-rank tensor completion (LRTC) framework with truncated nuclear norm (TNN).
result The proposed model outperforms state-of-the-art imputation models in various scenarios.
Paper optimizes traffic signal control for better traffic flow.
problem Optimizing traffic signal control to reduce congestion and improve safety.
method Value-based reinforcement learning with interpretable policy functions (polynomial functions).
result Deep Regulatable Hardmax Q-learning variant reduces vehicle delay by up to 19.4%.
DQN optimizes traffic light control policies in ITSs.
problem Challenges in scalable real-time actuation mechanisms for smart traffic management.
method Exploration of Deep Q-Networks (DQN) for traffic light control policies.
result DQN algorithms produce intelligent behavior, such as greenwave patterns.
New approach classifies network traffic with less labeled data.
problem Lack of labeled data for traffic classification.
method Reformulated as multi-task learning for bandwidth and duration prediction alongside traffic classification.
result High accuracy achieved with minimal labeled traffic classification data.
This paper tackles efficient cooperative control for large-scale traffic signals using tensor-based deep learning.
problem Efficient training and control for large-scale multi-intersection traffic signals.
method Tensor representation, multi-task learning, imitation learning, proximal policy optimization.
result The proposed model achieves better performance compared to existing methods.
MER-SDN uses machine learning to optimize energy efficiency in SDN networks.
problem Energy efficiency in SDN networks is challenging and impacts both economics and environment.
method Feature extraction, training, and testing phases of a machine learning framework.
result Achieves up to 25X speedup in predicting optimal parameters for energy efficient routing.
Co-DQL improves traffic signal control using multi-agent reinforcement learning.
problem Optimizing signal timing for large-scale traffic control.
method Cooperative double Q-learning (Co-DQL) with mean field approximation and reward allocation.
result Co-DQL reduces average waiting time for vehicles in the road system.
A new framework uses deep reinforcement learning to improve aircraft separation in busy airspace.
problem Improving aircraft separation in high-density, dynamic airspace constrained by human controllers.
method Proximal Policy Optimization with an attention network for distributed vehicle autonomy.
result The framework significantly reduces offline training time and increases performance.
ECAD detects anomalies without data exchangeability, improving traffic flow detection.
problem Detecting anomalies in spatio-temporal data with missing values.
method ECAD uses conformal prediction to wrap around any regression algorithm, controlling Type-I error without data exchangeability.
result ECAD outperforms other methods in detecting anomalous traffic flow.
A novel spatio-temporal graph neural network with a learnable Tweedie head improves vessel traffic flow prediction in sparse maritime data.
problem Accurate vessel traffic flow prediction in sparse maritime data.
method A model-agnostic learnable Tweedie head attached to ST-GNN backbones.
result The proposed head consistently improves RMSE across multiple ST-GNN backbones, especially on non-zero events.
BiCB combines traffic prediction and bidding optimization for live advertising.
problem Real-time bidding in live advertising with unknown future traffic.
method Binary Constrained Bidding (BiCB) that merges mathematical analysis and statistical traffic estimation.
result BiCB achieves good approximation to optimal bidding results with low complexity.
Paper proposes MA-BERT for efficient data-driven ATM models.
problem Long training time and need for large datasets in data-driven ATM models.
method Multi-Agent Bidirectional Encoder Representations from Transformers (MA-BERT) and transfer learning framework.
result MA-BERT saves training time and achieves high performance with little data.
Timely accurate traffic forecast is crucial for urban traffic control and guidance. Due to the high nonlinearity and complexity of traffic flow, traditional methods cannot satisfy the requirements of mid-and-long term prediction tasks and often neglect spatial and temporal dependencies. In this paper, we propose a nove…
Deep RL mimics human driving for collision avoidance in self-driving cars.
problem Developing human-like driving policies for autonomous vehicles in mixed traffic environments.
method Model-free, deep reinforcement learning approach using a combination of rule-based and expert-driven data.
result Demonstrated human-like driving policies through Gaussian process modeling of track position and speed distributions.
Paper tackles ML for non-scheduled URLLC traffic in 5G networks.
problem Coexistence of scheduled and non-scheduled URLLC traffic with stringent reliability and latency requirements.
method Distributed risk-aware ML solution for resource management (RRM).
result 75% increase in data rate for scheduled traffic with 99.99% reliability for both types.
This paper tackles traffic volume estimation challenges with a deep learning method.
problem Underdetermined and non-equilibrium traffic flows.
method Graph-based deep learning method with adaptive attention mechanisms.
result The proposed model achieves high accuracy even with low sensor coverage.
This paper improves MARL for networked systems through new protocols and discount factors.
problem Improving control in networked systems using multi-agent reinforcement learning.
method Formulated as a spatiotemporal Markov decision process, introduced a spatial discount factor, and proposed NeurComm.
result Appropriate spatial discount factor enhances learning curves of non-communicative MARL algorithms.
Proposes a framework to handle missing data in traffic forecasting with sensor blackouts.
problem Missing data in traffic forecasting due to sensor blackouts, especially when correlated with traffic conditions.
method Latent state-space framework that models traffic dynamics and sensor dropout probabilities.
result Improves traffic forecasting by reducing blackout imputation RMSE from 7.02 to 4.23, with MNAR modeling providing additional gains.
Advanced travel information and warning, if provided accurately, can help road users avoid traffic congestion through dynamic route planning and behavior change. It also enables traffic control centres mitigate the impact of congestion by activating Intelligent Transport System (ITS) proactively. Deep learning has beco…
TM-CNN predicts lane-level traffic speeds considering volume impact.
problem Aggregated lane-level traffic speed prediction and volume impact.
method Two-stream multi-channel CNN, data conversion, two-stream deep neural network, loss function.
result TM-CNN outperforms existing models in multi-lane traffic speed prediction.
We consider the traffic data reconstruction problem. Suppose we have the traffic data of an entire city that are incomplete because some road data are unobserved. The problem is to reconstruct the unobserved parts of the data. In this paper, we propose a new method to reconstruct incomplete traffic data collected from …
Deep neural network reconstructs traffic speeds from sparse vehicle data.
problem Reconstructing traffic speeds from limited probe vehicle data.
method Convolutional neural network architecture for spatio-temporal learning.
result The method can reconstruct traffic speeds with low probe vehicle penetration.