In this paper, we propose a deep reinforcement learning (DRL) based mobility load balancing (MLB) algorithm along with a two-layer architecture to solve the large-scale load balancing problem for ultra-dense networks (UDNs). Our contribution is three-fold. First, this work proposes a two-layer architecture to solve the…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “load balancing”
Model for open, decentralized network with task load balancing.
problem Complex computational tasks in open, decentralized networks.
method Incentive-based load balancing using economic mechanisms.
result Optimized resource allocation and enhanced system resilience.
Proposes -balancing for more balanced expert utilization in MoE models.
problem Balanced expert utilization in MoE models to avoid bias.
method Directly targets population-level balance by minimizing a convex potential function.
result Consistently outperforms prior methods in stability and effectiveness.
New principle reduces load imbalance in LLM serving systems, saving up to 52% energy.
problem Wasted computational power due to load imbalance in LLM serving systems.
method Developed a universal load-balancing principle for barrier-synchronized systems with non-migratable state.
result Proves worst-case theoretical guarantees for imbalance reduction and energy savings.
An increase in energy production from renewable energy sources is viewed as a crucial achievement in most industrialized countries. The higher variability of power production via renewables leads to a rise in ancillary service costs over the power system, in particular costs within the electricity balancing markets, ma…
Distributed machine learning training is one of the most common and important workloads running on data centers today, but it is rarely executed alone. Instead, to reduce costs, computing resources are consolidated and shared by different applications. In this scenario, elasticity and proper load balancing are vital to…
Lifelong learning is a very important step toward realizing robust autonomous artificial agents. Neural networks are the main engine of deep learning, which is the current state-of-the-art technique in formulating adaptive artificial intelligent systems. However, neural networks suffer from catastrophic forgetting when…
In this paper, we propose and study opportunistic bandits - a new variant of bandits where the regret of pulling a suboptimal arm varies under different environmental conditions, such as network load or produce price. When the load/price is low, so is the cost/regret of pulling a suboptimal arm (e.g., trying a suboptim…
Deep learning improves weather modeling for electricity load forecasting.
problem Accurate load and renewable energy forecasting requires complex spatio-temporal weather modeling.
method Automated spatio-temporal feature extraction using deep neural networks.
result Deep learning outperforms traditional methods in French national load forecasting.
Paper assesses the market value of sharing privacy-protected smart meter data.
problem Value of sharing privacy-protected smart meter data between consumers and load serving entities.
method Discounted differential privacy model, ANN-based load forecasting, optimal procurement problem.
result Significant value in sharing smart meter data while retaining individual consumer privacy.
Paper proposes a network framework for prosumers to manage peak loads in Iran.
problem Balancing renewable prosumers' self-sufficiency with grid integration under uncertainty.
method Distributed contextual stochastic optimization (DCSO) framework with consensus-based sharing.
result Integration of prediction and optimization reduces peak loads and costs.
New algorithm controls large groups of devices to match energy demand signals.
problem Controlling large populations of electrical devices to match energy demand signals.
method Developed MD-MFC algorithm for finite horizon Markovian mean field control problem.
result MD-MFC provides theoretical guarantees for convex and Lipschitz objective functions.
Paper optimizes internal balancing of wind and hydropower to reduce intraday market volatility.
problem Reduction of intraday market volatility for power producers with wind and hydropower assets.
method Internal balancing within the same river system and sales/purchase in a pay-as-bid intraday market.
result Reduction in short-term marginal cost and risk through internal balancing.
Traditional load analysis is facing challenges with the new electricity usage patterns due to demand response as well as increasing deployment of distributed generations, including photovoltaics (PV), electric vehicles (EV), and energy storage systems (ESS). At the transmission system, despite of irregular load behavio…
This work investigates the use of deep learning to perform user cell association for sum-rate maximization in Massive MIMO networks. It is shown how a deep neural network can be trained to approach the optimal association rule with a much more limited computational complexity, thus enabling to update the association ru…
Enhances load forecasting for multiple entities with dynamic similarities.
problem Inaccurate probabilistic load predictions due to uncertainties and dynamic changes.
method Online multi-task learning for probabilistic load forecasting.
result Significantly enhances load forecasting accuracy across various scenarios.
Data loading can dominate deep neural network training time on large-scale systems. We present a comprehensive study on accelerating data loading performance in large-scale distributed training. We first identify performance and scalability issues in current data loading implementations. We then propose optimizations t…
A new hybrid-ordered SGD method reduces communication and complexity for non-convex optimization.
problem Balancing communication, computational complexity, and convergence rate in distributed non-convex optimization.
method Hybrid-ordered distributed SGD with pre-shared scalers and periodic vector communication.
result Order-wise faster convergence compared to existing methods.
Recent advances in both machine learning and Internet-of-Things have attracted attention to automatic Activity Recognition, where users wear a device with sensors and their outputs are mapped to a predefined set of activities. However, few studies have considered the balance between wearable power consumption and activ…
HIV RNA viral load (VL) is an important outcome variable in studies of HIV infected persons. There exists only a handful of methods which classify patients by viral load patterns. Most methods place limits on the use of viral load measurements, are often specific to a particular study design, and do not account for com…
In (exploratory) factor analysis, the loading matrix is identified only up to orthogonal rotation. For identifiability, one thus often takes the loading matrix to be lower triangular with positive diagonal entries. In Bayesian inference, a standard practice is then to specify a prior under which the loadings are indepe…
Forecasting Short-term load using Econometrics time series model with T-student Distributionq-fin.ST
Paper uses econometrics time series model with T-student Distribution for short-term load forecasting.
problem Accurate short-term load forecasting for optimizing electrical sources and protecting energy.
method Uses SARIMA-GARCH model with T-student Distribution to forecast electric load.
result The proposed model outperforms the ARIMA model with Normal Distribution.
Short-term load forecasting (STLF) is essential for the reliable and economic operation of power systems. Though many STLF methods were proposed over the past decades, most of them focused on loads at high aggregation levels only. Thus, low-aggregation load forecast still requires further research and development. Comp…
Paper uses RL to optimize ICU load during COVID-19.
problem Optimizing ICU load during a pandemic.
method Combines epidemic model, Bayesian inference, and RL for adaptive intervention levels.
result RL policies reduce ICU burden compared to historical interventions.
Viral Load Inference in Non-Adaptive Pooled Testingcond-mat.stat-mech
New method infers viral load from pooled tests.
problem Inefficient viral load inference in pooled testing.
method Message passing algorithm with PCR noise function.
result Accurate viral load inference possible.
We use online convex optimization (OCO) for setpoint tracking with uncertain, flexible loads. We consider full feedback from the loads, bandit feedback, and two intermediate types of feedback: partial bandit where a subset of the loads are individually observed and the rest are observed in aggregate, and Bernoulli feed…
With the increasing complexity of modern power systems, conventional dynamic load modeling with ZIP and induction motors (ZIP + IM) is no longer adequate to address the current load characteristic transitions. In recent years, the WECC composite load model (WECC CLM) has shown to effectively capture the dynamic load re…
Accurate short-term load forecasting is essential for the efficient operation of the power sector. Forecasting load at a fine granularity such as hourly loads of individual households is challenging due to higher volatility and inherent stochasticity. At the aggregate levels, such as monthly load at a grid, the uncerta…
This paper uses a diffusion model to forecast electrical loads with uncertainty.
problem Uncertainties in electrical load forecasting due to renewable energy and external events.
method Diffusion-based Seq2Seq structure for epistemic uncertainty and robust additive Cauchy distribution for aleatoric uncertainty.
result Ability to separate and quantify both types of uncertainties in load forecasting.
Paper presents a method for probabilistic load forecasting using adaptive online learning.
problem Inability to assess intrinsic uncertainties and capture dynamic changes in consumption patterns.
method Adaptive online learning of hidden Markov models for recursive parameter updates and sequential prediction.
result Significant improvement in performance compared to existing techniques across various scenarios.
In this paper, we present a scalable distributed implementation of the Sampled Limited-memory Symmetric Rank-1 (S-LSR1) algorithm. First, we show that a naive distributed implementation of S-LSR1 requires multiple rounds of expensive communications at every iteration and thus is inefficient. We then propose DS-LSR1, a …
In recent years, dynamically growing data and incrementally growing number of classes pose new challenges to large-scale data classification research. Most traditional methods struggle to balance the precision and computational burden when data and its number of classes increased. However, some methods are with weak pr…
Log-supermodularity of weight functions and the loading monotonicity of weighted insurance premiumsq-fin.RM
The paper is motivated by a problem concerning the monotonicity of insurance premiums with respect to their loading parameter: the larger the parameter, the larger the insurance premium is expected to be. This property, usually called loading monotonicity, is satisfied by premiums that appear in the literature. The inc…
This paper monetizes customer load data to boost energy retailer profits.
problem Improving load forecasts to reduce energy imbalance costs.
method Cooperative game theory approach to quantify and distribute profits.
result Retailer gains significant profit from customer load data.
Study finds cherry-picking load shaping strategies outperforms others in reducing grid CO2 emissions.
problem Lack of detailed counterfactual data makes it hard to assess load shaping strategies' effectiveness.
method Calibrated granular ERCOT simulations for counterfactual analysis of load shaping strategies.
result LMP-based load shaping outperforms other strategies in reducing grid CO2 emissions.
Develops a method to analyze SARS-CoV-2 viral load vs. age, finding a significant increase.
problem Determining if SARS-CoV-2 viral load depends on patient age.
method Flexible, non-parametric, hierarchical, Bayesian, causal model.
result Statistically significant increase in viral load with age, but only for one dataset.
Adaptive probabilistic load forecasting improves performance in power systems.
problem Complexity of electricity load forecasting due to changing drivers and local generation.
method Adaptive probabilistic approach using Kalman filter and online gradient descent.
result Adaptive probabilistic forecasts improve performance in both point and probabilistic forecasting.
Machine learning reconstructs aerodynamic forces from noisy data.
problem Accurately modeling aerodynamic forces with limited or noisy data.
method Physics-informed Gaussian processes trained on noisy structural responses.
result Strong agreement between true and predicted aerodynamic loads.
This paper presents a novel deep learning architecture for short term load forecasting of building energy loads. The architecture is based on a simple base learner and multiple boosting systems that are modelled as a single deep neural network. The architecture transforms the original multivariate time series into mult…
In this paper a new method for heat load prediction in district energy systems is proposed. The method uses a nominal model for the prediction of the outdoor temperature dependent space heating load, and a data driven latent variable model to predict the time dependent residual heat load. The residual heat load arises …
Model uses GAMs to forecast hourly electricity load weeks to one year ahead.
problem Accurate mid-term hourly load forecasting for power plant operation and energy management.
method Generalized Additive Models (GAMs) with P-splines and autoregressive post-processing.
result Significantly enhanced forecasting accuracy compared to state-of-the-art methods.
We present a methodology for probabilistic load forecasting that is based on lasso (least absolute shrinkage and selection operator) estimation. The model considered can be regarded as a bivariate time-varying threshold autoregressive(AR) process for the hourly electric load and temperature. The joint modeling approach…
Short-Term Density Forecasting of Low-Voltage Load using Bernstein-Polynomial Normalizing Flowscs.LG
The paper proposes a new method for probabilistic load forecasting using Bernstein-Polynomial Normalizing Flows.
problem High variability in short-term load forecasting at the low-voltage level due to fluctuating demand and increasing electrification.
method Flexible conditional density forecasting based on Bernstein polynomial normalizing flows with neural network control.
result Density predictions outperform traditional methods for 24h-ahead load forecasting.
As an important part of the power system, power load forecasting directly affects the national economy. The data shows that improving the load forecasting accuracy by 0.01% can save millions of dollars for the power industry. Therefore, improving the accuracy of power load forecasting has always been the pursuing goals…
Short-term load forecasting is a critical element of power systems energy management systems. In recent years, probabilistic load forecasting (PLF) has gained increased attention for its ability to provide uncertainty information that helps to improve the reliability and economics of system operation performances. This…
Improves distributed SGD convergence speed with reduced computation load.
problem Mitigating stragglers in distributed SGD to speed up convergence.
method Modeling communication and computation times, adapting number of workers and computation load dynamically.
result Significantly reduces computation load while improving convergence speed.
Novel method improves load estimation in power grids using anomaly and change point detection.
problem Improving load estimation in power grid systems.
method Combining unsupervised anomaly and change point detection methods for automatic filtering.
result Automatic load estimation is accurate with 90% estimates within a 10% error margin.
This paper presents a convolutional neural network (CNN) which can be used for forecasting electricity load profiles 36 hours into the future. In contrast to well established CNN architectures, the input data is one-dimensional. A parameter scanning of network parameters is conducted in order to gain information about …