This paper proposes a submodular load clustering method for transmission-level load areas.
problem Traditional load analysis challenges with new electricity usage patterns.
method Robust Principal Component Analysis (R-PCA) and submodular cluster center selection.
result The proposed method efficiently clusters load areas and demonstrates effectiveness in PJM load data.
HIV RNA viral load (VL) is an important outcome variable in studies of HIV infected persons. There exists only a handful of methods which classify patients by viral load patterns. Most methods place limits on the use of viral load measurements, are often specific to a particular study design, and do not account for com…
Hierarchical clustering models capture electricity load patterns from smart meters.
problem Improving efficiency and sustainability of electricity systems.
method Quantile autocovariances and autocorrelations for summarizing time series.
result Clusters identify relevant consumption behaviors and capture geo-demographic segmentation.
Proposes a DRL-based MLB for UDNs to balance large-scale traffic.
problem Large-scale load balancing in ultra-dense networks (UDNs).
method Two-layer architecture with DRL for intra-cluster load balancing.
result Empirical results show superior load balancing performance.
Consumer Demand Response (DR) is an important research and industry problem, which seeks to categorize, predict and modify consumer's energy consumption. Unfortunately, traditional clustering methods have resulted in many hundreds of clusters, with a given consumer often associated with several clusters, making it diff…
SDCOR clusters massive datasets efficiently, detecting outliers with low memory usage.
problem Local outlier detection in large-scale datasets.
method Chunk-based density clustering with incremental updates.
result SDCOR achieves lower linear time complexity and better efficiency than traditional methods.
Paper examines vulnerabilities in data-driven pricing schemes.
problem Vulnerability of clustering-oriented pricing schemes to malicious user behavior.
method Defined a notion of disguising to identify strategic behaviors of malicious users, characterized sensitivity zones to evaluate malicious user percentages, conducted cost benefit analysis.
result Concluded with a vulnerability analysis of data-driven pricing schemes.
CROCS clusters consumer behaviour from smart meters, capturing variability and robustness.
problem Insufficient consumer segmentation in existing clustering methods.
method Two-stage clustering framework: first stage clusters daily load profiles, second stage uses WSMD for set-to-set comparison.
result CROCS captures intra-consumer variability and robustness to anomalies and missing data.
New ML-based detection improves PMH signal detection in load-modulated MIMO systems.
problem Detecting PMH signals without prior CSI is challenging and computationally expensive.
method Proposes HEM-ML and HEM-KD schemes using EM and KD-tree for efficient detection.
result Achieves comparable detection results to optimal ML detector with reduced complexity.
Understanding the heat usage of customers is crucial for effective district heating operations and management. Unfortunately, existing knowledge about customers and their heat load behaviors is quite scarce. Most previous studies are limited to small-scale analyses that are not representative enough to understand the b…
A mixture of common skew-t factor analyzers model is introduced for model-based clustering of high-dimensional data. By assuming common component factor loadings, this model allows clustering to be performed in the presence of a large number of mixture components or when the number of dimensions is too large to be well…
Study explores K-means clustering of variables and its relation to PCA.
problem Exploring the relationship between K-means clustering of variables and PCA.
method Apply PCA to original data and K-means to transposed data, quantify variable contributions to principal components.
result Identifies how variable clusters contribute to principal components identified by PCA.
Nonnegative Matrix Factorization (NMF) aims to factorize a matrix into two optimized nonnegative matrices appropriate for the intended applications. The method has been widely used for unsupervised learning tasks, including recommender systems (rating matrix of users by items) and document clustering (weighting matrix …
This work introduces a novel estimation method, called LOVE, of the entries and structure of a loading matrix A in a sparse latent factor model X = AZ + E, for an observable random vector X in Rp, with correlated unobservable factors Z \in RK, with K unknown, and independent noise E. Each row of A is scaled and sparse.…
Efficiently scheduling data processing jobs on distributed compute clusters requires complex algorithms. Current systems, however, use simple generalized heuristics and ignore workload characteristics, since developing and tuning a scheduling policy for each workload is infeasible. In this paper, we show that modern ma…
Accelerates data loading in deep neural network training by 30x.
problem Data loading is a bottleneck in deep neural network training.
method Locality-aware data loading method using software caches.
result More than 30x speedup in data loading.
This paper analyzes load predictability at different aggregation levels and improves forecasting accuracy.
problem Challenges in short-term load forecasting, especially at low aggregation levels.
method Characterized SME and residential loads, quantified predictability using approximate entropy, compared various STLF techniques.
result Improved forecasting accuracy for low-aggregation loads, validated with data processing techniques.
In this chapter we review the main literature related to kernel spectral clustering (KSC), an approach to clustering cast within a kernel-based optimization setting. KSC represents a least-squares support vector machine based formulation of spectral clustering described by a weighted kernel PCA objective. Just as in th…
Enhances load forecasting for multiple entities with dynamic similarities.
problem Inaccurate probabilistic load predictions due to uncertainties and dynamic changes.
method Online multi-task learning for probabilistic load forecasting.
result Significantly enhances load forecasting accuracy across various scenarios.
A distributed framework for reducing high-dimensional matrix-variate time series data.
problem Reducing dimensionality of high-dimensional, heterogeneous matrix-variate time series data.
method Data partitioning, distributed two-dimensional tensor PCA, aggregation, final PCA, factor matrix computation.
result Preserves latent matrix structure, improves computational efficiency and information utilization.
Given a multivariate data set, sparse principal component analysis (SPCA) aims to extract several linear combinations of the variables that together explain the variance in the data as much as possible, while controlling the number of nonzero loadings in these combinations. In this paper we consider 8 different optimiz…
Paper proposes a new method for hourly load forecasting using smart meter data.
problem Challenges in short-term load forecasting at fine granularity.
method Forecasting using Matrix Factorization (fmf) for hourly load forecasting.
result Significantly outperforms state-of-the-art methods in load forecasting.
In (exploratory) factor analysis, the loading matrix is identified only up to orthogonal rotation. For identifiability, one thus often takes the loading matrix to be lower triangular with positive diagonal entries. In Bayesian inference, a standard practice is then to specify a prior under which the loadings are indepe…
Simple 1D-CNN network predicts electricity loads 36 hours ahead.
problem Forecasting electricity loads for future time periods.
method Used a one-dimensional CNN with parameter scanning to optimize kernel size, filters, and dense size.
result Good forecast quality achieved with basic CNN architectures.
A new framework uses DDQN to simplify WECC CLM for efficient load modeling.
problem Complexity and high parameter count in WECC CLM.
method Two-stage approach with DDQN for load composition and parameter selection.
result The framework efficiently approximates WECC CLM transient responses.
Paper uses econometrics time series model with T-student Distribution for short-term load forecasting.
problem Accurate short-term load forecasting for optimizing electrical sources and protecting energy.
method Uses SARIMA-GARCH model with T-student Distribution to forecast electric load.
result The proposed model outperforms the ARIMA model with Normal Distribution.
Deep learning boosts building energy load forecasting.
problem Short-term load forecasting in buildings.
method Stacked Boosters Network architecture with sparse interactions, parameter sharing, and equivariant representations.
result Outperforms state-of-the-art models in short-term load forecasting tasks.
Proposes ITISC for clustering with minimized worst-case expected distortions.
problem Real-world clustering data distribution mismatch.
method Information theoretical importance sampling, constrained minimax optimization, Lagrange method.
result Validation of ITISC on synthetic and real-world datasets.
We consider a collection of prediction experiments, which are clustered in the sense that groups of experiments ex- hibit similar relationship between the predictor and response variables. The experiment clusters as well as the regres- sion relationships are unknown. The regression relation- ships define the experiment…
New method infers viral load from pooled tests.
problem Inefficient viral load inference in pooled testing.
method Message passing algorithm with PCR noise function.
result Accurate viral load inference possible.
We use online convex optimization (OCO) for setpoint tracking with uncertain, flexible loads. We consider full feedback from the loads, bandit feedback, and two intermediate types of feedback: partial bandit where a subset of the loads are individually observed and the rest are observed in aggregate, and Bernoulli feed…
This paper uses a diffusion model to forecast electrical loads with uncertainty.
problem Uncertainties in electrical load forecasting due to renewable energy and external events.
method Diffusion-based Seq2Seq structure for epistemic uncertainty and robust additive Cauchy distribution for aleatoric uncertainty.
result Ability to separate and quantify both types of uncertainties in load forecasting.
Paper presents a method for probabilistic load forecasting using adaptive online learning.
problem Inability to assess intrinsic uncertainties and capture dynamic changes in consumption patterns.
method Adaptive online learning of hidden Markov models for recursive parameter updates and sequential prediction.
result Significant improvement in performance compared to existing techniques across various scenarios.
New method predicts heat load in thermal grids using latent variables.
problem Predicting heat load in district energy systems.
method Combines nominal model for outdoor temperature with latent variable model for residual heat load.
result Proposed method achieves better prediction accuracy than artificial neural networks.
Paper proposes dense average network for improved power load forecasting.
problem Improving power load forecasting accuracy to save millions for the power industry.
method Introduces dense average connection and constructs dense average network for power load forecasting.
result Proposed model outperforms existing methods on public datasets.
The paper is motivated by a problem concerning the monotonicity of insurance premiums with respect to their loading parameter: the larger the parameter, the larger the insurance premium is expected to be. This property, usually called loading monotonicity, is satisfied by premiums that appear in the literature. The inc…
Paper proposes a framework for probabilistic load forecasting by integrating point forecasts.
problem Short-term load forecasting for power systems energy management.
method Two-stage framework: first stage for point forecasting, second stage for probabilistic forecasting using feature integration.
result Numerical results show effectiveness of the proposed approach in hour-ahead load forecasting.
A new method calculates risk loadings in classification ratemaking without subjective parameters.
problem Subjective risk loading parameters in classification ratemaking.
method Bootstrap method to calculate total risk premium, then determine risk loading parameters using quantile regression models.
result Risk premiums calculated by the new method reasonably differentiate different risk classes.
Deep learning improves weather modeling for electricity load forecasting.
problem Accurate load and renewable energy forecasting requires complex spatio-temporal weather modeling.
method Automated spatio-temporal feature extraction using deep neural networks.
result Deep learning outperforms traditional methods in French national load forecasting.
This paper monetizes customer load data to boost energy retailer profits.
problem Improving load forecasts to reduce energy imbalance costs.
method Cooperative game theory approach to quantify and distribute profits.
result Retailer gains significant profit from customer load data.
A method for selecting data for short-term load forecasting using Bayesian probabilistic models.
problem Lack of effective data selection techniques in power load forecasting.
method A fully automatic methodology based on a full Bayesian probabilistic model.
result The method improves the performance of load forecast models using real data.
t-distributed Stochastic Neighborhood Embedding (t-SNE) is a method for dimensionality reduction and visualization that has become widely popular in recent years. Efficient implementations of t-SNE are available, but they scale poorly to datasets with hundreds of thousands to millions of high dimensional data-points. W…
Study finds cherry-picking load shaping strategies outperforms others in reducing grid CO2 emissions.
problem Lack of detailed counterfactual data makes it hard to assess load shaping strategies' effectiveness.
method Calibrated granular ERCOT simulations for counterfactual analysis of load shaping strategies.
result LMP-based load shaping outperforms other strategies in reducing grid CO2 emissions.
Develops a method to analyze SARS-CoV-2 viral load vs. age, finding a significant increase.
problem Determining if SARS-CoV-2 viral load depends on patient age.
method Flexible, non-parametric, hierarchical, Bayesian, causal model.
result Statistically significant increase in viral load with age, but only for one dataset.
Adaptive probabilistic load forecasting improves performance in power systems.
problem Complexity of electricity load forecasting due to changing drivers and local generation.
method Adaptive probabilistic approach using Kalman filter and online gradient descent.
result Adaptive probabilistic forecasts improve performance in both point and probabilistic forecasting.
Machine learning reconstructs aerodynamic forces from noisy data.
problem Accurately modeling aerodynamic forces with limited or noisy data.
method Physics-informed Gaussian processes trained on noisy structural responses.
result Strong agreement between true and predicted aerodynamic loads.
Deep learning models improve electric load forecasting accuracy.
problem Accurate short-term electric load forecasting remains challenging.
method Comprehensive evaluation of various deep learning architectures on real-world datasets.
result Deep learning models outperform traditional methods in electric load forecasting.
Deep learning predicts bridge load capacity from images.
problem Lack of data on aging bridges in post-disaster zones.
method Crowd-sourced images trained on a new CNN for multiclass classification.
result Improved prediction accuracy and practical optimisation.