Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

120239359478 · Jun 202019922001200920172026
48 results for load estimation

Novel method improves load estimation in power grids using anomaly and change point detection.

problem Improving load estimation in power grid systems.
method Combining unsupervised anomaly and change point detection methods for automatic filtering.
result Automatic load estimation is accurate with 90% estimates within a 10% error margin.

This paper uses a diffusion model to forecast electrical loads with uncertainty.

problem Uncertainties in electrical load forecasting due to renewable energy and external events.
method Diffusion-based Seq2Seq structure for epistemic uncertainty and robust additive Cauchy distribution for aleatoric uncertainty.
result Ability to separate and quantify both types of uncertainties in load forecasting.

We present a methodology for probabilistic load forecasting that is based on lasso (least absolute shrinkage and selection operator) estimation. The model considered can be regarded as a bivariate time-varying threshold autoregressive(AR) process for the hourly electric load and temperature. The joint modeling approach…

2016-03-04abs ↗pdf ↗

New algorithm for shareable arms with load-dependent rewards in stochastic bandits.

problem Learning optimal play strategy with shareable finite-capacity arms in stochastic bandits.
method Developed a capacity estimator and online learning algorithm for MP-MAB with shareable arms.
result Regret upper bound matches the lower bound, validating the algorithm's performance.

CP-factorization for high-dimensional tensor time series and double projection iterations

problem Identifying and estimating factor loadings in CP decomposition for high-dimensional tensor time series
method One-pass estimation procedure using standard eigen-analysis for matrix constructed based on serial dependence
result Asymptotic properties established under general settings, adapt to sparsity, accommodates weak factors

In this paper, we provide explicit formulas, in terms of the covariances of sample covariances or sample correlations, for the asymptotic covariances of unrotated factor loading estimates and unique variance estimates. These estimates are extracted from least square, principal, iterative principal component, alpha or i…

2018-11-12abs ↗pdf ↗

b-LOAD extends local causal discovery with prior knowledge, improving causal effect estimation.

problem Local causal discovery struggles in data-scarce settings due to uncertainty and incomplete neighborhoods.
method b-LOAD incorporates prior knowledge directly into local structure learning, using Meek's rules to refine discovery.
result b-LOAD refines the admissible equivalence class and enlarges identifiable causal queries, improving causal effect estimation.

The paper proposes a new method for probabilistic load forecasting using Bernstein-Polynomial Normalizing Flows.

problem High variability in short-term load forecasting at the low-voltage level due to fluctuating demand and increasing electrification.
method Flexible conditional density forecasting based on Bernstein polynomial normalizing flows with neural network control.
result Density predictions outperform traditional methods for 24h-ahead load forecasting.

Paper proposes combining GAM and DNN for accurate peak demand estimation from lower-resolution data.

problem Predicting high-resolution peak demand from limited lower-resolution data.
method Combines generalized additive models (GAM) and deep neural networks (DNN) for half-hourly load forecasting.
result Proposed method reduces out-of-sample RMSE by 57.4% compared to benchmark.

Traditional load analysis is facing challenges with the new electricity usage patterns due to demand response as well as increasing deployment of distributed generations, including photovoltaics (PV), electric vehicles (EV), and energy storage systems (ESS). At the transmission system, despite of irregular load behavio…

2019-02-20abs ↗pdf ↗

In this paper we consider the use of the space vs. time Kronecker product decomposition in the estimation of covariance matrices for spatio-temporal data. This decomposition imposes lower dimensional structure on the estimated covariance matrix, thus reducing the number of samples required for estimation. To allow a sm…

2013-07-27abs ↗pdf ↗

We address the curse of dimensionality in dynamic covariance estimation by modeling the underlying co-volatility dynamics of a time series vector through latent time-varying stochastic factors. The use of a global-local shrinkage prior for the elements of the factor loadings matrix pulls loadings on superfluous factors…

2016-08-30abs ↗pdf ↗

Paper proposes a novel optimization method for disaggregating smart meter data.

problem Energy disaggregation, inferring appliance-specific energy consumption from aggregate meter data.
method Two-stage optimization approach: first phase uses mixed integer programming, second phase binary quadratic optimization with penalty terms and appliance constraints.
result Proposed method successfully reconstructs appliance signatures, overcoming previous optimization-based methods' limitations.

Data loading can dominate deep neural network training time on large-scale systems. We present a comprehensive study on accelerating data loading performance in large-scale distributed training. We first identify performance and scalability issues in current data loading implementations. We then propose optimizations t…

2019-10-02abs ↗pdf ↗

A distributed framework for reducing high-dimensional matrix-variate time series data.

problem Reducing dimensionality of high-dimensional, heterogeneous matrix-variate time series data.
method Data partitioning, distributed two-dimensional tensor PCA, aggregation, final PCA, factor matrix computation.
result Preserves latent matrix structure, improves computational efficiency and information utilization.

In (exploratory) factor analysis, the loading matrix is identified only up to orthogonal rotation. For identifiability, one thus often takes the loading matrix to be lower triangular with positive diagonal entries. In Bayesian inference, a standard practice is then to specify a prior under which the loadings are indepe…

2014-09-26abs ↗pdf ↗

Frugal method predicts multiple local electricity loads efficiently.

problem Day-ahead forecasting of over 1000 substations in France.
method Adaptive generalized additive models with state-space representations, combined with transfer learning.
result Reduction of computational needs and emissions with competitive accuracy.

Optimal tensor PCA for estimating factors and loadings in high-dimensional panel data.

problem Estimating factors and loadings in high-dimensional panel data with non-negligible correlations.
method Tensor Principal Component Analysis (TPCA) for estimating factors and loadings in a tensor factor model.
result Simple TPCA is optimal for strong factors and can be improved for weak factors with alternating least-squares iterations.

Paper uses econometrics time series model with T-student Distribution for short-term load forecasting.

problem Accurate short-term load forecasting for optimizing electrical sources and protecting energy.
method Uses SARIMA-GARCH model with T-student Distribution to forecast electric load.
result The proposed model outperforms the ARIMA model with Normal Distribution.

Bayesian Transformer improves probabilistic load forecasting with calibrated uncertainty estimates.

problem Overconfident point predictions from deep learning models fail under extreme weather distributional shifts.
method Integrates three uncertainty mechanisms: MC Dropout, variational layers, and stochastic attention.
result Achieves state-of-the-art performance with CRPS of 0.0289 and 90% PICP across various horizons.

We use online convex optimization (OCO) for setpoint tracking with uncertain, flexible loads. We consider full feedback from the loads, bandit feedback, and two intermediate types of feedback: partial bandit where a subset of the loads are individually observed and the rest are observed in aggregate, and Bernoulli feed…

2017-09-12abs ↗pdf ↗

The paper introduces metrics to evaluate NILM algorithms' performance on unseen buildings.

problem Assessing NILM algorithms' performance on new, unseen buildings.
method Developed several metrics to evaluate NILM algorithms' generalization ability.
result Demonstrated the utility of the proposed metrics through two case studies.

Paper presents a method for probabilistic load forecasting using adaptive online learning.

problem Inability to assess intrinsic uncertainties and capture dynamic changes in consumption patterns.
method Adaptive online learning of hidden Markov models for recursive parameter updates and sequential prediction.
result Significant improvement in performance compared to existing techniques across various scenarios.

A new model explains asset returns with a single factor, improving cross-sectional performance.

problem Understanding the cross-section of asset returns with complex models.
method Proposes a non-linear single-factor asset pricing model with a nonparametric link function estimated jointly with sieve-based estimators.
result The model delivers superior cross-sectional performance with a low-dimensional approximation of the link function.

New method predicts heat load in thermal grids using latent variables.

problem Predicting heat load in district energy systems.
method Combines nominal model for outdoor temperature with latent variable model for residual heat load.
result Proposed method achieves better prediction accuracy than artificial neural networks.

Paper proposes dense average network for improved power load forecasting.

problem Improving power load forecasting accuracy to save millions for the power industry.
method Introduces dense average connection and constructs dense average network for power load forecasting.
result Proposed model outperforms existing methods on public datasets.

Sparse GCA finds linear relationships in multiple datasets, using gradient descent.

problem Finding linear relationships across multiple datasets with sparse loading vectors.
method Formulated as generalized eigenvalue problems, used a thresholded gradient descent algorithm.
result Proposed algorithm yields tight estimation error bounds and demonstrates effectiveness on synthetic datasets.

A new method calculates risk loadings in classification ratemaking without subjective parameters.

problem Subjective risk loading parameters in classification ratemaking.
method Bootstrap method to calculate total risk premium, then determine risk loading parameters using quantile regression models.
result Risk premiums calculated by the new method reasonably differentiate different risk classes.

Deep learning improves weather modeling for electricity load forecasting.

problem Accurate load and renewable energy forecasting requires complex spatio-temporal weather modeling.
method Automated spatio-temporal feature extraction using deep neural networks.
result Deep learning outperforms traditional methods in French national load forecasting.