As renewable distributed energy resources (DERs) penetrate the power grid at an accelerating speed, it is essential for operators to have accurate solar photovoltaic (PV) energy forecasting for efficient operations and planning. Generally, observed weather data are applied in the solar PV generation forecasting model w…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “weather variables”
The effects of weather on agriculture in recent years have become a major global concern. Hence, the need for an effective weather risk management tool (i.e., weather derivatives) that can hedge crop yields against weather uncertainties. However, most smallholder farmers and agricultural stakeholders are unwilling to p…
New methods quantify uncertainties in AI weather forecasts.
problem Uncertainty in AI weather predictions.
method Comparing ensemble and post-hoc uncertainty quantification methods.
result Probabilistic forecasts improve over ensemble physics-based models.
Benchmarking Physics-Informed Time-Series Models for Operational Global Station Weather Forecastingcs.LG
PhysicsFormer improves TSF models for GSWF with WEATHER-5K dataset.
problem Lack of comprehensive datasets for GSWF.
method PhysicsFormer combines dynamic core and Transformer, enforcing physical consistency.
result PhysicsFormer outperforms TSF models in operational forecasting.
Neural network predicts weather probabilities with added uncertainty.
problem Inferring uncertainty from weather predictions.
method Data-driven neural network trained on WeatherBench dataset, combining outputs from subsets of variables.
result More accurate than some numerical models, provides probabilistic information.
Model for hedging price and quantity risks in electricity markets.
problem Hedging risks for energy retailers in a regulated electricity market.
method Closed-form solution for optimal portfolio using financial instruments based on price and weather indexes.
result Closed-form solution for mean-var model in discrete setting without distributional assumptions.
Nowadays, with the unprecedented penetration of renewable distributed energy resources (DERs), the necessity of an efficient energy forecasting model is more demanding than before. Generally, forecasting models are trained using observed weather data while the trained models are applied for energy forecasting using for…
Developed deep learning models to predict crop yields across diverse environments.
problem Precise crop yield prediction for improved agricultural practices and climate resilience.
method Integrated weather data, used CNN-DNN and CNN-LSTM-DNN models, applied GEM method.
result Achieved superior performance in crop yield prediction with reduced RMSE and MAE.
Improving data-driven global weather prediction using deep convolutional neural networks on a cubed spherephysics.ao-ph
Improved weather forecasting using deep CNN on cubed-sphere grid.
problem Global weather prediction accuracy and speed.
method Deep convolutional neural network (CNN) on cubed-sphere grid, offline mapping, loss minimization.
result Significantly improved weather forecasts, indefinitely stable, realistic patterns at long lead times.
Signature Kernel Scoring Rule: A Spatio-Temporal Diagnostic for Probabilistic Weather Forecastingstat.ML
Signature kernel scoring rule improves weather forecasting by capturing temporal and spatial dependencies.
problem Lack of suitable scoring rules for probabilistic weather forecasting.
method Reframe weather variables as continuous paths using iterated integrals (signature kernels) to capture temporal and spatial dependencies.
result Signature kernel scoring rule outperforms conventional methods in weather forecasting, especially for long-term forecasts.
Graph-EFM models weather uncertainty with graph-based ensembles.
problem Accurately capturing forecast uncertainty in chaotic weather.
method Flexible latent-variable formulation with hierarchical graph construction.
result Graph-EFM ensembles achieve equivalent or lower errors than deterministic models.
This study analyzes how weather impacts bike sharing usage in Washington D.C.
problem Understanding how weather affects bike sharing usage patterns.
method Gathered bike usage and weather data, used k-means clustering algorithm to identify clusters.
result Weather significantly impacts bike usage, with temperature and precipitation being the most influential factors.
Develops a new method for decision trees using categorical variable structure.
problem Lack of structure in treating categorical variables as predictors.
method Introduces a mathematical framework to represent categorical structure and generalizes decision trees to utilize this structure.
result Improves prediction accuracy on weather data using the new method.
Weather and atmospheric patterns are often persistent. The simplest weather forecasting method is the so-called persistence model, which assumes that the future state of a system will be similar (or equal) to the present state. Machine learning (ML) models are widely used in different weather forecasting applications, …
SubseasonalClimateUSA dataset improves subseasonal weather forecasting.
problem Challenges in subseasonal weather forecasting, especially skill of physics-based models and integration of local and global variables.
method Curated dataset for training and benchmarking subseasonal forecasting models, including various methods.
result Benchmarking suggests simple and effective ways to improve current operational models.
Deep learning predicts crop yield integrating genotype and weather data.
problem Improving crop yield prediction for diverse climates.
method Long Short Term Memory - Recurrent Neural Network model with temporal attention mechanism.
result Deep learning models outperform traditional methods for yield prediction.
PeakWeather provides Swiss weather station data for machine learning.
problem Accurate weather forecasting for various activities and decision-making.
method High-quality dataset of surface weather observations from 8 years of Swiss stations.
result Dataset supports a wide range of spatiotemporal tasks.
Enhanced visibility forecasts using CAMS data improve accuracy.
problem Improving the accuracy of visibility predictions in weather forecasts.
method Statistical post-processing with historical observations and CAMS forecasts.
result Post-processed forecasts with CAMS data are substantially superior to raw and climatological predictions.
Effective utilization of photovoltaic (PV) plants requires weather variability robust global solar radiation (GSR) forecasting models. Random weather turbulence phenomena coupled with assumptions of clear sky model as suggested by Hottel pose significant challenges to parametric & non-parametric models in GSR conversio…
New method improves wind and solar energy forecasts by 48 hours.
problem Volatility of wind and solar energy makes accurate forecasts difficult.
method Two-step machine learning approach to calibrate ensemble forecasts.
result Statistical post-processing improves forecast skill by at least 48 hours.
Ensemble weather predictions require statistical post-processing of systematic errors to obtain reliable and accurate probabilistic forecasts. Traditionally, this is accomplished with distributional regression models in which the parameters of a predictive distribution are estimated from a training period. We propose a…
Weather is a key production factor in agricultural crop production and at the same time the most significant and least controllable source of peril in agriculture. These effects of weather on agricultural crop production have triggered a widespread support for weather derivatives as a means of mitigating the risk assoc…
Efficient modeling of sub-kilometer surface wind with Gaussian processes and neural networksphysics.ao-ph
Paper uses Gaussian processes and neural nets to model sub-km wind accurately.
problem Accurately modeling sub-kilometer surface wind for optimal decision-making.
method Integrates Gaussian processes and neural networks to model wind gusts at sub-kilometer resolution.
result Modeling covariance structure improves prediction quality and calibration.
Deep learning improves weather modeling for electricity load forecasting.
problem Accurate load and renewable energy forecasting requires complex spatio-temporal weather modeling.
method Automated spatio-temporal feature extraction using deep neural networks.
result Deep learning outperforms traditional methods in French national load forecasting.
Causal Regime Detection in Energy Markets With Augmented Time Series Structural Causal Modelsq-fin.CP
New model predicts energy prices under different scenarios.
problem Complex causal relationships in energy markets with continuous regime changes.
method Augmented Time Series Structural Causal Models (ATSCM) integrating neural causal discovery.
result Enables novel counterfactual queries in energy markets.
Paper models spatio-temporal extremes using conditional variational autoencoders.
problem Modeling co-occurrence of extreme weather events under changing climate conditions.
method Conditional Variational Autoencoder (cXVAE) with CNN integration.
result Accurately emulates spatial fields and recovers extremal dependence with low computational cost.
SFM resolves small-scale physics challenges in weather data.
problem Challenges in super-resolving small-scale details in physical sciences like weather.
method Encoding inputs to a latent base distribution, flow matching for stochastic details, adaptive noise scaling.
result SFM framework significantly outperforms existing methods.
WindDragon forecasts wind power with deep learning.
problem Accurate short-term wind power forecasting is crucial for grid operation.
method Automated Deep Learning combined with Numerical Weather Predictions.
result Automated Deep Learning improves wind power forecasting accuracy.
PBC improves AI and dynamical subseasonal forecasts by reducing biases.
problem Subseasonal forecast accuracy drops due to model biases and compounding errors.
method Probabilistic bias correction (PBC) using machine learning to correct historical forecasts.
result PBC doubles AI Forecasting System's subseasonal skill and improves dynamical model skill.
New method predicts wind farm power and wakes using weather patterns.
problem Inefficient and computationally intensive wind energy resource assessment.
method Unsupervised clustering of ERA5 data on wind velocity, WRF simulations at cluster centers, and post-processing.
result Accurate long-term predictions of power and wakes with reduced computational time.
Enhances weather detection by learning from auxiliary information.
problem Mispredictions in unsupervised severe weather detection.
method Learning joint representations of textual and weather data.
result Improved decision boundaries for severe weather detection.
Improved visibility forecasts using statistical post-processing.
problem Accurate and reliable predictions of visibility are crucial in aviation and transportation.
method Calibrated ensemble forecasts using locally, semi-locally, and regionally trained POLR and MLP classifiers.
result Post-processing improves forecast skill and POLR models outperform MLPs.
Dynamic probabilistic forecasts guide optimal decisions in uncertain processes.
problem Optimal decision making in processes influenced by uncertain random factors.
method Stochastic models for probabilistic forecast evolution, calibrated from ensemble forecasts.
result Optimal decision strategies determined using dynamic probabilistic forecasts.
A deep mixture density network for outlier-corrected interpolation of crowd-sourced weather datastat.ML
Deep learning model detects and corrects outliers in crowd-sourced weather data.
problem Data quality issues in crowd-sourced weather data.
method Bayesian deep learning approach with Gaussian-uniform mixture density network.
result Automated outlier detection in spatio-temporal environmental modeling.
Study evaluates post-processing methods for improving solar power forecasts.
problem Improving accuracy of probabilistic solar energy forecasts through model chain approaches.
method Systematically evaluates different post-processing strategies for ensemble weather forecasts and direct solar power forecasting.
result Post-processing significantly improves solar power generation forecasts, especially when applied to power predictions.
WeatherFormer learns robust weather features from small datasets.
problem Modeling complex weather dynamics from limited data.
method Pretrained transformer encoder on large satellite dataset, with spatiotemporal encoding.
result State-of-the-art performance in county-level soybean yield prediction and influenza forecasting.
Enhancing Stratospheric Weather Analyses and Forecasts by Deploying Sensors from a Weather Ballooncs.LG
The ability to analyze and forecast stratospheric weather conditions is fundamental to addressing climate change. However, our capacity to collect data in the stratosphere is limited by sparsely deployed weather balloons. We propose a framework to collect stratospheric data by releasing a contrail of tiny sensor device…
A reliable and accurate forecasting model for crop yields is of crucial importance for efficient decision-making process in the agricultural sector. However, due to weather extremes and uncertainties, most forecasting models for crop yield are not reliable and accurate. For measuring the uncertainty and obtaining furth…
Trends in terrestrial temperature variability are perhaps more relevant for species viability than trends in mean temperature. In this paper, we develop methodology for estimating such trends using multi-resolution climate data from polar orbiting weather satellites. We derive two novel algorithms for computation that …
This study tackles basis risk in weather parametric insurance using Monte Carlo simulations.
problem Mismatch between actual loss and payout in weather parametric insurance leads to loss without payout or payout without loss.
method Empirical research using Monte Carlo simulations to test diversification and hedging strategies.
result Portfolio basis risk and volatility decrease with more contracts, and spatial relationships significantly impact basis risk.
Study improves accuracy of weather data for real-time building simulations.
problem Anomalous and missing weather data affect real-time building energy simulations.
method Introduces a framework for quality control of measured weather data using anomaly detection and neural network infilling.
result Neural Networks enhance the accuracy of data imputation compared to traditional methods.
Study compares machine learning methods for improving wind gust forecasts.
problem Improving accuracy of wind gust forecasts from ensemble models.
method Comprehensive comparison of 8 statistical and machine learning methods.
result Locally adaptive neural networks significantly outperform other methods.
Modern weather forecast models perform uncertainty quantification using ensemble prediction systems, which collect nonparametric statistics based on multiple perturbed simulations. To provide accurate estimation, dozens of such computationally intensive simulations must be run. We show that deep neural networks can be …
Deep neural networks improve ensemble weather forecasts.
problem Improving accuracy and efficiency of ensemble weather forecasts.
method Mixed model combining subset of trajectories with deep neural networks for post-processing.
result Achieved over 14% relative improvement in ensemble forecast skill.
New parameterization tackles stochasticity in weather models.
problem Uncertainty in small-scale processes in weather models.
method Bayesian neural network with Hamiltonian Monte Carlo for uncertainty quantification and memory.
result Shows skillful forecasts and trustworthy uncertainty quantifications.
A framework assesses the quality of crowdsourced weather data.
problem Quality control and assessment of crowdsourced weather data from third-party stations.
method Proposes a simple, scalable, and interpretable AI/Stats/ML framework to assess TPAWS data.
result Demonstrates the performance of the framework using synthetic and real data.
We price weather-contingent options by use of Monte Carlo simulations. After calibrating the models to fit quoted prices, we analyze bid-ask spreads in terms of correlations across markets. Results are presented for a double-trigger Weather vs. Natural Gas call option.
On Possible Influence of Space Weather on Agricultural Markets: Necessary Conditions and Probable Scenariosphysics.ao-ph
We present the results of study of a possible relationship between the space weather and terrestrial markets of agricultural products. It is shown that to implement the possible effect of space weather on the terrestrial harvests and prices, a simultaneous fulfillment of three conditions is required: 1) sensitivity of …