PhysicsFormer improves TSF models for GSWF with WEATHER-5K dataset.
problem Lack of comprehensive datasets for GSWF.
method PhysicsFormer combines dynamic core and Transformer, enforcing physical consistency.
result PhysicsFormer outperforms TSF models in operational forecasting.
Enhances weather detection by learning from auxiliary information.
problem Mispredictions in unsupervised severe weather detection.
method Learning joint representations of textual and weather data.
result Improved decision boundaries for severe weather detection.
Paper proposes a method for weather-informed probabilistic forecasting and scenario generation in power systems.
problem Challenges of integrating renewable energy sources into power grids due to their stochasticity and uncertainty.
method Combines probabilistic forecasting and Gaussian copula for day-ahead prediction and scenario generation of load, wind, and solar power.
result Demonstrates superior performance of the proposed weather-informed Temporal Fusion Transformer (WI-TFT) model.
Photovoltaic systems have been widely deployed in recent times to meet the increased electricity demand as an environmental-friendly energy source. The major challenge for integrating photovoltaic systems in power systems is the unpredictability of the solar power generated. In this paper, we analyze the impact of havi…
Neural network predicts weather probabilities with added uncertainty.
problem Inferring uncertainty from weather predictions.
method Data-driven neural network trained on WeatherBench dataset, combining outputs from subsets of variables.
result More accurate than some numerical models, provides probabilistic information.
Even though end-to-end supervised learning has shown promising results for sensorimotor control of self-driving cars, its performance is greatly affected by the weather conditions under which it was trained, showing poor generalization to unseen conditions. In this paper, we show how knowledge can be transferred using …
A framework assesses the quality of crowdsourced weather data.
problem Quality control and assessment of crowdsourced weather data from third-party stations.
method Proposes a simple, scalable, and interpretable AI/Stats/ML framework to assess TPAWS data.
result Demonstrates the performance of the framework using synthetic and real data.
We provide a model to understand how adverse weather conditions modify traffic flow dynamic. We first prove that the microscopic Free Flow Speed of the vehicles is changed and then provide a rule to model this change. For this, we consider a thresholded linear model, corresponding to an application of a MARS model to r…
A deep learning method for probabilistic weather forecasting.
problem Probabilistic forecasting of weather.
method Two chained machine-learning steps: dimension reduction and density estimation using normalizing flows.
result The method produces accurate conditional forecast distributions for weather.
Weather forecasting is usually solved through numerical weather prediction (NWP), which can sometimes lead to unsatisfactory performance due to inappropriate setting of the initial states. In this paper, we design a data-driven method augmented by an effective information fusion mechanism to learn from historical data …
The paper presents a machine learning framework to combine weather forecasts from multiple models.
problem Combining forecasts from different NWP models with varying biases and limitations.
method Three-stage framework using Quantile Regression Forests and quantile averaging.
result The framework generates well-calibrated probabilistic weather forecasts suitable for decision support.
Then detection and identification of extreme weather events in large-scale climate simulations is an important problem for risk management, informing governmental policy decisions and advancing our basic understanding of the climate system. Recent work has shown that fully supervised convolutional neural networks (CNNs…
Joint scene understanding and segmentation for automotive applications is a challenging problem in two key aspects:- (1) classifying every pixel in the entire scene and (2) performing this task under unstable weather and illumination changes (e.g. foggy weather), which results in poor outdoor scene visibility. This poo…
This report first provides a brief overview of a number of supervised learning algorithms for regression tasks. Among those are neural networks, regression trees, and the recently introduced Nexting. Nexting has been presented in the context of reinforcement learning where it was used to predict a large number of signa…
ML weather forecasts lack physical consistency, but add value.
problem Lack of physical consistency in ML weather forecasts.
method Examined Pangu-Weather forecasts for fidelity and physical consistency.
result ML forecasts lack physical consistency and accuracy can be partly due to this.
DISTANA improves weather prediction by inferring hidden factors from temperature data.
problem Inferring hidden factors in spatiotemporal processes without supervision.
method Enhanced DISTANA architecture for spatiotemporal data, active tuning for latent state inference.
result DISTANA achieves more accurate predictions than other methods, inferring hidden factors from temperature data.
New methods quantify uncertainties in AI weather forecasts.
problem Uncertainty in AI weather predictions.
method Comparing ensemble and post-hoc uncertainty quantification methods.
result Probabilistic forecasts improve over ensemble physics-based models.
As renewable distributed energy resources (DERs) penetrate the power grid at an accelerating speed, it is essential for operators to have accurate solar photovoltaic (PV) energy forecasting for efficient operations and planning. Generally, observed weather data are applied in the solar PV generation forecasting model w…
The effects of weather on agriculture in recent years have become a major global concern. Hence, the need for an effective weather risk management tool (i.e., weather derivatives) that can hedge crop yields against weather uncertainties. However, most smallholder farmers and agricultural stakeholders are unwilling to p…
Long Short-Term Memory (LSTM) is a well-known method used widely on sequence learning and time series prediction. In this paper we deployed stacked LSTM model in an application of weather forecasting. We propose a 2-layer spatio-temporal stacked LSTM model which consists of independent LSTM models per location in the f…
Signature kernel scoring rule improves weather forecasting by capturing temporal and spatial dependencies.
problem Lack of suitable scoring rules for probabilistic weather forecasting.
method Reframe weather variables as continuous paths using iterated integrals (signature kernels) to capture temporal and spatial dependencies.
result Signature kernel scoring rule outperforms conventional methods in weather forecasting, especially for long-term forecasts.
WeatherFormer learns robust weather features from small datasets.
problem Modeling complex weather dynamics from limited data.
method Pretrained transformer encoder on large satellite dataset, with spatiotemporal encoding.
result State-of-the-art performance in county-level soybean yield prediction and influenza forecasting.
The ability to analyze and forecast stratospheric weather conditions is fundamental to addressing climate change. However, our capacity to collect data in the stratosphere is limited by sparsely deployed weather balloons. We propose a framework to collect stratospheric data by releasing a contrail of tiny sensor device…
This study analyzes how weather impacts bike sharing usage in Washington D.C.
problem Understanding how weather affects bike sharing usage patterns.
method Gathered bike usage and weather data, used k-means clustering algorithm to identify clusters.
result Weather significantly impacts bike usage, with temperature and precipitation being the most influential factors.
Nowadays, with the unprecedented penetration of renewable distributed energy resources (DERs), the necessity of an efficient energy forecasting model is more demanding than before. Generally, forecasting models are trained using observed weather data while the trained models are applied for energy forecasting using for…
This study tackles basis risk in weather parametric insurance using Monte Carlo simulations.
problem Mismatch between actual loss and payout in weather parametric insurance leads to loss without payout or payout without loss.
method Empirical research using Monte Carlo simulations to test diversification and hedging strategies.
result Portfolio basis risk and volatility decrease with more contracts, and spatial relationships significantly impact basis risk.
CNNs improve wind speed forecasts in the Netherlands.
problem Limited spatial patterns in current post-processing methods.
method Convolutional Neural Networks (CNNs) for spatial wind speed information.
result CNNs produce better probabilistic forecasts with higher Brier skill scores.
Study improves accuracy of weather data for real-time building simulations.
problem Anomalous and missing weather data affect real-time building energy simulations.
method Introduces a framework for quality control of measured weather data using anomaly detection and neural network infilling.
result Neural Networks enhance the accuracy of data imputation compared to traditional methods.
New method combines model forecasts and real-time observations for hourly wind speed predictions.
problem Filling the six-hour gap between weather model runs for accurate hourly wind speed forecasts.
method Combines quasi-real-time observed wind speed and weather model predictions using a novel Ensemble Model Output Statistics (EMOS) strategy.
result Successfully improved wind speed predictions compared to observed data from SYNOP stations.
Machine learning improves sub-hourly precipitation data recovery.
problem Missing precipitation data at sub-hourly intervals.
method Two-step process: rain/non-rain classification and rain intensity prediction.
result Machine learning outperforms traditional methods in predicting missing precipitation data.
Modern weather forecast models perform uncertainty quantification using ensemble prediction systems, which collect nonparametric statistics based on multiple perturbed simulations. To provide accurate estimation, dozens of such computationally intensive simulations must be run. We show that deep neural networks can be …
Deep neural networks improve ensemble weather forecasts.
problem Improving accuracy and efficiency of ensemble weather forecasts.
method Mixed model combining subset of trajectories with deep neural networks for post-processing.
result Achieved over 14% relative improvement in ensemble forecast skill.
A deep learning model is applied for predicting block-level parking occupancy in real time. The model leverages Graph-Convolutional Neural Networks (GCNN) to extract the spatial relations of traffic flow in large-scale networks, and utilizes Recurrent Neural Networks (RNN) with Long-Short Term Memory (LSTM) to capture …
Running high-resolution physical models is computationally expensive and essential for many disciplines. Agriculture, transportation, and energy are sectors that depend on high-resolution weather models, which typically consume many hours of large High Performance Computing (HPC) systems to deliver timely results. Many…
Study evaluates post-processing methods for improving solar power forecasts.
problem Improving accuracy of probabilistic solar energy forecasts through model chain approaches.
method Systematically evaluates different post-processing strategies for ensemble weather forecasts and direct solar power forecasting.
result Post-processing significantly improves solar power generation forecasts, especially when applied to power predictions.
Graph-EFM models weather uncertainty with graph-based ensembles.
problem Accurately capturing forecast uncertainty in chaotic weather.
method Flexible latent-variable formulation with hierarchical graph construction.
result Graph-EFM ensembles achieve equivalent or lower errors than deterministic models.
We price weather-contingent options by use of Monte Carlo simulations. After calibrating the models to fit quoted prices, we analyze bid-ask spreads in terms of correlations across markets. Results are presented for a double-trigger Weather vs. Natural Gas call option.
We present the results of study of a possible relationship between the space weather and terrestrial markets of agricultural products. It is shown that to implement the possible effect of space weather on the terrestrial harvests and prices, a simultaneous fulfillment of three conditions is required: 1) sensitivity of …
AI boosts study of rare weather extremes with lower costs.
problem Difficulty in studying rare weather events due to limited data and models.
method Coupling AI forecasts with physics models using rare-event algorithms.
result Efficiently characterizes very rare events like once-per-millennium heatwaves.
Improved weather forecasting with gridded pseudo-token TNPs.
problem Handling large-scale, unstructured spatio-temporal data in weather forecasting.
method Introducing gridded pseudo-token transformer neural processes (TNPs) with efficient attention mechanisms.
result Consistently outperforms baselines on various synthetic and real-world regression tasks involving large-scale data.
This paper reviews radar-based nowcasting techniques for short-term weather predictions.
problem Short-term weather predictions for adverse events like heavy rain and flooding.
method Analysis of existing radar-based nowcasting techniques and machine learning approaches.
result New partnerships between environmental science and machine learning can improve nowcasting.
Graph-based weather prediction adapted for local models.
problem Applying neural weather prediction to limited area modeling.
method Adapting graph-based Neural Weather Prediction approach to local models.
result Validation of multi-scale hierarchical model extension for Nordic region.
Study uses SVM to predict weather-induced home insurance claims and losses.
problem Assessing future weather-induced home insurance claims and losses for disaster preparedness.
method Support Vector Machine (SVM) regression for forecasting future claim dynamics.
result Illustrates SVM approach in forecasting weather-induced home insurance claims in a Canadian city.
Deep learning model predicts European weather parameters.
problem Ensemble weather prediction using deep learning.
method Conditional deep convolutional generative adversarial network (GAN) and Monte-Carlo dropout.
result Forecast skill for geopotential height and two-meter temperature is good, but precipitation is challenging.
PeakWeather provides Swiss weather station data for machine learning.
problem Accurate weather forecasting for various activities and decision-making.
method High-quality dataset of surface weather observations from 8 years of Swiss stations.
result Dataset supports a wide range of spatiotemporal tasks.
Generative model emulates climate model for 100-year forecasts.
problem Challenges in accurately simulating long-term climate data.
method Integrates DYffusion with SFNO for stable, accurate climate simulations.
result Achieves near gold-standard performance for climate model emulation.
Rigorous uncertainty quantification of probabilistic AI weather forecasts with conformal prediction
problem Calibrated uncertainty quantification in probabilistic weather forecasts
method Conformal prediction
result Calibrated uncertainty at no expense to other probabilistic metrics
Improved weather forecasting using deep CNN on cubed-sphere grid.
problem Global weather prediction accuracy and speed.
method Deep convolutional neural network (CNN) on cubed-sphere grid, offline mapping, loss minimization.
result Significantly improved weather forecasts, indefinitely stable, realistic patterns at long lead times.