AI boosts study of rare weather extremes with lower costs.
problem Difficulty in studying rare weather events due to limited data and models.
method Coupling AI forecasts with physics models using rare-event algorithms.
result Efficiently characterizes very rare events like once-per-millennium heatwaves.
PhysicsFormer improves TSF models for GSWF with WEATHER-5K dataset.
problem Lack of comprehensive datasets for GSWF.
method PhysicsFormer combines dynamic core and Transformer, enforcing physical consistency.
result PhysicsFormer outperforms TSF models in operational forecasting.
One key requirement for effective supply chain management is the quality of its inventory management. Various inventory management methods are typically employed for different types of products based on their demand patterns, product attributes, and supply network. In this paper, our goal is to develop robust demand pr…
Modeling solar ramping events with spatio-temporal point processes.
problem Predicting solar ramping events influenced by weather conditions.
method Novel spatio-temporal categorical point process model.
result Effective modeling of spatio-temporal correlations in solar ramping events.
Then detection and identification of extreme weather events in large-scale climate simulations is an important problem for risk management, informing governmental policy decisions and advancing our basic understanding of the climate system. Recent work has shown that fully supervised convolutional neural networks (CNNs…
Deep neural networks improve ensemble weather forecasts.
problem Improving accuracy and efficiency of ensemble weather forecasts.
method Mixed model combining subset of trajectories with deep neural networks for post-processing.
result Achieved over 14% relative improvement in ensemble forecast skill.
This paper reviews radar-based nowcasting techniques for short-term weather predictions.
problem Short-term weather predictions for adverse events like heavy rain and flooding.
method Analysis of existing radar-based nowcasting techniques and machine learning approaches.
result New partnerships between environmental science and machine learning can improve nowcasting.
Modern weather forecast models perform uncertainty quantification using ensemble prediction systems, which collect nonparametric statistics based on multiple perturbed simulations. To provide accurate estimation, dozens of such computationally intensive simulations must be run. We show that deep neural networks can be …
Machine learning predicts Atlantic blocking using limited data.
problem Underestimation of blocking event duration in climate models.
method Transfer Learning and Explainable AI (SHAP analysis)
result High-pressure anomalies in specific regions contribute to blocking events.
NDI aims to forecast future natural disasters risk for insurers.
problem Increasing intensity and frequency of natural disasters.
method Develops a Natural Disasters Index (NDI) based on NOAA data.
result NDI forecasts future natural disasters risk for insurers.
This study tackles basis risk in weather parametric insurance using Monte Carlo simulations.
problem Mismatch between actual loss and payout in weather parametric insurance leads to loss without payout or payout without loss.
method Empirical research using Monte Carlo simulations to test diversification and hedging strategies.
result Portfolio basis risk and volatility decrease with more contracts, and spatial relationships significantly impact basis risk.
Paper models spatio-temporal extremes using conditional variational autoencoders.
problem Modeling co-occurrence of extreme weather events under changing climate conditions.
method Conditional Variational Autoencoder (cXVAE) with CNN integration.
result Accurately emulates spatial fields and recovers extremal dependence with low computational cost.
Develops a new stochastic volatility model for temperature derivatives.
problem Assessing risk related to temperature volatility.
method Conditional Least Squares and Fourier transform techniques.
result Better assessment of temperature volatility risk.
Rigorous uncertainty quantification of probabilistic AI weather forecasts with conformal prediction
problem Calibrated uncertainty quantification in probabilistic weather forecasts
method Conformal prediction
result Calibrated uncertainty at no expense to other probabilistic metrics
PeakWeather provides Swiss weather station data for machine learning.
problem Accurate weather forecasting for various activities and decision-making.
method High-quality dataset of surface weather observations from 8 years of Swiss stations.
result Dataset supports a wide range of spatiotemporal tasks.
Graph conformal prediction predicts future power outages with high confidence.
problem Accurately predicting future power outages to enable rapid recovery.
method Developed a graph conformal prediction method for quarter-hourly outage data.
result Graph conformal prediction method delivers accurate prediction regions for future outage numbers.
Paper improves predictive distributions for rare events using a simple framework.
problem Local miscalibration of predictive distributions for rare events.
method Semiparametric diagnostic transport maps to correct tail probabilities.
result Semiparametric maps improve predictions for severe weather hazards.
We present the results of study of a possible relationship between the space weather and terrestrial markets of agricultural products. It is shown that to implement the possible effect of space weather on the terrestrial harvests and prices, a simultaneous fulfillment of three conditions is required: 1) sensitivity of …
FCNv2 robustness tested under noise and random initial conditions.
problem Assessing AI weather forecasting model robustness to input noise.
method Two experiments with varying noise levels and random initial conditions.
result FCNv2 preserves hurricane features under low to moderate noise, but underestimates intensity and persistence.
PBC improves AI and dynamical subseasonal forecasts by reducing biases.
problem Subseasonal forecast accuracy drops due to model biases and compounding errors.
method Probabilistic bias correction (PBC) using machine learning to correct historical forecasts.
result PBC doubles AI Forecasting System's subseasonal skill and improves dynamical model skill.
PARIS reduces imbalanced regression datasets by pruning uninformative samples.
problem Imbalanced regression where models focus on high-frequency regions, ignoring rare but impactful events.
method PARIS uses the representer theorem to compute a closed-form representer deletion residual for iterative pruning of the training set.
result PARIS reduces training set by up to 75% while preserving or improving overall performance, outperforming other methods.
Study on price fluctuations and persistence in European electricity spot markets.
problem Analyzing variability and persistence of electricity prices in European spot markets.
method Analysis of hourly, intraday, and 15-min intraday market prices; quantification of fluctuations, correlations, and extreme events; classification into circulation weather types.
result Different time scales in market dynamics; multifractal behavior below 12 hours; anti-correlation and mean reversion above 12 hours; long-term behavior influenced by four-day weather patterns; q-Gaussian distributions as best fit. Graph Attention Networks predict power outage durations from natural disasters.
problem Accurately predicting power outage durations from geospatial and weather data.
method Graph Attention Networks (GAT) for semi-supervised learning.
result GAT model outperforms existing methods by 2% - 15% in accuracy.
Paper examines adversarial attacks on weather forecasting models, focusing on TC trajectory prediction.
problem Adversarial attacks can mislead downstream TC trajectory predictions in DLWF models.
method Proposes Cyc-Attack, a method using a surrogate model and skewness-aware loss function to generate adversarial TC paths.
result Cyc-Attack achieves higher true positive rates and lower false alarm rates compared to conventional methods.
Proposes a dynamic model for urban traffic volume prediction.
problem Urban traffic volume prediction for better traffic management and driver planning.
method Combines bidirectional LSTM, attention mechanism, and external features.
result Improves prediction precision by 3-7 percent on NYC-Taxi and NYC-Bike datasets.
New diffusion models capture heavy-tailed distributions better.
problem Diffusion models struggle with rare or extreme events in heavy-tailed distributions.
method Repurposed diffusion framework using multivariate Student-t distributions, tailored perturbation kernel, and γ-divergence. result Our models generate rare and extreme events more effectively than standard diffusion models.
Predicting when and where events will occur in cities, like taxi pick-ups, crimes, and vehicle collisions, is a challenging and important problem with many applications in fields such as urban planning, transportation optimization and location-based marketing. Though many point processes have been proposed to model eve…
Framework for Granger causality in extreme events.
problem Identifying causal links from extreme events in time series.
method Causal tail coefficient and novel inference method.
result Framework outperforms state-of-the-art methods in detecting Granger causality in extremes.
Stochastic model prices weather derivatives for Indian states, highlighting temperature volatility impacts.
problem Quantifying financial risk in Indian markets due to seasonal weather variations.
method Modified Ornstein-Uhlenbeck process with jumps for temperature dynamics, calibrated with historical data, Monte Carlo simulations for pricing.
result Volatility significantly impacts weather derivative pricing, with higher prices in colder states and lower in hotter states.
Enhances weather detection by learning from auxiliary information.
problem Mispredictions in unsupervised severe weather detection.
method Learning joint representations of textual and weather data.
result Improved decision boundaries for severe weather detection.
New methods quantify uncertainties in AI weather forecasts.
problem Uncertainty in AI weather predictions.
method Comparing ensemble and post-hoc uncertainty quantification methods.
result Probabilistic forecasts improve over ensemble physics-based models.
New method improves local precipitation predictions using video diffusion.
problem Limited high-resolution local precipitation predictions due to computational costs.
method Extends video diffusion models to capture conditional distribution of high-resolution patterns.
result Method outperforms state-of-the-art baselines in CRPS, MSE, and precipitation distribution.
Predict human lives using sequences of life events.
problem Predicting human life outcomes based on detailed event sequences.
method Adapting natural language processing techniques to analyze life events.
result Models predict diverse outcomes with high accuracy, outperforming state-of-the-art models.
As renewable distributed energy resources (DERs) penetrate the power grid at an accelerating speed, it is essential for operators to have accurate solar photovoltaic (PV) energy forecasting for efficient operations and planning. Generally, observed weather data are applied in the solar PV generation forecasting model w…
TRAKNN detects rare atmospheric trajectories efficiently.
problem Detecting rare atmospheric anomalies over long periods.
method Unsupervised, recurrence-based kNN algorithm.
result Rare trajectories correspond to physical anomalies.
We present a novel algorithm that predicts the probability that the time derivative of the horizontal component of the ground magnetic field dB/dt exceeds a specified threshold at a given location. This quantity provides important information that is physically relevant to Geomagnetically Induced Currents (GIC), whic…
The effects of weather on agriculture in recent years have become a major global concern. Hence, the need for an effective weather risk management tool (i.e., weather derivatives) that can hedge crop yields against weather uncertainties. However, most smallholder farmers and agricultural stakeholders are unwilling to p…
Parity calibration aims to predict increase-decrease events, not values.
problem Forecasting future increase-decrease events rather than exact values.
method Online binary calibration method to achieve parity calibration.
result Online binary calibration achieves parity calibration effectively.
Signature kernel scoring rule improves weather forecasting by capturing temporal and spatial dependencies.
problem Lack of suitable scoring rules for probabilistic weather forecasting.
method Reframe weather variables as continuous paths using iterated integrals (signature kernels) to capture temporal and spatial dependencies.
result Signature kernel scoring rule outperforms conventional methods in weather forecasting, especially for long-term forecasts.
WeatherFormer learns robust weather features from small datasets.
problem Modeling complex weather dynamics from limited data.
method Pretrained transformer encoder on large satellite dataset, with spatiotemporal encoding.
result State-of-the-art performance in county-level soybean yield prediction and influenza forecasting.
The ability to analyze and forecast stratospheric weather conditions is fundamental to addressing climate change. However, our capacity to collect data in the stratosphere is limited by sparsely deployed weather balloons. We propose a framework to collect stratospheric data by releasing a contrail of tiny sensor device…
This study analyzes how weather impacts bike sharing usage in Washington D.C.
problem Understanding how weather affects bike sharing usage patterns.
method Gathered bike usage and weather data, used k-means clustering algorithm to identify clusters.
result Weather significantly impacts bike usage, with temperature and precipitation being the most influential factors.
PredictionMarketBench benchmarks trading agents on prediction markets.
problem Evaluating trading agents on prediction markets with realistic conditions.
method Deterministic replay of historical data, execution-realistic simulator, agent interface.
result Fee-aware algorithmic strategies outperform naive agents in volatile episodes.
Nowadays, with the unprecedented penetration of renewable distributed energy resources (DERs), the necessity of an efficient energy forecasting model is more demanding than before. Generally, forecasting models are trained using observed weather data while the trained models are applied for energy forecasting using for…
Study improves crash rate forecasting in Washington, D.C. using stochastic volatility model.
problem Forecasting crash rates in areas with irregular traffic patterns and exogenous events.
method Adopted a stochastic volatility model to capture heterogeneity and temporal instability.
result The stochastic volatility model outperforms conventional models in forecasting crash rates in Washington, D.C.
Study improves accuracy of weather data for real-time building simulations.
problem Anomalous and missing weather data affect real-time building energy simulations.
method Introduces a framework for quality control of measured weather data using anomaly detection and neural network infilling.
result Neural Networks enhance the accuracy of data imputation compared to traditional methods.
Paper compares two forecasters using novel online inference methods.
problem How to compare forecasters without distributional assumptions.
method Confidence sequences and game-theoretic statistical framework for sequential testing.
result Valid methods for comparing forecasters without distributional assumptions.
A framework assesses the quality of crowdsourced weather data.
problem Quality control and assessment of crowdsourced weather data from third-party stations.
method Proposes a simple, scalable, and interpretable AI/Stats/ML framework to assess TPAWS data.
result Demonstrates the performance of the framework using synthetic and real data.