Weather balloons deploy sensors to collect stratospheric data.
problem Limited data collection in the stratosphere.
method Modeling forecast deviation as a Gaussian process to determine sensor release times; novel hardware system for optimal sensor release.
result Data engineering framework effectively collects stratospheric data through real flights and simulations.
Develops a computationally tractable differentially private mean estimator called the balloon mean.
problem Robust mean estimation in the presence of outliers and heavy-tailed distributions.
method Iterative clipping procedure over Mahalanobis balls.
result Balloon mean is robust to outliers and outperforms existing estimators in contaminated settings.
Balloons are two-dimensional spheres. Hoops are one dimensional loops. Knotted Balloons and Hoops (KBH) in 4-space behave much like the first and second homotopy groups of a topological space - hoops can be composed as in π_1, balloons as in π_2, and hoops "act" on balloons as π_1 acts on π_2. We observe that ordinary …
Given a linearly ordered set I, every surjective map p: A --> I endows the set A with a structure of set of preferences by "replacing" the elements of I with their inverse images via p considered as "balloons" (sets endowed with an equivalence relation), lifting the linear order on A, and "agglutinating" this structure…
Federated learning optimizes task and resource allocation in balloon networks.
problem Minimizing energy and time consumption in task computation and transmission.
method SVM-based federated learning algorithm to dynamically adjust user associations, service sequences, and task allocations.
result Reduces the weighted sum of energy and time consumption by up to 16.1%.
We generalize the theorems in {\it Mirror Principle I} and {\it II} to the case of general projective manifolds without the convexity assumption. We also apply the results to balloon manifolds, and generalize to higher genus.
New model for multi-armed bandits with growing arms.
problem Balancing exploration and exploitation in a growing set of arms.
method Introduces Ballooning Multi-Armed Bandits (BL-MAB) and analyzes existing algorithms.
result Achieves sub-linear regret under certain conditions.
PhysicsFormer improves TSF models for GSWF with WEATHER-5K dataset.
problem Lack of comprehensive datasets for GSWF.
method PhysicsFormer combines dynamic core and Transformer, enforcing physical consistency.
result PhysicsFormer outperforms TSF models in operational forecasting.
Enhances weather detection by learning from auxiliary information.
problem Mispredictions in unsupervised severe weather detection.
method Learning joint representations of textual and weather data.
result Improved decision boundaries for severe weather detection.
New methods quantify uncertainties in AI weather forecasts.
problem Uncertainty in AI weather predictions.
method Comparing ensemble and post-hoc uncertainty quantification methods.
result Probabilistic forecasts improve over ensemble physics-based models.
As renewable distributed energy resources (DERs) penetrate the power grid at an accelerating speed, it is essential for operators to have accurate solar photovoltaic (PV) energy forecasting for efficient operations and planning. Generally, observed weather data are applied in the solar PV generation forecasting model w…
The effects of weather on agriculture in recent years have become a major global concern. Hence, the need for an effective weather risk management tool (i.e., weather derivatives) that can hedge crop yields against weather uncertainties. However, most smallholder farmers and agricultural stakeholders are unwilling to p…
Signature kernel scoring rule improves weather forecasting by capturing temporal and spatial dependencies.
problem Lack of suitable scoring rules for probabilistic weather forecasting.
method Reframe weather variables as continuous paths using iterated integrals (signature kernels) to capture temporal and spatial dependencies.
result Signature kernel scoring rule outperforms conventional methods in weather forecasting, especially for long-term forecasts.
WeatherFormer learns robust weather features from small datasets.
problem Modeling complex weather dynamics from limited data.
method Pretrained transformer encoder on large satellite dataset, with spatiotemporal encoding.
result State-of-the-art performance in county-level soybean yield prediction and influenza forecasting.
This study analyzes how weather impacts bike sharing usage in Washington D.C.
problem Understanding how weather affects bike sharing usage patterns.
method Gathered bike usage and weather data, used k-means clustering algorithm to identify clusters.
result Weather significantly impacts bike usage, with temperature and precipitation being the most influential factors.
Nowadays, with the unprecedented penetration of renewable distributed energy resources (DERs), the necessity of an efficient energy forecasting model is more demanding than before. Generally, forecasting models are trained using observed weather data while the trained models are applied for energy forecasting using for…
This study tackles basis risk in weather parametric insurance using Monte Carlo simulations.
problem Mismatch between actual loss and payout in weather parametric insurance leads to loss without payout or payout without loss.
method Empirical research using Monte Carlo simulations to test diversification and hedging strategies.
result Portfolio basis risk and volatility decrease with more contracts, and spatial relationships significantly impact basis risk.
Study improves accuracy of weather data for real-time building simulations.
problem Anomalous and missing weather data affect real-time building energy simulations.
method Introduces a framework for quality control of measured weather data using anomaly detection and neural network infilling.
result Neural Networks enhance the accuracy of data imputation compared to traditional methods.
Modern weather forecast models perform uncertainty quantification using ensemble prediction systems, which collect nonparametric statistics based on multiple perturbed simulations. To provide accurate estimation, dozens of such computationally intensive simulations must be run. We show that deep neural networks can be …
Deep neural networks improve ensemble weather forecasts.
problem Improving accuracy and efficiency of ensemble weather forecasts.
method Mixed model combining subset of trajectories with deep neural networks for post-processing.
result Achieved over 14% relative improvement in ensemble forecast skill.
A framework assesses the quality of crowdsourced weather data.
problem Quality control and assessment of crowdsourced weather data from third-party stations.
method Proposes a simple, scalable, and interpretable AI/Stats/ML framework to assess TPAWS data.
result Demonstrates the performance of the framework using synthetic and real data.
Graph-EFM models weather uncertainty with graph-based ensembles.
problem Accurately capturing forecast uncertainty in chaotic weather.
method Flexible latent-variable formulation with hierarchical graph construction.
result Graph-EFM ensembles achieve equivalent or lower errors than deterministic models.
We price weather-contingent options by use of Monte Carlo simulations. After calibrating the models to fit quoted prices, we analyze bid-ask spreads in terms of correlations across markets. Results are presented for a double-trigger Weather vs. Natural Gas call option.
We present the results of study of a possible relationship between the space weather and terrestrial markets of agricultural products. It is shown that to implement the possible effect of space weather on the terrestrial harvests and prices, a simultaneous fulfillment of three conditions is required: 1) sensitivity of …
AI boosts study of rare weather extremes with lower costs.
problem Difficulty in studying rare weather events due to limited data and models.
method Coupling AI forecasts with physics models using rare-event algorithms.
result Efficiently characterizes very rare events like once-per-millennium heatwaves.
We introduce a balloon estimator in a generalized expectation-maximization method for estimating all parameters of a Gaussian mixture model given one data sample per mixture component. Instead of limiting explicitly the model size, this regularization strategy yields low-complexity sparse models where the number of eff…
Improved weather forecasting with gridded pseudo-token TNPs.
problem Handling large-scale, unstructured spatio-temporal data in weather forecasting.
method Introducing gridded pseudo-token transformer neural processes (TNPs) with efficient attention mechanisms.
result Consistently outperforms baselines on various synthetic and real-world regression tasks involving large-scale data.
Neural network predicts weather probabilities with added uncertainty.
problem Inferring uncertainty from weather predictions.
method Data-driven neural network trained on WeatherBench dataset, combining outputs from subsets of variables.
result More accurate than some numerical models, provides probabilistic information.
This paper reviews radar-based nowcasting techniques for short-term weather predictions.
problem Short-term weather predictions for adverse events like heavy rain and flooding.
method Analysis of existing radar-based nowcasting techniques and machine learning approaches.
result New partnerships between environmental science and machine learning can improve nowcasting.
Graph-based weather prediction adapted for local models.
problem Applying neural weather prediction to limited area modeling.
method Adapting graph-based Neural Weather Prediction approach to local models.
result Validation of multi-scale hierarchical model extension for Nordic region.
Study uses SVM to predict weather-induced home insurance claims and losses.
problem Assessing future weather-induced home insurance claims and losses for disaster preparedness.
method Support Vector Machine (SVM) regression for forecasting future claim dynamics.
result Illustrates SVM approach in forecasting weather-induced home insurance claims in a Canadian city.
Deep learning model predicts European weather parameters.
problem Ensemble weather prediction using deep learning.
method Conditional deep convolutional generative adversarial network (GAN) and Monte-Carlo dropout.
result Forecast skill for geopotential height and two-meter temperature is good, but precipitation is challenging.
PeakWeather provides Swiss weather station data for machine learning.
problem Accurate weather forecasting for various activities and decision-making.
method High-quality dataset of surface weather observations from 8 years of Swiss stations.
result Dataset supports a wide range of spatiotemporal tasks.
Paper proposes a method for weather-informed probabilistic forecasting and scenario generation in power systems.
problem Challenges of integrating renewable energy sources into power grids due to their stochasticity and uncertainty.
method Combines probabilistic forecasting and Gaussian copula for day-ahead prediction and scenario generation of load, wind, and solar power.
result Demonstrates superior performance of the proposed weather-informed Temporal Fusion Transformer (WI-TFT) model.
Rigorous uncertainty quantification of probabilistic AI weather forecasts with conformal prediction
problem Calibrated uncertainty quantification in probabilistic weather forecasts
method Conformal prediction
result Calibrated uncertainty at no expense to other probabilistic metrics
Improved weather forecasting using deep CNN on cubed-sphere grid.
problem Global weather prediction accuracy and speed.
method Deep convolutional neural network (CNN) on cubed-sphere grid, offline mapping, loss minimization.
result Significantly improved weather forecasts, indefinitely stable, realistic patterns at long lead times.
The paper presents a machine learning framework to combine weather forecasts from multiple models.
problem Combining forecasts from different NWP models with varying biases and limitations.
method Three-stage framework using Quantile Regression Forests and quantile averaging.
result The framework generates well-calibrated probabilistic weather forecasts suitable for decision support.
Even though end-to-end supervised learning has shown promising results for sensorimotor control of self-driving cars, its performance is greatly affected by the weather conditions under which it was trained, showing poor generalization to unseen conditions. In this paper, we show how knowledge can be transferred using …
WeatherBench provides a dataset and metrics for comparing data-driven weather forecasts.
problem Lack of a common dataset and evaluation metrics for data-driven weather forecasting.
method Publicly available dataset derived from ERA5, simple evaluation metrics.
result Baseline scores from various forecasting methods provided for comparison.
DAUM networks improve weather forecasting with attention and multistream features.
problem Improving weather forecasting accuracy using deep learning.
method Proposes DAUM networks combining tensorial unistream and multistream representations with attention mechanisms.
result Adding self-attention blocks enhances forecasting performance.
Photovoltaic systems have been widely deployed in recent times to meet the increased electricity demand as an environmental-friendly energy source. The major challenge for integrating photovoltaic systems in power systems is the unpredictability of the solar power generated. In this paper, we analyze the impact of havi…
Weather forecasting is usually solved through numerical weather prediction (NWP), which can sometimes lead to unsatisfactory performance due to inappropriate setting of the initial states. In this paper, we design a data-driven method augmented by an effective information fusion mechanism to learn from historical data …
The paper prices weather contracts using a complex temperature model.
problem Accurate pricing of weather contracts under temperature dynamics.
method Time-changed Levy model with mean-reverting dynamics, Fourier expansion, Esscher transform.
result An accurate approximation of weather contract prices.
This study improves weather forecasting accuracy with spatiotemporal models.
problem Complexity and resource-intensive nature of weather forecasting.
method Spatiotemporal forecasting models integrating machine learning and deep neural networks.
result Spatiotemporal models reduce computational costs and improve accuracy.
Model forecasts hourly electricity demand influenced by weather, socio-economic, and political factors.
problem Accurate hourly electricity demand forecasting in the face of multifaceted uncertainties.
method Interpretable probabilistic mid-term forecasting model using Generalized Additive Models (GAMs).
result Highlights vulnerability of countries to extreme weather scenarios under electric heating adoption.
One key requirement for effective supply chain management is the quality of its inventory management. Various inventory management methods are typically employed for different types of products based on their demand patterns, product attributes, and supply network. In this paper, our goal is to develop robust demand pr…
We provide a model to understand how adverse weather conditions modify traffic flow dynamic. We first prove that the microscopic Free Flow Speed of the vehicles is changed and then provide a rule to model this change. For this, we consider a thresholded linear model, corresponding to an application of a MARS model to r…
mvlearn simplifies multiview machine learning for non-specialists.
problem Handling multiview data sets from disparate sources.
method Python library implementing multiview machine learning methods.
result Enables non-specialists to use multiview machine learning methods easily.