Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

148296443591 · Jun 202019922001200920172026
48 results for weather datasets

WeatherFormer learns robust weather features from small datasets.

problem Modeling complex weather dynamics from limited data.
method Pretrained transformer encoder on large satellite dataset, with spatiotemporal encoding.
result State-of-the-art performance in county-level soybean yield prediction and influenza forecasting.

PeakWeather provides Swiss weather station data for machine learning.

problem Accurate weather forecasting for various activities and decision-making.
method High-quality dataset of surface weather observations from 8 years of Swiss stations.
result Dataset supports a wide range of spatiotemporal tasks.

Data-driven approaches, most prominently deep learning, have become powerful tools for prediction in many domains. A natural question to ask is whether data-driven methods could also be used to predict global weather patterns days in advance. First studies show promise but the lack of a common dataset and evaluation me…

2020-02-02abs ↗pdf ↗

Improved weather forecasting with gridded pseudo-token TNPs.

problem Handling large-scale, unstructured spatio-temporal data in weather forecasting.
method Introducing gridded pseudo-token transformer neural processes (TNPs) with efficient attention mechanisms.
result Consistently outperforms baselines on various synthetic and real-world regression tasks involving large-scale data.

ClimART dataset benchmarks ML emulators for atmospheric RT in climate models.

problem Lack of a comprehensive dataset and standardized practices for ML benchmarking in climate models.
method Builds ClimART, a large dataset with over 10 million samples, and presents novel baselines.
result Indicates shortcomings of prior datasets and network architectures.

SubseasonalClimateUSA dataset improves subseasonal weather forecasting.

problem Challenges in subseasonal weather forecasting, especially skill of physics-based models and integration of local and global variables.
method Curated dataset for training and benchmarking subseasonal forecasting models, including various methods.
result Benchmarking suggests simple and effective ways to improve current operational models.

Paper proposes a method for weather-informed probabilistic forecasting and scenario generation in power systems.

problem Challenges of integrating renewable energy sources into power grids due to their stochasticity and uncertainty.
method Combines probabilistic forecasting and Gaussian copula for day-ahead prediction and scenario generation of load, wind, and solar power.
result Demonstrates superior performance of the proposed weather-informed Temporal Fusion Transformer (WI-TFT) model.

Developed deep learning models to predict crop yields across diverse environments.

problem Precise crop yield prediction for improved agricultural practices and climate resilience.
method Integrated weather data, used CNN-DNN and CNN-LSTM-DNN models, applied GEM method.
result Achieved superior performance in crop yield prediction with reduced RMSE and MAE.

Neural network predicts weather probabilities with added uncertainty.

problem Inferring uncertainty from weather predictions.
method Data-driven neural network trained on WeatherBench dataset, combining outputs from subsets of variables.
result More accurate than some numerical models, provides probabilistic information.

FCNv2 robustness tested under noise and random initial conditions.

problem Assessing AI weather forecasting model robustness to input noise.
method Two experiments with varying noise levels and random initial conditions.
result FCNv2 preserves hurricane features under low to moderate noise, but underestimates intensity and persistence.

As renewable distributed energy resources (DERs) penetrate the power grid at an accelerating speed, it is essential for operators to have accurate solar photovoltaic (PV) energy forecasting for efficient operations and planning. Generally, observed weather data are applied in the solar PV generation forecasting model w…

2017-09-24abs ↗pdf ↗

Signature kernel scoring rule improves weather forecasting by capturing temporal and spatial dependencies.

problem Lack of suitable scoring rules for probabilistic weather forecasting.
method Reframe weather variables as continuous paths using iterated integrals (signature kernels) to capture temporal and spatial dependencies.
result Signature kernel scoring rule outperforms conventional methods in weather forecasting, especially for long-term forecasts.

This paper presents the recently published Cerema AWP (Adverse Weather Pedestrian) dataset for various machine learning tasks and its exports in machine learning friendly format. We explain why this dataset can be interesting (mainly because it is a greatly controlled and fully annotated image dataset) and present base…

2018-06-11abs ↗pdf ↗

This study analyzes how weather impacts bike sharing usage in Washington D.C.

problem Understanding how weather affects bike sharing usage patterns.
method Gathered bike usage and weather data, used k-means clustering algorithm to identify clusters.
result Weather significantly impacts bike usage, with temperature and precipitation being the most influential factors.

This study tackles basis risk in weather parametric insurance using Monte Carlo simulations.

problem Mismatch between actual loss and payout in weather parametric insurance leads to loss without payout or payout without loss.
method Empirical research using Monte Carlo simulations to test diversification and hedging strategies.
result Portfolio basis risk and volatility decrease with more contracts, and spatial relationships significantly impact basis risk.

Study improves accuracy of weather data for real-time building simulations.

problem Anomalous and missing weather data affect real-time building energy simulations.
method Introduces a framework for quality control of measured weather data using anomaly detection and neural network infilling.
result Neural Networks enhance the accuracy of data imputation compared to traditional methods.

Modern weather forecast models perform uncertainty quantification using ensemble prediction systems, which collect nonparametric statistics based on multiple perturbed simulations. To provide accurate estimation, dozens of such computationally intensive simulations must be run. We show that deep neural networks can be …

2019-11-02abs ↗pdf ↗

A framework assesses the quality of crowdsourced weather data.

problem Quality control and assessment of crowdsourced weather data from third-party stations.
method Proposes a simple, scalable, and interpretable AI/Stats/ML framework to assess TPAWS data.
result Demonstrates the performance of the framework using synthetic and real data.

Study evaluates post-processing methods for improving solar power forecasts.

problem Improving accuracy of probabilistic solar energy forecasts through model chain approaches.
method Systematically evaluates different post-processing strategies for ensemble weather forecasts and direct solar power forecasting.
result Post-processing significantly improves solar power generation forecasts, especially when applied to power predictions.

This paper reviews radar-based nowcasting techniques for short-term weather predictions.

problem Short-term weather predictions for adverse events like heavy rain and flooding.
method Analysis of existing radar-based nowcasting techniques and machine learning approaches.
result New partnerships between environmental science and machine learning can improve nowcasting.

Study uses SVM to predict weather-induced home insurance claims and losses.

problem Assessing future weather-induced home insurance claims and losses for disaster preparedness.
method Support Vector Machine (SVM) regression for forecasting future claim dynamics.
result Illustrates SVM approach in forecasting weather-induced home insurance claims in a Canadian city.

Deep learning model predicts European weather parameters.

problem Ensemble weather prediction using deep learning.
method Conditional deep convolutional generative adversarial network (GAN) and Monte-Carlo dropout.
result Forecast skill for geopotential height and two-meter temperature is good, but precipitation is challenging.

Unified framework for generating meteorological time series from text.

problem Lack of large-scale, physically grounded multimodal datasets and architectures ignoring spectral-temporal structure.
method Introduce MeteoCap-3B dataset and MTransformer model.
result State-of-the-art generation quality, accurate cross-modal alignment, strong semantic controllability.

Rigorous uncertainty quantification of probabilistic AI weather forecasts with conformal prediction

problem Calibrated uncertainty quantification in probabilistic weather forecasts
method Conformal prediction
result Calibrated uncertainty at no expense to other probabilistic metrics

Improved weather forecasting using deep CNN on cubed-sphere grid.

problem Global weather prediction accuracy and speed.
method Deep convolutional neural network (CNN) on cubed-sphere grid, offline mapping, loss minimization.
result Significantly improved weather forecasts, indefinitely stable, realistic patterns at long lead times.

The paper presents a machine learning framework to combine weather forecasts from multiple models.

problem Combining forecasts from different NWP models with varying biases and limitations.
method Three-stage framework using Quantile Regression Forests and quantile averaging.
result The framework generates well-calibrated probabilistic weather forecasts suitable for decision support.