Data scientists guide to streamflow prediction and flood forecasting.
problem Forecasting floods and predicting streamflow volume.
method Explains hydrologic concepts and machine learning applications.
result Helps data scientists understand streamflow prediction.
Paper presents a GAN model for realistic river image synthesis.
problem Generating high-quality river images for hydrological research.
method Used a Progressive Growing GAN (PGGAN) architecture to overcome training challenges.
result Demonstrated the effectiveness of GANs in generating high-resolution river images.
HydroNets use river structure to improve hydrologic predictions.
problem Scalable and accurate hydrologic models are needed for climate change impacts.
method HydroNets are deep neural networks that incorporate river network structure.
result HydroNets improve predictions with fewer data, especially at longer horizons.
Regional rainfall-runoff modeling is an old but still mostly out-standing problem in Hydrological Sciences. The problem currently is that traditional hydrological models degrade significantly in performance when calibrated for multiple basins together instead of for a single basin alone. In this paper, we propose a nov…
Proposes a probabilistic model to improve hydrology predictions and trust.
problem Noisy or missing basin characteristics impact streamflow prediction.
method Probabilistic inverse modeling framework to reconstruct basin characteristics.
result 6% improvement in R2 for streamflow prediction, 17% reduction in uncertainty. Deep learning enhances water resources management through data analysis.
problem Data volume and variety in water resources management.
method Systematic review of deep learning applications in hydrology and water resources.
result Deep learning improves water resources monitoring, prediction, and classification.
Despite the huge success of Long Short-Term Memory networks, their applications in environmental sciences are scarce. We argue that one reason is the difficulty to interpret the internals of trained networks. In this study, we look at the application of LSTMs for rainfall-runoff forecasting, one of the central tasks in…
New model uses less site-specific data for accurate hydrologic predictions.
problem Accurate rainfall-runoff modeling in data-poor regions.
method Data-driven learned embedding to replace location-specific attributes.
result Achieves state-of-the-art results with significantly less information.
PIML model improves hydrological predictions by blending physics and ML.
problem Hydrological models either lack predictive accuracy or fail to maintain physical consistency.
method Physics Informed Machine Learning (PIML) that integrates physics-based models and ML algorithms.
result PIML model outperforms both physics-based and ML models in predicting streamflow and evapotranspiration.
New method clusters hydrological and sediment data for storm event analysis.
problem Analyzing storm events for water quality constituents like turbidity.
method Multivariate time series clustering of river discharge and sediment data.
result Clusters differ from 2-D hysteresis loop classifications.
Transformer-based diffusion models improve hydrological time series imputation and forecasting.
problem Limited observations in hydrometeorological time series.
method Transformer-based diffusion models applied to hydrological data.
result Transformer-based models efficiently sample realistic time series distributions under variable missing data.
DL models can outperform regionalized models in hydrology by pooling diverse data.
problem Traditional wisdom in hydrology suggests regionalization improves model performance, but DL models can unify data for better performance.
method Used DL models on pooled data from different regions, showing improved performance compared to regionalized models.
result DL models can improve performance by pooling diverse data, highlighting the 'data synergy' effect.
LSTM model predicts climate impacts on floods and droughts.
problem Predicting climate impacts on individual watersheds is challenging.
method Large-scale LSTM training on extensive data sets.
result LSTM model outperforms state-of-the-art models in predicting extreme flows.
Researchers use Gaussian processes with non-stationary kernels to model precipitation patterns in the Upper Indus Basin.
problem Uncertainty in precipitation patterns in the Upper Indus Basin, Himalayas.
method Proposes Gaussian processes with structured non-stationary kernels to model precipitation patterns, accounting for spatial variation with a latent Gaussian process.
result The proposed model adapts to varying precipitation patterns across distinct topography and outperforms stationary models in ablation experiments.
New method combines simple forecasting techniques for river flow predictions.
problem Improving accuracy of long-term hydrological forecasts.
method Combines at least two forecasting methods using median combiner.
result Performs well in long-term forecasts, especially with multiple methods.
MC-LSTM extends LSTM to conserve mass in neural networks.
problem Conservation laws in real-world systems.
method Extending LSTM's inductive bias to conserve mass.
result MC-LSTM sets new state-of-the-art for predicting peak flows.
Data science models, although successful in a number of commercial domains, have had limited applicability in scientific problems involving complex physical phenomena. Theory-guided data science (TGDS) is an emerging paradigm that aims to leverage the wealth of scientific knowledge for improving the effectiveness of da…
Dataset for rainfall modeling in central Europe from 1981-2011.
problem Improving rainfall streamflow modeling beyond simple catchments.
method Spatially resolved meteorological and ancillary data compilation.
result Dataset for neural network-driven hydrological modeling.
Deep learning (DL), a new-generation of artificial neural network research, has transformed industries, daily lives and various scientific disciplines in recent years. DL represents significant progress in the ability of neural networks to automatically engineer problem-relevant features and capture highly complex data…
Enhanced time series forecasting with improved trend and seasonal components.
problem Challenges in real-world time series forecasting, especially in multivariate applications.
method Individual decomposition of trend and seasonal components, using different approaches for each.
result Significant reduction in error values, around 10% MSE average reduction across benchmarks.
Evaporation is one of the main processes in the hydrological cycle, and it is one of the most critical factors in agricultural, hydrological, and meteorological studies. Due to the interactions of multiple climatic factors, the evaporation is a complex and nonlinear phenomenon; therefore, the data-based methods can be …
Global hydrological and land surface models are increasingly used for tracking terrestrial total water storage (TWS) dynamics, but the utility of existing models is hampered by conceptual and/or data uncertainties related to various underrepresented and unrepresented processes, such as groundwater storage. The gravity …
Predicting flood for any location at times of extreme storms is a longstanding problem that has utmost importance in emergency management. Conventional methods that aim to predict water levels in streams use advanced hydrological models still lack of giving accurate forecasts everywhere. This study aims to explore arti…
A new method estimates time-varying parameters in earth system models using offline and online data assimilation.
problem Estimating time-varying parameters in complex earth system models.
method Hybrid Offline Online Parameter Estimation with Particle Filtering (HOOPE-PF)
result HOOPE-PF outperforms existing methods, especially with small ensemble sizes.
LSTM models with DI enhance streamflow forecasts across diverse regions.
problem Challenges in integrating varied discharge measurements for accurate streamflow forecasts.
method Flexible data integration (DI) using LSTM models with CNN units for lagged inputs.
result DI significantly improved streamflow forecast performance, reaching record efficiency coefficients.
Water balance models (WBMs) are often employed to understand regional hydrologic cycles over various time scales. Most WBMs, however, are physically-based, and few employ state-of-the-art statistical methods to reconcile independent input measurement uncertainty and bias. Further, few WBMs exist for large lakes, and mo…
Exploiting capacity of sewer system using decentralized control is a cost effective mean of minimizing the overflow. Given the size of the real sewer system, exploiting all the installed control structures in the sewer pipes can be challenging. This paper presents a divide and conquer solution to implement decentralize…
Climate extreme events are constantly increasing. What is the effect of these potentially catastrophic events on insurance demand in Italy, with particular reference to the economic activities? Extreme precipitation events over most of the midlatitude land masses and over wet tropical regions will very likely become mo…
The Soil Moisture Active Passive (SMAP) mission has delivered valuable sensing of surface soil moisture since 2015. However, it has a short time span and irregular revisit schedule. Utilizing a state-of-the-art time-series deep learning neural network, Long Short-Term Memory (LSTM), we created a system that predicts SM…
Combined Sewer Overflow (CSO) is a major problem to be addressed by many cities. Understanding the behavior of sewer system through proper urban hydrological models is an effective method of enhancing sewer system management. Conventional deterministic methods, which heavily rely on physical principles, is inappropriat…
Study identifies new stable climate states in climate model.
problem Understanding multistability and transitions in climate models.
method Combination of quasipotential theory and manifold learning.
result Discovery of a third stable climate state not previously known.
The development of global sensitivity analysis of numerical model outputs has recently raised new issues on 1-dimensional Poincaré inequalities. Typically two kind of sensitivity indices are linked by a Poincaré type inequality, which provide upper bounds of the most interpretable index by using the other one, cheaper …
Optimizes sampling for faster convergence in Bayesian experimental design and uncertainty quantification.
problem Efficiently selecting samples for faster convergence in Bayesian experimental design and uncertainty quantification.
method Output-weighted acquisition functions leveraging likelihood ratio to guide sampling towards relevant regions.
result Superiority of the proposed method in uncertainty quantification and rare event identification.
Learning hydrologic models for accurate riverine flood prediction at scale is a challenge of great importance. One of the key difficulties is the need to rely on in-situ river discharge measurements, which can be quite scarce and unreliable, particularly in regions where floods cause the most damage every year. Accordi…
fSDE-Net generates time series with long-term memory using neural networks.
problem Generating time series with long-term memory from irregularly sampled data.
method fSDE-Net: neural fractional Stochastic Differential Equation Network using fractional Brownian motion.
result fSDE-Net can replicate distributional properties of real time-series data.
Study improves precipitation predictions for High Mountain Asia using machine learning.
problem Uncertainty in future precipitation over High Mountain Asia due to regional climate model biases.
method Probabilistic machine learning framework combining 13 regional climate models via a mixture of experts.
result 32% improvement over equally-weighted average and 254% improvement over single ensemble member.
CauSTream forecasts streamflow by integrating causal graphs for better interpretability.
problem Streamflow forecasting lacks interpretability and generalization due to fixed causal models.
method CauSTream learns causal graphs for meteorological forcings and routing dependencies.
result CauSTream outperforms existing methods, especially at longer forecast windows.
Bayesian framework selects features and lags for time series forecasting.
problem Variable selection and lagged error term identification in time series models.
method Hierarchical Bayesian models with spike-and-slab priors, two-stage MCMC algorithm.
result Posterior selection consistency under mild conditions, improved predictive performance.
New framework uses time series features for predicting streamflow in ungauged areas.
problem Predicting streamflow in areas without gauging stations.
method Developed regression-based streamflow regionalization using a wide range of time series features from large datasets.
result Certain time series features, like entropy and autocorrelation, are better predictors of streamflow than traditional catchment attributes.
INDEQS: A Graph-Based Neural Controlled Differential Equation Framework for Forecasting
problem Forecasting time series with neural networks
method Incorporating prior knowledge of a directed graph
result Outer informedness consistently improves forecasting accuracy
In this paper, we consider the use of structure learning methods for probabilistic graphical models to identify statistical dependencies in high-dimensional physical processes. Such processes are often synthetically characterized using PDEs (partial differential equations) and are observed in a variety of natural pheno…
New findings challenge the importance of forecast accuracy in battery storage optimization, highlighting the role of rank correlation instead.
problem The challenge of optimizing battery storage dispatch decisions in multi-market electricity trading using forecast accuracy metrics.
method A hierarchical three-layer optimization system trading in multiple markets (FCR, aFRR, day-ahead, intraday) with real market data.
result Rank correlation (Kendall tau) is a better predictor of intraday dispatch value than forecast accuracy (MAE), with a threshold of tau around 0.85-0.95 capturing up to 97-100% of perfect-foresight revenue.
Deep learning improves probabilistic river discharge forecasting for hydroelectric power.
problem Uncertain river discharges due to climate variability.
method Modified recurrent neural network architecture conditioned on global circulation model projections.
result Generates parameterized probability distributions for realistic long-term discharge scenarios.
LSTM model predicts rainfall runoff with high temporal resolution.
problem Accurate and efficient rainfall runoff simulations for flood risk management.
method Data-driven rainfall runoff model using Long-short-Term-Memory (LSTM) networks.
result LSTM model achieves high-resolution discharge predictions with improved performance.
ML models predict water table depth more accurately than PB models, especially in data-scarce regions.
problem Uncertainty in large-scale simulations of water table depth due to biased observational data and model flexibility.
method Constructed three ML models using XGBoost and over 20 million real and proxy observations across the US and Canada.
result ML models correlate 0.6-0.75 with real and proxy observations, significantly better than PB models (0.21-0.40).
Machine learning predicts dam-break flood wave behavior accurately.
problem Predicting long-term wave behavior in dam-break floods.
method Solved Saint-Venant equations using Lax-Wendroff scheme, trained RC-ESN with flow depth data.
result RC-ESN model predicts 286 time-steps ahead with RMSE < 0.01, outperforming LSTM.
Paper proposes a method to monitor research topic evolution.
problem Difficulty in tracking research topic diffusion and evolution.
method Deep Non-negative Autoencoder with information divergence measurement.
result Identifies evolution of research topics and discovers topic diffusions.
The abstract warns against flawed empirical research in machine learning.
problem Flawed empirical research in machine learning leading to unreliable results.
method Call for more awareness of experimental knowledge plurality and epistemic limitations.
result Current empirical machine learning research should be exploratory, not confirmatory.