A new deep learning framework captures multi-scale spatio-temporal dependencies.
problem Designing and analyzing deep learning models for complex spatio-temporal analytics.
method Developed an I2DRNN model with three modules for integrating and learning multi-scale spatio-temporal data. result The I2DRNN model outperforms classical and state-of-the-art models in capturing meaningful multi-scale spatio-temporal dependencies. Efficient spatio-temporal Gaussian process inference method.
problem Scalable Gaussian process inference for multivariate, spatio-temporal data.
method Combines spatio-temporal filtering with natural gradient variational inference, resulting in a scalable non-conjugate GP method.
result Linear scaling with respect to time and logarithmic scaling with respect to time steps.
STACI uses neural nets to estimate spatio-temporal fields with valid uncertainty quantification.
problem Scalable spatio-temporal deep learning models fail to capture underlying correlation structure.
method Variational Bayesian neural network approximation of non-stationary spatio-temporal Gaussian Process (GP) with conformal inference.
result STACI provides accurate prediction intervals for spatio-temporal processes, outperforming competing methods.
MeshfreeFlowNet generates high-resolution spatio-temporal solutions from low-resolution inputs.
problem Generating high-resolution spatio-temporal solutions from low-resolution inputs.
method Physics-constrained deep learning framework using fully convolutional encoders.
result Significantly outperforms existing baselines in super-resolution of turbulent flows.
The spatio-temporal graph learning is becoming an increasingly important object of graph study. Many application domains involve highly dynamic graphs where temporal information is crucial, e.g. traffic networks and financial transaction graphs. Despite the constant progress made on learning structured data, there is s…
STAS selects optimal spatio-temporal scales for bias correction in precipitation forecasts.
problem Limited prior data and fixed ST scale in existing BCoPs lead to biases in numerical weather predictions.
method End-to-end deep-learning BCoP model STAS with SFM/TFM to automatically adjust spatial and temporal scales.
result STAS outperforms 8 published BCoP methods on threat scores (TS).
We introduce a probabilistic generative model for disentangling spatio-temporal disease trajectories from series of high-dimensional brain images. The model is based on spatio-temporal matrix factorization, where inference on the sources is constrained by anatomically plausible statistical priors. To model realistic tr…
Improved weather forecasting with gridded pseudo-token TNPs.
problem Handling large-scale, unstructured spatio-temporal data in weather forecasting.
method Introducing gridded pseudo-token transformer neural processes (TNPs) with efficient attention mechanisms.
result Consistently outperforms baselines on various synthetic and real-world regression tasks involving large-scale data.
Spatio-temporal data and processes are prevalent across a wide variety of scientific disciplines. These processes are often characterized by nonlinear time dynamics that include interactions across multiple scales of spatial and temporal variability. The data sets associated with many of these processes are increasing …
Variant of mSSA improves time series prediction error.
problem Improve prediction error in multivariate time series.
method Introduce spatio-temporal factor model, establish prediction error scaling.
result Prediction error scales as 1 / √(min(N, T)T).
DeepKriging uses neural networks for spatio-temporal interpolation and forecasting.
problem Non-Gaussianity and nonstationarity in real-world data.
method Two-stage model: DNN for interpolation, LSTM for forecasting.
result DeepKriging provides probabilistic forecasts without stationarity assumptions.
Paper presents a spatio-temporal Bayesian model for early detection of COVID-19 hotspots.
problem Understanding spatio-temporal dynamics of COVID-19 hotspots to prevent outbreaks.
method Spatio-temporal Bayesian framework with a zero-mean Gaussian process and non-stationary kernel function enhanced by deep neural networks.
result Model demonstrates superior hotspot-detection performance compared to baseline methods.
Paper proposes an efficient method for calibrating spatio-temporal forecasts.
problem Real-world spatio-temporal forecasting challenges like signal anomalies and distributional shifts.
method Learning with Calibration (ST-TTC) for real-time bias correction.
result ST-TTC improves spatio-temporal forecasting accuracy with reduced computational cost.
Timely accurate traffic forecast is crucial for urban traffic control and guidance. Due to the high nonlinearity and complexity of traffic flow, traditional methods cannot satisfy the requirements of mid-and-long term prediction tasks and often neglect spatial and temporal dependencies. In this paper, we propose a nove…
New framework assesses deep learning models for spatio-temporal data with missing data.
problem Challenges in assessing deep learning models for spatio-temporal data with missing and heterogeneous data.
method Residual correlation analysis framework using spatio-temporal graphs and asymptotically distribution-free summary statistics.
result Identification and localization of regions where predictive performance can be improved.
Spatio-temporal problems are ubiquitous and of vital importance in many research fields. Despite the potential already demonstrated by deep learning methods in modeling spatio-temporal data, typical approaches tend to focus solely on conditional expectations of the output variables being modeled. In this paper, we prop…
GNNs improve brain activity forecasting in fMRI studies.
problem Understanding neural dynamics in the brain.
method Comparison of GNN architectures for modeling fMRI data.
result GNNs outperform VAR models in robustly scaling to large network studies.
Novel spatio-temporal LSTM model forecasts oceanic variables across sensors and scales.
problem Data sparsity and lack of connected spatial and temporal information in environmental datasets.
method SPATIAL LSTM architecture that learns across spatial and temporal scales.
result Framework accurately forecasts oceanic variables with comparable performance to state-of-the-art models.
Predicting ambulance demand accurately at a fine resolution in time and space (e.g., every hour and 1 km2) is critical for staff / fleet management and dynamic deployment. There are several challenges: though the dataset is typically large-scale, demand per time period and locality is almost always zero. The demand …
Optimized DMD for fast atmospheric chemistry forecasting.
problem Forecasting global atmospheric chemistry dynamics efficiently.
method Optimized Dynamic Mode Decomposition (DMD) for reduced order modeling.
result Significant improvement in computational speed and interpretability.
We present a generic framework for spatio-temporal (ST) data modeling, analysis, and forecasting, with a special focus on data that is sparse in both space and time. Our multi-scaled framework is a seamless coupling of two major components: a self-exciting point process that models the macroscale statistical behaviors …
Advances in deep learning for spatio-temporal event modeling.
problem Limitations of traditional parametric models in capturing nonstationary dynamics.
method Integration of deep neural architectures to model conditional intensity function and influence kernels.
result Deep influence kernel approach enhances expressiveness and statistical explainability.
Long-lead forecasting for spatio-temporal systems can often entail complex nonlinear dynamics that are difficult to specify it a priori. Current statistical methodologies for modeling these processes are often highly parameterized and thus, challenging to implement from a computational perspective. One potential parsim…
Robust spatio-temporal GP framework for outlier-resilient predictions.
problem Outliers in spatio-temporal data degrade GP performance.
method Adapted and specialised RCGP framework for spatio-temporal settings.
result RCGP provides reliable spatio-temporal predictions with outliers.
Combines pseudo-point and state space approximations for scalable GPs.
problem Handling large numbers of off-the-grid spatial data-points and long time-series.
method Combines pseudo-point approximations for spatial data with state space GP approximations for temporal data.
result Combined approach is more scalable and applicable to a greater range of spatio-temporal problems.
A new autoencoder architecture captures multiscale data.
problem Multiscale spatio-temporal data representation.
method Integrates multigrid methods, convolutional autoencoders, and transfer learning.
result Adaptive, hierarchical architecture captures different scaled features dynamically.
FreST Loss decorrelates spatio-temporal dependencies in graph signals.
problem Complex spatio-temporal dependencies in graph-structured signals are not well captured by standard forecasting models.
method FreST Loss extends supervision to the joint spatio-temporal spectrum using Joint Fourier Transform (JFT).
result FreST Loss reduces estimation bias and improves forecasting accuracy on real-world datasets.
Neuro-inspired recurrent neural network algorithms, such as echo state networks, are computationally lightweight and thereby map well onto untethered devices. The baseline echo state network algorithms are shown to be efficient in solving small-scale spatio-temporal problems. However, they underperform for complex task…
New framework predicts urban traffic with high accuracy.
problem Urban traffic prediction challenges.
method Interpretable attention-based neural network combining multiple modules.
result Framework outperforms state-of-the-art alternatives.
A framework uses deep learning for spatio-temporal data prediction.
problem Interpolation of continuous spatio-temporal fields on irregular points.
method Decomposes spatio-temporal processes into products of basis functions and spatial coefficients.
result Effectiveness in reconstructing coherent spatio-temporal fields.
Proposes a new model for complex multivariate event data.
problem Modeling complex multivariate event data with spatio-temporal dynamics.
method Integrates spatial information into latent state evolution through learned temporal and spatial decay dynamics.
result Successfully recovers sensible temporal and spatial intensity structure in multivariate spatio-temporal point patterns.
New graph kernels capture spatio-temporal interactions.
problem Lack of justified spatio-temporal graph kernels for graph problems.
method Derive graph kernels via SPDEs for spatio-temporal modelling.
result Non-separable spatio-temporal graph kernels outperform existing ones.
Proposes a transformer model with geostatistical inductive bias for spatio-temporal forecasting.
problem Combining probabilistic rigor of geostatistics with flexible deep learning representations.
method Spatially-informed transformer with learnable covariance kernel.
result Successfully recovers spatial decay parameters end-to-end via backpropagation.
DeepMIDE forecasts wind speeds across space, time, and height for offshore wind energy.
problem Forecasting wind speeds across multiple heights for large offshore wind turbines.
method Statistical deep learning model that jointly models wind speeds at different heights using a multi-output integro-difference equation.
result DeepMIDE forecasts outperform traditional methods in real-world offshore wind energy data.
New neural networks model for spatio-temporal data.
problem Building a mapping from spatially encoded time series covariates to real-valued response data.
method Proposed two novel extensions of Functional Neural Network (FNN) for spatio-temporal regression.
result Demonstrated effectiveness in handling varying spatial correlations through comprehensive simulation studies.
New method predicts spatio-temporal data with short and long-range dependence.
problem Uncertainty in predicting the distribution of mixed moving average fields.
method Theory-guided machine learning approach using generalized Bayesian algorithm.
result Fixed-time and any-time PAC Bayesian bounds for ensemble forecasts.
New model infers causal relationships from spatio-temporal data, even with unobserved confounders.
problem Challenges in inferring causal relationships from spatio-temporal data due to unobserved confounders.
method Spatio-Temporal Hierarchical Causal Models (ST-HCMs) that extend hierarchical causal modeling to the spatio-temporal domain, using the Spatio-Temporal Collapse Theorem.
result Validated the effectiveness of ST-HCMs on both synthetic and real-world datasets, demonstrating robust causal inference in complex dynamic systems.
FNOs improve spatio-temporal forecasting without needing PDE details.
problem Complex spatio-temporal dynamics in physical and biological phenomena.
method Fourier Neural Operators (FNOs) for dynamic spatio-temporal modeling.
result FNO forecasts are accurate and capture complex real-world dependencies.
Model improves mortgage credit risk prediction with spatio-temporal machine learning.
problem Improving accuracy of default probabilities and loan portfolio loss distributions in mortgage credit risk.
method Combines tree-boosting with a latent spatio-temporal Gaussian process model.
result Predictive models outperform conventional methods due to non-linear and spatio-temporal effects.
Accurate real time crime prediction is a fundamental issue for public safety, but remains a challenging problem for the scientific community. Crime occurrences depend on many complex factors. Compared to many predictable events, crime is sparse. At different spatio-temporal scales, crime distributions display dramatica…
Temporal Normalizing Flows enhance density estimation of time-dependent data.
problem Accurate and robust density estimation of time-dependent stochastic data.
method Leveraging normalizing flows for temporal data, tNFs estimate multi-scale distributions without prior scale knowledge.
result Temporal Normalizing Flows improve density estimation of time-dependent data, including multi-scale distributions.
Modeling solar ramping events with spatio-temporal point processes.
problem Predicting solar ramping events influenced by weather conditions.
method Novel spatio-temporal categorical point process model.
result Effective modeling of spatio-temporal correlations in solar ramping events.
RCNPs extend equivariant neural processes to higher dimensions, improving performance on tasks with inherent symmetries.
problem Inherently equivariant tasks in spatio-temporal modeling, Bayesian Optimization, and continuous control.
method Relational Conditional Neural Processes (RCNPs) that extend equivariances to higher dimensions.
result Empirically competitive performance on tasks with equivariances.
A new kernel framework analyzes spatio-temporal data from dynamic equations.
problem Analyzing spatio-temporal data from dynamic equations with noisy measurements.
method Kernel-based framework with representer theorem for minimizing error with given samples.
result Minimizes error in solutions of dynamic equations with noisy spatio-temporal data.
Proposes FairDRL-ST for fair spatio-temporal mobility prediction.
problem Fairness concerns in spatio-temporal AI applications.
method Disentangled representation learning, adversarial learning.
result Achieves fairness in spatio-temporal mobility prediction without performance loss.
Combines CNN and LSTM for spatio-temporal graph networks.
problem Improving spatio-temporal feature extraction.
method Proposes a new architecture combining CNN and LSTM temporal blocks.
result Empirical comparison shows our model outperforms existing models.
This paper tackles spatio-temporal information preservation in machine learning.
problem Conventional machine learning assumes orthogonal data attributes, disrupting spatio-temporal information.
method Shift-invariant k-means, convolutional dictionary learning, and spatio-temporal hypercomplex encoding schemes are proposed.
result Gabor feature extraction outperforms convolutional dictionary learning in spatio-temporal information preservation.
Spatio-temporal data is intrinsically high dimensional, so unsupervised modeling is only feasible if we can exploit structure in the process. When the dynamics are local in both space and time, this structure can be exploited by splitting the global field into many lower-dimensional "light cones". We review light cone …