When sensors collect spatio-temporal data in a large geographical area, the existence of missing data cannot be escaped. Missing data negatively impacts the performance of data analysis and machine learning algorithms. In this paper, we study deep autoencoders for missing data imputation in spatio-temporal problems. We…
A new method for separating mixed signals in space and time.
problem Nonlinear and nonstationary spatio-temporal data challenges.
method Identifiable autoregressive variational autoencoder.
result The method outperforms existing techniques in blind source separation and spatio-temporal prediction.
Synthesizes images from audio and visual data using spike-based autoencoders.
problem Extracting meaningful information from spatio-temporal data for image synthesis.
method Spike-based autoencoders trained to learn spatio-temporal representations of audio and visual data.
result Synthesized images from audio samples with high fidelity, achieving competitive performance.
Paper models spatio-temporal extremes using conditional variational autoencoders.
problem Modeling co-occurrence of extreme weather events under changing climate conditions.
method Conditional Variational Autoencoder (cXVAE) with CNN integration.
result Accurately emulates spatial fields and recovers extremal dependence with low computational cost.
Paper tackles fall detection using adversarial learning.
problem Detecting falls in the absence of training data due to class imbalance.
method Adversarial learning framework with spatio-temporal autoencoder and convolution network.
result Proposed framework outperformed baseline methods on publicly available datasets.
Two autoencoding models learn latent traffic scene representations.
problem Learning latent representations of traffic scenarios.
method CNN and RNN models for spatio-temporal and temporal data, incorporating permutation invariance.
result Latent scenario embeddings can be used for clustering and similarity retrieval.
Framework reconstructs missing spatio-temporal data for extreme value prediction.
problem Predicting extreme values from incomplete spatio-temporal data.
method Convolutional deep neural networks and autoencoder-like models for conditional sampling.
result Framework produces accurate reconstructions of missing data for extremal values.
Develops SGP-VAE for efficient sparse GP inference in multi-dimensional datasets.
problem Sparse GP approximations and missing data in multi-dimensional spatio-temporal datasets.
method Leverages partial inference networks for sparse GP approximations and amortized variational inference.
result Outperforms multi-output GPs and structured VAEs in various experiments.
A new autoencoder architecture captures multiscale data.
problem Multiscale spatio-temporal data representation.
method Integrates multigrid methods, convolutional autoencoders, and transfer learning.
result Adaptive, hierarchical architecture captures different scaled features dynamically.
Human falls rarely occur; however, detecting falls is very important from the health and safety perspective. Due to the rarity of falls, it is difficult to employ supervised classification techniques to detect them. Moreover, in these highly skewed situations it is also difficult to extract domain specific features to …
This work creates a system for understanding human movement in spaces.
problem Simplify communication and interaction between robots and humans in spatial tasks.
method Uses unsupervised learning with neural autoencoding to learn continuous representations of spatio-temporal trajectory data.
result Proposes a method to form prototypical representations of movement based on spatial context.
A new method uses variational autoencoders to speed up greenhouse gas sensitivity calculations.
problem Computational inefficiency in generating LPDM sensitivities from gas mole fraction observations.
method Developed a convolutional variational autoencoder (CVAE) to emulate LPDM sensitivities in a low-dimensional space.
result The CVAE-based emulator outperforms traditional methods and can be applied to various LPDMs.
Bayesian autoencoders discover physics from noisy data.
problem Challenges in identifying governing equations and coordinates from noisy, low-data real-world data.
method Bayesian SINDy autoencoders with hierarchical Bayesian sparsifying prior and adaptive empirical Bayesian method.
result Better physics discovery with lower data and fewer training epochs, along with valid uncertainty quantification.
Paper presents a new video compression method using autoencoders.
problem Efficient video compression with reduced quality loss.
method 3D autoencoder with discrete latent space and autoregressive prior trained jointly.
result Method outperforms state-of-the-art learned video compression networks.
CESAR improves wind speed and power forecasting for high-resolution simulations.
problem Accurate high-resolution wind forecasting for efficient power grid management.
method A spatio-temporal neural network model using deep convolutional autoencoder and echo state network.
result CESAR provides up to 17% improvement in wind speed and power forecasting compared to best alternatives.
Inferring air quality from a limited number of observations is an essential task for monitoring and controlling air pollution. Existing inference methods typically use low spatial resolution data collected by fixed monitoring stations and infer the concentration of air pollutants using additional types of data, e.g., m…
Deep model predicts wildfire data in incomplete regions.
problem Predicting distributions of wildfire frequency and size in missing data regions.
method Conditional Missing data Importance-Weighted Autoencoder (CMIWAE) model trained on incomplete data.
result Maximizes log-likelihood of observed wildfire information.
STACI uses neural nets to estimate spatio-temporal fields with valid uncertainty quantification.
problem Scalable spatio-temporal deep learning models fail to capture underlying correlation structure.
method Variational Bayesian neural network approximation of non-stationary spatio-temporal Gaussian Process (GP) with conformal inference.
result STACI provides accurate prediction intervals for spatio-temporal processes, outperforming competing methods.
Robust spatio-temporal GP framework for outlier-resilient predictions.
problem Outliers in spatio-temporal data degrade GP performance.
method Adapted and specialised RCGP framework for spatio-temporal settings.
result RCGP provides reliable spatio-temporal predictions with outliers.
FreST Loss decorrelates spatio-temporal dependencies in graph signals.
problem Complex spatio-temporal dependencies in graph-structured signals are not well captured by standard forecasting models.
method FreST Loss extends supervision to the joint spatio-temporal spectrum using Joint Fourier Transform (JFT).
result FreST Loss reduces estimation bias and improves forecasting accuracy on real-world datasets.
We propose a mixed deep neural network strategy, incorporating parallel combination of Convolutional (CNN) and Recurrent Neural Networks (RNN), cascaded with deep autoencoders and fully connected layers towards automatic identification of imagined speech from EEG. Instead of utilizing raw EEG channel data, we compute t…
New framework predicts urban traffic with high accuracy.
problem Urban traffic prediction challenges.
method Interpretable attention-based neural network combining multiple modules.
result Framework outperforms state-of-the-art alternatives.
A framework uses deep learning for spatio-temporal data prediction.
problem Interpolation of continuous spatio-temporal fields on irregular points.
method Decomposes spatio-temporal processes into products of basis functions and spatial coefficients.
result Effectiveness in reconstructing coherent spatio-temporal fields.
Proposes a new model for complex multivariate event data.
problem Modeling complex multivariate event data with spatio-temporal dynamics.
method Integrates spatial information into latent state evolution through learned temporal and spatial decay dynamics.
result Successfully recovers sensible temporal and spatial intensity structure in multivariate spatio-temporal point patterns.
New graph kernels capture spatio-temporal interactions.
problem Lack of justified spatio-temporal graph kernels for graph problems.
method Derive graph kernels via SPDEs for spatio-temporal modelling.
result Non-separable spatio-temporal graph kernels outperform existing ones.
New neural networks model for spatio-temporal data.
problem Building a mapping from spatially encoded time series covariates to real-valued response data.
method Proposed two novel extensions of Functional Neural Network (FNN) for spatio-temporal regression.
result Demonstrated effectiveness in handling varying spatial correlations through comprehensive simulation studies.
New method predicts spatio-temporal data with short and long-range dependence.
problem Uncertainty in predicting the distribution of mixed moving average fields.
method Theory-guided machine learning approach using generalized Bayesian algorithm.
result Fixed-time and any-time PAC Bayesian bounds for ensemble forecasts.
New model infers causal relationships from spatio-temporal data, even with unobserved confounders.
problem Challenges in inferring causal relationships from spatio-temporal data due to unobserved confounders.
method Spatio-Temporal Hierarchical Causal Models (ST-HCMs) that extend hierarchical causal modeling to the spatio-temporal domain, using the Spatio-Temporal Collapse Theorem.
result Validated the effectiveness of ST-HCMs on both synthetic and real-world datasets, demonstrating robust causal inference in complex dynamic systems.
FNOs improve spatio-temporal forecasting without needing PDE details.
problem Complex spatio-temporal dynamics in physical and biological phenomena.
method Fourier Neural Operators (FNOs) for dynamic spatio-temporal modeling.
result FNO forecasts are accurate and capture complex real-world dependencies.
Model improves mortgage credit risk prediction with spatio-temporal machine learning.
problem Improving accuracy of default probabilities and loan portfolio loss distributions in mortgage credit risk.
method Combines tree-boosting with a latent spatio-temporal Gaussian process model.
result Predictive models outperform conventional methods due to non-linear and spatio-temporal effects.
Spatio-temporal RBF neural networks improve chaotic time series prediction.
problem Predicting chaotic time series due to their dynamic nature.
method Proposes an spatio-temporal extension of RBF neural networks.
result Spatio-temporal RBF outperforms standard RBF in chaotic time series prediction.
Modeling solar ramping events with spatio-temporal point processes.
problem Predicting solar ramping events influenced by weather conditions.
method Novel spatio-temporal categorical point process model.
result Effective modeling of spatio-temporal correlations in solar ramping events.
A new kernel framework analyzes spatio-temporal data from dynamic equations.
problem Analyzing spatio-temporal data from dynamic equations with noisy measurements.
method Kernel-based framework with representer theorem for minimizing error with given samples.
result Minimizes error in solutions of dynamic equations with noisy spatio-temporal data.
Proposes FairDRL-ST for fair spatio-temporal mobility prediction.
problem Fairness concerns in spatio-temporal AI applications.
method Disentangled representation learning, adversarial learning.
result Achieves fairness in spatio-temporal mobility prediction without performance loss.
Combines CNN and LSTM for spatio-temporal graph networks.
problem Improving spatio-temporal feature extraction.
method Proposes a new architecture combining CNN and LSTM temporal blocks.
result Empirical comparison shows our model outperforms existing models.
The spatio-temporal graph learning is becoming an increasingly important object of graph study. Many application domains involve highly dynamic graphs where temporal information is crucial, e.g. traffic networks and financial transaction graphs. Despite the constant progress made on learning structured data, there is s…
This paper tackles spatio-temporal information preservation in machine learning.
problem Conventional machine learning assumes orthogonal data attributes, disrupting spatio-temporal information.
method Shift-invariant k-means, convolutional dictionary learning, and spatio-temporal hypercomplex encoding schemes are proposed.
result Gabor feature extraction outperforms convolutional dictionary learning in spatio-temporal information preservation.
Spatio-temporal data is intrinsically high dimensional, so unsupervised modeling is only feasible if we can exploit structure in the process. When the dynamics are local in both space and time, this structure can be exploited by splitting the global field into many lower-dimensional "light cones". We review light cone …
Dynamic sample pruning speeds up spatio-temporal forecasting models.
problem Training deep learning models on large, redundant datasets is computationally expensive.
method Dynamic sample pruning based on real-time learning state.
result Significant acceleration of training speed with improved performance.
Improved RBFNN for nonlinear system identification.
problem Nonlinear system identification problem.
method Spatio-temporal extension of RBFNN with time-space orthogonality.
result Spatio-temporal RBFNN outperforms standard RBFNN in convergence and error reduction.
DeepKriging uses neural networks for spatio-temporal interpolation and forecasting.
problem Non-Gaussianity and nonstationarity in real-world data.
method Two-stage model: DNN for interpolation, LSTM for forecasting.
result DeepKriging provides probabilistic forecasts without stationarity assumptions.
Estimates spatio-temporal Hawkes processes using tensor recovery.
problem Estimating influence functions for spatio-temporal Hawkes processes.
method Formulates influence function as a tensor kernel, assumes low-rank structure, solves as convex optimization problem.
result Provides theoretical guarantees and demonstrates efficiency with simulations.
Efficient spatio-temporal Gaussian process inference method.
problem Scalable Gaussian process inference for multivariate, spatio-temporal data.
method Combines spatio-temporal filtering with natural gradient variational inference, resulting in a scalable non-conjugate GP method.
result Linear scaling with respect to time and logarithmic scaling with respect to time steps.
New method clusters evolving networks using spatio-temporal graph Laplacian.
problem Clustering communities in time-varying graphs.
method Extends spectral clustering to dynamic graphs using CCA and spatio-temporal graph Laplacian.
result The spatio-temporal graph Laplacian clearly interprets cluster evolution over time.
Deep learning models improve spatio-temporal data mining.
problem Mining valuable knowledge from spatio-temporal data.
method Application of deep learning techniques (CNN, RNN) in various spatio-temporal data mining tasks.
result Deep learning models enhance performance in spatio-temporal data mining.
New algorithm predicts spatio-temporal events with improved accuracy.
problem Non-stationary spatio-temporal prediction on dense and sparse sequences.
method Probabilistic approach using point processes and self-organizing decision trees.
result Significant performance improvements over baseline and state-of-the-art methods.
New method corrects seasonal Arctic sea ice predictions with probabilistic models.
problem Systematic biases and errors in climate model forecasts of Arctic sea ice.
method Conditional Variational Autoencoder model to map observation distribution given biased model predictions.
result Probabilistic adjusted forecasts are better calibrated and have smaller errors.
Paper analyzes privacy-aware mobility behavior using entropy metrics.
problem Intrusive user location tracking makes it easy to identify users.
method Proposes spatio-temporal entropy to quantify mobility, uses GAMs to study effects of variables.
result Global GAM provides more accurate predictions of spatio-temporal entropy.