Proposes a deep neural network for spatial data regression.
problem Regression of spatial data using deep neural networks.
method Localized two-layer deep neural network for spatial data, proving consistency and asymptotic convergence.
result Asymptotic convergence rate is faster than existing methods, demonstrating effectiveness on temperature estimation.
Graph neural networks extend neural Bayes estimators to irregular spatial data.
problem Estimating parameters from irregular spatial data with computational efficiency.
method Employing graph neural networks to approximate Bayes estimators for irregular spatial data.
result Extending neural Bayes estimation to irregular spatial data with computational benefits.
Neural networks improve geospatial data analysis by relaxing linearity assumptions.
problem Traditional geospatial analysis assumes linear models, limiting flexibility.
method Embedding neural networks within traditional geostatistical models for non-linear mean functions.
result NN-GLS algorithm provides consistent and scalable predictions for irregular spatial data.
Neural networks estimate spatial process likelihoods efficiently.
problem Challenges in estimating spatial processes with slow or intractable likelihoods.
method Convolutional neural networks trained on a classification task to learn likelihood function.
result Neural likelihood surfaces provide fast and accurate parameter estimation.
Spatially positioned neurons in neural networks mimic biological systems.
problem Creating neural networks that can perform multiple tasks efficiently.
method Added spatial positions and proximity penalties to artificial neurons.
result Neurons naturally cluster, each responsible for a specific task.
Spatial blind source separation simplifies multivariate spatial prediction.
problem Predicting multivariate measurements at unobserved locations with spatial dependencies.
method Spatial blind source separation as a pre-processing tool compared to Cokriging and neural networks.
result Spatial blind source separation simplifies spatial prediction by avoiding cross-dependencies.
Spatial smoothing improves BNNs' accuracy, uncertainty, and robustness without increasing computational cost.
problem Large ensembles in BNNs increase computational cost and reduce performance.
method Spatial smoothing adds blur layers to convolutional neural networks to ensemble neighboring feature map points.
result Spatial smoothing improves BNNs' performance with fewer ensembles and enhances robustness.
Proposes flexible spatial models for better understanding spatial heterogeneity.
problem Poor characterisation of spatial heterogeneity in conventional models.
method Spatial Bayesian Neural Networks (SBNNs) incorporating a spatial embedding layer and possibly spatially-varying parameters.
result SBNNs better match the finite-dimensional distribution of target spatial processes.
A2-SBNN models spatial data with copulas for non-Gaussian dependencies.
problem Capturing complex spatial relationships and extreme dependencies in non-Gaussian data.
method Embedding A2 copula into a Bayesian neural network, trained with Wasserstein loss and moment matching.
result A2-SBNN consistently delivers high accuracy across various dependency strengths.
Spatial information is not always necessary for spatio-temporal models.
problem The necessity of including spatial information in spatio-temporal models.
method Comparison of spatial agnostic neural networks with state-of-the-art models on ten datasets.
result Spatial information is not always needed in most spatio-temporal models.
This paper explores the trade-off between spatial and adversarial robustness in neural networks.
problem Understanding the trade-off between spatial and adversarial robustness in neural networks.
method Quantitative analysis and empirical testing with curriculum learning.
result Spatial robustness and adversarial robustness are quantitatively related and can be improved simultaneously.
PE-GQNN improves spatial data prediction and uncertainty quantification.
problem Poor calibration of predictive distributions in spatial data models.
method Combines PE-GNNs with Quantile Neural Networks and recalibration techniques.
result PE-GQNN outperforms existing methods in predictive accuracy and uncertainty quantification.
NCS enables efficient and accurate conditional simulation for complex spatial processes.
problem Challenges in simulating from complex spatial process distributions.
method Neural diffusion models and conditional score-based diffusion.
result NCS outperforms traditional methods in efficiency and accuracy.
Novel neural network solves PDEs with multi-scale resolution.
problem Solving time-dependent PDEs with varying spatial and temporal scales.
method Multi-scale message passing neural network with temporal and spatial gating modules.
result Outperforms baselines on PDEs with diverse scales.
Paper develops Dense NN models for temporal-spatial data with improved performance.
problem Improving predictive performance and robustness in temporal-spatial modeling.
method Fully connected neural networks with ReLU activation, non-asymptotic bounds, manifold modeling, short-range dependence.
result Demonstrates superior performance in temporal-spatial modeling across various synthetic functions.
Decades of research on the neural code underlying spatial navigation have revealed a diverse set of neural response properties. The Entorhinal Cortex (EC) of the mammalian brain contains a rich set of spatial correlates, including grid cells which encode space using tessellating patterns. However, the mechanisms and fu…
This work studies the entity-wise topical behavior from massive network logs. Both the temporal and the spatial relationships of the behavior are explored with the learning architectures combing the recurrent neural network (RNN) and the convolutional neural network (CNN). To make the behavioral data appropriate for th…
CNNs predict spatial fields from sparse data.
problem Predicting complete spatial fields from limited observations.
method Convolutional Neural Networks (CNNs) trained on a single partially observed field.
result CNNs can flexibly capture local spatial patterns without explicit covariance modeling.
This paper develops a new neural network architecture for modeling spatial distributions (i.e., distributions on R^d) which is computationally efficient and specifically designed to take advantage of the spatial structure of limit order books. The new architecture yields a low-dimensional model of price movements deep …
The understanding of geographical reality is a process of data representation and pattern discovery. Former studies mainly adopted continuous-field models to represent spatial variables and to investigate the underlying spatial continuity/heterogeneity in the regular spatial domain. In this article, we introduce a more…
STNN models forecast COVID-19 spread with improved accuracy.
problem Forecasting the spread of COVID-19 worldwide.
method Spatio-temporal Neural Network (STNN) incorporating spatial and temporal data.
result STNN models outperform classical models in accuracy and handling both spatial and temporal data.
New method improves convergence of spatial filters in neural networks.
problem Poor convergence behavior of spatial filters in neural networks.
method Correlated initialization for spatial filters.
result Uncorrelated initialization leads to poor convergence and slow training of some parameters.
Hybrid model predicts flow and pressure in water systems.
problem Predicting flow and pressure in water distribution systems with complex spatial-temporal correlations.
method Hybrid dual-stage spatial-temporal attention-based recurrent neural networks (hDS-RNN).
result Our model outperformed 9 baseline models in flow and pressure series prediction.
Infinite CNNs lose spatial correlations, but can be restored by correlated weights.
problem Infinite CNNs lose spatial correlations, which are crucial for their performance.
method Introduced correlated weights to restore spatial correlations in infinite CNNs.
result Optimal performance is achieved with a moderate level of weight correlation.
E-LMC improves spatial field prediction accuracy by linearizing complex fields.
problem Predicting complex spatial fields with high accuracy and efficiency.
method Introducing an invertible neural network to linearize nonlinear spatial fields, enabling the use of LMC for nonlinear problems.
result Maximum improvement of about 40% over original LMC, outperforming other models.
Spatial time series forecasting problems arise in a broad range of applications, such as environmental and transportation problems. These problems are challenging because of the existence of specific spatial, short-term and long-term patterns, and the curse of dimensionality. In this paper, we propose a deep neural net…
DISTANA predicts and denoises spatial wave dynamics.
problem Identifying causality in spatially distributed, non-linear dynamical processes.
method Generative, recurrent graph convolution neural network architecture (DISTANA).
result DISTANA outperforms alternative approaches in denoising and predicting complex spatial wave propagation.
Graph neural networks improve residential location choice predictions.
problem Capturing spatial dependence in discrete choice models.
method Graph Neural Networks (GNN) for analyzing spatial alternatives.
result GNN-DCMs outperform classical models in residential location choice predictions.
New model predicts travel demand uncertainty with high accuracy.
problem Uncertainty and sparsity in sparse travel demand prediction.
method Spatial-Temporal Zero-Inflated Negative Binomial Graph Neural Network (STZINB-GNN).
result STZINB-GNN outperforms benchmarks in predicting travel demand uncertainty.
New method relaxes spatial invariance in locally connected layers, improving accuracy.
problem Improving classification accuracy with locally connected layers.
method Designing a low-rank locally connected layer with varying spatially varying combining weights.
result Relaxing spatial invariance improves classification accuracy over convolution and locally connected layers.
Neural networks speed up covariance estimation in spatial Gaussian processes.
problem Efficiently estimating covariance parameters in spatial Gaussian processes.
method Training neural networks to approximate maximum likelihood estimates.
result Neural network estimates are as accurate as ML methods but much faster.
SXL embeds spatial autocorrelation into neural networks for better geographic data learning.
problem Difficulties in learning spatial effects for neural networks in geographic data.
method SXL uses auxiliary tasks and autoregressive embeddings to learn spatial autocorrelation.
result SXL improves neural network training in unsupervised and supervised learning tasks.
This study bridges the gap between spatial and spectral GNNs.
problem Lack of direct comparison and cross-reference of existing GNNs.
method Systematically categorizes and examines GNNs into spatial and spectral domains.
result Establishes a strong relationship between spatial and spectral GNNs.
DeepKriging uses DNNs to predict spatial data with improved accuracy and scalability.
problem Predicting spatial processes with non-linear and non-Gaussian data.
method Adds an embedding layer of spatial coordinates with basis functions to DNNs.
result DeepKriging provides non-linear predictions with smaller approximation errors and is scalable for large datasets.
Proposes deep graph persistence to address neural persistence issues in deep learning.
problem Variance of weights and lack of spatial structure in deep neural networks impact neural persistence.
method Extends neural persistence to the whole network, considering interactions between layers.
result Deep graph persistence alleviates variance-related issues and captures persistent paths through the network.
SHARE predicts city-wide parking availability using a hierarchical graph neural network.
problem Predicting city-wide parking availability is challenging due to spatial and temporal autocorrelation.
method SHARE uses a hierarchical graph convolution structure with contextual and soft clustering blocks, a recurrent neural network, and a parking availability approximation module.
result SHARE outperforms state-of-the-art baselines in predicting city-wide parking availability.
Improves deep generative models to generate images of any size.
problem Fixed-sized output images from deep generative models.
method Integrates spatial noise vectors into fully convolutional neural networks.
result Theoretical interpretation of infinite spatial generation using spatial stochastic processes.
We introduce a dynamical spatio-temporal model formalized as a recurrent neural network for forecasting time series of spatial processes, i.e. series of observations sharing temporal and spatial dependencies. The model learns these dependencies through a structured latent dynamical component, while a decoder predicts t…
Semantic segmentation is an established while rapidly evolving field in medical imaging. In this paper we focus on the segmentation of brain Magnetic Resonance Images (MRI) into cerebral structures using convolutional neural networks (CNN). CNNs achieve good performance by finding effective high dimensional image featu…
Proposes a GNN for multivariate time-series prediction with filtering.
problem Low signal-to-noise ratio in complex systems data.
method Integrates a spatial-temporal GNN with a matrix filtering module to generate filtered graphs.
result Proposed model outperforms baseline approaches in multivariate time-series prediction.
ConvNets improve nonstationary covariance estimation for large-scale spatial data.
problem Estimating nonstationary spatial covariance functions on large scales.
method Convolutional Neural Networks (ConvNets) for subregion identification and selection.
result Enhanced accuracy in parameter estimation using ConvNet-based partitioning.
SpatialSim benchmarks machine learning in recognizing object spatial configurations.
problem Machine learning in recognizing precise geometrical configurations of groups of objects.
method SpatialSim benchmark with tasks of Identification and Comparison, using Graph Neural Networks (MPGNNs).
result MPGNNs outperform baselines in recognizing spatial configurations, highlighting current limits.
Proposes new convex relaxations for certifying spatial robustness of neural networks.
problem Lack of provable guarantees for robustness against vector field transformations.
method Novel convex relaxations for certifying robustness against vector field transformations.
result First time providing a certificate of robustness against vector field transformations.
Convolutional Neural Networks (CNN) have been pivotal to the success of many state-of-the-art classification problems, in a wide variety of domains (for e.g. vision, speech, graphs and medical imaging). A commonality within those domains is the presence of hierarchical, spatially agglomerative local-to-global interacti…
DNNs improve SIMP method but not spatially invariant, study shows.
problem Improving SIMP method with DNNs but maintaining spatial invariance.
method Use of DNNs for density field generation, study of NTK filter properties.
result DNNs lead to a non-spatially invariant filter, requiring embeddings for spatial invariance.
The paper bridges spectral and spatial graph convolutions, improving model capacity and transferability.
problem Improving graph neural networks by bridging spectral and spatial design.
method Theoretical demonstration and general framework for spectral analysis, new spectral convolutions, and depthwise separable convolutions.
result General framework allows spectral analysis of ConvGNNs, showing their performance and limits, and proposing new spectral convolutions.
CaLoNet integrates spatial and local correlations for multivariate time series classification.
problem Ignoring spatial and local correlations in multivariate time series classification.
method Model spatial correlations using causality modeling, extract local correlations, integrate into graph neural network.
result Competitive performance compared to state-of-the-art methods on UEA datasets.
New method models precipitation extremes and spatial dependence.
problem Estimating dependencies of precipitation maxima in space and time.
method Generative neural networks for max-stable processes.
result Explicit nonparametric estimate of spatial dependence.