A new CNN approach for time series forecasting outperforms traditional RNNs.
problem Time series forecasting using conventional RNNs.
method Temporally folded convolutional neural networks (TFC's) for sequence forecasting.
result TFC's outperform conventional RNNs on sequential MNIST and JSB chorals datasets.
Convolutional neural network for probabilistic time series forecasting.
problem Forecasting multiple related time series with complex patterns.
method Temporal convolutional neural network with stacked residual blocks and dilated causal convolution.
result Outperforms state-of-the-art methods in accuracy and efficiency.
Enhances SNNs for spatio-temporal feature extraction.
problem Insufficient temporal dependencies in existing SNN synaptic structures.
method Integrates temporal convolution and attention mechanisms into synaptic connections.
result Improves SNN performance on classification tasks.
PSTN improves traffic condition forecasting with deep neural networks.
problem Challenges in accurately forecasting traffic conditions due to complex spatiotemporal correlations.
method Proposes PSTN with three modules: graph convolutional network, temporal convolutional network, and gated recurrent unit framework.
result Significantly outperforms state-of-the-art benchmarks in short-term traffic conditions forecasting.
Enhances speech emotion recognition by adapting to varying time scales.
problem Robust emotion recognition from speech audio with temporal variations.
method Introduces multi-time-scale (MTS) convolutional layers to CNNs.
result MTS layers improve generalization, especially on smaller datasets.
Acoustic scenes are rich and redundant in their content. In this work, we present a spatio-temporal attention pooling layer coupled with a convolutional recurrent neural network to learn from patterns that are discriminative while suppressing those that are irrelevant for acoustic scene classification. The convolutiona…
Recent studies have demonstrated the power of recurrent neural networks for machine translation, image captioning and speech recognition. For the task of capturing temporal structure in video, however, there still remain numerous open research questions. Current research suggests using a simple temporal feature pooling…
TFiLM expands convolutional models' receptive field with minimal overhead.
problem Capturing long-range dependencies in sequential data.
method A novel architectural component using a recurrent neural network to modulate convolutional model activations.
result TFiLM significantly improves learning speed and accuracy on various tasks.
Convolutional architectures have recently been shown to be competitive on many sequence modelling tasks when compared to the de-facto standard of recurrent neural networks (RNNs), while providing computational and modeling advantages due to inherent parallelism. However, currently there remains a performance gap to mor…
A new method aligns convolution filters for temporal sequences using Dynamic Time Warp.
problem Improving deep learning models' ability to handle temporal sequence data.
method Integrates Dynamic Time Warp algorithm into 1-D convolution layers for better alignment of input and filter.
result Exceeds or matches standard 1-D convolution layers in time series classification tasks.
SELD-TCN improves sound event localization and detection efficiency.
problem Efficient sound event localization and detection on embedded hardware.
method Developed a novel temporal convolutional network (TCN) architecture.
result SELD-TCN outperforms state-of-the-art SELDnet on four datasets.
Accurate prediction of disease trajectories is critical for early identification and timely treatment of patients at risk. Conventional methods in survival analysis are often constrained by strong parametric assumptions and limited in their ability to learn from high-dimensional data, while existing neural network mode…
This work studies the entity-wise topical behavior from massive network logs. Both the temporal and the spatial relationships of the behavior are explored with the learning architectures combing the recurrent neural network (RNN) and the convolutional neural network (CNN). To make the behavioral data appropriate for th…
When sensors collect spatio-temporal data in a large geographical area, the existence of missing data cannot be escaped. Missing data negatively impacts the performance of data analysis and machine learning algorithms. In this paper, we study deep autoencoders for missing data imputation in spatio-temporal problems. We…
Study compares deep learning models for volatility prediction using multivariate data.
problem Predicting volatility using multivariate data.
method Evaluated multiple deep learning models including MLP, RNN, TCN, and Temporal Fusion Transformer.
result Temporal Fusion Transformer and TCN variants outperform classical models and shallow networks.
In this article, we propose a novel ECG classification framework for atrial fibrillation (AF) detection using spectro-temporal representation (i.e., time varying spectrum) and deep convolutional networks. In the first step we use a Bayesian spectro-temporal representation based on the estimation of time-varying coeffic…
STConvS2S improves weather forecasting using only convolutional layers.
problem Predicting future weather conditions more accurately.
method Proposes a deep learning architecture combining spatiotemporal convolutional layers.
result Outperforms state-of-the-art architectures for forecasting tasks.
SHARE predicts city-wide parking availability using a hierarchical graph neural network.
problem Predicting city-wide parking availability is challenging due to spatial and temporal autocorrelation.
method SHARE uses a hierarchical graph convolution structure with contextual and soft clustering blocks, a recurrent neural network, and a parking availability approximation module.
result SHARE outperforms state-of-the-art baselines in predicting city-wide parking availability.
Unified tensor factorization for efficient 3D convolutions in spatio-temporal emotion analysis.
problem Training deep 3D convolutions is computationally expensive and requires large datasets.
method Tensor factorization framework for separable higher-order convolutions.
result Improved spatio-temporal emotion estimation on large datasets.
Localized CNNs improve geospatial wind forecasting.
problem Improving CNN performance in geospatial, spatio-temporal prediction.
method Localized convolutional neural networks (LCNNs) that learn local features in addition to global ones.
result LCNNs enhance wind forecasting models, often surpassing state-of-the-art.
Combines CNN and LSTM for spatio-temporal graph networks.
problem Improving spatio-temporal feature extraction.
method Proposes a new architecture combining CNN and LSTM temporal blocks.
result Empirical comparison shows our model outperforms existing models.
The widespread availability of electronic health records (EHRs) promises to usher in the era of personalized medicine. However, the problem of extracting useful clinical representations from longitudinal EHR data remains challenging. In this paper, we explore deep neural network models with learned medical feature embe…
Efficiently learns 3D convolutions with less data.
problem High parameter and data costs in 3D convolutions.
method Temporal factorization of 3D kernels.
result Significantly reduces training data requirement and parameter count.
Most of the research in convolutional neural networks has focused on increasing network depth to improve accuracy, resulting in a massive number of parameters which restricts the trained network to platforms with memory and processing constraints. We propose to modify the structure of the Very Deep Convolutional Neural…
FS-GCLSTM predicts stock returns by leveraging value-chain relationships.
problem Traditional time series models fail to capture complex interdependencies in modern markets.
method FS-GCLSTM integrates value-chain networks and graph convolutions to predict stock returns.
result FS-GCLSTM consistently delivers superior portfolio performance compared to traditional models.
Proposes MSTD-RCNN for improved financial time-series classification.
problem Combining Multi-Scale and Temporal Dependency for better financial time-series classification.
method Multi-Scale Temporal Dependent Recurrent Convolutional Neural Network (MSTD-RCNN).
result Achieves state-of-the-art performance in trend classification and simulated trading.
Convolutional neural networks learn effective summary statistics for ABC inference.
problem Selecting high-quality summary statistics for accurate ABC inference in complex systems.
method Proposes a CNN architecture to automatically learn informative summary statistics from time series data.
result CNNs can effectively circumvent the statistics selection problem in ABC inference.
Spatiotemporal forecasting has various applications in neuroscience, climate and transportation domain. Traffic forecasting is one canonical example of such learning task. The task is challenging due to (1) complex spatial dependency on road networks, (2) non-linear temporal dynamics with changing road conditions and (…
Accurately estimating the remaining useful life (RUL) of industrial machinery is beneficial in many real-world applications. Estimation techniques have mainly utilized linear models or neural network based approaches with a focus on short term time dependencies. This paper, introduces a system model that incorporates t…
Customer temporal behavioral data was represented as images in order to perform churn prediction by leveraging deep learning architectures prominent in image classification. Supervised learning was performed on labeled data of over 6 million customers using deep convolutional neural networks, which achieved an AUC of 0…
Deep CNN predicts disruptions in fusion plasmas with high accuracy.
problem Predicting plasma events in fusion devices with multi-scale, multi-physics characteristics.
method Deep convolutional neural networks (CNN) with dilated convolutions trained on ECEi diagnostic data.
result Deep CNN achieves an F1-score of ~91% on disruption prediction.
DACNN improves skeleton-based action recognition and segmentation.
problem Lack of spatial relationships and non-uniform temporal scalings in skeleton-based data.
method Introduces deep-aligned convolutional neural network (DACNN) with new filters trained on local subsequences.
result DACNN achieves competitive performance compared to state-of-the-art models.
Framework reconstructs missing spatio-temporal data for extreme value prediction.
problem Predicting extreme values from incomplete spatio-temporal data.
method Convolutional deep neural networks and autoencoder-like models for conditional sampling.
result Framework produces accurate reconstructions of missing data for extremal values.
Deep neural networks predict earthquake locations with high accuracy.
problem Predicting the location of earthquakes with high precision.
method Recurrent Convolutional Neural Networks (R-CNN) model that accounts for spatio-temporal dependencies.
result Neural networks model outperforms baseline models in predicting earthquakes with ROC AUC 0.975 and PR AUC 0.0890.
AGCRN forecasts traffic using adaptive graph and recurrent learning.
problem Forecasting traffic dynamics with complex spatial and temporal correlations.
method Adaptive Graph Convolutional Recurrent Network (AGCRN) with Node Adaptive Parameter Learning (NAPL) and Data Adaptive Graph Generation (DAGG).
result AGCRN outperforms state-of-the-art models without pre-defined graphs.
New neural networks model for spatio-temporal data.
problem Building a mapping from spatially encoded time series covariates to real-valued response data.
method Proposed two novel extensions of Functional Neural Network (FNN) for spatio-temporal regression.
result Demonstrated effectiveness in handling varying spatial correlations through comprehensive simulation studies.
DISTANA predicts and denoises spatial wave dynamics.
problem Identifying causality in spatially distributed, non-linear dynamical processes.
method Generative, recurrent graph convolution neural network architecture (DISTANA).
result DISTANA outperforms alternative approaches in denoising and predicting complex spatial wave propagation.
Proposes ECLSTM for more accurate RUL estimation from time series data.
problem Predicting Remaining Useful Life (RUL) from multivariate time series data.
method Embedded Convolutional LSTM (ECLSTM) with automated hyperparameter optimization.
result ECLSTM outperforms state-of-the-art approaches on benchmark data sets.
PhICNet combines physics and deep learning for forecasting and source identification in dynamical systems.
problem Forecasting and identifying unobservable external sources in spatio-temporal dynamical systems.
method Physics-Incorporated Convolutional Recurrent Neural Network (PhICNet).
result PhICNet can forecast dynamics and identify sources for relatively long periods.
Graph Neural Networks improve volatility prediction in financial markets.
problem Traditional models struggle with complex, non-linear interdependencies in financial markets.
method Temporal Graph Attention Network (Temporal GAT) combines GCNs and GATs to capture dynamic graph structures.
result Temporal GAT outperforms traditional GARCH models in volatility forecasting, especially for short- to mid-term predictions.
TSAM predicts directed temporal links using GCN and self-attention.
problem Predicting links in directed temporal networks.
method GCN, self-attention mechanism, autoencoder architecture, graph attentional layers, graph convolutional layers, graph recurrent unit layer.
result TSAM outperforms benchmarks on four realistic networks.
Paper uses HGNN to predict stock types from relationships and temporal data.
problem Predicting stock types from complex market data.
method Integrates stock relationships and temporal data using HGNN.
result Effective prediction of stock types with HGNN model.
Improved anomaly detection in time series data using kervolutional neural networks.
problem Anomaly detection in time series data.
method Mixed kervolutional and convolutional layers in a temporal auto-encoder.
result The mixed model detects anomalies more sensitively in time series data.
DeepIST uses CNNs to estimate travel time from path images.
problem Accurately estimating travel time for a path in urban transportation systems.
method Proposes DeepIST, a neural network framework that converts paths into generalized images and uses PathCNN and 1D CNN to capture spatial and temporal patterns.
result DeepIST significantly outperforms existing models in travel time estimation.
New method uses neural networks to forecast spatial-temporal data.
problem Probabilistic forecasting of spatio-temporal data with causal structure.
method MMAF-guided learning with ensemble of stochastic feed-forward neural networks.
result Forecasting remains calibrated across multiple time horizons.
This paper tackles spatio-temporal information preservation in machine learning.
problem Conventional machine learning assumes orthogonal data attributes, disrupting spatio-temporal information.
method Shift-invariant k-means, convolutional dictionary learning, and spatio-temporal hypercomplex encoding schemes are proposed.
result Gabor feature extraction outperforms convolutional dictionary learning in spatio-temporal information preservation.
A novel approach predicts long-term stock price trends using 2D-convolutional encoders and semantic segmentation.
problem Predicting long-term daily stock price changes with deep learning models.
method Proposes a hierarchical CNN structure with Atrous Spatial Pyramid Pooling blocks to capture both long and short-term temporal relationships.
result Achieved overall accuracy and AUC of 78.18% and 0.88 for predicting trends over the next 20 days.
Deep convolutional neural networks comprise a subclass of deep neural networks (DNN) with a constrained architecture that leverages the spatial and temporal structure of the domain they model. Convolutional networks achieve the best predictive performance in areas such as speech and image recognition by hierarchically …