New framework analyzes temporal features in state space models.
problem Understanding temporal dependencies in data streams.
method Proposes a framework for rigorous analysis of state representations in ESNs, using temporal feature spaces and kernel machines.
result Phase transition in kernel richness for cycle reservoir topology.
Temporal-difference and Q-learning learn feature representations that converge to optimal ones.
problem Understanding how feature representations evolve in temporal-difference and Q-learning with neural networks.
method Mean-field theory applied to overparameterized two-layer neural networks.
result The feature representation converges to the optimal one, generalizing previous results.
Bayesian framework extracts features from high-dimensional spatio-temporal data.
problem Sparse structure and spatio-temporal dependence in high-dimensional data.
method Develops a Bayesian feature-extraction framework using Gaussian and Diffused-gamma priors, employing Bregman divergence likelihood and MCMC for posterior computation.
result Improves recovery of sparse features and enhances interpretability in the presence of spatio-temporal dependence.
RTFN extracts robust temporal features for time series analysis.
problem Challenges in extracting sufficient shapelets from time series data.
method Combines temporal feature networks and attentional LSTM networks.
result RTFN outperforms in supervised and unsupervised time series analysis.
TGAT learns node embeddings for evolving graphs, capturing both static and temporal features.
problem Learning node embeddings for dynamic graphs with evolving topological structures and temporal patterns.
method Temporal Graph Attention (TGAT) layer using self-attention and functional time encoding.
result TGAT model can inductively infer node embeddings for new and observed nodes as the graph evolves.
TIME explains temporal models by analyzing feature importance.
problem Existing methods struggle with temporal models and feature importance.
method Model-agnostic permutation-based approach, temporal feature importance, hypothesis testing.
result TIME provides statistical rigor for explaining temporal models.
We propose the application of a high-speed maximum likelihood clustering algorithm to detect temporal financial market states, using correlation matrices estimated from intraday market microstructure features. We first determine the ex-ante intraday temporal cluster configurations to identify market states, and then st…
Wind power prediction is of vital importance in wind power utilization. There have been a lot of researches based on the time series of the wind power or speed, but In fact, these time series cannot express the temporal and spatial changes of wind, which fundamentally hinders the advance of wind power prediction. In th…
A novel distance measure aligns time series with feature and temporal variability.
problem Measuring similarity between time series with different features and dynamics.
method Learn a latent global transformation and temporal alignment in a joint optimization problem.
result Framework robustly aligns time series across various invariance classes.
This paper uses Reinforcement Learning to select features from a large dataset.
problem Selecting the best features to minimize variance and bias in machine learning models.
method Formulated the feature selection problem as a Markov Decision Process (MDP) and used Temporal Difference (TD) algorithm.
result The approach using Reinforcement Learning outperformed other methods in selecting features.
A new method learns stable, temporally coherent features in point clouds.
problem Flickering and halo structures in inferred solutions for time-varying point clouds.
method Proposes a novel temporal loss function and super-resolution method.
result Demonstrates flexibility and effectiveness on large, deforming point sets.
Combines CNN and LSTM for spatio-temporal graph networks.
problem Improving spatio-temporal feature extraction.
method Proposes a new architecture combining CNN and LSTM temporal blocks.
result Empirical comparison shows our model outperforms existing models.
Model predicts severity of traffic accidents using spatial and temporal features.
problem Estimating severity of traffic accidents in aggregated and disaggregated data.
method Gradient Boosting models and Gaussian Processes for inference and feature importance.
result Complexity of road networks and other situational features significantly impact accident severity.
Paper introduces TSSDMN for modeling dynamic multilayer networks.
problem Capturing temporal and cross-layer dynamics in multilayer networks.
method Tensor State Space Model (TSSDMN) using symmetric Tucker decomposition.
result TSSDMN uniquely captures temporal dynamics within and across layers.
Enhances SNNs for spatio-temporal feature extraction.
problem Insufficient temporal dependencies in existing SNN synaptic structures.
method Integrates temporal convolution and attention mechanisms into synaptic connections.
result Improves SNN performance on classification tasks.
New graph kernels capture spatio-temporal interactions.
problem Lack of justified spatio-temporal graph kernels for graph problems.
method Derive graph kernels via SPDEs for spatio-temporal modelling.
result Non-separable spatio-temporal graph kernels outperform existing ones.
A new model predicts network events with improved accuracy and interpretability.
problem Predicting and understanding complex dynamic relational data in networks.
method Mutually Exciting Latent Space Hawkes (LSH) model for continuous-time networks.
result The LSH model outperforms existing models in prediction accuracy and interpretability.
This paper addresses the energy disaggregation problem, i.e. decomposing the electricity signal of a whole home to its operating devices. First, we cast the problem as a dictionary learning (DL) problem where the key electricity patterns representing consumption behaviors are extracted for each device and stored in a d…
FIBS extracts relevant features from IBTSs for classification.
problem Classifying interval-based temporal sequences (IBTSs) using common algorithms is challenging.
method FIBS extracts features from IBTSs based on relative frequency and temporal relations, incorporating a filter-based selection strategy to avoid irrelevant features.
result FIBS effectively represents IBTSs for classification algorithms, providing similar or better accuracy compared to state-of-the-art competitors.
Proposes a new tensor decomposition method for functional temporal data with adaptive complexity.
problem Challenges in temporal tensor decomposition for general tensor data with continuous indexes.
method Encodes continuous spatial indexes as learnable Fourier features and uses neural ODEs for temporal trajectories. Introduces a sparsity-inducing prior for complexity adaptation.
result Significantly outperforms existing methods in prediction performance and robustness against noise.
Oddnet detects anomalies in dynamic networks using time series methods.
problem Detecting anomalies in temporal networks (e.g., transport, social networks).
method Feature-based network anomaly detection using time series methods.
result Demonstrated effectiveness on synthetic and real-world datasets.
The visual systems of many mammals, including humans, is able to integrate the geometric information of visual stimuli and to perform cognitive tasks already at the first stages of the cortical processing. This is thought to be the result of a combination of mechanisms, which include feature extraction at single cell l…
Accurately predicting customer churn using large scale time-series data is a common problem facing many business domains. The creation of model features across various time windows for training and testing can be particularly challenging due to temporal issues common to time-series data. In this paper, we will explore …
Novel framework for spatio-temporal event analysis using Hawkes processes.
problem Inference of dynamics in spatio-temporal event sequences.
method Randomized Fourier feature-based transformations and gradient descent.
result Improved fitting capability in synthetic and real datasets.
MIP framework improves urban flow prediction by adapting to distribution shifts.
problem Distribution shifts in urban flow data make prediction models unreliable.
method Memory-enhanced Invariant Prompt learning with learnable memory bank.
result MIP ensures robust predictions by focusing on invariant features.
Capsule networks improve temporal data understanding, achieving 96.21% ECG accuracy.
problem Improving temporal data understanding with capsule networks.
method Generated capsules along temporal and channel dimensions, learning contrasting relationships.
result Achieved 96.21% accuracy on ECG signal beat categories, surpassing state-of-the-art.
TSAM predicts directed temporal links using GCN and self-attention.
problem Predicting links in directed temporal networks.
method GCN, self-attention mechanism, autoencoder architecture, graph attentional layers, graph convolutional layers, graph recurrent unit layer.
result TSAM outperforms benchmarks on four realistic networks.
STAS selects optimal spatio-temporal scales for bias correction in precipitation forecasts.
problem Limited prior data and fixed ST scale in existing BCoPs lead to biases in numerical weather predictions.
method End-to-end deep-learning BCoP model STAS with SFM/TFM to automatically adjust spatial and temporal scales.
result STAS outperforms 8 published BCoP methods on threat scores (TS).
Hybrid model improves COVID-19 case forecasting accuracy.
problem Limited data and simplistic models for accurate prediction.
method Combining SEIR and RNN on a graph structure with local and edge features.
result Improves prediction accuracy on state-level COVID-19 data.
GTEA learns node representations in temporal interaction graphs.
problem Inductive representation learning on temporal interaction graphs.
method Integrates sequence model with time encoder and self-attention scheme for edge and node embeddings.
result GTEA learns comprehensive node representations capturing temporal and structural characteristics.
A framework uses deep learning for spatio-temporal data prediction.
problem Interpolation of continuous spatio-temporal fields on irregular points.
method Decomposes spatio-temporal processes into products of basis functions and spatial coefficients.
result Effectiveness in reconstructing coherent spatio-temporal fields.
Study on reinforcement learning dynamics using statistical physics.
problem Understanding how reinforcement learning dynamics interact with parameters and state features.
method Statistical physics concepts applied to temporal difference learning with linear function approximators.
result Stochastic semi-gradient noise leads to significant plateaus in value error.
Unsupervised learning of time series data, also known as temporal clustering, is a challenging problem in machine learning. Here we propose a novel algorithm, Deep Temporal Clustering (DTC), to naturally integrate dimensionality reduction and temporal clustering into a single end-to-end learning framework, fully unsupe…
StrGNN detects anomalies in dynamic graphs by analyzing subgraphs and temporal features.
problem Detecting anomalies in dynamic graphs with structural changes.
method StrGNN is an end-to-end model that uses structural subgraphs and temporal features for anomaly detection.
result StrGNN effectively detects anomalies in dynamic graphs, as shown by extensive experiments.
Recent results in coupled or temporal graphical models offer schemes for estimating the relationship structure between features when the data come from related (but distinct) longitudinal sources. A novel application of these ideas is for analyzing group-level differences, i.e., in identifying if trends of estimated ob…
HRTPP improves TPP interpretability and accuracy in medical event modeling.
problem Lack of interpretability in TPPs for medical event sequences.
method Hybrid-Rule Temporal Point Processes (HRTPP) integrating temporal logic rules and numerical features.
result HRTPP outperforms state-of-the-art interpretable TPPs in predictive performance and clinical interpretability.
Paper tackles class-incremental time series classification with dual-stream feature extraction.
problem Class-incremental continual learning for multivariate time series data.
method Dual-stream feature extraction pipeline combining deep temporal embedding features and statistical features.
result Competitive average accuracy across multiple datasets with low forgetting rates.
Method improves clarity in forecasting spatio-temporal data.
problem Forecasting spatio-temporal data with clarity and interpretability.
method Supervised semi-nonnegative matrix factorization with frequency regularization.
result Method offers clearer interpretability in forecasting spatio-temporal data.
SeqFM models dynamic and sequential features for better predictive analytics.
problem Inadequate handling of sequential dependencies in existing FM-based models.
method Introduces SeqFM, a novel model that incorporates multi-view self-attention to model static, dynamic, and their interactions.
result SeqFM outperforms existing models in ranking, classification, and regression tasks on six large-scale datasets.
STAD adapts models to evolving time-based data shifts.
problem Gradual distribution shifts over time challenge existing test-time adaptation methods.
method Bayesian filtering method that learns time-varying dynamics in hidden features.
result STAD excels in handling small batch sizes and label shift on real-world data.
This paper tackles spatio-temporal information preservation in machine learning.
problem Conventional machine learning assumes orthogonal data attributes, disrupting spatio-temporal information.
method Shift-invariant k-means, convolutional dictionary learning, and spatio-temporal hypercomplex encoding schemes are proposed.
result Gabor feature extraction outperforms convolutional dictionary learning in spatio-temporal information preservation.
IETNet identifies important channels for MVTS classification.
problem Multivariate time series classification with blackbox deep networks.
method End-to-end network combining temporal feature extraction, variable selection, and interaction.
result IETNet improves model accuracy and reduces overfitting by identifying and removing non-predictive variables.
HTGCN improves community detection in dynamic, heterogeneous graphs.
problem Challenges in detecting communities in graphs with varying features and temporal dynamics.
method Designs HTGCN combining heterogeneous GCN and residual compressed aggregation for dynamic feature representation.
result HTGCN outperforms existing methods on DBLP and IMDB datasets.
New framework for analyzing hydroclimatic time series across multiple scales.
problem Understanding geophysical processes and evaluating stochastic models across different time scales.
method A novel feature compilation method for multi-scale hydroclimatic analyses.
result Identified similarities and differences in time series types across various temporal resolutions.
Proposes a feature transformation for spatio-temporal traffic models to improve performance and transferability.
problem Limited transferability of deep learning models for traffic flow prediction across different locations.
method Integrates Newell's traffic flow estimators to capture broader dynamics and incorporates spatial dependencies.
result Improves model performance in predicting traffic flows over different horizons.
CODA simulates future data to generalize models across different datasets.
problem Concept drift in real-world machine learning models.
method CODA framework using a predicted feature correlation matrix to simulate future data.
result CODA effectively achieves temporal domain generalization across different model architectures.
The spatio-temporal graph learning is becoming an increasingly important object of graph study. Many application domains involve highly dynamic graphs where temporal information is crucial, e.g. traffic networks and financial transaction graphs. Despite the constant progress made on learning structured data, there is s…
Acoustic scenes are rich and redundant in their content. In this work, we present a spatio-temporal attention pooling layer coupled with a convolutional recurrent neural network to learn from patterns that are discriminative while suppressing those that are irrelevant for acoustic scene classification. The convolutiona…