Survey of data augmentation techniques for time series classification with neural networks.
problem Small datasets in time series recognition.
method Four families of data augmentation: transformation-based, pattern mixing, generative models, and decomposition methods.
result Empirical evaluation of 12 data augmentation methods on 128 datasets.
Proposes a neural network for handling multi-sensor time series with varying input dimensions.
problem Handling multi-sensor time series with varying input dimensions.
method Graph neural network conditioning vectors for zero-shot transfer learning.
result Better generalization in activity recognition and equipment prognostics datasets.
TFM trains Neural SDEs without backpropagation, improving clinical time series modeling.
problem Modeling irregularly sampled time series in medicine.
method Trajectory Flow Matching (TFM) using flow matching for generative modeling.
result TFM improves performance on clinical time series datasets.
ARMA cell simplifies neural autoregressive modeling for time series.
problem Complex RNN cells are not always necessary and can be inferior.
method Introduces ARMA cell, a simpler, modular approach for neural time series modeling.
result The ARMA cell is competitive with popular alternatives in performance.
Meta-learning for Koopman spectral analysis with short time-series data.
problem Lack of long time-series for training embedding functions in Koopman spectral analysis.
method Meta-learning approach using bidirectional LSTM and neural network to estimate embedding functions from short time-series.
result The proposed method achieves better performance in eigenvalue estimation and future prediction compared to existing methods.
fSDE-Net generates time series with long-term memory using neural networks.
problem Generating time series with long-term memory from irregularly sampled data.
method fSDE-Net: neural fractional Stochastic Differential Equation Network using fractional Brownian motion.
result fSDE-Net can replicate distributional properties of real time-series data.
A model combines GRU-D for missing data and Neural ODEs for time series continuity.
problem Challenges of informative missingness in multivariate time series data.
method Combines GRU-D for missing data imputation and Neural ODEs for temporal continuity.
result Demonstrates improved performance on a time series classification task.
ANCDEs improve time-series forecasting and classification using attention in NCDEs.
problem Improving time-series forecasting and classification using neural controlled differential equations.
method Integrating attention into neural controlled differential equations (ANCDEs).
result ANCDEs consistently show the best accuracy in time-series classification and forecasting.
NTW aligns multiple time-series data efficiently using neural networks.
problem Multiple sequence alignment for time-series analyses.
method Neural time warping that relaxes the MSA to a continuous optimization problem.
result NTW successfully aligns a hundred time-series and outperforms existing methods.
Multivariate time series classification is a high value and well-known problem in machine learning community. Feature extraction is a main step in classification tasks. Traditional approaches employ hand-crafted features for classification while convolutional neural networks (CNN) are able to extract features automatic…
Improved anomaly detection in time series data using kervolutional neural networks.
problem Anomaly detection in time series data.
method Mixed kervolutional and convolutional layers in a temporal auto-encoder.
result The mixed model detects anomalies more sensitively in time series data.
Guided warping augments time series data by aligning features with a teacher.
problem Small time series datasets limit neural network performance.
method Guided warping with a discriminative teacher to augment data deterministically.
result Significant improvement in performance on various time series datasets.
Graph Neural Networks improve financial time series forecasting accuracy.
problem Forecasting univariate financial time series with statistical significance.
method Introducing the Time-Geometric model combining geometric and temporal patterns.
result Statistically significant improvements in forecasting accuracy through geometric patterns.
Sig-Splines model uses signatures and splines for time series data, achieving universality and convexity.
problem Creating a generative model for multivariate time series data.
method Combines linear transformations and signature transforms into a neural spline flow.
result Achieves universality and introduces convexity in model parameters.
Model predicts competition between similar products in sales.
problem Predicting cannibalization between similar products in sales.
method Developed a neural network model that computes a 'competitiveness' function based on product features.
result The model outperforms traditional methods in predicting market share.
Global models outperform local models in forecasting intermittent time series.
problem Forecasting intermittent time series with zeros in supply chains.
method Comparison of state-of-the-art probabilistic local and global models on five datasets.
result TiDE, a simple neural network architecture, achieves the best accuracy among global models.
RobustTAD detects anomalies in diverse time series data.
problem Effective anomaly detection for complex time series data.
method Robust seasonal-trend decomposition + CNN architecture with data augmentation.
result RobustTAD outperforms other methods on public datasets.
EDAIN layer normalizes time series data for neural networks, improving model performance.
problem Irregularities in time series data degrade model performance in neural networks.
method EDAIN layer learns adaptive normalization parameters during end-to-end training.
result EDAIN layer outperforms conventional normalization methods and adaptive layers.
Improved prediction of hierarchical time series using structured regularization.
problem Making coherent forecasts for hierarchical time series.
method Structured regularization method for bottom-level time series predictions.
result Superior prediction accuracy and computational efficiency compared to previous methods.
Time series forecasting is difficult. It is difficult even for recurrent neural networks with their inherent ability to learn sequentiality. This article presents a recurrent neural network based time series forecasting framework covering feature engineering, feature importances, point and interval predictions, and for…
Proposes adjusting neural network errors for time series forecasting.
problem Autocorrelated errors in neural networks for time series.
method Jointly learn autocorrelation coefficient with model parameters.
result Enhances performance in almost all time series forecasting cases.
Proposes neural SDEs with change points for better time series modeling.
problem Restrictions in modeling time series with distributional shift.
method Generative adversarial networks (GANs) for SDEs and change point detection.
result Jointly learns change points and SDE model parameters.
Neural RDEs extend CDEs to irregular time series.
problem Modeling long irregular time series efficiently.
method Representing time series through log-signature and solving RDEs.
result Significant training speed-ups and improved model performance.
Develops framework for understanding deep learning in time series data.
problem Understanding and explaining decisions made by deep learning models in time series data.
method Uses deep neural networks to capture and explain temporal dependencies in time series data.
result Framework successfully captures and explains temporal dependencies in various synthetic and real-world datasets.
Paper shows how SFA fits into FBM framework for time series separation.
problem Identifying time series decomposition in flow-based models.
method Combining SFA and FBM to make time series decomposition identifiable.
result Time series decomposition becomes identifiable using SFA and FBM.
Proposes a neural network for accurate and reconciled hierarchical time series forecasting.
problem Forecasting and reconciling hierarchical time series data.
method Uses a deep neural network to directly produce accurate and reconciled forecasts, minimizing a customized loss function at training time.
result Our approach outperforms state-of-the-art competitors in hierarchical forecasting on real-world datasets.
Neural CDEs correct errors in learned time-series models for better forecasting.
problem Error accumulation in multi-step forecasts of learned time-series models.
method Predictor-Corrector framework with a neural controlled differential equation.
result The proposed framework consistently improves forecasting performance across various models.
Proposes a GNN for multivariate time-series prediction with filtering.
problem Low signal-to-noise ratio in complex systems data.
method Integrates a spatial-temporal GNN with a matrix filtering module to generate filtered graphs.
result Proposed model outperforms baseline approaches in multivariate time-series prediction.
New algorithm speeds up RNN time series prediction by filtering noise.
problem Predicting smooth trajectories from noisy time series data.
method Analyzed RNN dynamics to propose an efficient noise filtering algorithm.
result Significant speedup in predictive process without accuracy loss.
Neural GARCH models financial time series with time-varying coefficients.
problem Modeling conditional heteroskedasticity in financial time series.
method Neural network adaptation of GARCH and BEKK models with time-varying coefficients parameterized by a recurrent neural network.
result Neural Students t model consistently outperforms other models on financial time series.
The paper introduces neural INGARCH models for time series of counts.
problem Analyzing time series of counts using traditional INGARCH models.
method Combining artificial neural networks with INGARCH models.
result Neural INGARCH models outperform traditional models in information loss.
New RNN model forecasts unseen time series with little training data.
problem Lack of data for RNNs to generalize well in time series forecasting.
method Proposes a novel RNN-based model that learns shared feature embeddings over quantised time series.
result Accurately forecasts unseen time series with minimal training data.
The paper compares clustering methods for improving time series forecasting accuracy.
problem Improving time series forecasting accuracy using neural networks.
method Investigates feature-based and distance-based clustering methods for time series forecasting.
result Feature-based clustering outperforms distance-based clustering in terms of speed and efficiency.
Time series anomaly detection plays a critical role in automated monitoring systems. Most previous deep learning efforts related to time series anomaly detection were based on recurrent neural networks (RNN). In this paper, we propose a time series segmentation approach based on convolutional neural networks (CNN) for …
Time series are series of values ordered by time. This kind of data can be found in many real world settings. Classifying time series is a difficult task and an active area of research. This paper investigates the use of transfer learning in Deep Neural Networks and a 2D representation of time series known as Recurrenc…
Spatial time series forecasting problems arise in a broad range of applications, such as environmental and transportation problems. These problems are challenging because of the existence of specific spatial, short-term and long-term patterns, and the curse of dimensionality. In this paper, we propose a deep neural net…
This work combines recurrent models with diffusion for probabilistic time series forecasting.
problem Scalability and capturing high-dimensional distributions and cross-feature dependencies in time series forecasting.
method Combines recurrent neural networks' efficiency with diffusion models' probabilistic modeling, using stochastic interpolants and conditional generation.
result Offers scalable probabilistic time series forecasting methods.
NFM models time-series data directly in the Fourier domain, achieving state-of-the-art performance.
problem Traditional time-series analysis focuses on the time domain, limiting flexibility.
method NFM models time-series data in the Fourier domain, using frequency extrapolation and interpolation.
result NFM achieves state-of-the-art performance on various time-series tasks.
TimeMCL forecasts diverse time series futures using neural networks and WTA loss.
problem Forecasting multiple plausible time series futures.
method Multiple Choice Learning (MCL) framework with Winner-Takes-All (WTA) loss.
result TimeMCL efficiently predicts diverse time series futures at low computational cost.
Cyber-physical systems often consist of entities that interact with each other over time. Meanwhile, as part of the continued digitization of industrial processes, various sensor technologies are deployed that enable us to record time-varying attributes (a.k.a., time series) of such entities, thus producing correlated …
Generative Adversarial Graph Neural Network (Sig-Graph GAN) models financial time series data.
problem Challenges in generating synthetic data for non-stationary financial time series.
method Integrates time-series signature, LSTM, and GNNs with visibility graph algorithm.
result Sig-Graph GAN outperforms baseline methods in replicating time series data distributions.
New kernels boost RNN performance on non-time-series data.
problem Improving performance of RNNs on non-time-series data.
method Extended RNN kernels to complex architectures, developed fast GPU implementation.
result RNN-based classifiers outperform baselines on 90 non-time-series datasets.
NM-VQTSG improves synthetic time series fidelity by aligning distributions.
problem Fidelity challenges in VQ-based time series generation.
method Neural mapping model using U-Net to refine synthetic data.
result Significant improvements in FID, IS, and conditional FID metrics.
We use standard deep neural networks to classify univariate time series generated by discrete and continuous dynamical systems based on their chaotic or non-chaotic behaviour. Our approach to circumvent the lack of precise models for some of the most challenging real-life applications is to train different neural netwo…
Detecting structure in noisy time series is a difficult task. One intuitive feature is the notion of trend. From theoretical hints and using simulated time series, we empirically investigate the efficiency of standard recurrent neural networks (RNNs) to detect trends. We show the overall superiority and versatility of …
Combines neural networks and STL for multi-class time-series classification.
problem Lack of interpretability in neural networks for time-series data.
method Proposes a method that uses neural networks to classify time-series data using STL specifications, introducing margin for multi-class classification and STL-based attributes for interpretability.
result Evaluations show improved interpretability and performance compared to state-of-the-art baselines.
Model change points in time-series data with neural SDEs and variational autoencoders.
problem Modeling change points in time-series data with neural stochastic differential equations.
method Proposes a novel model formulation and training procedure based on the variational autoencoder framework, alternating between updating neural SDE parameters and change points.
result Demonstrates the expressive power of the proposed model in modeling both classical parametric SDEs and real datasets with distribution shifts.
This work proposes a method to learn graph structure for multivariate time series forecasting.
problem Improving multivariate time series forecasting by leveraging pairwise information.
method Learning a probabilistic graph model through optimizing mean performance over graph distribution parameterized by a neural network.
result Our method outperforms existing approaches in simplicity, efficiency, and performance.