Model compression improves dynamic forecasting ensembles while reducing computational costs.
problem High computational costs and lack of transparency in dynamic forecasting ensembles.
method Model compression applied to dynamic forecasting ensembles of various types of models.
result Compressed models achieve comparable predictive performance and significant computational savings.
Sparse deep learning improves prediction uncertainty for time series data.
problem Uncertainty quantification for dependent data like time series.
method Sparse recurrent neural networks (RNNs) for time series data.
result Sparse deep learning can consistently estimate and predict time series data with correct uncertainty quantification.
CSDM integrates compressed sensing into diffusion models for faster data generation.
problem Efficiently generating synthetic data in high-dimensional spaces.
method Integrating compressed sensing into diffusion models (CSDM) to reduce dimensionality and accelerate inference.
result Achieves provably faster convergence and better latent space dimension selection.
A new algorithm predicts periodic time series data efficiently in cloud environments.
problem Efficiently identifying and predicting periodic patterns in large-scale time-series data.
method Proposes a Periodicity-based Parallel Time Series Prediction (PPTSP) algorithm using TSDCA, MTSPPR, and PTSP methods.
result Significant improvements in prediction accuracy and performance compared to existing algorithms.
Rocket algorithm classifies time-series data efficiently using random projections and natural sparsity.
problem Time-series classification challenges in diverse fields.
method Random convolutional kernels, non-linear transformation, compressed sensing framework.
result Rocket algorithm preserves discriminative patterns in time-series data and expresses inherent sparsity.
Generalizes bits back coding for time-series models with latent Markov structures.
problem Efficiently compressing time-series data with latent Markov structures.
method Extends bits back coding to time-series models with latent Markov structures, including HMMs and LGSSMs.
result Effective for small scale models, promising for larger scale settings like video compression.
This paper investigates methods for quantifying similarity between audio signals, specifically for the task of of cover song detection. We consider an information-theoretic approach, where we compute pairwise measures of predictability between time series. We compare discrete-valued approaches operating on quantised au…
TEAFormers preserve multi-dimensional time series structures for better forecasting.
problem Traditional Transformers flatten multi-dimensional time series data, losing critical multi-dimensional relationships.
method Tensor-Augmented Transformer (TEAFormer) with Tensor-Augmentation (TEA) module.
result Significant performance enhancements in time series forecasting across benchmarks.
This paper proposes a communication-efficient deep anomaly detection framework for industrial IoT.
problem Accurately detecting anomalies in time-series data from edge devices in industrial IoT.
method A federated learning-based approach with an Attention Mechanism-based Convolutional Neural Network-Long Short Term Memory (AMCNN-LSTM) model and gradient compression.
result The proposed framework accurately and timely detects anomalies with reduced communication overhead.
What learning algorithms can be run directly on compressively-sensed data? In this work, we consider the question of accurately and efficiently computing low-rank matrix or tensor factorizations given data compressed via random projections. We examine the approach of first performing factorization in the compressed dom…
Paper ranks stocks by compression risk, not volatility.
problem Investment risk not correlated with stock price volatility.
method Binary-ternary compressive coding of price change time series.
result Compression risk is a better indicator of stock investment risk.
Method summarizes and predicts time series data for COVID-19 cases and deaths.
problem Summarizing and predicting time series data for multiple related time series.
method Hierarchical algorithm generating shapelets for centroids, nearest neighbor search for labeling, dynamic time warping for non-uniform lengths.
result Predictive model for individual time series based on aggregated statistics.
Clinical measurements collected over time are naturally represented as multivariate time series (MTS), which often contain missing data. An autoencoder can learn low dimensional vectorial representations of MTS that preserve important data characteristics, but cannot deal explicitly with missing data. In this work, we …
Proposes a parsimonious graph spectral method for time series data.
problem Efficiently transmitting multivariate time series data.
method Graph spectral embedding with unsupervised, parsimonious encoding.
result Near-linear computational complexity and interpretable event structure.
We propose a new method of discovering causal relationships in temporal data based on the notion of causal compression. To this end, we adopt the Pearlian graph setting and the directed information as an information theoretic tool for quantifying causality. We introduce chain rule for directed information and use it to…
A novel unsupervised method detects anomalies in time series data robust to warping.
problem Detecting anomalies in time series data is challenging due to warping and lack of labeled data.
method WaRTEm-AD method operates in two stages: representation learning through autoencoders and anomaly detection on learned representations.
result WaRTEm-AD effectively detects both point and sequence anomalies in time series data.
A new neural network reduces high-dimensional time-series data for faster classification.
problem Classifying high-dimensional time-series patterns efficiently.
method Developed a time-series discriminant component network (TSDCN) using TSDCA for dimensionality reduction and classification.
result The TSDCN achieves high-accuracy classification and reduces training time.
Scalable method for regionalizing and extracting temporal patterns from time series data.
problem Static spatial snapshots and ad hoc regularization limit effective spatial analysis and resource management.
method Minimum description length principle for fully nonparametric spatial partitioning and time series archetypes.
result Accurately recovers planted regional structure and drivers in synthetic and empirical data.
The paper uses neural networks to forecast time series data.
problem Forecasting high-dimensional stationary processes.
method Encoder-decoder neural network structure to model past observations.
result Upper bounds for forecast error under specific assumptions.
New method uses SDEs for accurate non-uniformly sampled time series analysis.
problem Characterizing non-uniformly sampled time series with high accuracy.
method Stochastic Differential Equations (SDEs) for modeling, incremental estimation, and model truncation.
result Increased accuracy in characterizing non-uniformly sampled time series.
NM-VQTSG improves synthetic time series fidelity by aligning distributions.
problem Fidelity challenges in VQ-based time series generation.
method Neural mapping model using U-Net to refine synthetic data.
result Significant improvements in FID, IS, and conditional FID metrics.
Enhances time series comparison by simplifying warping paths.
problem Lack of qualitative comparison on top of elastic distance measures.
method Proposes a technique to simplify warping paths for better visualization and interpretation.
result Clearer representation of how subsequences match between time series.
Designing a data sharing mechanism without sacrificing too much privacy can be considered as a game between data holders and malicious attackers. This paper describes a compressive adversarial privacy framework that captures the trade-off between the data privacy and utility. We characterize the optimal data releasing …
Proposes a method to detect anomalies in financial time series using PCA and neural networks.
problem Anomalies in financial time series lead to miscalibrated risk models.
method Extract features using PCA, define anomaly score with neural network, calibrate cutoff value.
result The proposed PCA NN approach outperforms other anomaly detection methods.
We perform wavelet decomposition of high frequency financial time series into large and small time scale components. Taking the FTSE100 index as a case study, and working with the Haar basis, it turns out that the small scale component defined by most (≃ 99.6%) of the wavelet coefficients can be neglected for th…
Proposes ACLAE-DT for unsupervised anomaly detection in multivariate time series.
problem Challenges in building anomaly detection frameworks for multivariate time series data.
method Attention-based ConvLSTM Autoencoder with Dynamic Thresholding.
result Demonstrates superior performance over state-of-the-art methods.
We propose a novel Bayesian approach to modelling nonlinear alignments of time series based on latent shared information. We apply the method to the real-world problem of finding common structure in the sensor data of wind turbines introduced by the underlying latent and turbulent wind field. The proposed model allows …
HiPPO framework optimizes memory compression for sequential data.
problem Incremental representation of cumulative history in sequential data.
method Optimal polynomial projections for online function approximation.
result HiPPO-LegS achieves state-of-the-art accuracy on MNIST.
We propose a method for inferring the conditional indepen- dence graph (CIG) of a high-dimensional discrete-time Gaus- sian vector random process from finite-length observations. Our approach does not rely on a parametric model (such as, e.g., an autoregressive model) for the vector random process; rather, it only assu…
ABBA creates a new symbolic time series representation based on Brownian bridge.
problem Representing time series data in a compact, symbolic form.
method Adaptive polygonal chain approximation followed by mean-based clustering.
result ABBA outperforms other representations in preserving time series shape information.
RONA compresses complex models while ensuring privacy.
problem Deploying complex deep neural networks on mobile devices poses privacy risks and computational constraints.
method RONA uses knowledge distillation, hint learning, and self learning to train a compact neural network with differential privacy guarantees.
result RONA achieves 20x compression and 19x speed-up with 0.97% accuracy loss on SVHN while maintaining strong privacy.
Locally private methods detect changes in time series data.
problem Detecting distributional changes in time series data under local differential privacy.
method Proposed locally differentially private algorithms based on randomized response and binary mechanisms.
result Theoretical performance bounds and empirical validation of detection accuracy.
Proposes BHT-ARIMA for forecasting multiple short time series.
problem Forecasting multiple short time series with mutual correlations.
method Block Hankel tensors, Tucker decomposition, generalized tensor ARIMA.
result Improves forecasting accuracy and reduces computational cost.
PCRs compress data for deep learning, reducing training time.
problem Efficiently training deep learning models over large datasets.
method Combining progressive compression with an efficient storage layout.
result PCRs can tolerate up to 50% compression without significantly affecting training accuracy.
Local well-posedness proved for 3D compressible Euler equations with rough vorticity.
problem Proving local well-posedness for compressible Euler equations with rough vorticity.
method Decomposing velocity into irrotational and wave components, using cancellations, trilinear estimates, and Strichartz estimates.
result Local well-posedness achieved for compressible Euler equations in Hs with s>2 for rough vorticity. This work compresses sequences by treating them as continuous-time processes, enabling efficient discretization.
problem Efficient compression of sequences, especially with deep learning models that scale with sequence length.
method Treat sequences as continuous-time processes, learn efficient discretization, and decode at different time intervals.
result Automatic bit rate reductions in video and motion capture sequences using learned discretization.
Compressed sensing improves MRI scans with data-driven learning.
problem Challenges in applying compressed sensing from research to clinical practice.
method Data-driven learning to address challenges of hand-crafted priors, tuning parameters, and long reconstruction times.
result Compressed sensing can have greater clinical impact with data-driven learning.
JANA trains networks to approximate Bayesian models efficiently.
problem Intractable likelihood functions and posterior densities in Bayesian models.
method End-to-end training of three networks: summary, posterior, and likelihood networks.
result JANA provides accurate amortized marginal likelihood and posterior predictive estimation.
Reinforcement Patching optimizes dynamic sequence patching for efficient time series forecasting.
problem Efficiently learning data-adaptive representations for long-horizon sequence data, especially continuous sequences.
method Reinforcement Patching (ReinPatch) uses reinforcement learning to optimize dynamic patching policies and sequence backbones.
result ReinPatch achieves compelling performance in time-series forecasting compared to state-of-the-art methods.
IoT nodes compress measurements into DNN outputs for efficient communication.
problem Efficient communication of high-dimensional IoT data with limited bandwidth.
method Modeling IoT node measurements as DNN intermediate outputs and optimizing model parameters.
result Approximately 96% reduction in transmissions with only 2.5% loss in inference accuracy.
Integrating wind power into the grid is challenging because of its random nature. Integration is facilitated with accurate short-term forecasts of wind power. The paper presents a spatio-temporal wind speed forecasting algorithm that incorporates the time series data of a target station and data of surrounding stations…
COIN++ compresses multiple data types efficiently.
problem Handling diverse data modalities in neural compression.
method Implicit neural representations and modulations quantization.
result Significant compression gains with reduced encoding time.
Generative adversarial networks create realistic equity option market simulations.
problem Limited real-world data for training and evaluating option trading strategies.
method Recurrent and temporal convolutional architectures with state compression.
result GANs outperform classical methods on benchmark metrics.
Often the analysis of time-dependent chemical and biophysical systems produces high-dimensional time-series data for which it can be difficult to interpret which individual features are most salient. While recent work from our group and others has demonstrated the utility of time-lagged co-variate models to study such …
Advances understanding of neural network generalization via tensor analysis.
problem Understanding the generalizability of deep neural networks.
method Tensor analysis to measure compressibility and generalizability.
result Proposed generalization bound outperforms previous methods, especially for tensor-based networks.
Distributed sensors compress and send features to a fusion center for linear regression.
problem Efficiently compress and transmit features from distributed sensors to a fusion center under varying communication constraints.
method Designs a distributed and adaptive feature compression scheme using optimal quantizers and simple adaptive strategies.
result Demonstrates improved inference performance through simulated experiments.
Paper compresses RNNs using HT decomposition for better performance.
problem Large model sizes of RNNs in sequence analysis.
method Hierarchical Tucker (HT) tensor decomposition for model compression.
result HT-LSTM achieves better compression and accuracy than state-of-the-art methods.
BCAE-2D compresses 3D data from a time projection chamber at high speed.
problem Compressing high-speed, sparse 3D data from a time projection chamber.
method 2D Bicephalous Convolutional Autoencoder (BCAE-2D) approach.
result 3x speedup in compression throughput with improved reconstruction accuracy.