Time series foundation models are well-calibrated, improving over baseline models.
problem Calibration of time series foundation models for practical applications.
method Systematic evaluations of five time series foundation models and two baselines, assessing calibration, prediction heads, and long-term forecasting.
result Time series foundation models are consistently better calibrated than baseline models and do not show over- or under-confidence.
New measure assesses time series pre-training data quality without labels.
problem Challenges in collecting diverse pre-training datasets for time series classification.
method Contrastive-learning-based foundation model and contrastive accuracy measure.
result Contrastive accuracy correlates with model performance on downstream tasks.
Paper introduces TS-GPT for engineering time series forecasting.
problem Engineering time series require causal operations, unlike linguistic data.
method Innovations representation theory, Generative Pre-trained Transformer.
result TS-GPT effectively forecasts real-time locational marginal prices.
Foundation models improve time series prediction reliability, especially with limited data.
problem Improving time series prediction reliability with limited data.
method Comparison of Time Series Foundation Models (TSFMs) with traditional methods in conformal prediction.
result TSFMs provide more reliable conformalized prediction intervals and more stable calibration with limited data.
Study evaluates interpretability of time series foundation models' latent spaces.
problem Improving interpretability of latent spaces in time series models for visual analytics.
method Evaluated MOMENT family of transformer-based models on five datasets, fine-tuning for performance.
result Fine-tuning improved latent space clarity but limited interpretability remained.
GIFT-Eval benchmarks time series forecasting models across diverse datasets.
problem Lack of comprehensive benchmarks for evaluating time series foundation models.
method Developed GIFT-Eval, a benchmark with 23 datasets, 177 million data points, and 144,000 time series.
result Promotes evaluation of foundation models across various domains and frequencies.
UniShape improves time series classification by selecting relevant subsequences.
problem Classifying time series data requires capturing interpretable shapelets.
method UniShape uses a shape-aware adapter to aggregate multiscale subsequences into class tokens.
result UniShape achieves state-of-the-art classification performance.
Paper speeds up large foundation models for time series data.
problem Resource-intensive foundation models limit accessibility.
method Dimensionality reduction techniques, including PCA and neural network adapters.
result Up to 10x speedup and 4.5x more datasets fit on a single GPU.
Mantis improves time series classification using a transformer model trained on synthetic data.
problem Insufficient application of foundation models to time series classification.
method Pre-trained transformer model on synthetic data, enhanced test-time methodology.
result Mantis achieves state-of-the-art performance across diverse datasets.
Paper presents a copula-based method to efficiently generate correlated sample paths from multi-step time series models.
problem Generating realistic correlation structures in multi-step forecast sample paths is expensive and time-consuming.
method Copula-based approach to generate correlated sample paths in one forward pass.
result Improved sample path quality and significant speedup over autoregressive sampling.
Moirai-MoE improves time series forecasting by automatically specializing tokens without human-defined frequency.
problem Unified training on time series data remains challenging due to heterogeneity and non-stationarity.
method Uses sparse mixture of experts (MoE) within Transformers to automatically specialize tokens for diverse time series patterns.
result Moirai-MoE outperforms existing foundation models in both in-distribution and zero-shot scenarios.
Enhanced TSFMs improve time series forecasting accuracy and reliability.
problem Variance, bias, and uncertainty in TSFMs' predictions on real data.
method Statistical and ensemble techniques including bagging, stacking, residual modeling, and prediction intervals.
result Hybrid models consistently outperform standalone TSFMs across multiple horizons.
Foundation models outperform supervised methods in time series forecasting across various operational regimes.
problem Lack of domain-specific training and ongoing maintenance in supervised learning for time series forecasting.
method Evaluation of foundation models against standard supervised approaches across four operational regimes: periodic, physically constrained, stochastic, and demand forecasting.
result Foundation models are optimal for cold-start or long-tail scenarios and perform well in domains with transferable periodic structures.
Chronos models improve financial forecasting by integrating multivariate data.
problem Improving financial forecasting accuracy using multivariate data.
method Evaluation of Chronos-2 on multivariate and univariate financial forecasting models.
result Multivariate forecasts consistently outperform univariate forecasts, especially for interest rates.
FinCast is a foundation model for financial time-series forecasting that outperforms existing methods.
problem Challenges in financial time-series forecasting due to temporal non-stationarity, multi-domain diversity, and varying temporal resolutions.
method FinCast is a foundation model specifically designed for financial time-series forecasting, trained on large-scale financial datasets.
result FinCast exhibits robust zero-shot performance, effectively capturing diverse patterns without domain-specific fine-tuning.
Improved forecast accuracy for energy systems through decision-focused fine-tuning.
problem Challenges in integrating forecast values into time series models for diverse and specific instances.
method Decision-focused fine-tuning within time series foundation models for dispatchable feeder optimization.
result Improvement of 9.45% in average total daily costs.
Foundation AI model outperforms traditional VaR methods in forecasting.
problem Forecasting Value-at-Risk (VaR) for financial returns.
method Time-series foundation AI model, pre-trained on diverse datasets, fine-tuned for specific quantiles.
result Fine-tuned foundation model consistently outperforms traditional methods in actual-over-expected ratios.
AdaPTS adapts univariate FMs for multivariate time series forecasting.
problem Challenges in managing feature dependencies and uncertainty quantification in multivariate time series forecasting.
method Adapters that transform multivariate inputs into a latent space and apply univariate FMs independently to each dimension.
result AdaPTS enhances forecasting accuracy and uncertainty quantification compared to baseline methods.
Synapse arbitrates TSFMs to improve time series forecasting performance.
problem TSFMs vary in performance across different forecasting tasks, domains, and horizons.
method Synapse dynamically assigns and adjusts predictive weights based on TSFM performance.
result Synapse consistently outperforms other ensembling techniques and individual TSFMs.
Foundation models improve volatility forecasting in finance.
problem Improving volatility forecasting in financial markets.
method Evaluation of TimesFM model, incremental fine-tuning, comparison with econometric benchmarks.
result Incremental fine-tuning improves forecast accuracy and outperforms traditional models.
Cold-start PV forecasting uses synthetic histories to train time-series foundation models.
problem Cold-start PV forecasting
method Zero-shot pipeline with synthetic histories
result TabPFN-TS achieves the lowest error under Real Feedback strategy
TSFMs show redundant components in layers, affecting their performance.
problem Redundant components in TSFMs layers impact their predictive accuracy.
method Mechanistic interpretability tools, ablations, logit attribution, theoretical framework.
result TSFMs are robust to ablations of entire layers and specific heads.
TempoPFN models for zero-shot time series forecasting using synthetic data.
problem Efficient long-horizon prediction and reproducibility in zero-shot time series forecasting.
method Linear RNNs pre-trained on synthetic data with GatedDeltaProduct architecture and state-weaving.
result Achieves top-tier competitive performance on various benchmarks.
TSFMs embed non-stationary time series data, revealing specific types of changes.
problem Understanding non-stationarity in TSFMs' embedding spaces.
method Examined mean shifts, variance changes, linear trends, and persistence in TSFMs.
result Different TSFMs exhibit distinct failure modes in detecting non-stationarity.
Fine-tuning a time series model improves financial price prediction accuracy.
problem Improving accuracy in predicting financial market prices using large models.
method Continual pre-training of a time series foundation model on financial data to fine-tune its performance for price prediction.
result The fine-tuned model outperforms the baseline in various financial metrics.
Foundation models improve on econometric benchmarks for forecasting volatility, but vary widely across models.
problem Comparing pretrained time series foundation models to econometric benchmarks for volatility forecasting.
method Systematic comparison of nine zero-shot TSFMs against eight econometric specifications on 50 assets across 3 markets and 3 horizons.
result Tiny Time Mixers (TTM) is the only model that consistently beats the Log-HAR benchmark, but performance varies widely across models.
The availability of large amounts of time series data, paired with the performance of deep-learning algorithms on a broad class of problems, has recently led to significant interest in the use of sequence-to-sequence models for time series forecasting. We provide the first theoretical analysis of this time series forec…
A new method calibrates scientific models by adding randomness to their predictions.
problem Current scientific foundation models lack calibrated uncertainty.
method Stochastic Attention, which randomizes attention weights using multinomial samples.
result Stochastic Attention achieves the strongest native calibration and sharpest prediction intervals.
ELF improves FM forecasts by efficiently using online feedback.
problem Fixed FMs fail to adapt to current data characteristics.
method ELF-Forecaster learns current data distribution, ELF-Weighter combines forecasts.
result ELF improves FM forecasts across various datasets.
ProbFM provides principled uncertainty quantification for financial forecasting.
problem Lack of principled uncertainty quantification in financial applications.
method Probabilistic Time Series Foundation Model with Uncertainty Decomposition using Deep Evidential Regression (DER).
result DER maintains competitive forecasting accuracy while providing explicit epistemic-aleatoric uncertainty decomposition.
TSFMs improve financial forecasting from diverse datasets.
problem Challenges in forecasting financial time series due to noisy, non-stationary, and heterogeneous data.
method Empirical study of TSFMs in global financial markets, evaluating zero-shot inference, fine-tuning, and pre-training from scratch.
result Pre-trained TSFMs on financial data achieve substantial forecasting and economic improvements, highlighting the value of domain-specific adaptation.
Kronos improves financial time series analysis with a pre-trained model.
problem Limited application of large-scale models to financial candlestick data.
method Unified, scalable pre-training framework for financial K-line modeling.
result Kronos excels in financial tasks like price forecasting and volatility prediction.
This work aims to create a large-scale model for critical care time series data.
problem Lack of large-scale datasets and distribution shifts in critical care time series data.
method Harmonized dataset creation and transfer learning research.
result Established a foundation for large-scale multi-variate time series models in critical care.
MixFT re-partitions data into sub-domains for better TSFM fine-tuning.
problem Improving zero-shot forecasting for new time series domains.
method MixFT re-divides data using Bayesian mixtures into homogeneous sub-domains for separate fine-tuning.
result MixFT outperforms per-dataset fine-tuning methods.
Cisco introduces a new time series model for better forecasting.
problem Improving time series forecasting accuracy.
method Developed a new multiresolution decoder-only model trained on large datasets.
result The new model achieves superior performance on observability datasets.
A new framework for generating predictive features in noisy multivariate time series.
problem Predicting noisy multivariate time series with limited user effort.
method Develops a feature programming framework based on spin-gas dynamical Ising models.
result Validated the method on synthetic and real-world datasets.
TSFMs improve financial forecasting across diverse tasks with strong transferability.
problem Complex nonlinear relationships, temporal dependencies, and limited data in financial time series forecasting.
method Pretraining on diverse time series corpora followed by task-specific adaptation.
result Tiny Time Mixers (TTM) achieved 25-50% better performance on limited data and 15-30% improvements on longer datasets.
Study uses zero-shot models to forecast mortality rates globally.
problem Forecasting mortality rates without task-specific fine-tuning.
method Two state-of-the-art foundation models (TimesFM and CHRONOS) and traditional/machine learning methods were evaluated.
result CHRONOS outperformed traditional methods for shorter-term forecasts, but TimesFM consistently underperformed.
New method identifies nonstationary causal structures in time series data.
problem Identifying causal relationships in time series data that change over time.
method High-order Markov Switching Models for regime-dependent causal discovery.
result Scalable approach for estimating high-order regime-dependent causal structures.
Survey of financial foundation models for diverse applications.
problem Challenges in applying general-purpose FMs to financial tasks.
method Review of financial foundation models (FFMs) in three modalities.
result Emergence of FFMs designed specifically for finance.
Paper establishes a comprehensive benchmark for ECG time-series analysis.
problem Incomplete understanding of ECG signal properties and limitations in evaluation metrics.
method Categorization of downstream applications, identification of limitations, introduction of a novel metric, benchmarking of time-series models.
result Validation of the effectiveness of the proposed metric and model architecture.
Pretrained time-series models outperform train-from-scratch baselines in financial return forecasting.
problem Financial return forecasting
method Pretrained time-series foundation models
result Pretrained TSFMs dominate the ranking distribution, accounting for 8 of 10 task-level wins.
AI model enhances grid monitoring with synchro-waveform tech.
problem Dynamic, stochastic, low-inertia future grids need advanced monitoring.
method AI Foundation Model with synchro-waveform tech.
result Significantly improved fault detection accuracy and speed.
Study evaluates local explanation methods for time series forecasting.
problem Lack of local interpretability methods for multivariate time series forecasting.
method Proposed two novel evaluation metrics: Area Over the Perturbation Curve for Regression and Ablation Percentage Threshold.
result Comprehensive comparison of local explanation models on two datasets.
This article proposes a Bayesian nonparametric method for forecasting, imputation, and clustering in sparsely observed, multivariate time series data. The method is appropriate for jointly modeling hundreds of time series with widely varying, non-stationary dynamics. Given a collection of N time series, the Bayesian …
New findings on how convolutional architectures approximate time series data.
problem Understanding the approximation properties of convolutional architectures in time series modeling.
method Mathematical analysis of convolutional architectures applied to time series modeling.
result A new definition of spectrum-based regularity for measuring temporal relationships under convolutional approximation.
VQShape learns interpretable time-series representations and achieves comparable performance to specialist models.
problem Lack of interpretability in existing time-series models.
method Vector quantization of time-series data into abstracted shapes.
result VQShape achieves comparable performance to specialist models in classification tasks.
Paper proposes a unified time series forecasting model with adaptive transfer.
problem General forecasting models for diverse time series data.
method Unified representations through Decomposed Frequency Learning and adaptive domain-specific features via Time Series Register.
result State-of-the-art forecasting performance on seven real-world benchmarks.