A novel model combines deep learning and extreme value theory for multivariate cyber risk prediction.
problem High dimensionality and heavy tails in multivariate cyber risk patterns.
method Combines deep learning for point predictions and extreme value theory for quantile predictions.
result The model provides satisfactory high quantile predictions and accurate point predictions.
Enhanced multivariate GARCH model using LSTM for better volatility forecasting.
problem Limitations of traditional multivariate GARCH in capturing persistent volatility and co-movement.
method Integrates deep learning (LSTM) into multivariate GARCH models to capture nonlinear and dynamic dependence structures.
result Superior out-of-sample portfolio risk forecast compared to traditional methods.
Research uses deep learning and copulas to predict multivariate survival data.
problem Handling right-censored and correlated multivariate survival data.
method Integrates deep learning, copula functions, and survival analysis. Uses copula-based activation functions to model nonlinear dependencies.
result Enhanced prediction accuracy for multivariate survival responses.
Deep learning has the potential to dramatically impact navigation and tracking state estimation problems critical to autonomous vehicles and robotics. Measurement uncertainties in state estimation systems based on Kalman and other Bayes filters are typically assumed to be a fixed covariance matrix. This assumption is r…
Deep learning models complex multivariate extremes using geometric shapes.
problem Modeling complex extremal dependencies in high-dimensional data.
method Geometric representation and deep learning for flexible semi-parametric models.
result First approach to modeling limit sets using deep learning for high-dimensional data.
CATS enhances MTSF by generating ATS from OTS to improve forecasting accuracy.
problem Recent deep learning models often outperform multivariate ones in MTSF.
method CATS constructs ATS from OTS using a 2D temporal-contextual attention mechanism.
result CATS achieves state-of-the-art performance with reduced complexity.
Study compares deep learning models for volatility prediction using multivariate data.
problem Predicting volatility using multivariate data.
method Evaluated multiple deep learning models including MLP, RNN, TCN, and Temporal Fusion Transformer.
result Temporal Fusion Transformer and TCN variants outperform classical models and shallow networks.
The paper introduces a new method for multivariate density estimation using deep neural mixture models.
problem Multivariate density estimation is a fundamental but underexplored task in machine learning.
method The paper extends Neural Mixture Densities (NMMs) to multivariate Deep Neural Mixture Models (DNMMs) using maximum-likelihood algorithm.
result The DNMMs can model any probability density function to any degree of precision and outperform traditional statistical estimation techniques.
Identifies interpretable generative model for multivariate data.
problem Black-box architectures of deep generative models are often unidentified and difficult to interpret.
method Introduces Deep Discrete Encoder (DDE) Copula, a hierarchical binary latent variable model inside a copula framework.
result Establishes conditions for identification of DDE copula parameters and proves posterior consistency.
Improved time series forecasting with multivariate probabilistic models.
problem Improving accuracy in forecasting time series with statistical dependencies.
method Conditioned Normalizing Flows for autoregressive deep learning models.
result Improved performance over state-of-the-art models on real-world data sets.
GenFormer uses deep learning to generate complex stochastic data.
problem Creating synthetic stochastic data that matches real-world statistical properties.
method Transformer-based deep learning model that maps Markov state sequences to time series values.
result GenFormer preserves target marginal distributions and other statistical properties in multivariate spatio-temporal data.
MES-LSTM hybrid method improves multivariate time series forecasting and mortality modeling.
problem Challenges in applying hybrid forecast methods to multivariate data.
method Generalized multivariate extension of ES-RNN, utilizing vectorized implementation.
result MES-LSTM shows significant improvement over pure statistical and deep learning methods in forecast accuracy and prediction interval construction.
The multivariate probit model (MVP) is a popular classic model for studying binary responses of multiple entities. Nevertheless, the computational challenge of learning the MVP model, given that its likelihood involves integrating over a multidimensional constrained space of latent variables, significantly limits its a…
This study compares deep generative models to traditional methods for generating financial time series.
problem Generating realistic multivariate financial time series for risk management and portfolio optimization.
method Systematic comparison of deep generative models (DGMs) against state-of-the-art parametric models on synthetic and empirical data.
result Deep generative models outperform traditional parametric models in generating financial time series.
Proposes MVG-CRPS for robust multivariate forecasting.
problem Outliers in multivariate forecasting lead to significant errors.
method Integrates CRPS for MVG distributions, optimizing with MVG-CRPS.
result Improves robustness, accuracy, and uncertainty quantification.
COMET Flows model multivariate extremes with heavy tails and asymmetric dependence.
problem Normalizing flows struggle with multivariate extremes and asymmetric tail dependence.
method COMET Flows decomposes modeling into marginal and copula parts; uses tail belief and kernel density for marginals, and low-dimensional manifold for tail dependence.
result COMET Flows outperform other models in capturing heavy-tailed marginals and asymmetric tail dependence.
Proposes a deep generative model for robust forecasting on sparse multivariate time series.
problem Forecasting on sparse multivariate time series with suboptimal results when sparsity is high.
method Dynamic Gaussian Mixture distribution for modeling latent clusters, using neural networks and gating mechanism.
result Demonstrates robust modeling of sparse multivariate time series with improved accuracy.
Air quality forecasting has been regarded as the key problem of air pollution early warning and control management. In this paper, we propose a novel deep learning model for air quality (mainly PM2.5) forecasting, which learns the spatial-temporal correlation features and interdependence of multivariate air quality rel…
Bayesian neural network models improve uncertainty quantification in multivariate regression.
problem Uncertainty quantification in multivariate regression models with heteroscedastic noise.
method Proposes Bayesian Last Layer neural network models and EM algorithms for parameter learning.
result Capable of disentangling aleatoric and epistemic uncertainty.
Proposes a new model for joint probability distributions in computer vision.
problem Limitation of existing models in meeting diverse downstream tasks.
method Uses parametric conditional probability distributions for each group of variables conditioned on the rest.
result Models can be used for any downstream task without task-specific design.
Deep neural network approximates multivariate option pricing.
problem High-dimensional partial differential equations in option pricing.
method Deep parametric PDE method using neural networks.
result Option prices computed in milliseconds for up to 25 dimensions.
CTLNet predicts Shanghai Composite Index with improved accuracy.
problem Predicting Shanghai Composite Index for investors and researchers.
method Proposes CNN-Transformer-LSTM Networks (CTLNet) for multivariate time series forecasting.
result CTLNet outperforms state-of-the-art baselines in Shanghai Composite Index prediction.
Study evaluates deep learning models for cryptocurrency price prediction.
problem Accurate cryptocurrency price forecasting models are needed due to market volatility.
method Reviewed and evaluated deep learning models including LSTM, CNN, and Transformer.
result Convolutional LSTM with multivariate approach provides best prediction accuracy.
This work proposes a method to learn graph structure for multivariate time series forecasting.
problem Improving multivariate time series forecasting by leveraging pairwise information.
method Learning a probabilistic graph model through optimizing mean performance over graph distribution parameterized by a neural network.
result Our method outperforms existing approaches in simplicity, efficiency, and performance.
In this paper, we present a new deep learning architecture for addressing the problem of supervised learning with sparse and irregularly sampled multivariate time series. The architecture is based on the use of a semi-parametric interpolation network followed by the application of a prediction network. The interpolatio…
This paper compares traditional econometric and contemporary machine/deep learning techniques for forecasting foreign exchange rates.
problem Accurate prediction of foreign exchange rates for investment purposes.
method Multivariate time series analysis using Vector Auto Regression, Support Vector Machine, and Recurrent Neural Networks.
result Contemporary machine/deep learning techniques outperform traditional econometric methods in forecasting foreign exchange rates.
Model predicts ESG ratings from news articles using multivariate timeseries analysis.
problem Lack of accurate and automated methods for ESG ratings prediction.
method Multivariate timeseries analysis combined with deep learning.
result Model outperforms state-of-the-art methods in predicting ESG ratings.
Deep learning predicts employment changes and industry health.
problem Forecasting short-term employment changes and assessing long-term industry health.
method LSTNet, a multi-scale deep learning model, processes multivariate time series data.
result LSTNet outperforms baseline models in most sectors, especially stable ones.
We develop deep Poisson-gamma dynamical systems (DPGDS) to model sequentially observed multivariate count data, improving previously proposed models by not only mining deep hierarchical latent structure from the data, but also capturing both first-order and long-range temporal dependencies. Using sophisticated but simp…
Proposes a new model for complex multivariate event data.
problem Modeling complex multivariate event data with spatio-temporal dynamics.
method Integrates spatial information into latent state evolution through learned temporal and spatial decay dynamics.
result Successfully recovers sensible temporal and spatial intensity structure in multivariate spatio-temporal point patterns.
Paper proposes PMformer for better cryptocurrency price forecasting.
problem Huge volatility and trade-off between univariate and multivariate models.
method Partial-multivariate approach using PMformer.
result PMformer achieves significant statistical accuracy in forecasting.
Paper develops deep learning for metocean variable extremes.
problem Estimating multivariate joint extremes of metocean variables.
method SPAR model with GP distribution for radial tail, kernel density for angular variable, deep neural networks for GP parameters.
result The method provides good description of metocean variables joint extremes.
This paper introduces a novel recalibration method for multivariate forecasts.
problem Multivariate calibration for potentially misspecified models.
method Local mappings between marginal probability integral transform values and observed space, using K-nearest neighbors or normalizing flows.
result Demonstrated effectiveness on currency exchange rate and childhood malnutrition data.
New framework improves multivariate time series forecasting by minimizing redundant information.
problem Improving multivariate time series forecasting with deep learning techniques.
method Cross-variable Decorrelation Aware feature Modeling (CDAM) and Temporal correlation Aware Modeling (TAM) to refine Channel-mixing and exploit temporal correlations.
result Significantly surpasses existing models in comprehensive tests.
Combines MCTM and NF for flexible multivariate density regression with interpretable marginals.
problem Difficult interpretation of flexible NF models and limitations of MCTM in flexibility.
method Hybrid approach combining MCTM for interpretable marginals and NF for complex joint distributions.
result Demonstrates versatility and improved performance compared to MCTM and other NF models.
Generative models improve angular variable simulation in high dimensions.
problem Lack of flexibility and scalability in simulating multivariate angular variables.
method Introducing generative adversarial networks, normalizing flows, and flow matching.
result Deep learning methods outperform classical parametric models in complex data structures.
We introduce a new category of multivariate conditional generative models and demonstrate its performance and versatility in probabilistic time series forecasting and simulation. Specifically, the output of quantile regression networks is expanded from a set of fixed quantiles to the whole Quantile Function by a univar…
Deep belief networks can approximate any multivariate density with binary hidden units.
problem Approximating multivariate probability densities with binary hidden units.
method Sharp quantitative bounds on approximation error in terms of hidden units.
result Deep belief networks can approximate any multivariate density with binary hidden units under mild integrability requirements.
CONFETTI improves interpretability of deep learning models for MTS by providing counterfactual explanations.
problem Lack of transparency in deep learning models for multivariate time series classification.
method CONFETTI is a novel multi-objective counterfactual explanation method that balances prediction confidence, proximity, and sparsity.
result CONFETTI outperforms state-of-the-art methods in various metrics, improving interpretability and decision support.
DCIts interprets complex time series data with interpretable coefficients.
problem Interpreting nonlinear multivariate time series data.
method Deep convolutional architecture with a Focuser and Modeler components.
result DCIts provides interpretable coefficients and interaction patterns.
ReGENN improves time series forecasting by considering inter and intra-temporal relationships.
problem Achieving reliable predictions in real-world time series applications.
method ReGENN combines graph evolution with deep recurrent learning to model dynamic dependencies among multiple variables.
result Sound improvement of up to 64.87% over competing algorithms in time-series forecasting.
Researchers forecast VoIP traffic in mobile networks using multivariate time series analysis.
problem Predicting VoIP traffic behavior in real mobile networks for better resource allocation.
method Multivariate time series analysis, Vector Autoregressive models, machine learning techniques.
result Forecasting accuracy and insights into VoIP traffic dynamics.
Unified taxonomy categorizes DL-based MTSAD methods.
problem Lack of systematization in MTSAD research.
method Two-fold approach: derived from methodological studies and reviewed papers.
result Convergence toward Transformer-based and reconstruction/prediction models.
New algorithms benchmarked for multivariate time series classification.
problem Comparing algorithms for multivariate time series classification.
method Review and comparison of recent MTSC algorithms using the UEA archive.
result HIVE-COTE ensemble is most accurate for MTSC, but dynamic time warping is competitive.
The paper explains DNNs by quantifying interactions among input variables.
problem Understanding and explaining the complex behavior of deep neural networks.
method The paper defines and quantifies the significance of interactions among multiple input variables using the Shapley value.
result The proposed method effectively explains the behavior of DNNs by assigning attribution values to input variables.
KSGAN uses KS distance for deep generative modeling.
problem Deep generative modeling challenges, especially for multivariate distributions.
method Formulates adversarial training as minimization of KS distance, using quantile function as critic.
result KSGAN trained distributions closely match target distributions.
VHVM models financial time series with varying volatility.
problem Modeling heteroscedastic behavior in multivariate financial time series.
method Variational autoencoder and recurrent neural network for capturing relationships and temporal dynamics.
result VHVM outperforms GARCH and SV models on FX datasets.
DL models for MTS regression are vulnerable to adversarial attacks, posing risks in safety-critical applications.
problem Vulnerability of DL models to adversarial examples in MTS regression.
method Adversarial attack generation techniques from image classification were adapted for MTS.
result All state-of-the-art DL regression models (CNN, LSTM, GRU) are vulnerable to adversarial attacks.