Develops a method for multivariate time series prediction intervals.
problem Uncertainty quantification in multivariate time series forecasting.
method Conformal prediction method for multivariate time series.
result Empirically demonstrates valid coverage of prediction regions.
Proposes a method to generate multivariate prediction intervals for random forests.
problem Uncertainty estimates for iterative design of experiments with multiple correlated model outputs.
method Recalibrated bootstrap method for bagged models.
result Significantly decreases the number of iterations required for satisfactory candidate in sequential learning problems.
A method for constructing tight prediction intervals for multiple numerical outputs.
problem Constructing tight prediction intervals for multiple related numerical outputs.
method A novel coordinate-wise standardization procedure that makes residuals comparable across output dimensions, estimating suitable scaling parameters using calibration data.
result The method produces tighter prediction intervals than existing baselines while maintaining valid simultaneous coverage.
Paper proposes new method for time series confidence intervals using LSTM.
problem Constructing accurate confidence intervals for multivariate time series.
method Uses Long Short Term Memory Network (LSTM) and novel block bootstrap techniques.
result Demonstrates improved accuracy in constructing confidence intervals.
Improved local multivariable regression for better inference with limited data.
problem Limited sample size hampers local polynomial/multivariable regression.
method Prediction-Powered Inference (PPI) algorithm for local multivariable regression.
result Significantly reduces estimation variance without increasing error.
MES-LSTM hybrid method improves multivariate time series forecasting and mortality modeling.
problem Challenges in applying hybrid forecast methods to multivariate data.
method Generalized multivariate extension of ES-RNN, utilizing vectorized implementation.
result MES-LSTM shows significant improvement over pure statistical and deep learning methods in forecast accuracy and prediction interval construction.
In modeling multivariate time series, it is important to allow time-varying smoothness in the mean and covariance process. In particular, there may be certain time intervals exhibiting rapid changes and others in which changes are slow. If such time-varying smoothness is not accounted for, one can obtain misleading inf…
Confidence intervals are a popular way to visualize and analyze data distributions. Unlike p-values, they can convey information both about statistical significance as well as effect size. However, very little work exists on applying confidence intervals to multivariate data. In this paper we define confidence interval…
A real-world dataset is provided from a pulp-and-paper manufacturing industry. The dataset comes from a multivariate time series process. The data contains a rare event of paper break that commonly occurs in the industry. The data contains sensor readings at regular time-intervals (x's) and the event label (y). The pri…
New method explains anomalies in multivariate time series data.
problem Understanding and explaining anomalies in multivariate time series data.
method Counterfactual reasoning applied to MDI-detected anomalous intervals.
result Our method accurately identifies and explains anomalies in various extreme events.
Paper introduces a new method for classifying interval-valued time series.
problem Classification of interval-valued time series.
method Extends point-valued time series imaging methods to interval-valued scenarios using DK-distance and employs deep learning for classification. result Proposed method achieves superior classification performance compared to existing methods.
New online method for multivariate probabilistic electricity price forecasting.
problem Multivariate probabilistic forecasting of electricity prices.
method Online multivariate distributional regression with LASSO regularization.
result Robust and interpretable joint prediction intervals for 24-hour electricity prices.
The paper develops approximations for Pearson's chi-square statistic and applies them to confidence intervals.
problem Finding confidence intervals for strictly convex functions of discrete distribution weights.
method Non-asymptotic local normal approximation for multinomial probabilities, deriving bounds and coupling inequalities.
result Developed methods to find confidence intervals for negative entropy of discrete distributions.
We present new methods for batch anomaly detection in multivariate time series. Our methods are based on maximizing the Kullback-Leibler divergence between the data distribution within and outside an interval of the time series. An empirical analysis shows the benefits of our algorithms compared to methods that treat e…
Conformal predictors, introduced by Vovk et al. (2005), serve to build prediction intervals by exploiting a notion of conformity of the new data point with previously observed data. In the present paper, we propose a novel method for constructing prediction intervals for the response variable in multivariate linear mod…
This paper deals with dependence across marginally exponentially distributed arrival times, such as default times in financial modeling or inter-failure times in reliability theory. We explore the relationship between dependence and the possibility to sample final multivariate survival in a long time-interval as a sequ…
Unified approach for nonparametric regression and conditional distribution learning.
problem Nonparametric regression and conditional distribution learning problems.
method Generative learning framework with deep neural networks to estimate a conditional generator.
result The approach estimates a regression function and a conditional generator simultaneously, providing good prediction intervals.
Having a regression model, we are interested in finding two-sided intervals that are guaranteed to contain at least a desired proportion of the conditional distribution of the response variable given a specific combination of predictors. We name such intervals predictive intervals. This work presents a new method to fi…
Proposes a method to create prediction intervals for neural networks using cross-validation.
problem Lack of prediction intervals for neural networks.
method k-fold cross-validation to construct conformal prediction intervals.
result Proposed method produces narrower intervals with similar coverage compared to SC method.
Archimedean copulas are popular in the world of multivariate modelling as a result of their breadth, tractability, and flexibility. A. J. McNeil and J. Nešlehová (2009) showed that the class of Archimedean copulas coincides with the class of multivariate ℓ1-norm symmetric distributions. Building upon their result…
The paper presents a method for generating well-calibrated prediction intervals using quality-driven deep ensembles.
problem Generating reliable prediction intervals for regression analysis.
method A multi-objective loss function combining quality measures for prediction intervals and point estimates, with a penalty function to ensure semantic integrity and stability.
result The method produces well-calibrated prediction intervals and point estimates, capturing both aleatoric and epistemic uncertainty.
Multivariate time series data in practical applications, such as health care, geoscience, and biology, are characterized by a variety of missing values. In time series prediction and other related tasks, it has been noted that missing values and their missing patterns are often correlated with the target labels, a.k.a.…
RFpredInterval package builds prediction intervals for random forests and boosted forests.
problem Quantifying uncertainty in random forest and boosted forest point predictions.
method 16 methods to build prediction intervals with random forests and boosted forests.
result The proposed method outperforms existing methods in building prediction intervals.
AutoCP automates the construction of accurate prediction intervals.
problem Creating valid and accurate prediction intervals for machine learning models.
method AutoML framework that optimizes prediction interval length for better accuracy and less conservatism.
result AutoCP significantly outperforms benchmark algorithms in constructing accurate prediction intervals.
Prediction intervals are a valuable way of quantifying uncertainty in regression problems. Good prediction intervals should be both correct, containing the actual value between the lower and upper bound at least a target percentage of the time; and tight, having a small mean width of the bounds. Many prior techniques f…
Boosted conformal procedure improves prediction intervals.
problem Enhancing prediction interval properties like coverage and length.
method Gradient boosting to optimize conformity score function.
result Significant improvements in interval length and coverage.
TSCoNet forecasts correlated geophysical fields with uncertainty estimates.
problem Accurate and reliable forecasts of correlated geophysical fields across many locations.
method Two-stage CNN-LSTM coupled with Gaussian copula.
result Calibrated prediction intervals without sacrificing point accuracy.
Random Forests provide interpretable prediction intervals with theoretical guarantees.
problem Lack of uncertainty estimates in machine learning point predictions.
method Out-of-Bag procedure for generating parametric and non-parametric prediction intervals.
result Proposed prediction intervals deliver correct coverage rates and narrow lengths.
CIR method constructs efficient prediction intervals with guaranteed coverage.
problem Efficiently constructing near-minimal prediction intervals with guaranteed coverage.
method Conditional Interquantile Regression (CIR) and CIR+ (enhanced version).
result Optimal balance between predictive accuracy and computational efficiency.
Self-calibrating conformal prediction improves interval efficiency and offers a practical alternative.
problem Improving the reliability and uncertainty quantification of machine learning predictions.
method Combines Venn-Abers calibration and conformal prediction for binary and regression problems.
result Improves interval efficiency through model calibration and offers practical alternatives.
UnKGCP generates prediction intervals for uncertain knowledge graphs with statistical guarantees.
problem Lack of quantified predictive uncertainty in existing UnKGE methods.
method Proposes extsc{UnKGCP} framework using conformal prediction with a novel nonconformity measure.
result Sharp prediction intervals effectively capture predictive uncertainty in diverse UnKGE methods.
This work reviews and evaluates methods for predicting prediction intervals in regression problems.
problem Calibration of prediction intervals in regression problems.
method Four classes of methods: Bayesian, ensemble, direct interval estimation, and conformal prediction.
result Conformal prediction can be used as a general calibration procedure.
Improved neural network predicts tropical storm trajectories and Bayesian intervals.
problem Accurately predicting the trajectories of tropical storms to prevent damage.
method Developed an improved RNN model with dropout to predict Bayesian intervals.
result Neural network dropout values significantly affect prediction accuracy and intervals.
CONTINA provides adaptive confidence intervals for traffic demand prediction.
problem Uncertainty in future traffic demand predictions and the need for valid confidence intervals.
method Adaptive confidence interval method that adjusts based on deployment errors.
result Valid confidence intervals with shorter lengths and theoretical coverage guarantee.
Develops efficient time series prediction intervals.
problem Constructing reliable prediction intervals for time series data.
method Introduces exttt{EnbPI} algorithm for time series data.
result Demonstrates superior performance compared to existing methods.
Constructs tail-specific prediction intervals for financial applications
problem Financial applications require strict control on the left tail
method Extends classical conformal frameworks to provide explicit tail-specific guarantees
result Improved directional calibration in skewed data
This work challenges the assumption that shorter conformal prediction intervals are always better.
problem The conventional evaluation of conformal prediction metrics (coverage and interval length) may not fully capture the quality of predictions.
method The Prejudicial Trick (PT) is introduced, which probabilistically returns either a null interval or a longer one to maintain valid coverage while potentially reducing interval length.
result The Prejudicial Trick can yield deceptively shorter intervals without compromising coverage, but introduces practical vulnerabilities.
The paper improves prediction intervals for non-parametric regression using histograms.
problem Computing accurate prediction intervals for non-parametric regression models.
method Uses conditional histograms to estimate conditional distributions and compute shortest prediction intervals.
result The method provides prediction intervals with provable marginal coverage and asymptotic conditional coverage.
Developing an explainable outlier detection method for interval-valued data using Shapley value-based approach.
problem Outlier detection in interval-valued data.
method Proposed a novel approach based on Shapley value for interval-valued data.
result Fine-grained interpretation of outliers with variable contributions.
BCI provides calibrated prediction intervals for time series forecasts.
problem Calibration of prediction intervals for time series forecasts.
method BCI wraps around any time series forecasting models and optimizes interval lengths using dynamic programming.
result BCI achieves long-term coverage under arbitrary distribution shifts and temporal dependence.
New method combines HQR and WACI for better time series prediction intervals.
problem Challenges in creating reliable prediction intervals for time series forecasting.
method Combining Heteroscedastic Quantile Regression (HQR) with Width-Adaptive Conformal Inference (WACI).
result Combined approach meets or surpasses typical benchmarks for validity and efficiency.
The paper extends conformal prediction to MDP trajectories for autonomous systems.
problem Ensuring reliability of autonomous systems by providing probabilistic guarantees.
method Applying conformal corrections to quantile regression prediction intervals.
result Conformal prediction intervals ensure the observed trajectory lies inside with high probability.
ProbRes calibrates probabilistic forecasts by learning volatility dynamics.
problem Quantifying risk and uncertainty in time series forecasting.
method ProbRes learns conditional mean and volatility separately, generating well-calibrated prediction intervals.
result ProbRes accurately captures predictive distributions and produces well-calibrated prediction intervals.
UTOPIA aggregates multiple prediction intervals efficiently.
problem Constructing optimal prediction intervals for various real-world data problems.
method UTOPIA is a universally trainable strategy using linear or convex programming.
result UTOPIA constructs prediction intervals with small average width and high coverage probability.
Conditional density estimation generalizes regression by modeling a full density f(yjx) rather than only the expected value E(yjx). This is important for many tasks, including handling multi-modality and generating prediction intervals. Though fundamental and widely applicable, nonparametric conditional density estimat…
New method assesses prediction intervals across different operating points.
problem Difficulty in comparing prediction intervals across studies.
method Operating characteristics curves and gain over a simple reference.
result A novel operating point agnostic assessment methodology for prediction intervals.
This paper improves prediction intervals for heteroskedastic regression.
problem Adaptive prediction intervals for heteroskedastic regression.
method Normalized and Mondrian conformal prediction methods.
result Conditional validity of chosen conformal predictors related to data-generating assumptions.
Skew-adaptive method improves prediction intervals for regression.
problem Improving prediction intervals for regression models, especially in cases of skewness and varying scales.
method Develops a skew-adaptive extension of split conformal prediction using an asymmetric interval family and gauge approach.
result Preserves marginal validity and adapts to local scale and skewness, with efficiency gains over existing methods.