Having a regression model, we are interested in finding two-sided intervals that are guaranteed to contain at least a desired proportion of the conditional distribution of the response variable given a specific combination of predictors. We name such intervals predictive intervals. This work presents a new method to fi…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “Prediction Intervals”
Proposes a method to create prediction intervals for neural networks using cross-validation.
problem Lack of prediction intervals for neural networks.
method k-fold cross-validation to construct conformal prediction intervals.
result Proposed method produces narrower intervals with similar coverage compared to SC method.
The paper presents a method for generating well-calibrated prediction intervals using quality-driven deep ensembles.
problem Generating reliable prediction intervals for regression analysis.
method A multi-objective loss function combining quality measures for prediction intervals and point estimates, with a penalty function to ensure semantic integrity and stability.
result The method produces well-calibrated prediction intervals and point estimates, capturing both aleatoric and epistemic uncertainty.
RFpredInterval: An R Package for Prediction Intervals with Random Forests and Boosted Forestsstat.ML
RFpredInterval package builds prediction intervals for random forests and boosted forests.
problem Quantifying uncertainty in random forest and boosted forest point predictions.
method 16 methods to build prediction intervals with random forests and boosted forests.
result The proposed method outperforms existing methods in building prediction intervals.
AutoCP automates the construction of accurate prediction intervals.
problem Creating valid and accurate prediction intervals for machine learning models.
method AutoML framework that optimizes prediction interval length for better accuracy and less conservatism.
result AutoCP significantly outperforms benchmark algorithms in constructing accurate prediction intervals.
Prediction intervals are a valuable way of quantifying uncertainty in regression problems. Good prediction intervals should be both correct, containing the actual value between the lower and upper bound at least a target percentage of the time; and tight, having a small mean width of the bounds. Many prior techniques f…
Boosted conformal procedure improves prediction intervals.
problem Enhancing prediction interval properties like coverage and length.
method Gradient boosting to optimize conformity score function.
result Significant improvements in interval length and coverage.
Random Forests provide interpretable prediction intervals with theoretical guarantees.
problem Lack of uncertainty estimates in machine learning point predictions.
method Out-of-Bag procedure for generating parametric and non-parametric prediction intervals.
result Proposed prediction intervals deliver correct coverage rates and narrow lengths.
CIR method constructs efficient prediction intervals with guaranteed coverage.
problem Efficiently constructing near-minimal prediction intervals with guaranteed coverage.
method Conditional Interquantile Regression (CIR) and CIR+ (enhanced version).
result Optimal balance between predictive accuracy and computational efficiency.
Self-calibrating conformal prediction improves interval efficiency and offers a practical alternative.
problem Improving the reliability and uncertainty quantification of machine learning predictions.
method Combines Venn-Abers calibration and conformal prediction for binary and regression problems.
result Improves interval efficiency through model calibration and offers practical alternatives.
Certainty in Uncertainty: Reasoning over Uncertain Knowledge Graphs with Statistical Guaranteesstat.ML
UnKGCP generates prediction intervals for uncertain knowledge graphs with statistical guarantees.
problem Lack of quantified predictive uncertainty in existing UnKGE methods.
method Proposes extsc{UnKGCP} framework using conformal prediction with a novel nonconformity measure.
result Sharp prediction intervals effectively capture predictive uncertainty in diverse UnKGE methods.
This work reviews and evaluates methods for predicting prediction intervals in regression problems.
problem Calibration of prediction intervals in regression problems.
method Four classes of methods: Bayesian, ensemble, direct interval estimation, and conformal prediction.
result Conformal prediction can be used as a general calibration procedure.
Improved neural network predicts tropical storm trajectories and Bayesian intervals.
problem Accurately predicting the trajectories of tropical storms to prevent damage.
method Developed an improved RNN model with dropout to predict Bayesian intervals.
result Neural network dropout values significantly affect prediction accuracy and intervals.
CONTINA provides adaptive confidence intervals for traffic demand prediction.
problem Uncertainty in future traffic demand predictions and the need for valid confidence intervals.
method Adaptive confidence interval method that adjusts based on deployment errors.
result Valid confidence intervals with shorter lengths and theoretical coverage guarantee.
Develops efficient time series prediction intervals.
problem Constructing reliable prediction intervals for time series data.
method Introduces exttt{EnbPI} algorithm for time series data.
result Demonstrates superior performance compared to existing methods.
Constructs tail-specific prediction intervals for financial applications
problem Financial applications require strict control on the left tail
method Extends classical conformal frameworks to provide explicit tail-specific guarantees
result Improved directional calibration in skewed data
This work challenges the assumption that shorter conformal prediction intervals are always better.
problem The conventional evaluation of conformal prediction metrics (coverage and interval length) may not fully capture the quality of predictions.
method The Prejudicial Trick (PT) is introduced, which probabilistically returns either a null interval or a longer one to maintain valid coverage while potentially reducing interval length.
result The Prejudicial Trick can yield deceptively shorter intervals without compromising coverage, but introduces practical vulnerabilities.
The paper improves prediction intervals for non-parametric regression using histograms.
problem Computing accurate prediction intervals for non-parametric regression models.
method Uses conditional histograms to estimate conditional distributions and compute shortest prediction intervals.
result The method provides prediction intervals with provable marginal coverage and asymptotic conditional coverage.
BCI provides calibrated prediction intervals for time series forecasts.
problem Calibration of prediction intervals for time series forecasts.
method BCI wraps around any time series forecasting models and optimizes interval lengths using dynamic programming.
result BCI achieves long-term coverage under arbitrary distribution shifts and temporal dependence.
New method combines HQR and WACI for better time series prediction intervals.
problem Challenges in creating reliable prediction intervals for time series forecasting.
method Combining Heteroscedastic Quantile Regression (HQR) with Width-Adaptive Conformal Inference (WACI).
result Combined approach meets or surpasses typical benchmarks for validity and efficiency.
The paper extends conformal prediction to MDP trajectories for autonomous systems.
problem Ensuring reliability of autonomous systems by providing probabilistic guarantees.
method Applying conformal corrections to quantile regression prediction intervals.
result Conformal prediction intervals ensure the observed trajectory lies inside with high probability.
UTOPIA aggregates multiple prediction intervals efficiently.
problem Constructing optimal prediction intervals for various real-world data problems.
method UTOPIA is a universally trainable strategy using linear or convex programming.
result UTOPIA constructs prediction intervals with small average width and high coverage probability.
New method assesses prediction intervals across different operating points.
problem Difficulty in comparing prediction intervals across studies.
method Operating characteristics curves and gain over a simple reference.
result A novel operating point agnostic assessment methodology for prediction intervals.
This paper improves prediction intervals for heteroskedastic regression.
problem Adaptive prediction intervals for heteroskedastic regression.
method Normalized and Mondrian conformal prediction methods.
result Conditional validity of chosen conformal predictors related to data-generating assumptions.
Skew-adaptive method improves prediction intervals for regression.
problem Improving prediction intervals for regression models, especially in cases of skewness and varying scales.
method Develops a skew-adaptive extension of split conformal prediction using an asymmetric interval family and gauge approach.
result Preserves marginal validity and adapts to local scale and skewness, with efficiency gains over existing methods.
New method provides reliable high-confidence prediction intervals for high-impact events.
problem High-impact events require very high confidence prediction intervals, but classical methods provide uninformative intervals.
method Bridge extreme value statistics and conformal prediction to provide reliable and informative prediction intervals.
result Provides reliable and informative prediction intervals with high-confidence coverage.
Methods for prediction and tolerance intervals in non-normal models.
problem Constructing prediction and tolerance intervals for non-normal data.
method Two approaches: pivotal quantity approximation and confidence interval for mean.
result Intuitive, simple, efficient methods with proper operating characteristics.
MAPS algorithm creates reliable prediction intervals for high-dimensional data.
problem Computing reliable conditional prediction intervals in high-dimensional settings.
method Lifted predictive model (LPM) and MAPS algorithm for distribution-free intervals.
result MAPS algorithm produces valid prediction intervals for any trained model.
Neural network learns kernel functions for survival analysis and prediction intervals.
problem Predicting survival times for individuals based on similar training subjects.
method Develops a neural network framework to learn kernel functions for kernel survival analysis and uses these to construct valid prediction intervals.
result Neural network survival estimators are competitive with existing methods and provide valid prediction intervals.
The paper improves NN predictions with reliable confidence intervals.
problem Creating accurate prediction intervals for neural network outputs.
method Introduces Conformal Prediction (CP) for NNs, ensuring reliable confidence measures.
result The proposed method produces well-calibrated and tight prediction intervals.
RQR improves prediction intervals for skewed data.
problem Invalid prediction intervals for skewed noise.
method Relaxed Quantile Regression (RQR) for asymmetric noise.
result Improved prediction intervals with desirable qualities.
New algorithm for efficient prediction intervals in neural networks.
problem Challenges in estimating uncertainty in neural network predictions.
method Applies matrix sketching to approximate Jacobian matrix for efficient uncertainty estimation.
result Produces approximate prediction intervals with competitive performance.
Study improves traffic prediction intervals for minor roads.
problem Uncertainty in traffic data for underrepresented minor roads.
method Quantile Random Forest with PCA for interval prediction.
result Achieved 88.22% interval coverage and Winkler Score of 7,468.47.
A new AMP-based method speeds up conformal prediction intervals.
problem Computational cost in building high-dimensional prediction intervals.
method Approximate Message Passing (AMP) to accelerate full conformal prediction.
result AMP-based method produces valid prediction intervals orders of magnitude faster.
LPCI provides valid prediction intervals for longitudinal data.
problem Current conformal prediction methods for time series data lack cross-sectional coverage when applied to longitudinal datasets.
method Modeling residual data as a quantile fixed-effects regression problem, constructing prediction intervals with a trained quantile regressor.
result LPCI achieves valid cross-sectional coverage and outperforms existing benchmarks in terms of longitudinal coverage rates.
RAGIC predicts stock intervals with risk considerations, improving prediction accuracy and coverage.
problem Limited success in predicting stock market outcomes due to stochastic nature and risk oversight.
method RAGIC uses a GAN with a risk module and temporal module to generate risk-sensitive stock intervals.
result RAGIC achieves a consistent 95% coverage with narrow interval widths, balancing accuracy and risk.
New method narrows prediction intervals for individual treatment effects.
problem Insufficiently conservative prediction intervals for individual treatment effects.
method Conformal inference using conditional density estimates.
result Narrower prediction intervals compared to existing methods.
This paper tackles uncertainty in deep learning for construction of prediction intervals.
problem Deep learning models lack the ability to provide reliable prediction intervals for high-risk tasks.
method The authors design a special loss function to learn both aleatory and epistemic uncertainties without requiring uncertainty labels.
result The method constructs prediction intervals that are competitive with state-of-the-art methods on publicly available datasets.
CTI produces efficient prediction intervals with guaranteed coverage.
problem Efficient and reliable uncertainty quantification in regression.
method CTI estimates conditional density for interval length, then thresholds intervals based on this density.
result CTI achieves smaller prediction sets with guaranteed coverage compared to existing methods.
SEMF predicts prediction intervals for ML models using latent variables.
problem Uncertainty quantification in ML models, especially for diverse data distributions.
method Supervised Expectation-Maximization Framework (SEMF) extending EM algorithm for latent variable modeling.
result SEMF produces narrower prediction intervals with desired coverage probability.
Paper develops new conformal prediction methods for sum or average of unknown labels.
problem Uncertainty quantification in joint distributions of random variables.
method Introduces novel conformal prediction methods for sum or average of unknown labels.
result Validates the proposed method for sum or average of unknown labels under permutation invariant assumptions.
Paper proposes a method to improve prediction intervals for neural networks.
problem Improving prediction intervals for neural network models.
method Adapting extremely randomized trees to neural networks to create ensembles.
result The method yields gains in out-of-sample accuracy and is superior to existing methods.
Conformal Prediction is a framework that produces prediction intervals based on the output from a machine learning algorithm. In this paper we explore the case when training data is made up of multiple parts available in different sources that cannot be pooled. We here consider the regression case and propose a method …
The paper improves methods for generating prediction intervals in regression.
problem Uncertainty quantification in regression models.
method Formalizes prediction interval generation as an optimization problem, studying generalization and calibration.
result Empirical demonstration of improved testing performances compared to existing methods.
TDistNNs improve prediction intervals for neural networks by using t-distributions.
problem Traditional neural networks provide only point estimates, lacking predictive uncertainty.
method TDistNNs generate t-distributed outputs with adjustable degrees of freedom, enhancing robustness to non-Gaussian data.
result TDistNNs produce narrower prediction intervals with proper coverage compared to Gaussian-based PNNs.
New method uses interval-based metric to validate prediction uncertainty in machine learning.
problem Validation of prediction uncertainty in machine learning regression tasks is unreliable due to heavy-tailed distributions.
method Shift from variance-based metrics to interval-based Prediction Interval Coverage Probability (PICP).
result PICP method more quickly and reliably tests prediction intervals than variance-based metrics.
Optimizes data splitting for shorter conformal prediction intervals.
problem Minimizing prediction interval length while maintaining coverage.
method Theoretical framework for optimal data splitting in split conformal prediction.
result Analytical characterizations of length-optimal split ratios in various settings.
PIVEN predicts both specific values and prediction intervals.
problem Improving robustness of neural nets in regression tasks.
method PIVEN is a deep neural network that produces both a prediction interval and a specific value prediction.
result PIVEN produces tighter uncertainty bounds than state-of-the-art approaches for prediction intervals.