ICP improves prediction intervals for continuous outcomes at lower computational cost.
problem Systematic bias in point predictions that undermines their use in decision-making.
method Develops Isotonic Conformal Prediction (ICP) framework to decouple calibration from prediction-set construction.
result SICP and TICP procedures match SC-CP coverage at lower computational cost.
Acute kidney injury (AKI) commonly occurs in hospitalized patients and can lead to serious medical complications. In order to optimally predict AKI before it develops at any time during a hospital stay, we present a novel framework in which AKI is continually predicted automatically from EHR data over the entire hospit…
Improved conformal prediction for better conditional coverage of classifier predictions.
problem Achieving exact conditional coverage in finite samples for prediction sets.
method Developed a variant of conformal prediction targeting coverage conditional on confidence and trust score.
result Empirically improved conditional coverage properties compared to standard conformal prediction.
Prediction of future observations is an important and challenging problem. The two mainstream approaches for quantifying prediction uncertainty use prediction regions and predictive distributions, respectively, with the latter believed to be more informative because it can perform other prediction-related tasks. The st…
The paper reviews exchangeability and its implications for conformal prediction and rank tests.
problem Ensuring distribution-free predictive inference in machine learning and statistics.
method Explains exchangeability and its role in conformal prediction and rank tests.
result Discovers similarities between conformal prediction and rank tests based on exchangeability.
This paper discusses a counterpart of conformal prediction for e-values, conformal e-prediction. Conformal e-prediction is conceptually simpler and had been developed in the 1990s as a precursor of conformal prediction. When conformal prediction emerged as result of replacing e-values by p-values, it seemed to have imp…
Generalizes conformal prediction to multiple learnable parameters for efficient prediction sets.
problem Learning valid and efficient prediction sets with low-capacity function classes.
method Constrained empirical risk minimization (ERM) with gradient-based optimization of differentiable surrogate losses and Lagrangians.
result Achieves approximate valid population coverage and near-optimal efficiency within class.
In industrial data analytics, one of the fundamental problems is to utilize the temporal correlation of the industrial data to make timely predictions in the production process, such as fault prediction and yield prediction. However, the traditional prediction models are fixed while the conditions of the machines chang…
New method improves predictive systems with better theoretical guarantees.
problem Constructing predictive systems with out-of-sample calibration guarantees.
method Residual Distribution Predictive Systems (RDPs) that nest conformal predictive systems and offer flexibility.
result Empirically, RDPs perform competitively with conformal predictive systems and can be implemented with various regression methods.
CPPS selects portfolios using conformal prediction for better returns.
problem Optimizing portfolio returns with predictive models and uncertainty.
method Conformal prediction framework for portfolio selection.
result CPPS outperforms simpler strategies in delivering superior returns.
We show social events can be accurately predicted, but often undesirably.
problem The predictability of social events and its implications.
method Recent ideas from performative prediction and outcome indistinguishability.
result Social events can be efficiently predicted accurately, but often undesirably.
DeepKriging uses DNNs to predict spatial data with improved accuracy and scalability.
problem Predicting spatial processes with non-linear and non-Gaussian data.
method Adds an embedding layer of spatial coordinates with basis functions to DNNs.
result DeepKriging provides non-linear predictions with smaller approximation errors and is scalable for large datasets.
Unihedge uses HTAX to create unlimited liquidity in prediction markets.
problem Limited liquidity and information incorporation issues in prediction markets.
method Introduces HTAX prediction markets with DPM derivatives and new incentive mechanisms.
result Unlimited liquidity and improved information incorporation in prediction markets.
Behavior modification improves prediction accuracy by nudging user behavior.
problem Improving prediction accuracy using behavior modification techniques.
method Combining prediction and behavior modification with reinforcement learning algorithms.
result Behavior modification can make predictions more certain but may not generalize.
JANET improves time series prediction with adaptive uncertainty regions.
problem Time series data's lack of exchangeability and multi-step prediction challenges.
method Proposes JANET, a framework for joint adaptive prediction regions with controlled error rates.
result Demonstrates superior performance in multi-step prediction tasks across diverse datasets.
A novel method predicts shape development using Riemannian shape spaces.
problem Predicting future shape development from a single observation.
method Proposes a novel prediction method that encodes shapes in a Riemannian shape space and learns hierarchical statistical models.
result Outperforms deep learning-supported variants and state-of-the-art methods in predicting shape development.
POSL predicts dynamic convection volumes in hemodiafiltration patients.
problem Continuous, personalised predictions in personalised medicine.
method Adapted POSL to dynamically predict convection volumes using combinations of parametric regressions and machine learning.
result POSL outperformed candidate learners in predicting convection volumes with lower errors and better calibration.
Spatial blind source separation simplifies multivariate spatial prediction.
problem Predicting multivariate measurements at unobserved locations with spatial dependencies.
method Spatial blind source separation as a pre-processing tool compared to Cokriging and neural networks.
result Spatial blind source separation simplifies spatial prediction by avoiding cross-dependencies.
Most existing examples of full conformal predictive systems, split-conformal predictive systems, and cross-conformal predictive systems impose severe restrictions on the adaptation of predictive distributions to the test object at hand. In this paper we develop split-conformal and cross-conformal predictive systems tha…
Generative model predicts vehicle faults up to 1000 hours in advance.
problem Forecasting vehicle faults for predictive maintenance.
method Generative model trained on US Army data, incorporating real-world factors.
result Highly accurate predictions of time to first fault.
JAPAN uses flow-based models to create adaptive prediction areas with better coverage guarantees.
problem Inadequate prediction areas from existing conformal prediction methods, especially for multimodal distributions.
method JAPAN employs density-based conformity scores using flow-based models to construct context-adaptive prediction areas.
result JAPAN produces more accurate and context-adaptive prediction areas compared to existing methods.
In its simplest form, the traffic flow prediction problem is restricted to predicting a single time-step into the future. Multi-step traffic flow prediction extends this set-up to the case where predicting multiple time-steps into the future based on some finite history is of interest. This problem is significantly mor…
Causal inference is similar to prediction with treatment bias.
problem Generalizing from labeled to unlabeled data with treatment effects.
method Reframing causal inference as a prediction problem with explicit assumptions.
result Causal assumptions are not uniquely strong but more explicit.
Conformal prediction improves prediction intervals for PCEs, especially in sparse cases.
problem Quantifying local model errors in PCEs for small datasets.
method Integration of conformal prediction methods (full and Jackknife+) into full and sparse PCEs.
result Better-calibrated prediction intervals for both full and sparse PCEs.
GeoConformal predicts spatial uncertainty without relying on specific models.
problem Measuring uncertainty in spatial predictions to enhance model credibility.
method GeoConformal Prediction integrates geographical weighting into conformal prediction.
result GeoConformal achieves higher coverage rates in uncertainty assessment compared to Bootstrap methods.
CRYSPNet predicts crystal structures from chemical compositions.
problem Predicting crystal structures of solids is challenging and computationally expensive.
method CRYSPNet uses a neural network to predict crystal properties from chemical composition.
result CRYSPNet outperforms alternative methods and is robustly validated.
Variational Prediction simplifies Bayesian inference without test time costs.
problem Bayesian inference's computational costs and posterior predictive distribution marginalization.
method Variational Prediction learns a variational approximation to the posterior predictive distribution using a variational bound.
result Directly learns a variational approximation to the posterior predictive distribution without test time marginalization costs.
PIVEN predicts both specific values and prediction intervals.
problem Improving robustness of neural nets in regression tasks.
method PIVEN is a deep neural network that produces both a prediction interval and a specific value prediction.
result PIVEN produces tighter uncertainty bounds than state-of-the-art approaches for prediction intervals.
COMA combines prediction sets from multiple models for online, adaptive prediction.
problem Combining multiple prediction models with uncertainty guarantees.
method Online model aggregation using weighted voting of conformal prediction sets.
result COMA retains coverage guarantees under negative correlation assumptions.
Every organism in an environment, whether biological, robotic or virtual, must be able to predict certain aspects of its environment in order to survive or perform whatever task is intended. It needs a model that is capable of estimating the consequences of possible actions, so that planning, control, and decision-maki…
Proposes online conformal prediction method with adversarial semi-bandit feedback.
problem Online uncertainty quantification with adversarial semi-bandit feedback.
method Formulates online conformal prediction as an adversarial bandit problem and uses regret minimization.
result Achieves long-run coverage guarantee with adversarial semi-bandit feedback.
Paper introduces PCP for efficient, reliable predictive inference.
problem Developing reliable predictive inference methods for target variables.
method Probabilistic conformal prediction using conditional random samples.
result PCP provides sharper predictive sets compared to existing methods.
Study robustness of split conformal prediction in data contamination setting.
problem Robustness of split conformal prediction under data contamination.
method Analyze split conformal prediction's performance in a contaminated data setting and propose a new method.
result Demonstrated the impact of corrupted data on prediction intervals' coverage and efficiency.
We interpret black box predictive models using causal attribution.
problem Interpreting models trained using machine learning in high-stakes applications.
method Estimate causal effects of model inputs on output using observational data.
result Effective interpretation of black box predictive models via causal attribution.
Improved measure of predictive uncertainty for machine learning models.
problem Current measure of predictive uncertainty assumes BMA predictive distribution is equivalent to true model's distribution.
method Introduced a new measure based on information theory to correct the assumption.
result Our measure behaves more reasonably in synthetic tasks and is advantageous in real-world applications.
Paper improves conformal prediction for imprecise training data.
problem Applying conformal prediction to partially labeled data.
method Generalizes conformal prediction for set-valued training and calibration data.
result Validates the proposed method and shows it outperforms baselines.
Model predicts Bitcoin's future movements using multimodal pattern matching.
problem Challenges in predicting Bitcoin's volatile future movements.
method Ranking similar past chart patterns given current chart information.
result Improves directional prediction of Bitcoin's future movements.
Treeffuser predicts tabular data distributions using gradient-boosted trees.
problem Probabilistic prediction with flexible, non-parametric models.
method Gradient-boosted trees for score estimation in conditional diffusion model.
result Treeffuser outperforms existing methods in probabilistic prediction tasks.
New method for valid inference from ML-predicted data.
problem Invalid scientific conclusions from ML-predicted outcomes.
method Assumption-Lean and Data-Adaptive Post-Prediction Inference (PSPA)
result Valid and powerful inference based on ML-predicted data.
Contrast uses normalizing flows to create precise prediction regions for multi-dimensional outputs.
problem Generating reliable prediction regions for multi-dimensional outputs in supervised and unsupervised learning.
method Contrast uses normalizing flows to define nonconformity scores based on distances in latent space, creating sharp prediction regions.
result Contrast maintains guaranteed coverage probability and outperforms existing methods in generating accurate prediction regions.
Neural networks for stock price prediction often misrepresent model performance due to flawed error metrics.
problem Flawed prediction error metrics lead to unreliable model evaluations in the securities market.
method Used data from 20 stock datasets across multiple markets and evaluated with four prediction error measures.
result Prediction error value only partially reflects model accuracy and fails to represent stock price direction.
Study proposes a new method for better price prediction using machine learning and metaheuristics.
problem Challenges in predicting prices due to correlated variables and computational efficiency.
method Introduces a novel decision fusion approach combining Elastic Net and MOPSO for variable selection and prediction.
result The proposed method outperforms traditional approaches in terms of accuracy and efficiency.
Introduces Rashomon Capacity to measure predictive multiplicity in probabilistic classifiers.
problem Predictive multiplicity in classification models leading to unjustified decisions.
method Introduces Rashomon Capacity, a metric for probabilistic classifiers, and provides a rigorous derivation.
result Rashomon Capacity captures nuanced score variations and provides strategies for disclosing conflicting models.
Physics-informed neural networks improve pathloss prediction accuracy.
problem Improving pathloss prediction accuracy in wireless communications.
method Physics-informed neural networks incorporating physical dependencies and measured values.
result Physics-informed neural networks achieve better generalization and prediction quality with fewer layers and parameters.
Improved CTR prediction with XDBoost neural network.
problem Predicting CTR with limited data and complex user behavior.
method Iterative three-stage neural network model XDBoost.
result XDBoost outperforms existing SOTA models for CTR prediction.
UTOPIA aggregates multiple prediction intervals efficiently.
problem Constructing optimal prediction intervals for various real-world data problems.
method UTOPIA is a universally trainable strategy using linear or convex programming.
result UTOPIA constructs prediction intervals with small average width and high coverage probability.
We discuss a concept denoted as Conformal Prediction (CP) in this paper. While initially stemming from the world of machine learning, it was never applied or analyzed in the context of short-term electricity price forecasting. Therefore, we elaborate the aspects that render Conformal Prediction worthwhile to know and e…
This paper considers the quantification of the prediction performance in Gaussian process regression. The standard approach is to base the prediction error bars on the theoretical predictive variance, which is a lower bound on the mean square-error (MSE). This approach, however, does not take into account that the stat…