COP improves online conformal prediction by incorporating data patterns, leading to tighter prediction sets.
problem Overly conservative prediction sets in online conformal prediction methods when data distribution shifts.
method Conformal Optimistic Prediction (COP) incorporating estimated cumulative distribution function of non-conformity scores.
result COP produces tighter prediction sets with valid coverage guarantees, outperforming other methods.
Conformal predictive systems are a recent modification of conformal predictors that output, in regression problems, probability distributions for labels of test observations rather than set predictions. The extra information provided by conformal predictive systems may be useful, e.g., in decision making problems. Conf…
Combining Bayesian deep learning and split conformal prediction affects out-of-distribution coverage.
problem Improving out-of-distribution coverage in multiclass image classification.
method Combining Bayesian deep learning with split conformal prediction methods.
result Combining methods can reduce out-of-distribution coverage in some cases.
New method improves predictive systems with better theoretical guarantees.
problem Constructing predictive systems with out-of-sample calibration guarantees.
method Residual Distribution Predictive Systems (RDPs) that nest conformal predictive systems and offer flexibility.
result Empirically, RDPs perform competitively with conformal predictive systems and can be implemented with various regression methods.
The paper develops distribution-free methods for ordinal classification.
problem Constructing valid prediction sets for ordinal classification problems.
method Leveraging conformal prediction and multiple testing with FWER control.
result The proposed methods achieve satisfactory levels of marginal and class-specific conditional coverages.
Paper develops new conformal prediction methods for sum or average of unknown labels.
problem Uncertainty quantification in joint distributions of random variables.
method Introduces novel conformal prediction methods for sum or average of unknown labels.
result Validates the proposed method for sum or average of unknown labels under permutation invariant assumptions.
Improves full conformal prediction for stochastic non-conformity measures.
problem Inability of existing conditions to guarantee full conformal prediction validity under stochastic settings.
method Introduces a new sufficient condition: Conditional Independence & Permutation Invariance in Distribution.
result Corrects the insufficient condition and provides a new sufficient condition for full conformal prediction validity.
Exact distribution of split conformal prediction coverage found.
problem Determining the reliability of prediction sets in batch mode.
method Analysis of exchangeable data to find universal distribution of empirical coverage.
result Exact distribution of empirical coverage is universal and determined by nominal miscoverage level and calibration sample size.
COMA combines prediction sets from multiple models for online, adaptive prediction.
problem Combining multiple prediction models with uncertainty guarantees.
method Online model aggregation using weighted voting of conformal prediction sets.
result COMA retains coverage guarantees under negative correlation assumptions.
New methods for distributed CP improve reliability in healthcare.
problem Post-hoc calibration of models in safety-critical domains.
method Quantile-based and histogram-based distributed conformal prediction via message passing.
result Improved reliability and coverage guarantees in decentralized settings.
Split conformal prediction provides finite-sample guarantees for black-box models without distributional assumptions.
problem Weak performance guarantees for modern predictive models under minimal assumptions.
method Develops finite-sample guarantees for split conformal prediction, a method that uses nested prediction sets and order statistics.
result The coverage of prediction sets based on order statistics stochastically dominates the Beta distribution.
This paper improves conformal prediction for robust interval estimation under distribution shifts.
problem Robustness of conformal prediction under distribution shifts.
method Modeling distribution shifts using Levy-Prokhorov (LP) ambiguity sets, which capture both local and global perturbations.
result Constructs robust conformal prediction intervals that remain valid under distribution shifts.
CIR method constructs efficient prediction intervals with guaranteed coverage.
problem Efficiently constructing near-minimal prediction intervals with guaranteed coverage.
method Conditional Interquantile Regression (CIR) and CIR+ (enhanced version).
result Optimal balance between predictive accuracy and computational efficiency.
New method optimizes prediction set volume in conformal prediction.
problem Achieving volume optimality in conformal prediction without sacrificing coverage guarantees.
method Dynamic programming algorithm for finding near-optimal volume unions of k-intervals.
result Efficient algorithm finds unions of k-intervals with near-optimal volume for any distribution.
Method constructs uniformly valid prediction sets across multiple distributions.
problem Uniformly valid prediction sets across multiple distributions.
method Max-p aggregation scheme and optimization programs.
result Optimal and efficient prediction sets for multiple distributions.
Study improves conformal prediction for EEG classification in healthcare, enhancing coverage.
problem Uncertainty quantification in clinical predictions, especially in distribution-shifted settings.
method Personalized calibration strategies to improve coverage of prediction sets.
result Coverage improved by over 20 percentage points with comparable prediction set sizes.
The paper reviews exchangeability and its implications for conformal prediction and rank tests.
problem Ensuring distribution-free predictive inference in machine learning and statistics.
method Explains exchangeability and its role in conformal prediction and rank tests.
result Discovers similarities between conformal prediction and rank tests based on exchangeability.
E-values enhance conformal prediction methods.
problem Distribution-free uncertainty quantification.
method Reformulation of conformal prediction using e-values.
result E-values offer new theoretical and practical capabilities.
Efficiently samples conformal boundaries in high dimensions using flows.
problem Difficulty in interpreting and using prediction sets in high-dimensional or structured output spaces.
method Flow-based approach using differentiable nonconformity scores to induce deterministic flows on the output space.
result Sampling conformal boundaries in arbitrary dimensions becomes computationally efficient and training-free.
Extend CPS to non-exchangeable settings with observation-specific permutation weights
problem Calibrated predictive bands under distributional shifts
method Encoding distributional shifts through observation-specific permutation weights
result Shift-aware predictive systems remain valid
Conformal prediction offers distribution-free inference for complex models.
problem Traditional predictive inference methods are limited by assumptions about data distributions and model details.
method Conformal prediction uses symmetry assumptions and treats learning algorithms as black boxes.
result Conformal prediction provides exact finite-sample guarantees, even under limited assumptions.
ResCP uses reservoir computing to create efficient, scalable time series prediction intervals.
problem Building distribution-free prediction intervals for time series data with small sample sizes and changing distributions.
method Reservoir Conformal Prediction (ResCP) leverages reservoir computing to dynamically reweight conformity scores based on similarity among reservoir states.
result ResCP achieves asymptotic conditional coverage and is effective across diverse forecasting tasks.
Extends conformal prediction for controlling expected risk of monotone loss functions.
problem Controlling expected risk of monotone loss functions.
method Generalizes split conformal prediction with coverage guarantee, extending to distribution shift, quantile risk, multiple, adversarial, and expectations of U-statistics.
result Tight up to an O(1/n) factor, with worked examples in computer vision and natural language processing. Paper proposes faster adaptation to distribution shifts in online settings.
problem Violation of exchangeability assumption in evolving data environments.
method Online conformal inference with retrospective adjustment.
result Faster adaptation to distributional shifts demonstrated through numerical studies.
Study evaluates conformal prediction methods for safety in vision models under shifts and long-tailed data.
problem Safety guarantees of conformal prediction methods under distribution shifts and long-tailed data.
method Empirical evaluation of post-hoc and training-based conformal prediction methods on large-scale datasets and models.
result Performance of conformal prediction methods degrades significantly under distribution shifts and long-tailed data.
Unified review of Conformal Prediction theory and applications.
problem Distribution-free, non-parametric forecasting method for valid prediction sets.
method Minimal assumptions, straightforward predictions sets valid in finite sample cases.
result Unified review of Conformal Prediction theory and applications.
A method for predicting credal sets in classification tasks using conformal prediction.
problem Designing methods for learning credal set predictors in machine learning.
method Incorporates conformal prediction for predicting credal sets in classification tasks.
result Conformal credal sets are guaranteed to be valid with high probability.
Most existing examples of full conformal predictive systems, split-conformal predictive systems, and cross-conformal predictive systems impose severe restrictions on the adaptation of predictive distributions to the test object at hand. In this paper we develop split-conformal and cross-conformal predictive systems tha…
Adaptive method for prediction sets under changing data distributions.
problem Forming prediction sets in an online setting with varying data distributions.
method Adaptive conformal inference that re-estimates the distribution shift parameter over time.
result Adaptive method achieves desired coverage frequency over long-time intervals.
Paper extends conformal prediction to complex survey data.
problem Applying distribution-free prediction intervals to complex survey data.
method Design-based conformal prediction for non-exchangeable data.
result Empirical guarantees of finite-sample coverage for complex survey data.
Audited Conformal Prediction improves conditional coverage in pretrained models under distribution shift.
problem Uncertainty quantification for pretrained models under unknown distribution shift
method Leverages a small labeled dataset to train an audit model for marginal coverage, integrates outputs into conformal prediction framework
result Significantly higher conditional coverage than existing approaches
CREDO combines credal and conformal methods to create interpretable prediction intervals.
problem Overconfident prediction intervals in regions of model extrapolation.
method CREDO uses a credal envelope to widen intervals in weak evidence regions and then applies conformal calibration.
result CREDO prediction intervals are interpretable and maintain target coverage.
New method for probabilistic prediction sets with conditional validity.
problem Marginal coverage guarantee of existing methods.
method Combines conformal methods with approximate conditional validity.
result Consistently outperforms existing approaches in conditional coverage.
The paper improves prediction intervals for non-parametric regression using histograms.
problem Computing accurate prediction intervals for non-parametric regression models.
method Uses conditional histograms to estimate conditional distributions and compute shortest prediction intervals.
result The method provides prediction intervals with provable marginal coverage and asymptotic conditional coverage.
A new method improves efficiency of conformal prediction for ensemble models.
problem Efficiently estimating uncertainty for ensemble models without distributional assumptions.
method Proposes a multivariate score function to merge prediction regions of individual models, reducing conservatism.
result Demonstrates more efficient prediction regions compared to existing methods.
Conformal Test Martingales can be 'blind' to significant changes in data distribution.
problem The converse of exchangeability does not hold, leading to potential blindness of CTMs.
method Explicit construction of A-cryptic change-point using bivariate Gaussian distributions. result CTMs can be perfectly cryptic to a significant change in marginal means.
Conformal prediction provides distribution-free uncertainty quantification for black-box models.
problem Uncertainty quantification for high-risk machine learning applications.
method Conformal prediction creates valid uncertainty sets without distributional assumptions.
result Sets contain the ground truth with a specified probability, e.g., 90%.
New method uses optimal transport to improve conformal prediction under distribution shifts.
problem Improving conformal prediction's coverage in non-exchangeable settings.
method Optimal transport to estimate and mitigate distribution shifts.
result Estimates and mitigates loss in coverage for arbitrary distribution shifts.
Two new methods generate probabilistic forecasts of individual treatment effects.
problem Generating probabilistic forecasts of individual treatment effects for risk-aware decision-making.
method Proposes CCT and CMC meta-learners combining conformal predictive systems with analytic convolution or Monte Carlo sampling.
result Achieve probabilistically calibrated predictive distributions and performant continuous ranked probability scores.
Proposes feature conformal prediction for broader application in semantic feature spaces.
problem Establishing valid prediction intervals in semantic feature spaces.
method Extends conformal prediction to semantic feature spaces using deep representation learning.
result Feature conformal prediction outperforms regular conformal prediction under mild assumptions.
This paper improves prediction intervals for heteroskedastic regression.
problem Adaptive prediction intervals for heteroskedastic regression.
method Normalized and Mondrian conformal prediction methods.
result Conditional validity of chosen conformal predictors related to data-generating assumptions.
This study uses ICL to efficiently generate robust confidence intervals for noisy regression tasks.
problem Uncertainty quantification for in-context learning in noisy regression tasks.
method Proposes a method based on conformal prediction to construct prediction intervals with guaranteed coverage.
result Conformal prediction with in-context learning (CP with ICL) achieves robust and scalable uncertainty estimates.
Neural optimal transport improves multivariate conformal prediction.
problem Multivariate quantile regression challenges and existing methods ignore joint distribution geometry.
method Combines neural optimal transport with amortized optimization for efficient training and faster inference.
result Constructs tighter and more informative predictive regions for multivariate conformal prediction.
DS-CP improves reliability of uncertainty quantification for large language models under domain shift.
problem Overconfident and factually incorrect outputs (hallucinations) from large language models.
method Adapts conformal prediction to large language models under domain shift by reweighting calibration samples.
result DS-CP delivers more reliable coverage than standard conformal prediction, especially under substantial distribution shifts.
A new AMP-based method speeds up conformal prediction intervals.
problem Computational cost in building high-dimensional prediction intervals.
method Approximate Message Passing (AMP) to accelerate full conformal prediction.
result AMP-based method produces valid prediction intervals orders of magnitude faster.
A stability-based method selects the most desirable conformal prediction set.
problem Selecting the most desirable conformal prediction set from multiple valid sets invalidates coverage guarantees.
method A stability-based approach that ensures coverage for the selected prediction set.
result The stability-based approach maintains coverage guarantees for the selected prediction set.
WBCP improves conformal prediction for distribution shifts using weighted Dirichlet posteriors.
problem Handling distribution shifts in conformal prediction.
method Generalizes Bayesian Quadrature Conformal Prediction (BQ-CP) to arbitrary importance-weighted settings.
result WBCP maintains coverage guarantees while providing richer uncertainty information.
JAPAN uses flow-based models to create adaptive prediction areas with better coverage guarantees.
problem Inadequate prediction areas from existing conformal prediction methods, especially for multimodal distributions.
method JAPAN employs density-based conformity scores using flow-based models to construct context-adaptive prediction areas.
result JAPAN produces more accurate and context-adaptive prediction areas compared to existing methods.