COP improves online conformal prediction by incorporating data patterns, leading to tighter prediction sets.
problem Overly conservative prediction sets in online conformal prediction methods when data distribution shifts.
method Conformal Optimistic Prediction (COP) incorporating estimated cumulative distribution function of non-conformity scores.
result COP produces tighter prediction sets with valid coverage guarantees, outperforming other methods.
Proposes online conformal prediction method with adversarial semi-bandit feedback.
problem Online uncertainty quantification with adversarial semi-bandit feedback.
method Formulates online conformal prediction as an adversarial bandit problem and uses regret minimization.
result Achieves long-run coverage guarantee with adversarial semi-bandit feedback.
Study online conformal prediction for non-stationary data with optimal training-conditional regret.
problem Online prediction for non-stationary data streams with unknown distribution drift.
method Proposes split-conformal and full-conformal algorithms that adapt to drift detection and incorporate stability for online learning.
result Proves minimax-optimal regret for online full conformal algorithm under appropriate restrictions.
Proposes methods for online conformal prediction with nested prediction sets across multiple confidence levels.
problem Need for uncertainty quantification with multiple confidence levels in diverse applications.
method Online optimization perspective to enforce nestedness of prediction sets while controlling quantile estimation error.
result Achieves stable coverage across all levels, strictly nested prediction sets, and improved efficiency.
New online conformal prediction methods minimize strongly adaptive regret and achieve near-optimal coverage.
problem Uncertainty quantification in online settings with changing data distributions.
method Developed new online conformal prediction methods that minimize strongly adaptive regret.
result Achieve near-optimal strongly adaptive regret and approximately valid coverage.
COMA combines prediction sets from multiple models for online, adaptive prediction.
problem Combining multiple prediction models with uncertainty guarantees.
method Online model aggregation using weighted voting of conformal prediction sets.
result COMA retains coverage guarantees under negative correlation assumptions.
Improved online prediction with guaranteed coverage.
problem Creating reliable online predictions for arbitrary sequences.
method Online conformal prediction with decaying step sizes.
result Substantially improved practical properties, including close coverage at every time point.
The paper addresses errors in online selective conformal prediction and proposes new strategies to ensure valid inference.
problem Online selective conformal prediction's exchangeability issues and false coverage rate control problems.
method Evaluation and correction of existing calibration selection strategies, proposing new ones that preserve exchangeability.
result Novel calibration selection strategies ensure both selection-conditional coverage and FCR control.
Paper proposes faster adaptation to distribution shifts in online settings.
problem Violation of exchangeability assumption in evolving data environments.
method Online conformal inference with retrospective adjustment.
result Faster adaptation to distributional shifts demonstrated through numerical studies.
Develops a new method for online conformal prediction without manual tuning.
problem Achieving long-run 1−α coverage for arbitrary data streams in an informative manner. method Linearized regret theory and universal portfolio algorithms.
result Strong finite-time bounds on miscoverage for UP-OCP, outperforming prior methods.
New insights link no-regret learning to online conformal prediction in adversarial settings.
problem Understanding the relationship between no-regret learning and online conformal prediction in adversarial environments.
method Analysis of existing algorithms and new connections between no-regret learning and conformal prediction.
result No-regret learning algorithms can provide group-conditional coverage guarantees in adversarial settings.
Proposes PEMI for online selective conformal prediction with asymmetric rules.
problem Challenges of handling asymmetric selection mechanisms in online selective conformal prediction.
method PEMI: permutation-based framework for selective conformal prediction with arbitrary asymmetric selection rules.
result Achieves exact selection-conditional coverage for any asymmetric selection mechanism and any prediction model.
CAP algorithm controls FCR in online selective prediction.
problem Online predictive tasks with temporal multiplicity and FCR control.
method CAP framework with adaptive pick rule and calibration set construction.
result CAP achieves exact selection-conditional coverage guarantee and FCR control.
Survey of algorithms to correct past mistakes in prediction.
problem Improving prediction accuracy by correcting past errors.
method Defensive Forecasting as a sequential game theory approach to minimize prediction metrics.
result Simple, near-optimal algorithms for various prediction tasks.
COLoKe adapts Koopman embeddings online, reducing overfitting and improving long-term predictions.
problem Online adaptation of Koopman embeddings to avoid overfitting and maintain long-term predictive accuracy.
method Combines deep feature learning with multistep prediction consistency in a lifted space, using a conformal-style mechanism for selective updates.
result Empirically effective in reducing overfitting and maintaining long-term predictive accuracy.
New algorithms improve time series prediction with uncertainty quantification.
problem Uncertainty quantification for time series prediction.
method Combines conformal prediction and control theory for online, adaptive forecasting.
result Improves coverage over ensemble forecasters in real-world applications.
New method calibrates probabilistic linear solver for online coverage guarantees.
problem Uncertainty in probabilistic linear solver solutions without coverage guarantees.
method Online conformal prediction-PLS (OCP-PLS) method to calibrate uncertainty thresholds.
result Validates online calibration of uncertainty thresholds via online conformal prediction.
Adaptive conformal inference without data exchangeability assumptions.
problem Real-world scenarios often violate the data exchangeability assumption for conformal prediction.
method Parameter-free online convex optimization for adaptive conformal inference.
result Controls long-term miscoverage frequency at a nominal level empirically.
Online GP-CP improves long-term coverage of predictions.
problem Model mis-specification in online Gaussian processes.
method Combining Gaussian processes with conformal prediction for guaranteed coverage.
result Adaptive thresholding ensures long-term coverage.
ECI improves time series prediction uncertainty quantification by smoothing miscoverage error.
problem Challenges in uncertainty quantification for time series prediction due to temporal dependence and distribution shift.
method Error-quantified Conformal Inference (ECI) by smoothing quantile loss function and introducing adaptive feedback scale.
result ECI achieves valid miscoverage control and tighter prediction sets than existing methods.
A new method for online prediction uncertainty quantification in non-exchangeable panel data.
problem Challenges in quantifying predictive uncertainty for non-exchangeable panel data.
method Online conformal prediction framework for non-exchangeable panel data, using similarity weights and adaptive miscoverage levels.
result Improves coverage on worst-covered target units through adaptive interval-width allocation.
Adaptive Bayesian learning aggregates experts to improve performance.
problem Bayesian online learning's performance depends on inferential choices.
method Treat Bayesian update rules as experts and aggregate them based on sequential predictive losses.
result The aggregate competes with the best expert in hindsight at a low aggregation cost.
A stability-based method selects the most desirable conformal prediction set.
problem Selecting the most desirable conformal prediction set from multiple valid sets invalidates coverage guarantees.
method A stability-based approach that ensures coverage for the selected prediction set.
result The stability-based approach maintains coverage guarantees for the selected prediction set.
New algorithm provides robust uncertainty quantification without parameter tuning.
problem Real-world machine learning predictors need reliable uncertainty quantification.
method Parameter-free, group-conditional online prediction algorithm.
result Achieves best group-conditional coverage guarantees.
Adaptive method for prediction sets under changing data distributions.
problem Forming prediction sets in an online setting with varying data distributions.
method Adaptive conformal inference that re-estimates the distribution shift parameter over time.
result Adaptive method achieves desired coverage frequency over long-time intervals.
C-PP-COAD detects anomalies with limited real data, reducing dependency on real calibration data.
problem Limited real calibration data for online anomaly detection.
method Context-aware prediction-powered conformal online anomaly detection (C-PP-COAD).
result Significantly reduces dependency on real calibration data without compromising FDR control.
Paper adapts ACI for online multi-step time-series forecasting with coverage guarantees.
problem Achieving reliable error bounds in online multi-step time-series forecasting.
method Adaptive conformal inference (ACI) adapted for multi-step forecasting with dynamic significance levels.
result Proposes a multi-step ACI algorithm with finite-sample coverage guarantees for non-exchangeable data.
A scalable GP model for online uncertainty quantification over graphs.
problem Scalable uncertainty quantification over graphs with dynamic data.
method Graph-aware parametric Gaussian process model using random features and online conformal prediction.
result Improved coverage and efficient prediction sets over existing methods.
BCCP uses bandit feedback to provide reliable predictions with limited labeled data.
problem Limited labeled data and bandit feedback challenge online set-valued classification.
method BCCP uses stochastic gradient descent to train model and make set-valued inferences with unbiased estimation of true label.
result BCCP offers coverage guarantees on a class-specific granularity.
Develops a framework to control risk in online learning models.
problem Rigorous uncertainty quantification for online learning models.
method A framework for constructing uncertainty sets that provably control risk.
result Guarantees risk control at any user-specified level even with distribution shifts.
OnlineSCI extends ACI for adaptive selective inference with improved coverage and IER control.
problem Adaptive selective inference in online settings with improved coverage and IER control.
method Adaptive selective inference with extended ACI algorithm.
result OnlineSCI controls average missed coverage and instantaneous error rate at selected times, up to a non-asymptotic remainder term.
SA-BCP combines long-term and local evidence for efficient, adaptive online prediction.
problem Balancing fast adaptation and stable coverage in online prediction.
method State-Adaptive Bayesian Conformal Prediction (SA-BCP) using gated convex combination of temporal inertia and spatial evidence.
result SA-BCP achieves at-or-above-nominal coverage with substantially sharper intervals compared to discounted Bayesian CP.
Bayesian approach improves online prediction accuracy without distributional assumptions.
problem Online construction of confidence sets for black-box models.
method Combines empirical distribution with Bayesian regularization to predict quantiles.
result Adaptive algorithm with low regret and correct coverage probability for iid data.
Study shows NCCP can replace CP for ACI in non-exchangeable data.
problem Ensuring reliable prediction under non-exchangeability.
method Demonstrates NCCP as a valid alternative to CP for ACI.
result NCCP offers computational advantages and comparable predictive efficiency.
New method for predicting paths of unpredictable objects with high confidence.
problem Need for dependable uncertainty estimates in motion planning with diverse unpredictable objects.
method Blend online conformal prediction, multiple time series techniques, and heteroscedasticity addressing.
result Simultaneous forecasting bands that cover entire paths with high probability.
An online framework optimizes efficiency in conformal prediction with a target miscoverage rate.
problem Achieving coverage and minimizing interval length in a sequential, online setting.
method Optimizes efficiency by directly optimizing the average length of intervals while maintaining coverage.
result Shows a gap between optimal performance for exchangeable and arbitrary sequences, and provides a matching algorithm for the Pareto-optimal settings.
Study risk-controlling prediction sets for single trajectory data from dynamical systems.
problem Performance guarantees for risk-controlling prediction sets in single trajectory data from unknown stochastic dynamical systems.
method Used blocking and decoupling techniques to analyze performance guarantees under different data generating processes.
result Performance guarantees similar to iid setting when data is stationary and contractive, with graceful degradation otherwise.
CPATTA uses conformal prediction for efficient test-time adaptation.
problem Low data selection efficiency in existing ATTA methods.
method Conformal Prediction, online weight-update algorithm, domain-shift detector, staged update scheme.
result CPATTA consistently outperforms state-of-the-art methods by 5% in accuracy.
We develop an online learning method for prediction, which is important in problems with large and/or streaming data sets. We formulate the learning approach using a covariance-fitting methodology, and show that the resulting predictor has desirable computational and distribution-free properties: It is implemented onli…
Study detects concept shift in online data using martingales.
problem Detecting concept shift in online datasets.
method Exchangeable martingales and conformal prediction techniques.
result Decomposes concept shift into detectable components.
Spectral Adaptive Conformal Prediction for Structured Non-Exchangeable Data
problem Improving prediction intervals for non-exchangeable time-indexed datasets
method Spectral adaptive conformal prediction
result Improves on fixed spectral weighting while monitoring uncertainty changes
Adaptive Conformal Inference improves time series forecasting uncertainty.
problem Uncertainty quantification in time series models with dependency.
method AgACI, an adaptive method based on online expert aggregation.
result AgACI provides efficient prediction intervals for day-ahead electricity price forecasting.
Rigorous uncertainty quantification of probabilistic AI weather forecasts with conformal prediction
problem Calibrated uncertainty quantification in probabilistic weather forecasts
method Conformal prediction
result Calibrated uncertainty at no expense to other probabilistic metrics
Online monitoring system for safety classifiers with shift detection and conformal adaptation
problem Detecting and adapting to distributional shifts in deployed safety classifiers
method Calibrated sequential statistics for online monitoring, conformal abstention for adaptation
result 86.6% valid detection with mean latency of 39.5 steps
Online monitor detects classifier drift and adapts predictions.
problem Silent degradation of classifier accuracy under distributional shift.
method Sliding-window KS statistic with calibrated alarm thresholds.
result 86.6% valid detection across various shift conditions.
Adaptive online learning algorithm improves history forgetting in nonstationary environments.
problem Adversarial nonstationary environments where future data can be very different from past data.
method Discounted regret in online convex optimization, FTRL-based algorithm, adaptive learning rate.
result Improves classical gradient descent with constant learning rate in online convex optimization.
TCP provides well-calibrated prediction intervals for nonstationary time series.
problem Nonstationary time series forecasting with well-calibrated prediction intervals.
method Temporal Conformal Prediction (TCP) couples a modern quantile forecaster with a rolling split-conformal calibration layer.
result TCP achieves near-nominal coverage, providing slightly wider intervals than Historical Simulation.
Develops methods to estimate and quantify uncertainty in off-policy evaluation.
problem Uncertainty quantification in off-policy evaluation for new policy deployment.
method Designs a pseudo policy to generate subsamples and applies conformal prediction.
result Valid interval estimators for target policy's return with uncertainty quantification.