Conformal predictive systems are a recent modification of conformal predictors that output, in regression problems, probability distributions for labels of test observations rather than set predictions. The extra information provided by conformal predictive systems may be useful, e.g., in decision making problems. Conf…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,657 papers · 148 categories
Trend · papers per month
48 results for “conformal predictive systems”
Most existing examples of full conformal predictive systems, split-conformal predictive systems, and cross-conformal predictive systems impose severe restrictions on the adaptation of predictive distributions to the test object at hand. In this paper we develop split-conformal and cross-conformal predictive systems tha…
New method improves predictive systems with better theoretical guarantees.
problem Constructing predictive systems with out-of-sample calibration guarantees.
method Residual Distribution Predictive Systems (RDPs) that nest conformal predictive systems and offer flexibility.
result Empirically, RDPs perform competitively with conformal predictive systems and can be implemented with various regression methods.
The paper extends conformal prediction to MDP trajectories for autonomous systems.
problem Ensuring reliability of autonomous systems by providing probabilistic guarantees.
method Applying conformal corrections to quantile regression prediction intervals.
result Conformal prediction intervals ensure the observed trajectory lies inside with high probability.
System uses conformal prediction to help experts make accurate decisions without understanding when to trust it.
problem Helping experts make accurate decisions in multiclass classification tasks.
method Develops an automated decision support system using conformal prediction to provide precise prediction sets and an efficient search method.
result System improves expert predictions by providing precise prediction sets and forcing experts to predict from these sets.
Extend CPS to non-exchangeable settings with observation-specific permutation weights
problem Calibrated predictive bands under distributional shifts
method Encoding distributional shifts through observation-specific permutation weights
result Shift-aware predictive systems remain valid
Paper uses GNN and conformal prediction for accurate edge weight prediction.
problem Predicting edge weights on graphs for various applications.
method Graph Neural Network (GNN) with conformal prediction and error reweighting.
result Our method provides better coverage and efficiency than baselines.
Study risk-controlling prediction sets for single trajectory data from dynamical systems.
problem Performance guarantees for risk-controlling prediction sets in single trajectory data from unknown stochastic dynamical systems.
method Used blocking and decoupling techniques to analyze performance guarantees under different data generating processes.
result Performance guarantees similar to iid setting when data is stationary and contractive, with graceful degradation otherwise.
MA-COPP predicts multi-agent system outcomes using data from a different policy, with probabilistic guarantees.
problem Predicting outcomes in multi-agent systems using data from a different policy.
method Conformal prediction framework applied to multi-agent systems, avoiding exhaustive search.
result Achieves probabilistic guarantees for multi-agent system predictions.
COLoKe adapts Koopman embeddings online, reducing overfitting and improving long-term predictions.
problem Online adaptation of Koopman embeddings to avoid overfitting and maintain long-term predictive accuracy.
method Combines deep feature learning with multistep prediction consistency in a lifted space, using a conformal-style mechanism for selective updates.
result Empirically effective in reducing overfitting and maintaining long-term predictive accuracy.
Valid prediction sets for dynamic graphs using conformal prediction.
problem Uncertainty quantification in dynamic graph neural networks.
method Dynamic graph unfolding for input to GNNs, combined with conformal prediction.
result Valid prediction sets with minimal assumptions, even in challenging scenarios.
General predictive models do not provide a measure of confidence in predictions without Bayesian assumptions. A way to circumvent potential restrictions is to use conformal methods for constructing non-parametric confidence regions, that offer guarantees regarding validity. In this paper we provide a detailed descripti…
The paper uses conformal prediction to detect railway signals with confidence.
problem Deploying deep learning models in certified systems requires accurate uncertainty estimates.
method The paper uses conformal prediction and risk control to detect railway signals.
result The conformal prediction framework provides reliable and trustworthy uncertainty estimates for model performance.
Book teaches conformal prediction for complex machine learning systems.
problem Formal guarantees for machine learning prediction sets.
method Permutation tests and exchangeability for distribution-free inference.
result Provides formal, finite-sample guarantees for machine learning.
New metrics improve understanding of predictive system reliability.
problem Evaluating conditional coverage of predictive systems.
method Casting conditional coverage estimation as a classification problem, using excess risk of the target coverage (ERT) metrics.
result Modern classifiers provide higher statistical power for estimating conditional coverage.
Enhanced route planning with probabilistic prediction and uncertainty sets.
problem Improving route planning reliability under uncertainty.
method CQR-GAE model integrating conformal prediction and uncertainty sets.
result Significantly outperforms baseline methods in real-world traffic scenarios.
Bayesian quadrature improves conformal prediction for better risk assessment.
problem Improving risk assessment for machine learning models.
method Revisiting conformal prediction from a Bayesian perspective and proposing Bayesian quadrature.
result Provides interpretable guarantees and a richer representation of likely losses.
Combining Bayesian deep learning and split conformal prediction affects out-of-distribution coverage.
problem Improving out-of-distribution coverage in multiclass image classification.
method Combining Bayesian deep learning with split conformal prediction methods.
result Combining methods can reduce out-of-distribution coverage in some cases.
The paper develops methods to predict the probability of achieving a user goal in a task, ensuring the system alerts when the probability falls below a threshold.
problem Ensuring an autonomous system achieves the user's goal with calibrated probability estimates.
method Invertible conformal prediction using Probability-space Conformalized Quantile Regression (PCQR) to produce well-calibrated conditional prediction intervals.
result The method produces well-calibrated probabilities that the cumulative reward will fall within a user-specified target interval, with finite-sample guarantees.
WCPS extends CPS to handle covariate shifts, providing probabilistically calibrated predictions.
problem Applying CPS to scenarios with covariate shifts.
method WCPS uses likelihood ratios between training and testing covariate distributions.
result WCPS are probabilistically calibrated under covariate shift.
New method detects drift in high-dimensional data.
problem Understanding and localizing concept drift in learning systems.
method Conformal predictions for drift localization.
result Our approach outperforms existing methods on image datasets.
Study baryogenesis in conformally flat spacetimes using causal fermion systems.
problem Understanding baryogenesis in specific spacetimes.
method Analysis of baryogenesis mechanism in conformally flat spacetimes with explicit formula derivation.
result Explicit formula for baryogenesis rate in these spacetimes.
Two new methods generate probabilistic forecasts of individual treatment effects.
problem Generating probabilistic forecasts of individual treatment effects for risk-aware decision-making.
method Proposes CCT and CMC meta-learners combining conformal predictive systems with analytic convolution or Monte Carlo sampling.
result Achieve probabilistically calibrated predictive distributions and performant continuous ranked probability scores.
A new score function improves explainability and reliability of AI systems.
problem Designing AI systems that are explainable, robust, and trustworthy.
method Integrates conformal prediction with explainable machine learning using a novel score function.
result The method achieves improved performance on target classes and satisfies conformal guarantees.
New methods improve anomaly detection with reduced false positives.
problem Effective anomaly detection with controlled error rates.
method Leave-one-out-, bootstrap-, and cross-conformal anomaly detection methods.
result Improved anomaly detection with reduced false positives.
Noise-Aware Conformal Prediction (NACP) calibrates CP for noisy labels.
problem Calibrating Conformal Prediction with noisy labels.
method Estimate conformal threshold from noisy labels using uniform noise coverage guarantee.
result Finite sample coverage guarantee for uniform noise remains effective in high-class tasks.
Proposes a method for generating prediction intervals in dose-response models using conformal prediction.
problem Uncertainty quantification in continuous treatments for personalized healthcare decisions.
method Causal dose-response problem framed as covariate shift, using weighted conformal prediction with propensity estimation and kernel functions.
result Demonstrates the significance of covariate shift assumptions for robust prediction intervals.
STOIC improves energy demand forecasting with reliable uncertainty estimates.
problem Accurate point forecasts alone are insufficient for energy systems; reliable uncertainty estimates are needed.
method Integrates graph-based forecasting with tabular foundation models for zero-shot calibration of spatial-temporal residuals.
result STOIC delivers more reliable and robust uncertainty estimates for complex graph-structured energy time series.
Paper proves conformal prediction works for any data distribution.
problem Quantifying risk in AI systems with non-exchangeable data.
method Developed a method to extend conformal prediction to any data distribution.
result Valid conformal prediction guarantees for any data distribution.
COMA combines prediction sets from multiple models for online, adaptive prediction.
problem Combining multiple prediction models with uncertainty guarantees.
method Online model aggregation using weighted voting of conformal prediction sets.
result COMA retains coverage guarantees under negative correlation assumptions.
New method calibrates probabilistic linear solver for online coverage guarantees.
problem Uncertainty in probabilistic linear solver solutions without coverage guarantees.
method Online conformal prediction-PLS (OCP-PLS) method to calibrate uncertainty thresholds.
result Validates online calibration of uncertainty thresholds via online conformal prediction.
Most machine learning classifiers give predictions for new examples accurately, yet without indicating how trustworthy predictions are. In the medical domain, this hampers their integration in decision support systems, which could be useful in the clinical practice. We use a supervised learning approach that combines E…
A framework for private prediction sets using conformal prediction and differential privacy.
problem Jointly addressing reliability and privacy in machine learning predictions.
method Split conformal prediction with privatized quantile subroutine.
result Private prediction sets can be generated from privately-trained models.
Proposes online conformal prediction method with adversarial semi-bandit feedback.
problem Online uncertainty quantification with adversarial semi-bandit feedback.
method Formulates online conformal prediction as an adversarial bandit problem and uses regret minimization.
result Achieves long-run coverage guarantee with adversarial semi-bandit feedback.
Proposes a recursive MPC scheme with probabilistic safety guarantees for uncertain dynamic systems.
problem Probabilistic safety guarantees for MPC in dynamic environments with unknown stochastic agents.
method Uses conformal prediction to derive high-confidence prediction regions and gradually relax safety constraints online.
result Ensures recursive feasibility of MPC schemes by relaxing safety constraints over time.
Conformal prediction sets can lead to unfair outcomes.
problem Disparate impact in decision-making with conformal prediction sets.
method Experiments with human participants to demonstrate disparate impact and propose equalizing set sizes across groups.
result Providing prediction sets that satisfy Equalized Coverage increases disparate impact compared to marginal coverage.
New decision support systems use prediction sets to help experts update their predictions, improving performance.
problem Challenges in explaining and updating predictions from decision support systems.
method Developed a methodology leveraging nested structure of prediction sets and counterfactual monotonicity to improve performance.
result Limiting experts' agency leads to better performance in decision support systems based on prediction sets.
Conformal Test Martingales can be 'blind' to significant changes in data distribution.
problem The converse of exchangeability does not hold, leading to potential blindness of CTMs.
method Explicit construction of -cryptic change-point using bivariate Gaussian distributions.
result CTMs can be perfectly cryptic to a significant change in marginal means.
CoCAI uses copulas for accurate multivariate time-series forecasting and anomaly detection.
problem Accurate multivariate time-series forecasting and robust anomaly detection.
method Copula-based conformal prediction for multivariate time-series analysis.
result CoCAI provides statistically valid predictive regions and robust anomaly scores.
Paper uses conformal prediction for solar power forecasting in electricity markets.
problem Enhancing participation in electricity markets through accurate day-ahead PV power predictions.
method Combines machine learning for point predictions and conformal prediction for uncertainty quantification.
result CP with k-nearest neighbors and Mondrian binning outperforms linear quantile regressors in predicting PV power.
CoNBONet: Conformalized Neuroscience-inspired Bayesian Operator Network for Reliability Analysisstat.ML
CoNBONet improves reliability analysis of complex systems with fast, energy-efficient predictions.
problem Time-dependent reliability analysis of nonlinear systems under stochastic excitations is computationally demanding.
method CoNBONet combines deep operator networks with neuroscience-inspired neuron models for fast, energy-efficient inference.
result CoNBONet provides reliable coverage of failure probabilities with theoretical guarantees.
Conformal prediction ensures reliable weed spraying guarantees.
problem Lack of trust in deep learning-based precision weeding systems.
method Conformal prediction for providing trustworthy guarantees on black-box models.
result Formal guarantees on spraying at least 90% of weeds.
GC-FCP provides efficient federated CP with group-conditional coverage guarantees.
problem Uncertainty quantification in federated settings with distributed calibration data.
method Group-conditional federated conformal prediction (GC-FCP) using group-stratified coresets.
result GC-FCP offers efficient aggregation and calibration compared to centralized methods.
New approach to fairness in machine learning models using conformal prediction.
problem Fairness in machine learning models' downstream decision-making.
method Theoretical derivation and empirical evaluation of label-clustered conformal prediction.
result Label-clustered conformal prediction often provides a favorable balance between utility and substantive fairness.
Conf-Gen applies uncertainty quantification to generative models.
problem Uncertainty quantification for unsupervised generative models.
method Adapts CRC to generative tasks, relaxing theoretical assumptions.
result Demonstrates flexibility and correctness of AI agent outputs.
Improves data-driven reachability estimation for complex systems.
problem Estimating reachable states in complex dynamical systems with unknown parameters.
method Uses Christoffel functions and conformal prediction to improve sample efficiency and robustness.
result Guaranteed convergence to the true reach set with improved sample efficiency and robustness.
Paper tightens optimization bounds using conformal prediction.
problem Lack of practical informiveness in dual bounds from optimization solvers.
method Introduces conformal prediction framework to tighten loose primal and dual bounds.
result Proposed method produces tighter, more informative prediction intervals.
Two methods improve Gaussian process predictive distributions' calibration.
problem Improving the reliability of Gaussian process predictive intervals.
method Introduces two methods: cps-gp and bcr-gp, both adapting conformal predictive systems to GP interpolation.
result Both methods provide finite-sample marginal calibration and smooth predictive distributions.