Conformal methods create prediction bands that control average coverage under no assumptions besides i.i.d. data. Besides average coverage, one might also desire to control conditional coverage, that is, coverage for every new testing point. However, without strong assumptions, conditional coverage is unachievable. Giv…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,742 papers · 148 categories
Trend · papers per month
48 results for “coverage assumptions”
T-SCI improves Cox-MLP's guaranteed coverage for censored data.
problem Losing guaranteed coverage when relaxing linear assumption with neural networks.
method Two-stage conformal inference algorithm with non-conformity score.
result T-SCI provides guaranteed coverage under milder assumptions.
CPPO learns policies from partial offline data in MDPs with structural assumptions.
problem Offline Reinforcement Learning with partial coverage assumption.
method Constrained Pessimistic Policy Optimization (CPPO) using a function class and model class constraint.
result CPPO achieves PAC guarantee with partial coverage, learning competitive policies.
New model OPSS allows constant approximation for maximum coverage problem.
problem Optimizing coverage functions from samples is hard.
method Proposed OPSS model with structured samples.
result Achieved constant approximation for maximum coverage problem.
The paper explores learning good policies from past data in large state spaces.
problem Learning good policies from historical data in large state spaces.
method Introduces expressivity assumptions and data coverage for function approximation and algorithmic design.
result A variety of algorithms and their guarantees are presented based on assumptions and desired complexity.
Responds to critiques on tests for causal parameter confidence intervals.
problem Testing nominal confidence interval coverage for causal parameters estimated by machine learning.
method Rejoinder to critiques on nearly assumption-free tests.
result Clarifies and supports the original research's approach.
Unified coverage analysis for linear off-policy evaluation in reinforcement learning.
problem Lack of a unified understanding of coverage parameters in linear off-policy evaluation.
method Developed a novel finite-sample analysis for LSTDQ algorithm, introducing feature-dynamics coverage.
result Unified understanding of coverage parameters in linear off-policy evaluation.
New offline RL method handles average-reward MDPs with single-policy coverage.
problem Challenges in offline reinforcement learning due to distribution shift and non-uniform coverage.
method Develops an algorithm based on pessimistic discounted value iteration with quantile clipping.
result First fully single-policy sample complexity bound for average-reward offline RL.
Online GP-CP improves long-term coverage of predictions.
problem Model mis-specification in online Gaussian processes.
method Combining Gaussian processes with conformal prediction for guaranteed coverage.
result Adaptive thresholding ensures long-term coverage.
Study shows offline RL with partial coverage and weak function classes is possible.
problem Learning optimal policies from logged data with function approximation.
method Marginalized Importance Sampling (MIS) with additional covering distribution.
result Finite-sample guarantees for sample-efficient offline RL for general MDPs.
Locally Valid and Discriminative prediction intervals for deep learning models.
problem Efficient and theoretically sound uncertainty quantification for deep learning models.
method Locally Valid and Discriminative prediction intervals (LVD) using kernel regression.
result Locally Valid and Discriminative prediction intervals (LVD) offer better performance and scalability compared to existing methods.
Improved RL algorithm with linear MDPs for offline learning with partial data coverage.
problem Efficient offline RL with linear MDPs under partial data coverage.
method Primal-dual algorithm with sample complexity.
result First computationally efficient algorithm with sample complexity for offline RL with linear MDPs under partial data coverage.
Paper proposes a new method for conditional coverage in conformal prediction.
problem Lack of strong conditional coverage guarantees in existing conformal prediction methods.
method Modified non-conformity score using local approximation of conditional distribution.
result Unified framework and empirical evaluations show advantage of the new method.
New coverage conditions improve sample efficiency in online reinforcement learning.
problem Improving sample efficiency in online reinforcement learning with function approximation.
method Identifying and studying new coverage conditions for online reinforcement learning.
result Improved regret bounds achieved with new coverage conditions.
Efficient PI for neural networks without distributional assumptions.
problem No distributional assumptions for efficient predictive inference.
method Differential privacy and linear approximation for leave-one-out models.
result Rigorous coverage guarantees with reduced computation.
Paper develops conformalized survival analysis method for better prediction.
problem Survival analysis models often misspecify and require strong assumptions.
method Uses conformal prediction to wrap around any survival prediction algorithm.
result Lower predictive bounds provide guaranteed coverage without strong assumptions.
Sharp analysis improves RLHF sample complexity with KL-regularization.
problem Improving RLHF sample complexity with KL-regularization.
method Sharp analysis of KL-regularized contextual bandits and RLHF.
result Achieved an O(1/ε) sample complexity when ε is sufficiently small.
Study improves conformal prediction for EEG classification in healthcare, enhancing coverage.
problem Uncertainty quantification in clinical predictions, especially in distribution-shifted settings.
method Personalized calibration strategies to improve coverage of prediction sets.
result Coverage improved by over 20 percentage points with comparable prediction set sizes.
Random forests are stable and provide reliable prediction intervals.
problem Stability and reliability of random forest prediction intervals.
method Established stability under mild conditions and proved coverage bounds.
result Non-asymptotic lower and upper bounds for prediction interval coverage.
Adaptive PI by reweighting nonconformity scores improves model uncertainty reflection.
problem CP methods using a constant correction for all test points ignore individual uncertainties.
method QRF learns distribution of nonconformity scores and assigns weights to samples.
result PI lengths more aligned with model uncertainty and improved adaptiveness.
New sampling bounds improve uniform coverage verification in machine learning.
problem Conservative bounds in classical coverage analyses at small failure probabilities.
method Variance-based analysis of uniform random sampling on a -dimensional unit hypercube.
result Sample complexity bound with logarithmic dependence on failure probability.
New algorithms estimate Q-functions under partial coverage and realizability, improving offline RL guarantees.
problem Offline RL with limited exploration and assumptions about data coverage and Q-function realizability.
method Proposes minimax learning algorithms to estimate soft or vanilla Q-functions with -convergence guarantees.
result PAC guarantees for offline RL under partial coverage and realizability conditions.
Conformal Prediction Assessment: A Framework for Conditional Coverage Evaluation and Selectionstat.ME
CPA framework assesses conditional validity of conformal prediction.
problem Challenges in evaluating conditional validity of conformal prediction.
method Reframes conditional coverage evaluation as a supervised learning task.
result Establishes convergence rates and proves CVI consistency.
On the Curses of Future and History in Future-dependent Value Functions for Off-policy Evaluationcs.LG
Study on future-dependent value functions for off-policy evaluation in complex environments.
problem Exponential dependence on horizon in off-policy evaluation for complex observations.
method Developed novel coverage assumptions for POMDPs to achieve polynomial bounds.
result Achieved polynomial bounds on previously exponential quantities, improving off-policy evaluation.
Proposes LSCP for spatial data uncertainty quantification.
problem Uncertainty quantification in spatial statistics, especially for complex and heterogeneous datasets.
method Localized quantile regression for spatial conformal prediction.
result LSCP provides more accurate and consistent prediction intervals.
New method for time series prediction with uncertainty quantification.
problem Uncertainty quantification for multi-dimensional time series predictions.
method Flow-based conformal prediction for time series.
result Significantly smaller prediction sets with target coverage.
Split conformal prediction provides finite-sample guarantees for black-box models without distributional assumptions.
problem Weak performance guarantees for modern predictive models under minimal assumptions.
method Develops finite-sample guarantees for split conformal prediction, a method that uses nested prediction sets and order statistics.
result The coverage of prediction sets based on order statistics stochastically dominates the Beta distribution.
Paper tackles offline RL with weak assumptions on both function classes and data coverage.
problem Achieve sample-efficient offline RL with weak assumptions on both factors.
method Simple algorithm based on primal-dual formulation of MDPs, with density-ratio function modeling dual variables.
result Polynomial sample complexity achieved under realizability and single-policy concentrability.
WR-CP reduces prediction set size and coverage gap under distribution shift.
problem Guaranteed coverage under distribution shift not achievable with i.i.d. assumption.
method Wasserstein distance, probability measure pushforwards, importance weighting, regularized representation learning.
result Reduces coverage gap to 3.2% across different confidence levels.
This work introduces a noise-adaptive conformal inference method for better prediction sets in noisy data.
problem Real-world complications like random label noise limit the effectiveness of conformal inference.
method An adaptive conformal inference method capable of handling deviations from exchangeability.
result Informative prediction sets with tight marginal coverage guarantees in noisy data.
Knowing what you know: valid and validated confidence sets in multiclass and multilabel predictionstat.ML
Develops methods for valid and validated confidence sets in multiclass and multilabel prediction.
problem Challenges of typical conformal prediction methods in multiclass and multilabel problems, especially uneven coverage.
method Leverages quantile regression to build methods that always guarantee correct coverage and asymptotically optimal conditional coverage, addressing label interactions with tree-structured classifiers.
result Empirical evaluation suggests more robust coverage of confidence sets.
Survey of offline RL theory and practical algorithm design challenges.
problem Optimizing return from fixed agent trajectories without additional interactions.
method Theoretical insights and practical algorithm design.
result Conditions for practical offline RL algorithms and their limitations.
Develops a calibration prediction interval for non-parametric regression and neural networks.
problem Lack of accurate conditional prediction in regression settings.
method Calibration Prediction Interval (cPI) using Deep Neural Networks (DNN) or kernel methods.
result Asymptotically valid coverage rate and high probability of coverage rate with large sample sizes.
New method for probabilistic prediction sets with conditional validity.
problem Marginal coverage guarantee of existing methods.
method Combines conformal methods with approximate conditional validity.
result Consistently outperforms existing approaches in conditional coverage.
COLEP improves robustness of conformal prediction via probabilistic circuits.
problem Adversarial perturbations can undermine the coverage guarantees of conformal prediction.
method COLEP uses probabilistic circuits to learn and reason about different semantic concepts, providing certifiable coverage guarantees.
result COLEP achieves higher prediction coverage and accuracy than a single model, especially with non-trivial knowledge models.
Enhances conformal prediction for better uncertainty estimates in armed conflict fatalities.
problem Lack of individual-level uncertainty estimates in existing forecasting models.
method Introduces bin-conditional conformal prediction (BCCP) to improve coverage rates across subsets of the outcome variable.
result Demonstrates improved local coverage and well-calibrated uncertainty estimates across various ranges of fatalities.
Paper introduces a new framework to improve sample efficiency in POMDPs learning.
problem Challenges in off-policy evaluation for POMDPs, especially with hidden states.
method Exploits the metric structure of belief space to relax coverage assumptions.
result Unified analysis technique yields tighter error bounds and sample efficiency improvements.
Predictive inference for time series: why is split conformal effective despite temporal dependence?stat.ML
Split conformal prediction works well for time series despite temporal dependence.
problem Uncertainty quantification for time series predictions with past data.
method Split conformal prediction method for time series data with predictors having memory.
result Theoretical bounds on coverage probability for split conformal prediction in time series with memory.
The paper introduces a method to assess machine translation quality with confidence intervals.
problem Evaluating the uncertainty and quality of machine translation.
method Utilizes conformal predictive distributions to produce prediction intervals with guaranteed coverage.
result The method outperforms a baseline on six language pairs in terms of coverage and sharpness.
Paper studies offline RL with linear approx, focusing on inherent Bellman error.
problem Offline RL with linear approx, focusing on inherent Bellman error.
method Algorithm that succeeds under single-policy coverage condition, leveraging inherent Bellman error.
result Algorithm yields first known guarantee under single-policy coverage, even for linear Bellman completeness.
This work challenges the assumption that shorter conformal prediction intervals are always better.
problem The conventional evaluation of conformal prediction metrics (coverage and interval length) may not fully capture the quality of predictions.
method The Prejudicial Trick (PT) is introduced, which probabilistically returns either a null interval or a longer one to maintain valid coverage while potentially reducing interval length.
result The Prejudicial Trick can yield deceptively shorter intervals without compromising coverage, but introduces practical vulnerabilities.
C-SymmPI provides near-conditional coverage for structured data with group symmetries.
problem Establishing near-conditional coverage guarantees for structured data with group symmetries.
method Developed a framework C-SymmPI that achieves near-conditional coverage under general data structures with group symmetries.
result Near-conditional coverage guarantees for structured data with group symmetries.
Offline RL struggles with sample efficiency due to fundamental barriers.
problem Sample efficiency in offline RL with value function approximation.
method Analyzes the necessity of distributional and representational assumptions.
result Even with concentrability and realizability, sample complexity is polynomial in state space size.
Online Conformal Inference with Retrospective Adjustment for Faster Adaptation to Distribution Shiftstat.ML
Paper proposes faster adaptation to distribution shifts in online settings.
problem Violation of exchangeability assumption in evolving data environments.
method Online conformal inference with retrospective adjustment.
result Faster adaptation to distributional shifts demonstrated through numerical studies.
Paper tackles non-uniform coverage planning for robots.
problem Non-uniform coverage planning for robots that need to visit some points more frequently.
method Proposes a novel reinforcement learning approach in a Semi-Markov Decision Process.
result Significant improvement over existing greedy approach in simulations.
New offline RL algorithm with optimal sample complexity using LP and error bounds.
problem Finding optimal policies from offline data with limited coverage and function approximation.
method Developed a new LP reformulation with error bounds and constraints for offline RL.
result Achieved optimal sample complexity under various assumptions.
New method refines prediction intervals for individual treatment effects using cross-world correlation.
problem Uncertainty in individual treatment effects for high-stakes decisions.
method Introduces cross-world correlation parameter ρ to refine prediction intervals for individual treatment effects.
result Achieves more stable and accurate coverage of prediction intervals for individual treatment effects.
Develops methods to adjust prediction set coverage based on post-selection analysis.
problem Adjusting prediction set coverage after initial analysis to better fit specific needs.
method Post-selection conformal inference to adjust miscoverage levels.
result Allows for trade-off between coverage and prediction set quality.