Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,695 papers · 148 categories

Trend · papers per month

118236354472 · May 202619922001200920172026
48 results for conditional calibration

A new metric CKCE improves model calibration comparison.

problem Comparing the calibration of probabilistic models is challenging.
method CKCE based on Hilbert-Schmidt norm of conditional mean operators.
result CKCE provides more consistent and robust model calibration comparisons.

This paper rethinks confidence calibration under covariate shifts.

problem Calibration methods struggle with covariate shifts and unstable importance weighting.
method Derives Expectation consistency condition and proposes Expectation consistency loss (ECL).
result ECL loss is compatible with various types of calibration and has the same sample complexity as ECE.

Study on estimating conditional risk in machine learning.

problem Estimating expected loss of prediction models given input features.
method Analyzed in classification and regression settings, showing equivalence to standard regression. Developed theoretical insights and empirical validation.
result Conditional risk calibration is distinct from existing uncertainty quantification problems.

Self-calibrating conformal prediction improves interval efficiency and offers a practical alternative.

problem Improving the reliability and uncertainty quantification of machine learning predictions.
method Combines Venn-Abers calibration and conformal prediction for binary and regression problems.
result Improves interval efficiency through model calibration and offers practical alternatives.

Proposes a method to create shorter, more accurate prediction intervals.

problem Challenges in achieving both conditional validity and interval efficiency in complex settings.
method Uses a conformal-style calibration method for neural network responses, adjusting to empirical PIT distribution.
result Demonstrates better conditional calibration and shorter intervals than existing methods.

ICP improves prediction intervals for continuous outcomes at lower computational cost.

problem Systematic bias in point predictions that undermines their use in decision-making.
method Develops Isotonic Conformal Prediction (ICP) framework to decouple calibration from prediction-set construction.
result SICP and TICP procedures match SC-CP coverage at lower computational cost.

Establishes a condition for multiclass classification-calibration of Gamma-Phi losses.

problem Ensuring classification-calibration of multiclass Gamma-Phi losses.
method Develops a general sufficient condition for classification-calibration of Gamma-Phi losses.
result Proves the first family of nonconvex multiclass surrogate losses for which classification-calibration has been fully justified.

ECCIT improves conditional independence tests by calibrating for miscalibration.

problem Inaccurate frequentist guarantees in CITs, especially in small samples and misspecified models.
method Empirically Calibrated Conditional Independence Tests (ECCIT) that optimize and correct for miscalibration.
result ECCIT achieves valid FDR with higher power than existing calibration strategies.

LADaR framework calibrates machine learning models for instance-wise predictions.

problem Challenges in assessing and calibrating predictive distributions for complex inputs.
method Local Amortized Diagnostics and Reshaping of Conditional Densities (LADaR) framework and extttCalPIT exttt{Cal-PIT} algorithm.
result Achieves better instance-wise calibration than existing methods in galaxy distance estimation.

New method simplifies checking consistency of differentiable loss functions.

problem Verifying consistency of differentiable loss functions is difficult.
method Developed a new approach called strong indirect elicitation (strong IE) to simplify checking consistency.
result Strong IE is equivalent to calibration for strongly convex, differentiable surrogates.

Unified framework for generalized Venn and Venn-Abers calibration for reliable prediction.

problem Asymptotic guarantees of popular distribution-free methods in model calibration.
method Unified framework extending Vovk's approach to generic loss functions, transforming predictors into set-valued predictions.
result Finite-sample set predictions shrink to a single conditionally calibrated prediction, capturing epistemic uncertainty.

New methods for better uncertainty prediction in ML.

problem Insufficient calibration in machine learning regression.
method Conditional calibration with respect to input features (adaptivity).
result Consistency and adaptivity are complementary, and good consistency does not guarantee good adaptivity.

Paper introduces a new method for calibrating ESGs to both historical and forward-looking data.

problem Lack of a generally accepted methodology for calibrating ESGs to forward-looking information.
method Conditional Scenario Simulator framework for consistent calibration of economic and financial variables.
result Framework can embed various financial and macroeconomic models and demonstrate practical examples in frequentist and Bayesian settings.

T-Cal tests model calibration with a minimax optimal test.

problem Detecting mis-calibration of predictive models using a finite validation dataset.
method T-Cal is a minimax optimal test for calibration based on a debiased plug-in estimator of the 2\ell_2-Expected Calibration Error (ECE).
result T-Cal is a practical tool for testing the calibration of probabilistic classification methods.

GC-FCP provides efficient federated CP with group-conditional coverage guarantees.

problem Uncertainty quantification in federated settings with distributed calibration data.
method Group-conditional federated conformal prediction (GC-FCP) using group-stratified coresets.
result GC-FCP offers efficient aggregation and calibration compared to centralized methods.

MOPI optimizes flexible set-valued mappings to achieve superior shape adaptivity in conformal prediction.

problem Challenges in achieving valid conditional coverage in conformal prediction.
method Minimax Optimization Predictive Inference (MOPI) framework that optimizes over a flexible class of set-valued mappings.
result MOPI achieves superior shape adaptivity and maintains a principled connection to mean squared coverage error.

Proposes CCE to assess point-wise reliability of neural network predictions.

problem Overconfidence and misaligned predictive distributions in neural networks.
method Introduces Conditional Congruence (CCE) metric using conditional kernel mean embeddings.
result CCE exhibits correctness, monotonicity, reliability, and robustness in high-dimensional regression tasks.

The paper studies calibration in ML models for wireless networks, showing key theoretical and practical insights.

problem Ensuring ML models in wireless networks deliver well-calibrated confidence scores for reliable decision-making.
method Theoretical analysis and simulation-based experiments using Platt scaling and isotonic regression.
result Well-calibrated models improve the system's minimum achievable OP and are part of a broader class of predictors.

For Hitchin's generalised geometries we introduce and analyse the concept of a structured submanifold which encapsulates the classical notion of a calibrated submanifold. Under a suitable integrability condition on the ambient geometry, these generalised calibrated cycles minimise a functional occurring as D-brane ener…

2006-05-29abs ↗pdf ↗

ProbRes calibrates probabilistic forecasts by learning volatility dynamics.

problem Quantifying risk and uncertainty in time series forecasting.
method ProbRes learns conditional mean and volatility separately, generating well-calibrated prediction intervals.
result ProbRes accurately captures predictive distributions and produces well-calibrated prediction intervals.

New quantile methods improve uncertainty quantification across various models.

problem Improper quantile loss limits model flexibility and accuracy.
method Developed new quantile methods that optimize for calibration, sharpness, and centered intervals.
result Improved conditional quantiles and better uncertainty quantification across diverse models.

Unique solutions found for Plateau problems in smooth and continuous calibrations.

problem Finding unique solutions to the Plateau problem for specific types of currents.
method Boundary regularity theory for area-minimizing currents and unique continuation argument.
result Every compactly supported smoothly or continuously calibrated integral current is the unique solution to the Plateau problem for its boundary data.

New truthful calibration errors improve model ranking in multiclass prediction.

problem Non-truthful calibration errors can mislead model comparisons.
method Introduced perfectly truthful calibration errors for multiclass predictions.
result Truthful calibration errors preserve decision-theoretic dominance and stabilize model rankings.

We present a scoring approach for speaker verification that mimics the standard PLDA-based backend process used in most current speaker verification systems. However, unlike the standard backends, all parameters of the model are jointly trained to optimize the binary cross-entropy for the speaker verification task. We …

2019-11-26abs ↗pdf ↗

Study adiabatic limits of calibrated submanifolds in Riemannian geometry.

problem Understanding the behavior of calibrated submanifolds under adiabatic limits.
method Define a 1-parameter family of forms and study their adiabatic limit, showing it is a generalized calibration.
result Adiabatic calibrated submanifolds are anisotropic minimal in the classical sense.

KCal calibrates deep networks by embedding logits in a metric space.

problem Overconfident predictions from DNNs, especially in high-risk applications.
method KCal learns a metric space on the penultimate-layer latent embedding and generates predictions using kernel density estimates.
result KCal provides a provable full calibration guarantee and consistently outperforms baselines.

The paper investigates how calibrating propensity scores improves DML estimates of average treatment effects.

problem Improving the accuracy of DML estimates in finite samples.
method Propensity score calibration within the Double/debiased machine learning framework.
result Calibrating propensity scores reduces the root mean squared error of DML estimates of average treatment effects in finite samples.

Estimates calibration error under label shift without labels.

problem Ensuring model reliability in the face of dataset shift without access to labels.
method Importance re-weighting of the labeled source distribution to estimate calibration error under label shift.
result Effective and reliable CE estimation with respect to the shifted target distribution.

Proposes a new calibration error estimator for deep neural networks.

problem Improves calibration of deep neural networks, especially for canonical calibration.
method Uses a Dirichlet kernel density estimate to create a low-bias, trainable calibration error estimator.
result Asymptotically converges to true LpL_p calibration error, enabling efficient estimation and mini-batch updates.

This paper improves Reifenberg's theorem for almost calibrated sets, ensuring rectifiability with volume bounds.

problem Improving the rectifiability of sets that are close to subspaces under certain calibrations.
method Using ε-calibrations and positivity conditions, the paper shows that almost calibrated sets are rectifiable with volume bounds.
result Almost calibrated sets are rectifiable with uniform volume bounds.

This paper characterizes and designs loss functions for robust classification with abstention.

problem Ensuring robustness against adversarial attacks and knowing when to abstain from prediction.
method Proposes adversarial robust reject option loss and characterizes surrogates for calibration.
result Shifted Double Ramp Loss and Shifted Double Sigmoid Loss satisfy the calibration conditions.

Reassesses calibration metrics in machine learning models.

problem Inconsistent reporting of calibration metrics in recent literature.
method Calibration-based decomposition of Bregman divergences, visualization of calibration and generalization error.
result New visualization technique for detecting trade-offs between calibration and generalization.