Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,657 papers · 148 categories

Trend · papers per month

3016019021,202 · Jun 202019922001200920172026
48 results for calibration methods

New method calibrates neural network predictions for better reliability.

problem Improper probability estimates from deep networks leading to unreliable predictions.
method Proposes a constrained optimization approach for a monotonic calibration map.
result Achieves state-of-the-art performance across various datasets and models.

Proposes an accuracy-preserving calibration method for DNNs.

problem Calibration of deep neural networks (DNNs) to measure prediction reliability.
method Uses Concrete distribution on the probability simplex to calibrate DNNs without accuracy loss.
result The proposed method outperforms previous methods in accuracy-preserving calibration tasks.

We propose nonparametric methods for individual calibration in regression models.

problem Uncertainty quantification and individual calibration for regression models.
method Nonparametric methods agnostic of the underlying model, combining nonparametric and covering number arguments.
result Established matching upper and lower bounds for calibration error.

Obtaining accurate and well calibrated probability estimates from classifiers is useful in many applications, for example, when minimising the expected cost of classifications. Existing methods of calibrating probability estimates are applied globally, ignoring the potential for improvements by applying a more fine-gra…

2018-07-31abs ↗pdf ↗

Develops confidence intervals for ECE, a measure of model calibration.

problem Ensuring the calibration of probabilistic predictions in machine learning models.
method Develops confidence intervals for the 2\ell_2 Expected Calibration Error (ECE), considering top-1-to-kk calibration.
result Shows asymptotic normality and different convergence rates for calibrated and miscalibrated models, developing methods to construct valid confidence intervals.

Two methods improve calibration of probabilistic classifiers, especially for multi-class problems.

problem Improving calibration of probabilistic classifiers, especially for multi-class problems.
method Two techniques: reduced calibration and class-wise calibration.
result Class-wise reduced calibration algorithms reduce prediction and per-class calibration errors.

Applications such as weather forecasting and personalized medicine demand models that output calibrated probability estimates---those representative of the true likelihood of a prediction. Most models are not calibrated out of the box but are recalibrated by post-processing model outputs. We find in this work that popu…

2019-09-23abs ↗pdf ↗

Certified calibration methods protect model confidence from adversarial attacks.

problem Adversarial attacks degrade model calibration, reducing confidence in predictions.
method Developed certified calibration methods to provide worst-case bounds on calibration under adversarial perturbations.
result Certified calibration methods produce analytic and approximate bounds for the Brier score and expected calibration error.

Self-calibrating conformal prediction improves interval efficiency and offers a practical alternative.

problem Improving the reliability and uncertainty quantification of machine learning predictions.
method Combines Venn-Abers calibration and conformal prediction for binary and regression problems.
result Improves interval efficiency through model calibration and offers practical alternatives.

Accurate calibration of probabilistic predictive models learned is critical for many practical prediction and decision-making tasks. There are two main categories of methods for building calibrated classifiers. One approach is to develop methods for learning probabilistic models that are well-calibrated, ab initio. The…

2014-01-14abs ↗pdf ↗

Efficiently calibrates epidemiological models using Bayesian optimization.

problem Calibration of complex epidemiological models is computationally expensive and challenging.
method Graybox Bayesian optimization scheme leveraging Gaussian processes and functional structure of compartmental models.
result Proposed methods achieve efficient calibration and improved performance compared to existing schemes.

JUCAL jointly calibrates aleatoric and epistemic uncertainties in classifier ensembles.

problem Misrepresentation of predictive uncertainty due to unbalanced aleatoric and epistemic uncertainties.
method Joint Uncertainty Calibration (JUCAL) that jointly calibrates two constants to weight and scale uncertainties.
result Significantly outperforms state-of-the-art calibration methods across various text classification tasks.

The paper proposes a method to produce well-calibrated predictions in regression tasks using maximum mean discrepancy.

problem The need for accurate uncertainty quantification in machine learning predictions.
method The method uses maximum mean discrepancy to minimize the kernel embedding measure and calibrate predictions.
result The method produces well-calibrated and sharp prediction intervals, outperforming state-of-the-art methods.

This paper improves multi-class calibration methods using mutual information maximization-based binning.

problem Calibration of deep neural network predictions, especially for small prior classes.
method I-Max concept for binning, shared class-wise calibration strategy.
result Improves multi-class ranking and calibration performance using a small calibration set.

This paper rethinks confidence calibration under covariate shifts.

problem Calibration methods struggle with covariate shifts and unstable importance weighting.
method Derives Expectation consistency condition and proposes Expectation consistency loss (ECL).
result ECL loss is compatible with various types of calibration and has the same sample complexity as ECE.

A new method for multiclass calibration using vector quantization.

problem Challenges in multiclass calibration, especially in high-stakes settings.
method Compositional approach via Vector Quantization (VQ) to learn region-specific calibration maps.
result Significant improvements in local calibration with competitive global calibration and predictive performance.

Unified calibration metrics improve forecast sharpness and accuracy.

problem Improving the sharpness of probabilistic forecasts while maintaining calibration.
method Kernel-based calibration metrics that unify and generalize existing methods for classification and regression.
result Enhanced calibration, sharpness, and decision-making across various tasks.

The paper presents methods to improve uncertainty calibration in Bayesian Neural Networks.

problem Uncalibrated Bayesian Neural Networks often lead to overconfidence.
method The paper uses alpha-divergences from Information Geometry for calibration.
result Calibration using alpha-divergences provides better uncertainty estimates and is more efficient.

Post-hoc calibration of neural networks using g-Layers proves theoretical justification.

problem Ensuring the confidence of neural network decisions in real-world applications.
method Proves theoretical justification for post-hoc calibration methods by adding g-Layers and minimizing NLL.
result Proves that adding g-Layers and minimizing NLL can lead to a calibrated network.

Proposes h-calibration for improving miscalibrated probability outputs of neural networks.

problem Improving reliability of probability outputs from neural networks.
method Probabilistic learning framework for calibration, including a simple yet effective post-hoc algorithm.
result Significantly better performance than traditional methods, validated by experiments.

New method calibrates confidence for object detection and segmentation models.

problem Intrinsically miscalibrated confidence estimates in object detection and segmentation models.
method Introduces multivariate confidence calibration for object detection and segmentation, extending ECE.
result Improves calibration, positively impacts segmentation quality.

New method calibrates heterogeneous treatment effect models.

problem Difficulty in estimating and calibrating heterogeneous treatment effects.
method Defined and proposed a robust estimator for HTE calibration, based on doubly robust treatment effect estimators.
result Proposed method evaluates calibration of learned HTE models, addressing overfitting and high-dimensionality.

New method calibrates classifier probabilities with guaranteed coverage.

problem Inaccurate probability estimates by classifiers in high-risk applications.
method Adaptive temperature scaling algorithm for conformal prediction.
result Improves calibration error measures and standard metrics across various tasks.

KCal calibrates deep networks by embedding logits in a metric space.

problem Overconfident predictions from DNNs, especially in high-risk applications.
method KCal learns a metric space on the penultimate-layer latent embedding and generates predictions using kernel density estimates.
result KCal provides a provable full calibration guarantee and consistently outperforms baselines.

The paper introduces a spline-based method for calibrating neural networks.

problem Ensuring neural network outputs are reliable for safety-critical applications.
method Approximating the empirical cumulative distribution function using splines to map network outputs to calibrated probabilities.
result The spline-based recalibration consistently outperforms existing methods on calibration measures.

A set of probabilistic predictions is well calibrated if the events that are predicted to occur with probability p do in fact occur about p fraction of the time. Well calibrated predictions are particularly important when machine learning models are used in decision analysis. This paper presents two new non-parametric …

2014-01-13abs ↗pdf ↗

New method improves calibration in multi-output probabilistic models.

problem Challenges in achieving multivariate calibration in multi-output regression.
method General regularization framework to enforce multivariate calibration during training for arbitrary pre-rank functions.
result Significant improvement in calibration across all pre-rank functions without sacrificing predictive accuracy.

T-Cal tests model calibration with a minimax optimal test.

problem Detecting mis-calibration of predictive models using a finite validation dataset.
method T-Cal is a minimax optimal test for calibration based on a debiased plug-in estimator of the 2\ell_2-Expected Calibration Error (ECE).
result T-Cal is a practical tool for testing the calibration of probabilistic classification methods.

New method improves calibration of BayesCG for better uncertainty quantification.

problem Bayesian conjugate gradient method's poor calibration limits its utility.
method Randomized postiteration strategy to enhance posterior calibration.
result The method improves the distribution of posterior errors and enhances uncertainty quantification.

Mix-n-Match improves uncertainty calibration in deep learning.

problem Post-hoc calibration of machine learning classifiers.
method Ensemble and composition strategies to improve accuracy, efficiency, and expressive power.
result Mix-n-Match strategies achieve better data-efficiency and expressive power while maintaining classification accuracy.

Method calibrates local volatility and stochastic short rate models for equity-rate dynamics.

problem Joint calibration of local volatility and stochastic short rate models.
method Iterative approach using semimartingale optimal transport.
result Demonstrated performance on market data using European SPX options and cap interest rate options.

CCAC calibrates DNN classifiers on OOD datasets by separating mis-classified samples.

problem Calibrating DNN classifiers on out-of-distribution datasets is challenging.
method CCAC introduces an auxiliary class to map DNN output to calibrated confidence, separating mis-classified from correctly classified samples.
result CCAC consistently outperforms prior methods on various DNN models, datasets, and applications.

Study compares various calibration methods for binary classification tasks.

problem Improving probabilistic predictions in binary classification models.
method Benchmarked 21 classifiers using 5 calibration methods on real data.
result Venn-Abers predictors and Beta calibration show the largest log-loss reductions.