THERMOMETER calibrates LLMs efficiently for diverse tasks.
problem Calibrating large language models is challenging due to computational and versatility issues.
method THERMOMETER learns an auxiliary model for calibrating a LLM using data from multiple tasks.
result THERMOMETER produces better-calibrated responses for new tasks.
Simple algorithm achieves distance to calibration error of at most 2√T+1.
problem Achieving distance to calibration error of O(√T) in adversarial setting.
method An extremely simple, efficient, deterministic algorithm.
result Obtains distance to calibration error at most 2√T+1.
Efficiently calibrates epidemiological models using Bayesian optimization.
problem Calibration of complex epidemiological models is computationally expensive and challenging.
method Graybox Bayesian optimization scheme leveraging Gaussian processes and functional structure of compartmental models.
result Proposed methods achieve efficient calibration and improved performance compared to existing schemes.
Self-calibrating conformal prediction improves interval efficiency and offers a practical alternative.
problem Improving the reliability and uncertainty quantification of machine learning predictions.
method Combines Venn-Abers calibration and conformal prediction for binary and regression problems.
result Improves interval efficiency through model calibration and offers practical alternatives.
New decision-theoretic calibration error metric improves prediction reliability.
problem Improving the reliability of predictions for decision-making.
method Proposed Calibration Decision Loss (CDL) and an efficient algorithm to achieve near-optimal CDL.
result Near-optimal CDL guarantees vanishing payoff loss from miscalibration.
We show that the existence of a computationally efficient calibration algorithm, with a low weak calibration rate, would imply the existence of an efficient algorithm for computing approximate Nash equilibria - thus implying the unlikely conclusion that every problem in PPAD is solvable in polynomial time.
New method calibrates multi-class predictions efficiently without sacrificing accuracy.
problem Efficiently calibrating multi-class predictions without sacrificing accuracy.
method Formulated robust projected smooth calibration and new recalibration algorithms.
result Achieves strong guarantees for binary classification tasks with polynomial complexity.
Efficiently calibrates volatility models using Chebyshev Tensors.
problem Calibrating pricing models efficiently.
method Used Chebyshev Tensors to speed up calibration of the rough Bergomi volatility model.
result Chebyshev Tensors can calibrate the rough Bergomi volatility model 40,000 times more efficiently than brute-force methods.
Mix-n-Match improves uncertainty calibration in deep learning.
problem Post-hoc calibration of machine learning classifiers.
method Ensemble and composition strategies to improve accuracy, efficiency, and expressive power.
result Mix-n-Match strategies achieve better data-efficiency and expressive power while maintaining classification accuracy.
Efficiently calibrates computationally expensive models using vine copulas.
problem Computational models are expensive and hard to calibrate with real data.
method Variational Bayes inference with vine copulas for dependent data.
result Computational scalability and efficiency of the proposed algorithm.
We develop an efficient method to calibrate CDS spreads using asymptotic approximations.
problem Calibrating CDS spreads in the SSRD model with correlated processes.
method Asymptotic coefficient expansion to approximate solutions of nonlinear PDEs.
result Our approximation does not require uncorrelated interest rate and default intensity processes.
Efficiently calibrates Bergomi models to VIX derivatives using vector quantization.
problem Calibrating Bergomi models to VIX derivatives for accurate pricing.
method Applied vector quantization in mixed Bergomi models for fast and efficient option pricing.
result Calibration of Bergomi models to VIX derivatives is feasible and accurate over daily data.
Efficiently calibrates SABR/LIBOR models to real market caplets and swaptions data.
problem Calibration of stochastic volatility models to real market data.
method Proposes a parallelized simulated annealing algorithm for multi-GPUs.
result Numerical results show advantages of using multi-GPUs for SABR/LIBOR model calibration.
Proposes FIPO-BC for efficient online calibration of complex models.
problem Efficiently calibrating computationally expensive models with large datasets.
method Fixed inducing points online Bayesian calibration (FIPO-BC) algorithm.
result FIPO-BC is at least ten times faster than standard methods and enables online updates.
Calibrated probabilistic solvers improve accuracy of ODE estimates.
problem Uncertainty in probabilistic ODE solutions is not well-calibrated for adaptive step sizes.
method Introduce and assess several calibration methods for probabilistic ODE solvers.
result Calibration methods interact efficiently with adaptive step-size selection, improving posteriors.
Proposes efficient calibration for indoor localization models.
problem Calibration data scarcity in wireless indoor localization.
method Uses synthetic labels and prediction sets to fine-tune a predictor and estimate bias.
result Yields rigorous coverage guarantees for prediction sets.
MEC improves efficiency and robustness in semi-supervised inference.
problem Efficient inference with limited labeled data and robust uncertainty quantification.
method Machine-Learning-Assisted Generalized Entropy Calibration (MEC) using cross-fitted, calibration-weighted PPI.
result MEC achieves semiparametric efficiency bounds under weaker assumptions and provides near-nominal coverage.
Proposes new method for calibrating treatment effect predictors.
problem Calibrating predictors of heterogeneous treatment effects.
method Causal isotonic calibration and cross-calibration.
result Achieves fast calibration rates under weak conditions.
Paper proposes an efficient method for calibrating spatio-temporal forecasts.
problem Real-world spatio-temporal forecasting challenges like signal anomalies and distributional shifts.
method Learning with Calibration (ST-TTC) for real-time bias correction.
result ST-TTC improves spatio-temporal forecasting accuracy with reduced computational cost.
New method converts p-values to e-values for more efficient CP and aggregation.
problem Limitations of existing p-to-e calibrators in CP setting.
method Proposes a novel P2E calibrator for set-preserving calibration.
result Significant efficiency gains over existing p-to-e calibrators.
In this paper an improved Cuckoo Search Algorithm is developed to allow for an efficient and robust calibration of the Heston option pricing model for American options. Calibration of stochastic volatility models like the Heston is significantly harder than classical option pricing models as more parameters have to be …
Proposes efficient calibration method for LIBOR Market Model with stochastic volatility.
problem Calibrating LIBOR Market Model with stochastic volatility.
method Derives analytical gradient of swaptions prices for DDSVLMM and uses it for gradient-based optimization.
result Analytical gradient-based calibration is highly competitive and efficient for DDSVLMM.
An innovative method optimizes engine calibration to improve efficiency and reduce emissions.
problem Complex engines with many tunable parameters require efficient calibration methods.
method Combines Principal Component Decomposition with constrained Bayesian Optimization to minimize pressure curve deviation.
result Optimal engine calibration found after 64.4s with a 0.017% efficiency gain.
In order to cope with the increased data volumes generated by modern radio interferometers such as LOFAR (Low Frequency Array) or SKA (Square Kilometre Array), fast and efficient calibration algorithms are essential. Traditional radio interferometric calibration is performed using nonlinear optimization techniques such…
ORCA calibrates LLMs for efficient, generalizable reasoning.
problem Miscalibration of large language models leading to inefficiencies.
method Online Reasoning Calibration (ORCA) using conformal prediction and test-time training.
result ORCA provides higher efficiency and generalization across different reasoning tasks.
New algorithm tests model calibration in nearly-linear time.
problem Testing model calibration from samples efficiently.
method Reformulated as minimum-cost flow, solved with dynamic programming.
result Optimal testing problem solved in nearly-linear time.
Extends DML for parametric problems, improving accuracy and efficiency in pricing and calibration.
problem Improving precision and efficiency in pricing and calibration for parametric problems.
method Exploits derivative information, uses adaptive parameter sampling, constructs pricing surrogates, and optimizes globally.
result Demonstrates improved accuracy and efficiency in pricing and calibration for complex models.
The paper presents methods to improve uncertainty calibration in Bayesian Neural Networks.
problem Uncalibrated Bayesian Neural Networks often lead to overconfidence.
method The paper uses alpha-divergences from Information Geometry for calibration.
result Calibration using alpha-divergences provides better uncertainty estimates and is more efficient.
Efficient approach improves prediction calibration for domain shifts.
problem Improving uncertainty-aware predictions for domain shifts.
method Combining entropy-encouraging and adversarial calibration losses.
result Substantially outperforms existing approaches in domain drift calibration.
Conformal Bayes under label shift: post-hoc calibration vs. in-training adaptation
problem Bayesian prediction sets under label shift
method Post-hoc calibration vs. In-training adaptation
result Both strategies achieve valid coverage equally in an unbiased training regime
WamOL uses PINNs to efficiently calibrate IVS from sparse data.
problem Calibrating time-dependent IVS from sparse market data.
method Physics-Informed Neural Networks (PINNs) with adaptive reweighting.
result WamOL outperforms in calibrating intraday IVS from uneven data.
New method calibrates classifier probabilities with guaranteed coverage.
problem Inaccurate probability estimates by classifiers in high-risk applications.
method Adaptive temperature scaling algorithm for conformal prediction.
result Improves calibration error measures and standard metrics across various tasks.
GC-FCP provides efficient federated CP with group-conditional coverage guarantees.
problem Uncertainty quantification in federated settings with distributed calibration data.
method Group-conditional federated conformal prediction (GC-FCP) using group-stratified coresets.
result GC-FCP offers efficient aggregation and calibration compared to centralized methods.
Optimizes biomanufacturing processes with a new digital twin calibration method.
problem Lack of interpretability and sample efficiency in traditional DoE methods.
method Developed a computational approach to calibrate Bio-SoS digital twin model.
result Guides sample-efficient and interpretable DoEs by quantifying sub-model parameter estimation errors.
New method calibrates neural network predictions for better reliability.
problem Improper probability estimates from deep networks leading to unreliable predictions.
method Proposes a constrained optimization approach for a monotonic calibration map.
result Achieves state-of-the-art performance across various datasets and models.
The paper calibrates a model to market quotes efficiently and arbitrage-free.
problem Calibrating a model to market option quotes efficiently and without arbitrage.
method Piecewise-linear local variance function for efficient calibration.
result Arbitrage-free interpolation of class C2 achieved under one millisecond. Method calibrates basket options using rearranged samples from constituent processes.
problem Calibrate basket options with non-linear dependency structure.
method Propose a method to extract dependency structure from market data through systematic sampling rearrangement, then calibrate a local volatility model.
result Efficiently calibrates basket options with near-perfect accuracy.
This paper presents an algorithm for a complete and efficient calibration of the Heston stochastic volatility model. We express the calibration as a nonlinear least squares problem. We exploit a suitable representation of the Heston characteristic function and modify it to avoid discontinuities caused by branch switchi…
Proposes an accuracy-preserving calibration method for DNNs.
problem Calibration of deep neural networks (DNNs) to measure prediction reliability.
method Uses Concrete distribution on the probability simplex to calibrate DNNs without accuracy loss.
result The proposed method outperforms previous methods in accuracy-preserving calibration tasks.
A new perfectly truthful calibration measure improves prediction reliability.
problem Improving the reliability of predictions by ensuring they are conditionally unbiased.
method Designing a simple, perfectly truthful calibration measure called ATB.
result ATB is the first perfectly truthful calibration measure in the batch setting.
We propose a new scalable multi-class Gaussian process classification approach building on a novel modified softmax likelihood function. The new likelihood has two benefits: it leads to well-calibrated uncertainty estimates and allows for an efficient latent variable augmentation. The augmented model has the advantage …
Paper presents unsupervised calibration for split conformal classification.
problem Inconvenient requirement of labeled calibration samples.
method Uses unsupervised calibration samples alongside supervised training samples.
result Achieves comparable performance to supervised calibration methods.
This paper improves lottery ticketing by calibrating network confidence.
problem Uncalibrated confidence in lottery tickets leads to overconfidence and poor performance.
method The paper introduces various calibration strategies and explores their impact on lottery tickets.
result Calibration mechanisms consistently improve lottery ticket performance, even under distribution shifts.
The paper proposes a framework to calibrate multi-agent simulation models from output series using Bayesian optimization.
problem Calibrating multi-agent simulation models from observable output series.
method Novel eligibility set concept, two-sample Kolmogorov-Smirnov test with Bonferroni correction, Bayesian optimization (BO), and trust-region BO (TuRBO).
result Demonstrated the efficiency of the proposed framework using numerical experiments.
Calibrated Prediction-Powered Inference improves semisupervised mean estimation by calibrating prediction scores.
problem Semisupervised mean estimation with a small labeled sample and a large unlabeled sample, and miscalibrated prediction models.
method Calibrated Prediction-Powered Inference (Calibeating) post-hoc calibrates the prediction score on the labeled sample before using it for semisupervised estimation.
result Calibrated Prediction-Powered Inference can improve the original score both as a predictor of the outcome and as a regression adjustment for semisupervised inference.
Proposes a new calibration error estimator for deep neural networks.
problem Improves calibration of deep neural networks, especially for canonical calibration.
method Uses a Dirichlet kernel density estimate to create a low-bias, trainable calibration error estimator.
result Asymptotically converges to true Lp calibration error, enabling efficient estimation and mini-batch updates. A novel post-hoc calibration method reduces neural network calibration errors.
problem Neural networks produce poorly calibrated probabilities, leading to underconfidence and overconfidence.
method Probability bounding (PB) via box-constrained softmax (BCSoftmax) function.
result Consistently reduces calibration errors on four real-world datasets.
Paper introduces a method to improve survival model calibration without sacrificing discrimination.
problem Survival models struggle to balance accurate ranking and event prediction.
method Uses conformal regression to enhance calibration without compromising discrimination.
result The approach improves model calibration across 11 real-world datasets.