Calibrated strategies can be obtained by performing strategies that have no internal regret in some auxiliary game. Such strategies can be constructed explicitly with the use of Blackwell's approachability theorem, in an other auxiliary game. We establish the converse: a strategy that approaches a convex B-set can be…
Improved active output selection reduces calibration time by 10% or more.
problem Efficiently calibrate models with noisy data.
method Improved active output selection strategy considering noise estimate.
result At least 10% fewer measurements needed compared to existing strategies.
Researchers calibrate an adaptive Farmer-Joshi model to recover stylized facts in financial markets.
problem Recovering stylized facts in financial markets using the Farmer-Joshi model.
method Calibrated an adaptive Farmer-Joshi model using genetic and Nelder-Mead algorithms, incorporating agent adaptation.
result The adaptive model recovers additional stylized facts, including auto-correlations and kurtosis, compared to the original model.
Nested dichotomies for multiclass tasks often fail to calibrate probabilities.
problem Poor probability calibration in nested dichotomies for multiclass classification.
method Transforming multiclass problems into binary ones using a tree structure, and applying various calibration strategies.
result Improving accuracy and log-loss by calibrating both internal base models and the nested dichotomy structure.
The paper addresses errors in online selective conformal prediction and proposes new strategies to ensure valid inference.
problem Online selective conformal prediction's exchangeability issues and false coverage rate control problems.
method Evaluation and correction of existing calibration selection strategies, proposing new ones that preserve exchangeability.
result Novel calibration selection strategies ensure both selection-conditional coverage and FCR control.
This paper improves lottery ticketing by calibrating network confidence.
problem Uncalibrated confidence in lottery tickets leads to overconfidence and poor performance.
method The paper introduces various calibration strategies and explores their impact on lottery tickets.
result Calibration mechanisms consistently improve lottery ticket performance, even under distribution shifts.
We present a universal algorithm for online trading in Stock Market which performs asymptotically at least as good as any stationary trading strategy that computes the investment at each step using a fixed function of the side information that belongs to a given RKHS (Reproducing Kernel Hilbert Space). Using a universa…
New algorithm achieves online calibration in polynomial time for high-dimensional problems.
problem Online calibration of high-dimensional probability distributions over many days.
method Randomly selects among sub-forecasters, each predicting empirical outcome frequency over recent time windows.
result Achieves asymptotically calibrated strategies after polynomial number of rounds, resolving open questions.
Mix-n-Match improves uncertainty calibration in deep learning.
problem Post-hoc calibration of machine learning classifiers.
method Ensemble and composition strategies to improve accuracy, efficiency, and expressive power.
result Mix-n-Match strategies achieve better data-efficiency and expressive power while maintaining classification accuracy.
Generative Adversarial Networks improve trading strategy performance.
problem Optimizing trading strategies in a competitive market.
method Conditional Generative Adversarial Networks (cGANs) for strategy calibration and combination.
result cGANs provide outperformance over traditional techniques in generating alpha.
Efficient approach improves prediction calibration for domain shifts.
problem Improving uncertainty-aware predictions for domain shifts.
method Combining entropy-encouraging and adversarial calibration losses.
result Substantially outperforms existing approaches in domain drift calibration.
Post-hoc calibration improves uncertainty under domain shift.
problem Improving uncertainty calibration under domain shift.
method Apply perturbations to validation set before post-hoc calibration.
result Perturbation step results in better calibration under domain shift.
Two approaches improve conformal Bayes for label shift, one post-hoc and one in-training.
problem Improving prediction sets for target domain under label shift.
method Two complementary approaches: post-hoc calibration and in-training adaptation.
result In-training adaptation achieves up to 43% width reduction at unchanged coverage.
Novel framework improves GNN uncertainty estimates under distribution shifts.
problem Improving reliability of GNN uncertainty estimates under distribution shifts.
method Adapting stochastic data centering to graph data through novel graph anchoring strategies.
result G-ΔUQ leads to better calibrated GNNs for node and graph classification. A fast deep learning method for parallel MRI without calibration.
problem Calibration issues in parallel MRI reconstruction.
method Model-based deep learning, self-learning non-linear annihilation filters, Fourier domain pre-learning.
result Significantly faster than SLR methods (3 orders of magnitude), improved performance with spatial domain prior.
New method improves calibration of BayesCG for better uncertainty quantification.
problem Bayesian conjugate gradient method's poor calibration limits its utility.
method Randomized postiteration strategy to enhance posterior calibration.
result The method improves the distribution of posterior errors and enhances uncertainty quantification.
We propose a new framework to improve the calibration of neural networks.
problem Improving the accuracy of model confidence predictions.
method Introducing a differentiable surrogate for expected calibration error (DECE) and a meta-learning framework to optimise model hyper-parameters for validation set calibration.
result Achieved competitive performance with existing calibration approaches.
Study improves MACD trading strategy with volume and price adjustments.
problem Signal lag and false signals in traditional MACD trading rules.
method Develops VP-MACD framework with sensitivity calibration.
result Proposed framework outperforms baseline MACD in profitability and risk-adjusted return.
Enhances out-of-domain calibration of neural networks.
problem Improving calibration performance of deep neural networks in out-of-domain settings.
method Consistency-guided temperature scaling (CTS) that considers style and content consistency.
result Significantly enhances out-of-domain calibration performance.
This paper enhances uplift modeling for multi-treatment marketing campaigns.
problem Optimizing marketing strategies by selecting individuals likely to respond to different treatments.
method Leveraging score ranking and calibration techniques.
result Improves overall performance of marketing campaigns.
Parity calibration aims to predict increase-decrease events, not values.
problem Forecasting future increase-decrease events rather than exact values.
method Online binary calibration method to achieve parity calibration.
result Online binary calibration achieves parity calibration effectively.
The Heston model optimizes portfolio management based on real market data.
problem Choosing between active and passive investment strategies.
method Calibrated Heston model to real stock market data.
result Passive strategy can outperform active strategy depending on market parameters.
American put options are among the most frequently traded single stock options, and their calibration is computationally challenging since no closed-form expression is available. Due to the higher flexibility in comparison to European options, the mathematical model involves additional constraints, and a variational in…
Paper proposes a new method to simulate realistic markets from data.
problem Lack of accurate market simulators leading to misleading conclusions.
method Proposes a world agent model trained on historical data without agent calibration.
result Models consistently outperform previous methods in realism and responsiveness.
A new method calibrates jump-diffusion models from option prices.
problem Calibrating jump-diffusion models from market data.
method Forward Dupire-type PIDE, Tikhonov regularization.
result Robust method for identifying local volatility and jump size.
The paper highlights how machine learning calibrations can be biased by training data.
problem Machine learning calibrations can be biased by the training data, affecting downstream analyses.
method The paper examines simulation-based and data-based calibrations, highlighting their prior dependence and proposing solutions.
result A recently proposed Gaussian Ansatz approach can avoid some biases in simulation-based calibrations.
New methods help calibrate complex ABMs more efficiently.
problem Calibrating parameters in complex ABMs is challenging.
method Integrates different sampling methods and surrogate models.
result Surrogate assisted methods perform better than standard methods.
Jointly tuning ensemble models improves performance and uncertainty calibration.
problem Improving both predictive performance and uncertainty calibration in deep ensembles.
method Investigated the impact of jointly tuning weight decay, temperature scaling, and early stopping.
result Jointly tuning ensemble models generally matches or improves performance, with significant variation across tasks.
Alpha signals for statistical arbitrage strategies are often driven by latent factors. This paper analyses how to optimally trade with latent factors that cause prices to jump and diffuse. Moreover, we account for the effect of the trader's actions on quoted prices and the prices they receive from trading. Under fairly…
Deep ensembles don't necessarily improve calibration in low data regimes.
problem Calibration issues in deep learning models, especially in low data regimes.
method Examination of data-augmentation, ensembling, and post-processing calibration methods.
result Standard ensembling techniques can lead to less calibrated models in low data regimes.
Study calibrates high-dimensional binary classifiers using angle between estimator and true weights.
problem Calibrating high-dimensional binary classifiers with provable properties.
method Interpolates with a chance classifier to construct well-calibrated predictor based on angle between estimator and true weights.
result Angular calibration approach is provably well-calibrated in high dimensions, minimizing Bregman divergence.
Efficiently calibrates epidemiological models using Bayesian optimization.
problem Calibration of complex epidemiological models is computationally expensive and challenging.
method Graybox Bayesian optimization scheme leveraging Gaussian processes and functional structure of compartmental models.
result Proposed methods achieve efficient calibration and improved performance compared to existing schemes.
Improves robustness of propensity score estimators in challenging settings.
problem Limited overlap, small sample sizes, or unbalanced data.
method Extends calibration techniques for propensity score models, focusing on sample-splitting schemes.
result Calibration reduces variance and bias in inverse probability weighting and double/debiased machine learning frameworks.
Develops a method to make predictions more informative without sacrificing accuracy.
problem Tension between well-calibrated and bold predictions.
method Bayesian model selection-based approach for assessing calibration and maximizing boldness.
result Maximally emboldening predictions while maintaining desired level of calibration.
New loss improves DNN calibration without sacrificing accuracy.
problem Overfitting and overconfident predictions in DNNs.
method Proposes a new loss function inspired by Bayes decision theory.
result Improves DNN calibration without compromising accuracy.
The paper proposes a method to improve model calibration without explicitly measuring uncertainties.
problem Improving the quality of uncertainty estimators in deep neural networks.
method A novel algorithm that performs simultaneous interval estimation for different calibration levels, effectively refining mean estimates.
result The proposed approach consistently outperforms existing regularization strategies in deep regression models.
This paper improves multi-class calibration methods using mutual information maximization-based binning.
problem Calibration of deep neural network predictions, especially for small prior classes.
method I-Max concept for binning, shared class-wise calibration strategy.
result Improves multi-class ranking and calibration performance using a small calibration set.
This work analyzes aggregation strategies for Bayesian deep learning models in federated learning.
problem Improper aggregation of Bayesian deep learning models in federated learning leads to sub-optimal performance.
method Six aggregation strategies for Bayesian deep learning models are analyzed using CIFAR-10 dataset and a fully variational ResNet-20 architecture.
result Aggregation strategy is a key hyperparameter affecting accuracy, calibration, uncertainty quantification, training stability, and client compute requirements.
Study improves neural network calibration for drug discovery.
problem Improper calibration of neural network predictions in drug discovery.
method Compared different metrics for model hyperparameter tuning and proposed Bayesian Linear Probing (BLP) method.
result Bayesian Linear Probing (BLP) improves model calibration and accuracy.
Optimizes decision-making with variational Bayesian methods for continuous utilities.
problem Inference approximations for continuous utilities without full posterior knowledge.
method Automatic pipeline that co-opts continuous utilities into variational inference algorithms.
result Consistent improvement in decision-making when calibrating approximations for specific utilities.
New method achieves faster calibration without randomization.
problem Calibrating probabilistic forecasts in adversarial settings.
method Using interval forecasts and the power of two choices.
result Achieves O(1/T) calibration error rate without randomization. Conformal Bayes under label shift: post-hoc calibration vs. in-training adaptation
problem Bayesian prediction sets under label shift
method Post-hoc calibration vs. In-training adaptation
result Both strategies achieve valid coverage equally in an unbiased training regime
Python package 'nonconform' simplifies conformal anomaly detection.
problem Heuristic thresholding in anomaly detection systems.
method 'nonconform' package converts anomaly scores into calibrated p-values.
result Statistically principled anomaly detection is made accessible.
Calibrated PRMs improve inference efficiency for LLMs by dynamically adjusting compute budgets.
problem Poor calibration of PRMs leads to overestimation of success probabilities in partial reasoning steps.
method Quantile regression for calibration, instance-adaptive scaling (IAS) framework.
result Calibrated PRMs reduce inference costs while maintaining accuracy, especially on confident problems.
Proposes h-calibration for improving miscalibrated probability outputs of neural networks.
problem Improving reliability of probability outputs from neural networks.
method Probabilistic learning framework for calibration, including a simple yet effective post-hoc algorithm.
result Significantly better performance than traditional methods, validated by experiments.
Corrects bias in LLM-as-a-judge evaluations using adaptive calibration.
problem Bias in LLM evaluations due to imperfect sensitivity and specificity.
method Plug-in framework with confidence intervals accounting for test and calibration dataset uncertainties.
result LML-based evaluation yields more reliable estimates than human-only evaluation.
The paper proposes a method to calibrate healthcare AI models for reliability and interpretability.
problem Characterizing model reliability and enabling introspection of model behavior in clinical decision making.
method A calibration-driven learning method combined with interpretability techniques based on counterfactual reasoning.
result Demonstrates the effectiveness of the proposed approach using a lesion classification problem with dermoscopy images.
Paper proposes method to calibrate market simulator for various scenarios.
problem Calibrate market simulator to represent different market conditions.
method Two-step method using GAN with self-attention to train discriminator and optimize simulator parameters.
result Demonstrates effectiveness of method in capturing various market scenarios.