Research
On-device research index

arXiv research

A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.

168,742 papers · 148 categories

Trend · papers per month

85170254339 · Jun 202019922001200920172026
48 results for output series calibration

The paper proposes a framework to calibrate multi-agent simulation models from output series using Bayesian optimization.

problem Calibrating multi-agent simulation models from observable output series.
method Novel eligibility set concept, two-sample Kolmogorov-Smirnov test with Bonferroni correction, Bayesian optimization (BO), and trust-region BO (TuRBO).
result Demonstrated the efficiency of the proposed framework using numerical experiments.

A new method calibrates scientific models by adding randomness to their predictions.

problem Current scientific foundation models lack calibrated uncertainty.
method Stochastic Attention, which randomizes attention weights using multinomial samples.
result Stochastic Attention achieves the strongest native calibration and sharpest prediction intervals.

New framework calibrates computer models using deep learning and quantile regression.

problem Uncertainty in computer model input parameters due to high-dimensional time series data.
method Deep neural network with long-short term memory layers for inverse modeling, quantile regression for interval predictions.
result Accurate point and interval estimates for input parameters in WRF-hydro model.

CoCAI uses copulas for accurate multivariate time-series forecasting and anomaly detection.

problem Accurate multivariate time-series forecasting and robust anomaly detection.
method Copula-based conformal prediction for multivariate time-series analysis.
result CoCAI provides statistically valid predictive regions and robust anomaly scores.

Noise titration benchmarks time series forecasting models rigorously.

problem Evaluation of time series forecasting models is often flawed due to lack of interventionist methods.
method Interventionist benchmarking using Gaussian noise titration of dynamical systems.
result Fern model outperforms state-of-the-art models in non-stationary conditions.

New method improves calibration in multi-output probabilistic models.

problem Challenges in achieving multivariate calibration in multi-output regression.
method General regularization framework to enforce multivariate calibration during training for arbitrary pre-rank functions.
result Significant improvement in calibration across all pre-rank functions without sacrificing predictive accuracy.

The paper uses optimal transport to calibrate stochastic simulations.

problem Improper fidelity of stochastic simulators in scientific applications.
method Optimal transport theory applied to neural network corrections.
result Calibrated stochastic simulations improve fidelity to reality.

Methods for reasoning under uncertainty are a key building block of accurate and reliable machine learning systems. Bayesian methods provide a general framework to quantify uncertainty. However, because of model misspecification and the use of approximate inference, Bayesian uncertainty estimates are often inaccurate -…

2018-07-01abs ↗pdf ↗

Time series foundation models are well-calibrated, improving over baseline models.

problem Calibration of time series foundation models for practical applications.
method Systematic evaluations of five time series foundation models and two baselines, assessing calibration, prediction heads, and long-term forecasting.
result Time series foundation models are consistently better calibrated than baseline models and do not show over- or under-confidence.

Improved financial market calibration reveals large excess volatility.

problem Large excess volatility in financial markets.
method Extended Chiarella model to handle long-term value drifts, calibrated on multiple asset classes.
result Large excess volatility (factor ≈ 4 for stock indices) and bimodal mispricing distribution.

Proposes a new calibration error estimator for deep neural networks.

problem Improves calibration of deep neural networks, especially for canonical calibration.
method Uses a Dirichlet kernel density estimate to create a low-bias, trainable calibration error estimator.
result Asymptotically converges to true LpL_p calibration error, enabling efficient estimation and mini-batch updates.

New method calibrates ABMs using graph neural networks for microdata.

problem Calibrating ABMs to granular microdata with high-dimensional learning tasks.
method Temporal graph neural networks for learning parameter posteriors.
result Graph neural networks offer inductive biases for Bayesian inference with ABM microstates.

Improves confidence calibration in neural networks by smoothing labels based on class similarity.

problem Improving confidence calibration in deep neural networks for safety-critical applications.
method Proposes a novel label smoothing technique where label values are based on similarities with the reference class, using different similarity measurements.
result Consistently outperforms state-of-the-art calibration techniques on various datasets and network architectures.

We are concerned with obtaining well-calibrated output distributions from regression models. Such distributions allow us to quantify the uncertainty that the model has regarding the predicted target value. We introduce the novel concept of distribution calibration, and demonstrate its advantages over the existing defin…

2019-05-15abs ↗pdf ↗

Applications such as weather forecasting and personalized medicine demand models that output calibrated probability estimates---those representative of the true likelihood of a prediction. Most models are not calibrated out of the box but are recalibrated by post-processing model outputs. We find in this work that popu…

2019-09-23abs ↗pdf ↗

Proposes h-calibration for improving miscalibrated probability outputs of neural networks.

problem Improving reliability of probability outputs from neural networks.
method Probabilistic learning framework for calibration, including a simple yet effective post-hoc algorithm.
result Significantly better performance than traditional methods, validated by experiments.

New method calibrates neural network predictions for better reliability.

problem Improper probability estimates from deep networks leading to unreliable predictions.
method Proposes a constrained optimization approach for a monotonic calibration map.
result Achieves state-of-the-art performance across various datasets and models.

CAMul forecasts with calibrated and accurate multi-view time-series data.

problem Combining diverse data sources for reliable time-series forecasting.
method CAMul integrates multi-modal data views dynamically, assigning importance based on context.
result CAMul outperforms state-of-the-art models by 25% in accuracy and calibration.

KCal calibrates deep networks by embedding logits in a metric space.

problem Overconfident predictions from DNNs, especially in high-risk applications.
method KCal learns a metric space on the penultimate-layer latent embedding and generates predictions using kernel density estimates.
result KCal provides a provable full calibration guarantee and consistently outperforms baselines.

A novel post-hoc calibration method reduces neural network calibration errors.

problem Neural networks produce poorly calibrated probabilities, leading to underconfidence and overconfidence.
method Probability bounding (PB) via box-constrained softmax (BCSoftmax) function.
result Consistently reduces calibration errors on four real-world datasets.

BCI provides calibrated prediction intervals for time series forecasts.

problem Calibration of prediction intervals for time series forecasts.
method BCI wraps around any time series forecasting models and optimizes interval lengths using dynamic programming.
result BCI achieves long-term coverage under arbitrary distribution shifts and temporal dependence.

Foundation models improve time series prediction reliability, especially with limited data.

problem Improving time series prediction reliability with limited data.
method Comparison of Time Series Foundation Models (TSFMs) with traditional methods in conformal prediction.
result TSFMs provide more reliable conformalized prediction intervals and more stable calibration with limited data.

This paper tackles non-identifiability in financial market simulations using multivariate time series data.

problem Non-identifiability issue in social simulation models, leading to indistinguishable simulated time series data.
method Proposes a maximization-based aggregation function to form a new calibration objective function using multiple time series features.
result Significant improvements in alleviating non-identifiability and achieving higher simulation fidelity.

SGPA calibrates transformer uncertainty for safety-critical tasks.

problem Uncertainty estimation in transformer models for safety-critical domains.
method Bayesian inference in transformer's output space using sparse Gaussian processes.
result SGPA-based Transformers improve in-distribution calibration and out-of-distribution robustness.

ProbRes calibrates probabilistic forecasts by learning volatility dynamics.

problem Quantifying risk and uncertainty in time series forecasting.
method ProbRes learns conditional mean and volatility separately, generating well-calibrated prediction intervals.
result ProbRes accurately captures predictive distributions and produces well-calibrated prediction intervals.

Ongoing developments in neural network models are continually advancing the state of the art in terms of system accuracy. However, the predicted labels should not be regarded as the only core output; also important is a well-calibrated estimate of the prediction uncertainty. Such estimates and their calibration are cri…

2018-03-26abs ↗pdf ↗

Develops geometric framework for uncertainty-aware multi-class classification.

problem Silent failure of AI models when uncertain, especially in multi-class settings.
method Geometric framework treating probability vectors as points on the (c1)(c-1)-dimensional probability simplex, using Fisher--Rao metric for calibration and uncertainty quantification.
result Empirical validation shows 72.5% of errors captured while deferring 34.5% of ambiguous predictions, reducing automated decision error rates from 16.8% to 6.9%.

Probabilistic classifiers output a probability distribution on target classes rather than just a class prediction. Besides providing a clear separation of prediction and decision making, the main advantage of probabilistic models is their ability to represent uncertainty about predictions. In safety-critical applicatio…

2019-02-19abs ↗pdf ↗

TCP provides well-calibrated prediction intervals for nonstationary time series.

problem Nonstationary time series forecasting with well-calibrated prediction intervals.
method Temporal Conformal Prediction (TCP) couples a modern quantile forecaster with a rolling split-conformal calibration layer.
result TCP achieves near-nominal coverage, providing slightly wider intervals than Historical Simulation.

This paper introduces a new learning rule for probabilistic SNNs that improves log-likelihood, accuracy, and calibration.

problem Training and inference of deterministic SNNs are constrained by their inability to generate multiple independent outputs.
method Introduces a generalized expectation-maximization (GEM) learning rule for probabilistic SNNs.
result The GEM-SNN learning rule leads to significant improvements in log-likelihood, accuracy, and calibration.

The paper studies the distance from calibration in sequential prediction, proving upper and lower bounds.

problem The challenge is to measure and minimize the deviation from perfect calibration in sequential binary prediction.
method The approach involves proving an O(T)O(\sqrt{T}) upper bound and an Ω(T1/3)Ω(T^{1/3}) lower bound, using structural results and minimax arguments.
result An O(T)O(\sqrt{T}) upper bound on the calibration distance is achieved, with an Ω(T1/3)Ω(T^{1/3}) lower bound showing the inherent difficulty.

Paper proposes method to calibrate market simulator for various scenarios.

problem Calibrate market simulator to represent different market conditions.
method Two-step method using GAN with self-attention to train discriminator and optimize simulator parameters.
result Demonstrates effectiveness of method in capturing various market scenarios.

Deep models predict intraday electricity prices accurately.

problem Accurately forecasting intraday electricity prices.
method Two deep time series probabilistic models using ESNs with stochastic disturbances and copulas.
result Deep distributional models provide accurate short-term probabilistic price forecasts.

The paper presents methods to improve uncertainty calibration in Bayesian Neural Networks.

problem Uncalibrated Bayesian Neural Networks often lead to overconfidence.
method The paper uses alpha-divergences from Information Geometry for calibration.
result Calibration using alpha-divergences provides better uncertainty estimates and is more efficient.

The paper introduces a non-linear version of the process convolution formalism for building covariance functions for multi-output Gaussian processes. The non-linearity is introduced via Volterra series, one series per each output. We provide closed-form expressions for the mean function and the covariance function of t…

2018-10-10abs ↗pdf ↗

In many classification problems it is desirable to output well-calibrated probabilities on the different classes. We propose a robust, non-parametric method of calibrating probabilities called SplineCalib that utilizes smoothing splines to determine a calibration function. We demonstrate how applying certain transforma…

2018-09-20abs ↗pdf ↗

Meta-Cal improves post-hoc calibration of neural networks.

problem Improving the accuracy of uncalibrated neural network predictions.
method Meta-Cal uses a base calibrator and a ranking model with constraints to provide high-probability bounds.
result Meta-Cal significantly outperforms existing methods in post-hoc multi-class classification calibration.

The task of calibration is to retrospectively adjust the outputs from a machine learning model to provide better probability estimates on the target variable. While calibration has been investigated thoroughly in classification, it has not yet been well-established for regression tasks. This paper considers the problem…

2018-06-20abs ↗pdf ↗

The paper studies calibration in ML models for wireless networks, showing key theoretical and practical insights.

problem Ensuring ML models in wireless networks deliver well-calibrated confidence scores for reliable decision-making.
method Theoretical analysis and simulation-based experiments using Platt scaling and isotonic regression.
result Well-calibrated models improve the system's minimum achievable OP and are part of a broader class of predictors.