Language models are miscalibrated, leading to overestimated entropy rates and memory usage.
problem Miscalibration of language models leading to overestimated entropy rates and memory usage.
method Calibration-based approach to measure discrepancies and improve models.
result State-of-the-art language models are miscalibrated, causing overestimated entropy rates and memory usage.
New approach for adaptive conformal inference using Blackwell's theory.
problem Non-exchangeable environments in sequential conformal inference.
method Reinterpretation of ACI as a game, construction of coverage and efficiency objectives, approachability strategy.
result Algorithm achieves strong theoretical guarantees and practical insights.
In this chapter, we consider volatility swap, variance swap and VIX future pricing under different stochastic volatility models and jump diffusion models which are commonly used in financial market. We use convexity correction approximation technique and Laplace transform method to evaluate volatility strikes and estim…
Paper introduces new metrics for evaluating model accuracy.
problem Improving model accuracy and calibration.
method Developed two second-order accuracy metrics with integral and numerical representations.
result Validates model calibration settings and reveals distortions.
Recently, a novel family of biologically plausible online algorithms for reducing the dimensionality of streaming data has been derived from the similarity matching principle. In these algorithms, the number of output dimensions can be determined adaptively by thresholding the singular values of the input data matrix. …
The paper calibrates the G2++ model using deep learning for interest rates.
problem Calibrating interest rate models with deep learning.
method Calibrated G2++ model using Neural Networks trained on covariances and correlations of Zero-Coupon and Forward rates.
result Deep learning calibration outperforms classic methods.
New method selects equivariant models using uncertainty metrics.
problem Selecting equivariant models among pretrained ones with varying symmetry biases.
method Uncertainty-aware model selection using frequentist, Bayesian, and calibration-based measures.
result Bayesian model evidence often misaligns with predictive performance.
New CV method reduces bias in spatial prediction models.
problem Bias in standard cross-validation due to uneven sampling.
method Target-Weighted Cross-Validation (TWCV) framework.
result Weighted CV approaches reduce bias in prediction error.
Reassesses calibration metrics in machine learning models.
problem Inconsistent reporting of calibration metrics in recent literature.
method Calibration-based decomposition of Bregman divergences, visualization of calibration and generalization error.
result New visualization technique for detecting trade-offs between calibration and generalization.
We introduce GLR-klUCB, a novel algorithm for the piecewise iid non-stationary bandit problem with bounded rewards. This algorithm combines an efficient bandit algorithm, kl-UCB, with an efficient, parameter-free, changepoint detector, the Bernoulli Generalized Likelihood Ratio Test, for which we provide new theoretica…
The paper explores various forms of calibration scores and their implications for fairness.
problem The evaluation of probabilistic predictions through calibration.
method The authors organize three grouping choices and one agglomeration of group errors, providing a framework for comparing and creating new calibration scores.
result The study demonstrates that appropriate choices of grouping can provide notions of (sub-)group or individual fairness.
We consider a stochastic volatility asset price model in which the volatility is the absolute value of a continuous Gaussian process with arbitrary prescribed mean and covariance. By exhibiting a Karhunen-Loève expansion for the integrated variance, and using sharp estimates of the density of a general second-chaos var…
This paper is devoted to the application of B-splines to volatility modeling, specifically the calibration of the leverage function in stochastic local volatility models and the parameterization of an arbitrage-free implied volatility surface calibrated to sparse option data. We use an extension of classical B-splines …
We analyse the behaviour of the implied volatility smile for options close to expiry in the exponential Lévy class of asset price models with jumps. We introduce a new renormalisation of the strike variable with the property that the implied volatility converges to a non-constant limiting shape, which is a function of …
New method calibrates uncertainty estimates for image classifiers without labeled data.
problem Uncertainty estimates for modern classifiers are unreliable without labeled calibration data.
method Calibrates uncertainty estimates using unlabeled examples for distribution shifts.
result Proposes a method that provides excellent uncertainty estimates under natural distribution shifts.
New loss improves DNN calibration without sacrificing accuracy.
problem Overfitting and overconfident predictions in DNNs.
method Proposes a new loss function inspired by Bayes decision theory.
result Improves DNN calibration without compromising accuracy.
Paper proposes a unified framework for evaluating calibration of probabilistic models.
problem Evaluation of calibration for general probabilistic predictive models.
method Unified framework for calibration evaluation and tests for any probabilistic model.
result Generalization and reformulation of existing measures and tests.
Paper presents LSTMMDN for hourly bike flow estimation in Copenhagen.
problem Sparse or unavailable hourly bike flow data for safety analysis.
method Hybrid LSTM MDN model for hourly bike flow estimation.
result 66-77% more accurate bike flow estimates compared to calibration factors.
LLMs show surprising confidence in their answers, beyond just tokens.
problem LLMs lack meaningful confidence estimates for their responses.
method Semantic calibration test based on local loss optimality and equivalence classes.
result Base LLMs are semantically calibrated across tasks, contrary to expectations.
T-Cal tests model calibration with a minimax optimal test.
problem Detecting mis-calibration of predictive models using a finite validation dataset.
method T-Cal is a minimax optimal test for calibration based on a debiased plug-in estimator of the ℓ2-Expected Calibration Error (ECE). result T-Cal is a practical tool for testing the calibration of probabilistic classification methods.
Geometric approach combines asset returns and investor views for better portfolio optimization.
problem Optimizing portfolios with investor-specific views.
method Generalized Wasserstein barycenter (GWB) to integrate statistical asset returns and investor views.
result The geometric approach offers more flexibility and rewards for correct investor views.
Paper proposes an alternative method to price American options using HJM approach.
problem Price American options efficiently and accurately.
method Utilizes HJM technique to model term structure of volatility for equity markets.
result Proposes a new value function, stopping criteria, and stopping time for American options.
We study inference and learning based on a sparse coding model with `spike-and-slab' prior. As in standard sparse coding, the model used assumes independent latent sources that linearly combine to generate data points. However, instead of using a standard sparse prior such as a Laplace distribution, we study the applic…
Quantum machine learning: Adiabatic quantum SVM outperforms classical methods.
problem Training support vector machines efficiently on large datasets.
method Adiabatic quantum computing for SVM training.
result Quantum approach outperforms classical methods in accuracy and scalability.
We develop a semi-analytic approach to the valuation of auto-callable structures with accrual features subject to barrier conditions. Our approach is based on recent studies of multi-assed binaries, present in the literature. We extend these studies to the case of time-dependent parameters. We compare numerically the s…
Two ML approaches learn local volatility surfaces from option prices, with GP being arbitrage-free.
problem Interpolating European vanilla option prices to create a local volatility surface.
method Gaussian process regression and neural net with arbitrage penalties.
result GP approach is arbitrage-free and yields best out-of-sample calibration error.
This paper critiques the Standardized Measurement Approach (SMA) for operational risk and recommends maintaining Advanced Measurement Approach (AMA).
problem Weaknesses and failures of the Standardized Measurement Approach (SMA) in operational risk.
method Critical review and analysis of SMA and AMA approaches.
result SMA is unstable, insensitive to risk, and implicitly related to systemic risk in the banking sector.
Distributed Acoustic Sensing (DAS) using fiber optic cables is a promising new technology for pipeline monitoring and protection. In this work, we applied and compared two approaches for event detection using DAS: Classic machine learning approach and the approach based on image processing and deep learning. Although w…
A new Euclidean approach reveals the pentagram map's beauty.
problem Exploring the pentagram map through classical geometry.
method Introducing an alternative Euclidean approach.
result Demonstrates the pentagram map's elegance through classical geometry.
Two approaches extend knowledge distillation to Gaussian Processes, showing relationships to existing methods.
problem Applying knowledge distillation to Gaussian Processes for regression and classification.
method Data-centric and distribution-centric approaches to extend distillation to GPR and GPC.
result Distribution-centric approach for GPC approximately corresponds to data duplication and scaling.
We discuss the relative merits of optimistic and randomized approaches to exploration in reinforcement learning. Optimistic approaches presented in the literature apply an optimistic boost to the value estimate at each state-action pair and select actions that are greedy with respect to the resulting optimistic value f…
Online boosting method improves weak to strong learner.
problem Online learning of weak to strong learner.
method Extends batch GentleAdaBoost to online approach with line search.
result Online boosting performs better than other methods.
Predicting potential credit default accounts in advance is challenging. Traditional statistical techniques typically cannot handle large amounts of data and the dynamic nature of fraud and humans. To tackle this problem, recent research has focused on artificial and computational intelligence based approaches. In this …
In this paper, we present a new wrapper feature selection approach based on Jensen-Shannon (JS) divergence, termed feature selection with maximum JS-divergence (FSMJ), for text categorization. Unlike most existing feature selection approaches, the proposed FSMJ approach is based on real-valued features which provide mo…
Two new methods for option pricing without or with a riskless asset.
problem Traditional option pricing methods require a riskless asset and may not be market-complete.
method Develops two approaches: one without a riskless asset and one with.
result Both methods produce the same option prices as classical approaches.
An integrated and extendable approach for stress-testing loan portfolios
problem Stress-testing loan portfolios
method Simulate completed portfolios, generate uncertain cash flow history, compute credit risk metrics
result Enhanced stress-testing practices within any bank
Bayesian symbolic regression automates model discovery from data.
problem Learning closed-form mathematical models from data using heuristic methods.
method Probabilistic approach to symbolic regression, connecting to information theory and statistical physics.
result Probabilistic approach provides model plausibility and performance guarantees.
Paper compares neural network approaches to Optimal Transport.
problem Learning Optimal Maps between probability distributions.
method Two categories of approaches: heuristic and math-justified. Novel approach involves dynamic flows and supervised learning.
result Novel approach involving dynamic flows and reductions of Optimal Transport to supervised learning.
New approach interprets Nyström for kernel machines with geometric insight.
problem No comparative study over Nyström-based kernel machine approaches.
method Developed a new approach with geometric interpretation, showing equivalence to existing methods.
result Proposed approach offers insights into approximation errors and accuracy.
Common Representation Learning (CRL), wherein different descriptions (or views) of the data are embedded in a common subspace, is receiving a lot of attention recently. Two popular paradigms here are Canonical Correlation Analysis (CCA) based approaches and Autoencoder (AE) based approaches. CCA based approaches learn …
Two approaches detect EV charging patterns at stations.
problem Identify charging patterns at electric vehicle charging stations.
method Two approaches: rule-based and hierarchical clustering.
result Hierarchical clustering revealed unexpected charging patterns.
Survey on methods to learn graph data representations.
problem Designing optimal Neural Network architectures for arbitrary graphs.
method Review of graph kernel methods, convolutional approaches, graph neural networks, graph embedding, and probabilistic approaches.
result Discussion of various methods for learning graph data representations.
We review classical approaches to the problem of isometrically embedding a Riemannian surface into Euclidean 3-space, including coordinate-based approaches exposited by Darboux and Eisenhart, as well as the moving-frames based approaches advocated by Cartan. In particular, the first approach involves reducing the probl…
Proposes ACP for efficient inference in noisy-or models.
problem Efficient inference in noisy-or models.
method Hybrid approach combining classical and modern variational inference.
result ACP outperforms or matches other approaches in noisy-or models.
The floating body approach to affine surface area is adapted to a holomorphic context providing an alternate approach to Fefferman's invariant hypersurface measure.
Paper evaluates CNN-based facial landmark detection methods.
problem Evaluate characteristics and performance of CNN-based facial landmark detection methods.
method Divided into regression and heatmap approaches, investigated using a hybrid loss function and discrimination network.
result Proposed model outperforms other models in all tested datasets.
This paper provides a comprehensive benchmark and taxonomy for certifiably robust DNN defenses.
problem Certifiably robust defenses against adversarial attacks for deep neural networks.
method Taxonomy and benchmark of certifiably robust approaches.
result First comprehensive benchmark of certifiably robust approaches on different datasets.
Unified approach for Bayesian optimal experiment design using stochastic gradients.
problem Designing optimal experiments in high-dimensional settings.
method Stochastic gradient ascent to optimize variational lower bounds on expected information gain.
result Unified approach outperforms existing methods in higher dimensions.