A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
Proposes method for eliciting non-parametric joint priors using normalizing flows.
Develops a simulation-based method to translate expert knowledge into prior distributions for Bayesian models.
A method for eliciting expert beliefs using preferential questions and normalizing flows.
Providing accurate predictions is challenging for machine learning algorithms when the number of features is larger than the number of samples in the data. Prior knowledge can improve machine learning models by indicating relevant variables and parameter values. Yet, this prior knowledge is often tacit and only availab…
PPT optimizes transformer behavior by steering its latent posterior using prior samples.
Improves AI-prior reliability for Bayesian inference.
AutoElicit uses LLMs to quickly create expert priors for predictive models.
Learning predictive models from small high-dimensional data sets is a key problem in high-dimensional statistics. Expert knowledge elicitation can help, and a strong line of work focuses on directly eliciting informative prior distributions for parameters. This either requires considerable statistical expertise or is l…
Informative Bayesian priors are often difficult to elicit, and when this is the case, modelers usually turn to noninformative or objective priors. However, objective priors such as the Jeffreys and reference priors are not tractable to derive for many models of interest. We address this issue by proposing techniques fo…
A good clustering can help a data analyst to explore and understand a data set, but what constitutes a good clustering may depend on domain-specific and application-specific criteria. These criteria can be difficult to formalize, even when it is easy for an analyst to know a good clustering when they see one. We presen…
A good clustering can help a data analyst to explore and understand a data set, but what constitutes a good clustering may depend on domain-specific and application-specific criteria. These criteria can be difficult to formalize, even when it is easy for an analyst to know a good clustering when she sees one. We presen…
The paper introduces a method to incorporate expert opinion on observable quantities into statistical models.
This paper develops a new method for eliciting more flexible metrics, improving fairness and applicability.
Constructs new elicitable risk measures with multiplicative scoring functions.
In multi-objective decision planning and learning, much attention is paid to producing optimal solution sets that contain an optimal policy for every possible user preference profile. We argue that the step that follows, i.e, determining which policy to execute by maximising the user's intrinsic utility function over t…
A property, or statistical functional, is said to be elicitable if it minimizes expected loss for some loss function. The study of which properties are elicitable sheds light on the capabilities and limitations of point estimation and empirical risk minimization. While recent work asks which properties are elicitable, …
Proposes a method to select fair performance metrics through metric elicitation.
We discuss equivalent axiomatic characterizations of distortion risk measures, and give a novel and concise proof of the characterization of elicitable distortion risk measures. Elicitability has recently been discussed as a desirable criterion for risk measures, motivated by statistical considerations of forecasting. …
Robustifies elicitable functionals to handle small distribution misspecifications.
Study generalizes property elicitation to imprecise probabilities.
A statistical functional, such as the mean or the median, is called elicitable if there is a scoring function or loss function such that the correct forecast of the functional is the unique minimizer of the expected score. Such scoring functions are called strictly consistent for the functional. The elicitability of a …
Study creates web interface to elicit user-preferred metrics.
It is important to collect credible training samples for building data-intensive learning systems (e.g., a deep learning system). Asking people to report complex distribution , though theoretically viable, is challenging in practice. This is primarily due to the cognitive loads required for human agents t…
Given a binary prediction problem, which performance metric should the classifier optimize? We address this question by formalizing the problem of Metric Elicitation. The goal of metric elicitation is to discover the performance metric of a practitioner, which reflects her innate rewards (costs) for correct (incorrect)…
The paper analyzes elicitability of return risk measures and their scoring functions.
This thesis formalizes metric selection for machine learning applications.
Model uses LLMs to process numerical data guided by natural language descriptions.
The risk of a financial position is usually summarized by a risk measure. As this risk measure has to be estimated from historical data, it is important to be able to verify and compare competing estimation procedures. In statistical decision theory, risk measures for which such verification and comparison is possible,…
Method combines deep learning and elicitability for solving complex stochastic equations.
Paper establishes identifiability and elicitability of tail risk measures.
In this note, we comment on the relevance of elicitability for backtesting risk measure estimates. In particular, we propose the use of Diebold-Mariano tests, and show how they can be implemented for Expected Shortfall (ES), based on the recent result of Fissler and Ziegel (2015) that ES is jointly elicitable with Valu…
In this paper, we derive a Bayesian model order selection rule by using the exponentially embedded family method, termed Bayesian EEF. Unlike many other Bayesian model selection methods, the Bayesian EEF can use vague proper priors and improper noninformative priors to be objective in the elicitation of parameter prior…
We consider settings in which the right notion of fairness is not captured by simple mathematical definitions (such as equality of error rates across groups), but might be more complex and nuanced and thus require elicitation from individual or collective stakeholders. We introduce a framework in which pairs of individ…
New algorithm achieves faster multicalibration in online settings.
High-dimensional prediction is a challenging problem setting for traditional statistical models. Although regularization improves model performance in high dimensions, it does not sufficiently leverage knowledge on feature importances held by domain experts. As an alternative to standard regularization techniques, we p…
We generalise the problem of inverse reinforcement learning to multiple tasks, from multiple demonstrations. Each one may represent one expert trying to solve a different task, or as different experts trying to solve the same task. Our main contribution is to formalise the problem as statistical preference elicitation,…
Framework uses IRL and RL to elicit and optimize risk preferences robustly to noise.
New method allows backtesting of systemic risk forecasts.
We propose a cost-effective framework for preference elicitation and aggregation under the Plackett-Luce model with features. Given a budget, our framework iteratively computes the most cost-effective elicitation questions in order to help the agents make a better group decision. We illustrate the viability of the fram…
Formulates a Dueling Bandits problem for eliciting Kemeny rankings.
Paper proposes incentives for federated learning to ensure truthful contributions.
A framework for eliciting utility functions from investor preferences.
FMP sampling improves model calibration without sharing data.
This work tackles the challenge of Bayesian deep learning by proposing a new framework for matching Gaussian process priors with neural network parameters.
Requirements elicitation can be very challenging in projects that require deep domain knowledge about the system at hand. As analysts have the full control over the elicitation process, their lack of knowledge about the system under study inhibits them from asking related questions and reduces the accuracy of requireme…
Improves feature selection in high-dimensional data using LLM-generated weights.
Adaptive querying learns user psychometrics with AI personas.
Study uses property elicitation to understand how fairness regularizers affect optimal decisions.