Sporting events are extremely complex and require a multitude of metrics to accurate describe the event. When making multiple predictions, one should make them from a single source to keep consistency across the predictions. We present a multi-task learning method of generating multiple predictions for analysis via a s…
On-device research index
arXiv research
A locally-built, LLM-digested index of recent arXiv papers in quant finance, geometry/topology, and statistical ML — keyword search served straight from SQLite on this machine.
168,695 papers · 148 categories
Trend · papers per month
48 results for “Utility Prediction”
Neural networks approximate random utility models for choice prediction.
problem Approximating random utility models with neural networks.
method RUMnets, a neural network-based model inspired by RUM framework.
result RUMnets can approximate any RUM model arbitrarily closely and vice versa.
Paper uses ML to predict utility in APS dialogue outcomes.
problem Predict utility for different user subpopulations in APS.
method Develops EAI and EDS ML methods to predict utility functions.
result EDS more effective at predicting utility functions.
Assessing the predictive accuracy of black box classifiers is challenging in the absence of labeled test datasets. In these scenarios we may need to rely on a human oracle to evaluate individual predictions; presenting the challenge to create query algorithms to guide the search for points that provide the most informa…
Healthcare data continues to flourish yet a relatively small portion, mostly structured, is being utilized effectively for predicting clinical outcomes. The rich subjective information available in unstructured clinical notes can possibly facilitate higher discrimination but tends to be under-utilized in mortality pred…
Study optimizes fairness in predictive models by balancing utility and separation.
problem Balancing fairness and utility in predictive models.
method Information-theoretic approach using conditional mutual information (CMI).
result Reduces separation violations while maintaining or improving utility.
New framework for evaluating multiclass classifier calibration.
problem Ensuring classifiers are well-calibrated for trustworthy predictions.
method Utility Calibration framework that measures calibration error relative to a utility function.
result Unified and robust interpretation of existing calibration metrics.
Study analyzes prediction market convergence and pricing mechanisms.
problem Understanding and optimizing prediction market performance and price formation.
method Introduces a multivariate utility (MU) based mechanism to unify market-making schemes and establish convergence results.
result The limiting price converges to the geometric mean of agent beliefs in exponential utility-based markets and to a weighted power mean in risk-measure-based markets.
In cases of uncertainty, a multi-class classifier preferably returns a set of candidate classes instead of predicting a single class label with little guarantee. More precisely, the classifier should strive for an optimal balance between the correctness (the true class is among the candidates) and the precision (the ca…
Models use embeddings and attention for better claim severity prediction.
problem Improving predictive modeling of claim severity with categorical data.
method Developed neural networks and attention-based architectures with embeddings.
result Attention-based models enhance predictive performance with contextual augmentation.
The Kelly Criterion is applied to prediction markets to analyze risk and return.
problem Mean beliefs in prediction markets often differ from actual prices.
method Logarithmic utility and Kullback-Leibler divergence are used to study risk and return adjustments.
result Misjudgment of bias and investment fraction affect portfolio growth rate.
Prediction markets show considerable promise for developing flexible mechanisms for machine learning. Here, machine learning markets for multivariate systems are defined, and a utility-based framework is established for their analysis. This differs from the usual approach of defining static betting functions. It is sho…
New method selects data points for better model performance.
problem Balancing input coverage and model utility in selective prediction.
method Study training dynamics to reject inputs with unstable predictions.
result State-of-the-art selective prediction performance achieved without model modifications.
Utility-Weighted Forecasting and Calibration for Risk-Adjusted Decisions under Trading Frictionsecon.EM
The paper optimizes forecasting for risk-adjusted decisions under trading frictions.
problem Optimizing forecasting accuracy for investment decisions in the presence of transaction costs.
method Develops a utility-weighted calibration criterion to minimize decision loss net of costs.
result Utility-weighted calibration reduces decision loss by over 30% and improves Sharpe ratio.
Develops optimal uncertainty quantification for risk-averse decision makers.
problem Quantifying prediction uncertainty for risk-sensitive domains.
method Decision-theoretic foundations connecting uncertainty quantification with risk-averse decision-making.
result Risk-Averse Calibration (RAC) algorithm provides optimal prediction sets for risk-averse decision makers.
Right Decisions from Wrong Predictions: A Mechanism Design Alternative to Individual Calibrationstat.ML
Proposes a compensation mechanism for improving individual forecast confidence.
problem Difficult to assess the quality of individual probabilistic forecasts and their utilities.
method Compensation mechanism based on fair bets and online learning.
result The proposed mechanism cannot be exploited and ensures forecasted utility matches actual utility.
RUMBoost combines RUMs and deep learning for better choice modelling.
problem Creating interpretable and robust discrete choice models.
method Gradient Boosted Regression Trees for utility functions, with constraints for interpretability and monotonicity.
result RUMBoost outperforms ML and RUM benchmarks in predictive performance and interpretability.
Proposes a method to infer the distributional impacts of predictive models on stakeholders.
problem The influence of predictive models on target variable distribution, leading to performative prediction.
method Modeling agents' responses as a cost-adjusted utility maximization problem and using optimal transport to align pre- and post-model distributions.
result Provides estimates for the cost associated with these responses and demonstrates the quality of these estimates.
Develops optimal decision-making framework for uncertain counterfactuals.
problem Ensuring reliability of predictions in high-stakes decisions.
method Policy-Coupled Risk-Averse Conformal Prediction (PC-RACP).
result Optimal prediction sets for counterfactual decisions with valid coverage.
Elicitation without Backpropagation: Steering Model Behavior by Optimizing the Latent Posteriorcs.LG
PPT optimizes transformer behavior by steering its latent posterior using prior samples.
problem Eliciting desired behavior from transformers without backpropagation.
method Posterior Prefix Tuning (PPT) uses predictive Monte Carlo (PMC) samples and importance sampling to optimize the latent posterior.
result PPT optimizes transformer behavior without backpropagation, achieving high utility across different utility functions.
Understanding Fairness and Prediction Error through Subspace Decomposition and Influence Analysisstat.ML
The paper proposes a method to balance fairness and prediction accuracy by adjusting data representations.
problem Machine learning models can inherit and amplify historical biases, leading to unfair outcomes.
method The paper uses subspace decomposition and influence analysis to control the fairness-utility trade-off.
result The method effectively improves fairness while preserving predictive performance.
New PFPPs based on rank-dependent utility for better performance control.
problem Improving performance prediction in systems with short-term control.
method Introduces rank-dependent PFPPs, solves integral equations via Volterra theory.
result Existence of rank-dependent PFPPs under specific market conditions.
ICP improves prediction intervals for continuous outcomes at lower computational cost.
problem Systematic bias in point predictions that undermines their use in decision-making.
method Develops Isotonic Conformal Prediction (ICP) framework to decouple calibration from prediction-set construction.
result SICP and TICP procedures match SC-CP coverage at lower computational cost.
In this paper we derive the exact solution of the multi-period portfolio choice problem for an exponential utility function under return predictability. It is assumed that the asset returns depend on predictable variables and that the joint random process of the asset returns and the predictable variables follow a vect…
Torch-Struct simplifies structured prediction for deep learning.
problem Difficulty in integrating structured prediction algorithms with deep learning frameworks.
method Develops a library (Torch-Struct) that integrates structured prediction with vectorized, auto-differentiation-based frameworks.
result Significant performance gains over fast baselines and cross-algorithm efficiency.
Resource Allocation for a Wireless Coexistence Management System Based on Reinforcement Learningeess.SP
In industrial environments, an increasing amount of wireless devices are used, which utilize license-free bands. As a consequence of these mutual interferences of wireless systems might decrease the state of coexistence. Therefore, a central coexistence management system is needed, which allocates conflict-free resourc…
We develop a tractable model of realization utility that studies the role of reference-dependent S-shaped preferences in a dynamic investment setting with reinvestment. Our model generates both voluntarily realized gains and losses. It makes specific predictions about the volume of gains and losses, the holding periods…
This document describes the R package UBL that allows the use of several methods for handling utility-based learning problems. Classification and regression problems that assume non-uniform costs and/or benefits pose serious challenges to predictive analytic tasks. In the context of meteorology, finance, medicine, ecol…
Optimal portfolios are formed by combining momentum, size, and volatility characteristics, enhancing utility for all investors.
problem Estimation error in forming optimal portfolios from characteristics.
method Maximizing an in-sample loss function that is more concave than the utility function, linking weights to characteristics.
result Optimal portfolios with significantly higher certainty equivalents than benchmarks for all investors.
Paper introduces impact curves for evaluating binarized regression models with varying costs.
problem Evaluating binarized regression models with varying costs and instance-specific utility.
method Proposes impact curves to optimize binary decisions across different utilities.
result Impact curves identify conditions where one model is favored over another and quantify model improvement.
Deep convolutional neural networks for multi-scale time-series classification and application to disruption prediction in fusion devicesphysics.plasm-ph
The multi-scale, mutli-physics nature of fusion plasmas makes predicting plasma events challenging. Recent advances in deep convolutional neural network architectures (CNN) utilizing dilated convolutions enable accurate predictions on sequences which have long-range, multi-scale characteristics, such as the time-series…
Hybrid model improves wind speed prediction accuracy using MLP and WOA.
problem Improving wind speed prediction accuracy for renewable energy control.
method Combining MLP with Whale Optimization Algorithm (WOA) for data preprocessing and model optimization.
result The hybrid MLP-WOA model outperformed standalone MLP model in wind speed prediction accuracy.
Gambles are random variables that model possible changes in monetary wealth. Classic decision theory transforms money into utility through a utility function and defines the value of a gamble as the expectation value of utility changes. Utility functions aim to capture individual psychological characteristics, but thei…
New private learning algorithms improve utility in tasks with public features.
problem Private learning with public features in recommendation and ad prediction.
method Developed algorithms that protect only certain sufficient statistics, improving utility for linear regression and private recommendation benchmarks.
result Achieved state-of-the-art performance on private recommendation benchmarks.
Consequential decisions are increasingly informed by sophisticated data-driven predictive models. However, to consistently learn accurate predictive models, one needs access to ground truth labels. Unfortunately, in practice, labels may only exist conditional on certain decisions---if a loan is denied, there is not eve…
Enhances crypto-asset AMM with deep learning for better liquidity and efficiency.
problem Reduced slippage and improved liquidity in decentralized finance.
method Deep reinforcement learning for predicting market equilibrium and optimizing liquidity.
result Improved capital efficiency and reduced slippage for crypto-asset traders.
Recently, prediction markets have shown considerable promise for developing flexible mechanisms for machine learning. In this paper, agents with isoelastic utilities are considered. It is shown that the costs associated with homogeneous markets of agents with isoelastic utilities produce equilibrium prices correspondin…
Paper introduces MTGP for engineering tasks with sparse data.
problem Challenges of data sparsity and varying task correlations in engineering.
method Multi-Task Gaussian Processes (MTGP) framework.
result Improves predictive performance and reduces computational costs.
This paper predicts stock prices using LLMs and news embeddings.
problem Predicting stock prices with high accuracy and relevance.
method Integrates LLMs with stock name embeddings and attention mechanisms for news filtering.
result Reduces MAE by 7.11% compared to baseline.
Active learning reduces smart meter data needs for better electric load predictions.
problem Inaccurate and costly electric load predictions due to insufficient data.
method Active learning to collect more informative data subsets.
result Electric load predictions can be made with about half the data using active learning.
New algorithms improve MPBART for HIV patient data.
problem Improving inference for multinomial outcomes in HIV patient data.
method Introduced two new algorithms for fitting MPBART.
result Better performance in MCMC convergence and predictive accuracy.
This paper presents a novel data-driven approach for predicting the number of vegetation-related outages that occur in power distribution systems on a monthly basis. In order to develop an approach that is able to successfully fulfill this objective, there are two main challenges that ought to be addressed. The first c…
Model uses Preisach hysteresis to predict gig worker acceptance, reducing costs and improving fill rates.
problem Predicting and optimizing gig worker acceptance in labor markets.
method Preisach hysteresis model applied to neural network and XGBoost classifier for binary transaction outcomes.
result Model reduces total wage bill by 21.3% and increases expected fill rate by 9.7 pp.
Unique optimal strategy identified for state-dependent risk aversion.
problem Consistency of optimal portfolio choice for varying risk aversion.
method Analysis of state-dependent exponential utilities in arbitrage-free markets.
result Uniqueness of optimal strategy across any time horizon.
New method corrects bias in feature importance measures of GBM.
problem Bias in feature importance measures of GBM.
method Cross-validated unbiased base learners.
result Significant improvement in feature importance measures with minimal computational cost.
Photovoltaic systems have been widely deployed in recent times to meet the increased electricity demand as an environmental-friendly energy source. The major challenge for integrating photovoltaic systems in power systems is the unpredictability of the solar power generated. In this paper, we analyze the impact of havi…
Predicting absolute magnitude of fluctuations of price, even if their sign remains unknown, is important for risk analysis and for option prices. In the present work, we display our predictions about absolute magnitude of daily fluctuations of the Dow Jones Industrials Average (DJIA), utilizing the original theory of c…
Study learns linear utility functions from comparisons, showing learnability gaps between passive and active learning.
problem Learn linear utility functions from pairwise comparison queries.
method Analyzes passive and active learning settings, considering noise-free and noisy query responses.
result Efficient learnability of linear utilities in passive learning, but not for utility parameters without strong assumptions.